[ 1279.175117] sd 0:0:1:1: task abort: SUCCESS scmd(ffff99512626abc0) [ 1279.182085] sd 0:0:1:1: attempting task abort! scmd(ffff99512626aa00) [ 1279.189301] sd 0:0:1:1: [sdi] tag#96 CDB: Write(16) 8a 00 00 00 00 00 02 a8 01 90 00 00 00 08 00 00 [ 1279.199423] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 1279.208168] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 1279.367751] sd 0:0:1:1: task abort: SUCCESS scmd(ffff99512626aa00) [ 1279.374697] sd 0:0:1:1: attempting task abort! scmd(ffff99512626a840) [ 1279.381918] sd 0:0:1:1: [sdi] tag#95 CDB: Write(16) 8a 00 00 00 00 00 02 a8 01 70 00 00 00 08 00 00 [ 1279.392037] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 1279.400779] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 1279.433783] sd 0:0:1:1: task abort: SUCCESS scmd(ffff99512626a840) [ 1279.440727] sd 0:0:1:1: attempting task abort! scmd(ffff99512626a680) [ 1279.447924] sd 0:0:1:1: [sdi] tag#94 CDB: Write(16) 8a 00 00 00 00 00 02 a8 01 50 00 00 00 10 00 00 [ 1279.458045] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 1279.466789] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 1279.580647] sd 0:0:1:1: task abort: SUCCESS scmd(ffff99512626a680) [ 1279.587585] sd 0:0:1:1: attempting task abort! scmd(ffff99512626a4c0) [ 1279.594796] sd 0:0:1:1: [sdi] tag#93 CDB: Write(16) 8a 00 00 00 00 00 02 a8 01 38 00 00 00 10 00 00 [ 1279.604920] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 1279.613664] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 1279.638322] sd 0:0:1:1: task abort: SUCCESS scmd(ffff99512626a4c0) [ 1279.645281] sd 0:0:1:1: attempting task abort! scmd(ffff99512626a300) [ 1279.652500] sd 0:0:1:1: [sdi] tag#92 CDB: Write(16) 8a 00 00 00 00 00 02 a8 01 28 00 00 00 08 00 00 [ 1279.662624] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 1279.671369] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 1279.683834] sd 0:0:1:1: task abort: SUCCESS scmd(ffff99512626a300) [ 1279.690769] sd 0:0:1:1: attempting task abort! scmd(ffff99512626a140) [ 1279.698003] sd 0:0:1:1: [sdi] tag#91 CDB: Write(16) 8a 00 00 00 00 00 02 a8 01 10 00 00 00 08 00 00 [ 1279.708119] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 1279.716860] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 1279.734138] sd 0:0:1:1: task abort: SUCCESS scmd(ffff99512626a140) [ 1279.741099] sd 0:0:1:1: attempting task abort! scmd(ffff995126269f80) [ 1279.748299] sd 0:0:1:1: [sdi] tag#90 CDB: Write(16) 8a 00 00 00 00 00 02 a8 00 d8 00 00 00 10 00 00 [ 1279.758412] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 1279.767154] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 1279.775418] sd 0:0:1:1: task abort: SUCCESS scmd(ffff995126269f80) [ 1988.110793] LNetError: 4841:0:(o2iblnd_cb.c:3348:kiblnd_check_txs_locked()) Timed out tx: active_txs, 0 seconds [ 1988.122070] LNetError: 4841:0:(o2iblnd_cb.c:3423:kiblnd_check_conns()) Timed out RDMA with 192.168.1.110@o2ib (9): c: 0, oc: 0, rc: 8 [ 1989.110766] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 1 seconds [ 1991.110591] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 1 seconds [ 1993.110432] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 3 seconds [ 1993.121802] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 9 previous similar messages [ 1993.150600] LNetError: 6717:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.110@o2ib) recovery failed with -113 [ 1996.110331] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 6 seconds [ 1996.121696] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 15 previous similar messages [ 1996.132303] Lustre: 4855:0:(client.c:2229:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1588127350/real 1588127362] req@ffff994d256f1b00 x1665270378846144/t0(0) o41->soaked-MDT0002-osp-MDT0000@192.168.1.110@o2ib:24/4 lens 224/368 e 0 to 1 dl 1588127402 ref 1 fl Rpc:eXQr/0/ffffffff rc 0/-1 job:'' [ 1996.165453] Lustre: soaked-MDT0002-osp-MDT0000: Connection to soaked-MDT0002 (at 192.168.1.110@o2ib) was lost; in progress operations using this service will wait for recovery to complete [ 1997.110370] Lustre: 7875:0:(client.c:2229:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1588127352/real 1588127362] req@ffff99513abf2880 x1665270378926400/t0(0) o101->soaked-MDT0002-osp-MDT0000@192.168.1.110@o2ib:24/4 lens 328/344 e 0 to 1 dl 1588127404 ref 2 fl Rpc:eXQr/0/ffffffff rc 0/-1 job:'' [ 1997.143674] Lustre: 7875:0:(client.c:2229:ptlrpc_expire_one_request()) Skipped 4 previous similar messages [ 1998.110267] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.110@o2ib) recovery failed with -110 [ 1998.123516] Lustre: 4867:0:(client.c:2229:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1588127353/real 1588127363] req@ffff994d28929680 x1665270378927744/t0(0) o103->soaked-MDT0002-osp-MDT0000@192.168.1.110@o2ib:17/18 lens 328/224 e 0 to 1 dl 1588127366 ref 1 fl Rpc:eXQr/0/ffffffff rc 0/-1 job:'' [ 1998.156803] Lustre: 4867:0:(client.c:2229:ptlrpc_expire_one_request()) Skipped 6 previous similar messages [ 2001.110009] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 9 seconds [ 2001.121382] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 29 previous similar messages [ 2003.161841] LNetError: 7369:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.110@o2ib) recovery failed with -113 [ 2009.133462] LNetError: 6717:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.110@o2ib) recovery failed with -113 [ 2011.109341] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 1 seconds [ 2011.120713] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 1 previous similar message [ 2015.109102] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.110@o2ib) recovery failed with -110 [ 2015.122326] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 3 previous similar messages [ 2026.108372] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.110@o2ib) recovery failed with -110 [ 2026.121610] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 4 previous similar messages [ 2028.108223] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 2 seconds [ 2028.119589] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 7 previous similar messages [ 2044.107186] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.110@o2ib) recovery failed with -110 [ 2044.120413] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 7 previous similar messages [ 2073.105333] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 0 seconds [ 2073.116700] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 8 previous similar messages [ 2079.104978] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.110@o2ib) recovery failed with -110 [ 2079.118195] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 8 previous similar messages [ 2144.116758] LNetError: 6717:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.110@o2ib) recovery failed with -113 [ 2144.129987] LNetError: 6717:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 14 previous similar messages [ 2150.100341] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 0 seconds [ 2150.111713] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 9 previous similar messages [ 2166.083297] Lustre: mdt00_004: service thread pid 5125 was inactive for 200.654 seconds. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes: [ 2166.083300] Pid: 7360, comm: mdt00_019 3.10.0-1062.9.1.el7_lustre.x86_64 #1 SMP Tue Feb 11 19:11:56 UTC 2020 [ 2166.083304] Call Trace: [ 2166.083407] [] ptlrpc_set_wait+0x4c9/0x7c0 [ptlrpc] [ 2166.083469] [] ptlrpc_queue_wait+0x83/0x230 [ptlrpc] [ 2166.083473] Lustre: mdt01_024: service thread pid 7876 was inactive for 200.641 seconds. Watchdog stack traces are limited to 3 per 300 seconds, skipping this one. [ 2166.083531] [] ldlm_cli_enqueue+0x402/0xa20 [ptlrpc] [ 2166.083548] [] osp_md_object_lock+0x162/0x2d0 [osp] [ 2166.083572] [] lod_object_lock+0x770/0x780 [lod] [ 2166.083592] [] mdd_object_lock+0x3b/0xd0 [mdd] [ 2166.083623] [] mdt_reint_striped_lock+0x390/0x5f0 [mdt] [ 2166.083645] [] mdt_reint_unlink+0x734/0x14b0 [mdt] [ 2166.083668] [] mdt_reint_rec+0x83/0x210 [mdt] [ 2166.083687] [] mdt_reint_internal+0x7b0/0xba0 [mdt] [ 2166.083708] [] mdt_reint+0x67/0x140 [mdt] [ 2166.083790] [] tgt_request_handle+0x95a/0x1630 [ptlrpc] [ 2166.083858] [] ptlrpc_server_handle_request+0x256/0xb10 [ptlrpc] [ 2166.083922] [] ptlrpc_main+0xbb4/0x1550 [ptlrpc] [ 2166.083929] [] kthread+0xd1/0xe0 [ 2166.083935] [] ret_from_fork_nospec_end+0x0/0x39 [ 2166.083967] [] 0xffffffffffffffff [ 2166.083971] Pid: 4915, comm: mdt01_000 3.10.0-1062.9.1.el7_lustre.x86_64 #1 SMP Tue Feb 11 19:11:56 UTC 2020 [ 2166.083972] Call Trace: [ 2166.084094] [] ldlm_completion_ast+0x75f/0x9b0 [ptlrpc] [ 2166.084151] [] ldlm_cli_enqueue_fini+0x9d0/0xe40 [ptlrpc] [ 2166.084207] [] ldlm_cli_enqueue+0x441/0xa20 [ptlrpc] [ 2166.084228] [] osp_md_object_lock+0x162/0x2d0 [osp] [ 2166.084273] [] lod_object_lock+0xf1/0x780 [lod] [ 2166.084299] [] mdd_object_lock+0x3b/0xd0 [mdd] [ 2166.084332] [] mdt_remote_object_lock_try+0x1e4/0x530 [mdt] [ 2166.084353] [] mdt_object_lock_internal+0x18c/0x3f0 [mdt] [ 2166.084373] [] mdt_reint_object_lock+0x2c/0x60 [mdt] [ 2166.084398] [] mdt_reint_unlink+0x1e7/0x14b0 [mdt] [ 2166.084421] [] mdt_reint_rec+0x83/0x210 [mdt] [ 2166.084440] [] mdt_reint_internal+0x7b0/0xba0 [mdt] [ 2166.084460] [] mdt_reint+0x67/0x140 [mdt] [ 2166.084550] [] tgt_request_handle+0x95a/0x1630 [ptlrpc] [ 2166.084618] [] ptlrpc_server_handle_request+0x256/0xb10 [ptlrpc] [ 2166.084683] [] ptlrpc_main+0xbb4/0x1550 [ptlrpc] [ 2166.084691] [] kthread+0xd1/0xe0 [ 2166.084698] [] ret_from_fork_nospec_end+0x0/0x39 [ 2166.084735] [] 0xffffffffffffffff [ 2166.403397] Lustre: Skipped 2 previous similar messages [ 2166.409242] Pid: 5125, comm: mdt00_004 3.10.0-1062.9.1.el7_lustre.x86_64 #1 SMP Tue Feb 11 19:11:56 UTC 2020 [ 2166.420214] Call Trace: [ 2166.422984] [] ldlm_completion_ast+0x75f/0x9b0 [ptlrpc] [ 2166.430718] [] ldlm_cli_enqueue_fini+0x9d0/0xe40 [ptlrpc] [ 2166.438629] [] ldlm_cli_enqueue+0x441/0xa20 [ptlrpc] [ 2166.446052] [] osp_md_object_lock+0x162/0x2d0 [osp] [ 2166.453367] [] lod_object_lock+0xf1/0x780 [lod] [ 2166.460298] [] mdd_object_lock+0x3b/0xd0 [mdd] [ 2166.467122] [] mdt_remote_object_lock_try+0x1e4/0x530 [mdt] [ 2166.475216] [] mdt_object_lock_internal+0x18c/0x3f0 [mdt] [ 2166.483104] [] mdt_reint_object_lock+0x2c/0x60 [mdt] [ 2166.490509] [] mdt_reint_unlink+0x1e7/0x14b0 [mdt] [ 2166.497724] [] mdt_reint_rec+0x83/0x210 [mdt] [ 2166.504450] [] mdt_reint_internal+0x7b0/0xba0 [mdt] [ 2166.511757] [] mdt_reint+0x67/0x140 [mdt] [ 2166.518096] [] tgt_request_handle+0x95a/0x1630 [ptlrpc] [ 2166.525817] [] ptlrpc_server_handle_request+0x256/0xb10 [ptlrpc] [ 2166.534413] [] ptlrpc_main+0xbb4/0x1550 [ptlrpc] [ 2166.541449] [] kthread+0xd1/0xe0 [ 2166.546905] [] ret_from_fork_nospec_end+0x0/0x39 [ 2166.553904] [] 0xffffffffffffffff [ 2167.107231] Lustre: mdt00_008: service thread pid 5199 was inactive for 200.000 seconds. Watchdog stack traces are limited to 3 per 300 seconds, skipping this one. [ 2167.123553] Lustre: Skipped 2 previous similar messages [ 2177.346590] Lustre: mdt01_022: service thread pid 7365 was inactive for 200.434 seconds. Watchdog stack traces are limited to 3 per 300 seconds, skipping this one. [ 2177.362928] Lustre: Skipped 4 previous similar messages [ 2186.561970] Lustre: mdt01_009: service thread pid 5198 was inactive for 200.029 seconds. Watchdog stack traces are limited to 3 per 300 seconds, skipping this one. [ 2186.578290] Lustre: Skipped 5 previous similar messages [ 2191.306437] Lustre: MGS: haven't heard from client 2277e637-d852-4 (at 192.168.1.110@o2ib) in 227 seconds. I think it's dead, and I am evicting it. exp ffff994d6d959000, cur 1588127557 expire 1588127407 last 1588127330 [ 2205.708626] Lustre: soaked-MDT0000: haven't heard from client soaked-MDT0002-mdtlov_UUID (at 192.168.1.110@o2ib) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9949e900dc00, cur 1588127571 expire 1588127421 last 1588127344 [ 2245.079630] Lustre: soaked-MDT0000: Connection restored to 192.168.1.111@o2ib (at 192.168.1.111@o2ib) [ 2245.089967] Lustre: Skipped 32 previous similar messages [ 2245.513933] Lustre: soaked-MDT0000: Received LWP connection from 192.168.1.111@o2ib, removing former export from 192.168.1.110@o2ib [ 2265.422880] Lustre: soaked-MDT0001-osp-MDT0000: Connection to soaked-MDT0001 (at 192.168.1.109@o2ib) was lost; in progress operations using this service will wait for recovery to complete [ 2265.441564] LustreError: 5125:0:(ldlm_request.c:143:ldlm_expired_completion_wait()) ### lock timed out (enqueued at 1588127331, 300s ago), entering recovery for soaked-MDT0001_UUID@192.168.1.109@o2ib ns: soaked-MDT0001-osp-MDT0000 lock: ffff994d2da31200/0x7f1e5ec50554a6d7 lrc: 4/0,1 mode: --/EX res: [0x2400105e7:0x4575:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x1000001000000 nid: local remote: 0xcfe18704975f2ee3 expref: -99 pid: 5125 timeout: 0 lvb_type: 0 [ 2265.487267] LustreError: 5125:0:(ldlm_request.c:143:ldlm_expired_completion_wait()) Skipped 2 previous similar messages [ 2265.521501] Lustre: soaked-MDT0001-osp-MDT0000: Connection restored to 192.168.1.109@o2ib (at 192.168.1.109@o2ib) [ 2265.533026] Lustre: Skipped 1 previous similar message [ 2267.068790] LustreError: 5196:0:(ldlm_request.c:143:ldlm_expired_completion_wait()) ### lock timed out (enqueued at 1588127332, 300s ago), entering recovery for soaked-MDT0001_UUID@192.168.1.109@o2ib ns: soaked-MDT0001-osp-MDT0000 lock: ffff99514a663f00/0x7f1e5ec50554ad05 lrc: 4/0,1 mode: --/EX res: [0x2400105e7:0x4575:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x1000001000000 nid: local remote: 0xcfe1870497624a43 expref: -99 pid: 5196 timeout: 0 lvb_type: 0 [ 2267.114507] LustreError: 5196:0:(ldlm_request.c:143:ldlm_expired_completion_wait()) Skipped 2 previous similar messages [ 2273.092405] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.110@o2ib) recovery failed with -110 [ 2273.105622] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 29 previous similar messages [ 2276.905173] LustreError: 7365:0:(ldlm_request.c:143:ldlm_expired_completion_wait()) ### lock timed out (enqueued at 1588127342, 300s ago), entering recovery for soaked-MDT0001_UUID@192.168.1.109@o2ib ns: soaked-MDT0001-osp-MDT0000 lock: ffff995163fa5c40/0x7f1e5ec50554b6ba lrc: 4/0,1 mode: --/EX res: [0x2400105e7:0x4575:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x1000001000000 nid: local remote: 0xcfe1870497715eae expref: -99 pid: 7365 timeout: 0 lvb_type: 0 [ 2276.950880] LustreError: 7365:0:(ldlm_request.c:143:ldlm_expired_completion_wait()) Skipped 3 previous similar messages [ 2280.092020] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 12 seconds [ 2280.103482] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 37 previous similar messages [ 2286.526508] LustreError: 7355:0:(ldlm_request.c:143:ldlm_expired_completion_wait()) ### lock timed out (enqueued at 1588127352, 300s ago), entering recovery for soaked-MDT0001_UUID@192.168.1.109@o2ib ns: soaked-MDT0001-osp-MDT0000 lock: ffff995163fa0fc0/0x7f1e5ec50554f0dc lrc: 4/0,1 mode: --/EX res: [0x2400105e7:0x4575:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x1000001000000 nid: local remote: 0xcfe18704977fa388 expref: -99 pid: 7355 timeout: 0 lvb_type: 0 [ 2286.572226] LustreError: 7355:0:(ldlm_request.c:143:ldlm_expired_completion_wait()) Skipped 1 previous similar message [ 2290.848276] Lustre: soaked-MDT0002-osp-MDT0000: Connection restored to 192.168.1.111@o2ib (at 192.168.1.111@o2ib) [ 2294.218131] LustreError: 11-0: soaked-MDT0002-osp-MDT0000: operation dt_index_read to node 192.168.1.111@o2ib failed: rc = -19 [ 2294.221086] Lustre: soaked-MDT0002-osp-MDT0000: Connection to soaked-MDT0002 (at 192.168.1.111@o2ib) was lost; in progress operations using this service will wait for recovery to complete [ 2294.249516] LustreError: Skipped 4 previous similar messages [ 2498.980792] Lustre: MGS: Connection restored to 2277e637-d852-4 (at 192.168.1.110@o2ib) [ 2594.129747] LustreError: 5198:0:(ldlm_request.c:143:ldlm_expired_completion_wait()) ### lock timed out (enqueued at 1588127660, 300s ago), entering recovery for soaked-MDT0002_UUID@192.168.1.110@o2ib ns: soaked-MDT0002-osp-MDT0000 lock: ffff99511e38bcc0/0x7f1e5ec505554c30 lrc: 4/0,1 mode: --/EX res: [0x28000e6a4:0x4575:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x1000001000000 nid: local remote: 0x1511b12dfd740982 expref: -99 pid: 5198 timeout: 0 lvb_type: 0 [ 2594.130636] Lustre: soaked-MDT0001-osp-MDT0000: Connection to soaked-MDT0001 (at 192.168.1.109@o2ib) was lost; in progress operations using this service will wait for recovery to complete [ 2594.144197] Lustre: soaked-MDT0001-osp-MDT0000: Connection restored to 192.168.1.109@o2ib (at 192.168.1.109@o2ib) [ 2594.144199] Lustre: Skipped 2 previous similar messages [ 2594.211331] LustreError: 5198:0:(ldlm_request.c:143:ldlm_expired_completion_wait()) Skipped 4 previous similar messages [ 2655.067702] LNetError: 4841:0:(o2iblnd_cb.c:3348:kiblnd_check_txs_locked()) Timed out tx: active_txs, 0 seconds [ 2655.078985] LNetError: 4841:0:(o2iblnd_cb.c:3423:kiblnd_check_conns()) Timed out RDMA with 192.168.1.107@o2ib (8): c: 3, oc: 0, rc: 8 [ 2656.067634] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.107@o2ib: 1 seconds [ 2656.078998] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 82 previous similar messages [ 2656.443609] Lustre: 4876:0:(client.c:2229:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1588128015/real 0] req@ffff9951617b2d00 x1665270379497216/t0(0) o13->soaked-OST000f-osc-MDT0000@192.168.1.107@o2ib:7/4 lens 224/368 e 0 to 1 dl 1588128022 ref 2 fl Rpc:Xr/0/ffffffff rc 0/-1 job:'' [ 2656.443661] Lustre: soaked-OST0003-osc-MDT0000: Connection to soaked-OST0003 (at 192.168.1.107@o2ib) was lost; in progress operations using this service will wait for recovery to complete [ 2656.443664] Lustre: soaked-OST000b-osc-MDT0000: Connection to soaked-OST000b (at 192.168.1.107@o2ib) was lost; in progress operations using this service will wait for recovery to complete [ 2656.443665] Lustre: Skipped 1 previous similar message [ 2656.443667] Lustre: Skipped 1 previous similar message [ 2656.524039] Lustre: 4876:0:(client.c:2229:ptlrpc_expire_one_request()) Skipped 8 previous similar messages [ 2660.067419] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.107@o2ib) recovery failed with -110 [ 2660.080645] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 75 previous similar messages [ 2698.340359] Lustre: soaked-MDT0002-osp-MDT0000: Connection restored to 192.168.1.110@o2ib (at 192.168.1.110@o2ib) [ 2698.351843] Lustre: Skipped 1 previous similar message [ 2873.987838] Lustre: soaked-MDT0000: haven't heard from client soaked-MDT0000-lwp-OST000b_UUID (at 192.168.1.107@o2ib) in 227 seconds. I think it's dead, and I am evicting it. exp ffff994d54f9c800, cur 1588128239 expire 1588128089 last 1588128012 [ 3010.175563] Lustre: MGS: Connection restored to soaked-MDT0000-lwp-OST0007_UUID (at 192.168.1.107@o2ib) [ 3038.156179] LustreError: 5733:0:(out_handler.c:918:out_tx_end()) soaked-MDT0000-osd: undo for /tmp/rpmbuild-lustre-jenkins-UoS8uXZU/BUILD/lustre-2.13.53_18_g6706bfa/lustre/ptlrpc/../../lustre/target/out_handler.c:453: rc = -524 [ 3038.660006] LustreError: 5733:0:(out_handler.c:918:out_tx_end()) soaked-MDT0000-osd: undo for /tmp/rpmbuild-lustre-jenkins-UoS8uXZU/BUILD/lustre-2.13.53_18_g6706bfa/lustre/ptlrpc/../../lustre/target/out_handler.c:453: rc = -524 [ 3038.682569] LustreError: 5733:0:(out_handler.c:918:out_tx_end()) Skipped 71 previous similar messages [ 3039.784516] LustreError: 5185:0:(out_handler.c:918:out_tx_end()) soaked-MDT0000-osd: undo for /tmp/rpmbuild-lustre-jenkins-UoS8uXZU/BUILD/lustre-2.13.53_18_g6706bfa/lustre/ptlrpc/../../lustre/target/out_handler.c:453: rc = -524 [ 3039.807084] LustreError: 5185:0:(out_handler.c:918:out_tx_end()) Skipped 55 previous similar messages [ 3041.858108] LustreError: 5728:0:(out_handler.c:918:out_tx_end()) soaked-MDT0000-osd: undo for /tmp/rpmbuild-lustre-jenkins-UoS8uXZU/BUILD/lustre-2.13.53_18_g6706bfa/lustre/ptlrpc/../../lustre/target/out_handler.c:453: rc = -524 [ 3041.880674] LustreError: 5728:0:(out_handler.c:918:out_tx_end()) Skipped 271 previous similar messages [ 3045.938798] LustreError: 5186:0:(out_handler.c:918:out_tx_end()) soaked-MDT0000-osd: undo for /tmp/rpmbuild-lustre-jenkins-UoS8uXZU/BUILD/lustre-2.13.53_18_g6706bfa/lustre/ptlrpc/../../lustre/target/out_handler.c:453: rc = -524 [ 3045.961327] LustreError: 5186:0:(out_handler.c:918:out_tx_end()) Skipped 239 previous similar messages [ 3058.122908] LustreError: 5728:0:(out_handler.c:918:out_tx_end()) soaked-MDT0000-osd: undo for /tmp/rpmbuild-lustre-jenkins-UoS8uXZU/BUILD/lustre-2.13.53_18_g6706bfa/lustre/ptlrpc/../../lustre/target/out_handler.c:453: rc = -524 [ 3058.145458] LustreError: 5728:0:(out_handler.c:918:out_tx_end()) Skipped 619 previous similar messages [ 3074.248022] LustreError: 5727:0:(out_handler.c:918:out_tx_end()) soaked-MDT0000-osd: undo for /tmp/rpmbuild-lustre-jenkins-UoS8uXZU/BUILD/lustre-2.13.53_18_g6706bfa/lustre/ptlrpc/../../lustre/target/out_handler.c:453: rc = -524 [ 3074.270563] LustreError: 5727:0:(out_handler.c:918:out_tx_end()) Skipped 1199 previous similar messages [ 3107.587048] LustreError: 5185:0:(out_handler.c:918:out_tx_end()) soaked-MDT0000-osd: undo for /tmp/rpmbuild-lustre-jenkins-UoS8uXZU/BUILD/lustre-2.13.53_18_g6706bfa/lustre/ptlrpc/../../lustre/target/out_handler.c:453: rc = -524 [ 3107.609592] LustreError: 5185:0:(out_handler.c:918:out_tx_end()) Skipped 191 previous similar messages [ 3179.573554] LustreError: 5726:0:(out_handler.c:918:out_tx_end()) soaked-MDT0000-osd: undo for /tmp/rpmbuild-lustre-jenkins-UoS8uXZU/BUILD/lustre-2.13.53_18_g6706bfa/lustre/ptlrpc/../../lustre/target/out_handler.c:453: rc = -524 [ 3179.596104] LustreError: 5726:0:(out_handler.c:918:out_tx_end()) Skipped 303 previous similar messages [ 3292.259101] LustreError: 4997:0:(llog_cat.c:756:llog_cat_cancel_arr_rec()) soaked-MDT0001-osp-MDT0000: fail to cancel 1 llog-records: rc = -2 [ 3292.273305] LustreError: 4997:0:(llog_cat.c:793:llog_cat_cancel_records()) soaked-MDT0001-osp-MDT0000: fail to cancel 1 of 1 llog-records: rc = -2 [ 3315.610220] LustreError: 5895:0:(out_handler.c:918:out_tx_end()) soaked-MDT0000-osd: undo for /tmp/rpmbuild-lustre-jenkins-UoS8uXZU/BUILD/lustre-2.13.53_18_g6706bfa/lustre/ptlrpc/../../lustre/target/out_handler.c:453: rc = -524 [ 3315.632778] LustreError: 5895:0:(out_handler.c:918:out_tx_end()) Skipped 435 previous similar messages [ 3316.075838] LustreError: 4997:0:(llog_cat.c:756:llog_cat_cancel_arr_rec()) soaked-MDT0001-osp-MDT0000: fail to cancel 1 llog-records: rc = -2 [ 3316.090037] LustreError: 4997:0:(llog_cat.c:756:llog_cat_cancel_arr_rec()) Skipped 22 previous similar messages [ 3316.101328] LustreError: 4997:0:(llog_cat.c:793:llog_cat_cancel_records()) soaked-MDT0001-osp-MDT0000: fail to cancel 1 of 1 llog-records: rc = -2 [ 3316.116010] LustreError: 4997:0:(llog_cat.c:793:llog_cat_cancel_records()) Skipped 22 previous similar messages [ 3322.334457] LustreError: 4997:0:(llog_cat.c:756:llog_cat_cancel_arr_rec()) soaked-MDT0001-osp-MDT0000: fail to cancel 1 llog-records: rc = -2 [ 3322.348671] LustreError: 4997:0:(llog_cat.c:756:llog_cat_cancel_arr_rec()) Skipped 12 previous similar messages [ 3322.359977] LustreError: 4997:0:(llog_cat.c:793:llog_cat_cancel_records()) soaked-MDT0001-osp-MDT0000: fail to cancel 1 of 1 llog-records: rc = -2 [ 3322.374655] LustreError: 4997:0:(llog_cat.c:793:llog_cat_cancel_records()) Skipped 12 previous similar messages [ 3327.086308] LustreError: 4997:0:(llog_cat.c:756:llog_cat_cancel_arr_rec()) soaked-MDT0001-osp-MDT0000: fail to cancel 1 llog-records: rc = -2 [ 3327.100502] LustreError: 4997:0:(llog_cat.c:756:llog_cat_cancel_arr_rec()) Skipped 46 previous similar messages [ 3327.111796] LustreError: 4997:0:(llog_cat.c:793:llog_cat_cancel_records()) soaked-MDT0001-osp-MDT0000: fail to cancel 1 of 1 llog-records: rc = -2 [ 3327.126459] LustreError: 4997:0:(llog_cat.c:793:llog_cat_cancel_records()) Skipped 46 previous similar messages [ 3335.449378] LustreError: 4997:0:(llog_cat.c:756:llog_cat_cancel_arr_rec()) soaked-MDT0001-osp-MDT0000: fail to cancel 1 llog-records: rc = -2 [ 3335.463594] LustreError: 4997:0:(llog_cat.c:756:llog_cat_cancel_arr_rec()) Skipped 51 previous similar messages [ 3335.474884] LustreError: 4997:0:(llog_cat.c:793:llog_cat_cancel_records()) soaked-MDT0001-osp-MDT0000: fail to cancel 1 of 1 llog-records: rc = -2 [ 3335.489560] LustreError: 4997:0:(llog_cat.c:793:llog_cat_cancel_records()) Skipped 51 previous similar messages [ 3347.557786] LustreError: 4997:0:(llog_cat.c:756:llog_cat_cancel_arr_rec()) soaked-MDT0001-osp-MDT0000: fail to cancel 1 llog-records: rc = -2 [ 3347.572010] LustreError: 4997:0:(llog_cat.c:756:llog_cat_cancel_arr_rec()) Skipped 108 previous similar messages [ 3347.583396] LustreError: 4997:0:(llog_cat.c:793:llog_cat_cancel_records()) soaked-MDT0001-osp-MDT0000: fail to cancel 1 of 1 llog-records: rc = -2 [ 3347.598073] LustreError: 4997:0:(llog_cat.c:793:llog_cat_cancel_records()) Skipped 108 previous similar messages [ 3364.338653] LustreError: 4997:0:(llog_cat.c:756:llog_cat_cancel_arr_rec()) soaked-MDT0001-osp-MDT0000: fail to cancel 1 llog-records: rc = -2 [ 3364.352865] LustreError: 4997:0:(llog_cat.c:756:llog_cat_cancel_arr_rec()) Skipped 89 previous similar messages [ 3364.364148] LustreError: 4997:0:(llog_cat.c:793:llog_cat_cancel_records()) soaked-MDT0001-osp-MDT0000: fail to cancel 1 of 1 llog-records: rc = -2 [ 3364.378831] LustreError: 4997:0:(llog_cat.c:793:llog_cat_cancel_records()) Skipped 89 previous similar messages [ 3895.997707] Lustre: 5140:0:(mdd_device.c:1825:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1 [ 4470.950344] LNetError: 4841:0:(o2iblnd_cb.c:3348:kiblnd_check_txs_locked()) Timed out tx: active_txs, 0 seconds [ 4470.961632] LNetError: 4841:0:(o2iblnd_cb.c:3423:kiblnd_check_conns()) Timed out RDMA with 192.168.1.102@o2ib (8): c: 0, oc: 0, rc: 8 [ 4472.078324] Lustre: 4866:0:(client.c:2229:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1588129831/real 0] req@ffff994d1cb43a80 x1665270420266048/t0(0) o6->soaked-OST000a-osc-MDT0000@192.168.1.102@o2ib:28/4 lens 544/432 e 0 to 1 dl 1588129838 ref 2 fl Rpc:Xr/0/ffffffff rc 0/-1 job:'' [ 4472.086287] Lustre: soaked-OST0002-osc-MDT0000: Connection to soaked-OST0002 (at 192.168.1.102@o2ib) was lost; in progress operations using this service will wait for recovery to complete [ 4472.086289] Lustre: Skipped 2 previous similar messages [ 4472.134486] Lustre: 4866:0:(client.c:2229:ptlrpc_expire_one_request()) Skipped 1 previous similar message [ 4472.598238] Lustre: 4861:0:(client.c:2229:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1588129831/real 0] req@ffff994d1de51680 x1665270420265664/t0(0) o6->soaked-OST0002-osc-MDT0000@192.168.1.102@o2ib:28/4 lens 544/432 e 0 to 1 dl 1588129838 ref 2 fl Rpc:Xr/0/ffffffff rc 0/-1 job:'' [ 4472.629881] Lustre: 4861:0:(client.c:2229:ptlrpc_expire_one_request()) Skipped 3 previous similar messages [ 4472.950282] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.102@o2ib: 2 seconds [ 4472.961645] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 115 previous similar messages [ 4473.238259] Lustre: soaked-OST0006-osc-MDT0000: Connection to soaked-OST0006 (at 192.168.1.102@o2ib) was lost; in progress operations using this service will wait for recovery to complete [ 4473.256913] Lustre: Skipped 2 previous similar messages [ 4474.230216] Lustre: 4874:0:(client.c:2229:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1588129833/real 0] req@ffff9951516a9200 x1665270420267712/t0(0) o13->soaked-OST0002-osc-MDT0000@192.168.1.102@o2ib:7/4 lens 224/368 e 0 to 1 dl 1588129840 ref 2 fl Rpc:Xr/0/ffffffff rc 0/-1 job:'' [ 4474.261886] Lustre: 4874:0:(client.c:2229:ptlrpc_expire_one_request()) Skipped 11 previous similar messages [ 4474.950191] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.102@o2ib) recovery failed with -110 [ 4474.963420] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 88 previous similar messages [ 4478.402881] Lustre: 4879:0:(client.c:2229:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1588129837/real 0] req@ffff995122220d80 x1665270420271040/t0(0) o6->soaked-OST0006-osc-MDT0000@192.168.1.102@o2ib:28/4 lens 544/432 e 0 to 1 dl 1588129844 ref 2 fl Rpc:Xr/0/ffffffff rc 0/-1 job:'' [ 4478.434537] Lustre: 4879:0:(client.c:2229:ptlrpc_expire_one_request()) Skipped 2 previous similar messages [ 4538.953950] LNetError: 11738:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.102@o2ib) recovery failed with -113 [ 4538.967296] LNetError: 11738:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 13 previous similar messages [ 4544.945586] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.102@o2ib: 0 seconds [ 4544.956959] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 74 previous similar messages [ 4667.937603] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.102@o2ib) recovery failed with -110 [ 4667.950848] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 34 previous similar messages [ 4672.980742] Lustre: soaked-MDT0000: haven't heard from client soaked-MDT0000-lwp-OST000a_UUID (at 192.168.1.102@o2ib) in 228 seconds. I think it's dead, and I am evicting it. exp ffff994d2ecb9800, cur 1588130039 expire 1588129889 last 1588129811 [ 4673.005063] Lustre: Skipped 4 previous similar messages [ 4674.937150] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.102@o2ib: 1 seconds [ 4674.948530] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 42 previous similar messages [ 4924.921129] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.102@o2ib) recovery failed with -110 [ 4924.934368] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 69 previous similar messages [ 4931.920586] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.102@o2ib: 0 seconds [ 4931.931944] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 116 previous similar messages [ 4988.748660] Lustre: MGS: Connection restored to soaked-MDT0000-lwp-OST0002_UUID (at 192.168.1.102@o2ib) [ 4988.759214] Lustre: Skipped 8 previous similar messages [ 5044.055438] Lustre: soaked-OST0006-osc-MDT0000: Connection restored to 192.168.1.102@o2ib (at 192.168.1.102@o2ib) [ 5044.066951] Lustre: Skipped 4 previous similar messages [ 6074.768815] sd 0:0:1:1: attempting task abort! scmd(ffff99516698d6c0) [ 6074.776039] sd 0:0:1:1: [sdi] tag#160 CDB: Write(16) 8a 00 00 00 00 00 06 64 00 a0 00 00 00 08 00 00 [ 6074.786270] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6074.795026] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6074.808882] sd 0:0:1:1: task abort: SUCCESS scmd(ffff99516698d6c0) [ 6074.815844] sd 0:0:1:1: attempting task abort! scmd(ffff99516698d500) [ 6074.823064] sd 0:0:1:1: [sdi] tag#159 CDB: Write(16) 8a 00 00 00 00 00 06 40 01 e8 00 00 00 08 00 00 [ 6074.833294] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6074.842049] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6074.900092] sd 0:0:1:1: task abort: SUCCESS scmd(ffff99516698d500) [ 6074.907021] sd 0:0:1:1: attempting task abort! scmd(ffff99516698d340) [ 6074.914240] sd 0:0:1:1: [sdi] tag#158 CDB: Write(16) 8a 00 00 00 00 00 06 40 00 80 00 00 00 08 00 00 [ 6074.924459] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6074.933202] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6075.049152] sd 0:0:1:1: task abort: SUCCESS scmd(ffff99516698d340) [ 6075.056102] sd 0:0:1:1: attempting task abort! scmd(ffff99516698d180) [ 6075.063308] sd 0:0:1:1: [sdi] tag#157 CDB: Write(16) 8a 00 00 00 00 00 06 40 00 48 00 00 00 08 00 00 [ 6075.073551] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6075.082299] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6075.289652] sd 0:0:1:1: task abort: SUCCESS scmd(ffff99516698d180) [ 6075.296588] sd 0:0:1:1: attempting task abort! scmd(ffff99516698cfc0) [ 6075.303793] sd 0:0:1:1: [sdi] tag#156 CDB: Write(16) 8a 00 00 00 00 00 06 24 00 80 00 00 00 18 00 00 [ 6075.314057] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6075.322802] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6075.399342] sd 0:0:1:1: task abort: SUCCESS scmd(ffff99516698cfc0) [ 6075.406296] sd 0:0:1:1: attempting task abort! scmd(ffff99516698ce00) [ 6075.413495] sd 0:0:1:1: [sdi] tag#155 CDB: Write(16) 8a 00 00 00 00 00 06 00 01 e0 00 00 00 10 00 00 [ 6075.423750] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6075.432495] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6075.602364] sd 0:0:1:1: task abort: SUCCESS scmd(ffff99516698ce00) [ 6075.609319] sd 0:0:1:1: attempting task abort! scmd(ffff99516698cc40) [ 6075.616526] sd 0:0:1:1: [sdi] tag#154 CDB: Write(16) 8a 00 00 00 00 00 06 00 00 80 00 00 00 08 00 00 [ 6075.626771] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6075.635514] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6075.689474] sd 0:0:1:1: task abort: SUCCESS scmd(ffff99516698cc40) [ 6075.696413] sd 0:0:1:1: attempting task abort! scmd(ffff99516698ca80) [ 6075.703635] sd 0:0:1:1: [sdi] tag#153 CDB: Write(16) 8a 00 00 00 00 00 06 00 00 48 00 00 00 08 00 00 [ 6075.713881] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6075.722623] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6075.842046] sd 0:0:1:1: task abort: SUCCESS scmd(ffff99516698ca80) [ 6075.849025] sd 0:0:1:1: attempting task abort! scmd(ffff99516698c8c0) [ 6075.856247] sd 0:0:1:1: [sdi] tag#152 CDB: Write(16) 8a 00 00 00 00 00 05 d0 03 e8 00 00 00 08 00 00 [ 6075.866488] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6075.875246] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6075.892969] sd 0:0:1:1: task abort: SUCCESS scmd(ffff99516698c8c0) [ 6075.899966] sd 0:0:1:1: attempting task abort! scmd(ffff99516698c700) [ 6075.907176] sd 0:0:1:1: [sdi] tag#151 CDB: Write(16) 8a 00 00 00 00 00 05 d0 03 d8 00 00 00 08 00 00 [ 6075.917395] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6075.926142] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6075.941065] sd 0:0:1:1: task abort: SUCCESS scmd(ffff99516698c700) [ 6075.948006] sd 0:0:1:1: attempting task abort! scmd(ffff99516698c540) [ 6075.955219] sd 0:0:1:1: [sdi] tag#150 CDB: Write(16) 8a 00 00 00 00 00 05 c0 01 e8 00 00 00 08 00 00 [ 6075.965439] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6075.974181] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6076.050179] sd 0:0:1:1: task abort: SUCCESS scmd(ffff99516698c540) [ 6076.057129] sd 0:0:1:1: attempting task abort! scmd(ffff99516698c380) [ 6076.064333] sd 0:0:1:1: [sdi] tag#149 CDB: Write(16) 8a 00 00 00 00 00 05 c0 00 80 00 00 00 08 00 00 [ 6076.074562] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6076.083322] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6076.319159] sd 0:0:1:1: task abort: SUCCESS scmd(ffff99516698c380) [ 6076.326124] sd 0:0:1:1: attempting task abort! scmd(ffff99516698c1c0) [ 6076.333332] sd 0:0:1:1: [sdi] tag#148 CDB: Write(16) 8a 00 00 00 00 00 05 c0 00 20 00 00 00 08 00 00 [ 6076.343558] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6076.352329] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6076.406421] sd 0:0:1:1: task abort: SUCCESS scmd(ffff99516698c1c0) [ 6076.413364] sd 0:0:1:1: attempting task abort! scmd(ffff99516698c000) [ 6076.420569] sd 0:0:1:1: [sdi] tag#147 CDB: Write(16) 8a 00 00 00 00 00 05 90 02 d0 00 00 00 08 00 00 [ 6076.430799] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6076.439542] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6076.457432] sd 0:0:1:1: task abort: SUCCESS scmd(ffff99516698c000) [ 6076.464390] sd 0:0:1:1: attempting task abort! scmd(ffff99516698fd40) [ 6076.471593] sd 0:0:1:1: [sdi] tag#146 CDB: Write(16) 8a 00 00 00 00 00 05 90 02 78 00 00 00 08 00 00 [ 6076.481805] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6076.490547] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6076.641165] sd 0:0:1:1: task abort: SUCCESS scmd(ffff99516698fd40) [ 6076.648117] sd 0:0:1:1: attempting task abort! scmd(ffff99516698fb80) [ 6076.655328] sd 0:0:1:1: [sdi] tag#145 CDB: Write(16) 8a 00 00 00 00 00 05 80 01 e8 00 00 00 08 00 00 [ 6076.665544] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6076.674287] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6076.869440] sd 0:0:1:1: task abort: SUCCESS scmd(ffff99516698fb80) [ 6076.876399] sd 0:0:1:1: attempting task abort! scmd(ffff99516698f9c0) [ 6076.883613] sd 0:0:1:1: [sdi] tag#144 CDB: Write(16) 8a 00 00 00 00 00 05 80 00 80 00 00 00 08 00 00 [ 6076.893824] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6076.902566] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6076.960317] sd 0:0:1:1: task abort: SUCCESS scmd(ffff99516698f9c0) [ 6076.967278] sd 0:0:1:1: attempting task abort! scmd(ffff99516698f800) [ 6076.974491] sd 0:0:1:1: [sdi] tag#143 CDB: Write(16) 8a 00 00 00 00 00 05 80 00 20 00 00 00 08 00 00 [ 6076.984721] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6076.993465] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6077.138255] sd 0:0:1:1: task abort: SUCCESS scmd(ffff99516698f800) [ 6077.145222] sd 0:0:1:1: attempting task abort! scmd(ffff9950f0226840) [ 6077.152425] sd 0:0:1:1: [sdi] tag#142 CDB: Write(16) 8a 00 00 00 00 00 05 64 00 60 00 00 00 10 00 00 [ 6077.162641] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6077.171384] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6077.236211] sd 0:0:1:1: task abort: SUCCESS scmd(ffff9950f0226840) [ 6077.243164] sd 0:0:1:1: attempting task abort! scmd(ffff9950f0224e00) [ 6077.250368] sd 0:0:1:1: [sdi] tag#141 CDB: Write(16) 8a 00 00 00 00 00 05 64 00 50 00 00 00 08 00 00 [ 6077.260590] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6077.269353] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6077.384065] sd 0:0:1:1: task abort: SUCCESS scmd(ffff9950f0224e00) [ 6077.391019] sd 0:0:1:1: attempting task abort! scmd(ffff9950f0224fc0) [ 6077.398231] sd 0:0:1:1: [sdi] tag#140 CDB: Write(16) 8a 00 00 00 00 00 05 40 01 e0 00 00 00 10 00 00 [ 6077.408451] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6077.417195] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6077.434066] sd 0:0:1:1: task abort: SUCCESS scmd(ffff9950f0224fc0) [ 6077.441018] sd 0:0:1:1: attempting task abort! scmd(ffff9950f02241c0) [ 6077.448236] sd 0:0:1:1: [sdi] tag#139 CDB: Write(16) 8a 00 00 00 00 00 05 40 00 80 00 00 00 08 00 00 [ 6077.458447] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6077.467187] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6077.682256] sd 0:0:1:1: task abort: SUCCESS scmd(ffff9950f02241c0) [ 6077.689199] sd 0:0:1:1: attempting task abort! scmd(ffff9950f0227640) [ 6077.696404] sd 0:0:1:1: [sdi] tag#138 CDB: Write(16) 8a 00 00 00 00 00 05 40 00 48 00 00 00 08 00 00 [ 6077.706621] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6077.715365] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6077.869420] sd 0:0:1:1: task abort: SUCCESS scmd(ffff9950f0227640) [ 6077.876378] sd 0:0:1:1: attempting task abort! scmd(ffff9950f0227d40) [ 6077.883592] sd 0:0:1:1: [sdi] tag#137 CDB: Write(16) 8a 00 00 00 00 00 05 24 00 90 00 00 00 08 00 00 [ 6077.893800] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6077.902542] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6077.988422] sd 0:0:1:1: task abort: SUCCESS scmd(ffff9950f0227d40) [ 6077.995375] sd 0:0:1:1: attempting task abort! scmd(ffff9950f0227b80) [ 6078.002572] sd 0:0:1:1: [sdi] tag#136 CDB: Write(16) 8a 00 00 00 00 00 05 24 00 20 00 00 00 08 00 00 [ 6078.012798] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6078.021558] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6078.063335] sd 0:0:1:1: task abort: SUCCESS scmd(ffff9950f0227b80) [ 6078.070279] sd 0:0:1:1: attempting task abort! scmd(ffff9950f02279c0) [ 6078.077483] sd 0:0:1:1: [sdi] tag#135 CDB: Write(16) 8a 00 00 00 00 00 05 00 01 e8 00 00 00 08 00 00 [ 6078.087710] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6078.096453] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6078.273606] sd 0:0:1:1: task abort: SUCCESS scmd(ffff9950f02279c0) [ 6078.280563] sd 0:0:1:1: attempting task abort! scmd(ffff9950f0227800) [ 6078.287774] sd 0:0:1:1: [sdi] tag#134 CDB: Write(16) 8a 00 00 00 00 00 05 00 00 80 00 00 00 08 00 00 [ 6078.297995] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6078.306739] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6078.504681] sd 0:0:1:1: task abort: SUCCESS scmd(ffff9950f0227800) [ 6078.511641] sd 0:0:1:1: attempting task abort! scmd(ffff9950f0227480) [ 6078.518846] sd 0:0:1:1: [sdi] tag#133 CDB: Write(16) 8a 00 00 00 00 00 05 00 00 48 00 00 00 08 00 00 [ 6078.529072] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6078.537816] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6078.599321] sd 0:0:1:1: task abort: SUCCESS scmd(ffff9950f0227480) [ 6078.606274] sd 0:0:1:1: attempting task abort! scmd(ffff9950f02272c0) [ 6078.613483] sd 0:0:1:1: [sdi] tag#132 CDB: Write(16) 8a 00 00 00 00 00 04 e4 00 78 00 00 00 08 00 00 [ 6078.623702] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6078.632445] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6078.670555] sd 0:0:1:1: task abort: SUCCESS scmd(ffff9950f02272c0) [ 6078.677515] sd 0:0:1:1: attempting task abort! scmd(ffff9950f0227100) [ 6078.684734] sd 0:0:1:1: [sdi] tag#131 CDB: Write(16) 8a 00 00 00 00 00 04 e4 00 58 00 00 00 08 00 00 [ 6078.694979] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6078.703723] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6078.799639] sd 0:0:1:1: task abort: SUCCESS scmd(ffff9950f0227100) [ 6078.806601] sd 0:0:1:1: attempting task abort! scmd(ffff9950f0226f40) [ 6078.813812] sd 0:0:1:1: [sdi] tag#130 CDB: Write(16) 8a 00 00 00 00 00 04 c0 01 e0 00 00 00 10 00 00 [ 6078.824032] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6078.832774] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6078.901820] sd 0:0:1:1: task abort: SUCCESS scmd(ffff9950f0226f40) [ 6078.908773] sd 0:0:1:1: attempting task abort! scmd(ffff9950f0226d80) [ 6078.915969] sd 0:0:1:1: [sdi] tag#129 CDB: Write(16) 8a 00 00 00 00 00 04 c0 00 80 00 00 00 08 00 00 [ 6078.926188] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6078.934931] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6078.949370] sd 0:0:1:1: task abort: SUCCESS scmd(ffff9950f0226d80) [ 6078.956322] sd 0:0:1:1: attempting task abort! scmd(ffff9950f0226bc0) [ 6078.963548] sd 0:0:1:1: [sdi] tag#128 CDB: Write(16) 8a 00 00 00 00 00 04 c0 00 48 00 00 00 08 00 00 [ 6078.973756] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6078.982499] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6079.045519] sd 0:0:1:1: task abort: SUCCESS scmd(ffff9950f0226bc0) [ 6079.052469] sd 0:0:1:1: attempting task abort! scmd(ffff9950f0226a00) [ 6079.059673] sd 0:0:1:1: [sdi] tag#127 CDB: Write(16) 8a 00 00 00 00 00 04 a8 06 b8 00 00 00 08 00 00 [ 6079.069910] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6079.078652] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6079.235616] sd 0:0:1:1: task abort: SUCCESS scmd(ffff9950f0226a00) [ 6079.242573] sd 0:0:1:1: attempting task abort! scmd(ffff9950f0226680) [ 6079.249790] sd 0:0:1:1: [sdi] tag#126 CDB: Write(16) 8a 00 00 00 00 00 04 a8 03 70 00 00 00 10 00 00 [ 6079.260004] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6079.268747] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6079.288711] sd 0:0:1:1: task abort: SUCCESS scmd(ffff9950f0226680) [ 6079.295662] sd 0:0:1:1: attempting task abort! scmd(ffff9950f02264c0) [ 6079.302865] sd 0:0:1:1: [sdi] tag#125 CDB: Write(16) 8a 00 00 00 00 00 04 80 03 38 00 00 00 50 00 00 [ 6079.313082] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6079.321825] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6079.381749] sd 0:0:1:1: task abort: SUCCESS scmd(ffff9950f02264c0) [ 6079.388702] sd 0:0:1:1: attempting task abort! scmd(ffff9950f0226300) [ 6079.395909] sd 0:0:1:1: [sdi] tag#124 CDB: Write(16) 8a 00 00 00 00 00 04 80 02 58 00 00 00 d8 00 00 [ 6079.406131] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6079.414874] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6079.440700] sd 0:0:1:1: task abort: SUCCESS scmd(ffff9950f0226300) [ 6079.447651] sd 0:0:1:1: attempting task abort! scmd(ffff9950f0226140) [ 6079.454854] sd 0:0:1:1: [sdi] tag#123 CDB: Write(16) 8a 00 00 00 00 00 04 80 02 48 00 00 00 08 00 00 [ 6079.465072] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6079.473814] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6079.493622] sd 0:0:1:1: task abort: SUCCESS scmd(ffff9950f0226140) [ 6079.500578] sd 0:0:1:1: attempting task abort! scmd(ffff9950f0225f80) [ 6079.507778] sd 0:0:1:1: [sdi] tag#122 CDB: Write(16) 8a 00 00 00 00 00 04 80 01 a0 00 00 00 08 00 00 [ 6079.518009] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6079.526752] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6079.753581] sd 0:0:1:1: task abort: SUCCESS scmd(ffff9950f0225f80) [ 6079.760531] sd 0:0:1:1: attempting task abort! scmd(ffff9950f0225c00) [ 6079.767744] sd 0:0:1:1: [sdi] tag#121 CDB: Write(16) 8a 00 00 00 00 00 04 80 00 80 00 00 00 08 00 00 [ 6079.777967] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6079.786714] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6079.867268] sd 0:0:1:1: task abort: SUCCESS scmd(ffff9950f0225c00) [ 6079.874229] sd 0:0:1:1: attempting task abort! scmd(ffff9950f0225a40) [ 6079.881435] sd 0:0:1:1: [sdi] tag#120 CDB: Write(16) 8a 00 00 00 00 00 04 80 00 50 00 00 00 08 00 00 [ 6079.891649] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6079.900383] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6079.968769] sd 0:0:1:1: task abort: SUCCESS scmd(ffff9950f0225a40) [ 6079.975723] sd 0:0:1:1: attempting task abort! scmd(ffff9950f0225880) [ 6079.982946] sd 0:0:1:1: [sdi] tag#119 CDB: Write(16) 8a 00 00 00 00 00 04 64 00 70 00 00 00 10 00 00 [ 6079.993162] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6080.001912] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6080.047588] sd 0:0:1:1: task abort: SUCCESS scmd(ffff9950f0225880) [ 6080.054545] sd 0:0:1:1: attempting task abort! scmd(ffff9950f02256c0) [ 6080.061750] sd 0:0:1:1: [sdi] tag#118 CDB: Write(16) 8a 00 00 00 00 00 04 40 01 e8 00 00 00 08 00 00 [ 6080.071987] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6080.080729] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6080.113307] sd 0:0:1:1: task abort: SUCCESS scmd(ffff9950f02256c0) [ 6080.120260] sd 0:0:1:1: attempting task abort! scmd(ffff9950f0225500) [ 6080.127464] sd 0:0:1:1: [sdi] tag#117 CDB: Write(16) 8a 00 00 00 00 00 04 40 00 80 00 00 00 08 00 00 [ 6080.137677] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6080.146418] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6080.190793] sd 0:0:1:1: task abort: SUCCESS scmd(ffff9950f0225500) [ 6080.197739] sd 0:0:1:1: attempting task abort! scmd(ffff9950f0225340) [ 6080.204945] sd 0:0:1:1: [sdi] tag#116 CDB: Write(16) 8a 00 00 00 00 00 04 40 00 48 00 00 00 08 00 00 [ 6080.215176] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6080.223933] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6080.275903] sd 0:0:1:1: task abort: SUCCESS scmd(ffff9950f0225340) [ 6080.282857] sd 0:0:1:1: attempting task abort! scmd(ffff9950f0225180) [ 6080.290061] sd 0:0:1:1: [sdi] tag#115 CDB: Write(16) 8a 00 00 00 00 00 04 24 00 78 00 00 00 08 00 00 [ 6080.300291] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6080.309041] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6080.427326] sd 0:0:1:1: task abort: SUCCESS scmd(ffff9950f0225180) [ 6080.434284] sd 0:0:1:1: attempting task abort! scmd(ffff9950f0224c40) [ 6080.441495] sd 0:0:1:1: [sdi] tag#114 CDB: Write(16) 8a 00 00 00 00 00 04 24 00 68 00 00 00 08 00 00 [ 6080.451708] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6080.460470] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6080.582121] sd 0:0:1:1: task abort: SUCCESS scmd(ffff9950f0224c40) [ 6080.589086] sd 0:0:1:1: attempting task abort! scmd(ffff9950f02248c0) [ 6080.596314] sd 0:0:1:1: [sdi] tag#113 CDB: Write(16) 8a 00 00 00 00 00 04 00 01 e8 00 00 00 08 00 00 [ 6080.606527] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6080.615261] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6080.652221] sd 0:0:1:1: task abort: SUCCESS scmd(ffff9950f02248c0) [ 6080.659175] sd 0:0:1:1: attempting task abort! scmd(ffff9950f0224700) [ 6080.666401] sd 0:0:1:1: [sdi] tag#112 CDB: Write(16) 8a 00 00 00 00 00 04 00 00 80 00 00 00 08 00 00 [ 6080.676635] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6080.685388] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6080.697549] sd 0:0:1:1: task abort: SUCCESS scmd(ffff9950f0224700) [ 6080.704507] sd 0:0:1:1: attempting task abort! scmd(ffff9950f0225dc0) [ 6080.711721] sd 0:0:1:1: [sdi] tag#111 CDB: Write(16) 8a 00 00 00 00 00 04 00 00 48 00 00 00 08 00 00 [ 6080.721967] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6080.730710] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6080.818626] sd 0:0:1:1: task abort: SUCCESS scmd(ffff9950f0225dc0) [ 6080.825578] sd 0:0:1:1: attempting task abort! scmd(ffff9950f0224a80) [ 6080.832790] sd 0:0:1:1: [sdi] tag#110 CDB: Write(16) 8a 00 00 00 00 00 03 cb 03 98 00 00 00 10 00 00 [ 6080.843013] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6080.851756] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6080.939294] sd 0:0:1:1: task abort: SUCCESS scmd(ffff9950f0224a80) [ 6080.946256] sd 0:0:1:1: attempting task abort! scmd(ffff9950f0224540) [ 6080.953467] sd 0:0:1:1: [sdi] tag#109 CDB: Write(16) 8a 00 00 00 00 00 03 c0 01 e8 00 00 00 08 00 00 [ 6080.963681] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6080.972424] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6081.090189] sd 0:0:1:1: task abort: SUCCESS scmd(ffff9950f0224540) [ 6081.097146] sd 0:0:1:1: attempting task abort! scmd(ffff9950f0224380) [ 6081.104350] sd 0:0:1:1: [sdi] tag#108 CDB: Write(16) 8a 00 00 00 00 00 03 c0 00 80 00 00 00 08 00 00 [ 6081.114562] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6081.123305] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6081.177715] sd 0:0:1:1: task abort: SUCCESS scmd(ffff9950f0224380) [ 6081.184669] sd 0:0:1:1: attempting task abort! scmd(ffff9950f0224000) [ 6081.191872] sd 0:0:1:1: [sdi] tag#107 CDB: Write(16) 8a 00 00 00 00 00 03 c0 00 10 00 00 00 08 00 00 [ 6081.202120] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6081.210863] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6081.277596] sd 0:0:1:1: task abort: SUCCESS scmd(ffff9950f0224000) [ 6081.284552] sd 0:0:1:1: attempting task abort! scmd(ffff995143fdda40) [ 6081.291759] sd 0:0:1:1: [sdi] tag#106 CDB: Write(16) 8a 00 00 00 00 00 03 90 04 a0 00 00 00 10 00 00 [ 6081.301990] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6081.310724] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6081.329100] sd 0:0:1:1: task abort: SUCCESS scmd(ffff995143fdda40) [ 6081.336065] sd 0:0:1:1: attempting task abort! scmd(ffff995143fde840) [ 6081.343268] sd 0:0:1:1: [sdi] tag#105 CDB: Write(16) 8a 00 00 00 00 00 03 80 01 e8 00 00 00 08 00 00 [ 6081.353500] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6081.362240] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6081.424889] sd 0:0:1:1: task abort: SUCCESS scmd(ffff995143fde840) [ 6081.431835] sd 0:0:1:1: attempting task abort! scmd(ffff995143fdce00) [ 6081.439046] sd 0:0:1:1: [sdi] tag#104 CDB: Write(16) 8a 00 00 00 00 00 03 80 00 80 00 00 00 08 00 00 [ 6081.449279] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6081.458042] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6081.500306] sd 0:0:1:1: task abort: SUCCESS scmd(ffff995143fdce00) [ 6081.507231] sd 0:0:1:1: attempting task abort! scmd(ffff995143fdd180) [ 6081.514439] sd 0:0:1:1: [sdi] tag#103 CDB: Write(16) 8a 00 00 00 00 00 03 80 00 20 00 00 00 08 00 00 [ 6081.524656] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6081.533398] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6081.583562] sd 0:0:1:1: task abort: SUCCESS scmd(ffff995143fdd180) [ 6081.590506] sd 0:0:1:1: attempting task abort! scmd(ffff995143fdebc0) [ 6081.597719] sd 0:0:1:1: [sdi] tag#102 CDB: Write(16) 8a 00 00 00 00 00 03 50 04 b8 00 00 00 08 00 00 [ 6081.607957] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6081.616701] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6081.665756] sd 0:0:1:1: task abort: SUCCESS scmd(ffff995143fdebc0) [ 6081.672709] sd 0:0:1:1: attempting task abort! scmd(ffff995143fddf80) [ 6081.679907] sd 0:0:1:1: [sdi] tag#101 CDB: Write(16) 8a 00 00 00 00 00 03 50 04 a0 00 00 00 08 00 00 [ 6081.690124] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6081.698866] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6081.723588] sd 0:0:1:1: task abort: SUCCESS scmd(ffff995143fddf80) [ 6081.730542] sd 0:0:1:1: attempting task abort! scmd(ffff995143fde300) [ 6081.737750] sd 0:0:1:1: [sdi] tag#100 CDB: Write(16) 8a 00 00 00 00 00 03 40 01 e8 00 00 00 08 00 00 [ 6081.747969] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6081.756710] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6081.942676] sd 0:0:1:1: task abort: SUCCESS scmd(ffff995143fde300) [ 6081.949636] sd 0:0:1:1: attempting task abort! scmd(ffff995143fdc8c0) [ 6081.956848] sd 0:0:1:1: [sdi] tag#99 CDB: Write(16) 8a 00 00 00 00 00 03 40 00 80 00 00 00 08 00 00 [ 6081.966975] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6081.975718] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6082.028469] sd 0:0:1:1: task abort: SUCCESS scmd(ffff995143fdc8c0) [ 6082.035422] sd 0:0:1:1: attempting task abort! scmd(ffff995143fdddc0) [ 6082.042620] sd 0:0:1:1: [sdi] tag#98 CDB: Write(16) 8a 00 00 00 00 00 03 40 00 20 00 00 00 08 00 00 [ 6082.052768] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6082.061512] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6082.079195] sd 0:0:1:1: task abort: SUCCESS scmd(ffff995143fdddc0) [ 6082.086150] sd 0:0:1:1: attempting task abort! scmd(ffff995143fddc00) [ 6082.093353] sd 0:0:1:1: [sdi] tag#97 CDB: Write(16) 8a 00 00 00 00 00 03 10 04 f0 00 00 00 10 00 00 [ 6082.103466] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6082.112209] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6082.207725] sd 0:0:1:1: task abort: SUCCESS scmd(ffff995143fddc00) [ 6082.214666] sd 0:0:1:1: attempting task abort! scmd(ffff995143fdf800) [ 6082.221877] sd 0:0:1:1: [sdi] tag#96 CDB: Write(16) 8a 00 00 00 00 00 03 00 01 e8 00 00 00 08 00 00 [ 6082.231999] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6082.240741] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6082.317845] sd 0:0:1:1: task abort: SUCCESS scmd(ffff995143fdf800) [ 6082.324799] sd 0:0:1:1: attempting task abort! scmd(ffff995143fdf640) [ 6082.331997] sd 0:0:1:1: [sdi] tag#95 CDB: Write(16) 8a 00 00 00 00 00 03 00 00 80 00 00 00 08 00 00 [ 6082.342119] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6082.350861] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6082.622905] sd 0:0:1:1: task abort: SUCCESS scmd(ffff995143fdf640) [ 6082.629871] sd 0:0:1:1: attempting task abort! scmd(ffff995143fdfd40) [ 6082.637076] sd 0:0:1:1: [sdi] tag#94 CDB: Write(16) 8a 00 00 00 00 00 03 00 00 20 00 00 00 08 00 00 [ 6082.647203] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6082.655946] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6082.718025] sd 0:0:1:1: task abort: SUCCESS scmd(ffff995143fdfd40) [ 6082.724979] sd 0:0:1:1: attempting task abort! scmd(ffff995143fdd880) [ 6082.732176] sd 0:0:1:1: [sdi] tag#93 CDB: Write(16) 8a 00 00 00 00 00 02 d0 03 f0 00 00 00 10 00 00 [ 6082.742318] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6082.751061] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6082.799871] sd 0:0:1:1: task abort: SUCCESS scmd(ffff995143fdd880) [ 6082.806826] sd 0:0:1:1: attempting task abort! scmd(ffff995143fdcfc0) [ 6082.814041] sd 0:0:1:1: [sdi] tag#92 CDB: Write(16) 8a 00 00 00 00 00 02 d0 03 e0 00 00 00 08 00 00 [ 6082.824162] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6082.832905] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6082.913354] sd 0:0:1:1: task abort: SUCCESS scmd(ffff995143fdcfc0) [ 6082.920311] sd 0:0:1:1: attempting task abort! scmd(ffff995143fdca80) [ 6082.927515] sd 0:0:1:1: [sdi] tag#91 CDB: Write(16) 8a 00 00 00 00 00 02 c0 01 e0 00 00 00 10 00 00 [ 6082.937658] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6082.946400] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6083.034425] sd 0:0:1:1: task abort: SUCCESS scmd(ffff995143fdca80) [ 6083.041379] sd 0:0:1:1: attempting task abort! scmd(ffff995143fdc000) [ 6083.048594] sd 0:0:1:1: [sdi] tag#90 CDB: Write(16) 8a 00 00 00 00 00 02 c0 00 80 00 00 00 08 00 00 [ 6083.058719] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6083.067461] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6083.250568] sd 0:0:1:1: task abort: SUCCESS scmd(ffff995143fdc000) [ 6083.257529] sd 0:0:1:1: attempting task abort! scmd(ffff995143fded80) [ 6083.264733] sd 0:0:1:1: [sdi] tag#89 CDB: Write(16) 8a 00 00 00 00 00 02 c0 00 20 00 00 00 08 00 00 [ 6083.274855] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6083.283599] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6083.310467] sd 0:0:1:1: task abort: SUCCESS scmd(ffff995143fded80) [ 6083.317417] sd 0:0:1:1: attempting task abort! scmd(ffff995143fdd500) [ 6083.324620] sd 0:0:1:1: [sdi] tag#88 CDB: Write(16) 8a 00 00 00 00 00 02 ab 30 48 00 00 00 08 00 00 [ 6083.334754] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6083.343495] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6083.364471] sd 0:0:1:1: task abort: SUCCESS scmd(ffff995143fdd500) [ 6083.371404] sd 0:0:1:1: attempting task abort! scmd(ffff995143fdf9c0) [ 6083.378613] sd 0:0:1:1: [sdi] tag#87 CDB: Write(16) 8a 00 00 00 00 00 02 ab 12 d8 00 00 00 10 00 00 [ 6083.388758] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6083.397505] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6083.576006] sd 0:0:1:1: task abort: SUCCESS scmd(ffff995143fdf9c0) [ 6083.582943] sd 0:0:1:1: attempting task abort! scmd(ffff995143fde4c0) [ 6083.590151] sd 0:0:1:1: [sdi] tag#86 CDB: Write(16) 8a 00 00 00 00 00 02 ab 02 20 00 00 00 08 00 00 [ 6083.600267] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6083.609015] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6083.684194] sd 0:0:1:1: task abort: SUCCESS scmd(ffff995143fde4c0) [ 6083.691164] sd 0:0:1:1: attempting task abort! scmd(ffff995143fdc700) [ 6083.698401] sd 0:0:1:1: [sdi] tag#85 CDB: Write(16) 8a 00 00 00 00 00 02 aa fb 50 00 00 00 08 00 00 [ 6083.708515] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6083.717256] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6083.762213] sd 0:0:1:1: task abort: SUCCESS scmd(ffff995143fdc700) [ 6083.769169] sd 0:0:1:1: attempting task abort! scmd(ffff995143fdc540) [ 6083.776380] sd 0:0:1:1: [sdi] tag#84 CDB: Write(16) 8a 00 00 00 00 00 02 aa fb 40 00 00 00 08 00 00 [ 6083.786516] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6083.795277] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6083.891499] sd 0:0:1:1: task abort: SUCCESS scmd(ffff995143fdc540) [ 6083.898456] sd 0:0:1:1: attempting task abort! scmd(ffff995143fdf480) [ 6083.905669] sd 0:0:1:1: [sdi] tag#83 CDB: Write(16) 8a 00 00 00 00 00 02 aa fa e8 00 00 00 08 00 00 [ 6083.915790] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6083.924532] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6083.969618] sd 0:0:1:1: task abort: SUCCESS scmd(ffff995143fdf480) [ 6083.976573] sd 0:0:1:1: attempting task abort! scmd(ffff995143fdc1c0) [ 6083.983794] sd 0:0:1:1: [sdi] tag#82 CDB: Write(16) 8a 00 00 00 00 00 02 aa e9 98 00 00 00 08 00 00 [ 6083.993914] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6084.002659] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6084.025670] sd 0:0:1:1: task abort: SUCCESS scmd(ffff995143fdc1c0) [ 6084.032627] sd 0:0:1:1: attempting task abort! scmd(ffff995143fdf2c0) [ 6084.039838] sd 0:0:1:1: [sdi] tag#81 CDB: Write(16) 8a 00 00 00 00 00 02 aa e9 88 00 00 00 08 00 00 [ 6084.049951] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6084.058692] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6084.244998] sd 0:0:1:1: task abort: SUCCESS scmd(ffff995143fdf2c0) [ 6084.251951] sd 0:0:1:1: attempting task abort! scmd(ffff995143fde140) [ 6084.259158] sd 0:0:1:1: [sdi] tag#80 CDB: Write(16) 8a 00 00 00 00 00 02 aa 7f 60 00 00 00 08 00 00 [ 6084.269292] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6084.278026] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6084.334243] sd 0:0:1:1: task abort: SUCCESS scmd(ffff995143fde140) [ 6084.341203] sd 0:0:1:1: attempting task abort! scmd(ffff995143fdef40) [ 6084.348422] sd 0:0:1:1: [sdi] tag#79 CDB: Write(16) 8a 00 00 00 00 00 02 aa 7f 30 00 00 00 08 00 00 [ 6084.358539] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6084.367284] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6084.431972] sd 0:0:1:1: task abort: SUCCESS scmd(ffff995143fdef40) [ 6084.438930] sd 0:0:1:1: attempting task abort! scmd(ffff995143fdcc40) [ 6084.446145] sd 0:0:1:1: [sdi] tag#78 CDB: Write(16) 8a 00 00 00 00 00 02 aa 62 20 00 00 00 10 00 00 [ 6084.456265] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6084.465009] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6084.584481] sd 0:0:1:1: task abort: SUCCESS scmd(ffff995143fdcc40) [ 6084.591440] sd 0:0:1:1: attempting task abort! scmd(ffff995143fdf100) [ 6084.598644] sd 0:0:1:1: [sdi] tag#77 CDB: Write(16) 8a 00 00 00 00 00 02 aa 04 78 00 00 00 08 00 00 [ 6084.608770] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6084.617531] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6084.653461] sd 0:0:1:1: task abort: SUCCESS scmd(ffff995143fdf100) [ 6084.660420] sd 0:0:1:1: attempting task abort! scmd(ffff995143fdea00) [ 6084.667627] sd 0:0:1:1: [sdi] tag#76 CDB: Write(16) 8a 00 00 00 00 00 02 a9 f4 a0 00 00 00 08 00 00 [ 6084.677763] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6084.686513] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6084.780734] sd 0:0:1:1: task abort: SUCCESS scmd(ffff995143fdea00) [ 6084.787703] sd 0:0:1:1: attempting task abort! scmd(ffff995143fdfb80) [ 6084.794908] sd 0:0:1:1: [sdi] tag#75 CDB: Write(16) 8a 00 00 00 00 00 02 a9 ed 78 00 00 00 08 00 00 [ 6084.805033] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6084.813777] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6084.847849] sd 0:0:1:1: task abort: SUCCESS scmd(ffff995143fdfb80) [ 6084.854801] sd 0:0:1:1: attempting task abort! scmd(ffff995143fdd340) [ 6084.862014] sd 0:0:1:1: [sdi] tag#74 CDB: Write(16) 8a 00 00 00 00 00 02 a9 d8 60 00 00 00 10 00 00 [ 6084.872157] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6084.880890] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6084.919499] sd 0:0:1:1: task abort: SUCCESS scmd(ffff995143fdd340) [ 6084.926452] sd 0:0:1:1: attempting task abort! scmd(ffff995143fdc380) [ 6084.933666] sd 0:0:1:1: [sdi] tag#73 CDB: Write(16) 8a 00 00 00 00 00 02 a9 84 18 00 00 00 08 00 00 [ 6084.943797] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6084.952566] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6084.973926] sd 0:0:1:1: task abort: SUCCESS scmd(ffff995143fdc380) [ 6084.980876] sd 0:0:1:1: attempting task abort! scmd(ffff995143fde680) [ 6084.988095] sd 0:0:1:1: [sdi] tag#72 CDB: Write(16) 8a 00 00 00 00 00 02 a9 76 10 00 00 00 08 00 00 [ 6084.998211] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6085.006953] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6085.023957] sd 0:0:1:1: task abort: SUCCESS scmd(ffff995143fde680) [ 6085.030889] sd 0:0:1:1: attempting task abort! scmd(ffff9950efed7d40) [ 6085.038121] sd 0:0:1:1: [sdi] tag#71 CDB: Write(16) 8a 00 00 00 00 00 02 a9 61 f8 00 00 00 08 00 00 [ 6085.048224] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6085.056967] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6085.076074] sd 0:0:1:1: task abort: SUCCESS scmd(ffff9950efed7d40) [ 6085.082998] sd 0:0:1:1: attempting task abort! scmd(ffff9950efed7b80) [ 6085.090227] sd 0:0:1:1: [sdi] tag#70 CDB: Write(16) 8a 00 00 00 00 00 02 a9 16 d0 00 00 00 08 00 00 [ 6085.100360] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6085.109110] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6085.132459] sd 0:0:1:1: task abort: SUCCESS scmd(ffff9950efed7b80) [ 6085.139397] sd 0:0:1:1: attempting task abort! scmd(ffff9950efed7800) [ 6085.146609] sd 0:0:1:1: [sdi] tag#69 CDB: Write(16) 8a 00 00 00 00 00 02 a8 aa 98 00 00 00 08 00 00 [ 6085.156736] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6085.165477] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6085.175251] sd 0:0:1:1: task abort: SUCCESS scmd(ffff9950efed7800) [ 6085.182193] sd 0:0:1:1: attempting task abort! scmd(ffff9950efed7640) [ 6085.189399] sd 0:0:1:1: [sdi] tag#68 CDB: Write(16) 8a 00 00 00 00 00 02 a8 30 98 00 00 00 08 00 00 [ 6085.199503] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6085.208250] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6085.216509] sd 0:0:1:1: task abort: SUCCESS scmd(ffff9950efed7640) [ 6085.223424] sd 0:0:1:1: attempting task abort! scmd(ffff9950efed7480) [ 6085.230626] sd 0:0:1:1: [sdi] tag#67 CDB: Write(16) 8a 00 00 00 00 00 02 a8 30 80 00 00 00 08 00 00 [ 6085.240728] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6085.249468] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6085.257733] sd 0:0:1:1: task abort: SUCCESS scmd(ffff9950efed7480) [ 6085.264655] sd 0:0:1:1: attempting task abort! scmd(ffff9950efed72c0) [ 6085.271842] sd 0:0:1:1: [sdi] tag#66 CDB: Write(16) 8a 00 00 00 00 00 02 a8 30 60 00 00 00 18 00 00 [ 6085.281965] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6085.290713] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6085.298986] sd 0:0:1:1: task abort: SUCCESS scmd(ffff9950efed72c0) [ 6085.305894] sd 0:0:1:1: attempting task abort! scmd(ffff9950efed7100) [ 6085.313091] sd 0:0:1:1: [sdi] tag#65 CDB: Write(16) 8a 00 00 00 00 00 02 a8 30 38 00 00 00 20 00 00 [ 6085.323190] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6085.331928] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6085.340192] sd 0:0:1:1: task abort: SUCCESS scmd(ffff9950efed7100) [ 6085.347100] sd 0:0:1:1: attempting task abort! scmd(ffff9950efed6f40) [ 6085.354291] sd 0:0:1:1: [sdi] tag#64 CDB: Write(16) 8a 00 00 00 00 00 02 a8 30 20 00 00 00 08 00 00 [ 6085.364391] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6085.373130] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6085.381387] sd 0:0:1:1: task abort: SUCCESS scmd(ffff9950efed6f40) [ 6085.388287] sd 0:0:1:1: attempting task abort! scmd(ffff9950efed6d80) [ 6085.395484] sd 0:0:1:1: [sdi] tag#63 CDB: Write(16) 8a 00 00 00 00 00 02 a8 20 a0 00 00 00 10 00 00 [ 6085.405589] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6085.414327] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6085.422584] sd 0:0:1:1: task abort: SUCCESS scmd(ffff9950efed6d80) [ 6085.429499] sd 0:0:1:1: attempting task abort! scmd(ffff9950efed6bc0) [ 6085.436695] sd 0:0:1:1: [sdi] tag#62 CDB: Write(16) 8a 00 00 00 00 00 02 a8 15 e8 00 00 00 08 00 00 [ 6085.446809] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6085.455548] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6085.463804] sd 0:0:1:1: task abort: SUCCESS scmd(ffff9950efed6bc0) [ 6085.470726] sd 0:0:1:1: attempting task abort! scmd(ffff9950efed6a00) [ 6085.477923] sd 0:0:1:1: [sdi] tag#61 CDB: Write(16) 8a 00 00 00 00 00 02 a8 02 68 00 00 00 08 00 00 [ 6085.488039] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6085.496779] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6085.505051] sd 0:0:1:1: task abort: SUCCESS scmd(ffff9950efed6a00) [ 6085.511960] sd 0:0:1:1: attempting task abort! scmd(ffff9950efed6840) [ 6085.519152] sd 0:0:1:1: [sdi] tag#60 CDB: Write(16) 8a 00 00 00 00 00 02 a8 00 d8 00 00 00 10 00 00 [ 6085.529251] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6085.537990] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6085.546248] sd 0:0:1:1: task abort: SUCCESS scmd(ffff9950efed6840) [ 6085.553157] sd 0:0:1:1: attempting task abort! scmd(ffff9950efed6680) [ 6085.560348] sd 0:0:1:1: [sdi] tag#59 CDB: Write(16) 8a 00 00 00 00 00 02 a8 00 c0 00 00 00 10 00 00 [ 6085.570447] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6085.579186] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6085.587451] sd 0:0:1:1: task abort: SUCCESS scmd(ffff9950efed6680) [ 6085.594358] sd 0:0:1:1: attempting task abort! scmd(ffff9950efed6300) [ 6085.601551] sd 0:0:1:1: [sdi] tag#58 CDB: Write(16) 8a 00 00 00 00 00 02 a8 00 a8 00 00 00 10 00 00 [ 6085.611650] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6085.620388] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6085.628661] sd 0:0:1:1: task abort: SUCCESS scmd(ffff9950efed6300) [ 6085.635576] sd 0:0:1:1: attempting task abort! scmd(ffff9950efed6140) [ 6085.642776] sd 0:0:1:1: [sdi] tag#57 CDB: Write(16) 8a 00 00 00 00 00 02 a8 00 90 00 00 00 10 00 00 [ 6085.652884] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6085.661614] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6085.669877] sd 0:0:1:1: task abort: SUCCESS scmd(ffff9950efed6140) [ 6085.676804] sd 0:0:1:1: attempting task abort! scmd(ffff9950efed5f80) [ 6085.684014] sd 0:0:1:1: [sdi] tag#56 CDB: Write(16) 8a 00 00 00 00 00 02 a8 00 78 00 00 00 10 00 00 [ 6085.694133] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6085.702870] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6085.711133] sd 0:0:1:1: task abort: SUCCESS scmd(ffff9950efed5f80) [ 6085.718062] sd 0:0:1:1: attempting task abort! scmd(ffff9950efed5dc0) [ 6085.725255] sd 0:0:1:1: [sdi] tag#55 CDB: Write(16) 8a 00 00 00 00 00 02 90 4c e0 00 00 03 e0 00 00 [ 6085.735354] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6085.744086] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6085.752342] sd 0:0:1:1: task abort: SUCCESS scmd(ffff9950efed5dc0) [ 6085.759253] sd 0:0:1:1: attempting task abort! scmd(ffff9950f52de300) [ 6085.766452] sd 0:0:1:1: [sdi] tag#33 CDB: Write(16) 8a 00 00 00 00 00 08 c0 00 80 00 00 00 08 00 00 [ 6085.776544] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6085.785281] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6085.793540] sd 0:0:1:1: task abort: SUCCESS scmd(ffff9950f52de300) [ 6085.800455] sd 0:0:1:1: attempting task abort! scmd(ffff9950f52de4c0) [ 6085.807648] sd 0:0:1:1: [sdi] tag#32 CDB: Write(16) 8a 00 00 00 00 00 08 c0 00 48 00 00 00 08 00 00 [ 6085.817768] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6085.826507] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6085.834763] sd 0:0:1:1: task abort: SUCCESS scmd(ffff9950f52de4c0) [ 6085.841682] sd 0:0:1:1: attempting task abort! scmd(ffff9950f52de680) [ 6085.848881] sd 0:0:1:1: [sdi] tag#31 CDB: Write(16) 8a 00 00 00 00 00 08 64 00 90 00 00 00 08 00 00 [ 6085.858990] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6085.867730] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6085.876002] sd 0:0:1:1: task abort: SUCCESS scmd(ffff9950f52de680) [ 6085.882910] sd 0:0:1:1: attempting task abort! scmd(ffff9950f52de840) [ 6085.890104] sd 0:0:1:1: [sdi] tag#30 CDB: Write(16) 8a 00 00 00 00 00 08 64 00 70 00 00 00 08 00 00 [ 6085.900204] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6085.908941] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6085.917198] sd 0:0:1:1: task abort: SUCCESS scmd(ffff9950f52de840) [ 6085.924111] sd 0:0:1:1: attempting task abort! scmd(ffff9950f52dea00) [ 6085.931305] sd 0:0:1:1: [sdi] tag#29 CDB: Write(16) 8a 00 00 00 00 00 08 40 01 e0 00 00 00 10 00 00 [ 6085.941405] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6085.950143] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6085.958398] sd 0:0:1:1: task abort: SUCCESS scmd(ffff9950f52dea00) [ 6085.965304] sd 0:0:1:1: attempting task abort! scmd(ffff9950f52debc0) [ 6085.972501] sd 0:0:1:1: [sdi] tag#28 CDB: Write(16) 8a 00 00 00 00 00 08 40 00 80 00 00 00 08 00 00 [ 6085.982617] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6085.991356] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6085.999610] sd 0:0:1:1: task abort: SUCCESS scmd(ffff9950f52debc0) [ 6086.006517] sd 0:0:1:1: attempting task abort! scmd(ffff9950f52ded80) [ 6086.013713] sd 0:0:1:1: [sdi] tag#27 CDB: Write(16) 8a 00 00 00 00 00 08 40 00 48 00 00 00 08 00 00 [ 6086.023825] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6086.032563] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6086.040827] sd 0:0:1:1: task abort: SUCCESS scmd(ffff9950f52ded80) [ 6086.047748] sd 0:0:1:1: attempting task abort! scmd(ffff9950f52def40) [ 6086.054943] sd 0:0:1:1: [sdi] tag#26 CDB: Write(16) 8a 00 00 00 00 00 08 24 00 58 00 00 00 08 00 00 [ 6086.065059] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6086.073798] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6086.082062] sd 0:0:1:1: task abort: SUCCESS scmd(ffff9950f52def40) [ 6086.088962] sd 0:0:1:1: attempting task abort! scmd(ffff9950f52df100) [ 6086.096144] sd 0:0:1:1: [sdi] tag#25 CDB: Write(16) 8a 00 00 00 00 00 08 00 01 e8 00 00 00 08 00 00 [ 6086.106254] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6086.114993] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6086.123248] sd 0:0:1:1: task abort: SUCCESS scmd(ffff9950f52df100) [ 6086.130154] sd 0:0:1:1: attempting task abort! scmd(ffff9950f52df2c0) [ 6086.137345] sd 0:0:1:1: [sdi] tag#24 CDB: Write(16) 8a 00 00 00 00 00 08 00 00 80 00 00 00 08 00 00 [ 6086.147455] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6086.156196] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6086.164462] sd 0:0:1:1: task abort: SUCCESS scmd(ffff9950f52df2c0) [ 6086.171368] sd 0:0:1:1: attempting task abort! scmd(ffff9950f52df480) [ 6086.178566] sd 0:0:1:1: [sdi] tag#23 CDB: Write(16) 8a 00 00 00 00 00 08 00 00 48 00 00 00 08 00 00 [ 6086.188682] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6086.197419] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6086.205674] sd 0:0:1:1: task abort: SUCCESS scmd(ffff9950f52df480) [ 6086.212582] sd 0:0:1:1: attempting task abort! scmd(ffff9950f52df640) [ 6086.219779] sd 0:0:1:1: [sdi] tag#22 CDB: Write(16) 8a 00 00 00 00 00 07 d0 03 e8 00 00 00 08 00 00 [ 6086.229885] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6086.238624] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6086.246895] sd 0:0:1:1: task abort: SUCCESS scmd(ffff9950f52df640) [ 6086.253802] sd 0:0:1:1: attempting task abort! scmd(ffff9950f52df800) [ 6086.261000] sd 0:0:1:1: [sdi] tag#21 CDB: Write(16) 8a 00 00 00 00 00 07 c0 01 e8 00 00 00 08 00 00 [ 6086.271101] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6086.279838] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6086.288095] sd 0:0:1:1: task abort: SUCCESS scmd(ffff9950f52df800) [ 6086.295002] sd 0:0:1:1: attempting task abort! scmd(ffff9950f52df9c0) [ 6086.302194] sd 0:0:1:1: [sdi] tag#20 CDB: Write(16) 8a 00 00 00 00 00 07 c0 00 80 00 00 00 08 00 00 [ 6086.312304] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6086.321041] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6086.329298] sd 0:0:1:1: task abort: SUCCESS scmd(ffff9950f52df9c0) [ 6086.336197] sd 0:0:1:1: attempting task abort! scmd(ffff9950f52dfb80) [ 6086.343388] sd 0:0:1:1: [sdi] tag#19 CDB: Write(16) 8a 00 00 00 00 00 07 c0 00 20 00 00 00 08 00 00 [ 6086.353501] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6086.362235] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6086.370500] sd 0:0:1:1: task abort: SUCCESS scmd(ffff9950f52dfb80) [ 6086.377413] sd 0:0:1:1: attempting task abort! scmd(ffff9950f52dfd40) [ 6086.384604] sd 0:0:1:1: [sdi] tag#18 CDB: Write(16) 8a 00 00 00 00 00 07 a0 00 d0 00 00 00 08 00 00 [ 6086.394714] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6086.403459] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6086.411723] sd 0:0:1:1: task abort: SUCCESS scmd(ffff9950f52dfd40) [ 6086.418630] sd 0:0:1:1: attempting task abort! scmd(ffff99516698d880) [ 6086.425827] sd 0:0:1:1: [sdi] tag#17 CDB: Write(16) 8a 00 00 00 00 00 07 80 01 e8 00 00 00 08 00 00 [ 6086.435942] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6086.444679] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6086.452941] sd 0:0:1:1: task abort: SUCCESS scmd(ffff99516698d880) [ 6086.459846] sd 0:0:1:1: attempting task abort! scmd(ffff99516698f640) [ 6086.467036] sd 0:0:1:1: [sdi] tag#16 CDB: Write(16) 8a 00 00 00 00 00 07 80 00 80 00 00 00 08 00 00 [ 6086.477136] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6086.485873] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6086.494136] sd 0:0:1:1: task abort: SUCCESS scmd(ffff99516698f640) [ 6086.501044] sd 0:0:1:1: attempting task abort! scmd(ffff99516698f480) [ 6086.508234] sd 0:0:1:1: [sdi] tag#15 CDB: Write(16) 8a 00 00 00 00 00 07 80 00 40 00 00 00 08 00 00 [ 6086.518344] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6086.527084] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6086.535339] sd 0:0:1:1: task abort: SUCCESS scmd(ffff99516698f480) [ 6086.542247] sd 0:0:1:1: attempting task abort! scmd(ffff99516698f2c0) [ 6086.549444] sd 0:0:1:1: [sdi] tag#14 CDB: Write(16) 8a 00 00 00 00 00 07 64 00 50 00 00 00 08 00 00 [ 6086.559551] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6086.568289] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6086.576546] sd 0:0:1:1: task abort: SUCCESS scmd(ffff99516698f2c0) [ 6086.583443] sd 0:0:1:1: attempting task abort! scmd(ffff99516698f100) [ 6086.590638] sd 0:0:1:1: [sdi] tag#13 CDB: Write(16) 8a 00 00 00 00 00 07 40 01 e0 00 00 00 08 00 00 [ 6086.600754] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6086.609493] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6086.617765] sd 0:0:1:1: task abort: SUCCESS scmd(ffff99516698f100) [ 6086.624680] sd 0:0:1:1: attempting task abort! scmd(ffff99516698ef40) [ 6086.631877] sd 0:0:1:1: [sdi] tag#12 CDB: Write(16) 8a 00 00 00 00 00 07 24 00 78 00 00 00 08 00 00 [ 6086.641983] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6086.650721] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6086.658979] sd 0:0:1:1: task abort: SUCCESS scmd(ffff99516698ef40) [ 6086.665886] sd 0:0:1:1: attempting task abort! scmd(ffff99516698ed80) [ 6086.673078] sd 0:0:1:1: [sdi] tag#11 CDB: Write(16) 8a 00 00 00 00 00 07 24 00 40 00 00 00 08 00 00 [ 6086.683189] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6086.691927] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6086.700192] sd 0:0:1:1: task abort: SUCCESS scmd(ffff99516698ed80) [ 6086.707101] sd 0:0:1:1: attempting task abort! scmd(ffff99516698ebc0) [ 6086.714294] sd 0:0:1:1: [sdi] tag#10 CDB: Write(16) 8a 00 00 00 00 00 07 00 01 e8 00 00 00 08 00 00 [ 6086.724403] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6086.733143] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6086.741405] sd 0:0:1:1: task abort: SUCCESS scmd(ffff99516698ebc0) [ 6086.748312] sd 0:0:1:1: attempting task abort! scmd(ffff99516698ea00) [ 6086.755509] sd 0:0:1:1: [sdi] tag#9 CDB: Write(16) 8a 00 00 00 00 00 07 00 00 80 00 00 00 08 00 00 [ 6086.765527] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6086.774266] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6086.782521] sd 0:0:1:1: task abort: SUCCESS scmd(ffff99516698ea00) [ 6086.789422] sd 0:0:1:1: attempting task abort! scmd(ffff99516698e840) [ 6086.796619] sd 0:0:1:1: [sdi] tag#8 CDB: Write(16) 8a 00 00 00 00 00 07 00 00 48 00 00 00 08 00 00 [ 6086.806624] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6086.815361] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6086.823625] sd 0:0:1:1: task abort: SUCCESS scmd(ffff99516698e840) [ 6086.830525] sd 0:0:1:1: attempting task abort! scmd(ffff99516698e680) [ 6086.837720] sd 0:0:1:1: [sdi] tag#7 CDB: Write(16) 8a 00 00 00 00 00 06 e4 00 50 00 00 00 08 00 00 [ 6086.847735] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6086.856473] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6086.864738] sd 0:0:1:1: task abort: SUCCESS scmd(ffff99516698e680) [ 6086.871644] sd 0:0:1:1: attempting task abort! scmd(ffff99516698e4c0) [ 6086.878842] sd 0:0:1:1: [sdi] tag#6 CDB: Write(16) 8a 00 00 00 00 00 06 a4 00 f0 00 00 00 08 00 00 [ 6086.888860] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6086.897599] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6086.905862] sd 0:0:1:1: task abort: SUCCESS scmd(ffff99516698e4c0) [ 6086.912783] sd 0:0:1:1: attempting task abort! scmd(ffff99516698e300) [ 6086.919985] sd 0:0:1:1: [sdi] tag#5 CDB: Write(16) 8a 00 00 00 00 00 06 a4 00 00 00 00 00 08 00 00 [ 6086.929996] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6086.938735] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6086.947004] sd 0:0:1:1: task abort: SUCCESS scmd(ffff99516698e300) [ 6086.953910] sd 0:0:1:1: attempting task abort! scmd(ffff99516698e140) [ 6086.961109] sd 0:0:1:1: [sdi] tag#4 CDB: Write(16) 8a 00 00 00 00 00 06 80 01 e8 00 00 00 08 00 00 [ 6086.971121] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6086.979859] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6086.988124] sd 0:0:1:1: task abort: SUCCESS scmd(ffff99516698e140) [ 6086.995032] sd 0:0:1:1: attempting task abort! scmd(ffff99516698df80) [ 6087.002214] sd 0:0:1:1: [sdi] tag#3 CDB: Write(16) 8a 00 00 00 00 00 06 80 00 80 00 00 00 08 00 00 [ 6087.012226] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6087.020963] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6087.029219] sd 0:0:1:1: task abort: SUCCESS scmd(ffff99516698df80) [ 6087.036126] sd 0:0:1:1: attempting task abort! scmd(ffff99516698ddc0) [ 6087.043316] sd 0:0:1:1: [sdi] tag#2 CDB: Write(16) 8a 00 00 00 00 00 06 80 00 48 00 00 00 08 00 00 [ 6087.053329] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6087.062066] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6087.070322] sd 0:0:1:1: task abort: SUCCESS scmd(ffff99516698ddc0) [ 6087.077227] sd 0:0:1:1: attempting task abort! scmd(ffff99516698dc00) [ 6087.084425] sd 0:0:1:1: [sdi] tag#1 CDB: Write(16) 8a 00 00 00 00 00 00 b1 23 78 00 00 00 08 00 00 [ 6087.094440] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6087.103177] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6087.111439] sd 0:0:1:1: task abort: SUCCESS scmd(ffff99516698dc00) [ 6087.118344] sd 0:0:1:1: attempting task abort! scmd(ffff99516698da40) [ 6087.125540] sd 0:0:1:1: [sdi] tag#0 CDB: Write(16) 8a 08 00 00 00 00 00 5f 5c e8 00 00 00 08 00 00 [ 6087.135558] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6087.144295] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6087.152550] sd 0:0:1:1: task abort: SUCCESS scmd(ffff99516698da40) [ 6478.774747] sd 0:0:1:1: attempting task abort! scmd(ffff9950f0327640) [ 6478.781974] sd 0:0:1:1: [sdi] tag#30 CDB: Write(16) 8a 00 00 00 00 00 00 00 03 c8 00 00 00 30 00 00 [ 6478.792103] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 6478.800860] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 6478.811626] sd 0:0:1:1: task abort: SUCCESS scmd(ffff9950f0327640) [ 7496.329274] Lustre: 5141:0:(mdd_device.c:1825:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1 [ 7841.710810] sd 0:0:1:1: attempting task abort! scmd(ffff994d057e7b80) [ 7841.718050] sd 0:0:1:1: [sdi] tag#106 CDB: Write(16) 8a 00 00 00 00 00 00 00 03 c0 00 00 00 10 00 00 [ 7841.728277] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 7841.737027] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 7841.799524] sd 0:0:1:1: task abort: SUCCESS scmd(ffff994d057e7b80) [ 7841.806510] sd 0:0:1:1: attempting task abort! scmd(ffff994d057e79c0) [ 7841.813740] sd 0:0:1:1: [sdi] tag#105 CDB: Write(16) 8a 00 00 00 00 00 00 00 03 a0 00 00 00 10 00 00 [ 7841.823953] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 7841.832701] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 7841.870378] sd 0:0:1:1: task abort: SUCCESS scmd(ffff994d057e79c0) [ 7841.877323] sd 0:0:1:1: attempting task abort! scmd(ffff994d057e7800) [ 7841.884531] sd 0:0:1:1: [sdi] tag#104 CDB: Write(16) 8a 00 00 00 00 00 00 00 03 68 00 00 00 30 00 00 [ 7841.894738] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 7841.903480] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 7841.922902] sd 0:0:1:1: task abort: SUCCESS scmd(ffff994d057e7800) [ 7841.929832] sd 0:0:1:1: attempting task abort! scmd(ffff994d057e7640) [ 7841.937048] sd 0:0:1:1: [sdi] tag#103 CDB: Write(16) 8a 00 00 00 00 00 00 00 03 38 00 00 00 28 00 00 [ 7841.947258] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 7841.956003] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 7841.988492] sd 0:0:1:1: task abort: SUCCESS scmd(ffff994d057e7640) [ 7841.995436] sd 0:0:1:1: attempting task abort! scmd(ffff994d057e7480) [ 7842.002647] sd 0:0:1:1: [sdi] tag#102 CDB: Write(16) 8a 00 00 00 00 00 00 00 03 20 00 00 00 08 00 00 [ 7842.012876] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 7842.021623] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 7842.042823] sd 0:0:1:1: task abort: SUCCESS scmd(ffff994d057e7480) [ 7842.049806] sd 0:0:1:1: attempting task abort! scmd(ffff994d057e72c0) [ 7842.057012] sd 0:0:1:1: [sdi] tag#101 CDB: Write(16) 8a 00 00 00 00 00 00 00 02 f8 00 00 00 08 00 00 [ 7842.067221] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 7842.075968] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 7842.100025] sd 0:0:1:1: task abort: SUCCESS scmd(ffff994d057e72c0) [ 7842.106949] sd 0:0:1:1: attempting task abort! scmd(ffff994d057e7100) [ 7842.114158] sd 0:0:1:1: [sdi] tag#100 CDB: Write(16) 8a 00 00 00 00 00 00 00 02 e0 00 00 00 10 00 00 [ 7842.124368] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 7842.133108] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 7842.165086] sd 0:0:1:1: task abort: SUCCESS scmd(ffff994d057e7100) [ 7842.172024] sd 0:0:1:1: attempting task abort! scmd(ffff994d057e6f40) [ 7842.179240] sd 0:0:1:1: [sdi] tag#99 CDB: Write(16) 8a 00 00 00 00 00 00 00 02 b8 00 00 00 10 00 00 [ 7842.189358] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 7842.198101] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 7842.226667] sd 0:0:1:1: task abort: SUCCESS scmd(ffff994d057e6f40) [ 7842.233658] sd 0:0:1:1: attempting task abort! scmd(ffff994d057e6d80) [ 7842.240864] sd 0:0:1:1: [sdi] tag#98 CDB: Write(16) 8a 00 00 00 00 00 00 00 02 98 00 00 00 08 00 00 [ 7842.250982] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 7842.259727] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 7842.277493] sd 0:0:1:1: task abort: SUCCESS scmd(ffff994d057e6d80) [ 7842.284456] sd 0:0:1:1: attempting task abort! scmd(ffff994d057e6bc0) [ 7842.291667] sd 0:0:1:1: [sdi] tag#97 CDB: Write(16) 8a 00 00 00 00 00 00 00 02 78 00 00 00 08 00 00 [ 7842.301788] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 7842.310540] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 7842.368591] sd 0:0:1:1: task abort: SUCCESS scmd(ffff994d057e6bc0) [ 7842.375533] sd 0:0:1:1: attempting task abort! scmd(ffff994d057e6a00) [ 7842.382748] sd 0:0:1:1: [sdi] tag#96 CDB: Write(16) 8a 00 00 00 00 00 00 00 02 68 00 00 00 08 00 00 [ 7842.392871] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 7842.401613] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 7842.433047] sd 0:0:1:1: task abort: SUCCESS scmd(ffff994d057e6a00) [ 7842.440006] sd 0:0:1:1: attempting task abort! scmd(ffff994d057e6840) [ 7842.447223] sd 0:0:1:1: [sdi] tag#95 CDB: Write(16) 8a 00 00 00 00 00 00 00 02 50 00 00 00 10 00 00 [ 7842.457340] scsi target0:0:1: handle(0x0009), sas_address(0x50080e52ff4f0004), phy(0) [ 7842.466093] scsi target0:0:1: enclosure logical id(0x500605b005d6e9a0), slot(3) [ 7842.476466] sd 0:0:1:1: task abort: SUCCESS scmd(ffff994d057e6840) [ 8417.789048] LustreError: 4928:0:(out_handler.c:918:out_tx_end()) soaked-MDT0000-osd: undo for /tmp/rpmbuild-lustre-jenkins-UoS8uXZU/BUILD/lustre-2.13.53_18_g6706bfa/lustre/ptlrpc/../../lustre/target/out_handler.c:453: rc = -524 [ 8417.811600] LustreError: 4928:0:(out_handler.c:918:out_tx_end()) Skipped 1003 previous similar messages [ 8450.797303] LustreError: 5185:0:(out_handler.c:918:out_tx_end()) soaked-MDT0000-osd: undo for /tmp/rpmbuild-lustre-jenkins-UoS8uXZU/BUILD/lustre-2.13.53_18_g6706bfa/lustre/ptlrpc/../../lustre/target/out_handler.c:453: rc = -524 [ 8450.819865] LustreError: 5185:0:(out_handler.c:918:out_tx_end()) Skipped 9395 previous similar messages [ 8472.277126] LustreError: 4997:0:(llog_cat.c:756:llog_cat_cancel_arr_rec()) soaked-MDT0001-osp-MDT0000: fail to cancel 1 llog-records: rc = -116 [ 8472.291549] LustreError: 4997:0:(llog_cat.c:756:llog_cat_cancel_arr_rec()) Skipped 845 previous similar messages [ 8472.302927] LustreError: 4997:0:(llog_cat.c:793:llog_cat_cancel_records()) soaked-MDT0001-osp-MDT0000: fail to cancel 1 of 1 llog-records: rc = -116 [ 8472.317782] LustreError: 4997:0:(llog_cat.c:793:llog_cat_cancel_records()) Skipped 845 previous similar messages [ 8476.286206] LustreError: 4997:0:(llog_cat.c:756:llog_cat_cancel_arr_rec()) soaked-MDT0001-osp-MDT0000: fail to cancel 1 llog-records: rc = -2 [ 8476.300417] LustreError: 4997:0:(llog_cat.c:756:llog_cat_cancel_arr_rec()) Skipped 691 previous similar messages [ 8476.311822] LustreError: 4997:0:(llog_cat.c:793:llog_cat_cancel_records()) soaked-MDT0001-osp-MDT0000: fail to cancel 1 of 1 llog-records: rc = -2 [ 8476.326510] LustreError: 4997:0:(llog_cat.c:793:llog_cat_cancel_records()) Skipped 691 previous similar messages [ 8477.026052] LustreError: 6068:0:(llog_osd.c:616:llog_osd_write_rec()) soaked-MDT0001-osp-MDT0000: index 51737 already set in log bitmap [ 8477.039690] LustreError: 6068:0:(llog_osd.c:618:llog_osd_write_rec()) LBUG [ 8477.047374] Pid: 6068, comm: mdt00_014 3.10.0-1062.9.1.el7_lustre.x86_64 #1 SMP Tue Feb 11 19:11:56 UTC 2020 [ 8477.058350] Call Trace: [ 8477.061102] [] libcfs_call_trace+0x8c/0xc0 [libcfs] [ 8477.068431] [] lbug_with_loc+0x4c/0xa0 [libcfs] [ 8477.075363] [] llog_osd_write_rec+0x1395/0x14b0 [obdclass] [ 8477.083398] [] llog_write_rec+0x273/0x540 [obdclass] [ 8477.090833] [] llog_cat_add_rec+0x220/0x880 [obdclass] [ 8477.098462] [] llog_add+0x162/0x1d0 [obdclass] [ 8477.105310] [] sub_updates_write+0x2e8/0xdd7 [ptlrpc] [ 8477.112896] [] top_trans_stop+0x827/0xbc0 [ptlrpc] [ 8477.120186] [] lod_trans_stop+0x25c/0x340 [lod] [ 8477.127143] [] mdd_trans_stop+0x2e/0x174 [mdd] [ 8477.133989] [] mdd_create+0x1395/0x17d0 [mdd] [ 8477.140726] [] mdt_create+0xaf9/0xf90 [mdt] [ 8477.147299] [] mdt_reint_create+0x16b/0x360 [mdt] [ 8477.154426] [] mdt_reint_rec+0x83/0x210 [mdt] [ 8477.161159] [] mdt_reint_internal+0x7b0/0xba0 [mdt] [ 8477.168513] [] mdt_reint+0x67/0x140 [mdt] [ 8477.174861] [] tgt_request_handle+0x95a/0x1630 [ptlrpc] [ 8477.182625] [] ptlrpc_server_handle_request+0x256/0xb10 [ptlrpc] [ 8477.191267] [] ptlrpc_main+0xbb4/0x1550 [ptlrpc] [ 8477.198350] [] kthread+0xd1/0xe0 [ 8477.203825] [] ret_from_fork_nospec_end+0x0/0x39 [ 8477.210849] [] 0xffffffffffffffff [ 8477.216621] LustreError: dumping log to /tmp/lustre-log.1588133843.6068 [ 8498.690416] LNetError: 4841:0:(o2iblnd_cb.c:3348:kiblnd_check_txs_locked()) Timed out tx: active_txs, 0 seconds [ 8498.701700] LNetError: 4841:0:(o2iblnd_cb.c:3423:kiblnd_check_conns()) Timed out RDMA with 192.168.1.104@o2ib (7): c: 4, oc: 0, rc: 8 [ 8499.690377] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.104@o2ib: 1 seconds [ 8499.701750] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 25 previous similar messages [ 8500.402310] Lustre: 4875:0:(client.c:2229:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1588133859/real 0] req@ffff995115a26300 x1665270491857024/t0(0) o13->soaked-OST0004-osc-MDT0000@192.168.1.104@o2ib:7/4 lens 224/368 e 0 to 1 dl 1588133866 ref 2 fl Rpc:Xr/0/ffffffff rc 0/-1 job:'' [ 8500.402325] Lustre: soaked-OST0000-osc-MDT0000: Connection to soaked-OST0000 (at 192.168.1.104@o2ib) was lost; in progress operations using this service will wait for recovery to complete [ 8500.452639] Lustre: 4875:0:(client.c:2229:ptlrpc_expire_one_request()) Skipped 1 previous similar message [ 8503.690099] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.104@o2ib) recovery failed with -110 [ 8503.703322] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 11 previous similar messages [ 8503.714934] LNetError: 4846:0:(lib-move.c:3646:lnet_handle_recovery_reply()) local NI (192.168.1.108@o2ib) recovery failed with -110 [ 8566.686010] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.104@o2ib: 0 seconds [ 8566.697384] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 31 previous similar messages [ 8572.685654] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.104@o2ib) recovery failed with -110 [ 8572.698882] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 13 previous similar messages [ 8640.698273] INFO: task dist_txn-0:4997 blocked for more than 120 seconds. [ 8640.705873] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 8640.714637] dist_txn-0 D ffff99514132d230 0 4997 2 0x00000080 [ 8640.722554] Call Trace: [ 8640.725303] [] schedule+0x29/0x70 [ 8640.730880] [] rwsem_down_write_failed+0x215/0x3c0 [ 8640.738145] [] ? llog_osd_regular_fid_del_name_entry+0x272/0x500 [obdclass] [ 8640.747789] [] call_rwsem_down_write_failed+0x17/0x30 [ 8640.755293] [] down_write+0x2d/0x3d [ 8640.761072] [] llog_cancel_arr_rec+0x14c/0x970 [obdclass] [ 8640.768990] [] llog_cat_cancel_arr_rec+0xd4/0x470 [obdclass] [ 8640.777195] [] llog_cat_cancel_records+0x77/0x1c0 [obdclass] [ 8640.785465] [] distribute_txn_commit_thread+0x5a9/0xc90 [ptlrpc] [ 8640.794053] [] ? wake_up_atomic_t+0x30/0x30 [ 8640.800630] [] ? sub_trans_commit_cb+0x20/0x20 [ptlrpc] [ 8640.808323] [] kthread+0xd1/0xe0 [ 8640.813778] [] ? insert_kthread_work+0x40/0x40 [ 8640.820611] [] ret_from_fork_nospec_begin+0x21/0x21 [ 8640.827910] [] ? insert_kthread_work+0x40/0x40 [ 8640.834745] INFO: task mdt00_014:6068 blocked for more than 120 seconds. [ 8640.842234] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 8640.850986] mdt00_014 D ffff994d6892b150 0 6068 2 0x00000080 [ 8640.858946] Call Trace: [ 8640.861704] [] ? wake_up_state+0x20/0x20 [ 8640.867940] [] schedule+0x29/0x70 [ 8640.873515] [] lbug_with_loc+0x7d/0xa0 [libcfs] [ 8640.880465] [] llog_osd_write_rec+0x1395/0x14b0 [obdclass] [ 8640.888446] [] ? __wake_up_common_lock+0x91/0xc0 [ 8640.895474] [] llog_write_rec+0x273/0x540 [obdclass] [ 8640.902880] [] llog_cat_add_rec+0x220/0x880 [obdclass] [ 8640.910477] [] llog_add+0x162/0x1d0 [obdclass] [ 8640.917308] [] ? lprocfs_counter_add+0xf9/0x160 [obdclass] [ 8640.925316] [] sub_updates_write+0x2e8/0xdd7 [ptlrpc] [ 8640.932840] [] ? prepare_writing_updates.isra.12+0x139/0x14a [ptlrpc] [ 8640.941927] [] top_trans_stop+0x827/0xbc0 [ptlrpc] [ 8640.949169] [] ? lod_sub_ref_add+0x1be/0x450 [lod] [ 8640.956383] [] lod_trans_stop+0x25c/0x340 [lod] [ 8640.963319] [] ? mdd_changelog_ns_store+0x30/0x8d0 [mdd] [ 8640.971118] [] ? mdd_links_rename+0x242/0x420 [mdd] [ 8640.978447] [] mdd_trans_stop+0x2e/0x174 [mdd] [ 8640.985280] [] mdd_create+0x1395/0x17d0 [mdd] [ 8640.992032] [] mdt_create+0xaf9/0xf90 [mdt] [ 8640.998567] [] ? lprocfs_stats_lock+0x24/0xd0 [obdclass] [ 8641.006358] [] mdt_reint_create+0x16b/0x360 [mdt] [ 8641.013468] [] mdt_reint_rec+0x83/0x210 [mdt] [ 8641.020202] [] mdt_reint_internal+0x7b0/0xba0 [mdt] [ 8641.027515] [] mdt_reint+0x67/0x140 [mdt] [ 8641.033889] [] tgt_request_handle+0x95a/0x1630 [ptlrpc] [ 8641.041602] [] ? ktime_get_real_seconds+0xe/0x10 [libcfs] [ 8641.049531] [] ptlrpc_server_handle_request+0x256/0xb10 [ptlrpc] [ 8641.058137] [] ? ptlrpc_wait_event+0x12e/0x5b0 [ptlrpc] [ 8641.065834] [] ? __wake_up+0x13/0x20 [ 8641.071700] [] ? ptlrpc_server_handle_req_in+0x92a/0x1100 [ptlrpc] [ 8641.080460] [] ? wake_up_atomic_t+0x30/0x30 [ 8641.087008] [] ptlrpc_main+0xbb4/0x1550 [ptlrpc] [ 8641.094048] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [ 8641.102323] [] kthread+0xd1/0xe0 [ 8641.107792] [] ? insert_kthread_work+0x40/0x40 [ 8641.114610] [] ret_from_fork_nospec_begin+0x21/0x21 [ 8641.121908] [] ? insert_kthread_work+0x40/0x40 [ 8677.278880] ptlrpc_watchdog_fire: 15 callbacks suppressed [ 8677.278903] Lustre: mdt00_012: service thread pid 5723 was inactive for 200.295 seconds. Watchdog stack traces are limited to 3 per 300 seconds, skipping this one. [ 8677.301254] Lustre: mdt00_014: service thread pid 6068 was inactive for 200.295 seconds. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes: [ 8677.322148] Pid: 6068, comm: mdt00_014 3.10.0-1062.9.1.el7_lustre.x86_64 #1 SMP Tue Feb 11 19:11:56 UTC 2020 [ 8677.333133] Call Trace: [ 8677.335906] [] lbug_with_loc+0x7d/0xa0 [libcfs] [ 8677.342858] [] llog_osd_write_rec+0x1395/0x14b0 [obdclass] [ 8677.350935] [] llog_write_rec+0x273/0x540 [obdclass] [ 8677.358385] [] llog_cat_add_rec+0x220/0x880 [obdclass] [ 8677.366013] [] llog_add+0x162/0x1d0 [obdclass] [ 8677.372885] [] sub_updates_write+0x2e8/0xdd7 [ptlrpc] [ 8677.380476] [] top_trans_stop+0x827/0xbc0 [ptlrpc] [ 8677.387774] [] lod_trans_stop+0x25c/0x340 [lod] [ 8677.394738] [] mdd_trans_stop+0x2e/0x174 [mdd] [ 8677.401596] [] mdd_create+0x1395/0x17d0 [mdd] [ 8677.408348] [] mdt_create+0xaf9/0xf90 [mdt] [ 8677.414907] [] mdt_reint_create+0x16b/0x360 [mdt] [ 8677.422042] [] mdt_reint_rec+0x83/0x210 [mdt] [ 8677.428797] [] mdt_reint_internal+0x7b0/0xba0 [mdt] [ 8677.436115] [] mdt_reint+0x67/0x140 [mdt] [ 8677.442467] [] tgt_request_handle+0x95a/0x1630 [ptlrpc] [ 8677.450213] [] ptlrpc_server_handle_request+0x256/0xb10 [ptlrpc] [ 8677.458832] [] ptlrpc_main+0xbb4/0x1550 [ptlrpc] [ 8677.465913] [] kthread+0xd1/0xe0 [ 8677.471404] [] ret_from_fork_nospec_end+0x0/0x39 [ 8677.478430] [] 0xffffffffffffffff [ 8695.706779] Lustre: soaked-MDT0000: haven't heard from client soaked-MDT0000-lwp-OST0008_UUID (at 192.168.1.104@o2ib) in 227 seconds. I think it's dead, and I am evicting it. exp ffff994d2ecbbc00, cur 1588134062 expire 1588133912 last 1588133835 [ 8695.731240] Lustre: Skipped 4 previous similar messages [ 8696.677631] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.104@o2ib: 0 seconds [ 8696.689005] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 30 previous similar messages [ 8702.677280] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.104@o2ib) recovery failed with -110 [ 8702.690496] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 29 previous similar messages [ 8761.120531] INFO: task dist_txn-0:4997 blocked for more than 120 seconds. [ 8761.128134] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 8761.136892] dist_txn-0 D ffff99514132d230 0 4997 2 0x00000080 [ 8761.144842] Call Trace: [ 8761.147599] [] schedule+0x29/0x70 [ 8761.153163] [] rwsem_down_write_failed+0x215/0x3c0 [ 8761.160450] [] ? llog_osd_regular_fid_del_name_entry+0x272/0x500 [obdclass] [ 8761.170095] [] call_rwsem_down_write_failed+0x17/0x30 [ 8761.177597] [] down_write+0x2d/0x3d [ 8761.183390] [] llog_cancel_arr_rec+0x14c/0x970 [obdclass] [ 8761.191296] [] llog_cat_cancel_arr_rec+0xd4/0x470 [obdclass] [ 8761.199511] [] llog_cat_cancel_records+0x77/0x1c0 [obdclass] [ 8761.207800] [] distribute_txn_commit_thread+0x5a9/0xc90 [ptlrpc] [ 8761.216367] [] ? wake_up_atomic_t+0x30/0x30 [ 8761.222949] [] ? sub_trans_commit_cb+0x20/0x20 [ptlrpc] [ 8761.230643] [] kthread+0xd1/0xe0 [ 8761.236112] [] ? insert_kthread_work+0x40/0x40 [ 8761.242931] [] ret_from_fork_nospec_begin+0x21/0x21 [ 8761.250227] [] ? insert_kthread_work+0x40/0x40 [ 8761.257068] INFO: task mdt00_014:6068 blocked for more than 120 seconds. [ 8761.264580] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 8761.273341] mdt00_014 D ffff994d6892b150 0 6068 2 0x00000080 [ 8761.281275] Call Trace: [ 8761.284026] [] ? wake_up_state+0x20/0x20 [ 8761.290263] [] schedule+0x29/0x70 [ 8761.295838] [] lbug_with_loc+0x7d/0xa0 [libcfs] [ 8761.302786] [] llog_osd_write_rec+0x1395/0x14b0 [obdclass] [ 8761.310783] [] ? __wake_up_common_lock+0x91/0xc0 [ 8761.317804] [] llog_write_rec+0x273/0x540 [obdclass] [ 8761.325220] [] llog_cat_add_rec+0x220/0x880 [obdclass] [ 8761.332819] [] llog_add+0x162/0x1d0 [obdclass] [ 8761.339668] [] ? lprocfs_counter_add+0xf9/0x160 [obdclass] [ 8761.347702] [] sub_updates_write+0x2e8/0xdd7 [ptlrpc] [ 8761.355244] [] ? prepare_writing_updates.isra.12+0x139/0x14a [ptlrpc] [ 8761.364318] [] top_trans_stop+0x827/0xbc0 [ptlrpc] [ 8761.371551] [] ? lod_sub_ref_add+0x1be/0x450 [lod] [ 8761.378761] [] lod_trans_stop+0x25c/0x340 [lod] [ 8761.385693] [] ? mdd_changelog_ns_store+0x30/0x8d0 [mdd] [ 8761.393485] [] ? mdd_links_rename+0x242/0x420 [mdd] [ 8761.400792] [] mdd_trans_stop+0x2e/0x174 [mdd] [ 8761.407615] [] mdd_create+0x1395/0x17d0 [mdd] [ 8761.414373] [] mdt_create+0xaf9/0xf90 [mdt] [ 8761.420912] [] ? lprocfs_stats_lock+0x24/0xd0 [obdclass] [ 8761.428710] [] mdt_reint_create+0x16b/0x360 [mdt] [ 8761.435820] [] mdt_reint_rec+0x83/0x210 [mdt] [ 8761.442551] [] mdt_reint_internal+0x7b0/0xba0 [mdt] [ 8761.449857] [] mdt_reint+0x67/0x140 [mdt] [ 8761.456222] [] tgt_request_handle+0x95a/0x1630 [ptlrpc] [ 8761.463927] [] ? ktime_get_real_seconds+0xe/0x10 [libcfs] [ 8761.471844] [] ptlrpc_server_handle_request+0x256/0xb10 [ptlrpc] [ 8761.480457] [] ? ptlrpc_wait_event+0x12e/0x5b0 [ptlrpc] [ 8761.488160] [] ? __wake_up+0x13/0x20 [ 8761.494037] [] ? ptlrpc_server_handle_req_in+0x92a/0x1100 [ptlrpc] [ 8761.502798] [] ? wake_up_atomic_t+0x30/0x30 [ 8761.509351] [] ptlrpc_main+0xbb4/0x1550 [ptlrpc] [ 8761.516389] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [ 8761.524659] [] kthread+0xd1/0xe0 [ 8761.530122] [] ? insert_kthread_work+0x40/0x40 [ 8761.536943] [] ret_from_fork_nospec_begin+0x21/0x21 [ 8761.544253] [] ? insert_kthread_work+0x40/0x40 [ 8776.977454] Lustre: soaked-MDT0001-osp-MDT0000: Connection to soaked-MDT0001 (at 192.168.1.109@o2ib) was lost; in progress operations using this service will wait for recovery to complete [ 8776.996111] Lustre: Skipped 3 previous similar messages [ 8777.001991] LustreError: 4913:0:(ldlm_request.c:143:ldlm_expired_completion_wait()) ### lock timed out (enqueued at 1588133843, 300s ago), entering recovery for soaked-MDT0001_UUID@192.168.1.109@o2ib ns: soaked-MDT0001-osp-MDT0000 lock: ffff994d2e9ef2c0/0x7f1e5ec5067444f8 lrc: 4/0,1 mode: --/EX res: [0x2400105e7:0xda77:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x1000001000000 nid: local remote: 0xcfe18704a1dbb81a expref: -99 pid: 4913 timeout: 0 lvb_type: 0 [ 8777.001996] LustreError: 5723:0:(ldlm_request.c:143:ldlm_expired_completion_wait()) ### lock timed out (enqueued at 1588133843, 300s ago), entering recovery for soaked-MDT0001_UUID@192.168.1.109@o2ib ns: soaked-MDT0001-osp-MDT0000 lock: ffff994d0ae05580/0x7f1e5ec5067444f1 lrc: 4/0,1 mode: --/EX res: [0x2400105e7:0xda77:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x1400401000000 nid: local remote: 0xcfe18704a1dbb813 expref: -99 pid: 5723 timeout: 0 lvb_type: 0 [ 8777.121338] Lustre: soaked-MDT0001-osp-MDT0000: Connection restored to 192.168.1.109@o2ib (at 192.168.1.109@o2ib) [ 8777.132848] Lustre: Skipped 3 previous similar messages [ 8881.542762] INFO: task dist_txn-0:4997 blocked for more than 120 seconds. [ 8881.550364] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 8881.559130] dist_txn-0 D ffff99514132d230 0 4997 2 0x00000080 [ 8881.567076] Call Trace: [ 8881.569840] [] schedule+0x29/0x70 [ 8881.575410] [] rwsem_down_write_failed+0x215/0x3c0 [ 8881.582694] [] ? llog_osd_regular_fid_del_name_entry+0x272/0x500 [obdclass] [ 8881.592346] [] call_rwsem_down_write_failed+0x17/0x30 [ 8881.599841] [] down_write+0x2d/0x3d [ 8881.605629] [] llog_cancel_arr_rec+0x14c/0x970 [obdclass] [ 8881.613553] [] llog_cat_cancel_arr_rec+0xd4/0x470 [obdclass] [ 8881.621756] [] llog_cat_cancel_records+0x77/0x1c0 [obdclass] [ 8881.630058] [] distribute_txn_commit_thread+0x5a9/0xc90 [ptlrpc] [ 8881.638633] [] ? wake_up_atomic_t+0x30/0x30 [ 8881.645198] [] ? sub_trans_commit_cb+0x20/0x20 [ptlrpc] [ 8881.652892] [] kthread+0xd1/0xe0 [ 8881.658351] [] ? insert_kthread_work+0x40/0x40 [ 8881.665171] [] ret_from_fork_nospec_begin+0x21/0x21 [ 8881.672479] [] ? insert_kthread_work+0x40/0x40 [ 8881.679318] INFO: task mdt00_014:6068 blocked for more than 120 seconds. [ 8881.686816] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 8881.695568] mdt00_014 D ffff994d6892b150 0 6068 2 0x00000080 [ 8881.703487] Call Trace: [ 8881.706236] [] ? wake_up_state+0x20/0x20 [ 8881.712473] [] schedule+0x29/0x70 [ 8881.718042] [] lbug_with_loc+0x7d/0xa0 [libcfs] [ 8881.724979] [] llog_osd_write_rec+0x1395/0x14b0 [obdclass] [ 8881.732961] [] ? __wake_up_common_lock+0x91/0xc0 [ 8881.739981] [] llog_write_rec+0x273/0x540 [obdclass] [ 8881.747389] [] llog_cat_add_rec+0x220/0x880 [obdclass] [ 8881.754986] [] llog_add+0x162/0x1d0 [obdclass] [ 8881.761816] [] ? lprocfs_counter_add+0xf9/0x160 [obdclass] [ 8881.769837] [] sub_updates_write+0x2e8/0xdd7 [ptlrpc] [ 8881.777361] [] ? prepare_writing_updates.isra.12+0x139/0x14a [ptlrpc] [ 8881.786429] [] top_trans_stop+0x827/0xbc0 [ptlrpc] [ 8881.793665] [] ? lod_sub_ref_add+0x1be/0x450 [lod] [ 8881.800870] [] lod_trans_stop+0x25c/0x340 [lod] [ 8881.807801] [] ? mdd_changelog_ns_store+0x30/0x8d0 [mdd] [ 8881.815597] [] ? mdd_links_rename+0x242/0x420 [mdd] [ 8881.822902] [] mdd_trans_stop+0x2e/0x174 [mdd] [ 8881.829723] [] mdd_create+0x1395/0x17d0 [mdd] [ 8881.836466] [] mdt_create+0xaf9/0xf90 [mdt] [ 8881.843000] [] ? lprocfs_stats_lock+0x24/0xd0 [obdclass] [ 8881.850789] [] mdt_reint_create+0x16b/0x360 [mdt] [ 8881.857901] [] mdt_reint_rec+0x83/0x210 [mdt] [ 8881.864640] [] mdt_reint_internal+0x7b0/0xba0 [mdt] [ 8881.871944] [] mdt_reint+0x67/0x140 [mdt] [ 8881.878305] [] tgt_request_handle+0x95a/0x1630 [ptlrpc] [ 8881.885993] [] ? ktime_get_real_seconds+0xe/0x10 [libcfs] [ 8881.893902] [] ptlrpc_server_handle_request+0x256/0xb10 [ptlrpc] [ 8881.902486] [] ? ptlrpc_wait_event+0x12e/0x5b0 [ptlrpc] [ 8881.910173] [] ? __wake_up+0x13/0x20 [ 8881.916040] [] ? ptlrpc_server_handle_req_in+0x92a/0x1100 [ptlrpc] [ 8881.924785] [] ? wake_up_atomic_t+0x30/0x30 [ 8881.931333] [] ptlrpc_main+0xbb4/0x1550 [ptlrpc] [ 8881.938370] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [ 8881.946645] [] kthread+0xd1/0xe0 [ 8881.952101] [] ? insert_kthread_work+0x40/0x40 [ 8881.958915] [] ret_from_fork_nospec_begin+0x21/0x21 [ 8881.966216] [] ? insert_kthread_work+0x40/0x40 [ 8953.661093] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.104@o2ib: 0 seconds [ 8953.672480] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 97 previous similar messages [ 8959.660701] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.104@o2ib) recovery failed with -110 [ 8959.673928] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 53 previous similar messages [ 9001.964985] INFO: task dist_txn-0:4997 blocked for more than 120 seconds. [ 9001.972591] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 9001.981345] dist_txn-0 D ffff99514132d230 0 4997 2 0x00000080 [ 9001.989306] Call Trace: [ 9001.992071] [] schedule+0x29/0x70 [ 9001.997646] [] rwsem_down_write_failed+0x215/0x3c0 [ 9002.004944] [] ? llog_osd_regular_fid_del_name_entry+0x272/0x500 [obdclass] [ 9002.014590] [] call_rwsem_down_write_failed+0x17/0x30 [ 9002.022101] [] down_write+0x2d/0x3d [ 9002.027913] [] llog_cancel_arr_rec+0x14c/0x970 [obdclass] [ 9002.035856] [] llog_cat_cancel_arr_rec+0xd4/0x470 [obdclass] [ 9002.044061] [] llog_cat_cancel_records+0x77/0x1c0 [obdclass] [ 9002.052346] [] distribute_txn_commit_thread+0x5a9/0xc90 [ptlrpc] [ 9002.060945] [] ? wake_up_atomic_t+0x30/0x30 [ 9002.067540] [] ? sub_trans_commit_cb+0x20/0x20 [ptlrpc] [ 9002.075245] [] kthread+0xd1/0xe0 [ 9002.080724] [] ? insert_kthread_work+0x40/0x40 [ 9002.087570] [] ret_from_fork_nospec_begin+0x21/0x21 [ 9002.094887] [] ? insert_kthread_work+0x40/0x40 [ 9002.101740] INFO: task mdt00_014:6068 blocked for more than 120 seconds. [ 9002.109253] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 9002.118019] mdt00_014 D ffff994d6892b150 0 6068 2 0x00000080 [ 9002.125975] Call Trace: [ 9002.128742] [] ? wake_up_state+0x20/0x20 [ 9002.134995] [] schedule+0x29/0x70 [ 9002.140571] [] lbug_with_loc+0x7d/0xa0 [libcfs] [ 9002.147524] [] llog_osd_write_rec+0x1395/0x14b0 [obdclass] [ 9002.155513] [] ? __wake_up_common_lock+0x91/0xc0 [ 9002.162548] [] llog_write_rec+0x273/0x540 [obdclass] [ 9002.169957] [] llog_cat_add_rec+0x220/0x880 [obdclass] [ 9002.177575] [] llog_add+0x162/0x1d0 [obdclass] [ 9002.184432] [] ? lprocfs_counter_add+0xf9/0x160 [obdclass] [ 9002.192465] [] sub_updates_write+0x2e8/0xdd7 [ptlrpc] [ 9002.200005] [] ? prepare_writing_updates.isra.12+0x139/0x14a [ptlrpc] [ 9002.209096] [] top_trans_stop+0x827/0xbc0 [ptlrpc] [ 9002.216345] [] ? lod_sub_ref_add+0x1be/0x450 [lod] [ 9002.223562] [] lod_trans_stop+0x25c/0x340 [lod] [ 9002.230505] [] ? mdd_changelog_ns_store+0x30/0x8d0 [mdd] [ 9002.238306] [] ? mdd_links_rename+0x242/0x420 [mdd] [ 9002.245631] [] mdd_trans_stop+0x2e/0x174 [mdd] [ 9002.252468] [] mdd_create+0x1395/0x17d0 [mdd] [ 9002.259214] [] mdt_create+0xaf9/0xf90 [mdt] [ 9002.265756] [] ? lprocfs_stats_lock+0x24/0xd0 [obdclass] [ 9002.273563] [] mdt_reint_create+0x16b/0x360 [mdt] [ 9002.280693] [] mdt_reint_rec+0x83/0x210 [mdt] [ 9002.287432] [] mdt_reint_internal+0x7b0/0xba0 [mdt] [ 9002.294765] [] mdt_reint+0x67/0x140 [mdt] [ 9002.301149] [] tgt_request_handle+0x95a/0x1630 [ptlrpc] [ 9002.308860] [] ? ktime_get_real_seconds+0xe/0x10 [libcfs] [ 9002.316789] [] ptlrpc_server_handle_request+0x256/0xb10 [ptlrpc] [ 9002.325408] [] ? ptlrpc_wait_event+0x12e/0x5b0 [ptlrpc] [ 9002.333102] [] ? __wake_up+0x13/0x20 [ 9002.338977] [] ? ptlrpc_server_handle_req_in+0x92a/0x1100 [ptlrpc] [ 9002.347752] [] ? wake_up_atomic_t+0x30/0x30 [ 9002.354308] [] ptlrpc_main+0xbb4/0x1550 [ptlrpc] [ 9002.361341] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [ 9002.369617] [] kthread+0xd1/0xe0 [ 9002.375086] [] ? insert_kthread_work+0x40/0x40 [ 9002.381905] [] ret_from_fork_nospec_begin+0x21/0x21 [ 9002.389215] [] ? insert_kthread_work+0x40/0x40 [ 9072.645382] Lustre: 7357:0:(service.c:1440:ptlrpc_at_send_early_reply()) @@@ Could not add any time (5/5), not sending early reply req@ffff994d23f5e300 x1665261784823680/t0(0) o36->80445a37-adf6-4@192.168.1.131@o2ib:248/0 lens 512/448 e 24 to 0 dl 1588134443 ref 2 fl Interpret:/0/0 rc 0/0 job:'' [ 9078.017983] Lustre: soaked-MDT0000: Client fb44dc01-e001-4 (at 192.168.1.126@o2ib) reconnecting [ 9078.027796] Lustre: soaked-MDT0000: Connection restored to 2f083a8e-0a9a-4 (at 192.168.1.126@o2ib) [ 9079.028035] Lustre: soaked-MDT0000: Client 0098bb46-ec5c-4 (at 192.168.1.128@o2ib) reconnecting [ 9079.037790] Lustre: Skipped 1 previous similar message [ 9097.634810] LNet: 19422:0:(o2iblnd_cb.c:2598:kiblnd_passive_connect()) Conn stale 192.168.1.104@o2ib version 12/12 incarnation 1588134463568739/1588134463568739 [ 9097.658337] Lustre: MGS: Connection restored to 6f08e67c-f68c-4 (at 192.168.1.104@o2ib) [ 9097.667327] Lustre: Skipped 2 previous similar messages [ 9122.388207] INFO: task dist_txn-0:4997 blocked for more than 120 seconds. [ 9122.395811] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 9122.404577] dist_txn-0 D ffff99514132d230 0 4997 2 0x00000080 [ 9122.412508] Call Trace: [ 9122.415270] [] schedule+0x29/0x70 [ 9122.420838] [] rwsem_down_write_failed+0x215/0x3c0 [ 9122.428098] [] ? llog_osd_regular_fid_del_name_entry+0x272/0x500 [obdclass] [ 9122.437777] [] call_rwsem_down_write_failed+0x17/0x30 [ 9122.445273] [] down_write+0x2d/0x3d [ 9122.451065] [] llog_cancel_arr_rec+0x14c/0x970 [obdclass] [ 9122.458992] [] llog_cat_cancel_arr_rec+0xd4/0x470 [obdclass] [ 9122.467186] [] llog_cat_cancel_records+0x77/0x1c0 [obdclass] [ 9122.475484] [] distribute_txn_commit_thread+0x5a9/0xc90 [ptlrpc] [ 9122.484062] [] ? wake_up_atomic_t+0x30/0x30 [ 9122.490669] [] ? sub_trans_commit_cb+0x20/0x20 [ptlrpc] [ 9122.498364] [] kthread+0xd1/0xe0 [ 9122.503824] [] ? insert_kthread_work+0x40/0x40 [ 9122.510645] [] ret_from_fork_nospec_begin+0x21/0x21 [ 9122.517960] [] ? insert_kthread_work+0x40/0x40 [ 9122.524795] INFO: task mdt00_014:6068 blocked for more than 120 seconds. [ 9122.532294] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 9122.541041] mdt00_014 D ffff994d6892b150 0 6068 2 0x00000080 [ 9122.548963] Call Trace: [ 9122.551697] [] ? wake_up_state+0x20/0x20 [ 9122.557925] [] schedule+0x29/0x70 [ 9122.563516] [] lbug_with_loc+0x7d/0xa0 [libcfs] [ 9122.570451] [] llog_osd_write_rec+0x1395/0x14b0 [obdclass] [ 9122.578447] [] ? __wake_up_common_lock+0x91/0xc0 [ 9122.585485] [] llog_write_rec+0x273/0x540 [obdclass] [ 9122.592932] [] llog_cat_add_rec+0x220/0x880 [obdclass] [ 9122.600559] [] llog_add+0x162/0x1d0 [obdclass] [ 9122.607419] [] ? lprocfs_counter_add+0xf9/0x160 [obdclass] [ 9122.615465] [] sub_updates_write+0x2e8/0xdd7 [ptlrpc] [ 9122.623029] [] ? prepare_writing_updates.isra.12+0x139/0x14a [ptlrpc] [ 9122.632140] [] top_trans_stop+0x827/0xbc0 [ptlrpc] [ 9122.639376] [] ? lod_sub_ref_add+0x1be/0x450 [lod] [ 9122.646610] [] lod_trans_stop+0x25c/0x340 [lod] [ 9122.653552] [] ? mdd_changelog_ns_store+0x30/0x8d0 [mdd] [ 9122.661361] [] ? mdd_links_rename+0x242/0x420 [mdd] [ 9122.668665] [] mdd_trans_stop+0x2e/0x174 [mdd] [ 9122.675491] [] mdd_create+0x1395/0x17d0 [mdd] [ 9122.682268] [] mdt_create+0xaf9/0xf90 [mdt] [ 9122.688820] [] ? lprocfs_stats_lock+0x24/0xd0 [obdclass] [ 9122.696625] [] mdt_reint_create+0x16b/0x360 [mdt] [ 9122.703756] [] mdt_reint_rec+0x83/0x210 [mdt] [ 9122.710497] [] mdt_reint_internal+0x7b0/0xba0 [mdt] [ 9122.717819] [] mdt_reint+0x67/0x140 [mdt] [ 9122.724213] [] tgt_request_handle+0x95a/0x1630 [ptlrpc] [ 9122.731919] [] ? ktime_get_real_seconds+0xe/0x10 [libcfs] [ 9122.739866] [] ptlrpc_server_handle_request+0x256/0xb10 [ptlrpc] [ 9122.748482] [] ? ptlrpc_wait_event+0x12e/0x5b0 [ptlrpc] [ 9122.756185] [] ? __wake_up+0x13/0x20 [ 9122.762089] [] ? ptlrpc_server_handle_req_in+0x92a/0x1100 [ptlrpc] [ 9122.770857] [] ? wake_up_atomic_t+0x30/0x30 [ 9122.777432] [] ptlrpc_main+0xbb4/0x1550 [ptlrpc] [ 9122.784497] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [ 9122.792773] [] kthread+0xd1/0xe0 [ 9122.798230] [] ? insert_kthread_work+0x40/0x40 [ 9122.805067] [] ret_from_fork_nospec_begin+0x21/0x21 [ 9122.812387] [] ? insert_kthread_work+0x40/0x40 [ 9679.066811] Lustre: soaked-MDT0000: Client fb44dc01-e001-4 (at 192.168.1.126@o2ib) reconnecting [ 9679.076677] Lustre: soaked-MDT0000: Connection restored to 2f083a8e-0a9a-4 (at 192.168.1.126@o2ib) [ 9679.086710] Lustre: Skipped 8 previous similar messages [10280.121493] Lustre: soaked-MDT0000: Client fb44dc01-e001-4 (at 192.168.1.126@o2ib) reconnecting [10280.131235] Lustre: Skipped 2 previous similar messages [10280.137142] Lustre: soaked-MDT0000: Connection restored to 2f083a8e-0a9a-4 (at 192.168.1.126@o2ib) [10280.147174] Lustre: Skipped 2 previous similar messages [10881.182311] Lustre: soaked-MDT0000: Client fb44dc01-e001-4 (at 192.168.1.126@o2ib) reconnecting [10881.192061] Lustre: Skipped 2 previous similar messages [10881.197975] Lustre: soaked-MDT0000: Connection restored to 2f083a8e-0a9a-4 (at 192.168.1.126@o2ib) [10881.207993] Lustre: Skipped 2 previous similar messages [11095.644282] Lustre: 6067:0:(mdd_device.c:1825:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1 [11095.810801] Lustre: mdt01_011: service thread pid 5565 was inactive for 200.671 seconds. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes: [11095.810810] Pid: 5220, comm: mdt00_010 3.10.0-1062.9.1.el7_lustre.x86_64 #1 SMP Tue Feb 11 19:11:56 UTC 2020 [11095.810811] Call Trace: [11095.810839] Lustre: mdt00_006: service thread pid 5142 was inactive for 200.671 seconds. Watchdog stack traces are limited to 3 per 300 seconds, skipping this one. [11095.810841] Lustre: Skipped 1 previous similar message [11095.810939] [] ldlm_completion_ast+0x75f/0x9b0 [ptlrpc] [11095.810996] [] ldlm_cli_enqueue_local+0x25c/0x850 [ptlrpc] [11095.811026] [] mdt_object_local_lock+0x450/0xb60 [mdt] [11095.811046] [] mdt_object_lock_internal+0x70/0x3f0 [mdt] [11095.811066] [] mdt_getattr_name_lock+0x1018/0x1d60 [mdt] [11095.811087] [] mdt_intent_getattr+0x2b5/0x480 [mdt] [11095.811107] [] mdt_intent_opc+0x1ba/0xb40 [mdt] [11095.811127] [] mdt_intent_policy+0x1a4/0x360 [mdt] [11095.811179] [] ldlm_lock_enqueue+0x3cb/0xad0 [ptlrpc] [11095.811238] [] ldlm_handle_enqueue0+0xa56/0x1610 [ptlrpc] [11095.811321] [] tgt_enqueue+0x62/0x210 [ptlrpc] [11095.811396] [] tgt_request_handle+0x95a/0x1630 [ptlrpc] [11095.811463] [] ptlrpc_server_handle_request+0x256/0xb10 [ptlrpc] [11095.811528] [] ptlrpc_main+0xbb4/0x1550 [ptlrpc] [11095.811535] [] kthread+0xd1/0xe0 [11095.811541] [] ret_from_fork_nospec_end+0x0/0x39 [11095.811576] [] 0xffffffffffffffff [11095.811581] Pid: 5195, comm: mdt01_008 3.10.0-1062.9.1.el7_lustre.x86_64 #1 SMP Tue Feb 11 19:11:56 UTC 2020 [11095.811582] Call Trace: [11095.811702] [] ldlm_completion_ast+0x75f/0x9b0 [ptlrpc] [11095.811759] [] ldlm_cli_enqueue_local+0x25c/0x850 [ptlrpc] [11095.811814] [] mdt_object_local_lock+0x450/0xb60 [mdt] [11095.811835] [] mdt_object_lock_internal+0x70/0x3f0 [mdt] [11095.811856] [] mdt_getattr_name_lock+0x1018/0x1d60 [mdt] [11095.811877] [] mdt_intent_getattr+0x2b5/0x480 [mdt] [11095.811897] [] mdt_intent_opc+0x1ba/0xb40 [mdt] [11095.811917] [] mdt_intent_policy+0x1a4/0x360 [mdt] [11095.811969] [] ldlm_lock_enqueue+0x3cb/0xad0 [ptlrpc] [11095.812029] [] ldlm_handle_enqueue0+0xa56/0x1610 [ptlrpc] [11095.812117] [] tgt_enqueue+0x62/0x210 [ptlrpc] [11095.812193] [] tgt_request_handle+0x95a/0x1630 [ptlrpc] [11095.812260] [] ptlrpc_server_handle_request+0x256/0xb10 [ptlrpc] [11095.812325] [] ptlrpc_main+0xbb4/0x1550 [ptlrpc] [11095.812333] [] kthread+0xd1/0xe0 [11095.812340] [] ret_from_fork_nospec_end+0x0/0x39 [11095.812377] [] 0xffffffffffffffff [11096.128612] Lustre: Skipped 2 previous similar messages [11096.134467] Pid: 5565, comm: mdt01_011 3.10.0-1062.9.1.el7_lustre.x86_64 #1 SMP Tue Feb 11 19:11:56 UTC 2020 [11096.145465] Call Trace: [11096.148220] [] ldlm_completion_ast+0x75f/0x9b0 [ptlrpc] [11096.155953] [] ldlm_cli_enqueue_local+0x25c/0x850 [ptlrpc] [11096.163996] [] mdt_object_local_lock+0x450/0xb60 [mdt] [11096.171624] [] mdt_object_lock_internal+0x70/0x3f0 [mdt] [11096.179457] [] mdt_getattr_name_lock+0x1018/0x1d60 [mdt] [11096.187269] [] mdt_intent_getattr+0x2b5/0x480 [mdt] [11096.194621] [] mdt_intent_opc+0x1ba/0xb40 [mdt] [11096.201578] [] mdt_intent_policy+0x1a4/0x360 [mdt] [11096.208806] [] ldlm_lock_enqueue+0x3cb/0xad0 [ptlrpc] [11096.216368] [] ldlm_handle_enqueue0+0xa56/0x1610 [ptlrpc] [11096.224334] [] tgt_enqueue+0x62/0x210 [ptlrpc] [11096.231223] [] tgt_request_handle+0x95a/0x1630 [ptlrpc] [11096.238989] [] ptlrpc_server_handle_request+0x256/0xb10 [ptlrpc] [11096.247638] [] ptlrpc_main+0xbb4/0x1550 [ptlrpc] [11096.254715] [] kthread+0xd1/0xe0 [11096.260226] [] ret_from_fork_nospec_end+0x0/0x39 [11096.267279] [] 0xffffffffffffffff [11195.132438] LustreError: 5125:0:(ldlm_request.c:124:ldlm_expired_completion_wait()) ### lock timed out (enqueued at 1588136261, 300s ago); not entering recovery in server code, just going back to sleep ns: mdt-soaked-MDT0000_UUID lock: ffff994d21b48480/0x7f1e5ec506a7f7ac lrc: 3/1,0 mode: --/CR res: [0x200000405:0x5:0x0].0x0 bits 0x2/0x0 rrc: 35 type: IBT flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5125 timeout: 0 lvb_type: 0 [11195.132684] LustreError: dumping log to /tmp/lustre-log.1588136561.5566 [11195.183811] LustreError: 5125:0:(ldlm_request.c:124:ldlm_expired_completion_wait()) Skipped 9 previous similar messages [11482.243139] Lustre: soaked-MDT0000: Client fb44dc01-e001-4 (at 192.168.1.126@o2ib) reconnecting [11482.252898] Lustre: Skipped 2 previous similar messages [11482.258806] Lustre: soaked-MDT0000: Connection restored to 2f083a8e-0a9a-4 (at 192.168.1.126@o2ib) [11482.268843] Lustre: Skipped 2 previous similar messages [11490.025592] Lustre: 5200:0:(service.c:1440:ptlrpc_at_send_early_reply()) @@@ Could not add any time (5/5), not sending early reply req@ffff994d1df25a00 x1665261529062144/t0(0) o101->fe2e5e5a-f3b1-4@192.168.1.139@o2ib:401/0 lens 576/3328 e 24 to 0 dl 1588136861 ref 2 fl Interpret:/0/0 rc 0/0 job:'' [11490.055100] Lustre: 5200:0:(service.c:1440:ptlrpc_at_send_early_reply()) Skipped 2 previous similar messages [12078.083626] Lustre: 4914:0:(service.c:1440:ptlrpc_at_send_early_reply()) @@@ Could not add any time (5/-583), not sending early reply req@ffff994d12f54380 x1665261793467264/t0(0) o101->0098bb46-ec5c-4@192.168.1.128@o2ib:234/0 lens 576/3328 e 24 to 0 dl 1588137449 ref 2 fl Interpret:/0/0 rc 0/0 job:'' [12078.113444] Lustre: 4914:0:(service.c:1440:ptlrpc_at_send_early_reply()) Skipped 7 previous similar messages [12083.303892] Lustre: soaked-MDT0000: Client fb44dc01-e001-4 (at 192.168.1.126@o2ib) reconnecting [12083.313643] Lustre: Skipped 10 previous similar messages [12083.319647] Lustre: soaked-MDT0000: Connection restored to 2f083a8e-0a9a-4 (at 192.168.1.126@o2ib) [12083.329716] Lustre: Skipped 10 previous similar messages [12119.456940] LNetError: 4841:0:(o2iblnd_cb.c:3348:kiblnd_check_txs_locked()) Timed out tx: active_txs, 0 seconds [12119.468228] LNetError: 4841:0:(o2iblnd_cb.c:3423:kiblnd_check_conns()) Timed out RDMA with 192.168.1.105@o2ib (10): c: 4, oc: 0, rc: 8 [12120.456936] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.105@o2ib: 1 seconds [12120.468307] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 62 previous similar messages [12120.952881] Lustre: 4856:0:(client.c:2229:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1588137480/real 0] req@ffff994cf6a0d100 x1665270507758720/t0(0) o13->soaked-OST0005-osc-MDT0000@192.168.1.105@o2ib:7/4 lens 224/368 e 0 to 1 dl 1588137487 ref 2 fl Rpc:Xr/0/ffffffff rc 0/-1 job:'' [12120.952956] Lustre: soaked-OST000d-osc-MDT0000: Connection to soaked-OST000d (at 192.168.1.105@o2ib) was lost; in progress operations using this service will wait for recovery to complete [12121.003170] Lustre: 4856:0:(client.c:2229:ptlrpc_expire_one_request()) Skipped 4 previous similar messages [12124.456657] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.105@o2ib) recovery failed with -110 [12124.469882] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 25 previous similar messages [12187.452642] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.105@o2ib: 0 seconds [12187.464016] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 31 previous similar messages [12193.452218] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.105@o2ib) recovery failed with -110 [12193.465434] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 20 previous similar messages [12316.444312] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.105@o2ib: 0 seconds [12316.455686] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 41 previous similar messages [12322.443949] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.105@o2ib) recovery failed with -110 [12322.457172] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 35 previous similar messages [12335.703224] Lustre: MGS: haven't heard from client c1544b66-594b-4 (at 192.168.1.105@o2ib) in 227 seconds. I think it's dead, and I am evicting it. exp ffff994d2f35c800, cur 1588137702 expire 1588137552 last 1588137475 [12335.725253] Lustre: Skipped 4 previous similar messages [12472.570792] LustreError: 11-0: soaked-OST0009-osc-MDT0000: operation ost_statfs to node 192.168.1.104@o2ib failed: rc = -107 [12472.583368] Lustre: soaked-OST0009-osc-MDT0000: Connection to soaked-OST0009 (at 192.168.1.104@o2ib) was lost; in progress operations using this service will wait for recovery to complete [12472.602014] Lustre: Skipped 3 previous similar messages [12485.326240] LNet: 19422:0:(o2iblnd_cb.c:2598:kiblnd_passive_connect()) Conn stale 192.168.1.105@o2ib version 12/12 incarnation 1588137851588224/1588137851588224 [12485.433488] LNet: 4841:0:(o2iblnd_cb.c:1509:kiblnd_reconnect_peer()) Abort reconnection of 192.168.1.105@o2ib: connected [12491.625574] LustreError: 11-0: soaked-OST0001-osc-MDT0000: operation ost_statfs to node 192.168.1.104@o2ib failed: rc = -107 [12491.638205] Lustre: soaked-OST0001-osc-MDT0000: Connection to soaked-OST0001 (at 192.168.1.104@o2ib) was lost; in progress operations using this service will wait for recovery to complete [12499.257153] LustreError: 11-0: soaked-OST0005-osc-MDT0000: operation ost_statfs to node 192.168.1.104@o2ib failed: rc = -107 [12499.269757] Lustre: soaked-OST0005-osc-MDT0000: Connection to soaked-OST0005 (at 192.168.1.104@o2ib) was lost; in progress operations using this service will wait for recovery to complete [12508.184495] LustreError: 11-0: soaked-OST000d-osc-MDT0000: operation ost_statfs to node 192.168.1.104@o2ib failed: rc = -107 [12508.197124] Lustre: soaked-OST000d-osc-MDT0000: Connection to soaked-OST000d (at 192.168.1.104@o2ib) was lost; in progress operations using this service will wait for recovery to complete [12684.364699] Lustre: soaked-MDT0000: Client fb44dc01-e001-4 (at 192.168.1.126@o2ib) reconnecting [12684.374442] Lustre: Skipped 10 previous similar messages [12684.380461] Lustre: soaked-MDT0000: Connection restored to 2f083a8e-0a9a-4 (at 192.168.1.126@o2ib) [12684.390485] Lustre: Skipped 27 previous similar messages [13285.425353] Lustre: soaked-MDT0000: Client fb44dc01-e001-4 (at 192.168.1.126@o2ib) reconnecting [13285.435143] Lustre: Skipped 10 previous similar messages [13285.441158] Lustre: soaked-MDT0000: Connection restored to 2f083a8e-0a9a-4 (at 192.168.1.126@o2ib) [13285.451180] Lustre: Skipped 10 previous similar messages [13886.486147] Lustre: soaked-MDT0000: Client fb44dc01-e001-4 (at 192.168.1.126@o2ib) reconnecting [13886.495941] Lustre: Skipped 9 previous similar messages [13886.501853] Lustre: soaked-MDT0000: Connection restored to 2f083a8e-0a9a-4 (at 192.168.1.126@o2ib) [13886.511884] Lustre: Skipped 10 previous similar messages [14487.546768] Lustre: soaked-MDT0000: Client fb44dc01-e001-4 (at 192.168.1.126@o2ib) reconnecting [14487.556516] Lustre: Skipped 10 previous similar messages [14487.562525] Lustre: soaked-MDT0000: Connection restored to 2f083a8e-0a9a-4 (at 192.168.1.126@o2ib) [14487.572557] Lustre: Skipped 10 previous similar messages [14695.939341] Lustre: 6069:0:(mdd_device.c:1825:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1 [15088.607446] Lustre: soaked-MDT0000: Client fb44dc01-e001-4 (at 192.168.1.126@o2ib) reconnecting [15088.617196] Lustre: Skipped 10 previous similar messages [15088.623203] Lustre: soaked-MDT0000: Connection restored to 2f083a8e-0a9a-4 (at 192.168.1.126@o2ib) [15088.633225] Lustre: Skipped 10 previous similar messages [15375.248010] LNetError: 4841:0:(o2iblnd_cb.c:3348:kiblnd_check_txs_locked()) Timed out tx: active_txs, 1 seconds [15375.259293] LNetError: 4841:0:(o2iblnd_cb.c:3423:kiblnd_check_conns()) Timed out RDMA with 192.168.1.104@o2ib (6): c: 4, oc: 0, rc: 8 [15375.273234] LNetError: 25333:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.104@o2ib) recovery failed with -113 [15375.286583] LNetError: 25333:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 38 previous similar messages [15375.298293] Lustre: 4869:0:(client.c:2229:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1588140735/real 1588140742] req@ffff995161e9e300 x1665270508564544/t0(0) o13->soaked-OST0008-osc-MDT0000@192.168.1.104@o2ib:7/4 lens 224/368 e 0 to 1 dl 1588140742 ref 1 fl Rpc:eXQr/0/ffffffff rc 0/-1 job:'' [15375.298311] Lustre: soaked-OST000c-osc-MDT0000: Connection to soaked-OST000c (at 192.168.1.104@o2ib) was lost; in progress operations using this service will wait for recovery to complete [15375.349982] Lustre: 4869:0:(client.c:2229:ptlrpc_expire_one_request()) Skipped 4 previous similar messages [15407.359216] LNetError: 30374:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.104@o2ib) recovery failed with -113 [15407.372549] LNetError: 30374:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 31 previous similar messages [15471.514125] LNetError: 25333:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.104@o2ib) recovery failed with -113 [15471.527455] LNetError: 25333:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 63 previous similar messages [15590.296646] Lustre: MGS: haven't heard from client 0d3c1919-0895-4 (at 192.168.1.104@o2ib) in 228 seconds. I think it's dead, and I am evicting it. exp ffff99512260f000, cur 1588140957 expire 1588140807 last 1588140729 [15590.318358] Lustre: Skipped 4 previous similar messages [15600.033854] LNetError: 30374:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.104@o2ib) recovery failed with -113 [15600.047212] LNetError: 30374:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 127 previous similar messages [15675.228763] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.104@o2ib: 0 seconds [15675.240152] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 61 previous similar messages [15689.668333] Lustre: soaked-MDT0000: Client fb44dc01-e001-4 (at 192.168.1.126@o2ib) reconnecting [15689.678087] Lustre: Skipped 10 previous similar messages [15689.684093] Lustre: soaked-MDT0000: Connection restored to 2f083a8e-0a9a-4 (at 192.168.1.126@o2ib) [15689.694126] Lustre: Skipped 10 previous similar messages [15713.226310] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.104@o2ib: 0 seconds [15713.237692] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 17 previous similar messages [15780.222000] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.104@o2ib: 0 seconds [15780.233388] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 22 previous similar messages [15852.848046] LNet: 25541:0:(o2iblnd_cb.c:2598:kiblnd_passive_connect()) Conn stale 192.168.1.104@o2ib version 12/12 incarnation 1588141219147446/1588141219147446 [15854.217197] LNet: 4841:0:(o2iblnd_cb.c:1509:kiblnd_reconnect_peer()) Abort reconnection of 192.168.1.104@o2ib: connected [16290.729018] Lustre: soaked-MDT0000: Client fb44dc01-e001-4 (at 192.168.1.126@o2ib) reconnecting [16290.738768] Lustre: Skipped 10 previous similar messages [16290.744792] Lustre: soaked-MDT0000: Connection restored to 2f083a8e-0a9a-4 (at 192.168.1.126@o2ib) [16290.754823] Lustre: Skipped 19 previous similar messages [16891.789909] Lustre: soaked-MDT0000: Client fb44dc01-e001-4 (at 192.168.1.126@o2ib) reconnecting [16891.799673] Lustre: Skipped 10 previous similar messages [16891.805681] Lustre: soaked-MDT0000: Connection restored to 2f083a8e-0a9a-4 (at 192.168.1.126@o2ib) [16891.815699] Lustre: Skipped 10 previous similar messages [17492.850942] Lustre: soaked-MDT0000: Client fb44dc01-e001-4 (at 192.168.1.126@o2ib) reconnecting [17492.860719] Lustre: Skipped 10 previous similar messages [17492.866717] Lustre: soaked-MDT0000: Connection restored to 2f083a8e-0a9a-4 (at 192.168.1.126@o2ib) [17492.876744] Lustre: Skipped 10 previous similar messages [18088.258033] ptlrpc_watchdog_fire: 7 callbacks suppressed [18088.264007] Lustre: mdt01_015: service thread pid 6069 was inactive for 200.668 seconds. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes: [18088.284886] Pid: 6069, comm: mdt01_015 3.10.0-1062.9.1.el7_lustre.x86_64 #1 SMP Tue Feb 11 19:11:56 UTC 2020 [18088.295872] Call Trace: [18088.298645] [] ldlm_completion_ast+0x75f/0x9b0 [ptlrpc] [18088.306437] [] ldlm_cli_enqueue_local+0x25c/0x850 [ptlrpc] [18088.314472] [] mdt_object_local_lock+0x523/0xb60 [mdt] [18088.322130] [] mdt_object_lock_internal+0x70/0x3f0 [mdt] [18088.329949] [] mdt_getattr_name_lock+0x985/0x1d60 [mdt] [18088.337661] [] mdt_intent_getattr+0x2b5/0x480 [mdt] [18088.344983] [] mdt_intent_opc+0x1ba/0xb40 [mdt] [18088.351913] [] mdt_intent_policy+0x1a4/0x360 [mdt] [18088.359131] [] ldlm_lock_enqueue+0x3cb/0xad0 [ptlrpc] [18088.366670] [] ldlm_handle_enqueue0+0xa56/0x1610 [ptlrpc] [18088.374591] [] tgt_enqueue+0x62/0x210 [ptlrpc] [18088.381478] [] tgt_request_handle+0x95a/0x1630 [ptlrpc] [18088.389225] [] ptlrpc_server_handle_request+0x256/0xb10 [ptlrpc] [18088.397828] [] ptlrpc_main+0xbb4/0x1550 [ptlrpc] [18088.404874] [] kthread+0xd1/0xe0 [18088.410346] [] ret_from_fork_nospec_end+0x0/0x39 [18088.417370] [] 0xffffffffffffffff [18093.911836] Lustre: soaked-MDT0000: Client fb44dc01-e001-4 (at 192.168.1.126@o2ib) reconnecting [18093.921596] Lustre: Skipped 10 previous similar messages [18093.927600] Lustre: soaked-MDT0000: Connection restored to 2f083a8e-0a9a-4 (at 192.168.1.126@o2ib) [18093.937625] Lustre: Skipped 10 previous similar messages [18187.582674] LustreError: 6069:0:(ldlm_request.c:124:ldlm_expired_completion_wait()) ### lock timed out (enqueued at 1588143254, 300s ago); not entering recovery in server code, just going back to sleep ns: mdt-soaked-MDT0000_UUID lock: ffff9950f3b29d40/0x7f1e5ec506a81637 lrc: 3/1,0 mode: --/PR res: [0x200000405:0x5:0x0].0x0 bits 0x13/0x0 rrc: 23 type: IBT flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6069 timeout: 0 lvb_type: 0 [18295.257290] Lustre: 5201:0:(mdd_device.c:1825:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1 [18482.856673] Lustre: 5201:0:(service.c:1440:ptlrpc_at_send_early_reply()) @@@ Could not add any time (5/5), not sending early reply req@ffff99512d3f9680 x1665263046272896/t0(0) o101->a50df61c-5c0a-4@192.168.1.124@o2ib:599/0 lens 576/3328 e 24 to 0 dl 1588143854 ref 2 fl Interpret:/0/0 rc 0/0 job:'' [18482.886202] Lustre: 5201:0:(service.c:1440:ptlrpc_at_send_early_reply()) Skipped 1 previous similar message [18694.973383] Lustre: soaked-MDT0000: Client fb44dc01-e001-4 (at 192.168.1.126@o2ib) reconnecting [18694.983144] Lustre: Skipped 11 previous similar messages [18694.989155] Lustre: soaked-MDT0000: Connection restored to 2f083a8e-0a9a-4 (at 192.168.1.126@o2ib) [18694.999231] Lustre: Skipped 11 previous similar messages [18815.027378] LNetError: 4841:0:(o2iblnd_cb.c:3348:kiblnd_check_txs_locked()) Timed out tx: active_txs, 0 seconds [18815.038662] LNetError: 4841:0:(o2iblnd_cb.c:3423:kiblnd_check_conns()) Timed out RDMA with 192.168.1.107@o2ib (9): c: 4, oc: 0, rc: 8 [18815.052873] LNetError: 28913:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.107@o2ib) recovery failed with -113 [18815.066251] LNetError: 28913:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 99 previous similar messages [18815.077952] Lustre: 4867:0:(client.c:2229:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1588144176/real 1588144182] req@ffff994d2d52b600 x1665270509414336/t0(0) o13->soaked-OST0003-osc-MDT0000@192.168.1.107@o2ib:7/4 lens 224/368 e 0 to 1 dl 1588144183 ref 1 fl Rpc:eXQr/0/ffffffff rc 0/-1 job:'' [18815.077971] Lustre: soaked-OST0007-osc-MDT0000: Connection to soaked-OST0007 (at 192.168.1.107@o2ib) was lost; in progress operations using this service will wait for recovery to complete [18815.077975] Lustre: Skipped 3 previous similar messages [18815.135461] Lustre: 4867:0:(client.c:2229:ptlrpc_expire_one_request()) Skipped 3 previous similar messages [18847.144559] LNetError: 28913:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.107@o2ib) recovery failed with -113 [18847.157888] LNetError: 28913:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 31 previous similar messages [18911.293502] LNetError: 36122:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.107@o2ib) recovery failed with -113 [18911.306842] LNetError: 36122:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 63 previous similar messages [19011.516491] Lustre: soaked-MDT0000: haven't heard from client soaked-MDT0000-lwp-OST000f_UUID (at 192.168.1.107@o2ib) in 229 seconds. I think it's dead, and I am evicting it. exp ffff994d25244400, cur 1588144378 expire 1588144228 last 1588144149 [19011.540793] Lustre: Skipped 4 previous similar messages [19039.813142] LNetError: 36122:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.107@o2ib) recovery failed with -113 [19039.826478] LNetError: 36122:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 127 previous similar messages [19109.008413] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.107@o2ib: 0 seconds [19109.019793] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 36 previous similar messages [19128.007232] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.107@o2ib: 0 seconds [19128.018605] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 14 previous similar messages [19166.004783] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.107@o2ib: 0 seconds [19166.016149] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 5 previous similar messages [19192.427440] LustreError: 11-0: soaked-OST000b-osc-MDT0000: operation ost_statfs to node 192.168.1.102@o2ib failed: rc = -107 [19192.440124] Lustre: soaked-OST000b-osc-MDT0000: Connection to soaked-OST000b (at 192.168.1.102@o2ib) was lost; in progress operations using this service will wait for recovery to complete [19192.458790] Lustre: Skipped 3 previous similar messages [19202.543178] LNet: 25541:0:(o2iblnd_cb.c:2598:kiblnd_passive_connect()) Conn stale 192.168.1.107@o2ib version 12/12 incarnation 1588144569104498/1588144569104498 [19203.002357] LNet: 4841:0:(o2iblnd_cb.c:1509:kiblnd_reconnect_peer()) Abort reconnection of 192.168.1.107@o2ib: connected [19207.418700] LustreError: 11-0: soaked-OST0003-osc-MDT0000: operation ost_statfs to node 192.168.1.102@o2ib failed: rc = -107 [19207.431301] Lustre: soaked-OST0003-osc-MDT0000: Connection to soaked-OST0003 (at 192.168.1.102@o2ib) was lost; in progress operations using this service will wait for recovery to complete [19217.034183] LustreError: 11-0: soaked-OST000f-osc-MDT0000: operation ost_statfs to node 192.168.1.102@o2ib failed: rc = -107 [19217.046796] Lustre: soaked-OST000f-osc-MDT0000: Connection to soaked-OST000f (at 192.168.1.102@o2ib) was lost; in progress operations using this service will wait for recovery to complete [19223.417631] LustreError: 11-0: soaked-OST0007-osc-MDT0000: operation ost_statfs to node 192.168.1.102@o2ib failed: rc = -107 [19223.430256] Lustre: soaked-OST0007-osc-MDT0000: Connection to soaked-OST0007 (at 192.168.1.102@o2ib) was lost; in progress operations using this service will wait for recovery to complete [19296.048234] Lustre: soaked-MDT0000: Client fb44dc01-e001-4 (at 192.168.1.126@o2ib) reconnecting [19296.056024] Lustre: soaked-MDT0000: Connection restored to 80445a37-adf6-4 (at 192.168.1.131@o2ib) [19296.056027] Lustre: Skipped 19 previous similar messages [19296.073918] Lustre: Skipped 4 previous similar messages [19897.071412] Lustre: soaked-MDT0000: Client 80445a37-adf6-4 (at 192.168.1.131@o2ib) reconnecting [19897.081184] Lustre: Skipped 1 previous similar message [19897.087001] Lustre: soaked-MDT0000: Connection restored to 80445a37-adf6-4 (at 192.168.1.131@o2ib) [19897.097024] Lustre: Skipped 4 previous similar messages [20497.071702] Lustre: soaked-MDT0000: Client 0098bb46-ec5c-4 (at 192.168.1.128@o2ib) reconnecting [20497.081448] Lustre: Skipped 3 previous similar messages [20497.087371] Lustre: soaked-MDT0000: Connection restored to d064055a-9b76-4 (at 192.168.1.128@o2ib) [20497.097387] Lustre: Skipped 2 previous similar messages [21098.098351] Lustre: soaked-MDT0000: Client 0098bb46-ec5c-4 (at 192.168.1.128@o2ib) reconnecting [21098.108126] Lustre: Skipped 3 previous similar messages [21098.114048] Lustre: soaked-MDT0000: Connection restored to d064055a-9b76-4 (at 192.168.1.128@o2ib) [21098.124061] Lustre: Skipped 3 previous similar messages [21699.157829] Lustre: soaked-MDT0000: Client 0098bb46-ec5c-4 (at 192.168.1.128@o2ib) reconnecting [21699.167586] Lustre: Skipped 3 previous similar messages [21699.173493] Lustre: soaked-MDT0000: Connection restored to d064055a-9b76-4 (at 192.168.1.128@o2ib) [21699.183511] Lustre: Skipped 3 previous similar messages [21895.568641] Lustre: 5201:0:(mdd_device.c:1825:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1 [22211.808364] LNetError: 4841:0:(o2iblnd_cb.c:3348:kiblnd_check_txs_locked()) Timed out tx: active_txs, 0 seconds [22211.819655] LNetError: 4841:0:(o2iblnd_cb.c:3423:kiblnd_check_conns()) Timed out RDMA with 192.168.1.107@o2ib (6): c: 4, oc: 0, rc: 8 [22211.833615] LNetError: 28913:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.107@o2ib) recovery failed with -113 [22211.846960] LNetError: 28913:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 78 previous similar messages [22211.858668] Lustre: 4854:0:(client.c:2229:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1588147573/real 1588147579] req@ffff994d2d52f500 x1665270510253824/t0(0) o13->soaked-OST000b-osc-MDT0000@192.168.1.107@o2ib:7/4 lens 224/368 e 0 to 1 dl 1588147580 ref 1 fl Rpc:eXQr/0/ffffffff rc 0/-1 job:'' [22211.858710] Lustre: soaked-OST000f-osc-MDT0000: Connection to soaked-OST000f (at 192.168.1.107@o2ib) was lost; in progress operations using this service will wait for recovery to complete [22211.910404] Lustre: 4854:0:(client.c:2229:ptlrpc_expire_one_request()) Skipped 2 previous similar messages [22243.919581] LNetError: 28913:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.107@o2ib) recovery failed with -113 [22243.932922] LNetError: 28913:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 31 previous similar messages [22300.217784] Lustre: soaked-MDT0000: Client 0098bb46-ec5c-4 (at 192.168.1.128@o2ib) reconnecting [22300.226826] Lustre: soaked-MDT0000: Connection restored to 80445a37-adf6-4 (at 192.168.1.131@o2ib) [22300.226828] Lustre: Skipped 3 previous similar messages [22300.243380] Lustre: Skipped 4 previous similar messages [22308.066447] LNetError: 30374:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.107@o2ib) recovery failed with -113 [22308.079787] LNetError: 30374:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 63 previous similar messages [22416.825941] Lustre: soaked-MDT0000: haven't heard from client soaked-MDT0000-lwp-OST000b_UUID (at 192.168.1.107@o2ib) in 229 seconds. I think it's dead, and I am evicting it. exp ffff994d223dfc00, cur 1588147784 expire 1588147634 last 1588147555 [22416.850262] Lustre: Skipped 4 previous similar messages [22417.964975] Lustre: MGS: haven't heard from client 5eecfae9-3b41-4 (at 192.168.1.107@o2ib) in 230 seconds. I think it's dead, and I am evicting it. exp ffff994d22aba000, cur 1588147785 expire 1588147635 last 1588147555 [22417.986649] Lustre: Skipped 3 previous similar messages [22436.586148] LNetError: 28913:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.107@o2ib) recovery failed with -113 [22436.599479] LNetError: 28913:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 127 previous similar messages [22508.789232] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.107@o2ib: 0 seconds [22508.800606] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 14 previous similar messages [22517.788673] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.107@o2ib: 0 seconds [22517.800046] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 5 previous similar messages [22540.787250] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.107@o2ib: 1 seconds [22540.798628] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 10 previous similar messages [22576.784881] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.107@o2ib: 0 seconds [22576.796254] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 11 previous similar messages [22588.288708] LustreError: 11-0: soaked-OST000b-osc-MDT0000: operation ost_statfs to node 192.168.1.102@o2ib failed: rc = -107 [22588.301309] Lustre: soaked-OST000b-osc-MDT0000: Connection to soaked-OST000b (at 192.168.1.102@o2ib) was lost; in progress operations using this service will wait for recovery to complete [22588.319980] Lustre: Skipped 3 previous similar messages [22596.417355] LNet: 25541:0:(o2iblnd_cb.c:2598:kiblnd_passive_connect()) Conn stale 192.168.1.107@o2ib version 12/12 incarnation 1588147963208605/1588147963208605 [22597.783470] LNet: 4841:0:(o2iblnd_cb.c:1509:kiblnd_reconnect_peer()) Abort reconnection of 192.168.1.107@o2ib: connected [22603.519679] LustreError: 11-0: soaked-OST0003-osc-MDT0000: operation ost_statfs to node 192.168.1.102@o2ib failed: rc = -107 [22603.532320] Lustre: soaked-OST0003-osc-MDT0000: Connection to soaked-OST0003 (at 192.168.1.102@o2ib) was lost; in progress operations using this service will wait for recovery to complete [22611.183202] LustreError: 11-0: soaked-OST000f-osc-MDT0000: operation ost_statfs to node 192.168.1.102@o2ib failed: rc = -107 [22611.195788] Lustre: soaked-OST000f-osc-MDT0000: Connection to soaked-OST000f (at 192.168.1.102@o2ib) was lost; in progress operations using this service will wait for recovery to complete [22617.246815] LustreError: 11-0: soaked-OST0007-osc-MDT0000: operation ost_statfs to node 192.168.1.102@o2ib failed: rc = -107 [22824.768893] LNetError: 4841:0:(o2iblnd_cb.c:3348:kiblnd_check_txs_locked()) Timed out tx: active_txs, 0 seconds [22824.780177] LNetError: 4841:0:(o2iblnd_cb.c:3423:kiblnd_check_conns()) Timed out RDMA with 192.168.1.110@o2ib (9): c: 6, oc: 0, rc: 8 [22824.794135] LNetError: 36122:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.110@o2ib) recovery failed with -113 [22824.807505] LNetError: 36122:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 81 previous similar messages [22824.819210] Lustre: 4859:0:(client.c:2229:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1588148186/real 1588148192] req@ffff994d0bf81200 x1665270510404032/t0(0) o41->soaked-MDT0002-osp-MDT0000@192.168.1.110@o2ib:24/4 lens 224/368 e 0 to 1 dl 1588148193 ref 1 fl Rpc:eXQr/0/ffffffff rc 0/-1 job:'' [22824.852316] Lustre: 4859:0:(client.c:2229:ptlrpc_expire_one_request()) Skipped 1 previous similar message [22824.863053] Lustre: soaked-MDT0002-osp-MDT0000: Connection to soaked-MDT0002 (at 192.168.1.110@o2ib) was lost; in progress operations using this service will wait for recovery to complete [22824.881709] Lustre: Skipped 1 previous similar message [22901.271416] Lustre: soaked-MDT0000: Client 80445a37-adf6-4 (at 192.168.1.131@o2ib) reconnecting [22901.281168] Lustre: Skipped 2 previous similar messages [22901.287067] Lustre: soaked-MDT0000: Connection restored to 80445a37-adf6-4 (at 192.168.1.131@o2ib) [22901.297081] Lustre: Skipped 21 previous similar messages [23018.756415] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 0 seconds [23018.767789] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 3 previous similar messages [23026.251853] Lustre: MGS: haven't heard from client ffbe2892-e144-4 (at 192.168.1.110@o2ib) in 229 seconds. I think it's dead, and I am evicting it. exp ffff99515e33a000, cur 1588148393 expire 1588148243 last 1588148164 [23151.747807] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 1 seconds [23151.759189] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 30 previous similar messages [23210.917618] Lustre: soaked-MDT0000: Received new LWP connection from 192.168.1.110@o2ib, removing former export from same NID [23897.305980] Lustre: soaked-MDT0000: Client a50df61c-5c0a-4 (at 192.168.1.124@o2ib) reconnecting [23897.315745] Lustre: Skipped 3 previous similar messages [23897.321671] Lustre: soaked-MDT0000: Connection restored to d754faaf-ec8f-4 (at 192.168.1.124@o2ib) [23897.331705] Lustre: Skipped 6 previous similar messages [23935.697146] LNetError: 4841:0:(o2iblnd_cb.c:3348:kiblnd_check_txs_locked()) Timed out tx: active_txs, 0 seconds [23935.708436] LNetError: 4841:0:(o2iblnd_cb.c:3423:kiblnd_check_conns()) Timed out RDMA with 192.168.1.110@o2ib (8): c: 6, oc: 0, rc: 8 [23935.722406] LNetError: 28913:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.110@o2ib) recovery failed with -113 [23935.735786] LNetError: 28913:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 210 previous similar messages [23935.747582] Lustre: 4867:0:(client.c:2229:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1588149297/real 1588149303] req@ffff994d2d52e780 x1665270510858368/t0(0) o41->soaked-MDT0002-osp-MDT0000@192.168.1.110@o2ib:24/4 lens 224/368 e 0 to 1 dl 1588149341 ref 1 fl Rpc:eXQr/0/ffffffff rc 0/-1 job:'' [23935.780716] Lustre: soaked-MDT0002-osp-MDT0000: Connection to soaked-MDT0002 (at 192.168.1.110@o2ib) was lost; in progress operations using this service will wait for recovery to complete [24141.665082] Lustre: MGS: haven't heard from client 463c434d-f601-4 (at 192.168.1.110@o2ib) in 227 seconds. I think it's dead, and I am evicting it. exp ffff994d222f8400, cur 1588149508 expire 1588149358 last 1588149281 [24142.683856] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 1 seconds [24175.681701] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 2 seconds [24175.693081] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 8 previous similar messages [24183.710681] Lustre: soaked-MDT0000: Received LWP connection from 192.168.1.111@o2ib, removing former export from 192.168.1.110@o2ib [24183.726737] Lustre: 5565:0:(service.c:2324:ptlrpc_server_handle_request()) @@@ Request took longer than estimated (7212/6078s); client may timeout req@ffff9951123da880 x1665261527291328/t0(0) o101->23952f37-c233-4@192.168.1.142@o2ib:401/0 lens 576/632 e 24 to 0 dl 1588143473 ref 1 fl Complete:/0/0 rc 0/0 job:'' [24183.757642] Lustre: 5565:0:(service.c:2324:ptlrpc_server_handle_request()) Skipped 9 previous similar messages [24243.677323] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 1 seconds [24243.688697] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 14 previous similar messages [24375.668812] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 0 seconds [24375.680184] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 24 previous similar messages [24483.762840] LustreError: 5565:0:(ldlm_request.c:124:ldlm_expired_completion_wait()) ### lock timed out (enqueued at 1588149551, 300s ago); not entering recovery in server code, just going back to sleep ns: mdt-soaked-MDT0000_UUID lock: ffff994d26ee8b40/0x7f1e5ec506a8b92f lrc: 3/1,0 mode: --/PR res: [0x200000405:0x13a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5565 timeout: 0 lvb_type: 0 [24538.658316] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.110@o2ib) recovery failed with -110 [24538.671553] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 269 previous similar messages [24633.652176] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 0 seconds [24633.663549] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 41 previous similar messages [24933.970833] Lustre: 4917:0:(service.c:1440:ptlrpc_at_send_early_reply()) @@@ Could not add any time (5/-150), not sending early reply req@ffff995123b57980 x1665263046375808/t0(0) o101->a50df61c-5c0a-4@192.168.1.124@o2ib:256/0 lens 576/3328 e 0 to 0 dl 1588150306 ref 2 fl Interpret:/0/0 rc 0/0 job:'' [24939.732220] Lustre: soaked-MDT0000: Client a50df61c-5c0a-4 (at 192.168.1.124@o2ib) reconnecting [24939.742050] Lustre: soaked-MDT0000: Connection restored to d754faaf-ec8f-4 (at 192.168.1.124@o2ib) [24939.752078] Lustre: Skipped 2 previous similar messages [25144.619297] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.110@o2ib) recovery failed with -110 [25144.632546] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 97 previous similar messages [25150.618852] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 0 seconds [25150.630231] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 83 previous similar messages [25386.859611] Lustre: mdt01_011: service thread pid 5565 was inactive for 1203.155 seconds. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes: [25386.880617] Pid: 5565, comm: mdt01_011 3.10.0-1062.9.1.el7_lustre.x86_64 #1 SMP Tue Feb 11 19:11:56 UTC 2020 [25386.891614] Call Trace: [25386.894393] [] ldlm_completion_ast+0x62d/0x9b0 [ptlrpc] [25386.902232] [] ldlm_cli_enqueue_local+0x25c/0x850 [ptlrpc] [25386.910277] [] mdt_object_local_lock+0x523/0xb60 [mdt] [25386.917953] [] mdt_object_lock_internal+0x70/0x3f0 [mdt] [25386.925790] [] mdt_getattr_name_lock+0x985/0x1d60 [mdt] [25386.933533] [] mdt_intent_getattr+0x2b5/0x480 [mdt] [25386.940865] [] mdt_intent_opc+0x1ba/0xb40 [mdt] [25386.947805] [] mdt_intent_policy+0x1a4/0x360 [mdt] [25386.955027] [] ldlm_lock_enqueue+0x3cb/0xad0 [ptlrpc] [25386.962578] [] ldlm_handle_enqueue0+0xa56/0x1610 [ptlrpc] [25386.970507] [] tgt_enqueue+0x62/0x210 [ptlrpc] [25386.977407] [] tgt_request_handle+0x95a/0x1630 [ptlrpc] [25386.985146] [] ptlrpc_server_handle_request+0x256/0xb10 [ptlrpc] [25386.993762] [] ptlrpc_main+0xbb4/0x1550 [ptlrpc] [25387.000819] [] kthread+0xd1/0xe0 [25387.006324] [] ret_from_fork_nospec_end+0x0/0x39 [25387.013382] [] 0xffffffffffffffff [25494.880457] Lustre: 7356:0:(mdd_device.c:1825:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1 [25695.708048] Lustre: soaked-MDT0000: Client a50df61c-5c0a-4 (at 192.168.1.124@o2ib) reconnecting [25695.717870] Lustre: soaked-MDT0000: Connection restored to d754faaf-ec8f-4 (at 192.168.1.124@o2ib) [25746.580423] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.110@o2ib) recovery failed with -110 [25746.593658] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 96 previous similar messages [25753.579957] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 1 seconds [25753.591329] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 96 previous similar messages [26352.541345] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.110@o2ib) recovery failed with -110 [26352.554590] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 99 previous similar messages [26359.540877] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 1 seconds [26359.552232] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 99 previous similar messages [26451.677893] Lustre: soaked-MDT0000: Client a50df61c-5c0a-4 (at 192.168.1.124@o2ib) reconnecting [26451.687713] Lustre: soaked-MDT0000: Connection restored to d754faaf-ec8f-4 (at 192.168.1.124@o2ib) [26956.502351] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.110@o2ib) recovery failed with -110 [26956.515608] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 98 previous similar messages [26962.501953] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 0 seconds [26962.513317] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 98 previous similar messages [27207.647826] Lustre: soaked-MDT0000: Client a50df61c-5c0a-4 (at 192.168.1.124@o2ib) reconnecting [27207.657646] Lustre: soaked-MDT0000: Connection restored to d754faaf-ec8f-4 (at 192.168.1.124@o2ib) [27562.463313] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.110@o2ib) recovery failed with -110 [27562.476555] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 96 previous similar messages [27568.462862] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 0 seconds [27568.474234] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 96 previous similar messages [27963.617897] Lustre: soaked-MDT0000: Client a50df61c-5c0a-4 (at 192.168.1.124@o2ib) reconnecting [27963.627720] Lustre: soaked-MDT0000: Connection restored to d754faaf-ec8f-4 (at 192.168.1.124@o2ib) [28168.424157] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.110@o2ib) recovery failed with -110 [28168.437397] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 98 previous similar messages [28174.423768] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 0 seconds [28174.435158] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 98 previous similar messages [28719.588003] Lustre: soaked-MDT0000: Client a50df61c-5c0a-4 (at 192.168.1.124@o2ib) reconnecting [28719.597820] Lustre: soaked-MDT0000: Connection restored to d754faaf-ec8f-4 (at 192.168.1.124@o2ib) [28774.385057] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.110@o2ib) recovery failed with -110 [28774.398283] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 95 previous similar messages [28780.384623] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 0 seconds [28780.395995] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 95 previous similar messages [29094.180904] Lustre: 7356:0:(mdd_device.c:1825:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1 [29375.346205] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.110@o2ib) recovery failed with -110 [29375.359449] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 283 previous similar messages [29381.345812] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 41 seconds [29381.357284] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 287 previous similar messages [29475.558231] Lustre: soaked-MDT0000: Client a50df61c-5c0a-4 (at 192.168.1.124@o2ib) reconnecting [29475.568036] Lustre: soaked-MDT0000: Connection restored to d754faaf-ec8f-4 (at 192.168.1.124@o2ib) [29976.307403] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.110@o2ib) recovery failed with -110 [29976.320651] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 386 previous similar messages [29986.306752] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 0 seconds [29986.318118] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 385 previous similar messages [30231.528441] Lustre: soaked-MDT0000: Client a50df61c-5c0a-4 (at 192.168.1.124@o2ib) reconnecting [30231.538255] Lustre: soaked-MDT0000: Connection restored to d754faaf-ec8f-4 (at 192.168.1.124@o2ib) [30577.268628] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.110@o2ib) recovery failed with -110 [30577.281871] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 375 previous similar messages [30592.267687] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 0 seconds [30592.279052] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 375 previous similar messages [30987.498783] Lustre: soaked-MDT0000: Client a50df61c-5c0a-4 (at 192.168.1.124@o2ib) reconnecting [30987.508606] Lustre: soaked-MDT0000: Connection restored to d754faaf-ec8f-4 (at 192.168.1.124@o2ib) [31178.229936] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.110@o2ib) recovery failed with -110 [31178.243185] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 358 previous similar messages [31193.228825] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 10 seconds [31193.240294] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 363 previous similar messages [31743.469193] Lustre: soaked-MDT0000: Client a50df61c-5c0a-4 (at 192.168.1.124@o2ib) reconnecting [31743.479010] Lustre: soaked-MDT0000: Connection restored to d754faaf-ec8f-4 (at 192.168.1.124@o2ib) [31779.191103] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.110@o2ib) recovery failed with -110 [31779.204338] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 368 previous similar messages [31795.190051] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 0 seconds [31795.201431] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 364 previous similar messages [32380.152366] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.110@o2ib) recovery failed with -110 [32380.165604] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 354 previous similar messages [32396.151284] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 65 seconds [32396.162746] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 362 previous similar messages [32499.439705] Lustre: soaked-MDT0000: Client a50df61c-5c0a-4 (at 192.168.1.124@o2ib) reconnecting [32499.449516] Lustre: soaked-MDT0000: Connection restored to d754faaf-ec8f-4 (at 192.168.1.124@o2ib) [32694.541127] Lustre: 4917:0:(mdd_device.c:1825:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1 [32982.113551] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.110@o2ib) recovery failed with -110 [32982.126794] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 368 previous similar messages [32997.112549] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 81 seconds [32997.124016] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 367 previous similar messages [33255.410304] Lustre: soaked-MDT0000: Client a50df61c-5c0a-4 (at 192.168.1.124@o2ib) reconnecting [33255.420104] Lustre: soaked-MDT0000: Connection restored to d754faaf-ec8f-4 (at 192.168.1.124@o2ib) [33583.074796] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.110@o2ib) recovery failed with -110 [33583.088038] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 370 previous similar messages [33598.073777] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 54 seconds [33598.085247] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 370 previous similar messages [34011.380877] Lustre: soaked-MDT0000: Client a50df61c-5c0a-4 (at 192.168.1.124@o2ib) reconnecting [34011.390692] Lustre: soaked-MDT0000: Connection restored to d754faaf-ec8f-4 (at 192.168.1.124@o2ib) [34184.035460] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.110@o2ib) recovery failed with -110 [34184.048713] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 367 previous similar messages [34199.034374] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 66 seconds [34199.045842] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 367 previous similar messages [34767.351447] Lustre: soaked-MDT0000: Client a50df61c-5c0a-4 (at 192.168.1.124@o2ib) reconnecting [34767.361259] Lustre: soaked-MDT0000: Connection restored to d754faaf-ec8f-4 (at 192.168.1.124@o2ib) [34784.996036] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.110@o2ib) recovery failed with -110 [34785.009272] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 364 previous similar messages [34799.995074] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 46 seconds [34800.006536] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 364 previous similar messages [35385.956759] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.110@o2ib) recovery failed with -110 [35385.970005] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 343 previous similar messages [35400.955805] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 21 seconds [35400.967274] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 343 previous similar messages [35523.322903] Lustre: soaked-MDT0000: Client a50df61c-5c0a-4 (at 192.168.1.124@o2ib) reconnecting [35523.332736] Lustre: soaked-MDT0000: Connection restored to d754faaf-ec8f-4 (at 192.168.1.124@o2ib) [35987.917564] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.110@o2ib) recovery failed with -110 [35987.930825] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 365 previous similar messages [36006.916265] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 1 seconds [36006.927636] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 360 previous similar messages [36279.294510] Lustre: soaked-MDT0000: Client a50df61c-5c0a-4 (at 192.168.1.124@o2ib) reconnecting [36279.304326] Lustre: soaked-MDT0000: Connection restored to d754faaf-ec8f-4 (at 192.168.1.124@o2ib) [36293.862681] Lustre: 4917:0:(mdd_device.c:1825:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1 [36588.878455] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.110@o2ib) recovery failed with -110 [36588.891697] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 350 previous similar messages [36607.877210] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 20 seconds [36607.888680] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 358 previous similar messages [37035.265976] Lustre: soaked-MDT0000: Client a50df61c-5c0a-4 (at 192.168.1.124@o2ib) reconnecting [37035.275788] Lustre: soaked-MDT0000: Connection restored to d754faaf-ec8f-4 (at 192.168.1.124@o2ib) [37189.839439] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.110@o2ib) recovery failed with -110 [37189.852676] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 378 previous similar messages [37208.838170] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 5 seconds [37208.849542] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 375 previous similar messages [37791.237923] Lustre: soaked-MDT0000: Client a50df61c-5c0a-4 (at 192.168.1.124@o2ib) reconnecting [37791.247777] Lustre: soaked-MDT0000: Connection restored to d754faaf-ec8f-4 (at 192.168.1.124@o2ib) [37791.800362] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.110@o2ib) recovery failed with -110 [37791.813591] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 390 previous similar messages [37809.799155] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 3 seconds [37809.810528] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 384 previous similar messages [38392.761292] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.110@o2ib) recovery failed with -110 [38392.774526] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 376 previous similar messages [38413.759957] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 0 seconds [38413.771322] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 379 previous similar messages [38993.722343] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.110@o2ib) recovery failed with -110 [38993.735576] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 335 previous similar messages [39014.720928] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 30 seconds [39014.732405] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 343 previous similar messages [39594.683414] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.110@o2ib) recovery failed with -110 [39594.696651] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 329 previous similar messages [39615.681956] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 15 seconds [39615.693428] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 325 previous similar messages [39894.219876] Lustre: 6069:0:(mdd_device.c:1825:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1 [40195.644341] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.110@o2ib) recovery failed with -110 [40195.657591] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 324 previous similar messages [40221.642685] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 0 seconds [40221.654056] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 324 previous similar messages [40796.605357] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.110@o2ib) recovery failed with -110 [40796.618600] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 338 previous similar messages [40822.603663] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 47 seconds [40822.615115] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 346 previous similar messages [41397.566403] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.110@o2ib) recovery failed with -110 [41397.579630] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 384 previous similar messages [41427.564454] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 0 seconds [41427.575841] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 383 previous similar messages [41998.527371] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.110@o2ib) recovery failed with -110 [41998.540605] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 351 previous similar messages [42028.525395] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 24 seconds [42028.536854] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 351 previous similar messages [42600.488404] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.110@o2ib) recovery failed with -110 [42600.501637] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 340 previous similar messages [42629.486504] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 4 seconds [42629.497869] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 335 previous similar messages [43201.449422] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.110@o2ib) recovery failed with -110 [43201.462661] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 332 previous similar messages [43230.447548] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 41 seconds [43230.459026] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 340 previous similar messages [43493.550424] Lustre: 4917:0:(mdd_device.c:1825:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1 [43805.410407] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.110@o2ib) recovery failed with -110 [43805.423646] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 327 previous similar messages [43831.408609] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 16 seconds [43831.420075] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 320 previous similar messages [44406.371381] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.110@o2ib) recovery failed with -110 [44406.384607] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 333 previous similar messages [44432.369677] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 1 seconds [44432.381042] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 329 previous similar messages [45007.332473] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.110@o2ib) recovery failed with -110 [45007.345713] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 360 previous similar messages [45033.330773] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 32 seconds [45033.342260] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 368 previous similar messages [45608.293570] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.110@o2ib) recovery failed with -110 [45608.306823] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 376 previous similar messages [45634.291850] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 7 seconds [45634.303229] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 368 previous similar messages [46212.254434] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.110@o2ib) recovery failed with -110 [46212.267675] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 362 previous similar messages [46236.252873] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 3 seconds [46236.264240] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 365 previous similar messages [46818.215195] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.110@o2ib) recovery failed with -110 [46818.228447] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 361 previous similar messages [46837.213952] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 13 seconds [46837.225413] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 357 previous similar messages [47093.877028] Lustre: 5141:0:(mdd_device.c:1825:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1 [47419.176286] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.110@o2ib) recovery failed with -110 [47419.189528] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 340 previous similar messages [47440.174915] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 0 seconds [47440.186296] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 338 previous similar messages [48020.137370] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.110@o2ib) recovery failed with -110 [48020.150620] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 323 previous similar messages [48041.136048] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 38 seconds [48041.147518] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 331 previous similar messages [48621.098456] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.110@o2ib) recovery failed with -110 [48621.111691] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 326 previous similar messages [48642.097095] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 33 seconds [48642.108557] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 326 previous similar messages [49222.059488] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.110@o2ib) recovery failed with -110 [49222.072733] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 346 previous similar messages [49243.058098] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 45 seconds [49243.069583] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 346 previous similar messages [49824.020470] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.110@o2ib) recovery failed with -110 [49824.033717] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 350 previous similar messages [49844.019185] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 33 seconds [49844.030664] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 349 previous similar messages [50424.981566] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.110@o2ib) recovery failed with -110 [50424.994798] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 332 previous similar messages [50444.980232] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 32 seconds [50444.991694] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 332 previous similar messages [50693.217149] Lustre: 6069:0:(mdd_device.c:1825:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1 [51028.942389] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.110@o2ib) recovery failed with -110 [51028.955627] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 324 previous similar messages [51045.941279] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 7 seconds [51045.952645] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 317 previous similar messages [51629.903445] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.110@o2ib) recovery failed with -110 [51629.916667] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 311 previous similar messages [51646.902327] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 2 seconds [51646.913701] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 311 previous similar messages [52230.864472] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.110@o2ib) recovery failed with -110 [52230.877706] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 321 previous similar messages [52247.863408] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 11 seconds [52247.874878] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 321 previous similar messages [52831.825578] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.110@o2ib) recovery failed with -110 [52831.838814] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 361 previous similar messages [52853.824170] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 1 seconds [52853.835536] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 361 previous similar messages [53432.786603] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.110@o2ib) recovery failed with -110 [53432.799837] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 358 previous similar messages [53454.785301] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 4 seconds [53454.796666] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 358 previous similar messages [54033.747668] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.110@o2ib) recovery failed with -110 [54033.760914] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 334 previous similar messages [54055.746270] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 3 seconds [54055.757636] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 334 previous similar messages [54292.613306] Lustre: 4917:0:(mdd_device.c:1825:mdd_changelog_clear()) soaked-MDD0000: No entry for user 1 [54634.708726] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.110@o2ib) recovery failed with -110 [54634.721953] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 316 previous similar messages [54656.707271] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 15 seconds [54656.718732] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 320 previous similar messages [55235.669730] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.110@o2ib) recovery failed with -110 [55235.682957] LNetError: 4841:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 308 previous similar messages [55257.668317] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 3 seconds [55257.679682] LNet: 4841:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 304 previous similar messages [55670.675549] SysRq : Show State [55670.679016] task PC stack pid father [55670.685652] systemd S ffff994aba340000 0 1 0 0x00000000 [55670.693583] Call Trace: [55670.696356] [] schedule+0x29/0x70 [55670.701946] [] schedule_hrtimeout_range_clock+0x12d/0x150 [55670.709843] [] ? ep_scan_ready_list.isra.7+0x1b9/0x1f0 [55670.717478] [] schedule_hrtimeout_range+0x13/0x20 [55670.724584] [] ep_poll+0x23e/0x360 [55670.730248] [] ? wake_up_state+0x20/0x20 [55670.736487] [] SyS_epoll_wait+0xed/0x120 [55670.742726] [] ? system_call_after_swapgs+0xa2/0x146 [55670.750162] [] system_call_fastpath+0x25/0x2a [55670.756881] [] ? system_call_after_swapgs+0xae/0x146 [55670.764308] kthreadd S ffff994aba341070 0 2 0 0x00000000 [55670.772276] Call Trace: [55670.775028] [] ? set_cpus_allowed_ptr+0xda/0x1c0 [55670.782066] [] schedule+0x29/0x70 [55670.787627] [] kthreadd+0x315/0x320 [55670.793393] [] ? kthread_create_on_cpu+0x60/0x60 [55670.800416] [] ret_from_fork_nospec_begin+0x21/0x21 [55670.807710] [] ? kthread_create_on_cpu+0x60/0x60 [55670.814723] kworker/0:0H S ffff994aba343150 0 4 2 0x00000000 [55670.822650] Call Trace: [55670.825423] [] ? process_one_work+0x21a/0x440 [55670.832157] [] schedule+0x29/0x70 [55670.837724] [] worker_thread+0x1d9/0x3c0 [55670.843973] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55670.851305] [] kthread+0xd1/0xe0 [55670.856788] [] ? insert_kthread_work+0x40/0x40 [55670.863605] [] ret_from_fork_nospec_begin+0x21/0x21 [55670.870935] [] ? insert_kthread_work+0x40/0x40 [55670.877788] ksoftirqd/0 S ffff994aba345230 0 6 2 0x00000000 [55670.885750] Call Trace: [55670.888507] [] schedule+0x29/0x70 [55670.894067] [] smpboot_thread_fn+0xe2/0x1a0 [55670.900594] [] ? lg_double_unlock+0x40/0x40 [55670.907157] [] kthread+0xd1/0xe0 [55670.912619] [] ? insert_kthread_work+0x40/0x40 [55670.919470] [] ret_from_fork_nospec_begin+0x21/0x21 [55670.926772] [] ? insert_kthread_work+0x40/0x40 [55670.933586] migration/0 S ffff994aba3462a0 0 7 2 0x00000000 [55670.941532] Call Trace: [55670.944292] [] schedule+0x29/0x70 [55670.949878] [] smpboot_thread_fn+0xe2/0x1a0 [55670.956444] [] ? lg_double_unlock+0x40/0x40 [55670.962978] [] kthread+0xd1/0xe0 [55670.968470] [] ? insert_kthread_work+0x40/0x40 [55670.975302] [] ret_from_fork_nospec_begin+0x21/0x21 [55670.982624] [] ? insert_kthread_work+0x40/0x40 [55670.989509] rcu_bh S ffff994ab9c00000 0 8 2 0x00000000 [55670.997510] Call Trace: [55671.000295] [] ? __switch_to+0xce/0x580 [55671.006485] [] schedule+0x29/0x70 [55671.012067] [] rcu_gp_kthread+0xb2/0x720 [55671.018332] [] ? wake_up_atomic_t+0x30/0x30 [55671.024878] [] ? rcu_gp_fqs+0x90/0x90 [55671.030845] [] kthread+0xd1/0xe0 [55671.036320] [] ? insert_kthread_work+0x40/0x40 [55671.043157] [] ret_from_fork_nospec_begin+0x21/0x21 [55671.050463] [] ? insert_kthread_work+0x40/0x40 [55671.057307] rcu_sched S ffff994ab9c01070 0 9 2 0x00000000 [55671.065263] Call Trace: [55671.068015] [] schedule+0x29/0x70 [55671.073583] [] schedule_timeout+0x168/0x2d0 [55671.080125] [] ? __internal_add_timer+0x130/0x130 [55671.087262] [] ? prepare_to_wait+0x56/0x90 [55671.093714] [] rcu_gp_kthread+0x359/0x720 [55671.100083] [] ? wake_up_atomic_t+0x30/0x30 [55671.106611] [] ? rcu_gp_fqs+0x90/0x90 [55671.112556] [] kthread+0xd1/0xe0 [55671.118039] [] ? insert_kthread_work+0x40/0x40 [55671.124857] [] ret_from_fork_nospec_begin+0x21/0x21 [55671.132181] [] ? insert_kthread_work+0x40/0x40 [55671.139019] lru-add-drain S ffff994ab9c020e0 0 10 2 0x00000000 [55671.147017] Call Trace: [55671.149762] [] schedule+0x29/0x70 [55671.155334] [] rescuer_thread+0x31e/0x3c0 [55671.161671] [] ? process_one_work+0x440/0x440 [55671.168427] [] kthread+0xd1/0xe0 [55671.173910] [] ? insert_kthread_work+0x40/0x40 [55671.180741] [] ret_from_fork_nospec_begin+0x21/0x21 [55671.188057] [] ? insert_kthread_work+0x40/0x40 [55671.194897] watchdog/0 S ffff994ab9c03150 0 11 2 0x00000000 [55671.202848] Call Trace: [55671.205592] [] ? local_clock+0x25/0x30 [55671.211643] [] ? running_clock+0x9/0x10 [55671.217791] [] ? sched_clock+0x9/0x10 [55671.223742] [] schedule+0x29/0x70 [55671.229326] [] smpboot_thread_fn+0xe2/0x1a0 [55671.235859] [] ? lg_double_unlock+0x40/0x40 [55671.242417] [] kthread+0xd1/0xe0 [55671.247891] [] ? insert_kthread_work+0x40/0x40 [55671.254708] [] ret_from_fork_nospec_begin+0x21/0x21 [55671.262041] [] ? insert_kthread_work+0x40/0x40 [55671.268857] watchdog/1 S ffff994ab9e11070 0 12 2 0x00000000 [55671.276823] Call Trace: [55671.279600] [] ? local_clock+0x25/0x30 [55671.285663] [] ? running_clock+0x9/0x10 [55671.291823] [] ? sched_clock+0x9/0x10 [55671.297784] [] schedule+0x29/0x70 [55671.303367] [] smpboot_thread_fn+0xe2/0x1a0 [55671.309916] [] ? lg_double_unlock+0x40/0x40 [55671.316459] [] kthread+0xd1/0xe0 [55671.321945] [] ? insert_kthread_work+0x40/0x40 [55671.328765] [] ret_from_fork_nospec_begin+0x21/0x21 [55671.336103] [] ? insert_kthread_work+0x40/0x40 [55671.342933] migration/1 S ffff994d6cb86400 0 13 2 0x00000000 [55671.350867] Call Trace: [55671.353609] [] schedule+0x29/0x70 [55671.359178] [] smpboot_thread_fn+0xe2/0x1a0 [55671.365692] [] ? lg_double_unlock+0x40/0x40 [55671.372232] [] kthread+0xd1/0xe0 [55671.377693] [] ? insert_kthread_work+0x40/0x40 [55671.384531] [] ret_from_fork_nospec_begin+0x21/0x21 [55671.391823] [] ? insert_kthread_work+0x40/0x40 [55671.398637] ksoftirqd/1 S ffff994ab9e13150 0 14 2 0x00000000 [55671.406568] Call Trace: [55671.409314] [] schedule+0x29/0x70 [55671.414881] [] smpboot_thread_fn+0xe2/0x1a0 [55671.421417] [] ? lg_double_unlock+0x40/0x40 [55671.427949] [] kthread+0xd1/0xe0 [55671.433444] [] ? insert_kthread_work+0x40/0x40 [55671.440273] [] ret_from_fork_nospec_begin+0x21/0x21 [55671.447581] [] ? insert_kthread_work+0x40/0x40 [55671.454428] kworker/1:0H S ffff994ab9e15230 0 16 2 0x00000000 [55671.462360] Call Trace: [55671.465112] [] ? process_one_work+0x21a/0x440 [55671.471845] [] schedule+0x29/0x70 [55671.477440] [] worker_thread+0x1d9/0x3c0 [55671.483675] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55671.490990] [] kthread+0xd1/0xe0 [55671.496468] [] ? insert_kthread_work+0x40/0x40 [55671.503298] [] ret_from_fork_nospec_begin+0x21/0x21 [55671.510615] [] ? insert_kthread_work+0x40/0x40 [55671.517437] watchdog/2 S ffff994ab9e41070 0 18 2 0x00000000 [55671.525398] Call Trace: [55671.528150] [] ? sched_clock+0x9/0x10 [55671.534114] [] schedule+0x29/0x70 [55671.539670] [] smpboot_thread_fn+0xe2/0x1a0 [55671.546212] [] ? lg_double_unlock+0x40/0x40 [55671.552740] [] kthread+0xd1/0xe0 [55671.558213] [] ? insert_kthread_work+0x40/0x40 [55671.565043] [] ret_from_fork_nospec_begin+0x21/0x21 [55671.572351] [] ? insert_kthread_work+0x40/0x40 [55671.579180] migration/2 S ffff994ab9e420e0 0 19 2 0x00000000 [55671.587125] Call Trace: [55671.589871] [] schedule+0x29/0x70 [55671.595449] [] smpboot_thread_fn+0xe2/0x1a0 [55671.602008] [] ? lg_double_unlock+0x40/0x40 [55671.608534] [] kthread+0xd1/0xe0 [55671.614007] [] ? insert_kthread_work+0x40/0x40 [55671.620825] [] ret_from_fork_nospec_begin+0x21/0x21 [55671.628139] [] ? insert_kthread_work+0x40/0x40 [55671.634967] ksoftirqd/2 S ffff994ab9e43150 0 20 2 0x00000000 [55671.642912] Call Trace: [55671.645662] [] schedule+0x29/0x70 [55671.651232] [] smpboot_thread_fn+0xe2/0x1a0 [55671.657760] [] ? lg_double_unlock+0x40/0x40 [55671.664300] [] kthread+0xd1/0xe0 [55671.669761] [] ? insert_kthread_work+0x40/0x40 [55671.676592] [] ret_from_fork_nospec_begin+0x21/0x21 [55671.683909] [] ? insert_kthread_work+0x40/0x40 [55671.690726] kworker/2:0H S ffff994ab9e45230 0 22 2 0x00000000 [55671.698654] Call Trace: [55671.701419] [] ? process_one_work+0x21a/0x440 [55671.708162] [] schedule+0x29/0x70 [55671.713721] [] worker_thread+0x1d9/0x3c0 [55671.719973] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55671.727290] [] kthread+0xd1/0xe0 [55671.732749] [] ? insert_kthread_work+0x40/0x40 [55671.739578] [] ret_from_fork_nospec_begin+0x21/0x21 [55671.746894] [] ? insert_kthread_work+0x40/0x40 [55671.753710] watchdog/3 S ffff994ab9e462a0 0 23 2 0x00000000 [55671.761645] Call Trace: [55671.764413] [] ? local_clock+0x25/0x30 [55671.770471] [] ? running_clock+0x9/0x10 [55671.776609] [] ? sched_clock+0x9/0x10 [55671.782559] [] schedule+0x29/0x70 [55671.788129] [] smpboot_thread_fn+0xe2/0x1a0 [55671.794657] [] ? lg_double_unlock+0x40/0x40 [55671.801196] [] kthread+0xd1/0xe0 [55671.806657] [] ? insert_kthread_work+0x40/0x40 [55671.813481] [] ret_from_fork_nospec_begin+0x21/0x21 [55671.820796] [] ? insert_kthread_work+0x40/0x40 [55671.827611] migration/3 S ffff994ab9418000 0 24 2 0x00000000 [55671.835553] Call Trace: [55671.838306] [] ? cpu_stop_queue_work+0xe0/0xe0 [55671.845137] [] schedule+0x29/0x70 [55671.850709] [] smpboot_thread_fn+0xe2/0x1a0 [55671.857250] [] ? lg_double_unlock+0x40/0x40 [55671.863783] [] kthread+0xd1/0xe0 [55671.869258] [] ? insert_kthread_work+0x40/0x40 [55671.876087] [] ret_from_fork_nospec_begin+0x21/0x21 [55671.883407] [] ? insert_kthread_work+0x40/0x40 [55671.890229] ksoftirqd/3 S ffff994ab9419070 0 25 2 0x00000000 [55671.898182] Call Trace: [55671.900940] [] schedule+0x29/0x70 [55671.906497] [] smpboot_thread_fn+0xe2/0x1a0 [55671.913036] [] ? lg_double_unlock+0x40/0x40 [55671.919575] [] kthread+0xd1/0xe0 [55671.925047] [] ? insert_kthread_work+0x40/0x40 [55671.931878] [] ret_from_fork_nospec_begin+0x21/0x21 [55671.939196] [] ? insert_kthread_work+0x40/0x40 [55671.946025] kworker/3:0H S ffff994ab941b150 0 27 2 0x00000000 [55671.953959] Call Trace: [55671.956704] [] ? process_one_work+0x21a/0x440 [55671.963436] [] schedule+0x29/0x70 [55671.969005] [] worker_thread+0x1d9/0x3c0 [55671.975255] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55671.982572] [] kthread+0xd1/0xe0 [55671.988044] [] ? insert_kthread_work+0x40/0x40 [55671.994874] [] ret_from_fork_nospec_begin+0x21/0x21 [55672.002190] [] ? insert_kthread_work+0x40/0x40 [55672.009020] watchdog/4 S ffff994ab941c1c0 0 28 2 0x00000000 [55672.016957] Call Trace: [55672.019702] [] ? local_clock+0x25/0x30 [55672.025751] [] ? running_clock+0x9/0x10 [55672.031903] [] ? sched_clock+0x9/0x10 [55672.037861] [] schedule+0x29/0x70 [55672.043450] [] smpboot_thread_fn+0xe2/0x1a0 [55672.049996] [] ? lg_double_unlock+0x40/0x40 [55672.056521] [] kthread+0xd1/0xe0 [55672.061997] [] ? insert_kthread_work+0x40/0x40 [55672.068827] [] ret_from_fork_nospec_begin+0x21/0x21 [55672.076141] [] ? insert_kthread_work+0x40/0x40 [55672.082969] migration/4 S ffff99516ca79900 0 29 2 0x00000000 [55672.090909] Call Trace: [55672.093659] [] schedule+0x29/0x70 [55672.099228] [] smpboot_thread_fn+0xe2/0x1a0 [55672.105769] [] ? lg_double_unlock+0x40/0x40 [55672.112311] [] kthread+0xd1/0xe0 [55672.117786] [] ? insert_kthread_work+0x40/0x40 [55672.124609] [] ret_from_fork_nospec_begin+0x21/0x21 [55672.131923] [] ? insert_kthread_work+0x40/0x40 [55672.138744] ksoftirqd/4 S ffff994ab941e2a0 0 30 2 0x00000000 [55672.146660] Call Trace: [55672.149403] [] schedule+0x29/0x70 [55672.154985] [] smpboot_thread_fn+0xe2/0x1a0 [55672.161511] [] ? lg_double_unlock+0x40/0x40 [55672.168049] [] kthread+0xd1/0xe0 [55672.173508] [] ? insert_kthread_work+0x40/0x40 [55672.180340] [] ret_from_fork_nospec_begin+0x21/0x21 [55672.187653] [] ? insert_kthread_work+0x40/0x40 [55672.194469] kworker/4:0H S ffff994ab9461070 0 32 2 0x00000000 [55672.202431] Call Trace: [55672.205182] [] ? process_one_work+0x21a/0x440 [55672.211916] [] schedule+0x29/0x70 [55672.217483] [] worker_thread+0x1d9/0x3c0 [55672.223720] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55672.231043] [] kthread+0xd1/0xe0 [55672.236502] [] ? insert_kthread_work+0x40/0x40 [55672.243337] [] ret_from_fork_nospec_begin+0x21/0x21 [55672.250653] [] ? insert_kthread_work+0x40/0x40 [55672.257469] watchdog/5 S ffff994ab94620e0 0 33 2 0x00000000 [55672.265431] Call Trace: [55672.268176] [] ? local_clock+0x25/0x30 [55672.274231] [] ? running_clock+0x9/0x10 [55672.280390] [] ? sched_clock+0x9/0x10 [55672.286362] [] schedule+0x29/0x70 [55672.291932] [] smpboot_thread_fn+0xe2/0x1a0 [55672.298461] [] ? lg_double_unlock+0x40/0x40 [55672.305000] [] kthread+0xd1/0xe0 [55672.310470] [] ? insert_kthread_work+0x40/0x40 [55672.317301] [] ret_from_fork_nospec_begin+0x21/0x21 [55672.324610] [] ? insert_kthread_work+0x40/0x40 [55672.331448] migration/5 S ffff994ab9463150 0 34 2 0x00000000 [55672.339398] Call Trace: [55672.342161] [] schedule+0x29/0x70 [55672.347717] [] smpboot_thread_fn+0xe2/0x1a0 [55672.354263] [] ? lg_double_unlock+0x40/0x40 [55672.360801] [] kthread+0xd1/0xe0 [55672.366274] [] ? insert_kthread_work+0x40/0x40 [55672.373106] [] ret_from_fork_nospec_begin+0x21/0x21 [55672.380428] [] ? insert_kthread_work+0x40/0x40 [55672.387248] ksoftirqd/5 S ffff994ab94641c0 0 35 2 0x00000000 [55672.395180] Call Trace: [55672.397922] [] schedule+0x29/0x70 [55672.403477] [] smpboot_thread_fn+0xe2/0x1a0 [55672.410018] [] ? lg_double_unlock+0x40/0x40 [55672.416545] [] kthread+0xd1/0xe0 [55672.422017] [] ? insert_kthread_work+0x40/0x40 [55672.428854] [] ret_from_fork_nospec_begin+0x21/0x21 [55672.436170] [] ? insert_kthread_work+0x40/0x40 [55672.442998] kworker/5:0H S ffff994ab94662a0 0 37 2 0x00000000 [55672.450961] Call Trace: [55672.453700] [] ? process_one_work+0x21a/0x440 [55672.460442] [] schedule+0x29/0x70 [55672.466012] [] worker_thread+0x1d9/0x3c0 [55672.472263] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55672.479563] [] kthread+0xd1/0xe0 [55672.485036] [] ? insert_kthread_work+0x40/0x40 [55672.491866] [] ret_from_fork_nospec_begin+0x21/0x21 [55672.499182] [] ? insert_kthread_work+0x40/0x40 [55672.506011] watchdog/6 S ffff994ab94f0000 0 38 2 0x00000000 [55672.513933] Call Trace: [55672.516676] [] ? local_clock+0x25/0x30 [55672.522733] [] ? running_clock+0x9/0x10 [55672.528884] [] ? sched_clock+0x9/0x10 [55672.534842] [] schedule+0x29/0x70 [55672.540421] [] smpboot_thread_fn+0xe2/0x1a0 [55672.546960] [] ? lg_double_unlock+0x40/0x40 [55672.553493] [] kthread+0xd1/0xe0 [55672.558973] [] ? insert_kthread_work+0x40/0x40 [55672.565796] [] ret_from_fork_nospec_begin+0x21/0x21 [55672.573117] [] ? insert_kthread_work+0x40/0x40 [55672.579948] migration/6 S ffff994ab94f1070 0 39 2 0x00000000 [55672.587887] Call Trace: [55672.590622] [] schedule+0x29/0x70 [55672.596193] [] smpboot_thread_fn+0xe2/0x1a0 [55672.602734] [] ? lg_double_unlock+0x40/0x40 [55672.609273] [] kthread+0xd1/0xe0 [55672.614747] [] ? insert_kthread_work+0x40/0x40 [55672.621579] [] ret_from_fork_nospec_begin+0x21/0x21 [55672.628897] [] ? insert_kthread_work+0x40/0x40 [55672.635720] ksoftirqd/6 S ffff994ab94f20e0 0 40 2 0x00000000 [55672.643654] Call Trace: [55672.646405] [] schedule+0x29/0x70 [55672.651977] [] smpboot_thread_fn+0xe2/0x1a0 [55672.658502] [] ? lg_double_unlock+0x40/0x40 [55672.665041] [] kthread+0xd1/0xe0 [55672.670502] [] ? insert_kthread_work+0x40/0x40 [55672.677333] [] ret_from_fork_nospec_begin+0x21/0x21 [55672.684648] [] ? insert_kthread_work+0x40/0x40 [55672.691465] kworker/6:0H S ffff994ab94f41c0 0 42 2 0x00000000 [55672.699402] Call Trace: [55672.702148] [] ? process_one_work+0x21a/0x440 [55672.708879] [] schedule+0x29/0x70 [55672.714442] [] worker_thread+0x1d9/0x3c0 [55672.720678] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55672.727989] [] kthread+0xd1/0xe0 [55672.733448] [] ? insert_kthread_work+0x40/0x40 [55672.740277] [] ret_from_fork_nospec_begin+0x21/0x21 [55672.747581] [] ? insert_kthread_work+0x40/0x40 [55672.754400] watchdog/7 S ffff994ab94f5230 0 43 2 0x00000000 [55672.762357] Call Trace: [55672.765105] [] ? local_clock+0x25/0x30 [55672.771162] [] ? running_clock+0x9/0x10 [55672.777334] [] ? sched_clock+0x9/0x10 [55672.783293] [] schedule+0x29/0x70 [55672.788864] [] smpboot_thread_fn+0xe2/0x1a0 [55672.795418] [] ? lg_double_unlock+0x40/0x40 [55672.801957] [] kthread+0xd1/0xe0 [55672.807434] [] ? insert_kthread_work+0x40/0x40 [55672.814270] [] ret_from_fork_nospec_begin+0x21/0x21 [55672.821572] [] ? insert_kthread_work+0x40/0x40 [55672.828414] migration/7 S ffff994ab94f62a0 0 44 2 0x00000000 [55672.836378] Call Trace: [55672.839138] [] schedule+0x29/0x70 [55672.844695] [] smpboot_thread_fn+0xe2/0x1a0 [55672.851235] [] ? lg_double_unlock+0x40/0x40 [55672.857776] [] kthread+0xd1/0xe0 [55672.863251] [] ? insert_kthread_work+0x40/0x40 [55672.870079] [] ret_from_fork_nospec_begin+0x21/0x21 [55672.877395] [] ? insert_kthread_work+0x40/0x40 [55672.884231] ksoftirqd/7 S ffff994ab9538000 0 45 2 0x00000000 [55672.892164] Call Trace: [55672.894917] [] schedule+0x29/0x70 [55672.900488] [] smpboot_thread_fn+0xe2/0x1a0 [55672.907027] [] ? lg_double_unlock+0x40/0x40 [55672.913554] [] kthread+0xd1/0xe0 [55672.919029] [] ? insert_kthread_work+0x40/0x40 [55672.925859] [] ret_from_fork_nospec_begin+0x21/0x21 [55672.933173] [] ? insert_kthread_work+0x40/0x40 [55672.940004] kworker/7:0H S ffff994ab953a0e0 0 47 2 0x00000000 [55672.947957] Call Trace: [55672.950709] [] ? process_one_work+0x21a/0x440 [55672.957428] [] schedule+0x29/0x70 [55672.962998] [] worker_thread+0x1d9/0x3c0 [55672.969247] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55672.976550] [] kthread+0xd1/0xe0 [55672.982024] [] ? insert_kthread_work+0x40/0x40 [55672.988855] [] ret_from_fork_nospec_begin+0x21/0x21 [55672.996170] [] ? insert_kthread_work+0x40/0x40 [55673.002999] watchdog/8 S ffff994dfa023150 0 48 2 0x00000000 [55673.010940] Call Trace: [55673.013690] [] ? sched_clock+0x9/0x10 [55673.019634] [] schedule+0x29/0x70 [55673.025205] [] smpboot_thread_fn+0xe2/0x1a0 [55673.031744] [] ? lg_double_unlock+0x40/0x40 [55673.038287] [] kthread+0xd1/0xe0 [55673.043775] [] ? insert_kthread_work+0x40/0x40 [55673.050606] [] ret_from_fork_nospec_begin+0x21/0x21 [55673.057928] [] ? insert_kthread_work+0x40/0x40 [55673.064766] migration/8 S ffff994d6cb876c0 0 49 2 0x00000000 [55673.072699] Call Trace: [55673.075445] [] schedule+0x29/0x70 [55673.081014] [] smpboot_thread_fn+0xe2/0x1a0 [55673.087540] [] ? lg_double_unlock+0x40/0x40 [55673.094081] [] kthread+0xd1/0xe0 [55673.099541] [] ? insert_kthread_work+0x40/0x40 [55673.106376] [] ret_from_fork_nospec_begin+0x21/0x21 [55673.113701] [] ? insert_kthread_work+0x40/0x40 [55673.120515] ksoftirqd/8 S ffffffff8c174eed 0 50 2 0x00000000 [55673.128448] Call Trace: [55673.131196] [] schedule+0x29/0x70 [55673.136774] [] smpboot_thread_fn+0xe2/0x1a0 [55673.143316] [] ? lg_double_unlock+0x40/0x40 [55673.149867] [] kthread+0xd1/0xe0 [55673.155333] [] ? insert_kthread_work+0x40/0x40 [55673.162163] [] ret_from_fork_nospec_begin+0x21/0x21 [55673.169467] [] ? insert_kthread_work+0x40/0x40 [55673.176309] kworker/8:0 S ffff994df9dc20e0 0 51 2 0x00000000 [55673.184248] Call Trace: [55673.186999] [] ? process_one_work+0x21a/0x440 [55673.193733] [] schedule+0x29/0x70 [55673.199303] [] worker_thread+0x1d9/0x3c0 [55673.205546] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55673.212862] [] kthread+0xd1/0xe0 [55673.218341] [] ? insert_kthread_work+0x40/0x40 [55673.225182] [] ret_from_fork_nospec_begin+0x21/0x21 [55673.232482] [] ? insert_kthread_work+0x40/0x40 [55673.239326] kworker/8:0H S ffff994df9dc3150 0 52 2 0x00000000 [55673.247271] Call Trace: [55673.250021] [] ? process_one_work+0x21a/0x440 [55673.256754] [] schedule+0x29/0x70 [55673.262311] [] worker_thread+0x1d9/0x3c0 [55673.268541] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55673.275863] [] kthread+0xd1/0xe0 [55673.281348] [] ? insert_kthread_work+0x40/0x40 [55673.288181] [] ret_from_fork_nospec_begin+0x21/0x21 [55673.295490] [] ? insert_kthread_work+0x40/0x40 [55673.302312] watchdog/9 S ffff994df9dc5230 0 54 2 0x00000000 [55673.310254] Call Trace: [55673.313008] [] ? local_clock+0x25/0x30 [55673.319069] [] ? running_clock+0x9/0x10 [55673.325222] [] ? sched_clock+0x9/0x10 [55673.331195] [] schedule+0x29/0x70 [55673.336768] [] smpboot_thread_fn+0xe2/0x1a0 [55673.343309] [] ? lg_double_unlock+0x40/0x40 [55673.349856] [] kthread+0xd1/0xe0 [55673.355318] [] ? insert_kthread_work+0x40/0x40 [55673.362156] [] ret_from_fork_nospec_begin+0x21/0x21 [55673.369458] [] ? insert_kthread_work+0x40/0x40 [55673.376301] migration/9 S ffff994df9dc62a0 0 55 2 0x00000000 [55673.384260] Call Trace: [55673.387041] [] schedule+0x29/0x70 [55673.392628] [] smpboot_thread_fn+0xe2/0x1a0 [55673.399168] [] ? lg_double_unlock+0x40/0x40 [55673.405693] [] kthread+0xd1/0xe0 [55673.411183] [] ? insert_kthread_work+0x40/0x40 [55673.418016] [] ret_from_fork_nospec_begin+0x21/0x21 [55673.425334] [] ? insert_kthread_work+0x40/0x40 [55673.432182] ksoftirqd/9 S ffff994df9e10000 0 56 2 0x00000000 [55673.440155] Call Trace: [55673.442907] [] schedule+0x29/0x70 [55673.448474] [] smpboot_thread_fn+0xe2/0x1a0 [55673.455030] [] ? lg_double_unlock+0x40/0x40 [55673.461577] [] kthread+0xd1/0xe0 [55673.467055] [] ? insert_kthread_work+0x40/0x40 [55673.473907] [] ret_from_fork_nospec_begin+0x21/0x21 [55673.481224] [] ? insert_kthread_work+0x40/0x40 [55673.488055] kworker/9:0 S ffff994df9e11070 0 57 2 0x00000000 [55673.496015] Call Trace: [55673.498774] [] ? process_one_work+0x21a/0x440 [55673.505494] [] schedule+0x29/0x70 [55673.511065] [] worker_thread+0x1d9/0x3c0 [55673.517304] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55673.524618] [] kthread+0xd1/0xe0 [55673.530106] [] ? insert_kthread_work+0x40/0x40 [55673.536951] [] ret_from_fork_nospec_begin+0x21/0x21 [55673.544280] [] ? insert_kthread_work+0x40/0x40 [55673.551120] kworker/9:0H S ffff994df9e120e0 0 58 2 0x00000000 [55673.559091] Call Trace: [55673.561845] [] ? process_one_work+0x21a/0x440 [55673.568565] [] schedule+0x29/0x70 [55673.574134] [] worker_thread+0x1d9/0x3c0 [55673.580376] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55673.587691] [] kthread+0xd1/0xe0 [55673.593167] [] ? insert_kthread_work+0x40/0x40 [55673.600020] [] ret_from_fork_nospec_begin+0x21/0x21 [55673.607344] [] ? insert_kthread_work+0x40/0x40 [55673.614186] watchdog/10 R running task 0 59 2 0x00000000 [55673.622140] Call Trace: [55673.624891] [] ? sched_clock+0x9/0x10 [55673.630848] [] schedule+0x29/0x70 [55673.636411] [] smpboot_thread_fn+0xe2/0x1a0 [55673.642951] [] ? lg_double_unlock+0x40/0x40 [55673.649478] [] kthread+0xd1/0xe0 [55673.654951] [] ? insert_kthread_work+0x40/0x40 [55673.661789] [] ret_from_fork_nospec_begin+0x21/0x21 [55673.669118] [] ? insert_kthread_work+0x40/0x40 [55673.675947] migration/10 R running task 0 60 2 0x00000000 [55673.683916] Call Trace: [55673.686684] [] schedule+0x29/0x70 [55673.692270] [] smpboot_thread_fn+0xe2/0x1a0 [55673.698826] [] ? lg_double_unlock+0x40/0x40 [55673.705357] [] kthread+0xd1/0xe0 [55673.710847] [] ? insert_kthread_work+0x40/0x40 [55673.717666] [] ret_from_fork_nospec_begin+0x21/0x21 [55673.724997] [] ? insert_kthread_work+0x40/0x40 [55673.731841] ksoftirqd/10 S ffff994df9e15230 0 61 2 0x00000000 [55673.739821] Call Trace: [55673.742568] [] schedule+0x29/0x70 [55673.748137] [] smpboot_thread_fn+0xe2/0x1a0 [55673.754679] [] ? lg_double_unlock+0x40/0x40 [55673.761229] [] kthread+0xd1/0xe0 [55673.766724] [] ? insert_kthread_work+0x40/0x40 [55673.773569] [] ret_from_fork_nospec_begin+0x21/0x21 [55673.780885] [] ? insert_kthread_work+0x40/0x40 [55673.787723] kworker/10:0H S ffff994df9e68000 0 63 2 0x00000000 [55673.795673] Call Trace: [55673.798415] [] ? process_one_work+0x21a/0x440 [55673.805150] [] schedule+0x29/0x70 [55673.810724] [] worker_thread+0x1d9/0x3c0 [55673.816974] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55673.824326] [] kthread+0xd1/0xe0 [55673.829809] [] ? insert_kthread_work+0x40/0x40 [55673.836648] [] ret_from_fork_nospec_begin+0x21/0x21 [55673.843958] [] ? insert_kthread_work+0x40/0x40 [55673.850804] watchdog/11 S ffff994df9e69070 0 64 2 0x00000000 [55673.858754] Call Trace: [55673.861499] [] ? local_clock+0x25/0x30 [55673.867548] [] ? running_clock+0x9/0x10 [55673.873693] [] ? sched_clock+0x9/0x10 [55673.879643] [] schedule+0x29/0x70 [55673.885217] [] smpboot_thread_fn+0xe2/0x1a0 [55673.891757] [] ? lg_double_unlock+0x40/0x40 [55673.898314] [] kthread+0xd1/0xe0 [55673.903788] [] ? insert_kthread_work+0x40/0x40 [55673.910606] [] ret_from_fork_nospec_begin+0x21/0x21 [55673.917929] [] ? insert_kthread_work+0x40/0x40 [55673.924758] migration/11 S ffff994df9e6a0e0 0 65 2 0x00000000 [55673.932694] Call Trace: [55673.935459] [] schedule+0x29/0x70 [55673.941039] [] smpboot_thread_fn+0xe2/0x1a0 [55673.947603] [] ? lg_double_unlock+0x40/0x40 [55673.954158] [] kthread+0xd1/0xe0 [55673.959641] [] ? insert_kthread_work+0x40/0x40 [55673.966457] [] ret_from_fork_nospec_begin+0x21/0x21 [55673.973796] [] ? insert_kthread_work+0x40/0x40 [55673.980634] ksoftirqd/11 S ffff994df9e6b150 0 66 2 0x00000000 [55673.988593] Call Trace: [55673.991335] [] schedule+0x29/0x70 [55673.996907] [] smpboot_thread_fn+0xe2/0x1a0 [55674.003434] [] ? lg_double_unlock+0x40/0x40 [55674.009988] [] kthread+0xd1/0xe0 [55674.015451] [] ? insert_kthread_work+0x40/0x40 [55674.022319] [] ret_from_fork_nospec_begin+0x21/0x21 [55674.029628] [] ? insert_kthread_work+0x40/0x40 [55674.036444] kworker/11:0H S ffff994df9e6d230 0 68 2 0x00000000 [55674.044381] Call Trace: [55674.047155] [] ? process_one_work+0x21a/0x440 [55674.053887] [] schedule+0x29/0x70 [55674.059451] [] worker_thread+0x1d9/0x3c0 [55674.065687] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55674.073026] [] kthread+0xd1/0xe0 [55674.078488] [] ? insert_kthread_work+0x40/0x40 [55674.085351] [] ret_from_fork_nospec_begin+0x21/0x21 [55674.092645] [] ? insert_kthread_work+0x40/0x40 [55674.099461] watchdog/12 S ffff994df9e6e2a0 0 69 2 0x00000000 [55674.107378] Call Trace: [55674.110131] [] ? sched_clock+0x9/0x10 [55674.116097] [] schedule+0x29/0x70 [55674.121677] [] smpboot_thread_fn+0xe2/0x1a0 [55674.128249] [] ? lg_double_unlock+0x40/0x40 [55674.134795] [] kthread+0xd1/0xe0 [55674.140284] [] ? insert_kthread_work+0x40/0x40 [55674.147127] [] ret_from_fork_nospec_begin+0x21/0x21 [55674.154457] [] ? insert_kthread_work+0x40/0x40 [55674.161300] migration/12 S ffff994df9ed8000 0 70 2 0x00000000 [55674.169305] Call Trace: [55674.172071] [] schedule+0x29/0x70 [55674.177645] [] smpboot_thread_fn+0xe2/0x1a0 [55674.184201] [] ? lg_double_unlock+0x40/0x40 [55674.190755] [] kthread+0xd1/0xe0 [55674.196244] [] ? insert_kthread_work+0x40/0x40 [55674.203084] [] ret_from_fork_nospec_begin+0x21/0x21 [55674.210388] [] ? insert_kthread_work+0x40/0x40 [55674.217257] ksoftirqd/12 S ffffffff8c174eed 0 71 2 0x00000000 [55674.225222] Call Trace: [55674.227973] [] schedule+0x29/0x70 [55674.233528] [] smpboot_thread_fn+0xe2/0x1a0 [55674.240062] [] ? lg_double_unlock+0x40/0x40 [55674.246587] [] kthread+0xd1/0xe0 [55674.252062] [] ? insert_kthread_work+0x40/0x40 [55674.258901] [] ret_from_fork_nospec_begin+0x21/0x21 [55674.266237] [] ? insert_kthread_work+0x40/0x40 [55674.273074] kworker/12:0H S ffff994df9edb150 0 73 2 0x00000000 [55674.281070] Call Trace: [55674.283823] [] ? process_one_work+0x21a/0x440 [55674.290543] [] schedule+0x29/0x70 [55674.296121] [] worker_thread+0x1d9/0x3c0 [55674.302359] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55674.309674] [] kthread+0xd1/0xe0 [55674.315149] [] ? insert_kthread_work+0x40/0x40 [55674.321981] [] ret_from_fork_nospec_begin+0x21/0x21 [55674.329302] [] ? insert_kthread_work+0x40/0x40 [55674.336132] watchdog/13 S ffff994df9edc1c0 0 74 2 0x00000000 [55674.344079] Call Trace: [55674.346846] [] ? local_clock+0x25/0x30 [55674.352909] [] ? running_clock+0x9/0x10 [55674.359082] [] ? sched_clock+0x9/0x10 [55674.365055] [] schedule+0x29/0x70 [55674.370627] [] smpboot_thread_fn+0xe2/0x1a0 [55674.377183] [] ? lg_double_unlock+0x40/0x40 [55674.383715] [] kthread+0xd1/0xe0 [55674.389191] [] ? insert_kthread_work+0x40/0x40 [55674.396021] [] ret_from_fork_nospec_begin+0x21/0x21 [55674.403350] [] ? insert_kthread_work+0x40/0x40 [55674.410196] migration/13 S ffff994df9edd230 0 75 2 0x00000000 [55674.418173] Call Trace: [55674.420938] [] schedule+0x29/0x70 [55674.426498] [] smpboot_thread_fn+0xe2/0x1a0 [55674.433044] [] ? lg_double_unlock+0x40/0x40 [55674.439592] [] kthread+0xd1/0xe0 [55674.445073] [] ? insert_kthread_work+0x40/0x40 [55674.451918] [] ret_from_fork_nospec_begin+0x21/0x21 [55674.459244] [] ? insert_kthread_work+0x40/0x40 [55674.466082] ksoftirqd/13 S ffff994df9ede2a0 0 76 2 0x00000000 [55674.474044] Call Trace: [55674.476796] [] schedule+0x29/0x70 [55674.482359] [] smpboot_thread_fn+0xe2/0x1a0 [55674.488899] [] ? lg_double_unlock+0x40/0x40 [55674.495428] [] kthread+0xd1/0xe0 [55674.500900] [] ? insert_kthread_work+0x40/0x40 [55674.507746] [] ret_from_fork_nospec_begin+0x21/0x21 [55674.515084] [] ? insert_kthread_work+0x40/0x40 [55674.521913] kworker/13:0 S ffff994df9f40000 0 77 2 0x00000000 [55674.529889] Call Trace: [55674.532656] [] ? process_one_work+0x21a/0x440 [55674.539383] [] schedule+0x29/0x70 [55674.544977] [] worker_thread+0x1d9/0x3c0 [55674.551246] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55674.558550] [] kthread+0xd1/0xe0 [55674.564025] [] ? insert_kthread_work+0x40/0x40 [55674.570877] [] ret_from_fork_nospec_begin+0x21/0x21 [55674.578216] [] ? insert_kthread_work+0x40/0x40 [55674.585046] kworker/13:0H S ffff994df9f41070 0 78 2 0x00000000 [55674.593041] Call Trace: [55674.595803] [] ? process_one_work+0x21a/0x440 [55674.602529] [] schedule+0x29/0x70 [55674.608123] [] worker_thread+0x1d9/0x3c0 [55674.614365] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55674.621691] [] kthread+0xd1/0xe0 [55674.627168] [] ? insert_kthread_work+0x40/0x40 [55674.634006] [] ret_from_fork_nospec_begin+0x21/0x21 [55674.641311] [] ? insert_kthread_work+0x40/0x40 [55674.648116] watchdog/14 S ffff994df9f420e0 0 79 2 0x00000000 [55674.656108] Call Trace: [55674.658877] [] ? local_clock+0x25/0x30 [55674.664949] [] ? running_clock+0x9/0x10 [55674.671123] [] ? sched_clock+0x9/0x10 [55674.677095] [] schedule+0x29/0x70 [55674.682683] [] smpboot_thread_fn+0xe2/0x1a0 [55674.689229] [] ? lg_double_unlock+0x40/0x40 [55674.695777] [] kthread+0xd1/0xe0 [55674.701259] [] ? insert_kthread_work+0x40/0x40 [55674.708086] [] ret_from_fork_nospec_begin+0x21/0x21 [55674.715404] [] ? insert_kthread_work+0x40/0x40 [55674.722226] migration/14 S ffff994df9f43150 0 80 2 0x00000000 [55674.730194] Call Trace: [55674.732962] [] schedule+0x29/0x70 [55674.738529] [] smpboot_thread_fn+0xe2/0x1a0 [55674.745071] [] ? lg_double_unlock+0x40/0x40 [55674.751609] [] kthread+0xd1/0xe0 [55674.757056] [] ? insert_kthread_work+0x40/0x40 [55674.763893] [] ret_from_fork_nospec_begin+0x21/0x21 [55674.771217] [] ? insert_kthread_work+0x40/0x40 [55674.778058] ksoftirqd/14 S ffff994df9f441c0 0 81 2 0x00000000 [55674.786022] Call Trace: [55674.788779] [] schedule+0x29/0x70 [55674.794343] [] smpboot_thread_fn+0xe2/0x1a0 [55674.800883] [] ? lg_double_unlock+0x40/0x40 [55674.807411] [] kthread+0xd1/0xe0 [55674.812884] [] ? insert_kthread_work+0x40/0x40 [55674.819721] [] ret_from_fork_nospec_begin+0x21/0x21 [55674.827049] [] ? insert_kthread_work+0x40/0x40 [55674.833878] kworker/14:0 S ffff994df9f45230 0 82 2 0x00000000 [55674.841849] Call Trace: [55674.844602] [] ? process_one_work+0x21a/0x440 [55674.851322] [] schedule+0x29/0x70 [55674.856918] [] worker_thread+0x1d9/0x3c0 [55674.863208] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55674.870501] [] kthread+0xd1/0xe0 [55674.875990] [] ? insert_kthread_work+0x40/0x40 [55674.882819] [] ret_from_fork_nospec_begin+0x21/0x21 [55674.890150] [] ? insert_kthread_work+0x40/0x40 [55674.896980] kworker/14:0H S ffff994df9f462a0 0 83 2 0x00000000 [55674.904947] Call Trace: [55674.907715] [] ? process_one_work+0x21a/0x440 [55674.914436] [] schedule+0x29/0x70 [55674.920029] [] worker_thread+0x1d9/0x3c0 [55674.926277] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55674.933605] [] kthread+0xd1/0xe0 [55674.939078] [] ? insert_kthread_work+0x40/0x40 [55674.945924] [] ret_from_fork_nospec_begin+0x21/0x21 [55674.953267] [] ? insert_kthread_work+0x40/0x40 [55674.960095] watchdog/15 S ffff994df9fa8000 0 84 2 0x00000000 [55674.968071] Call Trace: [55674.970845] [] ? local_clock+0x25/0x30 [55674.976910] [] ? running_clock+0x9/0x10 [55674.983083] [] ? sched_clock+0x9/0x10 [55674.989051] [] schedule+0x29/0x70 [55674.994636] [] smpboot_thread_fn+0xe2/0x1a0 [55675.001204] [] ? lg_double_unlock+0x40/0x40 [55675.007745] [] kthread+0xd1/0xe0 [55675.013230] [] ? insert_kthread_work+0x40/0x40 [55675.020065] [] ret_from_fork_nospec_begin+0x21/0x21 [55675.027390] [] ? insert_kthread_work+0x40/0x40 [55675.034224] migration/15 S ffff994d6cb85140 0 85 2 0x00000000 [55675.042207] Call Trace: [55675.044964] [] schedule+0x29/0x70 [55675.050517] [] smpboot_thread_fn+0xe2/0x1a0 [55675.057078] [] ? lg_double_unlock+0x40/0x40 [55675.063626] [] kthread+0xd1/0xe0 [55675.069110] [] ? insert_kthread_work+0x40/0x40 [55675.075956] [] ret_from_fork_nospec_begin+0x21/0x21 [55675.083264] [] ? insert_kthread_work+0x40/0x40 [55675.090073] ksoftirqd/15 S ffff994df9faa0e0 0 86 2 0x00000000 [55675.097998] Call Trace: [55675.100748] [] schedule+0x29/0x70 [55675.106313] [] smpboot_thread_fn+0xe2/0x1a0 [55675.112852] [] ? lg_double_unlock+0x40/0x40 [55675.119376] [] kthread+0xd1/0xe0 [55675.124850] [] ? insert_kthread_work+0x40/0x40 [55675.131689] [] ret_from_fork_nospec_begin+0x21/0x21 [55675.139018] [] ? insert_kthread_work+0x40/0x40 [55675.145847] kworker/15:0 S ffff994df9fab150 0 87 2 0x00000000 [55675.153822] Call Trace: [55675.156582] [] ? process_one_work+0x21a/0x440 [55675.163301] [] schedule+0x29/0x70 [55675.168895] [] worker_thread+0x1d9/0x3c0 [55675.175192] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55675.182489] [] kthread+0xd1/0xe0 [55675.187963] [] ? insert_kthread_work+0x40/0x40 [55675.194802] [] ret_from_fork_nospec_begin+0x21/0x21 [55675.202126] [] ? insert_kthread_work+0x40/0x40 [55675.208948] kworker/15:0H S ffff994df9fac1c0 0 88 2 0x00000000 [55675.216908] Call Trace: [55675.219668] [] ? process_one_work+0x21a/0x440 [55675.226388] [] schedule+0x29/0x70 [55675.231974] [] worker_thread+0x1d9/0x3c0 [55675.238238] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55675.245547] [] kthread+0xd1/0xe0 [55675.251023] [] ? insert_kthread_work+0x40/0x40 [55675.257869] [] ret_from_fork_nospec_begin+0x21/0x21 [55675.265205] [] ? insert_kthread_work+0x40/0x40 [55675.272034] watchdog/16 S ffff994ab953e2a0 0 89 2 0x00000000 [55675.280002] Call Trace: [55675.282759] [] ? local_clock+0x25/0x30 [55675.288809] [] ? running_clock+0x9/0x10 [55675.294960] [] ? sched_clock+0x9/0x10 [55675.300927] [] schedule+0x29/0x70 [55675.306500] [] smpboot_thread_fn+0xe2/0x1a0 [55675.313062] [] ? lg_double_unlock+0x40/0x40 [55675.319588] [] kthread+0xd1/0xe0 [55675.325069] [] ? insert_kthread_work+0x40/0x40 [55675.331901] [] ret_from_fork_nospec_begin+0x21/0x21 [55675.339228] [] ? insert_kthread_work+0x40/0x40 [55675.346079] migration/16 S ffff994ab953d230 0 90 2 0x00000000 [55675.354048] Call Trace: [55675.356808] [] schedule+0x29/0x70 [55675.362368] [] smpboot_thread_fn+0xe2/0x1a0 [55675.368916] [] ? lg_double_unlock+0x40/0x40 [55675.375466] [] kthread+0xd1/0xe0 [55675.380949] [] ? insert_kthread_work+0x40/0x40 [55675.387802] [] ret_from_fork_nospec_begin+0x21/0x21 [55675.395120] [] ? insert_kthread_work+0x40/0x40 [55675.401971] ksoftirqd/16 S ffff994ab953c1c0 0 91 2 0x00000000 [55675.409911] Call Trace: [55675.412664] [] schedule+0x29/0x70 [55675.418239] [] smpboot_thread_fn+0xe2/0x1a0 [55675.424783] [] ? lg_double_unlock+0x40/0x40 [55675.431310] [] kthread+0xd1/0xe0 [55675.436783] [] ? insert_kthread_work+0x40/0x40 [55675.443630] [] ret_from_fork_nospec_begin+0x21/0x21 [55675.450950] [] ? insert_kthread_work+0x40/0x40 [55675.457778] kworker/16:0 S ffff994ab953b150 0 92 2 0x00000000 [55675.465749] Call Trace: [55675.468488] [] ? process_one_work+0x21a/0x440 [55675.475226] [] schedule+0x29/0x70 [55675.480811] [] worker_thread+0x1d9/0x3c0 [55675.487085] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55675.494388] [] kthread+0xd1/0xe0 [55675.499862] [] ? insert_kthread_work+0x40/0x40 [55675.506706] [] ret_from_fork_nospec_begin+0x21/0x21 [55675.514046] [] ? insert_kthread_work+0x40/0x40 [55675.520876] kworker/16:0H S ffff994ab95c8000 0 93 2 0x00000000 [55675.528849] Call Trace: [55675.531617] [] ? process_one_work+0x21a/0x440 [55675.538338] [] schedule+0x29/0x70 [55675.543918] [] worker_thread+0x1d9/0x3c0 [55675.550193] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55675.557521] [] kthread+0xd1/0xe0 [55675.562995] [] ? insert_kthread_work+0x40/0x40 [55675.569840] [] ret_from_fork_nospec_begin+0x21/0x21 [55675.577183] [] ? insert_kthread_work+0x40/0x40 [55675.584012] watchdog/17 S ffff994ab95c9070 0 94 2 0x00000000 [55675.591985] Call Trace: [55675.594743] [] ? local_clock+0x25/0x30 [55675.600821] [] ? running_clock+0x9/0x10 [55675.606989] [] ? sched_clock+0x9/0x10 [55675.612955] [] schedule+0x29/0x70 [55675.618528] [] smpboot_thread_fn+0xe2/0x1a0 [55675.625092] [] ? lg_double_unlock+0x40/0x40 [55675.631630] [] kthread+0xd1/0xe0 [55675.637116] [] ? insert_kthread_work+0x40/0x40 [55675.643969] [] ret_from_fork_nospec_begin+0x21/0x21 [55675.651295] [] ? insert_kthread_work+0x40/0x40 [55675.658146] migration/17 S ffff994ab95ca0e0 0 95 2 0x00000000 [55675.666115] Call Trace: [55675.668874] [] ? cpu_stop_unpark+0x50/0x50 [55675.675332] [] schedule+0x29/0x70 [55675.680917] [] smpboot_thread_fn+0xe2/0x1a0 [55675.687466] [] ? lg_double_unlock+0x40/0x40 [55675.694023] [] kthread+0xd1/0xe0 [55675.699505] [] ? insert_kthread_work+0x40/0x40 [55675.706337] [] ret_from_fork_nospec_begin+0x21/0x21 [55675.713668] [] ? insert_kthread_work+0x40/0x40 [55675.720507] ksoftirqd/17 S ffff994ab95cb150 0 96 2 0x00000000 [55675.728462] Call Trace: [55675.731217] [] schedule+0x29/0x70 [55675.736789] [] smpboot_thread_fn+0xe2/0x1a0 [55675.743316] [] ? lg_double_unlock+0x40/0x40 [55675.749862] [] kthread+0xd1/0xe0 [55675.755307] [] ? insert_kthread_work+0x40/0x40 [55675.762180] [] ret_from_fork_nospec_begin+0x21/0x21 [55675.769488] [] ? insert_kthread_work+0x40/0x40 [55675.776292] kworker/17:0H S ffff994ab95cd230 0 98 2 0x00000000 [55675.784243] Call Trace: [55675.787012] [] ? process_one_work+0x21a/0x440 [55675.793745] [] schedule+0x29/0x70 [55675.799303] [] worker_thread+0x1d9/0x3c0 [55675.805548] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55675.812873] [] kthread+0xd1/0xe0 [55675.818333] [] ? insert_kthread_work+0x40/0x40 [55675.825170] [] ret_from_fork_nospec_begin+0x21/0x21 [55675.832459] [] ? insert_kthread_work+0x40/0x40 [55675.839275] watchdog/18 S ffff994ab95ce2a0 0 99 2 0x00000000 [55675.847233] Call Trace: [55675.849992] [] ? local_clock+0x25/0x30 [55675.856062] [] ? running_clock+0x9/0x10 [55675.862215] [] ? sched_clock+0x9/0x10 [55675.868177] [] schedule+0x29/0x70 [55675.873766] [] smpboot_thread_fn+0xe2/0x1a0 [55675.880292] [] ? lg_double_unlock+0x40/0x40 [55675.886833] [] kthread+0xd1/0xe0 [55675.892299] [] ? insert_kthread_work+0x40/0x40 [55675.899129] [] ret_from_fork_nospec_begin+0x21/0x21 [55675.906456] [] ? insert_kthread_work+0x40/0x40 [55675.913265] migration/18 S ffff994ab9630000 0 100 2 0x00000000 [55675.921213] Call Trace: [55675.923994] [] schedule+0x29/0x70 [55675.929581] [] smpboot_thread_fn+0xe2/0x1a0 [55675.936162] [] ? lg_double_unlock+0x40/0x40 [55675.942717] [] kthread+0xd1/0xe0 [55675.948204] [] ? insert_kthread_work+0x40/0x40 [55675.955050] [] ret_from_fork_nospec_begin+0x21/0x21 [55675.962338] [] ? insert_kthread_work+0x40/0x40 [55675.969195] ksoftirqd/18 S ffff994ab9631070 0 101 2 0x00000000 [55675.977157] Call Trace: [55675.979909] [] schedule+0x29/0x70 [55675.985458] [] smpboot_thread_fn+0xe2/0x1a0 [55675.991997] [] ? lg_double_unlock+0x40/0x40 [55675.998546] [] kthread+0xd1/0xe0 [55676.004020] [] ? insert_kthread_work+0x40/0x40 [55676.010873] [] ret_from_fork_nospec_begin+0x21/0x21 [55676.018179] [] ? insert_kthread_work+0x40/0x40 [55676.025009] kworker/18:0H S ffff994ab9633150 0 103 2 0x00000000 [55676.032979] Call Trace: [55676.035755] [] ? process_one_work+0x21a/0x440 [55676.042469] [] schedule+0x29/0x70 [55676.048048] [] worker_thread+0x1d9/0x3c0 [55676.054286] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55676.061624] [] kthread+0xd1/0xe0 [55676.067112] [] ? insert_kthread_work+0x40/0x40 [55676.073966] [] ret_from_fork_nospec_begin+0x21/0x21 [55676.081268] [] ? insert_kthread_work+0x40/0x40 [55676.088093] watchdog/19 S ffff994ab96341c0 0 104 2 0x00000000 [55676.096050] Call Trace: [55676.098825] [] ? touch_nmi_watchdog+0x30/0x30 [55676.105542] [] ? sched_clock+0x9/0x10 [55676.111487] [] schedule+0x29/0x70 [55676.117067] [] smpboot_thread_fn+0xe2/0x1a0 [55676.123602] [] ? lg_double_unlock+0x40/0x40 [55676.130134] [] kthread+0xd1/0xe0 [55676.135607] [] ? insert_kthread_work+0x40/0x40 [55676.142420] [] ret_from_fork_nospec_begin+0x21/0x21 [55676.149756] [] ? insert_kthread_work+0x40/0x40 [55676.156585] migration/19 S ffff994ab9635230 0 105 2 0x00000000 [55676.164546] Call Trace: [55676.167314] [] ? cpu_stop_queue_work+0xe0/0xe0 [55676.174153] [] schedule+0x29/0x70 [55676.179758] [] smpboot_thread_fn+0xe2/0x1a0 [55676.186279] [] ? lg_double_unlock+0x40/0x40 [55676.192819] [] kthread+0xd1/0xe0 [55676.198279] [] ? insert_kthread_work+0x40/0x40 [55676.205110] [] ret_from_fork_nospec_begin+0x21/0x21 [55676.212441] [] ? insert_kthread_work+0x40/0x40 [55676.219255] ksoftirqd/19 S ffff994ab96362a0 0 106 2 0x00000000 [55676.227218] Call Trace: [55676.229983] [] schedule+0x29/0x70 [55676.235570] [] smpboot_thread_fn+0xe2/0x1a0 [55676.242152] [] ? lg_double_unlock+0x40/0x40 [55676.248719] [] kthread+0xd1/0xe0 [55676.254209] [] ? insert_kthread_work+0x40/0x40 [55676.261048] [] ret_from_fork_nospec_begin+0x21/0x21 [55676.268345] [] ? insert_kthread_work+0x40/0x40 [55676.275175] kworker/19:0H S ffff994ab96a1070 0 108 2 0x00000000 [55676.283163] Call Trace: [55676.285915] [] ? process_one_work+0x21a/0x440 [55676.292659] [] schedule+0x29/0x70 [55676.298212] [] worker_thread+0x1d9/0x3c0 [55676.304442] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55676.311779] [] kthread+0xd1/0xe0 [55676.317263] [] ? insert_kthread_work+0x40/0x40 [55676.324122] [] ret_from_fork_nospec_begin+0x21/0x21 [55676.331419] [] ? insert_kthread_work+0x40/0x40 [55676.338262] watchdog/20 S ffff994ab96a20e0 0 109 2 0x00000000 [55676.346203] Call Trace: [55676.348956] [] ? sched_clock+0x9/0x10 [55676.354913] [] schedule+0x29/0x70 [55676.360470] [] smpboot_thread_fn+0xe2/0x1a0 [55676.367011] [] ? lg_double_unlock+0x40/0x40 [55676.373557] [] kthread+0xd1/0xe0 [55676.379030] [] ? insert_kthread_work+0x40/0x40 [55676.385877] [] ret_from_fork_nospec_begin+0x21/0x21 [55676.393185] [] ? insert_kthread_work+0x40/0x40 [55676.400012] migration/20 S ffff994ab96a3150 0 110 2 0x00000000 [55676.407997] Call Trace: [55676.410762] [] schedule+0x29/0x70 [55676.416333] [] smpboot_thread_fn+0xe2/0x1a0 [55676.422888] [] ? lg_double_unlock+0x40/0x40 [55676.429409] [] kthread+0xd1/0xe0 [55676.434885] [] ? insert_kthread_work+0x40/0x40 [55676.441714] [] ret_from_fork_nospec_begin+0x21/0x21 [55676.449049] [] ? insert_kthread_work+0x40/0x40 [55676.455901] ksoftirqd/20 S ffff994ab96a41c0 0 111 2 0x00000000 [55676.463868] Call Trace: [55676.466642] [] schedule+0x29/0x70 [55676.472191] [] smpboot_thread_fn+0xe2/0x1a0 [55676.478744] [] ? lg_double_unlock+0x40/0x40 [55676.485292] [] kthread+0xd1/0xe0 [55676.490787] [] ? insert_kthread_work+0x40/0x40 [55676.497631] [] ret_from_fork_nospec_begin+0x21/0x21 [55676.504940] [] ? insert_kthread_work+0x40/0x40 [55676.511770] kworker/20:0H S ffff994ab96a62a0 0 113 2 0x00000000 [55676.519720] Call Trace: [55676.522459] [] ? process_one_work+0x21a/0x440 [55676.529175] [] schedule+0x29/0x70 [55676.534747] [] worker_thread+0x1d9/0x3c0 [55676.540996] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55676.548319] [] kthread+0xd1/0xe0 [55676.553810] [] ? insert_kthread_work+0x40/0x40 [55676.560663] [] ret_from_fork_nospec_begin+0x21/0x21 [55676.567978] [] ? insert_kthread_work+0x40/0x40 [55676.574817] watchdog/21 S ffff994ab9708000 0 114 2 0x00000000 [55676.582781] Call Trace: [55676.585517] [] ? local_clock+0x25/0x30 [55676.591572] [] ? running_clock+0x9/0x10 [55676.597728] [] ? sched_clock+0x9/0x10 [55676.603687] [] schedule+0x29/0x70 [55676.609239] [] smpboot_thread_fn+0xe2/0x1a0 [55676.615780] [] ? lg_double_unlock+0x40/0x40 [55676.622301] [] kthread+0xd1/0xe0 [55676.627776] [] ? insert_kthread_work+0x40/0x40 [55676.634615] [] ret_from_fork_nospec_begin+0x21/0x21 [55676.641955] [] ? insert_kthread_work+0x40/0x40 [55676.648770] migration/21 S ffff994ab9709070 0 115 2 0x00000000 [55676.656740] Call Trace: [55676.659507] [] schedule+0x29/0x70 [55676.665110] [] smpboot_thread_fn+0xe2/0x1a0 [55676.671672] [] ? lg_double_unlock+0x40/0x40 [55676.678192] [] kthread+0xd1/0xe0 [55676.683689] [] ? insert_kthread_work+0x40/0x40 [55676.690512] [] ret_from_fork_nospec_begin+0x21/0x21 [55676.697843] [] ? insert_kthread_work+0x40/0x40 [55676.704673] ksoftirqd/21 S ffff994ab970a0e0 0 116 2 0x00000000 [55676.712603] Call Trace: [55676.715346] [] schedule+0x29/0x70 [55676.720916] [] smpboot_thread_fn+0xe2/0x1a0 [55676.727461] [] ? lg_double_unlock+0x40/0x40 [55676.734002] [] kthread+0xd1/0xe0 [55676.739461] [] ? insert_kthread_work+0x40/0x40 [55676.746273] [] ret_from_fork_nospec_begin+0x21/0x21 [55676.753592] [] ? insert_kthread_work+0x40/0x40 [55676.760408] kworker/21:0 S ffff994ab970b150 0 117 2 0x00000000 [55676.768332] Call Trace: [55676.771096] [] ? process_one_work+0x21a/0x440 [55676.777844] [] schedule+0x29/0x70 [55676.783417] [] worker_thread+0x1d9/0x3c0 [55676.789669] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55676.796978] [] kthread+0xd1/0xe0 [55676.802438] [] ? insert_kthread_work+0x40/0x40 [55676.809251] [] ret_from_fork_nospec_begin+0x21/0x21 [55676.816585] [] ? insert_kthread_work+0x40/0x40 [55676.823403] kworker/21:0H S ffff994ab970c1c0 0 118 2 0x00000000 [55676.831382] Call Trace: [55676.834161] [] ? process_one_work+0x21a/0x440 [55676.840918] [] schedule+0x29/0x70 [55676.846503] [] worker_thread+0x1d9/0x3c0 [55676.852753] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55676.860065] [] kthread+0xd1/0xe0 [55676.865539] [] ? insert_kthread_work+0x40/0x40 [55676.872350] [] ret_from_fork_nospec_begin+0x21/0x21 [55676.879675] [] ? insert_kthread_work+0x40/0x40 [55676.886489] watchdog/22 S ffff994ab970d230 0 119 2 0x00000000 [55676.894477] Call Trace: [55676.897224] [] ? touch_nmi_watchdog+0x30/0x30 [55676.903981] [] ? sched_clock+0x9/0x10 [55676.909959] [] schedule+0x29/0x70 [55676.915545] [] smpboot_thread_fn+0xe2/0x1a0 [55676.922072] [] ? lg_double_unlock+0x40/0x40 [55676.928621] [] kthread+0xd1/0xe0 [55676.934103] [] ? insert_kthread_work+0x40/0x40 [55676.940944] [] ret_from_fork_nospec_begin+0x21/0x21 [55676.948264] [] ? insert_kthread_work+0x40/0x40 [55676.955103] migration/22 S ffff994ab970e2a0 0 120 2 0x00000000 [55676.963097] Call Trace: [55676.965886] [] schedule+0x29/0x70 [55676.971458] [] smpboot_thread_fn+0xe2/0x1a0 [55676.978020] [] ? lg_double_unlock+0x40/0x40 [55676.984575] [] kthread+0xd1/0xe0 [55676.990072] [] ? insert_kthread_work+0x40/0x40 [55676.996911] [] ret_from_fork_nospec_begin+0x21/0x21 [55677.004215] [] ? insert_kthread_work+0x40/0x40 [55677.011068] ksoftirqd/22 S ffff994ab9750000 0 121 2 0x00000000 [55677.019026] Call Trace: [55677.021778] [] schedule+0x29/0x70 [55677.027327] [] smpboot_thread_fn+0xe2/0x1a0 [55677.033869] [] ? lg_double_unlock+0x40/0x40 [55677.040388] [] kthread+0xd1/0xe0 [55677.045863] [] ? insert_kthread_work+0x40/0x40 [55677.052700] [] ret_from_fork_nospec_begin+0x21/0x21 [55677.060026] [] ? insert_kthread_work+0x40/0x40 [55677.066876] kworker/22:0H S ffff994ab97520e0 0 123 2 0x00000000 [55677.074850] Call Trace: [55677.077624] [] ? process_one_work+0x21a/0x440 [55677.084346] [] schedule+0x29/0x70 [55677.089941] [] worker_thread+0x1d9/0x3c0 [55677.096179] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55677.103508] [] kthread+0xd1/0xe0 [55677.108980] [] ? insert_kthread_work+0x40/0x40 [55677.115818] [] ret_from_fork_nospec_begin+0x21/0x21 [55677.123138] [] ? insert_kthread_work+0x40/0x40 [55677.129968] watchdog/23 S ffff994ab9753150 0 124 2 0x00000000 [55677.137954] Call Trace: [55677.140721] [] ? local_clock+0x25/0x30 [55677.146799] [] ? running_clock+0x9/0x10 [55677.152975] [] ? sched_clock+0x9/0x10 [55677.158955] [] schedule+0x29/0x70 [55677.164535] [] smpboot_thread_fn+0xe2/0x1a0 [55677.171090] [] ? lg_double_unlock+0x40/0x40 [55677.177643] [] kthread+0xd1/0xe0 [55677.183110] [] ? insert_kthread_work+0x40/0x40 [55677.189947] [] ret_from_fork_nospec_begin+0x21/0x21 [55677.197264] [] ? insert_kthread_work+0x40/0x40 [55677.204106] migration/23 S ffff994ab97541c0 0 125 2 0x00000000 [55677.212084] Call Trace: [55677.214851] [] schedule+0x29/0x70 [55677.220417] [] smpboot_thread_fn+0xe2/0x1a0 [55677.226973] [] ? lg_double_unlock+0x40/0x40 [55677.233528] [] kthread+0xd1/0xe0 [55677.239040] [] ? insert_kthread_work+0x40/0x40 [55677.245878] [] ret_from_fork_nospec_begin+0x21/0x21 [55677.253164] [] ? insert_kthread_work+0x40/0x40 [55677.260004] ksoftirqd/23 S ffff994ab9755230 0 126 2 0x00000000 [55677.267965] Call Trace: [55677.270705] [] schedule+0x29/0x70 [55677.276255] [] smpboot_thread_fn+0xe2/0x1a0 [55677.282796] [] ? lg_double_unlock+0x40/0x40 [55677.289316] [] kthread+0xd1/0xe0 [55677.294788] [] ? insert_kthread_work+0x40/0x40 [55677.301627] [] ret_from_fork_nospec_begin+0x21/0x21 [55677.308943] [] ? insert_kthread_work+0x40/0x40 [55677.315778] kworker/23:0H S ffff994ab97d0000 0 128 2 0x00000000 [55677.323775] Call Trace: [55677.326561] [] ? process_one_work+0x21a/0x440 [55677.333278] [] schedule+0x29/0x70 [55677.338874] [] worker_thread+0x1d9/0x3c0 [55677.345118] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55677.352445] [] kthread+0xd1/0xe0 [55677.357917] [] ? insert_kthread_work+0x40/0x40 [55677.364764] [] ret_from_fork_nospec_begin+0x21/0x21 [55677.372080] [] ? insert_kthread_work+0x40/0x40 [55677.378922] watchdog/24 S ffff994df9fae2a0 0 129 2 0x00000000 [55677.386877] Call Trace: [55677.389640] [] ? local_clock+0x25/0x30 [55677.395712] [] ? running_clock+0x9/0x10 [55677.401885] [] ? sched_clock+0x9/0x10 [55677.407865] [] schedule+0x29/0x70 [55677.413459] [] smpboot_thread_fn+0xe2/0x1a0 [55677.420007] [] ? lg_double_unlock+0x40/0x40 [55677.426568] [] kthread+0xd1/0xe0 [55677.432073] [] ? insert_kthread_work+0x40/0x40 [55677.438914] [] ret_from_fork_nospec_begin+0x21/0x21 [55677.446237] [] ? insert_kthread_work+0x40/0x40 [55677.453069] migration/24 S ffff994df9fad230 0 130 2 0x00000000 [55677.461058] Call Trace: [55677.463839] [] schedule+0x29/0x70 [55677.469406] [] smpboot_thread_fn+0xe2/0x1a0 [55677.475969] [] ? lg_double_unlock+0x40/0x40 [55677.482525] [] kthread+0xd1/0xe0 [55677.488031] [] ? insert_kthread_work+0x40/0x40 [55677.494879] [] ret_from_fork_nospec_begin+0x21/0x21 [55677.502177] [] ? insert_kthread_work+0x40/0x40 [55677.509042] ksoftirqd/24 S ffff994df9ff8000 0 131 2 0x00000000 [55677.516990] Call Trace: [55677.519734] [] schedule+0x29/0x70 [55677.525283] [] smpboot_thread_fn+0xe2/0x1a0 [55677.531823] [] ? lg_double_unlock+0x40/0x40 [55677.538350] [] kthread+0xd1/0xe0 [55677.543825] [] ? insert_kthread_work+0x40/0x40 [55677.550664] [] ret_from_fork_nospec_begin+0x21/0x21 [55677.557983] [] ? insert_kthread_work+0x40/0x40 [55677.564811] kworker/24:0 S ffff994df9ff9070 0 132 2 0x00000000 [55677.572797] Call Trace: [55677.575565] [] ? process_one_work+0x21a/0x440 [55677.582292] [] schedule+0x29/0x70 [55677.587872] [] worker_thread+0x1d9/0x3c0 [55677.594116] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55677.601442] [] kthread+0xd1/0xe0 [55677.606916] [] ? insert_kthread_work+0x40/0x40 [55677.613761] [] ret_from_fork_nospec_begin+0x21/0x21 [55677.621084] [] ? insert_kthread_work+0x40/0x40 [55677.627912] kworker/24:0H S ffff994df9ffa0e0 0 133 2 0x00000000 [55677.635898] Call Trace: [55677.638665] [] ? process_one_work+0x21a/0x440 [55677.645384] [] schedule+0x29/0x70 [55677.650979] [] worker_thread+0x1d9/0x3c0 [55677.657223] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55677.664519] [] kthread+0xd1/0xe0 [55677.669964] [] ? insert_kthread_work+0x40/0x40 [55677.676800] [] ret_from_fork_nospec_begin+0x21/0x21 [55677.684095] [] ? insert_kthread_work+0x40/0x40 [55677.690926] watchdog/25 S ffff994df9ffb150 0 134 2 0x00000000 [55677.698873] Call Trace: [55677.701646] [] ? local_clock+0x25/0x30 [55677.707710] [] ? running_clock+0x9/0x10 [55677.713884] [] ? sched_clock+0x9/0x10 [55677.719864] [] schedule+0x29/0x70 [55677.725451] [] smpboot_thread_fn+0xe2/0x1a0 [55677.732029] [] ? lg_double_unlock+0x40/0x40 [55677.738563] [] kthread+0xd1/0xe0 [55677.744052] [] ? insert_kthread_work+0x40/0x40 [55677.750894] [] ret_from_fork_nospec_begin+0x21/0x21 [55677.758212] [] ? insert_kthread_work+0x40/0x40 [55677.765045] migration/25 S ffff994df9ffc1c0 0 135 2 0x00000000 [55677.772986] Call Trace: [55677.775787] [] schedule+0x29/0x70 [55677.781346] [] smpboot_thread_fn+0xe2/0x1a0 [55677.787886] [] ? lg_double_unlock+0x40/0x40 [55677.794450] [] kthread+0xd1/0xe0 [55677.799946] [] ? insert_kthread_work+0x40/0x40 [55677.806799] [] ret_from_fork_nospec_begin+0x21/0x21 [55677.814096] [] ? insert_kthread_work+0x40/0x40 [55677.820941] ksoftirqd/25 S ffff994df9ffd230 0 136 2 0x00000000 [55677.828892] Call Trace: [55677.831653] [] schedule+0x29/0x70 [55677.837210] [] smpboot_thread_fn+0xe2/0x1a0 [55677.843751] [] ? lg_double_unlock+0x40/0x40 [55677.850272] [] kthread+0xd1/0xe0 [55677.855749] [] ? insert_kthread_work+0x40/0x40 [55677.862591] [] ret_from_fork_nospec_begin+0x21/0x21 [55677.869931] [] ? insert_kthread_work+0x40/0x40 [55677.876753] kworker/25:0H S ffff994df9848000 0 138 2 0x00000000 [55677.884728] Call Trace: [55677.887494] [] ? process_one_work+0x21a/0x440 [55677.894209] [] schedule+0x29/0x70 [55677.899780] [] worker_thread+0x1d9/0x3c0 [55677.906042] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55677.913358] [] kthread+0xd1/0xe0 [55677.918832] [] ? insert_kthread_work+0x40/0x40 [55677.925679] [] ret_from_fork_nospec_begin+0x21/0x21 [55677.933025] [] ? insert_kthread_work+0x40/0x40 [55677.939852] watchdog/26 S ffff994df9849070 0 139 2 0x00000000 [55677.947845] Call Trace: [55677.950626] [] ? local_clock+0x25/0x30 [55677.956691] [] ? running_clock+0x9/0x10 [55677.962863] [] ? sched_clock+0x9/0x10 [55677.968836] [] schedule+0x29/0x70 [55677.974423] [] smpboot_thread_fn+0xe2/0x1a0 [55677.980996] [] ? lg_double_unlock+0x40/0x40 [55677.987537] [] kthread+0xd1/0xe0 [55677.993037] [] ? insert_kthread_work+0x40/0x40 [55677.999878] [] ret_from_fork_nospec_begin+0x21/0x21 [55678.007202] [] ? insert_kthread_work+0x40/0x40 [55678.014037] migration/26 S ffff994df984a0e0 0 140 2 0x00000000 [55678.022024] Call Trace: [55678.024797] [] schedule+0x29/0x70 [55678.030362] [] smpboot_thread_fn+0xe2/0x1a0 [55678.036903] [] ? lg_double_unlock+0x40/0x40 [55678.043467] [] kthread+0xd1/0xe0 [55678.048935] [] ? insert_kthread_work+0x40/0x40 [55678.055782] [] ret_from_fork_nospec_begin+0x21/0x21 [55678.063078] [] ? insert_kthread_work+0x40/0x40 [55678.069913] ksoftirqd/26 S ffff994df984b150 0 141 2 0x00000000 [55678.077877] Call Trace: [55678.080634] [] schedule+0x29/0x70 [55678.086190] [] smpboot_thread_fn+0xe2/0x1a0 [55678.092731] [] ? lg_double_unlock+0x40/0x40 [55678.099251] [] kthread+0xd1/0xe0 [55678.104724] [] ? insert_kthread_work+0x40/0x40 [55678.111564] [] ret_from_fork_nospec_begin+0x21/0x21 [55678.118887] [] ? insert_kthread_work+0x40/0x40 [55678.125709] kworker/26:0H S ffff994df984d230 0 143 2 0x00000000 [55678.133697] Call Trace: [55678.136463] [] ? process_one_work+0x21a/0x440 [55678.143178] [] schedule+0x29/0x70 [55678.148763] [] worker_thread+0x1d9/0x3c0 [55678.155026] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55678.162329] [] kthread+0xd1/0xe0 [55678.167802] [] ? insert_kthread_work+0x40/0x40 [55678.174643] [] ret_from_fork_nospec_begin+0x21/0x21 [55678.182002] [] ? insert_kthread_work+0x40/0x40 [55678.188833] watchdog/27 S ffff994df984e2a0 0 144 2 0x00000000 [55678.196803] Call Trace: [55678.199576] [] ? local_clock+0x25/0x30 [55678.205641] [] ? running_clock+0x9/0x10 [55678.211815] [] ? sched_clock+0x9/0x10 [55678.217788] [] schedule+0x29/0x70 [55678.223359] [] smpboot_thread_fn+0xe2/0x1a0 [55678.229920] [] ? lg_double_unlock+0x40/0x40 [55678.236461] [] kthread+0xd1/0xe0 [55678.241946] [] ? insert_kthread_work+0x40/0x40 [55678.248777] [] ret_from_fork_nospec_begin+0x21/0x21 [55678.256106] [] ? insert_kthread_work+0x40/0x40 [55678.262954] migration/27 S ffff994df98c8000 0 145 2 0x00000000 [55678.270924] Call Trace: [55678.273696] [] schedule+0x29/0x70 [55678.279245] [] smpboot_thread_fn+0xe2/0x1a0 [55678.285795] [] ? lg_double_unlock+0x40/0x40 [55678.292317] [] kthread+0xd1/0xe0 [55678.297786] [] ? insert_kthread_work+0x40/0x40 [55678.304625] [] ret_from_fork_nospec_begin+0x21/0x21 [55678.311937] [] ? insert_kthread_work+0x40/0x40 [55678.318783] ksoftirqd/27 S ffff994df98c9070 0 146 2 0x00000000 [55678.326756] Call Trace: [55678.329500] [] schedule+0x29/0x70 [55678.335057] [] smpboot_thread_fn+0xe2/0x1a0 [55678.341597] [] ? lg_double_unlock+0x40/0x40 [55678.348117] [] kthread+0xd1/0xe0 [55678.353584] [] ? insert_kthread_work+0x40/0x40 [55678.360423] [] ret_from_fork_nospec_begin+0x21/0x21 [55678.367747] [] ? insert_kthread_work+0x40/0x40 [55678.374577] kworker/27:0H S ffff994df98cb150 0 148 2 0x00000000 [55678.382529] Call Trace: [55678.385306] [] ? process_one_work+0x21a/0x440 [55678.392052] [] schedule+0x29/0x70 [55678.397644] [] worker_thread+0x1d9/0x3c0 [55678.403910] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55678.411208] [] kthread+0xd1/0xe0 [55678.416682] [] ? insert_kthread_work+0x40/0x40 [55678.423521] [] ret_from_fork_nospec_begin+0x21/0x21 [55678.430852] [] ? insert_kthread_work+0x40/0x40 [55678.437672] watchdog/28 S ffff994df98cc1c0 0 149 2 0x00000000 [55678.445644] Call Trace: [55678.448405] [] ? local_clock+0x25/0x30 [55678.454469] [] ? running_clock+0x9/0x10 [55678.460634] [] ? sched_clock+0x9/0x10 [55678.466608] [] schedule+0x29/0x70 [55678.472177] [] smpboot_thread_fn+0xe2/0x1a0 [55678.478740] [] ? lg_double_unlock+0x40/0x40 [55678.485261] [] kthread+0xd1/0xe0 [55678.490734] [] ? insert_kthread_work+0x40/0x40 [55678.497564] [] ret_from_fork_nospec_begin+0x21/0x21 [55678.504888] [] ? insert_kthread_work+0x40/0x40 [55678.511726] migration/28 S ffff994df98cd230 0 150 2 0x00000000 [55678.519721] Call Trace: [55678.522503] [] schedule+0x29/0x70 [55678.528062] [] smpboot_thread_fn+0xe2/0x1a0 [55678.534610] [] ? lg_double_unlock+0x40/0x40 [55678.541127] [] kthread+0xd1/0xe0 [55678.546622] [] ? insert_kthread_work+0x40/0x40 [55678.553469] [] ret_from_fork_nospec_begin+0x21/0x21 [55678.560786] [] ? insert_kthread_work+0x40/0x40 [55678.567625] ksoftirqd/28 S ffff994df98ce2a0 0 151 2 0x00000000 [55678.575581] Call Trace: [55678.578311] [] schedule+0x29/0x70 [55678.583902] [] smpboot_thread_fn+0xe2/0x1a0 [55678.590442] [] ? lg_double_unlock+0x40/0x40 [55678.596973] [] kthread+0xd1/0xe0 [55678.602448] [] ? insert_kthread_work+0x40/0x40 [55678.609259] [] ret_from_fork_nospec_begin+0x21/0x21 [55678.616596] [] ? insert_kthread_work+0x40/0x40 [55678.623424] kworker/28:0H S ffff994df9919070 0 153 2 0x00000000 [55678.631395] Call Trace: [55678.634170] [] ? process_one_work+0x21a/0x440 [55678.640921] [] schedule+0x29/0x70 [55678.646509] [] worker_thread+0x1d9/0x3c0 [55678.652760] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55678.660056] [] kthread+0xd1/0xe0 [55678.665528] [] ? insert_kthread_work+0x40/0x40 [55678.672361] [] ret_from_fork_nospec_begin+0x21/0x21 [55678.679683] [] ? insert_kthread_work+0x40/0x40 [55678.686505] watchdog/29 S ffff994df991a0e0 0 154 2 0x00000000 [55678.694452] Call Trace: [55678.697193] [] ? local_clock+0x25/0x30 [55678.703237] [] ? running_clock+0x9/0x10 [55678.709388] [] ? sched_clock+0x9/0x10 [55678.715347] [] schedule+0x29/0x70 [55678.720922] [] smpboot_thread_fn+0xe2/0x1a0 [55678.727501] [] ? lg_double_unlock+0x40/0x40 [55678.734019] [] kthread+0xd1/0xe0 [55678.739495] [] ? insert_kthread_work+0x40/0x40 [55678.746336] [] ret_from_fork_nospec_begin+0x21/0x21 [55678.753652] [] ? insert_kthread_work+0x40/0x40 [55678.760488] migration/29 S ffff994df991b150 0 155 2 0x00000000 [55678.768460] Call Trace: [55678.771197] [] schedule+0x29/0x70 [55678.776777] [] smpboot_thread_fn+0xe2/0x1a0 [55678.783303] [] ? lg_double_unlock+0x40/0x40 [55678.789843] [] kthread+0xd1/0xe0 [55678.795304] [] ? insert_kthread_work+0x40/0x40 [55678.802125] [] ret_from_fork_nospec_begin+0x21/0x21 [55678.809465] [] ? insert_kthread_work+0x40/0x40 [55678.816266] ksoftirqd/29 S ffff994df991c1c0 0 156 2 0x00000000 [55678.824234] Call Trace: [55678.827019] [] schedule+0x29/0x70 [55678.832601] [] smpboot_thread_fn+0xe2/0x1a0 [55678.839150] [] ? lg_double_unlock+0x40/0x40 [55678.845704] [] kthread+0xd1/0xe0 [55678.851179] [] ? insert_kthread_work+0x40/0x40 [55678.858006] [] ret_from_fork_nospec_begin+0x21/0x21 [55678.865324] [] ? insert_kthread_work+0x40/0x40 [55678.872156] kworker/29:0H S ffff994df991e2a0 0 158 2 0x00000000 [55678.880111] Call Trace: [55678.882863] [] ? process_one_work+0x21a/0x440 [55678.889613] [] schedule+0x29/0x70 [55678.895164] [] worker_thread+0x1d9/0x3c0 [55678.901424] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55678.908748] [] kthread+0xd1/0xe0 [55678.914241] [] ? insert_kthread_work+0x40/0x40 [55678.921052] [] ret_from_fork_nospec_begin+0x21/0x21 [55678.928379] [] ? insert_kthread_work+0x40/0x40 [55678.935225] watchdog/30 S ffff994df9980000 0 159 2 0x00000000 [55678.943187] Call Trace: [55678.945943] [] ? local_clock+0x25/0x30 [55678.951999] [] ? running_clock+0x9/0x10 [55678.958138] [] ? sched_clock+0x9/0x10 [55678.964076] [] schedule+0x29/0x70 [55678.969646] [] smpboot_thread_fn+0xe2/0x1a0 [55678.976166] [] ? lg_double_unlock+0x40/0x40 [55678.982729] [] kthread+0xd1/0xe0 [55678.988190] [] ? insert_kthread_work+0x40/0x40 [55678.995041] [] ret_from_fork_nospec_begin+0x21/0x21 [55679.002339] [] ? insert_kthread_work+0x40/0x40 [55679.009149] migration/30 S ffff994df9981070 0 160 2 0x00000000 [55679.017074] Call Trace: [55679.019840] [] schedule+0x29/0x70 [55679.025389] [] smpboot_thread_fn+0xe2/0x1a0 [55679.031947] [] ? lg_double_unlock+0x40/0x40 [55679.038482] [] kthread+0xd1/0xe0 [55679.043970] [] ? insert_kthread_work+0x40/0x40 [55679.050814] [] ret_from_fork_nospec_begin+0x21/0x21 [55679.058139] [] ? insert_kthread_work+0x40/0x40 [55679.064986] ksoftirqd/30 S ffff994df99820e0 0 161 2 0x00000000 [55679.072959] Call Trace: [55679.075719] [] schedule+0x29/0x70 [55679.081278] [] smpboot_thread_fn+0xe2/0x1a0 [55679.087820] [] ? lg_double_unlock+0x40/0x40 [55679.094375] [] kthread+0xd1/0xe0 [55679.099862] [] ? insert_kthread_work+0x40/0x40 [55679.106701] [] ret_from_fork_nospec_begin+0x21/0x21 [55679.114008] [] ? insert_kthread_work+0x40/0x40 [55679.120845] kworker/30:0H S ffff994df99841c0 0 163 2 0x00000000 [55679.128798] Call Trace: [55679.131559] [] ? process_one_work+0x21a/0x440 [55679.138274] [] schedule+0x29/0x70 [55679.143845] [] worker_thread+0x1d9/0x3c0 [55679.150075] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55679.157396] [] kthread+0xd1/0xe0 [55679.162887] [] ? insert_kthread_work+0x40/0x40 [55679.169721] [] ret_from_fork_nospec_begin+0x21/0x21 [55679.177016] [] ? insert_kthread_work+0x40/0x40 [55679.183839] watchdog/31 S ffff994df9985230 0 164 2 0x00000000 [55679.191812] Call Trace: [55679.194564] [] ? local_clock+0x25/0x30 [55679.200618] [] ? running_clock+0x9/0x10 [55679.206771] [] ? sched_clock+0x9/0x10 [55679.212729] [] schedule+0x29/0x70 [55679.218280] [] smpboot_thread_fn+0xe2/0x1a0 [55679.224819] [] ? lg_double_unlock+0x40/0x40 [55679.231368] [] kthread+0xd1/0xe0 [55679.236841] [] ? insert_kthread_work+0x40/0x40 [55679.243673] [] ret_from_fork_nospec_begin+0x21/0x21 [55679.250982] [] ? insert_kthread_work+0x40/0x40 [55679.257811] migration/31 S ffff994df99862a0 0 165 2 0x00000000 [55679.265791] Call Trace: [55679.268555] [] schedule+0x29/0x70 [55679.274142] [] smpboot_thread_fn+0xe2/0x1a0 [55679.280705] [] ? lg_double_unlock+0x40/0x40 [55679.287224] [] kthread+0xd1/0xe0 [55679.292715] [] ? insert_kthread_work+0x40/0x40 [55679.299548] [] ret_from_fork_nospec_begin+0x21/0x21 [55679.306882] [] ? insert_kthread_work+0x40/0x40 [55679.313740] ksoftirqd/31 S ffff994df99e8000 0 166 2 0x00000000 [55679.321711] Call Trace: [55679.324478] [] schedule+0x29/0x70 [55679.330031] [] smpboot_thread_fn+0xe2/0x1a0 [55679.336586] [] ? lg_double_unlock+0x40/0x40 [55679.343134] [] kthread+0xd1/0xe0 [55679.348617] [] ? insert_kthread_work+0x40/0x40 [55679.355464] [] ret_from_fork_nospec_begin+0x21/0x21 [55679.362772] [] ? insert_kthread_work+0x40/0x40 [55679.369604] kworker/31:0 S ffff994df99e9070 0 167 2 0x00000000 [55679.377564] Call Trace: [55679.380309] [] ? process_one_work+0x21a/0x440 [55679.387029] [] schedule+0x29/0x70 [55679.392600] [] worker_thread+0x1d9/0x3c0 [55679.398850] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55679.406175] [] kthread+0xd1/0xe0 [55679.411669] [] ? insert_kthread_work+0x40/0x40 [55679.418509] [] ret_from_fork_nospec_begin+0x21/0x21 [55679.425826] [] ? insert_kthread_work+0x40/0x40 [55679.432678] kworker/31:0H S ffff994df99ea0e0 0 168 2 0x00000000 [55679.440622] Call Trace: [55679.443380] [] ? process_one_work+0x21a/0x440 [55679.450094] [] schedule+0x29/0x70 [55679.455664] [] worker_thread+0x1d9/0x3c0 [55679.461910] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55679.469242] [] kthread+0xd1/0xe0 [55679.474722] [] ? insert_kthread_work+0x40/0x40 [55679.481559] [] ret_from_fork_nospec_begin+0x21/0x21 [55679.488870] [] ? insert_kthread_work+0x40/0x40 [55679.495720] kdevtmpfs S ffff994ab97d41c0 0 171 2 0x00000000 [55679.503685] Call Trace: [55679.506438] [] schedule+0x29/0x70 [55679.512007] [] devtmpfsd+0x16d/0x180 [55679.517910] [] ? handle_create.isra.2+0x220/0x220 [55679.525011] [] kthread+0xd1/0xe0 [55679.530487] [] ? insert_kthread_work+0x40/0x40 [55679.537327] [] ret_from_fork_nospec_begin+0x21/0x21 [55679.544657] [] ? insert_kthread_work+0x40/0x40 [55679.551478] netns S ffff99516e45ac80 0 172 2 0x00000000 [55679.559427] Call Trace: [55679.562195] [] schedule+0x29/0x70 [55679.567788] [] rescuer_thread+0x31e/0x3c0 [55679.574146] [] ? process_one_work+0x440/0x440 [55679.580901] [] kthread+0xd1/0xe0 [55679.586388] [] ? insert_kthread_work+0x40/0x40 [55679.593199] [] ret_from_fork_nospec_begin+0x21/0x21 [55679.600516] [] ? insert_kthread_work+0x40/0x40 [55679.607361] khungtaskd S ffff994ab97d20e0 0 173 2 0x00000000 [55679.615336] Call Trace: [55679.618087] [] schedule+0x29/0x70 [55679.623659] [] schedule_timeout+0x168/0x2d0 [55679.630181] [] ? __internal_add_timer+0x130/0x130 [55679.637306] [] schedule_timeout_interruptible+0x1e/0x20 [55679.644991] [] watchdog+0x4c/0x2c0 [55679.650658] [] ? reset_hung_task_detector+0x20/0x20 [55679.657998] [] kthread+0xd1/0xe0 [55679.663478] [] ? insert_kthread_work+0x40/0x40 [55679.670317] [] ret_from_fork_nospec_begin+0x21/0x21 [55679.677634] [] ? insert_kthread_work+0x40/0x40 [55679.684472] writeback S ffff99516e45ac80 0 174 2 0x00000000 [55679.692426] Call Trace: [55679.695165] [] schedule+0x29/0x70 [55679.700737] [] rescuer_thread+0x31e/0x3c0 [55679.707066] [] ? process_one_work+0x440/0x440 [55679.713779] [] kthread+0xd1/0xe0 [55679.719240] [] ? insert_kthread_work+0x40/0x40 [55679.726050] [] ret_from_fork_nospec_begin+0x21/0x21 [55679.733380] [] ? insert_kthread_work+0x40/0x40 [55679.740203] kintegrityd S ffff99516e45ac80 0 175 2 0x00000000 [55679.748173] Call Trace: [55679.750950] [] schedule+0x29/0x70 [55679.756534] [] rescuer_thread+0x31e/0x3c0 [55679.762899] [] ? process_one_work+0x440/0x440 [55679.769649] [] kthread+0xd1/0xe0 [55679.775131] [] ? insert_kthread_work+0x40/0x40 [55679.781954] [] ret_from_fork_nospec_begin+0x21/0x21 [55679.789292] [] ? insert_kthread_work+0x40/0x40 [55679.796132] bioset S ffff99516e45ac80 0 176 2 0x00000000 [55679.804097] Call Trace: [55679.806849] [] schedule+0x29/0x70 [55679.812427] [] rescuer_thread+0x31e/0x3c0 [55679.818774] [] ? process_one_work+0x440/0x440 [55679.825519] [] kthread+0xd1/0xe0 [55679.830980] [] ? insert_kthread_work+0x40/0x40 [55679.837818] [] ret_from_fork_nospec_begin+0x21/0x21 [55679.845120] [] ? insert_kthread_work+0x40/0x40 [55679.851949] bioset S ffff99516e45ac80 0 177 2 0x00000000 [55679.859918] Call Trace: [55679.862682] [] schedule+0x29/0x70 [55679.868261] [] rescuer_thread+0x31e/0x3c0 [55679.874622] [] ? process_one_work+0x440/0x440 [55679.881347] [] kthread+0xd1/0xe0 [55679.886831] [] ? insert_kthread_work+0x40/0x40 [55679.893663] [] ret_from_fork_nospec_begin+0x21/0x21 [55679.900994] [] ? insert_kthread_work+0x40/0x40 [55679.907841] bioset S ffff99516e45ac80 0 178 2 0x00000000 [55679.915805] Call Trace: [55679.918571] [] schedule+0x29/0x70 [55679.924131] [] rescuer_thread+0x31e/0x3c0 [55679.930493] [] ? process_one_work+0x440/0x440 [55679.937225] [] kthread+0xd1/0xe0 [55679.942700] [] ? insert_kthread_work+0x40/0x40 [55679.949552] [] ret_from_fork_nospec_begin+0x21/0x21 [55679.956864] [] ? insert_kthread_work+0x40/0x40 [55679.963710] kblockd S ffff99516e45ac80 0 179 2 0x00000000 [55679.971685] Call Trace: [55679.974443] [] schedule+0x29/0x70 [55679.980002] [] rescuer_thread+0x31e/0x3c0 [55679.986349] [] ? process_one_work+0x440/0x440 [55679.993061] [] kthread+0xd1/0xe0 [55679.998536] [] ? insert_kthread_work+0x40/0x40 [55680.005375] [] ret_from_fork_nospec_begin+0x21/0x21 [55680.012697] [] ? insert_kthread_work+0x40/0x40 [55680.019519] md S ffff99516e45ac80 0 181 2 0x00000000 [55680.027502] Call Trace: [55680.030276] [] schedule+0x29/0x70 [55680.035883] [] rescuer_thread+0x31e/0x3c0 [55680.042244] [] ? process_one_work+0x440/0x440 [55680.048955] [] kthread+0xd1/0xe0 [55680.054451] [] ? insert_kthread_work+0x40/0x40 [55680.061264] [] ret_from_fork_nospec_begin+0x21/0x21 [55680.068596] [] ? insert_kthread_work+0x40/0x40 [55680.075440] edac-poller S ffff99516e45ac80 0 182 2 0x00000000 [55680.083444] Call Trace: [55680.086194] [] schedule+0x29/0x70 [55680.091764] [] rescuer_thread+0x31e/0x3c0 [55680.098096] [] ? process_one_work+0x440/0x440 [55680.104856] [] kthread+0xd1/0xe0 [55680.110340] [] ? insert_kthread_work+0x40/0x40 [55680.117180] [] ret_from_fork_nospec_begin+0x21/0x21 [55680.124496] [] ? insert_kthread_work+0x40/0x40 [55680.131334] watchdogd S ffff99516e45ac80 0 183 2 0x00000000 [55680.139268] Call Trace: [55680.142011] [] schedule+0x29/0x70 [55680.147597] [] rescuer_thread+0x31e/0x3c0 [55680.153947] [] ? process_one_work+0x440/0x440 [55680.160680] [] kthread+0xd1/0xe0 [55680.166142] [] ? insert_kthread_work+0x40/0x40 [55680.172953] [] ret_from_fork_nospec_begin+0x21/0x21 [55680.180270] [] ? insert_kthread_work+0x40/0x40 [55680.187077] kworker/3:1 S ffff994d6fdeb150 0 184 2 0x00000000 [55680.195020] Call Trace: [55680.197790] [] ? process_one_work+0x21a/0x440 [55680.204531] [] schedule+0x29/0x70 [55680.210117] [] worker_thread+0x1d9/0x3c0 [55680.216369] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55680.223684] [] kthread+0xd1/0xe0 [55680.229144] [] ? insert_kthread_work+0x40/0x40 [55680.235955] [] ret_from_fork_nospec_begin+0x21/0x21 [55680.243286] [] ? insert_kthread_work+0x40/0x40 [55680.250103] kworker/1:1 S ffff994d6fded230 0 186 2 0x00000000 [55680.258056] Call Trace: [55680.260817] [] ? process_one_work+0x21a/0x440 [55680.267580] [] schedule+0x29/0x70 [55680.273167] [] worker_thread+0x1d9/0x3c0 [55680.279433] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55680.286749] [] kthread+0xd1/0xe0 [55680.292209] [] ? insert_kthread_work+0x40/0x40 [55680.299028] [] ret_from_fork_nospec_begin+0x21/0x21 [55680.306360] [] ? insert_kthread_work+0x40/0x40 [55680.313170] kworker/17:1 S ffff994d6fdee2a0 0 187 2 0x00000000 [55680.321135] Call Trace: [55680.323916] [] ? process_one_work+0x21a/0x440 [55680.330675] [] schedule+0x29/0x70 [55680.336263] [] worker_thread+0x1d9/0x3c0 [55680.342528] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55680.349842] [] kthread+0xd1/0xe0 [55680.355316] [] ? insert_kthread_work+0x40/0x40 [55680.362128] [] ret_from_fork_nospec_begin+0x21/0x21 [55680.369467] [] ? insert_kthread_work+0x40/0x40 [55680.376283] kswapd0 S ffff994d6ea1ac80 0 192 2 0x00000000 [55680.384249] Call Trace: [55680.387006] [] ? calculate_normal_threshold+0x27/0x50 [55680.394514] [] schedule+0x29/0x70 [55680.400074] [] kswapd+0x38f/0x440 [55680.405660] [] ? wake_up_atomic_t+0x30/0x30 [55680.412172] [] ? balance_pgdat+0x5e0/0x5e0 [55680.418607] [] kthread+0xd1/0xe0 [55680.424069] [] ? insert_kthread_work+0x40/0x40 [55680.430877] [] ret_from_fork_nospec_begin+0x21/0x21 [55680.438206] [] ? insert_kthread_work+0x40/0x40 [55680.445023] kswapd1 S ffff99516e45ac80 0 193 2 0x00000000 [55680.452986] Call Trace: [55680.455753] [] ? calculate_normal_threshold+0x27/0x50 [55680.463243] [] schedule+0x29/0x70 [55680.468817] [] kswapd+0x38f/0x440 [55680.474395] [] ? wake_up_atomic_t+0x30/0x30 [55680.480930] [] ? balance_pgdat+0x5e0/0x5e0 [55680.487372] [] kthread+0xd1/0xe0 [55680.492867] [] ? insert_kthread_work+0x40/0x40 [55680.499696] [] ret_from_fork_nospec_begin+0x21/0x21 [55680.507022] [] ? insert_kthread_work+0x40/0x40 [55680.513871] ksmd S ffff99516e45ac80 0 194 2 0x00000000 [55680.521834] Call Trace: [55680.524609] [] schedule+0x29/0x70 [55680.530166] [] ksm_scan_thread+0x16a/0x240 [55680.536626] [] ? wake_up_atomic_t+0x30/0x30 [55680.543167] [] ? ksm_do_scan+0x11c0/0x11c0 [55680.549633] [] kthread+0xd1/0xe0 [55680.555096] [] ? insert_kthread_work+0x40/0x40 [55680.561919] [] ret_from_fork_nospec_begin+0x21/0x21 [55680.569235] [] ? insert_kthread_work+0x40/0x40 [55680.576074] khugepaged S ffff994d6cd7b150 0 195 2 0x00000000 [55680.584007] Call Trace: [55680.586757] [] schedule+0x29/0x70 [55680.592327] [] schedule_timeout+0x168/0x2d0 [55680.598858] [] ? __internal_add_timer+0x130/0x130 [55680.605986] [] khugepaged+0x226/0x490 [55680.611950] [] ? wake_up_atomic_t+0x30/0x30 [55680.618511] [] ? khugepaged_scan_mm_slot+0xfb0/0xfb0 [55680.625912] [] kthread+0xd1/0xe0 [55680.631387] [] ? insert_kthread_work+0x40/0x40 [55680.638226] [] ret_from_fork_nospec_begin+0x21/0x21 [55680.645558] [] ? insert_kthread_work+0x40/0x40 [55680.652387] crypto S ffff99516e45ac80 0 196 2 0x00000000 [55680.660357] Call Trace: [55680.663125] [] schedule+0x29/0x70 [55680.668704] [] rescuer_thread+0x31e/0x3c0 [55680.675053] [] ? process_one_work+0x440/0x440 [55680.681830] [] kthread+0xd1/0xe0 [55680.687312] [] ? insert_kthread_work+0x40/0x40 [55680.694129] [] ret_from_fork_nospec_begin+0x21/0x21 [55680.701426] [] ? insert_kthread_work+0x40/0x40 [55680.708264] kthrotld S ffff99516e45ac80 0 204 2 0x00000000 [55680.716220] Call Trace: [55680.718967] [] schedule+0x29/0x70 [55680.724539] [] rescuer_thread+0x31e/0x3c0 [55680.730886] [] ? process_one_work+0x440/0x440 [55680.737643] [] kthread+0xd1/0xe0 [55680.743109] [] ? insert_kthread_work+0x40/0x40 [55680.749955] [] ret_from_fork_nospec_begin+0x21/0x21 [55680.757252] [] ? insert_kthread_work+0x40/0x40 [55680.764064] kworker/8:1 S ffff99516cff0000 0 205 2 0x00000000 [55680.771981] Call Trace: [55680.774743] [] ? process_one_work+0x21a/0x440 [55680.781477] [] schedule+0x29/0x70 [55680.787035] [] worker_thread+0x1d9/0x3c0 [55680.793284] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55680.800615] [] kthread+0xd1/0xe0 [55680.806062] [] ? insert_kthread_work+0x40/0x40 [55680.812922] [] ret_from_fork_nospec_begin+0x21/0x21 [55680.820216] [] ? insert_kthread_work+0x40/0x40 [55680.827032] kmpath_rdacd S ffff99516e45ac80 0 209 2 0x00000000 [55680.834952] Call Trace: [55680.837711] [] schedule+0x29/0x70 [55680.843299] [] rescuer_thread+0x31e/0x3c0 [55680.849668] [] ? process_one_work+0x440/0x440 [55680.856404] [] kthread+0xd1/0xe0 [55680.861880] [] ? insert_kthread_work+0x40/0x40 [55680.868710] [] ret_from_fork_nospec_begin+0x21/0x21 [55680.876037] [] ? insert_kthread_work+0x40/0x40 [55680.882877] kaluad S ffff99516e45ac80 0 210 2 0x00000000 [55680.890874] Call Trace: [55680.893654] [] schedule+0x29/0x70 [55680.899233] [] rescuer_thread+0x31e/0x3c0 [55680.905588] [] ? process_one_work+0x440/0x440 [55680.912331] [] kthread+0xd1/0xe0 [55680.917826] [] ? insert_kthread_work+0x40/0x40 [55680.924664] [] ret_from_fork_nospec_begin+0x21/0x21 [55680.931962] [] ? insert_kthread_work+0x40/0x40 [55680.938819] kworker/15:1 S ffff99516cff1070 0 213 2 0x00000000 [55680.946767] Call Trace: [55680.949518] [] ? process_one_work+0x21a/0x440 [55680.956261] [] schedule+0x29/0x70 [55680.961814] [] worker_thread+0x1d9/0x3c0 [55680.968051] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55680.975388] [] kthread+0xd1/0xe0 [55680.980869] [] ? insert_kthread_work+0x40/0x40 [55680.987719] [] ret_from_fork_nospec_begin+0x21/0x21 [55680.995018] [] ? insert_kthread_work+0x40/0x40 [55681.001877] kpsmoused S ffff99516e45ac80 0 214 2 0x00000000 [55681.009850] Call Trace: [55681.012602] [] schedule+0x29/0x70 [55681.018161] [] rescuer_thread+0x31e/0x3c0 [55681.024508] [] ? process_one_work+0x440/0x440 [55681.031249] [] kthread+0xd1/0xe0 [55681.036723] [] ? insert_kthread_work+0x40/0x40 [55681.043564] [] ret_from_fork_nospec_begin+0x21/0x21 [55681.050879] [] ? insert_kthread_work+0x40/0x40 [55681.057714] kworker/10:1 R running task 0 215 2 0x00000000 [55681.065682] Call Trace: [55681.068442] [] ? process_one_work+0x21a/0x440 [55681.075153] [] schedule+0x29/0x70 [55681.080749] [] worker_thread+0x1d9/0x3c0 [55681.086994] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55681.094326] [] kthread+0xd1/0xe0 [55681.099812] [] ? insert_kthread_work+0x40/0x40 [55681.106656] [] ret_from_fork_nospec_begin+0x21/0x21 [55681.113959] [] ? insert_kthread_work+0x40/0x40 [55681.120770] ipv6_addrconf S ffff99516e45ac80 0 216 2 0x00000000 [55681.128746] Call Trace: [55681.131518] [] schedule+0x29/0x70 [55681.137101] [] rescuer_thread+0x31e/0x3c0 [55681.143457] [] ? process_one_work+0x440/0x440 [55681.150178] [] kthread+0xd1/0xe0 [55681.155674] [] ? insert_kthread_work+0x40/0x40 [55681.162504] [] ret_from_fork_nospec_begin+0x21/0x21 [55681.169831] [] ? insert_kthread_work+0x40/0x40 [55681.176695] kworker/11:1 S ffff99516e2dac80 0 217 2 0x00000000 [55681.184690] Call Trace: [55681.187443] [] ? process_one_work+0x21a/0x440 [55681.194193] [] schedule+0x29/0x70 [55681.199800] [] worker_thread+0x1d9/0x3c0 [55681.206058] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55681.213382] [] kthread+0xd1/0xe0 [55681.218848] [] ? insert_kthread_work+0x40/0x40 [55681.225695] [] ret_from_fork_nospec_begin+0x21/0x21 [55681.232990] [] ? insert_kthread_work+0x40/0x40 [55681.239821] deferwq S ffff99516e45ac80 0 230 2 0x00000000 [55681.247778] Call Trace: [55681.250536] [] schedule+0x29/0x70 [55681.256128] [] rescuer_thread+0x31e/0x3c0 [55681.262489] [] ? process_one_work+0x440/0x440 [55681.269206] [] kthread+0xd1/0xe0 [55681.274688] [] ? insert_kthread_work+0x40/0x40 [55681.281519] [] ret_from_fork_nospec_begin+0x21/0x21 [55681.288856] [] ? insert_kthread_work+0x40/0x40 [55681.295700] kworker/4:1 S ffff994d6c5b8000 0 234 2 0x00000000 [55681.303670] Call Trace: [55681.306438] [] ? process_one_work+0x21a/0x440 [55681.313196] [] schedule+0x29/0x70 [55681.318753] [] worker_thread+0x1d9/0x3c0 [55681.325027] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55681.332343] [] kthread+0xd1/0xe0 [55681.337840] [] ? insert_kthread_work+0x40/0x40 [55681.344662] [] ret_from_fork_nospec_begin+0x21/0x21 [55681.351981] [] ? insert_kthread_work+0x40/0x40 [55681.358820] kworker/6:1 S ffff994d6c5b9070 0 235 2 0x00000000 [55681.366816] Call Trace: [55681.369598] [] ? process_one_work+0x21a/0x440 [55681.376347] [] schedule+0x29/0x70 [55681.381926] [] worker_thread+0x1d9/0x3c0 [55681.388176] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55681.395491] [] kthread+0xd1/0xe0 [55681.400960] [] ? insert_kthread_work+0x40/0x40 [55681.407781] [] ret_from_fork_nospec_begin+0x21/0x21 [55681.415105] [] ? insert_kthread_work+0x40/0x40 [55681.421914] kworker/9:1 S ffff99516cb28000 0 237 2 0x00000000 [55681.429876] Call Trace: [55681.432648] [] ? process_one_work+0x21a/0x440 [55681.439398] [] schedule+0x29/0x70 [55681.444980] [] worker_thread+0x1d9/0x3c0 [55681.451240] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55681.458556] [] kthread+0xd1/0xe0 [55681.464016] [] ? insert_kthread_work+0x40/0x40 [55681.470848] [] ret_from_fork_nospec_begin+0x21/0x21 [55681.478164] [] ? insert_kthread_work+0x40/0x40 [55681.484982] kworker/13:1 S ffff99516cb29070 0 238 2 0x00000000 [55681.492935] Call Trace: [55681.495715] [] ? process_one_work+0x21a/0x440 [55681.502465] [] schedule+0x29/0x70 [55681.508039] [] worker_thread+0x1d9/0x3c0 [55681.514305] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55681.521620] [] kthread+0xd1/0xe0 [55681.527082] [] ? insert_kthread_work+0x40/0x40 [55681.533904] [] ret_from_fork_nospec_begin+0x21/0x21 [55681.541229] [] ? insert_kthread_work+0x40/0x40 [55681.548038] kworker/14:1 S ffff99516cb2a0e0 0 239 2 0x00000000 [55681.555981] Call Trace: [55681.558763] [] ? process_one_work+0x21a/0x440 [55681.565498] [] schedule+0x29/0x70 [55681.571087] [] worker_thread+0x1d9/0x3c0 [55681.577354] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55681.584671] [] kthread+0xd1/0xe0 [55681.590138] [] ? insert_kthread_work+0x40/0x40 [55681.596957] [] ret_from_fork_nospec_begin+0x21/0x21 [55681.604267] [] ? insert_kthread_work+0x40/0x40 [55681.611076] kworker/16:1 S ffff994d6c5be2a0 0 240 2 0x00000000 [55681.619038] Call Trace: [55681.621821] [] ? process_one_work+0x21a/0x440 [55681.628570] [] schedule+0x29/0x70 [55681.634157] [] worker_thread+0x1d9/0x3c0 [55681.640425] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55681.647729] [] kthread+0xd1/0xe0 [55681.653189] [] ? insert_kthread_work+0x40/0x40 [55681.660002] [] ret_from_fork_nospec_begin+0x21/0x21 [55681.667335] [] ? insert_kthread_work+0x40/0x40 [55681.674154] kworker/18:1 S ffff994d6c5bd230 0 241 2 0x00000000 [55681.682125] Call Trace: [55681.684879] [] ? process_one_work+0x21a/0x440 [55681.691614] [] schedule+0x29/0x70 [55681.697175] [] worker_thread+0x1d9/0x3c0 [55681.703426] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55681.710729] [] kthread+0xd1/0xe0 [55681.716216] [] ? insert_kthread_work+0x40/0x40 [55681.723035] [] ret_from_fork_nospec_begin+0x21/0x21 [55681.730351] [] ? insert_kthread_work+0x40/0x40 [55681.737169] kworker/20:1 S ffff994d6c5bc1c0 0 242 2 0x00000000 [55681.745104] Call Trace: [55681.747851] [] ? process_one_work+0x21a/0x440 [55681.754585] [] schedule+0x29/0x70 [55681.760134] [] worker_thread+0x1d9/0x3c0 [55681.766375] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55681.773685] [] kthread+0xd1/0xe0 [55681.779175] [] ? insert_kthread_work+0x40/0x40 [55681.785994] [] ret_from_fork_nospec_begin+0x21/0x21 [55681.793318] [] ? insert_kthread_work+0x40/0x40 [55681.800129] kworker/23:1 S ffff994d6c5d8000 0 244 2 0x00000000 [55681.808084] Call Trace: [55681.810854] [] ? process_one_work+0x21a/0x440 [55681.817603] [] schedule+0x29/0x70 [55681.823181] [] worker_thread+0x1d9/0x3c0 [55681.829446] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55681.836777] [] kthread+0xd1/0xe0 [55681.842242] [] ? insert_kthread_work+0x40/0x40 [55681.849059] [] ret_from_fork_nospec_begin+0x21/0x21 [55681.856390] [] ? insert_kthread_work+0x40/0x40 [55681.863211] kworker/21:1 S ffff994d6c5d9070 0 245 2 0x00000000 [55681.871169] Call Trace: [55681.873938] [] ? process_one_work+0x21a/0x440 [55681.880680] [] schedule+0x29/0x70 [55681.886254] [] worker_thread+0x1d9/0x3c0 [55681.892513] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55681.899814] [] kthread+0xd1/0xe0 [55681.905288] [] ? insert_kthread_work+0x40/0x40 [55681.912122] [] ret_from_fork_nospec_begin+0x21/0x21 [55681.919439] [] ? insert_kthread_work+0x40/0x40 [55681.926268] kworker/24:1 S ffff99516cb2e2a0 0 246 2 0x00000000 [55681.934242] Call Trace: [55681.937009] [] ? process_one_work+0x21a/0x440 [55681.943771] [] schedule+0x29/0x70 [55681.949344] [] worker_thread+0x1d9/0x3c0 [55681.955619] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55681.962915] [] kthread+0xd1/0xe0 [55681.968382] [] ? insert_kthread_work+0x40/0x40 [55681.975230] [] ret_from_fork_nospec_begin+0x21/0x21 [55681.982554] [] ? insert_kthread_work+0x40/0x40 [55681.989383] kworker/25:1 S ffff99516cb2d230 0 247 2 0x00000000 [55681.997335] Call Trace: [55682.000087] [] ? process_one_work+0x21a/0x440 [55682.006819] [] schedule+0x29/0x70 [55682.012384] [] worker_thread+0x1d9/0x3c0 [55682.018636] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55682.025938] [] kthread+0xd1/0xe0 [55682.031414] [] ? insert_kthread_work+0x40/0x40 [55682.038260] [] ret_from_fork_nospec_begin+0x21/0x21 [55682.045593] [] ? insert_kthread_work+0x40/0x40 [55682.052422] kworker/29:1 S ffff99516cb2c1c0 0 248 2 0x00000000 [55682.060378] Call Trace: [55682.063144] [] ? process_one_work+0x21a/0x440 [55682.069866] [] schedule+0x29/0x70 [55682.075439] [] worker_thread+0x1d9/0x3c0 [55682.081699] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55682.089026] [] kthread+0xd1/0xe0 [55682.094499] [] ? insert_kthread_work+0x40/0x40 [55682.101338] [] ret_from_fork_nospec_begin+0x21/0x21 [55682.108656] [] ? insert_kthread_work+0x40/0x40 [55682.115485] kworker/30:1 S ffff99516cb2b150 0 249 2 0x00000000 [55682.123456] Call Trace: [55682.126223] [] ? process_one_work+0x21a/0x440 [55682.132934] [] schedule+0x29/0x70 [55682.138508] [] worker_thread+0x1d9/0x3c0 [55682.144760] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55682.152062] [] kthread+0xd1/0xe0 [55682.157541] [] ? insert_kthread_work+0x40/0x40 [55682.164380] [] ret_from_fork_nospec_begin+0x21/0x21 [55682.171699] [] ? insert_kthread_work+0x40/0x40 [55682.178555] kworker/26:1 S ffff99516cb50000 0 250 2 0x00000000 [55682.186548] Call Trace: [55682.189324] [] ? pm_runtime_work+0xaf/0xc0 [55682.195761] [] ? process_one_work+0x21a/0x440 [55682.202506] [] schedule+0x29/0x70 [55682.208066] [] worker_thread+0x1d9/0x3c0 [55682.214316] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55682.221633] [] kthread+0xd1/0xe0 [55682.227102] [] ? insert_kthread_work+0x40/0x40 [55682.233948] [] ret_from_fork_nospec_begin+0x21/0x21 [55682.241263] [] ? insert_kthread_work+0x40/0x40 [55682.248094] kworker/27:1 S ffff99516cb51070 0 251 2 0x00000000 [55682.256041] Call Trace: [55682.258804] [] ? process_one_work+0x21a/0x440 [55682.265539] [] schedule+0x29/0x70 [55682.271096] [] worker_thread+0x1d9/0x3c0 [55682.277345] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55682.284670] [] kthread+0xd1/0xe0 [55682.290124] [] ? insert_kthread_work+0x40/0x40 [55682.296956] [] ret_from_fork_nospec_begin+0x21/0x21 [55682.304266] [] ? insert_kthread_work+0x40/0x40 [55682.311105] kworker/28:1 S ffff99516cb520e0 0 252 2 0x00000000 [55682.319047] Call Trace: [55682.321788] [] ? process_one_work+0x21a/0x440 [55682.328527] [] schedule+0x29/0x70 [55682.334085] [] worker_thread+0x1d9/0x3c0 [55682.340336] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55682.347668] [] kthread+0xd1/0xe0 [55682.353150] [] ? insert_kthread_work+0x40/0x40 [55682.359989] [] ret_from_fork_nospec_begin+0x21/0x21 [55682.367307] [] ? insert_kthread_work+0x40/0x40 [55682.374145] kworker/31:1 S ffff99516cb53150 0 253 2 0x00000000 [55682.382095] Call Trace: [55682.384834] [] ? process_one_work+0x21a/0x440 [55682.391568] [] schedule+0x29/0x70 [55682.397132] [] worker_thread+0x1d9/0x3c0 [55682.403382] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55682.410720] [] kthread+0xd1/0xe0 [55682.416202] [] ? insert_kthread_work+0x40/0x40 [55682.423050] [] ret_from_fork_nospec_begin+0x21/0x21 [55682.430367] [] ? insert_kthread_work+0x40/0x40 [55682.437205] kworker/5:1 S ffff994d6c5de2a0 0 254 2 0x00000000 [55682.445152] Call Trace: [55682.447900] [] ? process_one_work+0x21a/0x440 [55682.454651] [] schedule+0x29/0x70 [55682.460222] [] worker_thread+0x1d9/0x3c0 [55682.466472] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55682.473814] [] kthread+0xd1/0xe0 [55682.479297] [] ? insert_kthread_work+0x40/0x40 [55682.486144] [] ret_from_fork_nospec_begin+0x21/0x21 [55682.493462] [] ? insert_kthread_work+0x40/0x40 [55682.500300] kworker/12:1 S ffff994df99ee2a0 0 255 2 0x00000000 [55682.508238] Call Trace: [55682.510978] [] ? process_one_work+0x21a/0x440 [55682.517707] [] schedule+0x29/0x70 [55682.523287] [] worker_thread+0x1d9/0x3c0 [55682.529538] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55682.536861] [] kthread+0xd1/0xe0 [55682.542350] [] ? insert_kthread_work+0x40/0x40 [55682.549172] [] ret_from_fork_nospec_begin+0x21/0x21 [55682.556489] [] ? insert_kthread_work+0x40/0x40 [55682.563334] kauditd S ffff994ab97d1070 0 332 2 0x00000000 [55682.571285] Call Trace: [55682.574026] [] ? task_rq_unlock+0x20/0x20 [55682.580370] [] schedule+0x29/0x70 [55682.585927] [] kauditd_thread+0x184/0x1e0 [55682.592275] [] ? wake_up_state+0x20/0x20 [55682.598524] [] ? audit_printk_skb+0x70/0x70 [55682.605053] [] kthread+0xd1/0xe0 [55682.610525] [] ? insert_kthread_work+0x40/0x40 [55682.617349] [] ret_from_fork_nospec_begin+0x21/0x21 [55682.624670] [] ? insert_kthread_work+0x40/0x40 [55682.631517] ata_sff S ffff994d6c718640 0 982 2 0x00000000 [55682.639474] Call Trace: [55682.642221] [] schedule+0x29/0x70 [55682.647807] [] rescuer_thread+0x31e/0x3c0 [55682.654170] [] ? process_one_work+0x440/0x440 [55682.660883] [] kthread+0xd1/0xe0 [55682.666371] [] ? insert_kthread_work+0x40/0x40 [55682.673195] [] ret_from_fork_nospec_begin+0x21/0x21 [55682.680535] [] ? insert_kthread_work+0x40/0x40 [55682.687378] scsi_eh_0 S ffff99516e45ac80 0 1006 2 0x00000000 [55682.695353] Call Trace: [55682.698113] [] schedule+0x29/0x70 [55682.703696] [] scsi_error_handler+0xa3/0x8b0 [55682.710342] [] ? scsi_eh_get_sense+0x250/0x250 [55682.717180] [] kthread+0xd1/0xe0 [55682.722684] [] ? insert_kthread_work+0x40/0x40 [55682.729531] [] ret_from_fork_nospec_begin+0x21/0x21 [55682.736836] [] ? insert_kthread_work+0x40/0x40 [55682.743690] scsi_tmf_0 S ffff99516e45ac80 0 1007 2 0x00000000 [55682.751648] Call Trace: [55682.754399] [] schedule+0x29/0x70 [55682.759959] [] rescuer_thread+0x31e/0x3c0 [55682.766298] [] ? process_one_work+0x440/0x440 [55682.773011] [] kthread+0xd1/0xe0 [55682.778484] [] ? insert_kthread_work+0x40/0x40 [55682.785330] [] ret_from_fork_nospec_begin+0x21/0x21 [55682.792647] [] ? insert_kthread_work+0x40/0x40 [55682.799476] mlx4 S ffff99516e49ac80 0 1012 2 0x00000000 [55682.807427] Call Trace: [55682.810192] [] schedule+0x29/0x70 [55682.815788] [] rescuer_thread+0x31e/0x3c0 [55682.822150] [] ? process_one_work+0x440/0x440 [55682.828863] [] kthread+0xd1/0xe0 [55682.834357] [] ? insert_kthread_work+0x40/0x40 [55682.841187] [] ret_from_fork_nospec_begin+0x21/0x21 [55682.848526] [] ? insert_kthread_work+0x40/0x40 [55682.855354] mlx4_health S ffff99516e45ac80 0 1014 2 0x00000000 [55682.863344] Call Trace: [55682.866109] [] schedule+0x29/0x70 [55682.871686] [] rescuer_thread+0x31e/0x3c0 [55682.878003] [] ? process_one_work+0x440/0x440 [55682.884761] [] kthread+0xd1/0xe0 [55682.890235] [] ? insert_kthread_work+0x40/0x40 [55682.897061] [] ret_from_fork_nospec_begin+0x21/0x21 [55682.904377] [] ? insert_kthread_work+0x40/0x40 [55682.911213] scsi_eh_1 S ffff994d6eddac80 0 1015 2 0x00000000 [55682.919162] Call Trace: [55682.921893] [] ? __scsi_iterate_devices+0x75/0x90 [55682.928994] [] schedule+0x29/0x70 [55682.934565] [] scsi_error_handler+0xa3/0x8b0 [55682.941227] [] ? scsi_eh_get_sense+0x250/0x250 [55682.948061] [] kthread+0xd1/0xe0 [55682.953548] [] ? insert_kthread_work+0x40/0x40 [55682.960401] [] ret_from_fork_nospec_begin+0x21/0x21 [55682.967700] [] ? insert_kthread_work+0x40/0x40 [55682.974538] scsi_tmf_1 S ffff99516e45ac80 0 1016 2 0x00000000 [55682.982503] Call Trace: [55682.985261] [] schedule+0x29/0x70 [55682.990814] [] rescuer_thread+0x31e/0x3c0 [55682.997160] [] ? process_one_work+0x440/0x440 [55683.003875] [] kthread+0xd1/0xe0 [55683.009347] [] ? insert_kthread_work+0x40/0x40 [55683.016186] [] ret_from_fork_nospec_begin+0x21/0x21 [55683.023525] [] ? insert_kthread_work+0x40/0x40 [55683.030356] scsi_wq_1 S ffff99516e45ac80 0 1017 2 0x00000000 [55683.038348] Call Trace: [55683.041121] [] schedule+0x29/0x70 [55683.046730] [] rescuer_thread+0x31e/0x3c0 [55683.053086] [] ? process_one_work+0x440/0x440 [55683.059808] [] kthread+0xd1/0xe0 [55683.065304] [] ? insert_kthread_work+0x40/0x40 [55683.072136] [] ret_from_fork_nospec_begin+0x21/0x21 [55683.079467] [] ? insert_kthread_work+0x40/0x40 [55683.086310] scsi_eh_2 S ffff994d6c5dc1c0 0 1018 2 0x00000000 [55683.094318] Call Trace: [55683.097088] [] ? __scsi_iterate_devices+0x68/0x90 [55683.104219] [] schedule+0x29/0x70 [55683.109815] [] scsi_error_handler+0xa3/0x8b0 [55683.116468] [] ? scsi_eh_get_sense+0x250/0x250 [55683.123298] [] kthread+0xd1/0xe0 [55683.128765] [] ? insert_kthread_work+0x40/0x40 [55683.135596] [] ret_from_fork_nospec_begin+0x21/0x21 [55683.142921] [] ? insert_kthread_work+0x40/0x40 [55683.149748] scsi_tmf_2 S ffff99516e45ac80 0 1019 2 0x00000000 [55683.157743] Call Trace: [55683.160514] [] schedule+0x29/0x70 [55683.166107] [] rescuer_thread+0x31e/0x3c0 [55683.172455] [] ? process_one_work+0x440/0x440 [55683.179210] [] kthread+0xd1/0xe0 [55683.184722] [] ? insert_kthread_work+0x40/0x40 [55683.191567] [] ret_from_fork_nospec_begin+0x21/0x21 [55683.198865] [] ? insert_kthread_work+0x40/0x40 [55683.205727] scsi_eh_3 S ffff994d6a205230 0 1020 2 0x00000000 [55683.213725] Call Trace: [55683.216506] [] ? __scsi_iterate_devices+0x68/0x90 [55683.223659] [] schedule+0x29/0x70 [55683.229231] [] scsi_error_handler+0xa3/0x8b0 [55683.235850] [] ? scsi_eh_get_sense+0x250/0x250 [55683.242677] [] kthread+0xd1/0xe0 [55683.248150] [] ? insert_kthread_work+0x40/0x40 [55683.254963] [] ret_from_fork_nospec_begin+0x21/0x21 [55683.262294] [] ? insert_kthread_work+0x40/0x40 [55683.269125] scsi_tmf_3 S ffff99516e45ac80 0 1021 2 0x00000000 [55683.277079] Call Trace: [55683.279854] [] schedule+0x29/0x70 [55683.285427] [] rescuer_thread+0x31e/0x3c0 [55683.291796] [] ? process_one_work+0x440/0x440 [55683.298545] [] kthread+0xd1/0xe0 [55683.304020] [] ? insert_kthread_work+0x40/0x40 [55683.310831] [] ret_from_fork_nospec_begin+0x21/0x21 [55683.318154] [] ? insert_kthread_work+0x40/0x40 [55683.324982] scsi_eh_4 S ffff994d6a203150 0 1022 2 0x00000000 [55683.332926] Call Trace: [55683.335679] [] ? __scsi_iterate_devices+0x68/0x90 [55683.342802] [] schedule+0x29/0x70 [55683.348379] [] scsi_error_handler+0xa3/0x8b0 [55683.355026] [] ? scsi_eh_get_sense+0x250/0x250 [55683.361839] [] kthread+0xd1/0xe0 [55683.367337] [] ? insert_kthread_work+0x40/0x40 [55683.374158] [] ret_from_fork_nospec_begin+0x21/0x21 [55683.381490] [] ? insert_kthread_work+0x40/0x40 [55683.388334] scsi_tmf_4 S ffff99516e45ac80 0 1023 2 0x00000000 [55683.396326] Call Trace: [55683.399102] [] schedule+0x29/0x70 [55683.404681] [] rescuer_thread+0x31e/0x3c0 [55683.411025] [] ? process_one_work+0x440/0x440 [55683.417761] [] kthread+0xd1/0xe0 [55683.423258] [] ? insert_kthread_work+0x40/0x40 [55683.430104] [] ret_from_fork_nospec_begin+0x21/0x21 [55683.437415] [] ? insert_kthread_work+0x40/0x40 [55683.444253] scsi_eh_5 S ffff994d6a2062a0 0 1024 2 0x00000000 [55683.452208] Call Trace: [55683.454946] [] ? __scsi_iterate_devices+0x68/0x90 [55683.462082] [] schedule+0x29/0x70 [55683.467639] [] scsi_error_handler+0xa3/0x8b0 [55683.474300] [] ? scsi_eh_get_sense+0x250/0x250 [55683.481149] [] kthread+0xd1/0xe0 [55683.486640] [] ? insert_kthread_work+0x40/0x40 [55683.493503] [] ret_from_fork_nospec_begin+0x21/0x21 [55683.500792] [] ? insert_kthread_work+0x40/0x40 [55683.507644] scsi_tmf_5 S ffff99516e45ac80 0 1025 2 0x00000000 [55683.515607] Call Trace: [55683.518352] [] schedule+0x29/0x70 [55683.523903] [] rescuer_thread+0x31e/0x3c0 [55683.530241] [] ? process_one_work+0x440/0x440 [55683.536956] [] kthread+0xd1/0xe0 [55683.542431] [] ? insert_kthread_work+0x40/0x40 [55683.549264] [] ret_from_fork_nospec_begin+0x21/0x21 [55683.556583] [] ? insert_kthread_work+0x40/0x40 [55683.563398] scsi_eh_6 S ffff994d6a200000 0 1026 2 0x00000000 [55683.571375] Call Trace: [55683.574136] [] ? __scsi_iterate_devices+0x68/0x90 [55683.581257] [] schedule+0x29/0x70 [55683.586808] [] scsi_error_handler+0xa3/0x8b0 [55683.593446] [] ? scsi_eh_get_sense+0x250/0x250 [55683.600300] [] kthread+0xd1/0xe0 [55683.605754] [] ? insert_kthread_work+0x40/0x40 [55683.612586] [] ret_from_fork_nospec_begin+0x21/0x21 [55683.619882] [] ? insert_kthread_work+0x40/0x40 [55683.626715] scsi_tmf_6 S ffff99516e45ac80 0 1027 2 0x00000000 [55683.634697] Call Trace: [55683.637458] [] schedule+0x29/0x70 [55683.643024] [] rescuer_thread+0x31e/0x3c0 [55683.649375] [] ? process_one_work+0x440/0x440 [55683.656108] [] kthread+0xd1/0xe0 [55683.661593] [] ? insert_kthread_work+0x40/0x40 [55683.668425] [] ret_from_fork_nospec_begin+0x21/0x21 [55683.675748] [] ? insert_kthread_work+0x40/0x40 [55683.682588] scsi_eh_7 S ffff994ab97d62a0 0 1028 2 0x00000000 [55683.690557] Call Trace: [55683.693329] [] ? __scsi_iterate_devices+0x68/0x90 [55683.700458] [] schedule+0x29/0x70 [55683.706031] [] scsi_error_handler+0xa3/0x8b0 [55683.712672] [] ? scsi_eh_get_sense+0x250/0x250 [55683.719515] [] kthread+0xd1/0xe0 [55683.724974] [] ? insert_kthread_work+0x40/0x40 [55683.731786] [] ret_from_fork_nospec_begin+0x21/0x21 [55683.739109] [] ? insert_kthread_work+0x40/0x40 [55683.745917] scsi_tmf_7 S ffff99516e45ac80 0 1029 2 0x00000000 [55683.753880] Call Trace: [55683.756668] [] schedule+0x29/0x70 [55683.762280] [] rescuer_thread+0x31e/0x3c0 [55683.768656] [] ? process_one_work+0x440/0x440 [55683.775392] [] kthread+0xd1/0xe0 [55683.780877] [] ? insert_kthread_work+0x40/0x40 [55683.787695] [] ret_from_fork_nospec_begin+0x21/0x21 [55683.795012] [] ? insert_kthread_work+0x40/0x40 [55683.801845] ttm_swap S ffff99516e45ac80 0 1037 2 0x00000000 [55683.809793] Call Trace: [55683.812545] [] schedule+0x29/0x70 [55683.818117] [] rescuer_thread+0x31e/0x3c0 [55683.824465] [] ? process_one_work+0x440/0x440 [55683.831200] [] kthread+0xd1/0xe0 [55683.836656] [] ? insert_kthread_work+0x40/0x40 [55683.843507] [] ret_from_fork_nospec_begin+0x21/0x21 [55683.850802] [] ? insert_kthread_work+0x40/0x40 [55683.857623] poll_mpt2sas0_s S ffff99516e45ac80 0 1043 2 0x00000000 [55683.865587] Call Trace: [55683.868366] [] schedule+0x29/0x70 [55683.873960] [] rescuer_thread+0x31e/0x3c0 [55683.880315] [] ? process_one_work+0x440/0x440 [55683.887045] [] kthread+0xd1/0xe0 [55683.892533] [] ? insert_kthread_work+0x40/0x40 [55683.899365] [] ret_from_fork_nospec_begin+0x21/0x21 [55683.906704] [] ? insert_kthread_work+0x40/0x40 [55683.913549] kworker/3:1H S ffff994d6cd79070 0 1050 2 0x00000000 [55683.921530] Call Trace: [55683.924269] [] ? process_one_work+0x21a/0x440 [55683.931020] [] schedule+0x29/0x70 [55683.936627] [] worker_thread+0x1d9/0x3c0 [55683.942884] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55683.950199] [] kthread+0xd1/0xe0 [55683.955686] [] ? insert_kthread_work+0x40/0x40 [55683.962516] [] ret_from_fork_nospec_begin+0x21/0x21 [55683.969842] [] ? insert_kthread_work+0x40/0x40 [55683.976677] kworker/0:1H S ffff994d69370000 0 1051 2 0x00000000 [55683.984673] Call Trace: [55683.987453] [] ? process_one_work+0x21a/0x440 [55683.994188] [] schedule+0x29/0x70 [55683.999783] [] worker_thread+0x1d9/0x3c0 [55684.006040] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55684.013355] [] kthread+0xd1/0xe0 [55684.018817] [] ? insert_kthread_work+0x40/0x40 [55684.025629] [] ret_from_fork_nospec_begin+0x21/0x21 [55684.032937] [] ? insert_kthread_work+0x40/0x40 [55684.039746] kworker/22:1H S ffff994d69371070 0 1052 2 0x00000000 [55684.047715] Call Trace: [55684.050487] [] ? process_one_work+0x21a/0x440 [55684.057236] [] schedule+0x29/0x70 [55684.062816] [] worker_thread+0x1d9/0x3c0 [55684.069070] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55684.076384] [] kthread+0xd1/0xe0 [55684.081846] [] ? insert_kthread_work+0x40/0x40 [55684.088677] [] ret_from_fork_nospec_begin+0x21/0x21 [55684.096003] [] ? insert_kthread_work+0x40/0x40 [55684.102818] ib-comp-wq S ffff99516e45ac80 0 1054 2 0x00000000 [55684.110769] Call Trace: [55684.113535] [] schedule+0x29/0x70 [55684.119120] [] rescuer_thread+0x31e/0x3c0 [55684.125490] [] ? process_one_work+0x440/0x440 [55684.132224] [] kthread+0xd1/0xe0 [55684.137706] [] ? insert_kthread_work+0x40/0x40 [55684.144559] [] ret_from_fork_nospec_begin+0x21/0x21 [55684.151864] [] ? insert_kthread_work+0x40/0x40 [55684.158709] kworker/u307:0 S ffff99516e29ac80 0 1055 2 0x00000000 [55684.166675] Call Trace: [55684.169426] [] schedule+0x29/0x70 [55684.174990] [] worker_thread+0x1d9/0x3c0 [55684.181239] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55684.188558] [] kthread+0xd1/0xe0 [55684.194056] [] ? insert_kthread_work+0x40/0x40 [55684.200904] [] ret_from_fork_nospec_begin+0x21/0x21 [55684.208241] [] ? insert_kthread_work+0x40/0x40 [55684.215069] kworker/u308:0 S ffff994d693741c0 0 1056 2 0x00000000 [55684.223037] Call Trace: [55684.225854] [] ? ib_cq_poll_work+0x45/0x60 [ib_core] [55684.233251] [] ? process_one_work+0x21a/0x440 [55684.239985] [] schedule+0x29/0x70 [55684.245560] [] worker_thread+0x1d9/0x3c0 [55684.251805] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55684.259143] [] kthread+0xd1/0xe0 [55684.264659] [] ? insert_kthread_work+0x40/0x40 [55684.271518] [] ret_from_fork_nospec_begin+0x21/0x21 [55684.278822] [] ? insert_kthread_work+0x40/0x40 [55684.285682] kworker/u309:0 S ffff99516e45ac80 0 1057 2 0x00000000 [55684.293634] Call Trace: [55684.296397] [] schedule+0x29/0x70 [55684.301955] [] worker_thread+0x1d9/0x3c0 [55684.308205] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55684.315539] [] kthread+0xd1/0xe0 [55684.321029] [] ? insert_kthread_work+0x40/0x40 [55684.327861] [] ret_from_fork_nospec_begin+0x21/0x21 [55684.335180] [] ? insert_kthread_work+0x40/0x40 [55684.342019] ib-comp-unb-wq S ffff99516e45ac80 0 1058 2 0x00000000 [55684.349955] Call Trace: [55684.352703] [] schedule+0x29/0x70 [55684.358285] [] rescuer_thread+0x31e/0x3c0 [55684.364652] [] ? process_one_work+0x440/0x440 [55684.371385] [] kthread+0xd1/0xe0 [55684.376846] [] ? insert_kthread_work+0x40/0x40 [55684.383660] [] ret_from_fork_nospec_begin+0x21/0x21 [55684.390999] [] ? insert_kthread_work+0x40/0x40 [55684.397808] ib_mcast S ffff99516e45ac80 0 1059 2 0x00000000 [55684.405772] Call Trace: [55684.408541] [] schedule+0x29/0x70 [55684.414123] [] rescuer_thread+0x31e/0x3c0 [55684.420484] [] ? process_one_work+0x440/0x440 [55684.427232] [] kthread+0xd1/0xe0 [55684.432700] [] ? insert_kthread_work+0x40/0x40 [55684.439543] [] ret_from_fork_nospec_begin+0x21/0x21 [55684.446839] [] ? insert_kthread_work+0x40/0x40 [55684.453678] ib_nl_sa_wq S ffff994d6eddac80 0 1060 2 0x00000000 [55684.461642] Call Trace: [55684.464400] [] schedule+0x29/0x70 [55684.469964] [] rescuer_thread+0x31e/0x3c0 [55684.476311] [] ? process_one_work+0x440/0x440 [55684.483045] [] kthread+0xd1/0xe0 [55684.488518] [] ? insert_kthread_work+0x40/0x40 [55684.495350] [] ret_from_fork_nospec_begin+0x21/0x21 [55684.502658] [] ? insert_kthread_work+0x40/0x40 [55684.509488] mlx4_ib S ffff99516e45ac80 0 1061 2 0x00000000 [55684.517459] Call Trace: [55684.520240] [] schedule+0x29/0x70 [55684.525819] [] rescuer_thread+0x31e/0x3c0 [55684.532179] [] ? process_one_work+0x440/0x440 [55684.538894] [] kthread+0xd1/0xe0 [55684.544378] [] ? insert_kthread_work+0x40/0x40 [55684.551210] [] ret_from_fork_nospec_begin+0x21/0x21 [55684.558535] [] ? insert_kthread_work+0x40/0x40 [55684.565385] mlx4_ib_mcg S ffff994d6eddac80 0 1062 2 0x00000000 [55684.573402] Call Trace: [55684.576176] [] schedule+0x29/0x70 [55684.581728] [] rescuer_thread+0x31e/0x3c0 [55684.588076] [] ? process_one_work+0x440/0x440 [55684.594793] [] kthread+0xd1/0xe0 [55684.600276] [] ? insert_kthread_work+0x40/0x40 [55684.607114] [] ret_from_fork_nospec_begin+0x21/0x21 [55684.614423] [] ? insert_kthread_work+0x40/0x40 [55684.621254] ib_mad1 S ffff99516e45ac80 0 1063 2 0x00000000 [55684.629209] Call Trace: [55684.631948] [] schedule+0x29/0x70 [55684.637561] [] rescuer_thread+0x31e/0x3c0 [55684.643896] [] ? process_one_work+0x440/0x440 [55684.650620] [] kthread+0xd1/0xe0 [55684.656094] [] ? insert_kthread_work+0x40/0x40 [55684.662905] [] ret_from_fork_nospec_begin+0x21/0x21 [55684.670236] [] ? insert_kthread_work+0x40/0x40 [55684.677069] to_fifo S ffff99516e45ac80 0 1064 2 0x00000000 [55684.685009] Call Trace: [55684.687769] [] schedule+0x29/0x70 [55684.693347] [] rescuer_thread+0x31e/0x3c0 [55684.699711] [] ? process_one_work+0x440/0x440 [55684.706470] [] kthread+0xd1/0xe0 [55684.711937] [] ? insert_kthread_work+0x40/0x40 [55684.718749] [] ret_from_fork_nospec_begin+0x21/0x21 [55684.726073] [] ? insert_kthread_work+0x40/0x40 [55684.732912] ib_mad2 S ffff99516e45ac80 0 1065 2 0x00000000 [55684.740849] Call Trace: [55684.743589] [] schedule+0x29/0x70 [55684.749173] [] rescuer_thread+0x31e/0x3c0 [55684.755524] [] ? process_one_work+0x440/0x440 [55684.762288] [] kthread+0xd1/0xe0 [55684.767744] [] ? insert_kthread_work+0x40/0x40 [55684.774598] [] ret_from_fork_nospec_begin+0x21/0x21 [55684.781905] [] ? insert_kthread_work+0x40/0x40 [55684.788713] to_fifo S ffff99516e45ac80 0 1066 2 0x00000000 [55684.796654] Call Trace: [55684.799415] [] schedule+0x29/0x70 [55684.804997] [] rescuer_thread+0x31e/0x3c0 [55684.811345] [] ? process_one_work+0x440/0x440 [55684.818087] [] kthread+0xd1/0xe0 [55684.823555] [] ? insert_kthread_work+0x40/0x40 [55684.830402] [] ret_from_fork_nospec_begin+0x21/0x21 [55684.837699] [] ? insert_kthread_work+0x40/0x40 [55684.844540] kworker/12:1H S ffff99516a9162a0 0 1102 2 0x00000000 [55684.852515] Call Trace: [55684.855269] [] ? process_one_work+0x21a/0x440 [55684.861985] [] schedule+0x29/0x70 [55684.867587] [] worker_thread+0x1d9/0x3c0 [55684.873817] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55684.881149] [] kthread+0xd1/0xe0 [55684.886654] [] ? insert_kthread_work+0x40/0x40 [55684.893477] [] ret_from_fork_nospec_begin+0x21/0x21 [55684.900802] [] ? insert_kthread_work+0x40/0x40 [55684.907665] jbd2/sda1-8 S ffff99516a913150 0 1109 2 0x00000000 [55684.915637] Call Trace: [55684.918397] [] ? task_rq_unlock+0x20/0x20 [55684.924736] [] schedule+0x29/0x70 [55684.930318] [] kjournald2+0x203/0x260 [jbd2] [55684.936961] [] ? wake_up_atomic_t+0x30/0x30 [55684.943541] [] ? commit_timeout+0x10/0x10 [jbd2] [55684.950609] [] kthread+0xd1/0xe0 [55684.956092] [] ? insert_kthread_work+0x40/0x40 [55684.962904] [] ret_from_fork_nospec_begin+0x21/0x21 [55684.970233] [] ? insert_kthread_work+0x40/0x40 [55684.977085] ext4-rsv-conver S ffff99516e45ac80 0 1110 2 0x00000000 [55684.985054] Call Trace: [55684.987814] [] schedule+0x29/0x70 [55684.993374] [] rescuer_thread+0x31e/0x3c0 [55684.999720] [] ? process_one_work+0x440/0x440 [55685.006454] [] kthread+0xd1/0xe0 [55685.011914] [] ? insert_kthread_work+0x40/0x40 [55685.018726] [] ret_from_fork_nospec_begin+0x21/0x21 [55685.026050] [] ? insert_kthread_work+0x40/0x40 [55685.032896] kworker/u306:2 S ffff99516caca0e0 0 1147 2 0x00000000 [55685.040865] Call Trace: [55685.043653] [] ? process_one_work+0x21a/0x440 [55685.050411] [] schedule+0x29/0x70 [55685.055976] [] worker_thread+0x1d9/0x3c0 [55685.062227] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55685.069571] [] kthread+0xd1/0xe0 [55685.075069] [] ? insert_kthread_work+0x40/0x40 [55685.081880] [] ret_from_fork_nospec_begin+0x21/0x21 [55685.089213] [] ? insert_kthread_work+0x40/0x40 [55685.096058] systemd-journal R running task 0 1194 1 0x00000000 [55685.104034] Call Trace: [55685.106771] [] schedule+0x29/0x70 [55685.112341] [] schedule_hrtimeout_range_clock+0x12d/0x150 [55685.120263] [] ? ep_scan_ready_list.isra.7+0x1b9/0x1f0 [55685.127851] [] schedule_hrtimeout_range+0x13/0x20 [55685.134989] [] ep_poll+0x23e/0x360 [55685.140660] [] ? do_truncate+0x88/0xc0 [55685.146741] [] ? __sb_start_write+0x58/0x120 [55685.153401] [] ? wake_up_state+0x20/0x20 [55685.159646] [] SyS_epoll_wait+0xed/0x120 [55685.165876] [] ? system_call_after_swapgs+0xa2/0x146 [55685.173295] [] system_call_fastpath+0x25/0x2a [55685.180040] [] ? system_call_after_swapgs+0xae/0x146 [55685.187451] kworker/10:2 S ffff99516e29ac80 0 1209 2 0x00000000 [55685.195420] Call Trace: [55685.198193] [] schedule+0x29/0x70 [55685.203781] [] worker_thread+0x1d9/0x3c0 [55685.210047] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55685.217386] [] kthread+0xd1/0xe0 [55685.222869] [] ? insert_kthread_work+0x40/0x40 [55685.229716] [] ret_from_fork_nospec_begin+0x21/0x21 [55685.237042] [] ? insert_kthread_work+0x40/0x40 [55685.243880] rpciod S ffff99516e45ac80 0 1219 2 0x00000000 [55685.251854] Call Trace: [55685.254627] [] schedule+0x29/0x70 [55685.260205] [] rescuer_thread+0x31e/0x3c0 [55685.266587] [] ? process_one_work+0x440/0x440 [55685.273352] [] kthread+0xd1/0xe0 [55685.278807] [] ? insert_kthread_work+0x40/0x40 [55685.285652] [] ret_from_fork_nospec_begin+0x21/0x21 [55685.292949] [] ? insert_kthread_work+0x40/0x40 [55685.299759] xprtiod S ffff99516e45ac80 0 1220 2 0x00000000 [55685.307690] Call Trace: [55685.310455] [] schedule+0x29/0x70 [55685.316025] [] rescuer_thread+0x31e/0x3c0 [55685.322396] [] ? process_one_work+0x440/0x440 [55685.329146] [] kthread+0xd1/0xe0 [55685.334643] [] ? insert_kthread_work+0x40/0x40 [55685.341483] [] ret_from_fork_nospec_begin+0x21/0x21 [55685.348781] [] ? insert_kthread_work+0x40/0x40 [55685.355633] lvmetad S ffff99516e45ac80 0 1221 1 0x00000000 [55685.363581] Call Trace: [55685.366349] [] schedule+0x29/0x70 [55685.371914] [] schedule_hrtimeout_range_clock+0x12d/0x150 [55685.379820] [] ? add_wait_queue+0x3c/0x50 [55685.386181] [] ? __pollwait+0x7f/0xf0 [55685.392162] [] ? list_del+0xd/0x30 [55685.397828] [] schedule_hrtimeout_range+0x13/0x20 [55685.404932] [] poll_schedule_timeout+0x55/0xc0 [55685.411743] [] do_select+0x6d1/0x7c0 [55685.417596] [] ? __pollwait+0xf0/0xf0 [55685.423536] [] ? list_del+0xd/0x30 [55685.429204] [] ? __rmqueue+0x8a/0x460 [55685.435162] [] ? zone_statistics+0x88/0xa0 [55685.441594] [] core_sys_select+0x1ff/0x340 [55685.448031] [] ? page_add_new_anon_rmap+0xb8/0x170 [55685.455274] [] ? enqueue_entity+0x2ef/0xbe0 [55685.461806] [] ? cpumask_next_and+0x35/0x50 [55685.468346] [] ? enqueue_task_fair+0x208/0x6c0 [55685.475192] [] ? sched_clock_cpu+0x85/0xc0 [55685.481660] [] ? recalc_sigpending+0x1b/0x70 [55685.488321] [] ? __set_task_blocked+0x41/0xa0 [55685.495046] [] ? __set_current_blocked+0x42/0x70 [55685.502072] [] SyS_pselect6+0x153/0x260 [55685.508238] [] ? system_call_after_swapgs+0xa2/0x146 [55685.515638] [] ? system_call_after_swapgs+0xae/0x146 [55685.523052] [] ? system_call_after_swapgs+0xa2/0x146 [55685.530475] [] ? system_call_after_swapgs+0xae/0x146 [55685.537902] [] system_call_fastpath+0x25/0x2a [55685.544646] [] ? system_call_after_swapgs+0xae/0x146 [55685.552057] systemd-udevd S ffff994d679462a0 0 1233 1 0x00000000 [55685.560037] Call Trace: [55685.562797] [] ? kmem_cache_alloc+0x35/0x1f0 [55685.569458] [] schedule+0x29/0x70 [55685.575027] [] schedule_hrtimeout_range_clock+0x12d/0x150 [55685.582933] [] ? ep_scan_ready_list.isra.7+0x1b9/0x1f0 [55685.590563] [] schedule_hrtimeout_range+0x13/0x20 [55685.597674] [] ep_poll+0x23e/0x360 [55685.603344] [] ? do_unlinkat+0xf1/0x2d0 [55685.609497] [] ? wake_up_state+0x20/0x20 [55685.615728] [] SyS_epoll_wait+0xed/0x120 [55685.621991] [] ? system_call_after_swapgs+0xa2/0x146 [55685.629419] [] system_call_fastpath+0x25/0x2a [55685.636144] [] ? system_call_after_swapgs+0xae/0x146 [55685.643568] kmpathd S ffff99516e45ac80 0 1241 2 0x00000000 [55685.651527] Call Trace: [55685.654278] [] schedule+0x29/0x70 [55685.659837] [] rescuer_thread+0x31e/0x3c0 [55685.666185] [] ? process_one_work+0x440/0x440 [55685.672942] [] kthread+0xd1/0xe0 [55685.678416] [] ? insert_kthread_work+0x40/0x40 [55685.685270] [] ret_from_fork_nospec_begin+0x21/0x21 [55685.692581] [] ? insert_kthread_work+0x40/0x40 [55685.699410] kmpath_handlerd S ffff99516e45ac80 0 1242 2 0x00000000 [55685.707392] Call Trace: [55685.710170] [] schedule+0x29/0x70 [55685.715757] [] rescuer_thread+0x31e/0x3c0 [55685.722116] [] ? process_one_work+0x440/0x440 [55685.728837] [] kthread+0xd1/0xe0 [55685.734335] [] ? insert_kthread_work+0x40/0x40 [55685.741167] [] ret_from_fork_nospec_begin+0x21/0x21 [55685.748514] [] ? insert_kthread_work+0x40/0x40 [55685.755342] kworker/1:1H S ffff994d585f5230 0 1246 2 0x00000000 [55685.763360] Call Trace: [55685.766129] [] ? process_one_work+0x21a/0x440 [55685.772864] [] schedule+0x29/0x70 [55685.778452] [] worker_thread+0x1d9/0x3c0 [55685.784711] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55685.792027] [] kthread+0xd1/0xe0 [55685.797525] [] ? insert_kthread_work+0x40/0x40 [55685.804347] [] ret_from_fork_nospec_begin+0x21/0x21 [55685.811671] [] ? insert_kthread_work+0x40/0x40 [55685.818533] multipathd S ffff994975e6a0e0 0 1251 1 0x00000000 [55685.826527] Call Trace: [55685.829287] [] schedule+0x29/0x70 [55685.834850] [] futex_wait_queue_me+0xc6/0x130 [55685.841579] [] futex_wait+0x17b/0x280 [55685.847568] [] do_futex+0x106/0x5a0 [55685.853345] [] ? mntput+0x24/0x40 [55685.858932] [] ? __fput+0x186/0x260 [55685.864684] [] SyS_futex+0x80/0x190 [55685.870452] [] ? system_call_after_swapgs+0xa2/0x146 [55685.877879] [] ? system_call_after_swapgs+0xae/0x146 [55685.885282] [] ? system_call_after_swapgs+0xa2/0x146 [55685.892703] [] ? system_call_after_swapgs+0xae/0x146 [55685.900114] [] ? system_call_after_swapgs+0xa2/0x146 [55685.907547] [] ? system_call_after_swapgs+0xae/0x146 [55685.914967] [] system_call_fastpath+0x25/0x2a [55685.921682] [] ? system_call_after_swapgs+0xae/0x146 [55685.929094] multipathd S ffff9949759962a0 0 1252 1 0x00000000 [55685.937074] Call Trace: [55685.939816] [] schedule+0x29/0x70 [55685.945386] [] futex_wait_queue_me+0xc6/0x130 [55685.952136] [] futex_wait+0x17b/0x280 [55685.958110] [] do_futex+0x106/0x5a0 [55685.963871] [] SyS_futex+0x80/0x190 [55685.969621] [] ? system_call_after_swapgs+0xa2/0x146 [55685.977049] [] ? system_call_after_swapgs+0xae/0x146 [55685.984450] [] ? system_call_after_swapgs+0xa2/0x146 [55685.991871] [] ? system_call_after_swapgs+0xae/0x146 [55685.999283] [] ? system_call_after_swapgs+0xa2/0x146 [55686.006702] [] ? system_call_after_swapgs+0xae/0x146 [55686.014116] [] system_call_fastpath+0x25/0x2a [55686.020838] [] ? system_call_after_swapgs+0xae/0x146 [55686.028258] multipathd S ffff99516e4dac80 0 1253 1 0x00000000 [55686.036241] Call Trace: [55686.039008] [] schedule+0x29/0x70 [55686.044565] [] schedule_hrtimeout_range_clock+0x12d/0x150 [55686.052485] [] ? add_wait_queue+0x3c/0x50 [55686.058817] [] ? __pollwait+0x7f/0xf0 [55686.064752] [] schedule_hrtimeout_range+0x13/0x20 [55686.071884] [] poll_schedule_timeout+0x55/0xc0 [55686.078723] [] do_sys_poll+0x48d/0x590 [55686.084794] [] ? netlink_recvmsg+0x212/0x490 [55686.091432] [] ? plist_add+0x91/0xd0 [55686.097317] [] ? enqueue_pushable_task+0x6d/0x90 [55686.104341] [] ? __pollwait+0xf0/0xf0 [55686.110300] [] ? try_to_wake_up+0x190/0x390 [55686.116823] [] ? wake_up_q+0x5b/0x80 [55686.122665] [] ? futex_wake_op+0x3b5/0x640 [55686.129121] [] ? do_futex+0x17a/0x5a0 [55686.135095] [] ? _raw_spin_unlock_bh+0x1e/0x20 [55686.141928] [] ? release_sock+0x120/0x170 [55686.148283] [] ? system_call_after_swapgs+0xae/0x146 [55686.155683] [] SyS_poll+0x74/0x110 [55686.161350] [] ? system_call_after_swapgs+0xa2/0x146 [55686.168770] [] ? system_call_after_swapgs+0xae/0x146 [55686.176182] [] system_call_fastpath+0x25/0x2a [55686.182923] [] ? system_call_after_swapgs+0xae/0x146 [55686.190339] multipathd S ffff995167635230 0 1254 1 0x00000000 [55686.198298] Call Trace: [55686.201066] [] ? hrtimer_start_range_ns+0x1fd/0x3c0 [55686.208379] [] schedule+0x29/0x70 [55686.213948] [] schedule_hrtimeout_range_clock+0xb2/0x150 [55686.221730] [] ? hrtimer_get_res+0x50/0x50 [55686.228175] [] ? schedule_hrtimeout_range_clock+0xa6/0x150 [55686.236168] [] schedule_hrtimeout_range+0x13/0x20 [55686.243303] [] poll_schedule_timeout+0x55/0xc0 [55686.250151] [] do_sys_poll+0x48d/0x590 [55686.256223] [] ? add_page_to_unevictable_list+0xc8/0x100 [55686.264037] [] ? page_add_new_anon_rmap+0x12d/0x170 [55686.271363] [] ? handle_pte_fault+0x6b4/0xe20 [55686.278099] [] ? alloc_pages_current+0x98/0x110 [55686.285035] [] ? __pollwait+0xf0/0xf0 [55686.291010] [] ? unlock_page+0x2b/0x30 [55686.297087] [] ? plist_add+0x91/0xd0 [55686.302927] [] ? enqueue_pushable_task+0x6d/0x90 [55686.309959] [] ? check_preempt_curr+0x80/0xa0 [55686.316672] [] ? ttwu_do_wakeup+0x3f/0xe0 [55686.323018] [] ? ttwu_do_activate+0x6f/0x80 [55686.329539] [] ? __kmalloc+0x55/0x230 [55686.335486] [] ? pmd_clear_huge+0x80/0x80 [55686.341819] [] ? recalc_sigpending+0x1b/0x70 [55686.348487] [] ? __set_task_blocked+0x41/0xa0 [55686.355230] [] SyS_ppoll+0xee/0x1f0 [55686.361018] [] system_call_fastpath+0x25/0x2a [55686.367732] [] ? system_call_after_swapgs+0xae/0x146 [55686.375142] multipathd S ffff9951676341c0 0 1258 1 0x00000000 [55686.383107] Call Trace: [55686.385846] [] ? hrtimer_start_range_ns+0x1fd/0x3c0 [55686.393168] [] schedule+0x29/0x70 [55686.398716] [] do_nanosleep+0x70/0x100 [55686.404753] [] hrtimer_nanosleep+0xbb/0x180 [55686.411316] [] ? hrtimer_get_res+0x50/0x50 [55686.417760] [] ? do_nanosleep+0x5b/0x100 [55686.424024] [] SyS_nanosleep+0x96/0xb0 [55686.430088] [] system_call_fastpath+0x25/0x2a [55686.436803] [] ? system_call_after_swapgs+0xae/0x146 [55686.444214] multipathd S ffff99516e21ac80 0 1259 1 0x00000000 [55686.452169] Call Trace: [55686.454927] [] schedule+0x29/0x70 [55686.460494] [] futex_wait_queue_me+0xc6/0x130 [55686.467230] [] futex_wait+0x17b/0x280 [55686.473188] [] ? mntput+0x24/0x40 [55686.478746] [] ? path_openat+0x176/0x5a0 [55686.484977] [] do_futex+0x106/0x5a0 [55686.490729] [] ? lockref_put_or_lock+0x48/0x80 [55686.497546] [] ? mntput+0x24/0x40 [55686.503118] [] ? __fput+0x186/0x260 [55686.508872] [] SyS_futex+0x80/0x190 [55686.514623] [] ? system_call_after_swapgs+0xa2/0x146 [55686.522050] [] ? system_call_after_swapgs+0xae/0x146 [55686.529482] [] ? system_call_after_swapgs+0xa2/0x146 [55686.536902] [] ? system_call_after_swapgs+0xae/0x146 [55686.544336] [] ? system_call_after_swapgs+0xa2/0x146 [55686.551729] [] ? system_call_after_swapgs+0xae/0x146 [55686.559158] [] system_call_fastpath+0x25/0x2a [55686.565893] [] ? system_call_after_swapgs+0xae/0x146 [55686.573306] multipathd S ffff99516e41ac80 0 2022 1 0x00000000 [55686.581296] Call Trace: [55686.584046] [] schedule+0x29/0x70 [55686.589620] [] dm_wait_event+0xa1/0xf0 [dm_mod] [55686.596532] [] ? strlcpy+0x42/0x60 [55686.602198] [] ? wake_up_atomic_t+0x30/0x30 [55686.608727] [] dev_wait+0x50/0xd0 [dm_mod] [55686.615184] [] ctl_ioctl+0x24e/0x550 [dm_mod] [55686.621919] [] ? enqueue_entity+0x2ef/0xbe0 [55686.628470] [] ? table_deps+0x1a0/0x1a0 [dm_mod] [55686.635510] [] dm_ctl_ioctl+0xe/0x20 [dm_mod] [55686.642231] [] do_vfs_ioctl+0x3a0/0x5a0 [55686.648379] [] ? __set_task_blocked+0x41/0xa0 [55686.655116] [] ? __set_current_blocked+0x42/0x70 [55686.662141] [] SyS_ioctl+0xa1/0xc0 [55686.667803] [] ? system_call_after_swapgs+0xa2/0x146 [55686.675236] [] system_call_fastpath+0x25/0x2a [55686.681987] [] ? system_call_after_swapgs+0xae/0x146 [55686.689400] multipathd S ffff99516e41ac80 0 2028 1 0x00000000 [55686.697381] Call Trace: [55686.700147] [] schedule+0x29/0x70 [55686.705733] [] dm_wait_event+0xa1/0xf0 [dm_mod] [55686.712641] [] ? strlcpy+0x42/0x60 [55686.718315] [] ? wake_up_atomic_t+0x30/0x30 [55686.724833] [] dev_wait+0x50/0xd0 [dm_mod] [55686.731282] [] ctl_ioctl+0x24e/0x550 [dm_mod] [55686.738034] [] ? table_deps+0x1a0/0x1a0 [dm_mod] [55686.745072] [] dm_ctl_ioctl+0xe/0x20 [dm_mod] [55686.751788] [] do_vfs_ioctl+0x3a0/0x5a0 [55686.757942] [] ? __set_task_blocked+0x41/0xa0 [55686.764657] [] ? __set_current_blocked+0x42/0x70 [55686.771693] [] SyS_ioctl+0xa1/0xc0 [55686.777374] [] ? system_call_after_swapgs+0xa2/0x146 [55686.784767] [] system_call_fastpath+0x25/0x2a [55686.791494] [] ? system_call_after_swapgs+0xae/0x146 [55686.798912] multipathd S ffff99516e41ac80 0 2035 1 0x00000000 [55686.806908] Call Trace: [55686.809647] [] schedule+0x29/0x70 [55686.815214] [] dm_wait_event+0xa1/0xf0 [dm_mod] [55686.822150] [] ? strlcpy+0x42/0x60 [55686.827805] [] ? wake_up_atomic_t+0x30/0x30 [55686.834372] [] dev_wait+0x50/0xd0 [dm_mod] [55686.840839] [] ctl_ioctl+0x24e/0x550 [dm_mod] [55686.847565] [] ? table_deps+0x1a0/0x1a0 [dm_mod] [55686.854579] [] dm_ctl_ioctl+0xe/0x20 [dm_mod] [55686.861319] [] do_vfs_ioctl+0x3a0/0x5a0 [55686.867498] [] ? __set_task_blocked+0x41/0xa0 [55686.874248] [] ? __set_current_blocked+0x42/0x70 [55686.881273] [] SyS_ioctl+0xa1/0xc0 [55686.886940] [] ? system_call_after_swapgs+0xa2/0x146 [55686.894362] [] system_call_fastpath+0x25/0x2a [55686.901105] [] ? system_call_after_swapgs+0xae/0x146 [55686.908505] multipathd S ffff99516e41ac80 0 2041 1 0x00000000 [55686.916441] Call Trace: [55686.919199] [] schedule+0x29/0x70 [55686.924755] [] dm_wait_event+0xa1/0xf0 [dm_mod] [55686.931662] [] ? strlcpy+0x42/0x60 [55686.937339] [] ? wake_up_atomic_t+0x30/0x30 [55686.943889] [] dev_wait+0x50/0xd0 [dm_mod] [55686.950337] [] ctl_ioctl+0x24e/0x550 [dm_mod] [55686.957085] [] ? table_deps+0x1a0/0x1a0 [dm_mod] [55686.964127] [] dm_ctl_ioctl+0xe/0x20 [dm_mod] [55686.970849] [] do_vfs_ioctl+0x3a0/0x5a0 [55686.977001] [] ? __set_task_blocked+0x41/0xa0 [55686.983722] [] ? __set_current_blocked+0x42/0x70 [55686.990764] [] SyS_ioctl+0xa1/0xc0 [55686.996453] [] ? system_call_after_swapgs+0xa2/0x146 [55687.003850] [] system_call_fastpath+0x25/0x2a [55687.010566] [] ? system_call_after_swapgs+0xae/0x146 [55687.017992] multipathd S ffff99516cbc3200 0 2047 1 0x00000000 [55687.025996] Call Trace: [55687.028739] [] schedule+0x29/0x70 [55687.034315] [] dm_wait_event+0xa1/0xf0 [dm_mod] [55687.041266] [] ? strlcpy+0x42/0x60 [55687.046950] [] ? wake_up_atomic_t+0x30/0x30 [55687.053525] [] dev_wait+0x50/0xd0 [dm_mod] [55687.059982] [] ctl_ioctl+0x24e/0x550 [dm_mod] [55687.066697] [] ? enqueue_entity+0x2ef/0xbe0 [55687.073242] [] ? table_deps+0x1a0/0x1a0 [dm_mod] [55687.080281] [] dm_ctl_ioctl+0xe/0x20 [dm_mod] [55687.087038] [] do_vfs_ioctl+0x3a0/0x5a0 [55687.093211] [] ? __set_task_blocked+0x41/0xa0 [55687.099947] [] ? __set_current_blocked+0x42/0x70 [55687.106988] [] SyS_ioctl+0xa1/0xc0 [55687.112636] [] ? system_call_after_swapgs+0xa2/0x146 [55687.120062] [] system_call_fastpath+0x25/0x2a [55687.126776] [] ? system_call_after_swapgs+0xae/0x146 [55687.134196] kworker/11:2 S ffff995169cc62a0 0 1255 2 0x00000000 [55687.142142] Call Trace: [55687.144902] [] ? process_one_work+0x21a/0x440 [55687.151614] [] schedule+0x29/0x70 [55687.157188] [] worker_thread+0x1d9/0x3c0 [55687.163434] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55687.170749] [] kthread+0xd1/0xe0 [55687.176231] [] ? insert_kthread_work+0x40/0x40 [55687.183076] [] ret_from_fork_nospec_begin+0x21/0x21 [55687.190375] [] ? insert_kthread_work+0x40/0x40 [55687.197240] kipmi0 S ffff995169cc1070 0 1344 2 0x00000000 [55687.205204] Call Trace: [55687.207958] [] schedule+0x29/0x70 [55687.213525] [] ipmi_thread+0x15c/0x220 [ipmi_si] [55687.220535] [] ? cleanup_one_si+0x60/0x60 [ipmi_si] [55687.227859] [] kthread+0xd1/0xe0 [55687.233351] [] ? insert_kthread_work+0x40/0x40 [55687.240202] [] ret_from_fork_nospec_begin+0x21/0x21 [55687.247500] [] ? insert_kthread_work+0x40/0x40 [55687.254336] kworker/7:1H S ffff994d6a3ca0e0 0 1365 2 0x00000000 [55687.262307] Call Trace: [55687.265061] [] ? process_one_work+0x21a/0x440 [55687.271798] [] schedule+0x29/0x70 [55687.277365] [] worker_thread+0x1d9/0x3c0 [55687.283611] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55687.290942] [] kthread+0xd1/0xe0 [55687.296440] [] ? insert_kthread_work+0x40/0x40 [55687.303296] [] ret_from_fork_nospec_begin+0x21/0x21 [55687.310601] [] ? insert_kthread_work+0x40/0x40 [55687.317425] kworker/2:1H S ffff994d6a3cb150 0 1366 2 0x00000000 [55687.325390] Call Trace: [55687.328149] [] ? process_one_work+0x21a/0x440 [55687.334891] [] schedule+0x29/0x70 [55687.340455] [] worker_thread+0x1d9/0x3c0 [55687.346694] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55687.354017] [] kthread+0xd1/0xe0 [55687.359506] [] ? insert_kthread_work+0x40/0x40 [55687.366354] [] ret_from_fork_nospec_begin+0x21/0x21 [55687.373672] [] ? insert_kthread_work+0x40/0x40 [55687.380504] kworker/14:1H S ffff99516c2b8000 0 1699 2 0x00000000 [55687.388461] Call Trace: [55687.391218] [] ? process_one_work+0x21a/0x440 [55687.397967] [] schedule+0x29/0x70 [55687.403517] [] worker_thread+0x1d9/0x3c0 [55687.409755] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55687.417092] [] kthread+0xd1/0xe0 [55687.422571] [] ? insert_kthread_work+0x40/0x40 [55687.429427] [] ret_from_fork_nospec_begin+0x21/0x21 [55687.436757] [] ? insert_kthread_work+0x40/0x40 [55687.443587] kworker/29:1H S ffff99516c2be2a0 0 1955 2 0x00000000 [55687.451538] Call Trace: [55687.454305] [] ? process_one_work+0x21a/0x440 [55687.461038] [] schedule+0x29/0x70 [55687.466594] [] worker_thread+0x1d9/0x3c0 [55687.472831] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55687.480166] [] kthread+0xd1/0xe0 [55687.485629] [] ? insert_kthread_work+0x40/0x40 [55687.492478] [] ret_from_fork_nospec_begin+0x21/0x21 [55687.499774] [] ? insert_kthread_work+0x40/0x40 [55687.506583] kdmflush S ffff99516e49ac80 0 2005 2 0x00000000 [55687.514514] Call Trace: [55687.517274] [] schedule+0x29/0x70 [55687.522859] [] rescuer_thread+0x31e/0x3c0 [55687.529215] [] ? process_one_work+0x440/0x440 [55687.535949] [] kthread+0xd1/0xe0 [55687.541435] [] ? insert_kthread_work+0x40/0x40 [55687.548266] [] ret_from_fork_nospec_begin+0x21/0x21 [55687.555593] [] ? insert_kthread_work+0x40/0x40 [55687.562424] bioset S ffff99516e45ac80 0 2020 2 0x00000000 [55687.570402] Call Trace: [55687.573180] [] schedule+0x29/0x70 [55687.578753] [] rescuer_thread+0x31e/0x3c0 [55687.585122] [] ? process_one_work+0x440/0x440 [55687.591855] [] kthread+0xd1/0xe0 [55687.597341] [] ? insert_kthread_work+0x40/0x40 [55687.604208] [] ret_from_fork_nospec_begin+0x21/0x21 [55687.611504] [] ? insert_kthread_work+0x40/0x40 [55687.618337] kdmwork-253:0 S ffff994d6b10c1c0 0 2021 2 0x00000000 [55687.626280] Call Trace: [55687.629030] [] schedule+0x29/0x70 [55687.634580] [] kthread_worker_fn+0xf7/0x180 [55687.641122] [] ? kthread_stop+0xf0/0xf0 [55687.647272] [] kthread+0xd1/0xe0 [55687.652727] [] ? insert_kthread_work+0x40/0x40 [55687.659539] [] ret_from_fork_nospec_begin+0x21/0x21 [55687.666837] [] ? insert_kthread_work+0x40/0x40 [55687.673647] kdmflush S ffff99516e29ac80 0 2024 2 0x00000000 [55687.681586] Call Trace: [55687.684367] [] schedule+0x29/0x70 [55687.689954] [] rescuer_thread+0x31e/0x3c0 [55687.696324] [] ? process_one_work+0x440/0x440 [55687.703069] [] kthread+0xd1/0xe0 [55687.708552] [] ? insert_kthread_work+0x40/0x40 [55687.715402] [] ret_from_fork_nospec_begin+0x21/0x21 [55687.722701] [] ? insert_kthread_work+0x40/0x40 [55687.729544] bioset S ffff99516e25ac80 0 2026 2 0x00000000 [55687.737500] Call Trace: [55687.740251] [] schedule+0x29/0x70 [55687.745801] [] rescuer_thread+0x31e/0x3c0 [55687.752148] [] ? process_one_work+0x440/0x440 [55687.758905] [] kthread+0xd1/0xe0 [55687.764373] [] ? insert_kthread_work+0x40/0x40 [55687.771235] [] ret_from_fork_nospec_begin+0x21/0x21 [55687.778538] [] ? insert_kthread_work+0x40/0x40 [55687.785364] kdmwork-253:1 S ffff994d6ed9ac80 0 2027 2 0x00000000 [55687.793316] Call Trace: [55687.796082] [] schedule+0x29/0x70 [55687.801654] [] kthread_worker_fn+0xf7/0x180 [55687.808195] [] ? kthread_stop+0xf0/0xf0 [55687.814363] [] kthread+0xd1/0xe0 [55687.819845] [] ? insert_kthread_work+0x40/0x40 [55687.826663] [] ret_from_fork_nospec_begin+0x21/0x21 [55687.833993] [] ? insert_kthread_work+0x40/0x40 [55687.840836] kworker/9:1H S ffff995168368000 0 2030 2 0x00000000 [55687.848800] Call Trace: [55687.851542] [] ? process_one_work+0x21a/0x440 [55687.858298] [] schedule+0x29/0x70 [55687.863885] [] worker_thread+0x1d9/0x3c0 [55687.870144] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55687.877440] [] kthread+0xd1/0xe0 [55687.882938] [] ? insert_kthread_work+0x40/0x40 [55687.889756] [] ret_from_fork_nospec_begin+0x21/0x21 [55687.897080] [] ? insert_kthread_work+0x40/0x40 [55687.903917] kdmflush S ffff99516e25ac80 0 2031 2 0x00000000 [55687.911903] Call Trace: [55687.914646] [] schedule+0x29/0x70 [55687.920217] [] rescuer_thread+0x31e/0x3c0 [55687.926544] [] ? process_one_work+0x440/0x440 [55687.933292] [] kthread+0xd1/0xe0 [55687.938767] [] ? insert_kthread_work+0x40/0x40 [55687.945606] [] ret_from_fork_nospec_begin+0x21/0x21 [55687.952921] [] ? insert_kthread_work+0x40/0x40 [55687.959752] bioset S ffff99516e25ac80 0 2033 2 0x00000000 [55687.967708] Call Trace: [55687.970453] [] schedule+0x29/0x70 [55687.976039] [] rescuer_thread+0x31e/0x3c0 [55687.982394] [] ? process_one_work+0x440/0x440 [55687.989139] [] kthread+0xd1/0xe0 [55687.994599] [] ? insert_kthread_work+0x40/0x40 [55688.001423] [] ret_from_fork_nospec_begin+0x21/0x21 [55688.008750] [] ? insert_kthread_work+0x40/0x40 [55688.015562] kdmwork-253:2 S ffff994df99eb150 0 2034 2 0x00000000 [55688.023504] Call Trace: [55688.026285] [] schedule+0x29/0x70 [55688.031858] [] kthread_worker_fn+0xf7/0x180 [55688.038425] [] ? kthread_stop+0xf0/0xf0 [55688.044577] [] kthread+0xd1/0xe0 [55688.050068] [] ? insert_kthread_work+0x40/0x40 [55688.056913] [] ret_from_fork_nospec_begin+0x21/0x21 [55688.064228] [] ? insert_kthread_work+0x40/0x40 [55688.071067] kworker/8:1H S ffff994df99ec1c0 0 2036 2 0x00000000 [55688.079030] Call Trace: [55688.081769] [] ? process_one_work+0x21a/0x440 [55688.088475] [] schedule+0x29/0x70 [55688.094036] [] worker_thread+0x1d9/0x3c0 [55688.100286] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55688.107610] [] kthread+0xd1/0xe0 [55688.113092] [] ? insert_kthread_work+0x40/0x40 [55688.119938] [] ret_from_fork_nospec_begin+0x21/0x21 [55688.127246] [] ? insert_kthread_work+0x40/0x40 [55688.134088] kdmflush S ffff99516e2dac80 0 2037 2 0x00000000 [55688.142032] Call Trace: [55688.144769] [] schedule+0x29/0x70 [55688.150380] [] rescuer_thread+0x31e/0x3c0 [55688.156725] [] ? process_one_work+0x440/0x440 [55688.163443] [] kthread+0xd1/0xe0 [55688.168917] [] ? insert_kthread_work+0x40/0x40 [55688.175757] [] ret_from_fork_nospec_begin+0x21/0x21 [55688.183080] [] ? insert_kthread_work+0x40/0x40 [55688.189911] bioset S ffff99516e29ac80 0 2039 2 0x00000000 [55688.197887] Call Trace: [55688.200662] [] schedule+0x29/0x70 [55688.206250] [] rescuer_thread+0x31e/0x3c0 [55688.212601] [] ? process_one_work+0x440/0x440 [55688.219377] [] kthread+0xd1/0xe0 [55688.224879] [] ? insert_kthread_work+0x40/0x40 [55688.231690] [] ret_from_fork_nospec_begin+0x21/0x21 [55688.239021] [] ? insert_kthread_work+0x40/0x40 [55688.245864] kdmwork-253:3 S ffff99516e29ac80 0 2040 2 0x00000000 [55688.253847] Call Trace: [55688.256589] [] schedule+0x29/0x70 [55688.262160] [] kthread_worker_fn+0xf7/0x180 [55688.268680] [] ? kthread_stop+0xf0/0xf0 [55688.274804] [] kthread+0xd1/0xe0 [55688.280277] [] ? insert_kthread_work+0x40/0x40 [55688.287124] [] ret_from_fork_nospec_begin+0x21/0x21 [55688.294427] [] ? insert_kthread_work+0x40/0x40 [55688.301256] kdmflush S ffff99516e29ac80 0 2043 2 0x00000000 [55688.309240] Call Trace: [55688.312013] [] schedule+0x29/0x70 [55688.317591] [] rescuer_thread+0x31e/0x3c0 [55688.323953] [] ? process_one_work+0x440/0x440 [55688.330668] [] kthread+0xd1/0xe0 [55688.336142] [] ? insert_kthread_work+0x40/0x40 [55688.342972] [] ret_from_fork_nospec_begin+0x21/0x21 [55688.350320] [] ? insert_kthread_work+0x40/0x40 [55688.357164] bioset S ffff99516e4dac80 0 2044 2 0x00000000 [55688.365187] Call Trace: [55688.367956] [] schedule+0x29/0x70 [55688.373507] [] rescuer_thread+0x31e/0x3c0 [55688.379868] [] ? process_one_work+0x440/0x440 [55688.386602] [] kthread+0xd1/0xe0 [55688.392055] [] ? insert_kthread_work+0x40/0x40 [55688.398892] [] ret_from_fork_nospec_begin+0x21/0x21 [55688.406200] [] ? insert_kthread_work+0x40/0x40 [55688.413036] kdmwork-253:4 S ffff995168473150 0 2045 2 0x00000000 [55688.420980] Call Trace: [55688.423725] [] schedule+0x29/0x70 [55688.429325] [] kthread_worker_fn+0xf7/0x180 [55688.435864] [] ? kthread_stop+0xf0/0xf0 [55688.442015] [] kthread+0xd1/0xe0 [55688.447482] [] ? insert_kthread_work+0x40/0x40 [55688.454315] [] ret_from_fork_nospec_begin+0x21/0x21 [55688.461654] [] ? insert_kthread_work+0x40/0x40 [55688.468487] kworker/11:1H S ffff9951680de2a0 0 2048 2 0x00000000 [55688.476423] Call Trace: [55688.479189] [] ? process_one_work+0x21a/0x440 [55688.485944] [] schedule+0x29/0x70 [55688.491518] [] worker_thread+0x1d9/0x3c0 [55688.497784] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55688.505099] [] kthread+0xd1/0xe0 [55688.510561] [] ? insert_kthread_work+0x40/0x40 [55688.517395] [] ret_from_fork_nospec_begin+0x21/0x21 [55688.524706] [] ? insert_kthread_work+0x40/0x40 [55688.531525] kworker/15:1H S ffff9951680dc1c0 0 2050 2 0x00000000 [55688.539493] Call Trace: [55688.542261] [] ? process_one_work+0x21a/0x440 [55688.548990] [] schedule+0x29/0x70 [55688.554540] [] worker_thread+0x1d9/0x3c0 [55688.560759] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55688.568101] [] kthread+0xd1/0xe0 [55688.573557] [] ? insert_kthread_work+0x40/0x40 [55688.580407] [] ret_from_fork_nospec_begin+0x21/0x21 [55688.587711] [] ? insert_kthread_work+0x40/0x40 [55688.594522] kworker/30:1H S ffff9951680d9070 0 2052 2 0x00000000 [55688.602437] Call Trace: [55688.605198] [] ? process_one_work+0x21a/0x440 [55688.611932] [] schedule+0x29/0x70 [55688.617491] [] worker_thread+0x1d9/0x3c0 [55688.623728] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55688.631064] [] kthread+0xd1/0xe0 [55688.636519] [] ? insert_kthread_work+0x40/0x40 [55688.643352] [] ret_from_fork_nospec_begin+0x21/0x21 [55688.650665] [] ? insert_kthread_work+0x40/0x40 [55688.657474] kworker/28:1H S ffff9951675a0000 0 2053 2 0x00000000 [55688.665409] Call Trace: [55688.668164] [] ? process_one_work+0x21a/0x440 [55688.674896] [] schedule+0x29/0x70 [55688.680449] [] worker_thread+0x1d9/0x3c0 [55688.686686] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55688.694016] [] kthread+0xd1/0xe0 [55688.699470] [] ? insert_kthread_work+0x40/0x40 [55688.706302] [] ret_from_fork_nospec_begin+0x21/0x21 [55688.713611] [] ? insert_kthread_work+0x40/0x40 [55688.720419] kworker/27:1H S ffff9951675a1070 0 2057 2 0x00000000 [55688.728354] Call Trace: [55688.731122] [] ? process_one_work+0x21a/0x440 [55688.737863] [] schedule+0x29/0x70 [55688.743422] [] worker_thread+0x1d9/0x3c0 [55688.749652] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55688.756974] [] kthread+0xd1/0xe0 [55688.762444] [] ? insert_kthread_work+0x40/0x40 [55688.769293] [] ret_from_fork_nospec_begin+0x21/0x21 [55688.776596] [] ? insert_kthread_work+0x40/0x40 [55688.783414] kworker/13:1H S ffff9951675a3150 0 2071 2 0x00000000 [55688.791365] Call Trace: [55688.794125] [] ? process_one_work+0x21a/0x440 [55688.800858] [] schedule+0x29/0x70 [55688.806415] [] worker_thread+0x1d9/0x3c0 [55688.812659] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55688.819982] [] kthread+0xd1/0xe0 [55688.825446] [] ? insert_kthread_work+0x40/0x40 [55688.832300] [] ret_from_fork_nospec_begin+0x21/0x21 [55688.839603] [] ? insert_kthread_work+0x40/0x40 [55688.846413] kworker/25:1H S ffff995168471070 0 2075 2 0x00000000 [55688.854365] Call Trace: [55688.857132] [] ? process_one_work+0x21a/0x440 [55688.863864] [] schedule+0x29/0x70 [55688.869423] [] worker_thread+0x1d9/0x3c0 [55688.875659] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55688.882975] [] kthread+0xd1/0xe0 [55688.888431] [] ? insert_kthread_work+0x40/0x40 [55688.895313] [] ret_from_fork_nospec_begin+0x21/0x21 [55688.902615] [] ? insert_kthread_work+0x40/0x40 [55688.909433] spl_system_task S ffff994d6ec5ac80 0 2085 2 0x00000000 [55688.917369] Call Trace: [55688.920142] [] ? task_rq_unlock+0x20/0x20 [55688.926468] [] schedule+0x29/0x70 [55688.932059] [] taskq_thread+0x4a2/0x4f0 [spl] [55688.938793] [] ? wake_up_state+0x20/0x20 [55688.945048] [] ? taskq_thread_spawn+0x60/0x60 [spl] [55688.952389] [] kthread+0xd1/0xe0 [55688.957879] [] ? insert_kthread_work+0x40/0x40 [55688.964719] [] ret_from_fork_nospec_begin+0x21/0x21 [55688.972036] [] ? insert_kthread_work+0x40/0x40 [55688.978881] spl_delay_taskq S ffff994d6ec9ac80 0 2086 2 0x00000000 [55688.986835] Call Trace: [55688.989575] [] ? task_rq_unlock+0x20/0x20 [55688.995923] [] schedule+0x29/0x70 [55689.001492] [] taskq_thread+0x4a2/0x4f0 [spl] [55689.008227] [] ? wake_up_state+0x20/0x20 [55689.014469] [] ? taskq_thread_spawn+0x60/0x60 [spl] [55689.021794] [] kthread+0xd1/0xe0 [55689.027299] [] ? insert_kthread_work+0x40/0x40 [55689.034132] [] ret_from_fork_nospec_begin+0x21/0x21 [55689.041430] [] ? insert_kthread_work+0x40/0x40 [55689.048305] spl_dynamic_tas S ffff994d6ec9ac80 0 2087 2 0x00000000 [55689.056275] Call Trace: [55689.059034] [] ? task_rq_unlock+0x20/0x20 [55689.065369] [] schedule+0x29/0x70 [55689.070945] [] taskq_thread+0x4a2/0x4f0 [spl] [55689.077682] [] ? wake_up_state+0x20/0x20 [55689.083950] [] ? taskq_thread_spawn+0x60/0x60 [spl] [55689.091286] [] kthread+0xd1/0xe0 [55689.096755] [] ? insert_kthread_work+0x40/0x40 [55689.103566] [] ret_from_fork_nospec_begin+0x21/0x21 [55689.110887] [] ? insert_kthread_work+0x40/0x40 [55689.117726] spl_kmem_cache S ffff994d6ec9ac80 0 2088 2 0x00000000 [55689.125712] Call Trace: [55689.128451] [] ? task_rq_unlock+0x20/0x20 [55689.134803] [] schedule+0x29/0x70 [55689.140363] [] taskq_thread+0x4a2/0x4f0 [spl] [55689.147119] [] ? wake_up_state+0x20/0x20 [55689.153363] [] ? __spl_cache_grow+0x2c0/0x2c0 [spl] [55689.160664] [] ? taskq_thread_spawn+0x60/0x60 [spl] [55689.168003] [] kthread+0xd1/0xe0 [55689.173458] [] ? insert_kthread_work+0x40/0x40 [55689.180315] [] ret_from_fork_nospec_begin+0x21/0x21 [55689.187622] [] ? insert_kthread_work+0x40/0x40 [55689.194439] zvol S ffff99516e4dac80 0 2154 2 0x00000000 [55689.202362] Call Trace: [55689.205130] [] ? task_rq_unlock+0x20/0x20 [55689.211463] [] schedule+0x29/0x70 [55689.217054] [] taskq_thread+0x4a2/0x4f0 [spl] [55689.223788] [] ? wake_up_state+0x20/0x20 [55689.230042] [] ? taskq_thread_spawn+0x60/0x60 [spl] [55689.237375] [] kthread+0xd1/0xe0 [55689.242871] [] ? insert_kthread_work+0x40/0x40 [55689.249714] [] ret_from_fork_nospec_begin+0x21/0x21 [55689.257031] [] ? insert_kthread_work+0x40/0x40 [55689.263874] arc_prune S ffff994d6ec5ac80 0 2155 2 0x00000000 [55689.271805] Call Trace: [55689.274544] [] ? task_rq_unlock+0x20/0x20 [55689.280891] [] schedule+0x29/0x70 [55689.286458] [] taskq_thread+0x4a2/0x4f0 [spl] [55689.293193] [] ? wake_up_state+0x20/0x20 [55689.299435] [] ? taskq_thread_spawn+0x60/0x60 [spl] [55689.306766] [] kthread+0xd1/0xe0 [55689.312268] [] ? insert_kthread_work+0x40/0x40 [55689.319103] [] ret_from_fork_nospec_begin+0x21/0x21 [55689.326403] [] ? insert_kthread_work+0x40/0x40 [55689.333250] zthr_procedure S ffff994d6ec5ac80 0 2156 2 0x00000000 [55689.341217] Call Trace: [55689.343984] [] schedule+0x29/0x70 [55689.349577] [] cv_wait_common+0x125/0x150 [spl] [55689.356491] [] ? wake_up_atomic_t+0x30/0x30 [55689.363036] [] __cv_wait_sig+0x15/0x40 [spl] [55689.369772] [] zthr_procedure+0x7f/0x140 [zfs] [55689.376662] [] ? zrl_is_locked+0x20/0x20 [zfs] [55689.383530] [] thread_generic_wrapper+0x73/0x80 [spl] [55689.391062] [] ? __thread_exit+0x20/0x20 [spl] [55689.397916] [] kthread+0xd1/0xe0 [55689.403393] [] ? insert_kthread_work+0x40/0x40 [55689.410213] [] ret_from_fork_nospec_begin+0x21/0x21 [55689.417512] [] ? insert_kthread_work+0x40/0x40 [55689.424361] zthr_procedure S ffff99516ae4b150 0 2157 2 0x00000000 [55689.432324] Call Trace: [55689.435076] [] schedule+0x29/0x70 [55689.440633] [] schedule_hrtimeout_range_clock+0xb2/0x150 [55689.448456] [] ? hrtimer_get_res+0x50/0x50 [55689.454922] [] ? schedule_hrtimeout_range_clock+0xa6/0x150 [55689.462938] [] schedule_hrtimeout_range+0x13/0x20 [55689.470086] [] __cv_timedwait_hires+0x123/0x210 [spl] [55689.477579] [] ? wake_up_atomic_t+0x30/0x30 [55689.484133] [] cv_timedwait_sig_hires+0x67/0x90 [spl] [55689.491695] [] zthr_procedure+0xeb/0x140 [zfs] [55689.498590] [] ? zrl_is_locked+0x20/0x20 [zfs] [55689.505443] [] thread_generic_wrapper+0x73/0x80 [spl] [55689.512957] [] ? __thread_exit+0x20/0x20 [spl] [55689.519804] [] kthread+0xd1/0xe0 [55689.525272] [] ? insert_kthread_work+0x40/0x40 [55689.532117] [] ret_from_fork_nospec_begin+0x21/0x21 [55689.539419] [] ? insert_kthread_work+0x40/0x40 [55689.546243] dbu_evict S ffff994d6ec5ac80 0 2158 2 0x00000000 [55689.554220] Call Trace: [55689.556995] [] ? task_rq_unlock+0x20/0x20 [55689.563322] [] schedule+0x29/0x70 [55689.568931] [] taskq_thread+0x4a2/0x4f0 [spl] [55689.575648] [] ? wake_up_state+0x20/0x20 [55689.581903] [] ? taskq_thread_spawn+0x60/0x60 [spl] [55689.589253] [] kthread+0xd1/0xe0 [55689.594735] [] ? insert_kthread_work+0x40/0x40 [55689.601576] [] ret_from_fork_nospec_begin+0x21/0x21 [55689.608907] [] ? insert_kthread_work+0x40/0x40 [55689.615743] dbuf_evict S ffff995167039070 0 2159 2 0x00000000 [55689.623695] Call Trace: [55689.626436] [] schedule+0x29/0x70 [55689.632023] [] schedule_hrtimeout_range_clock+0xb2/0x150 [55689.639849] [] ? hrtimer_get_res+0x50/0x50 [55689.646326] [] ? schedule_hrtimeout_range_clock+0xa6/0x150 [55689.654308] [] schedule_hrtimeout_range+0x13/0x20 [55689.661446] [] __cv_timedwait_hires+0x123/0x210 [spl] [55689.668959] [] ? wake_up_atomic_t+0x30/0x30 [55689.675488] [] cv_timedwait_sig_hires+0x67/0x90 [spl] [55689.683060] [] dbuf_evict_thread+0x82/0x1e0 [zfs] [55689.690239] [] ? dbuf_sync_indirect+0x1b0/0x1b0 [zfs] [55689.697794] [] thread_generic_wrapper+0x73/0x80 [spl] [55689.705302] [] ? __thread_exit+0x20/0x20 [spl] [55689.712150] [] kthread+0xd1/0xe0 [55689.717620] [] ? insert_kthread_work+0x40/0x40 [55689.724461] [] ret_from_fork_nospec_begin+0x21/0x21 [55689.731776] [] ? insert_kthread_work+0x40/0x40 [55689.738592] z_vdev_file S ffff994d6ec5ac80 0 2175 2 0x00000000 [55689.746536] Call Trace: [55689.749282] [] ? task_rq_unlock+0x20/0x20 [55689.755621] [] schedule+0x29/0x70 [55689.761206] [] taskq_thread+0x4a2/0x4f0 [spl] [55689.767951] [] ? wake_up_state+0x20/0x20 [55689.774226] [] ? taskq_thread_spawn+0x60/0x60 [spl] [55689.781558] [] kthread+0xd1/0xe0 [55689.787039] [] ? insert_kthread_work+0x40/0x40 [55689.793893] [] ret_from_fork_nospec_begin+0x21/0x21 [55689.801203] [] ? insert_kthread_work+0x40/0x40 [55689.808058] l2arc_feed S ffff99516703c1c0 0 2176 2 0x00000000 [55689.816033] Call Trace: [55689.818785] [] schedule+0x29/0x70 [55689.824341] [] schedule_timeout+0x168/0x2d0 [55689.830881] [] ? __internal_add_timer+0x130/0x130 [55689.838019] [] __cv_timedwait_common+0xd2/0x190 [spl] [55689.845516] [] ? wake_up_atomic_t+0x30/0x30 [55689.852103] [] ? l2arc_evict+0x2c0/0x2c0 [zfs] [55689.858957] [] __cv_timedwait_sig+0x16/0x20 [spl] [55689.866141] [] l2arc_feed_thread+0x6f/0x460 [zfs] [55689.873255] [] ? kfree+0x106/0x140 [55689.878953] [] ? l2arc_evict+0x2c0/0x2c0 [zfs] [55689.885817] [] thread_generic_wrapper+0x73/0x80 [spl] [55689.893359] [] ? __thread_exit+0x20/0x20 [spl] [55689.900194] [] kthread+0xd1/0xe0 [55689.905700] [] ? insert_kthread_work+0x40/0x40 [55689.912546] [] ret_from_fork_nospec_begin+0x21/0x21 [55689.919877] [] ? insert_kthread_work+0x40/0x40 [55689.926677] kworker/2:3 S ffff994975e6e2a0 0 2178 2 0x00000000 [55689.934639] Call Trace: [55689.937406] [] ? process_one_work+0x21a/0x440 [55689.944163] [] schedule+0x29/0x70 [55689.949757] [] worker_thread+0x1d9/0x3c0 [55689.956008] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55689.963347] [] kthread+0xd1/0xe0 [55689.968842] [] ? insert_kthread_work+0x40/0x40 [55689.975688] [] ret_from_fork_nospec_begin+0x21/0x21 [55689.983025] [] ? insert_kthread_work+0x40/0x40 [55689.989864] kworker/31:1H S ffff99516703e2a0 0 2181 2 0x00000000 [55689.997862] Call Trace: [55690.000630] [] ? process_one_work+0x21a/0x440 [55690.007380] [] schedule+0x29/0x70 [55690.012959] [] worker_thread+0x1d9/0x3c0 [55690.019242] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55690.026566] [] kthread+0xd1/0xe0 [55690.032049] [] ? insert_kthread_work+0x40/0x40 [55690.038903] [] ret_from_fork_nospec_begin+0x21/0x21 [55690.046258] [] ? insert_kthread_work+0x40/0x40 [55690.053103] kworker/10:1H S ffff99516c0ca0e0 0 2189 2 0x00000000 [55690.061088] Call Trace: [55690.063863] [] ? process_one_work+0x21a/0x440 [55690.070612] [] schedule+0x29/0x70 [55690.076185] [] worker_thread+0x1d9/0x3c0 [55690.082457] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55690.089780] [] kthread+0xd1/0xe0 [55690.095275] [] ? insert_kthread_work+0x40/0x40 [55690.102136] [] ret_from_fork_nospec_begin+0x21/0x21 [55690.109468] [] ? insert_kthread_work+0x40/0x40 [55690.116318] auditd S ffff994975dde2a0 0 2223 1 0x00000000 [55690.124303] Call Trace: [55690.127075] [] schedule+0x29/0x70 [55690.132646] [] schedule_hrtimeout_range_clock+0xb2/0x150 [55690.140457] [] ? hrtimer_get_res+0x50/0x50 [55690.146908] [] ? schedule_hrtimeout_range_clock+0xa6/0x150 [55690.154923] [] schedule_hrtimeout_range+0x13/0x20 [55690.162069] [] ep_poll+0x23e/0x360 [55690.167748] [] ? wake_up_state+0x20/0x20 [55690.174021] [] SyS_epoll_wait+0xed/0x120 [55690.180299] [] ? system_call_after_swapgs+0xa2/0x146 [55690.187735] [] system_call_fastpath+0x25/0x2a [55690.194486] [] ? system_call_after_swapgs+0xae/0x146 [55690.201914] auditd S ffff9951675a5230 0 2224 1 0x00000000 [55690.209888] Call Trace: [55690.212642] [] schedule+0x29/0x70 [55690.218226] [] futex_wait_queue_me+0xc6/0x130 [55690.224983] [] futex_wait+0x17b/0x280 [55690.230964] [] ? __schedule+0x402/0x840 [55690.237133] [] do_futex+0x106/0x5a0 [55690.242930] [] ? jbd2_complete_transaction+0x52/0xa0 [jbd2] [55690.251017] [] SyS_futex+0x80/0x190 [55690.256805] [] ? system_call_after_swapgs+0xa2/0x146 [55690.264268] [] ? system_call_after_swapgs+0xae/0x146 [55690.271696] [] ? system_call_after_swapgs+0xa2/0x146 [55690.279124] [] ? system_call_after_swapgs+0xae/0x146 [55690.286553] [] ? system_call_after_swapgs+0xa2/0x146 [55690.293980] [] ? system_call_after_swapgs+0xae/0x146 [55690.301410] [] system_call_fastpath+0x25/0x2a [55690.308161] [] ? system_call_after_swapgs+0xae/0x146 [55690.315588] polkitd S ffff9951693641c0 0 2252 1 0x00000080 [55690.323568] Call Trace: [55690.326328] [] schedule+0x29/0x70 [55690.331908] [] schedule_hrtimeout_range_clock+0x12d/0x150 [55690.339829] [] ? add_wait_queue+0x3c/0x50 [55690.346206] [] schedule_hrtimeout_range+0x13/0x20 [55690.353343] [] poll_schedule_timeout+0x55/0xc0 [55690.360209] [] do_sys_poll+0x48d/0x590 [55690.366279] [] ? put_prev_entity+0x31/0x400 [55690.372834] [] ? __switch_to+0x151/0x580 [55690.379097] [] ? __enqueue_entity+0x78/0x80 [55690.385653] [] ? __pollwait+0xf0/0xf0 [55690.391627] [] ? __pollwait+0xf0/0xf0 [55690.397601] [] ? ttwu_do_activate+0x6f/0x80 [55690.404151] [] ? try_to_wake_up+0x190/0x390 [55690.410693] [] ? inotify_free_event+0xe/0x10 [55690.417344] [] ? kfree+0x106/0x140 [55690.423028] [] ? list_del+0xd/0x30 [55690.428703] [] ? remove_wait_queue+0x31/0x40 [55690.435352] [] ? eventfd_ctx_read+0x67/0x1e0 [55690.442006] [] ? system_call_after_swapgs+0xae/0x146 [55690.449435] [] SyS_poll+0x74/0x110 [55690.455111] [] ? system_call_after_swapgs+0xa2/0x146 [55690.462530] [] ? system_call_after_swapgs+0xae/0x146 [55690.469948] [] system_call_fastpath+0x25/0x2a [55690.476692] [] ? system_call_after_swapgs+0xae/0x146 [55690.484116] gmain S ffff994d6ec5ac80 0 2281 1 0x00000080 [55690.492102] Call Trace: [55690.494858] [] schedule+0x29/0x70 [55690.500437] [] schedule_hrtimeout_range_clock+0x12d/0x150 [55690.508337] [] ? add_wait_queue+0x3c/0x50 [55690.514690] [] schedule_hrtimeout_range+0x13/0x20 [55690.521820] [] poll_schedule_timeout+0x55/0xc0 [55690.528665] [] do_sys_poll+0x48d/0x590 [55690.534737] [] ? radix_tree_lookup_slot+0x22/0x50 [55690.541879] [] ? __find_get_page+0x1e/0xa0 [55690.548331] [] ? filemap_fault+0x17e/0x490 [55690.554815] [] ? ext4_filemap_fault+0x41/0x50 [ext4] [55690.562210] [] ? __pollwait+0xf0/0xf0 [55690.568198] [] ? __pollwait+0xf0/0xf0 [55690.574174] [] ? handle_pte_fault+0x22a/0xe20 [55690.580916] [] ? alloc_pages_current+0x98/0x110 [55690.587855] [] ? eventfd_ctx_read+0x67/0x1e0 [55690.594514] [] ? system_call_after_swapgs+0xae/0x146 [55690.601942] [] SyS_poll+0x74/0x110 [55690.607616] [] ? system_call_after_swapgs+0xa2/0x146 [55690.615051] [] ? system_call_after_swapgs+0xae/0x146 [55690.622473] [] system_call_fastpath+0x25/0x2a [55690.629235] [] ? system_call_after_swapgs+0xae/0x146 [55690.636647] gdbus S ffff99516716d230 0 2288 1 0x00000080 [55690.644628] Call Trace: [55690.647391] [] ? __kmalloc_reserve.isra.32+0x31/0x90 [55690.654827] [] schedule+0x29/0x70 [55690.660407] [] schedule_hrtimeout_range_clock+0x12d/0x150 [55690.668286] [] ? add_wait_queue+0x3c/0x50 [55690.674640] [] ? add_wait_queue+0x3c/0x50 [55690.680985] [] schedule_hrtimeout_range+0x13/0x20 [55690.688122] [] poll_schedule_timeout+0x55/0xc0 [55690.694968] [] do_sys_poll+0x48d/0x590 [55690.701028] [] ? sock_sendmsg+0xb6/0xf0 [55690.707193] [] ? sock_recvmsg+0xc5/0x100 [55690.713429] [] ? __enqueue_entity+0x78/0x80 [55690.719967] [] ? __pollwait+0xf0/0xf0 [55690.725912] [] ? __pollwait+0xf0/0xf0 [55690.731871] [] ? ___sys_sendmsg+0x3e9/0x400 [55690.738395] [] ? default_wake_function+0x12/0x20 [55690.745427] [] ? pollwake+0x73/0x90 [55690.751187] [] ? wake_up_state+0x20/0x20 [55690.757420] [] ? __wake_up_common+0x82/0x120 [55690.764044] [] ? eventfd_ctx_read+0x67/0x1e0 [55690.770687] [] ? system_call_after_swapgs+0xae/0x146 [55690.778102] [] SyS_poll+0x74/0x110 [55690.783783] [] ? system_call_after_swapgs+0xa2/0x146 [55690.791195] [] ? system_call_after_swapgs+0xae/0x146 [55690.798623] [] system_call_fastpath+0x25/0x2a [55690.805364] [] ? system_call_after_swapgs+0xae/0x146 [55690.812775] polkitd S ffff99516e45ac80 0 2289 1 0x00000080 [55690.820735] Call Trace: [55690.823493] [] schedule+0x29/0x70 [55690.829066] [] schedule_hrtimeout_range_clock+0x12d/0x150 [55690.836966] [] ? add_wait_queue+0x3c/0x50 [55690.843305] [] schedule_hrtimeout_range+0x13/0x20 [55690.850441] [] poll_schedule_timeout+0x55/0xc0 [55690.857259] [] do_sys_poll+0x48d/0x590 [55690.863311] [] ? __alloc_pages_nodemask+0x184/0xbe0 [55690.870642] [] ? __alloc_pages_nodemask+0x184/0xbe0 [55690.877981] [] ? __pollwait+0xf0/0xf0 [55690.883947] [] ? sched_clock+0x9/0x10 [55690.889913] [] ? sched_clock_cpu+0x85/0xc0 [55690.896341] [] ? try_to_wake_up+0x190/0x390 [55690.902879] [] ? wake_up_q+0x5b/0x80 [55690.908742] [] ? futex_wake+0x90/0x180 [55690.914806] [] ? eventfd_ctx_read+0x67/0x1e0 [55690.921436] [] ? system_call_after_swapgs+0xae/0x146 [55690.928850] [] SyS_poll+0x74/0x110 [55690.934517] [] ? system_call_after_swapgs+0xa2/0x146 [55690.941935] [] ? system_call_after_swapgs+0xae/0x146 [55690.949359] [] system_call_fastpath+0x25/0x2a [55690.956093] [] ? system_call_after_swapgs+0xae/0x146 [55690.963488] JS GC Helper S ffff99516e45ac80 0 2290 1 0x00000080 [55690.971419] Call Trace: [55690.974181] [] schedule+0x29/0x70 [55690.979776] [] futex_wait_queue_me+0xc6/0x130 [55690.986491] [] futex_wait+0x17b/0x280 [55690.992430] [] ? handle_pte_fault+0x22a/0xe20 [55690.999157] [] ? sched_clock_cpu+0x85/0xc0 [55691.005610] [] ? try_to_wake_up+0x190/0x390 [55691.012183] [] do_futex+0x106/0x5a0 [55691.017939] [] SyS_futex+0x80/0x190 [55691.023726] [] ? system_call_after_swapgs+0xa2/0x146 [55691.031164] [] ? system_call_after_swapgs+0xae/0x146 [55691.038598] [] ? system_call_after_swapgs+0xa2/0x146 [55691.046028] [] ? system_call_after_swapgs+0xae/0x146 [55691.053422] [] ? system_call_after_swapgs+0xa2/0x146 [55691.060849] [] ? system_call_after_swapgs+0xae/0x146 [55691.068246] [] system_call_fastpath+0x25/0x2a [55691.074989] [] ? system_call_after_swapgs+0xae/0x146 [55691.082386] JS Sour~ Thread S ffff99516e45ac80 0 2291 1 0x00000080 [55691.090339] Call Trace: [55691.093108] [] schedule+0x29/0x70 [55691.098703] [] futex_wait_queue_me+0xc6/0x130 [55691.105440] [] futex_wait+0x17b/0x280 [55691.111420] [] ? page_add_new_anon_rmap+0xb8/0x170 [55691.118639] [] ? handle_pte_fault+0x6b4/0xe20 [55691.125352] [] ? get_futex_key+0x1c8/0x2c0 [55691.131811] [] do_futex+0x106/0x5a0 [55691.137579] [] ? cap_task_prctl+0x288/0x390 [55691.144154] [] ? yama_task_prctl+0x24/0x110 [55691.150715] [] ? cap_task_prctl+0x288/0x390 [55691.157236] [] ? strlcpy+0x42/0x60 [55691.162928] [] SyS_futex+0x80/0x190 [55691.168716] [] ? system_call_after_swapgs+0xa2/0x146 [55691.176130] [] ? system_call_after_swapgs+0xae/0x146 [55691.183559] [] ? system_call_after_swapgs+0xa2/0x146 [55691.190963] [] ? system_call_after_swapgs+0xae/0x146 [55691.198382] [] ? system_call_after_swapgs+0xa2/0x146 [55691.205781] [] ? system_call_after_swapgs+0xae/0x146 [55691.213216] [] system_call_fastpath+0x25/0x2a [55691.219957] [] ? system_call_after_swapgs+0xae/0x146 [55691.227351] polkitd S ffff99516e45ac80 0 2292 1 0x00000080 [55691.235273] Call Trace: [55691.238042] [] schedule+0x29/0x70 [55691.243620] [] schedule_hrtimeout_range_clock+0x12d/0x150 [55691.251513] [] ? add_wait_queue+0x3c/0x50 [55691.257871] [] schedule_hrtimeout_range+0x13/0x20 [55691.265014] [] poll_schedule_timeout+0x55/0xc0 [55691.271844] [] do_sys_poll+0x48d/0x590 [55691.277901] [] ? __alloc_pages_nodemask+0x184/0xbe0 [55691.285250] [] ? __alloc_pages_nodemask+0x184/0xbe0 [55691.292548] [] ? __pollwait+0xf0/0xf0 [55691.298485] [] ? sched_clock+0x9/0x10 [55691.304425] [] ? sched_clock_cpu+0x85/0xc0 [55691.310869] [] ? try_to_wake_up+0x190/0x390 [55691.317389] [] ? wake_up_q+0x5b/0x80 [55691.323231] [] ? futex_wake+0x90/0x180 [55691.329268] [] ? eventfd_ctx_read+0x67/0x1e0 [55691.335918] [] ? system_call_after_swapgs+0xae/0x146 [55691.343310] [] SyS_poll+0x74/0x110 [55691.348977] [] ? system_call_after_swapgs+0xa2/0x146 [55691.356372] [] ? system_call_after_swapgs+0xae/0x146 [55691.363807] [] system_call_fastpath+0x25/0x2a [55691.370521] [] ? system_call_after_swapgs+0xae/0x146 [55691.377955] sssd S ffff9951693662a0 0 2253 1 0x00000080 [55691.385922] Call Trace: [55691.388673] [] ? hrtimer_start_range_ns+0x1fd/0x3c0 [55691.395995] [] schedule+0x29/0x70 [55691.401557] [] schedule_hrtimeout_range_clock+0xb2/0x150 [55691.409338] [] ? hrtimer_get_res+0x50/0x50 [55691.415781] [] ? schedule_hrtimeout_range_clock+0xa6/0x150 [55691.423790] [] schedule_hrtimeout_range+0x13/0x20 [55691.430911] [] poll_schedule_timeout+0x55/0xc0 [55691.437748] [] do_sys_poll+0x48d/0x590 [55691.443818] [] ? sock_recvmsg+0xc5/0x100 [55691.450067] [] ? __pollwait+0xf0/0xf0 [55691.456033] [] ? __pollwait+0xf0/0xf0 [55691.462004] [] ? __pollwait+0xf0/0xf0 [55691.467963] [] ? __pollwait+0xf0/0xf0 [55691.473942] [] ? __pollwait+0xf0/0xf0 [55691.479920] [] ? __pollwait+0xf0/0xf0 [55691.485882] [] ? __pollwait+0xf0/0xf0 [55691.491846] [] ? __pollwait+0xf0/0xf0 [55691.497794] [] ? __pollwait+0xf0/0xf0 [55691.503757] [] SyS_poll+0x74/0x110 [55691.509411] [] system_call_fastpath+0x25/0x2a [55691.516169] [] ? system_call_after_swapgs+0xae/0x146 [55691.523593] irqbalance S ffff9949758962a0 0 2256 1 0x00000080 [55691.531528] Call Trace: [55691.534294] [] ? hrtimer_start_range_ns+0x1fd/0x3c0 [55691.541610] [] schedule+0x29/0x70 [55691.547190] [] do_nanosleep+0x70/0x100 [55691.553231] [] hrtimer_nanosleep+0xbb/0x180 [55691.559772] [] ? hrtimer_get_res+0x50/0x50 [55691.566194] [] ? do_nanosleep+0x5b/0x100 [55691.572423] [] SyS_nanosleep+0x96/0xb0 [55691.578461] [] system_call_fastpath+0x25/0x2a [55691.585223] [] ? system_call_after_swapgs+0xae/0x146 [55691.592633] dbus-daemon S ffff994975895230 0 2259 1 0x00000080 [55691.600606] Call Trace: [55691.603366] [] schedule+0x29/0x70 [55691.608945] [] schedule_hrtimeout_range_clock+0x12d/0x150 [55691.616845] [] ? ep_scan_ready_list.isra.7+0x1b9/0x1f0 [55691.624460] [] schedule_hrtimeout_range+0x13/0x20 [55691.631580] [] ep_poll+0x23e/0x360 [55691.637227] [] ? wake_up_state+0x20/0x20 [55691.643464] [] SyS_epoll_wait+0xed/0x120 [55691.649714] [] ? system_call_after_swapgs+0xa2/0x146 [55691.657153] [] system_call_fastpath+0x25/0x2a [55691.663916] [] ? system_call_after_swapgs+0xae/0x146 [55691.671309] rpcbind S ffff9949759de2a0 0 2280 1 0x00000080 [55691.679219] Call Trace: [55691.681980] [] ? hrtimer_start_range_ns+0x1fd/0x3c0 [55691.689277] [] schedule+0x29/0x70 [55691.694847] [] schedule_hrtimeout_range_clock+0xb2/0x150 [55691.702669] [] ? hrtimer_get_res+0x50/0x50 [55691.709150] [] ? schedule_hrtimeout_range_clock+0xa6/0x150 [55691.717176] [] schedule_hrtimeout_range+0x13/0x20 [55691.724283] [] poll_schedule_timeout+0x55/0xc0 [55691.731119] [] do_sys_poll+0x48d/0x590 [55691.737168] [] ? task_rq_unlock+0x20/0x20 [55691.743503] [] ? __wake_up_sync_key+0x1d/0x20 [55691.750246] [] ? __pollwait+0xf0/0xf0 [55691.756219] [] ? __pollwait+0xf0/0xf0 [55691.762191] [] ? __pollwait+0xf0/0xf0 [55691.768188] [] ? __pollwait+0xf0/0xf0 [55691.774167] [] ? __pollwait+0xf0/0xf0 [55691.780137] [] ? __pollwait+0xf0/0xf0 [55691.786116] [] ? __pollwait+0xf0/0xf0 [55691.792119] [] ? ktime_get_ts64+0x52/0xf0 [55691.798453] [] SyS_poll+0x74/0x110 [55691.804164] [] system_call_fastpath+0x25/0x2a [55691.810914] [] ? system_call_after_swapgs+0xae/0x146 [55691.818314] NetworkManager S ffff994d6b233150 0 2283 1 0x00000080 [55691.826222] Call Trace: [55691.828983] [] ? hrtimer_start_range_ns+0x1fd/0x3c0 [55691.836279] [] schedule+0x29/0x70 [55691.841871] [] schedule_hrtimeout_range_clock+0xb2/0x150 [55691.849686] [] ? hrtimer_get_res+0x50/0x50 [55691.856140] [] ? schedule_hrtimeout_range_clock+0xa6/0x150 [55691.864144] [] schedule_hrtimeout_range+0x13/0x20 [55691.871258] [] poll_schedule_timeout+0x55/0xc0 [55691.878101] [] do_sys_poll+0x48d/0x590 [55691.884136] [] ? put_prev_entity+0x31/0x400 [55691.890709] [] ? __switch_to+0x151/0x580 [55691.896981] [] ? __schedule+0x402/0x840 [55691.903155] [] ? __pollwait+0xf0/0xf0 [55691.909143] [] ? __pollwait+0xf0/0xf0 [55691.915104] [] ? __pollwait+0xf0/0xf0 [55691.921084] [] ? __pollwait+0xf0/0xf0 [55691.927034] [] ? __pollwait+0xf0/0xf0 [55691.933000] [] ? __pollwait+0xf0/0xf0 [55691.938964] [] ? __pollwait+0xf0/0xf0 [55691.944945] [] ? __pollwait+0xf0/0xf0 [55691.950912] [] ? ktime_get_ts64+0x52/0xf0 [55691.957259] [] SyS_poll+0x74/0x110 [55691.962941] [] system_call_fastpath+0x25/0x2a [55691.969690] [] ? system_call_after_swapgs+0xae/0x146 [55691.977087] gmain S ffff994d68841070 0 2381 1 0x00000080 [55691.985056] Call Trace: [55691.987840] [] ? hrtimer_start_range_ns+0x1fd/0x3c0 [55691.995136] [] schedule+0x29/0x70 [55692.000717] [] schedule_hrtimeout_range_clock+0xb2/0x150 [55692.008538] [] ? hrtimer_get_res+0x50/0x50 [55692.014960] [] ? schedule_hrtimeout_range_clock+0xa6/0x150 [55692.022976] [] schedule_hrtimeout_range+0x13/0x20 [55692.030121] [] poll_schedule_timeout+0x55/0xc0 [55692.036942] [] do_sys_poll+0x48d/0x590 [55692.043000] [] ? security_inode_permission+0x22/0x30 [55692.050428] [] ? __inode_permission+0x52/0xd0 [55692.057159] [] ? __pollwait+0xf0/0xf0 [55692.063118] [] ? __pollwait+0xf0/0xf0 [55692.069105] [] ? path_lookupat+0x1ea/0x8b0 [55692.075542] [] ? kmem_cache_alloc+0x35/0x1f0 [55692.082163] [] ? getname_flags+0x4f/0x1a0 [55692.088517] [] ? putname+0x3d/0x60 [55692.094171] [] ? user_path_at_empty+0x72/0xc0 [55692.100920] [] ? ktime_get_ts64+0x52/0xf0 [55692.107274] [] SyS_poll+0x74/0x110 [55692.112957] [] system_call_fastpath+0x25/0x2a [55692.119713] [] ? system_call_after_swapgs+0xae/0x146 [55692.127112] gdbus S ffff994d688441c0 0 2383 1 0x00000080 [55692.135097] Call Trace: [55692.137865] [] ? kmem_cache_free+0x1e2/0x200 [55692.144480] [] schedule+0x29/0x70 [55692.150085] [] schedule_hrtimeout_range_clock+0x12d/0x150 [55692.157983] [] ? add_wait_queue+0x3c/0x50 [55692.164336] [] ? __pollwait+0x7f/0xf0 [55692.170310] [] ? add_wait_queue+0x3c/0x50 [55692.176667] [] schedule_hrtimeout_range+0x13/0x20 [55692.183787] [] poll_schedule_timeout+0x55/0xc0 [55692.190626] [] do_sys_poll+0x48d/0x590 [55692.196694] [] ? unix_stream_recvmsg+0x54/0x70 [55692.203541] [] ? unix_ioctl+0x70/0x70 [55692.209509] [] ? sock_recvmsg+0xc5/0x100 [55692.215771] [] ? __schedule+0x402/0x840 [55692.221945] [] ? get_futex_key+0x1c8/0x2c0 [55692.228368] [] ? __pollwait+0xf0/0xf0 [55692.234297] [] ? __pollwait+0xf0/0xf0 [55692.240240] [] ? __pollwait+0xf0/0xf0 [55692.246186] [] ? try_to_wake_up+0x190/0x390 [55692.252727] [] ? default_wake_function+0x12/0x20 [55692.259767] [] ? pollwake+0x73/0x90 [55692.265539] [] ? wake_up_state+0x20/0x20 [55692.271806] [] ? __wake_up_common+0x82/0x120 [55692.278446] [] ? eventfd_ctx_read+0x67/0x1e0 [55692.285098] [] ? system_call_after_swapgs+0xae/0x146 [55692.292518] [] SyS_poll+0x74/0x110 [55692.298166] [] ? system_call_after_swapgs+0xa2/0x146 [55692.305587] [] ? system_call_after_swapgs+0xae/0x146 [55692.312998] [] system_call_fastpath+0x25/0x2a [55692.319747] [] ? system_call_after_swapgs+0xae/0x146 [55692.327140] zed S ffff994d6ea1ac80 0 2286 1 0x00000080 [55692.335069] Call Trace: [55692.337846] [] schedule+0x29/0x70 [55692.343409] [] cv_wait_common+0x125/0x150 [spl] [55692.350340] [] ? wake_up_atomic_t+0x30/0x30 [55692.356902] [] __cv_wait_sig+0x15/0x40 [spl] [55692.363605] [] zfs_zevent_wait+0x49/0x100 [zfs] [55692.370625] [] zfs_ioc_events_next+0x66/0xe0 [zfs] [55692.377935] [] zfsdev_ioctl+0x864/0x8c0 [zfs] [55692.384674] [] do_vfs_ioctl+0x3a0/0x5a0 [55692.390829] [] ? __do_page_fault+0x238/0x500 [55692.397484] [] SyS_ioctl+0xa1/0xc0 [55692.403141] [] ? system_call_after_swapgs+0xa2/0x146 [55692.410560] [] system_call_fastpath+0x25/0x2a [55692.417282] [] ? system_call_after_swapgs+0xae/0x146 [55692.424716] zed S ffff99516e45ac80 0 2301 1 0x00000080 [55692.432659] Call Trace: [55692.435399] [] schedule+0x29/0x70 [55692.440992] [] futex_wait_queue_me+0xc6/0x130 [55692.447727] [] futex_wait+0x17b/0x280 [55692.453686] [] ? _raw_spin_unlock_irqrestore+0x15/0x20 [55692.461308] [] ? try_to_wake_up+0x190/0x390 [55692.467864] [] do_futex+0x106/0x5a0 [55692.473647] [] ? call_rwsem_wake+0x1b/0x30 [55692.480100] [] SyS_futex+0x80/0x190 [55692.485892] [] ? system_call_after_swapgs+0xa2/0x146 [55692.493286] [] ? system_call_after_swapgs+0xae/0x146 [55692.500707] [] ? system_call_after_swapgs+0xa2/0x146 [55692.508112] [] ? system_call_after_swapgs+0xae/0x146 [55692.515552] [] ? system_call_after_swapgs+0xa2/0x146 [55692.522963] [] ? system_call_after_swapgs+0xae/0x146 [55692.530379] [] system_call_fastpath+0x25/0x2a [55692.537125] [] ? system_call_after_swapgs+0xae/0x146 [55692.544544] zed S ffff99516e45ac80 0 2302 1 0x00000080 [55692.552497] Call Trace: [55692.555235] [] schedule+0x29/0x70 [55692.560793] [] schedule_timeout+0x221/0x2d0 [55692.567314] [] ? prepare_to_wait_exclusive+0x56/0x90 [55692.574731] [] __skb_wait_for_more_packets+0x120/0x180 [55692.582317] [] ? datagram_poll+0x110/0x110 [55692.588762] [] __skb_recv_datagram+0x6f/0xd0 [55692.595381] [] skb_recv_datagram+0x43/0x60 [55692.601839] [] netlink_recvmsg+0x62/0x490 [55692.608165] [] sock_recvmsg+0xc5/0x100 [55692.614237] [] ___sys_recvmsg+0x133/0x2d0 [55692.620593] [] ? handle_mm_fault+0x39d/0x9b0 [55692.627211] [] __sys_recvmsg+0x51/0x90 [55692.633259] [] SyS_recvmsg+0x12/0x20 [55692.639120] [] system_call_fastpath+0x25/0x2a [55692.645840] [] ? system_call_after_swapgs+0xae/0x146 [55692.653259] mcelog S ffff994d6ecdac80 0 2325 1 0x00000080 [55692.661174] Call Trace: [55692.663924] [] schedule+0x29/0x70 [55692.669475] [] schedule_hrtimeout_range_clock+0x12d/0x150 [55692.677375] [] ? add_wait_queue+0x3c/0x50 [55692.683735] [] ? add_wait_queue+0x3c/0x50 [55692.690088] [] schedule_hrtimeout_range+0x13/0x20 [55692.697205] [] poll_schedule_timeout+0x55/0xc0 [55692.704037] [] do_sys_poll+0x48d/0x590 [55692.710082] [] ? shmem_add_to_page_cache.isra.26+0xd0/0x120 [55692.718160] [] ? __radix_tree_lookup+0x84/0xf0 [55692.725001] [] ? radix_tree_lookup_slot+0x22/0x50 [55692.732116] [] ? __find_get_page+0x1e/0xa0 [55692.738559] [] ? filemap_fault+0x17e/0x490 [55692.745005] [] ? __pollwait+0xf0/0xf0 [55692.750961] [] ? __pollwait+0xf0/0xf0 [55692.756910] [] ? unlock_page+0x2b/0x30 [55692.762967] [] ? do_read_fault.isra.63+0x139/0x1b0 [55692.770180] [] ? handle_pte_fault+0x22a/0xe20 [55692.776939] [] ? arch_tlb_finish_mmu+0x47/0x80 [55692.783769] [] ? tlb_finish_mmu+0x23/0x30 [55692.790117] [] ? unmap_region+0xf4/0x140 [55692.796356] [] ? handle_mm_fault+0x39d/0x9b0 [55692.802994] [] ? recalc_sigpending+0x1b/0x70 [55692.809652] [] ? __set_task_blocked+0x41/0xa0 [55692.816367] [] SyS_ppoll+0xee/0x1f0 [55692.822110] [] ? system_call_after_swapgs+0xa2/0x146 [55692.829545] [] ? system_call_after_swapgs+0xae/0x146 [55692.836957] [] ? system_call_after_swapgs+0xa2/0x146 [55692.844349] [] ? system_call_after_swapgs+0xae/0x146 [55692.851770] [] system_call_fastpath+0x25/0x2a [55692.858506] [] ? system_call_after_swapgs+0xae/0x146 [55692.865925] kworker/23:1H S ffff994975e6c1c0 0 2364 2 0x00000080 [55692.873876] Call Trace: [55692.876629] [] ? process_one_work+0x21a/0x440 [55692.883357] [] schedule+0x29/0x70 [55692.888928] [] worker_thread+0x1d9/0x3c0 [55692.895159] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55692.902497] [] kthread+0xd1/0xe0 [55692.907988] [] ? insert_kthread_work+0x40/0x40 [55692.914835] [] ret_from_fork_nospec_begin+0x21/0x21 [55692.922142] [] ? insert_kthread_work+0x40/0x40 [55692.928988] kworker/19:1H S ffff994975e6d230 0 2365 2 0x00000080 [55692.936950] Call Trace: [55692.939703] [] ? process_one_work+0x21a/0x440 [55692.946443] [] schedule+0x29/0x70 [55692.952026] [] worker_thread+0x1d9/0x3c0 [55692.958257] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55692.965589] [] kthread+0xd1/0xe0 [55692.971092] [] ? insert_kthread_work+0x40/0x40 [55692.977943] [] ret_from_fork_nospec_begin+0x21/0x21 [55692.985239] [] ? insert_kthread_work+0x40/0x40 [55692.992089] kworker/16:1H S ffff994975a41070 0 2366 2 0x00000080 [55693.000056] Call Trace: [55693.002821] [] ? process_one_work+0x21a/0x440 [55693.009569] [] schedule+0x29/0x70 [55693.015120] [] worker_thread+0x1d9/0x3c0 [55693.021343] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55693.028667] [] kthread+0xd1/0xe0 [55693.034144] [] ? insert_kthread_work+0x40/0x40 [55693.040992] [] ret_from_fork_nospec_begin+0x21/0x21 [55693.048313] [] ? insert_kthread_work+0x40/0x40 [55693.055152] kworker/18:1H S ffff994975a45230 0 2367 2 0x00000080 [55693.063114] Call Trace: [55693.065867] [] ? process_one_work+0x21a/0x440 [55693.072616] [] schedule+0x29/0x70 [55693.078175] [] worker_thread+0x1d9/0x3c0 [55693.084403] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55693.091733] [] kthread+0xd1/0xe0 [55693.097215] [] ? insert_kthread_work+0x40/0x40 [55693.104051] [] ret_from_fork_nospec_begin+0x21/0x21 [55693.111349] [] ? insert_kthread_work+0x40/0x40 [55693.118186] gssproxy S ffff9949758920e0 0 2368 1 0x00000080 [55693.126141] Call Trace: [55693.128893] [] schedule+0x29/0x70 [55693.134449] [] schedule_hrtimeout_range_clock+0xb2/0x150 [55693.142259] [] ? hrtimer_get_res+0x50/0x50 [55693.148711] [] ? schedule_hrtimeout_range_clock+0xa6/0x150 [55693.156706] [] schedule_hrtimeout_range+0x13/0x20 [55693.163837] [] ep_poll+0x23e/0x360 [55693.169522] [] ? wake_up_state+0x20/0x20 [55693.175787] [] SyS_epoll_wait+0xed/0x120 [55693.182017] [] ? system_call_after_swapgs+0xa2/0x146 [55693.189456] [] system_call_fastpath+0x25/0x2a [55693.196193] [] ? system_call_after_swapgs+0xae/0x146 [55693.203603] gssproxy S ffff994d6ec5ac80 0 2375 1 0x00000080 [55693.211599] Call Trace: [55693.214357] [] schedule+0x29/0x70 [55693.219938] [] futex_wait_queue_me+0xc6/0x130 [55693.226694] [] futex_wait+0x17b/0x280 [55693.232676] [] ? handle_pte_fault+0x22a/0xe20 [55693.239397] [] ? put_prev_entity+0x31/0x400 [55693.245937] [] ? pick_next_task_fair+0x1c6/0x870 [55693.252974] [] do_futex+0x106/0x5a0 [55693.258756] [] SyS_futex+0x80/0x190 [55693.264529] [] ? system_call_after_swapgs+0xa2/0x146 [55693.271937] [] ? system_call_after_swapgs+0xae/0x146 [55693.279339] [] ? system_call_after_swapgs+0xa2/0x146 [55693.286767] [] ? system_call_after_swapgs+0xae/0x146 [55693.294168] [] ? system_call_after_swapgs+0xa2/0x146 [55693.301581] [] ? system_call_after_swapgs+0xae/0x146 [55693.308998] [] system_call_fastpath+0x25/0x2a [55693.315753] [] ? system_call_after_swapgs+0xae/0x146 [55693.323154] gssproxy S ffff994d6ec9ac80 0 2376 1 0x00000080 [55693.331113] Call Trace: [55693.333894] [] schedule+0x29/0x70 [55693.339481] [] futex_wait_queue_me+0xc6/0x130 [55693.346230] [] futex_wait+0x17b/0x280 [55693.352201] [] do_futex+0x106/0x5a0 [55693.358008] [] SyS_futex+0x80/0x190 [55693.363787] [] ? system_call_after_swapgs+0xa2/0x146 [55693.371185] [] ? system_call_after_swapgs+0xae/0x146 [55693.378606] [] ? system_call_after_swapgs+0xa2/0x146 [55693.386037] [] ? system_call_after_swapgs+0xae/0x146 [55693.393458] [] ? system_call_after_swapgs+0xa2/0x146 [55693.400891] [] ? system_call_after_swapgs+0xae/0x146 [55693.408284] [] system_call_fastpath+0x25/0x2a [55693.415067] [] ? system_call_after_swapgs+0xae/0x146 [55693.422477] gssproxy S ffff99516e4dac80 0 2377 1 0x00000080 [55693.430453] Call Trace: [55693.433219] [] schedule+0x29/0x70 [55693.438804] [] futex_wait_queue_me+0xc6/0x130 [55693.445553] [] futex_wait+0x17b/0x280 [55693.451514] [] ? put_prev_entity+0x31/0x400 [55693.458062] [] ? pick_next_task_fair+0x1c6/0x870 [55693.465085] [] do_futex+0x106/0x5a0 [55693.470839] [] ? schedule+0x29/0x70 [55693.476605] [] ? do_exit+0x6ce/0xa50 [55693.482468] [] SyS_futex+0x80/0x190 [55693.488225] [] ? system_call_after_swapgs+0xa2/0x146 [55693.495645] [] ? system_call_after_swapgs+0xae/0x146 [55693.503035] [] ? system_call_after_swapgs+0xa2/0x146 [55693.510470] [] ? system_call_after_swapgs+0xae/0x146 [55693.517897] [] ? system_call_after_swapgs+0xa2/0x146 [55693.525290] [] ? system_call_after_swapgs+0xae/0x146 [55693.532701] [] system_call_fastpath+0x25/0x2a [55693.539422] [] ? system_call_after_swapgs+0xae/0x146 [55693.546834] gssproxy S ffff994d6ec5ac80 0 2378 1 0x00000080 [55693.554823] Call Trace: [55693.557575] [] schedule+0x29/0x70 [55693.563126] [] futex_wait_queue_me+0xc6/0x130 [55693.569852] [] futex_wait+0x17b/0x280 [55693.575812] [] do_futex+0x106/0x5a0 [55693.581580] [] SyS_futex+0x80/0x190 [55693.587337] [] ? system_call_after_swapgs+0xa2/0x146 [55693.594749] [] ? system_call_after_swapgs+0xae/0x146 [55693.602146] [] ? system_call_after_swapgs+0xa2/0x146 [55693.609567] [] ? system_call_after_swapgs+0xae/0x146 [55693.616983] [] ? system_call_after_swapgs+0xa2/0x146 [55693.624396] [] ? system_call_after_swapgs+0xae/0x146 [55693.631815] [] system_call_fastpath+0x25/0x2a [55693.638549] [] ? system_call_after_swapgs+0xae/0x146 [55693.645982] gssproxy S ffff99516772e2a0 0 2379 1 0x00000080 [55693.653938] Call Trace: [55693.656688] [] schedule+0x29/0x70 [55693.662239] [] futex_wait_queue_me+0xc6/0x130 [55693.668956] [] futex_wait+0x17b/0x280 [55693.674929] [] ? __sb_end_write+0x31/0x70 [55693.681250] [] ? pipe_write+0x48f/0x540 [55693.687405] [] do_futex+0x106/0x5a0 [55693.693152] [] SyS_futex+0x80/0x190 [55693.698916] [] ? system_call_after_swapgs+0xa2/0x146 [55693.706330] [] ? system_call_after_swapgs+0xae/0x146 [55693.713745] [] ? system_call_after_swapgs+0xa2/0x146 [55693.721151] [] ? system_call_after_swapgs+0xae/0x146 [55693.728564] [] ? system_call_after_swapgs+0xa2/0x146 [55693.736004] [] ? system_call_after_swapgs+0xae/0x146 [55693.743395] [] system_call_fastpath+0x25/0x2a [55693.750118] [] ? system_call_after_swapgs+0xae/0x146 [55693.757537] rpc.gssd S ffff994d694c20e0 0 2395 1 0x00000080 [55693.765523] Call Trace: [55693.768269] [] ? call_rcu_sched+0x1d/0x20 [55693.774616] [] schedule+0x29/0x70 [55693.780173] [] schedule_hrtimeout_range_clock+0x12d/0x150 [55693.788051] [] ? ep_scan_ready_list.isra.7+0x1b9/0x1f0 [55693.795666] [] schedule_hrtimeout_range+0x13/0x20 [55693.802810] [] ep_poll+0x23e/0x360 [55693.808499] [] ? abort_exclusive_wait+0xa0/0xa0 [55693.815411] [] ? wake_up_state+0x20/0x20 [55693.821659] [] SyS_epoll_wait+0xed/0x120 [55693.827908] [] ? system_call_after_swapgs+0xa2/0x146 [55693.835329] [] system_call_fastpath+0x25/0x2a [55693.842050] [] ? system_call_after_swapgs+0xae/0x146 [55693.849476] kworker/17:1H S ffff994975a40000 0 2406 2 0x00000080 [55693.857407] Call Trace: [55693.860146] [] ? process_one_work+0x21a/0x440 [55693.866881] [] schedule+0x29/0x70 [55693.872453] [] worker_thread+0x1d9/0x3c0 [55693.878703] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55693.886045] [] kthread+0xd1/0xe0 [55693.891532] [] ? insert_kthread_work+0x40/0x40 [55693.898380] [] ret_from_fork_nospec_begin+0x21/0x21 [55693.905695] [] ? insert_kthread_work+0x40/0x40 [55693.912526] sssd_be S ffff994d6c7c1070 0 2447 2253 0x00000080 [55693.920493] Call Trace: [55693.923231] [] schedule+0x29/0x70 [55693.928818] [] schedule_hrtimeout_range_clock+0xb2/0x150 [55693.936640] [] ? hrtimer_get_res+0x50/0x50 [55693.943091] [] ? schedule_hrtimeout_range_clock+0xa6/0x150 [55693.951072] [] schedule_hrtimeout_range+0x13/0x20 [55693.958201] [] ep_poll+0x23e/0x360 [55693.963868] [] ? recalc_sigpending+0x1b/0x70 [55693.970530] [] ? wake_up_state+0x20/0x20 [55693.976801] [] SyS_epoll_wait+0xed/0x120 [55693.983034] [] ? system_call_after_swapgs+0xa2/0x146 [55693.990469] [] system_call_fastpath+0x25/0x2a [55693.997211] [] ? system_call_after_swapgs+0xae/0x146 [55694.004623] dhclient S ffff994d6b751070 0 2468 2283 0x00000080 [55694.012603] Call Trace: [55694.015368] [] schedule+0x29/0x70 [55694.020968] [] schedule_hrtimeout_range_clock+0xb2/0x150 [55694.028762] [] ? hrtimer_get_res+0x50/0x50 [55694.035186] [] ? schedule_hrtimeout_range_clock+0xa6/0x150 [55694.043166] [] schedule_hrtimeout_range+0x13/0x20 [55694.050278] [] poll_schedule_timeout+0x55/0xc0 [55694.057119] [] do_select+0x6d1/0x7c0 [55694.063016] [] ? __pollwait+0xf0/0xf0 [55694.068997] [] ? __pollwait+0xf0/0xf0 [55694.075034] [] ? memcpy_toiovec+0x5c/0xb0 [55694.081389] [] ? skb_release_data+0x132/0x140 [55694.088103] [] ? kfree_skbmem+0x37/0x90 [55694.094227] [] ? consume_skb+0x34/0x90 [55694.100260] [] ? skb_consume_udp+0x23/0x80 [55694.106704] [] ? udp_recvmsg+0x2a4/0x480 [55694.112954] [] ? unlock_page+0x2b/0x30 [55694.119004] [] ? do_wp_page+0x19e/0x720 [55694.125145] [] ? __check_object_size+0x1ca/0x250 [55694.132177] [] core_sys_select+0x1ff/0x340 [55694.138642] [] ? handle_mm_fault+0x39d/0x9b0 [55694.145260] [] ? ktime_get_ts64+0x52/0xf0 [55694.151606] [] SyS_select+0xca/0x120 [55694.157469] [] system_call_fastpath+0x25/0x2a [55694.164192] [] ? system_call_after_swapgs+0xae/0x146 [55694.171604] mlx4_en S ffff994d6ec5ac80 0 2470 2 0x00000080 [55694.179602] Call Trace: [55694.182378] [] schedule+0x29/0x70 [55694.187946] [] rescuer_thread+0x31e/0x3c0 [55694.194281] [] ? process_one_work+0x440/0x440 [55694.201046] [] kthread+0xd1/0xe0 [55694.206528] [] ? insert_kthread_work+0x40/0x40 [55694.213375] [] ret_from_fork_nospec_begin+0x21/0x21 [55694.220684] [] ? insert_kthread_work+0x40/0x40 [55694.227520] mlx5_ib_sigerr_ S ffff995169e262a0 0 2501 2 0x00000080 [55694.235482] Call Trace: [55694.238220] [] schedule+0x29/0x70 [55694.243806] [] rescuer_thread+0x31e/0x3c0 [55694.250134] [] ? process_one_work+0x440/0x440 [55694.256867] [] kthread+0xd1/0xe0 [55694.262329] [] ? insert_kthread_work+0x40/0x40 [55694.269142] [] ret_from_fork_nospec_begin+0x21/0x21 [55694.276458] [] ? insert_kthread_work+0x40/0x40 [55694.283269] sssd_nss S ffff994d6a3bc1c0 0 2515 2253 0x00000080 [55694.291217] Call Trace: [55694.294010] [] schedule+0x29/0x70 [55694.299593] [] schedule_hrtimeout_range_clock+0xb2/0x150 [55694.307374] [] ? hrtimer_get_res+0x50/0x50 [55694.313814] [] ? schedule_hrtimeout_range_clock+0xa6/0x150 [55694.321831] [] schedule_hrtimeout_range+0x13/0x20 [55694.328953] [] ep_poll+0x23e/0x360 [55694.334629] [] ? recalc_sigpending+0x1b/0x70 [55694.341254] [] ? wake_up_state+0x20/0x20 [55694.347519] [] SyS_epoll_wait+0xed/0x120 [55694.353789] [] ? system_call_after_swapgs+0xa2/0x146 [55694.361191] [] system_call_fastpath+0x25/0x2a [55694.367908] [] ? system_call_after_swapgs+0xae/0x146 [55694.375356] sssd_pam S ffff994d6a3bb150 0 2516 2253 0x00000080 [55694.383338] Call Trace: [55694.386106] [] schedule+0x29/0x70 [55694.391698] [] schedule_hrtimeout_range_clock+0xb2/0x150 [55694.399499] [] ? hrtimer_get_res+0x50/0x50 [55694.405938] [] ? schedule_hrtimeout_range_clock+0xa6/0x150 [55694.413964] [] schedule_hrtimeout_range+0x13/0x20 [55694.421067] [] ep_poll+0x23e/0x360 [55694.426736] [] ? recalc_sigpending+0x1b/0x70 [55694.433374] [] ? wake_up_state+0x20/0x20 [55694.439631] [] SyS_epoll_wait+0xed/0x120 [55694.445896] [] ? system_call_after_swapgs+0xa2/0x146 [55694.453296] [] system_call_fastpath+0x25/0x2a [55694.460010] [] ? system_call_after_swapgs+0xae/0x146 [55694.467433] sssd_ssh S ffff994d6a3b9070 0 2517 2253 0x00000080 [55694.475414] Call Trace: [55694.478154] [] schedule+0x29/0x70 [55694.483723] [] schedule_hrtimeout_range_clock+0xb2/0x150 [55694.491549] [] ? hrtimer_get_res+0x50/0x50 [55694.497998] [] ? schedule_hrtimeout_range_clock+0xa6/0x150 [55694.506012] [] schedule_hrtimeout_range+0x13/0x20 [55694.513114] [] ep_poll+0x23e/0x360 [55694.518789] [] ? recalc_sigpending+0x1b/0x70 [55694.525427] [] ? wake_up_state+0x20/0x20 [55694.531675] [] SyS_epoll_wait+0xed/0x120 [55694.537919] [] ? system_call_after_swapgs+0xa2/0x146 [55694.545338] [] system_call_fastpath+0x25/0x2a [55694.552054] [] ? system_call_after_swapgs+0xae/0x146 [55694.559481] sssd_pac S ffff994d6a3be2a0 0 2518 2253 0x00000080 [55694.567435] Call Trace: [55694.570174] [] schedule+0x29/0x70 [55694.575753] [] schedule_hrtimeout_range_clock+0xb2/0x150 [55694.583568] [] ? hrtimer_get_res+0x50/0x50 [55694.590025] [] ? schedule_hrtimeout_range_clock+0xa6/0x150 [55694.598009] [] schedule_hrtimeout_range+0x13/0x20 [55694.605119] [] ep_poll+0x23e/0x360 [55694.610808] [] ? recalc_sigpending+0x1b/0x70 [55694.617467] [] ? wake_up_state+0x20/0x20 [55694.623739] [] SyS_epoll_wait+0xed/0x120 [55694.629986] [] ? system_call_after_swapgs+0xa2/0x146 [55694.637415] [] system_call_fastpath+0x25/0x2a [55694.644129] [] ? system_call_after_swapgs+0xae/0x146 [55694.651539] systemd-logind S ffff994d6c7c0000 0 2538 1 0x00000080 [55694.659489] Call Trace: [55694.662257] [] schedule+0x29/0x70 [55694.667835] [] schedule_hrtimeout_range_clock+0x12d/0x150 [55694.675731] [] ? ep_scan_ready_list.isra.7+0x1b9/0x1f0 [55694.683338] [] schedule_hrtimeout_range+0x13/0x20 [55694.690452] [] ep_poll+0x23e/0x360 [55694.696105] [] ? SyS_epoll_ctl+0x24d/0xc80 [55694.702547] [] ? wake_up_state+0x20/0x20 [55694.708789] [] SyS_epoll_wait+0xed/0x120 [55694.715025] [] ? system_call_after_swapgs+0xa2/0x146 [55694.722452] [] system_call_fastpath+0x25/0x2a [55694.729165] [] ? system_call_after_swapgs+0xae/0x146 [55694.736576] ipoib_wq S ffff99515ab3a0e0 0 2556 2 0x00000080 [55694.744578] Call Trace: [55694.747352] [] schedule+0x29/0x70 [55694.752976] [] rescuer_thread+0x31e/0x3c0 [55694.759353] [] ? process_one_work+0x440/0x440 [55694.766067] [] kthread+0xd1/0xe0 [55694.771563] [] ? insert_kthread_work+0x40/0x40 [55694.778393] [] ret_from_fork_nospec_begin+0x21/0x21 [55694.785723] [] ? insert_kthread_work+0x40/0x40 [55694.792565] ipoib_wq S ffff99515ab3b150 0 2557 2 0x00000080 [55694.800576] Call Trace: [55694.803333] [] schedule+0x29/0x70 [55694.808904] [] rescuer_thread+0x31e/0x3c0 [55694.815230] [] ? process_one_work+0x440/0x440 [55694.821981] [] kthread+0xd1/0xe0 [55694.827466] [] ? insert_kthread_work+0x40/0x40 [55694.834297] [] ret_from_fork_nospec_begin+0x21/0x21 [55694.841613] [] ? insert_kthread_work+0x40/0x40 [55694.848458] rdma_cm S ffff99515ab3d230 0 2583 2 0x00000080 [55694.856422] Call Trace: [55694.859161] [] schedule+0x29/0x70 [55694.864746] [] rescuer_thread+0x31e/0x3c0 [55694.871074] [] ? process_one_work+0x440/0x440 [55694.877808] [] kthread+0xd1/0xe0 [55694.883271] [] ? insert_kthread_work+0x40/0x40 [55694.890073] [] ret_from_fork_nospec_begin+0x21/0x21 [55694.897404] [] ? insert_kthread_work+0x40/0x40 [55694.904212] sshd S ffff994d67c541c0 0 2957 1 0x00000080 [55694.912164] Call Trace: [55694.914943] [] schedule+0x29/0x70 [55694.920514] [] schedule_hrtimeout_range_clock+0x12d/0x150 [55694.928410] [] ? add_wait_queue+0x3c/0x50 [55694.934748] [] ? __pollwait+0x7f/0xf0 [55694.940706] [] schedule_hrtimeout_range+0x13/0x20 [55694.947836] [] poll_schedule_timeout+0x55/0xc0 [55694.954683] [] do_select+0x6d1/0x7c0 [55694.960550] [] ? __pollwait+0xf0/0xf0 [55694.966515] [] ? __pollwait+0xf0/0xf0 [55694.972471] [] ? fsnotify_grab_connector+0x43/0x70 [55694.979702] [] ? fsnotify_destroy_marks+0x26/0xf0 [55694.986836] [] ? fsnotify_grab_connector+0x43/0x70 [55694.994033] [] ? fsnotify_destroy_marks+0x26/0xf0 [55695.001135] [] ? call_rcu_sched+0x1d/0x20 [55695.007489] [] ? proc_destroy_inode+0x1c/0x20 [55695.014234] [] ? destroy_inode+0x3b/0x60 [55695.020499] [] ? evict+0x115/0x180 [55695.026175] [] ? call_rcu_sched+0x1d/0x20 [55695.032544] [] ? d_free+0x50/0x70 [55695.038124] [] ? __dentry_kill+0x130/0x190 [55695.044575] [] core_sys_select+0x1ff/0x340 [55695.050999] [] ? wait_consider_task+0xa5/0xb30 [55695.057823] [] ? __set_current_blocked+0x42/0x70 [55695.064857] [] ? __check_object_size+0x1ca/0x250 [55695.071933] [] ? __restore_xstate_sig+0xac/0x630 [55695.078965] [] ? recalc_sigpending+0x1b/0x70 [55695.085617] [] SyS_select+0xca/0x120 [55695.091486] [] ? system_call_after_swapgs+0xa2/0x146 [55695.098921] [] ? system_call_after_swapgs+0xae/0x146 [55695.106343] [] ? system_call_after_swapgs+0xa2/0x146 [55695.113770] [] ? system_call_after_swapgs+0xae/0x146 [55695.121152] [] system_call_fastpath+0x25/0x2a [55695.127912] [] ? system_call_after_swapgs+0xae/0x146 [55695.135309] tuned S ffff994d67aab150 0 2960 1 0x00000080 [55695.143286] Call Trace: [55695.146035] [] schedule+0x29/0x70 [55695.151627] [] schedule_hrtimeout_range_clock+0xb2/0x150 [55695.159429] [] ? hrtimer_get_res+0x50/0x50 [55695.165878] [] ? schedule_hrtimeout_range_clock+0xa6/0x150 [55695.173885] [] schedule_hrtimeout_range+0x13/0x20 [55695.181001] [] poll_schedule_timeout+0x55/0xc0 [55695.187840] [] do_select+0x6d1/0x7c0 [55695.193710] [] ? enqueue_entity+0x814/0xbe0 [55695.200272] [] ? sched_clock_cpu+0x85/0xc0 [55695.206733] [] ? task_scan_max+0x27/0x40 [55695.212961] [] ? task_numa_fault+0x8d0/0xbb0 [55695.219597] [] ? do_numa_page+0x1be/0x250 [55695.225935] [] ? handle_pte_fault+0x2b9/0xe20 [55695.232692] [] ? putback_lru_page+0x52/0xc0 [55695.239242] [] ? migrate_pages+0x531/0x7b0 [55695.245701] [] ? should_numa_migrate_memory+0x5b/0x150 [55695.253324] [] ? mpol_misplaced+0x18c/0x1e0 [55695.259885] [] ? handle_mm_fault+0x39d/0x9b0 [55695.266554] [] ? do_numa_page+0x1be/0x250 [55695.272915] [] core_sys_select+0x1ff/0x340 [55695.279349] [] ? handle_mm_fault+0x39d/0x9b0 [55695.285971] [] ? __check_object_size+0x1ca/0x250 [55695.293005] [] ? ktime_get_ts64+0x52/0xf0 [55695.299367] [] SyS_select+0xca/0x120 [55695.305243] [] system_call_fastpath+0x25/0x2a [55695.311953] [] ? system_call_after_swapgs+0xae/0x146 [55695.319378] gmain S ffff995167169070 0 3232 1 0x00000080 [55695.327330] Call Trace: [55695.330073] [] schedule+0x29/0x70 [55695.335660] [] schedule_hrtimeout_range_clock+0x12d/0x150 [55695.343579] [] ? add_wait_queue+0x3c/0x50 [55695.349939] [] schedule_hrtimeout_range+0x13/0x20 [55695.357043] [] poll_schedule_timeout+0x55/0xc0 [55695.363873] [] do_sys_poll+0x48d/0x590 [55695.369930] [] ? __alloc_pages_nodemask+0x184/0xbe0 [55695.377267] [] ? __alloc_pages_nodemask+0x184/0xbe0 [55695.384582] [] ? __pollwait+0xf0/0xf0 [55695.390540] [] ? handle_pte_fault+0x3d5/0xe20 [55695.397281] [] ? alloc_pages_current+0x98/0x110 [55695.404221] [] ? eventfd_ctx_read+0x67/0x1e0 [55695.410893] [] ? system_call_after_swapgs+0xae/0x146 [55695.418321] [] SyS_poll+0x74/0x110 [55695.423960] [] ? system_call_after_swapgs+0xa2/0x146 [55695.431372] [] ? system_call_after_swapgs+0xae/0x146 [55695.438785] [] system_call_fastpath+0x25/0x2a [55695.445526] [] ? system_call_after_swapgs+0xae/0x146 [55695.452943] tuned S ffff995167168000 0 3233 1 0x00000080 [55695.460898] Call Trace: [55695.463666] [] schedule+0x29/0x70 [55695.469224] [] schedule_hrtimeout_range_clock+0xb2/0x150 [55695.477007] [] ? hrtimer_get_res+0x50/0x50 [55695.483450] [] ? schedule_hrtimeout_range_clock+0xa6/0x150 [55695.491465] [] schedule_hrtimeout_range+0x13/0x20 [55695.498586] [] poll_schedule_timeout+0x55/0xc0 [55695.505439] [] do_select+0x6d1/0x7c0 [55695.511316] [] ? do_page_add_anon_rmap+0x9a/0xc0 [55695.518358] [] ? rmap_walk+0x2b9/0x360 [55695.524423] [] ? update_curr+0x14c/0x1e0 [55695.530695] [] ? enqueue_entity+0x814/0xbe0 [55695.537215] [] ? enqueue_task_fair+0x208/0x6c0 [55695.544036] [] ? sched_clock_cpu+0x85/0xc0 [55695.550486] [] ? task_scan_min+0x3e/0x60 [55695.556741] [] ? should_numa_migrate_memory+0x5b/0x150 [55695.564348] [] ? mpol_misplaced+0x18c/0x1e0 [55695.570878] [] core_sys_select+0x1ff/0x340 [55695.577323] [] ? ktime_get_ts64+0x3c/0xf0 [55695.583683] [] ? __check_object_size+0x1ca/0x250 [55695.590717] [] ? ktime_get_ts64+0x52/0xf0 [55695.597049] [] SyS_select+0xca/0x120 [55695.602928] [] system_call_fastpath+0x25/0x2a [55695.609662] [] ? system_call_after_swapgs+0xae/0x146 [55695.617090] tuned S ffff994d6c0341c0 0 3237 1 0x00000080 [55695.625028] Call Trace: [55695.627781] [] schedule+0x29/0x70 [55695.633350] [] schedule_hrtimeout_range_clock+0x12d/0x150 [55695.641255] [] ? wake_up_q+0x5b/0x80 [55695.647104] [] ? futex_wake+0x90/0x180 [55695.653182] [] schedule_hrtimeout_range+0x13/0x20 [55695.660291] [] ep_poll+0x23e/0x360 [55695.665955] [] ? wake_up_state+0x20/0x20 [55695.672192] [] SyS_epoll_wait+0xed/0x120 [55695.678440] [] ? system_call_after_swapgs+0xa2/0x146 [55695.685881] [] system_call_fastpath+0x25/0x2a [55695.692622] [] ? system_call_after_swapgs+0xae/0x146 [55695.700015] tuned S ffff994d6892c1c0 0 3309 1 0x00000080 [55695.707943] Call Trace: [55695.710723] [] schedule+0x29/0x70 [55695.716303] [] schedule_hrtimeout_range_clock+0x12d/0x150 [55695.724182] [] ? list_del+0xd/0x30 [55695.729864] [] ? add_wait_queue+0x3c/0x50 [55695.736195] [] ? add_wait_queue+0x3c/0x50 [55695.742556] [] schedule_hrtimeout_range+0x13/0x20 [55695.749678] [] poll_schedule_timeout+0x55/0xc0 [55695.756509] [] do_sys_poll+0x48d/0x590 [55695.762566] [] ? put_prev_entity+0x31/0x400 [55695.769087] [] ? __switch_to+0x151/0x580 [55695.775350] [] ? __schedule+0x402/0x840 [55695.781512] [] ? get_futex_key+0x1c8/0x2c0 [55695.787964] [] ? __pollwait+0xf0/0xf0 [55695.793954] [] ? __pollwait+0xf0/0xf0 [55695.799945] [] ? sched_clock+0x9/0x10 [55695.805926] [] ? sched_clock_cpu+0x85/0xc0 [55695.812385] [] ? try_to_wake_up+0x190/0x390 [55695.818920] [] ? wake_up_q+0x5b/0x80 [55695.824804] [] ? futex_wake+0x90/0x180 [55695.830884] [] ? do_futex+0x12a/0x5a0 [55695.836883] [] ? system_call_after_swapgs+0xae/0x146 [55695.844313] [] SyS_poll+0x74/0x110 [55695.849967] [] ? system_call_after_swapgs+0xa2/0x146 [55695.857400] [] ? system_call_after_swapgs+0xae/0x146 [55695.864808] [] system_call_fastpath+0x25/0x2a [55695.871557] [] ? system_call_after_swapgs+0xae/0x146 [55695.878947] rsyslogd S ffff994d67aad230 0 2962 1 0x00000080 [55695.886891] Call Trace: [55695.889657] [] schedule+0x29/0x70 [55695.895226] [] schedule_hrtimeout_range_clock+0xb2/0x150 [55695.903008] [] ? hrtimer_get_res+0x50/0x50 [55695.909451] [] ? schedule_hrtimeout_range_clock+0xa6/0x150 [55695.917467] [] schedule_hrtimeout_range+0x13/0x20 [55695.924589] [] poll_schedule_timeout+0x55/0xc0 [55695.931434] [] do_select+0x6d1/0x7c0 [55695.937312] [] ? enqueue_entity+0x814/0xbe0 [55695.943871] [] ? sched_clock_cpu+0x85/0xc0 [55695.950329] [] ? task_scan_max+0x27/0x40 [55695.956586] [] ? task_numa_fault+0x8d0/0xbb0 [55695.963202] [] ? do_numa_page+0x1be/0x250 [55695.969547] [] ? handle_pte_fault+0x2b9/0xe20 [55695.976289] [] ? should_numa_migrate_memory+0x5b/0x150 [55695.983900] [] ? mpol_misplaced+0x18c/0x1e0 [55695.990433] [] ? handle_mm_fault+0x39d/0x9b0 [55695.997050] [] ? do_numa_page+0x1be/0x250 [55696.003402] [] core_sys_select+0x1ff/0x340 [55696.009868] [] ? handle_mm_fault+0x39d/0x9b0 [55696.016511] [] ? ktime_get_ts64+0x52/0xf0 [55696.022854] [] SyS_select+0xca/0x120 [55696.028716] [] system_call_fastpath+0x25/0x2a [55696.035474] [] ? system_call_after_swapgs+0xae/0x146 [55696.042889] in:imjournal S ffff994d6a6fd230 0 2964 1 0x00000080 [55696.050888] Call Trace: [55696.053665] [] ? hrtimer_start_range_ns+0x1fd/0x3c0 [55696.060961] [] schedule+0x29/0x70 [55696.066537] [] schedule_hrtimeout_range_clock+0xb2/0x150 [55696.074354] [] ? hrtimer_get_res+0x50/0x50 [55696.080828] [] ? schedule_hrtimeout_range_clock+0xa6/0x150 [55696.088816] [] schedule_hrtimeout_range+0x13/0x20 [55696.095960] [] poll_schedule_timeout+0x55/0xc0 [55696.102837] [] do_sys_poll+0x48d/0x590 [55696.108892] [] ? __wake_up_common_lock+0x91/0xc0 [55696.115897] [] ? sched_clock+0x9/0x10 [55696.121845] [] ? __enqueue_entity+0x78/0x80 [55696.128407] [] ? enqueue_entity+0x2ef/0xbe0 [55696.134964] [] ? link_path_walk+0x81/0x8b0 [55696.141419] [] ? __pollwait+0xf0/0xf0 [55696.147401] [] ? destroy_inode+0x3b/0x60 [55696.153665] [] ? ttwu_do_wakeup+0xb5/0xe0 [55696.159981] [] ? ttwu_do_activate+0x6f/0x80 [55696.166521] [] ? try_to_wake_up+0x190/0x390 [55696.173042] [] ? wake_up_q+0x5b/0x80 [55696.178899] [] ? futex_wake_op+0x3b5/0x640 [55696.185361] [] ? do_futex+0x17a/0x5a0 [55696.191323] [] ? ktime_get_ts64+0x52/0xf0 [55696.197683] [] SyS_ppoll+0x1d3/0x1f0 [55696.203552] [] ? system_call_after_swapgs+0xa2/0x146 [55696.210952] [] ? system_call_after_swapgs+0xae/0x146 [55696.218380] [] system_call_fastpath+0x25/0x2a [55696.225129] [] ? system_call_after_swapgs+0xae/0x146 [55696.232531] rs:main Q:Reg S ffff9951677ee2a0 0 2972 1 0x00000080 [55696.240509] Call Trace: [55696.243275] [] schedule+0x29/0x70 [55696.248866] [] futex_wait_queue_me+0xc6/0x130 [55696.255617] [] futex_wait+0x17b/0x280 [55696.261590] [] ? generic_file_aio_write+0x77/0xa0 [55696.268720] [] ? ext4_file_write+0xd2/0x1e0 [ext4] [55696.275936] [] do_futex+0x106/0x5a0 [55696.281711] [] SyS_futex+0x80/0x190 [55696.287499] [] ? system_call_after_swapgs+0xa2/0x146 [55696.294903] [] ? system_call_after_swapgs+0xae/0x146 [55696.302331] [] ? system_call_after_swapgs+0xa2/0x146 [55696.309765] [] ? system_call_after_swapgs+0xae/0x146 [55696.317161] [] ? system_call_after_swapgs+0xa2/0x146 [55696.324587] [] ? system_call_after_swapgs+0xae/0x146 [55696.331988] [] system_call_fastpath+0x25/0x2a [55696.338743] [] ? system_call_after_swapgs+0xae/0x146 [55696.346136] rpc.statd S ffff995167401070 0 2973 1 0x00000080 [55696.354131] Call Trace: [55696.356908] [] ? update_curr+0x14c/0x1e0 [55696.363171] [] schedule+0x29/0x70 [55696.368757] [] schedule_hrtimeout_range_clock+0x12d/0x150 [55696.376645] [] ? add_wait_queue+0x3c/0x50 [55696.382970] [] ? __pollwait+0x7f/0xf0 [55696.388910] [] ? datagram_poll+0x2c/0x110 [55696.395272] [] schedule_hrtimeout_range+0x13/0x20 [55696.402407] [] poll_schedule_timeout+0x55/0xc0 [55696.409217] [] do_select+0x6d1/0x7c0 [55696.415064] [] ? __slab_free+0x9d/0x290 [55696.421198] [] ? __pollwait+0xf0/0xf0 [55696.427136] [] ? __pollwait+0xf0/0xf0 [55696.433066] [] ? __pollwait+0xf0/0xf0 [55696.439002] [] ? __pollwait+0xf0/0xf0 [55696.444939] [] ? __pollwait+0xf0/0xf0 [55696.450890] [] ? ext4_filemap_fault+0x41/0x50 [ext4] [55696.458313] [] ? __do_fault.isra.61+0x8a/0x100 [55696.465160] [] ? unlock_page+0x2b/0x30 [55696.471230] [] ? do_read_fault.isra.63+0x139/0x1b0 [55696.478449] [] core_sys_select+0x1ff/0x340 [55696.484881] [] ? handle_mm_fault+0x39d/0x9b0 [55696.491526] [] ? task_rq_unlock+0x20/0x20 [55696.497902] [] SyS_select+0xca/0x120 [55696.503800] [] ? system_call_after_swapgs+0xa2/0x146 [55696.511200] [] ? system_call_after_swapgs+0xae/0x146 [55696.518633] [] ? system_call_after_swapgs+0xa2/0x146 [55696.526031] [] ? system_call_after_swapgs+0xae/0x146 [55696.533465] [] system_call_fastpath+0x25/0x2a [55696.540206] [] ? system_call_after_swapgs+0xae/0x146 [55696.547617] munged S ffff9951677ea0e0 0 2975 1 0x00000080 [55696.555575] Call Trace: [55696.558335] [] schedule+0x29/0x70 [55696.563917] [] schedule_timeout+0x221/0x2d0 [55696.570481] [] ? __generic_file_aio_write+0x1e2/0x400 [55696.577975] [] ? prepare_to_wait_exclusive+0x56/0x90 [55696.585412] [] __skb_wait_for_more_packets+0x120/0x180 [55696.592990] [] ? datagram_poll+0x110/0x110 [55696.599434] [] __skb_recv_datagram+0x6f/0xd0 [55696.606054] [] skb_recv_datagram+0x43/0x60 [55696.612496] [] unix_accept+0x97/0x170 [55696.618453] [] SYSC_accept4+0x109/0x230 [55696.624607] [] ? __sb_end_write+0x31/0x70 [55696.630934] [] ? vfs_write+0x182/0x1f0 [55696.636968] [] ? system_call_after_swapgs+0xae/0x146 [55696.644381] [] ? system_call_after_swapgs+0xa2/0x146 [55696.651808] [] ? system_call_after_swapgs+0xae/0x146 [55696.659236] [] ? system_call_after_swapgs+0xa2/0x146 [55696.666648] [] ? system_call_after_swapgs+0xae/0x146 [55696.674076] [] SyS_accept4+0xe/0x10 [55696.679860] [] SyS_accept+0x10/0x20 [55696.685639] [] system_call_fastpath+0x25/0x2a [55696.692382] [] ? system_call_after_swapgs+0xae/0x146 [55696.699795] munged S ffff994d67aaa0e0 0 2990 1 0x00000080 [55696.707757] Call Trace: [55696.710539] [] schedule+0x29/0x70 [55696.716107] [] futex_wait_queue_me+0xc6/0x130 [55696.722849] [] futex_wait+0x17b/0x280 [55696.728827] [] ? hrtimer_get_res+0x50/0x50 [55696.735283] [] ? futex_wait_queue_me+0xa4/0x130 [55696.742236] [] do_futex+0x106/0x5a0 [55696.747984] [] SyS_futex+0x80/0x190 [55696.753751] [] system_call_fastpath+0x25/0x2a [55696.760507] [] ? system_call_after_swapgs+0xae/0x146 [55696.767899] munged S ffff994d67aa9070 0 2991 1 0x00000080 [55696.775843] Call Trace: [55696.778615] [] schedule+0x29/0x70 [55696.784196] [] futex_wait_queue_me+0xc6/0x130 [55696.790946] [] futex_wait+0x17b/0x280 [55696.796916] [] do_futex+0x106/0x5a0 [55696.802684] [] ? recalc_sigpending+0x1b/0x70 [55696.809343] [] ? __set_task_blocked+0x41/0xa0 [55696.816064] [] SyS_futex+0x80/0x190 [55696.821821] [] ? system_call_after_swapgs+0xa2/0x146 [55696.829255] [] ? system_call_after_swapgs+0xae/0x146 [55696.836684] [] ? system_call_after_swapgs+0xa2/0x146 [55696.844078] [] ? system_call_after_swapgs+0xae/0x146 [55696.851513] [] ? system_call_after_swapgs+0xa2/0x146 [55696.858911] [] ? system_call_after_swapgs+0xae/0x146 [55696.866341] [] system_call_fastpath+0x25/0x2a [55696.873062] [] ? system_call_after_swapgs+0xae/0x146 [55696.880482] munged S ffff995169e220e0 0 2992 1 0x00000080 [55696.888441] Call Trace: [55696.891171] [] schedule+0x29/0x70 [55696.896744] [] futex_wait_queue_me+0xc6/0x130 [55696.903494] [] futex_wait+0x17b/0x280 [55696.909450] [] ? pick_next_entity+0xa9/0x190 [55696.916075] [] ? set_next_entity+0x3c/0xe0 [55696.922542] [] ? pick_next_task_fair+0x6c3/0x870 [55696.929577] [] ? tracing_is_on+0x15/0x30 [55696.935834] [] do_futex+0x106/0x5a0 [55696.941620] [] ? schedule+0x29/0x70 [55696.947406] [] ? recalc_sigpending+0x1b/0x70 [55696.954023] [] ? __set_task_blocked+0x41/0xa0 [55696.960742] [] SyS_futex+0x80/0x190 [55696.966521] [] ? system_call_after_swapgs+0xa2/0x146 [55696.973933] [] ? system_call_after_swapgs+0xae/0x146 [55696.981344] [] ? system_call_after_swapgs+0xa2/0x146 [55696.988768] [] ? system_call_after_swapgs+0xae/0x146 [55696.996173] [] ? system_call_after_swapgs+0xa2/0x146 [55697.003594] [] ? system_call_after_swapgs+0xae/0x146 [55697.010985] [] system_call_fastpath+0x25/0x2a [55697.017721] [] ? system_call_after_swapgs+0xae/0x146 [55697.025147] xinetd S ffff995167403150 0 2981 1 0x00000080 [55697.033082] Call Trace: [55697.035842] [] schedule+0x29/0x70 [55697.041411] [] schedule_hrtimeout_range_clock+0x12d/0x150 [55697.049324] [] ? try_to_wake_up+0x190/0x390 [55697.055851] [] ? add_wait_queue+0x3c/0x50 [55697.062181] [] schedule_hrtimeout_range+0x13/0x20 [55697.069324] [] poll_schedule_timeout+0x55/0xc0 [55697.076163] [] do_sys_poll+0x48d/0x590 [55697.082236] [] ? radix_tree_lookup_slot+0x22/0x50 [55697.089359] [] ? __find_get_page+0x1e/0xa0 [55697.095799] [] ? filemap_fault+0x17e/0x490 [55697.102264] [] ? __wake_up_sync_key+0x1d/0x20 [55697.109014] [] ? ext4_filemap_fault+0x41/0x50 [ext4] [55697.116426] [] ? __pollwait+0xf0/0xf0 [55697.122385] [] ? unlock_page+0x2b/0x30 [55697.128441] [] ? do_read_fault.isra.63+0x139/0x1b0 [55697.135667] [] ? handle_pte_fault+0x22a/0xe20 [55697.142419] [] ? handle_mm_fault+0x39d/0x9b0 [55697.149043] [] ? __do_page_fault+0x238/0x500 [55697.155681] [] ? system_call_after_swapgs+0xae/0x146 [55697.163110] [] SyS_poll+0x74/0x110 [55697.168818] [] ? system_call_after_swapgs+0xa2/0x146 [55697.176235] [] ? system_call_after_swapgs+0xae/0x146 [55697.183657] [] system_call_fastpath+0x25/0x2a [55697.190392] [] ? system_call_after_swapgs+0xae/0x146 [55697.197828] nfsiod S ffff99516c0ce2a0 0 3007 2 0x00000080 [55697.205803] Call Trace: [55697.208554] [] schedule+0x29/0x70 [55697.214120] [] rescuer_thread+0x31e/0x3c0 [55697.220466] [] ? process_one_work+0x440/0x440 [55697.227210] [] kthread+0xd1/0xe0 [55697.232684] [] ? insert_kthread_work+0x40/0x40 [55697.239522] [] ret_from_fork_nospec_begin+0x21/0x21 [55697.246826] [] ? insert_kthread_work+0x40/0x40 [55697.253663] master S ffff9951677e9070 0 3230 1 0x00000080 [55697.261637] Call Trace: [55697.264404] [] schedule+0x29/0x70 [55697.269990] [] schedule_hrtimeout_range_clock+0xb2/0x150 [55697.277780] [] ? hrtimer_get_res+0x50/0x50 [55697.284230] [] ? schedule_hrtimeout_range_clock+0xa6/0x150 [55697.292213] [] schedule_hrtimeout_range+0x13/0x20 [55697.299348] [] ep_poll+0x23e/0x360 [55697.304996] [] ? wake_up_state+0x20/0x20 [55697.311269] [] SyS_epoll_wait+0xed/0x120 [55697.317508] [] ? system_call_after_swapgs+0xa2/0x146 [55697.324900] [] system_call_fastpath+0x25/0x2a [55697.331625] [] ? system_call_after_swapgs+0xae/0x146 [55697.339039] qmgr S ffff99516a911070 0 3235 3230 0x00000080 [55697.346986] Call Trace: [55697.349760] [] schedule+0x29/0x70 [55697.355324] [] schedule_hrtimeout_range_clock+0xb2/0x150 [55697.363128] [] ? hrtimer_get_res+0x50/0x50 [55697.369592] [] ? schedule_hrtimeout_range_clock+0xa6/0x150 [55697.377607] [] schedule_hrtimeout_range+0x13/0x20 [55697.384771] [] ep_poll+0x23e/0x360 [55697.390452] [] ? mntput+0x24/0x40 [55697.396032] [] ? wake_up_state+0x20/0x20 [55697.402298] [] SyS_epoll_wait+0xed/0x120 [55697.408561] [] ? system_call_after_swapgs+0xa2/0x146 [55697.415962] [] system_call_fastpath+0x25/0x2a [55697.422710] [] ? system_call_after_swapgs+0xae/0x146 [55697.430101] nfsv4.0-svc S ffff9949759db150 0 3273 2 0x00000080 [55697.438071] Call Trace: [55697.440847] [] ? icm_tr_xdomain_connected+0x131/0x160 [55697.448358] [] ? destroy_inode+0x3b/0x60 [55697.454607] [] schedule+0x29/0x70 [55697.460161] [] schedule_timeout+0x221/0x2d0 [55697.466701] [] ? kfree+0x106/0x140 [55697.472418] [] ? svc_xprt_free+0x77/0x90 [sunrpc] [55697.479570] [] svc_recv+0x980/0xa20 [sunrpc] [55697.486249] [] ? nfs_callback_authenticate+0x60/0x60 [nfsv4] [55697.494476] [] ? nfs_callback_authenticate+0x60/0x60 [nfsv4] [55697.502667] [] nfs4_callback_svc+0x33/0x60 [nfsv4] [55697.509896] [] kthread+0xd1/0xe0 [55697.515377] [] ? insert_kthread_work+0x40/0x40 [55697.522225] [] ret_from_fork_nospec_begin+0x21/0x21 [55697.529541] [] ? insert_kthread_work+0x40/0x40 [55697.536393] kworker/23:2 S ffff9949759dc1c0 0 3316 2 0x00000080 [55697.544333] Call Trace: [55697.547074] [] ? process_one_work+0x21a/0x440 [55697.553806] [] schedule+0x29/0x70 [55697.559368] [] worker_thread+0x1d9/0x3c0 [55697.565619] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55697.572944] [] kthread+0xd1/0xe0 [55697.578434] [] ? insert_kthread_work+0x40/0x40 [55697.585280] [] ret_from_fork_nospec_begin+0x21/0x21 [55697.592596] [] ? insert_kthread_work+0x40/0x40 [55697.599441] automount S ffff994d6c0b5230 0 3320 1 0x00000080 [55697.607407] Call Trace: [55697.610145] [] schedule+0x29/0x70 [55697.615758] [] schedule_hrtimeout_range_clock+0x12d/0x150 [55697.623680] [] ? sock_destroy_inode+0x2f/0x40 [55697.630438] [] ? recalc_sigpending+0x1b/0x70 [55697.637055] [] schedule_hrtimeout_range+0x13/0x20 [55697.644187] [] do_sigtimedwait+0x196/0x240 [55697.650632] [] SYSC_rt_sigtimedwait+0xb4/0x120 [55697.657480] [] ? mntput+0x24/0x40 [55697.663029] [] ? __fput+0x186/0x260 [55697.668786] [] ? system_call_after_swapgs+0xae/0x146 [55697.676201] [] ? system_call_after_swapgs+0xa2/0x146 [55697.683636] [] ? system_call_after_swapgs+0xae/0x146 [55697.691029] [] ? system_call_after_swapgs+0xa2/0x146 [55697.698448] [] ? system_call_after_swapgs+0xae/0x146 [55697.705841] [] ? system_call_after_swapgs+0xa2/0x146 [55697.713254] [] ? system_call_after_swapgs+0xae/0x146 [55697.720683] [] ? system_call_after_swapgs+0xa2/0x146 [55697.728066] [] ? system_call_after_swapgs+0xae/0x146 [55697.735492] [] SyS_rt_sigtimedwait+0xe/0x10 [55697.742011] [] system_call_fastpath+0x25/0x2a [55697.748729] [] ? system_call_after_swapgs+0xae/0x146 [55697.756153] automount S ffff994d6c0b20e0 0 3361 1 0x00000080 [55697.764130] Call Trace: [55697.766862] [] schedule+0x29/0x70 [55697.772435] [] futex_wait_queue_me+0xc6/0x130 [55697.779184] [] futex_wait+0x17b/0x280 [55697.785151] [] ? hrtimer_get_res+0x50/0x50 [55697.791603] [] ? futex_wait_queue_me+0xa4/0x130 [55697.798554] [] do_futex+0x106/0x5a0 [55697.804320] [] ? __check_object_size+0x198/0x250 [55697.811356] [] SyS_futex+0x80/0x190 [55697.817136] [] system_call_fastpath+0x25/0x2a [55697.823859] [] ? system_call_after_swapgs+0xae/0x146 [55697.831276] automount S ffff994d6c0b1070 0 3362 1 0x00000080 [55697.839261] Call Trace: [55697.842001] [] schedule+0x29/0x70 [55697.847572] [] futex_wait_queue_me+0xc6/0x130 [55697.854329] [] futex_wait+0x17b/0x280 [55697.860294] [] ? sched_slice.isra.56+0x66/0xc0 [55697.867097] [] ? get_futex_key+0x1c8/0x2c0 [55697.873533] [] do_futex+0x106/0x5a0 [55697.879300] [] ? check_preempt_curr+0x80/0xa0 [55697.886022] [] ? wake_up_new_task+0x131/0x1a0 [55697.892793] [] SyS_futex+0x80/0x190 [55697.898572] [] ? system_call_after_swapgs+0xa2/0x146 [55697.905969] [] ? system_call_after_swapgs+0xae/0x146 [55697.913403] [] ? system_call_after_swapgs+0xa2/0x146 [55697.920805] [] ? system_call_after_swapgs+0xae/0x146 [55697.928238] [] ? system_call_after_swapgs+0xa2/0x146 [55697.935668] [] ? system_call_after_swapgs+0xae/0x146 [55697.943068] [] system_call_fastpath+0x25/0x2a [55697.949807] [] ? system_call_after_swapgs+0xae/0x146 [55697.957218] automount S ffff994d586e5230 0 3552 1 0x00000080 [55697.965182] Call Trace: [55697.967947] [] schedule+0x29/0x70 [55697.973524] [] schedule_hrtimeout_range_clock+0x12d/0x150 [55697.981422] [] ? add_wait_queue+0x3c/0x50 [55697.987760] [] schedule_hrtimeout_range+0x13/0x20 [55697.994883] [] poll_schedule_timeout+0x55/0xc0 [55698.001742] [] do_sys_poll+0x48d/0x590 [55698.007800] [] ? radix_tree_lookup_slot+0x22/0x50 [55698.014901] [] ? __find_get_page+0x1e/0xa0 [55698.021368] [] ? filemap_fault+0x17e/0x490 [55698.027823] [] ? enqueue_entity+0x2ef/0xbe0 [55698.034392] [] ? ext4_filemap_fault+0x41/0x50 [ext4] [55698.041794] [] ? __pollwait+0xf0/0xf0 [55698.047733] [] ? __pollwait+0xf0/0xf0 [55698.053698] [] ? __pollwait+0xf0/0xf0 [55698.059659] [] ? handle_pte_fault+0x22a/0xe20 [55698.066414] [] ? handle_mm_fault+0x39d/0x9b0 [55698.073067] [] ? __do_page_fault+0x238/0x500 [55698.079732] [] ? system_call_after_swapgs+0xae/0x146 [55698.087165] [] SyS_poll+0x74/0x110 [55698.092815] [] ? system_call_after_swapgs+0xa2/0x146 [55698.100236] [] ? system_call_after_swapgs+0xae/0x146 [55698.107651] [] system_call_fastpath+0x25/0x2a [55698.114401] [] ? system_call_after_swapgs+0xae/0x146 [55698.121798] automount S ffff994d586e62a0 0 3555 1 0x00000080 [55698.129730] Call Trace: [55698.132489] [] schedule+0x29/0x70 [55698.138042] [] schedule_hrtimeout_range_clock+0x12d/0x150 [55698.145926] [] ? add_wait_queue+0x3c/0x50 [55698.152272] [] schedule_hrtimeout_range+0x13/0x20 [55698.159416] [] poll_schedule_timeout+0x55/0xc0 [55698.166260] [] do_sys_poll+0x48d/0x590 [55698.172330] [] ? __d_alloc+0x25/0x180 [55698.178303] [] ? mntput+0x24/0x40 [55698.183873] [] ? __enqueue_entity+0x78/0x80 [55698.190426] [] ? enqueue_entity+0x2ef/0xbe0 [55698.196947] [] ? select_task_rq_fair+0x5a6/0x760 [55698.203944] [] ? tracing_record_cmdline+0x1d/0x120 [55698.211179] [] ? __pollwait+0xf0/0xf0 [55698.217159] [] ? __pollwait+0xf0/0xf0 [55698.223117] [] ? __pollwait+0xf0/0xf0 [55698.229085] [] ? futex_wake_op+0x3b5/0x640 [55698.235544] [] ? do_futex+0x17a/0x5a0 [55698.241520] [] ? autofs_dev_ioctl+0x13/0x20 [55698.248041] [] ? do_vfs_ioctl+0x3a0/0x5a0 [55698.254386] [] ? system_call_after_swapgs+0xae/0x146 [55698.261806] [] SyS_poll+0x74/0x110 [55698.267497] [] ? system_call_after_swapgs+0xa2/0x146 [55698.274889] [] ? system_call_after_swapgs+0xae/0x146 [55698.282322] [] system_call_fastpath+0x25/0x2a [55698.289071] [] ? system_call_after_swapgs+0xae/0x146 [55698.296474] automount S ffff994d586e41c0 0 3556 1 0x00000080 [55698.304439] Call Trace: [55698.307202] [] ? __find_get_block+0xbc/0x120 [55698.313826] [] schedule+0x29/0x70 [55698.319417] [] schedule_hrtimeout_range_clock+0x12d/0x150 [55698.327329] [] ? add_wait_queue+0x3c/0x50 [55698.333681] [] schedule_hrtimeout_range+0x13/0x20 [55698.340784] [] poll_schedule_timeout+0x55/0xc0 [55698.347614] [] do_sys_poll+0x48d/0x590 [55698.353671] [] ? put_prev_entity+0x31/0x400 [55698.360226] [] ? __switch_to+0x151/0x580 [55698.366488] [] ? __schedule+0x402/0x840 [55698.372652] [] ? __pollwait+0xf0/0xf0 [55698.378632] [] ? __pollwait+0xf0/0xf0 [55698.384613] [] ? __pollwait+0xf0/0xf0 [55698.390593] [] ? hrtimer_get_res+0x50/0x50 [55698.397049] [] ? get_futex_key+0x1c8/0x2c0 [55698.403517] [] ? futex_wake+0x90/0x180 [55698.409590] [] ? do_futex+0x12a/0x5a0 [55698.415557] [] ? check_preempt_curr+0x80/0xa0 [55698.422290] [] ? wake_up_new_task+0x131/0x1a0 [55698.429005] [] ? system_call_after_swapgs+0xae/0x146 [55698.436416] [] SyS_poll+0x74/0x110 [55698.442099] [] ? system_call_after_swapgs+0xa2/0x146 [55698.449502] [] ? system_call_after_swapgs+0xae/0x146 [55698.456917] [] system_call_fastpath+0x25/0x2a [55698.463682] [] ? system_call_after_swapgs+0xae/0x146 [55698.471116] automount S ffff994d586e3150 0 3557 1 0x00000080 [55698.479062] Call Trace: [55698.481802] [] ? lru_cache_add+0xe/0x10 [55698.487941] [] schedule+0x29/0x70 [55698.493520] [] schedule_hrtimeout_range_clock+0x12d/0x150 [55698.501441] [] ? add_wait_queue+0x3c/0x50 [55698.507779] [] schedule_hrtimeout_range+0x13/0x20 [55698.514886] [] poll_schedule_timeout+0x55/0xc0 [55698.521703] [] do_sys_poll+0x48d/0x590 [55698.527757] [] ? __d_lookup+0x7a/0x160 [55698.533795] [] ? mntput+0x24/0x40 [55698.539365] [] ? terminate_walk+0x49/0x50 [55698.545698] [] ? __enqueue_entity+0x78/0x80 [55698.552245] [] ? enqueue_entity+0x2ef/0xbe0 [55698.558801] [] ? path_mountpoint+0x359/0x430 [55698.565452] [] ? select_task_rq_fair+0x5a6/0x760 [55698.572476] [] ? tracing_record_cmdline+0x1d/0x120 [55698.579701] [] ? __pollwait+0xf0/0xf0 [55698.585698] [] ? __pollwait+0xf0/0xf0 [55698.591699] [] ? __pollwait+0xf0/0xf0 [55698.597684] [] ? futex_wake_op+0x3b5/0x640 [55698.604136] [] ? do_futex+0x17a/0x5a0 [55698.610109] [] ? autofs_dev_ioctl+0x13/0x20 [55698.616677] [] ? do_vfs_ioctl+0x3a0/0x5a0 [55698.623011] [] ? system_call_after_swapgs+0xae/0x146 [55698.630436] [] SyS_poll+0x74/0x110 [55698.636105] [] ? system_call_after_swapgs+0xa2/0x146 [55698.643520] [] ? system_call_after_swapgs+0xae/0x146 [55698.650920] [] system_call_fastpath+0x25/0x2a [55698.657689] [] ? system_call_after_swapgs+0xae/0x146 [55698.665122] atd S ffff994d6c0b3150 0 3321 1 0x00000080 [55698.673091] Call Trace: [55698.675852] [] ? hrtimer_start_range_ns+0x1fd/0x3c0 [55698.683165] [] schedule+0x29/0x70 [55698.688733] [] do_nanosleep+0x70/0x100 [55698.694765] [] hrtimer_nanosleep+0xbb/0x180 [55698.701308] [] ? hrtimer_get_res+0x50/0x50 [55698.707738] [] ? do_nanosleep+0x5b/0x100 [55698.713962] [] SyS_nanosleep+0x96/0xb0 [55698.719998] [] system_call_fastpath+0x25/0x2a [55698.726725] [] ? system_call_after_swapgs+0xae/0x146 [55698.734143] crond S ffff994d6c0b0000 0 3324 1 0x00000080 [55698.742086] Call Trace: [55698.744846] [] ? hrtimer_start_range_ns+0x1fd/0x3c0 [55698.752170] [] schedule+0x29/0x70 [55698.757722] [] do_nanosleep+0x70/0x100 [55698.763757] [] hrtimer_nanosleep+0xbb/0x180 [55698.770300] [] ? hrtimer_get_res+0x50/0x50 [55698.776729] [] ? do_nanosleep+0x5b/0x100 [55698.782971] [] SyS_nanosleep+0x96/0xb0 [55698.789021] [] system_call_fastpath+0x25/0x2a [55698.795752] [] ? system_call_after_swapgs+0xae/0x146 [55698.803179] agetty S ffff994d68928000 0 3355 1 0x00000080 [55698.811165] Call Trace: [55698.813905] [] schedule+0x29/0x70 [55698.819477] [] schedule_timeout+0x221/0x2d0 [55698.826007] [] ? flush_work+0x47/0x1b0 [55698.832082] [] n_tty_read+0x2b0/0xd10 [55698.838038] [] ? task_rq_unlock+0x20/0x20 [55698.844395] [] ? wake_up_state+0x20/0x20 [55698.850710] [] tty_read+0x90/0x100 [55698.856401] [] vfs_read+0x9f/0x170 [55698.862085] [] SyS_read+0x7f/0xf0 [55698.867651] [] ? system_call_after_swapgs+0xae/0x146 [55698.875074] [] system_call_fastpath+0x25/0x2a [55698.881789] [] ? system_call_after_swapgs+0xae/0x146 [55698.889198] agetty S ffff994d6892d230 0 3358 1 0x00000080 [55698.897142] Call Trace: [55698.899888] [] schedule+0x29/0x70 [55698.905460] [] schedule_timeout+0x221/0x2d0 [55698.911996] [] ? flush_work+0x47/0x1b0 [55698.918038] [] ? serial8250_start_tx+0xa5/0xe0 [55698.924852] [] n_tty_read+0x2b0/0xd10 [55698.930792] [] ? task_rq_unlock+0x20/0x20 [55698.937148] [] ? wake_up_state+0x20/0x20 [55698.943420] [] tty_read+0x90/0x100 [55698.949096] [] vfs_read+0x9f/0x170 [55698.954744] [] SyS_read+0x7f/0xf0 [55698.960306] [] ? system_call_after_swapgs+0xae/0x146 [55698.967746] [] system_call_fastpath+0x25/0x2a [55698.974496] [] ? system_call_after_swapgs+0xae/0x146 [55698.981889] kworker/u308:1 S ffff9949759d8000 0 3848 2 0x00000080 [55698.989834] Call Trace: [55698.992605] [] ? ib_cq_poll_work+0x45/0x60 [ib_core] [55699.000007] [] ? process_one_work+0x21a/0x440 [55699.006747] [] schedule+0x29/0x70 [55699.012332] [] worker_thread+0x1d9/0x3c0 [55699.018591] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55699.025894] [] kthread+0xd1/0xe0 [55699.031384] [] ? insert_kthread_work+0x40/0x40 [55699.038217] [] ret_from_fork_nospec_begin+0x21/0x21 [55699.045555] [] ? insert_kthread_work+0x40/0x40 [55699.052403] kworker/22:2 S ffff9949759da0e0 0 3849 2 0x00000080 [55699.060419] Call Trace: [55699.063201] [] ? process_one_work+0x21a/0x440 [55699.069945] [] schedule+0x29/0x70 [55699.075539] [] worker_thread+0x1d9/0x3c0 [55699.081789] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55699.089105] [] kthread+0xd1/0xe0 [55699.094590] [] ? insert_kthread_work+0x40/0x40 [55699.101423] [] ret_from_fork_nospec_begin+0x21/0x21 [55699.108752] [] ? insert_kthread_work+0x40/0x40 [55699.115599] ntpd S ffff995167400000 0 3976 1 0x00000080 [55699.123590] Call Trace: [55699.126356] [] schedule+0x29/0x70 [55699.131914] [] schedule_hrtimeout_range_clock+0xb2/0x150 [55699.139702] [] ? hrtimer_get_res+0x50/0x50 [55699.146144] [] ? schedule_hrtimeout_range_clock+0xa6/0x150 [55699.154145] [] schedule_hrtimeout_range+0x13/0x20 [55699.161268] [] poll_schedule_timeout+0x55/0xc0 [55699.168121] [] do_select+0x6d1/0x7c0 [55699.173973] [] ? put_cmsg+0xcd/0x150 [55699.179827] [] ? number.isra.2+0x323/0x360 [55699.186293] [] ? __pollwait+0xf0/0xf0 [55699.192273] [] ? __pollwait+0xf0/0xf0 [55699.198245] [] ? __pollwait+0xf0/0xf0 [55699.204212] [] ? __pollwait+0xf0/0xf0 [55699.210190] [] ? __pollwait+0xf0/0xf0 [55699.216170] [] ? __pollwait+0xf0/0xf0 [55699.222136] [] ? __pollwait+0xf0/0xf0 [55699.228101] [] ? __pollwait+0xf0/0xf0 [55699.234059] [] ? __pollwait+0xf0/0xf0 [55699.240004] [] core_sys_select+0x1ff/0x340 [55699.246462] [] ? __d_free+0x35/0x40 [55699.252242] [] ? d_free+0x60/0x70 [55699.257792] [] ? __dentry_kill+0x130/0x190 [55699.264252] [] ? ktime_get_ts64+0x52/0xf0 [55699.270621] [] SyS_select+0xca/0x120 [55699.276484] [] system_call_fastpath+0x25/0x2a [55699.283226] [] ? system_call_after_swapgs+0xae/0x146 [55699.290630] kworker/12:2 S ffff99516c6362a0 0 4425 2 0x00000080 [55699.298627] Call Trace: [55699.301400] [] schedule+0x29/0x70 [55699.306987] [] worker_thread+0x1d9/0x3c0 [55699.313260] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55699.320578] [] kthread+0xd1/0xe0 [55699.326037] [] ? insert_kthread_work+0x40/0x40 [55699.332847] [] ret_from_fork_nospec_begin+0x21/0x21 [55699.340170] [] ? insert_kthread_work+0x40/0x40 [55699.346978] kworker/5:1H S ffff994d6c7c20e0 0 4805 2 0x00000080 [55699.354933] Call Trace: [55699.357726] [] ? process_one_work+0x21a/0x440 [55699.364467] [] schedule+0x29/0x70 [55699.370047] [] worker_thread+0x1d9/0x3c0 [55699.376313] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55699.383643] [] kthread+0xd1/0xe0 [55699.389116] [] ? insert_kthread_work+0x40/0x40 [55699.395928] [] ret_from_fork_nospec_begin+0x21/0x21 [55699.403266] [] ? insert_kthread_work+0x40/0x40 [55699.410096] ptlrpc_hr00_000 S ffff994d688462a0 0 4816 2 0x00000080 [55699.418055] Call Trace: [55699.420823] [] schedule+0x29/0x70 [55699.426521] [] ptlrpc_hr_main+0x46c/0x560 [ptlrpc] [55699.433734] [] ? wake_up_atomic_t+0x30/0x30 [55699.440343] [] ? ptlrpc_handle_rs+0x5f0/0x5f0 [ptlrpc] [55699.447974] [] kthread+0xd1/0xe0 [55699.453472] [] ? insert_kthread_work+0x40/0x40 [55699.460318] [] ret_from_fork_nospec_begin+0x21/0x21 [55699.467610] [] ? insert_kthread_work+0x40/0x40 [55699.474463] ptlrpc_hr00_001 S ffff994d68843150 0 4817 2 0x00000080 [55699.482442] Call Trace: [55699.485195] [] schedule+0x29/0x70 [55699.490825] [] ptlrpc_hr_main+0x46c/0x560 [ptlrpc] [55699.498065] [] ? wake_up_atomic_t+0x30/0x30 [55699.504713] [] ? ptlrpc_handle_rs+0x5f0/0x5f0 [ptlrpc] [55699.512336] [] kthread+0xd1/0xe0 [55699.517796] [] ? insert_kthread_work+0x40/0x40 [55699.524608] [] ret_from_fork_nospec_begin+0x21/0x21 [55699.531924] [] ? insert_kthread_work+0x40/0x40 [55699.538735] ptlrpc_hr00_002 S ffff994d68845230 0 4818 2 0x00000080 [55699.546711] Call Trace: [55699.549478] [] schedule+0x29/0x70 [55699.555127] [] ptlrpc_hr_main+0x46c/0x560 [ptlrpc] [55699.562372] [] ? wake_up_atomic_t+0x30/0x30 [55699.568964] [] ? ptlrpc_handle_rs+0x5f0/0x5f0 [ptlrpc] [55699.576610] [] kthread+0xd1/0xe0 [55699.582100] [] ? insert_kthread_work+0x40/0x40 [55699.588941] [] ret_from_fork_nospec_begin+0x21/0x21 [55699.596257] [] ? insert_kthread_work+0x40/0x40 [55699.603095] ptlrpc_hr00_003 S ffff994d688420e0 0 4819 2 0x00000080 [55699.611034] Call Trace: [55699.613777] [] schedule+0x29/0x70 [55699.619433] [] ptlrpc_hr_main+0x46c/0x560 [ptlrpc] [55699.626650] [] ? wake_up_atomic_t+0x30/0x30 [55699.633267] [] ? ptlrpc_handle_rs+0x5f0/0x5f0 [ptlrpc] [55699.640866] [] kthread+0xd1/0xe0 [55699.646361] [] ? insert_kthread_work+0x40/0x40 [55699.653194] [] ret_from_fork_nospec_begin+0x21/0x21 [55699.660509] [] ? insert_kthread_work+0x40/0x40 [55699.667361] ptlrpc_hr00_004 S ffff995169360000 0 4820 2 0x00000080 [55699.675365] Call Trace: [55699.678134] [] schedule+0x29/0x70 [55699.683751] [] ptlrpc_hr_main+0x46c/0x560 [ptlrpc] [55699.690991] [] ? wake_up_atomic_t+0x30/0x30 [55699.697624] [] ? ptlrpc_handle_rs+0x5f0/0x5f0 [ptlrpc] [55699.705258] [] kthread+0xd1/0xe0 [55699.710714] [] ? insert_kthread_work+0x40/0x40 [55699.717556] [] ret_from_fork_nospec_begin+0x21/0x21 [55699.724852] [] ? insert_kthread_work+0x40/0x40 [55699.731668] ptlrpc_hr00_005 S ffff995169361070 0 4821 2 0x00000080 [55699.739628] Call Trace: [55699.742389] [] schedule+0x29/0x70 [55699.748029] [] ptlrpc_hr_main+0x46c/0x560 [ptlrpc] [55699.755277] [] ? wake_up_atomic_t+0x30/0x30 [55699.761867] [] ? ptlrpc_handle_rs+0x5f0/0x5f0 [ptlrpc] [55699.769507] [] kthread+0xd1/0xe0 [55699.774998] [] ? insert_kthread_work+0x40/0x40 [55699.781846] [] ret_from_fork_nospec_begin+0x21/0x21 [55699.789185] [] ? insert_kthread_work+0x40/0x40 [55699.796016] ptlrpc_hr00_006 S ffff995169363150 0 4822 2 0x00000080 [55699.804016] Call Trace: [55699.806776] [] schedule+0x29/0x70 [55699.812420] [] ptlrpc_hr_main+0x46c/0x560 [ptlrpc] [55699.819679] [] ? wake_up_atomic_t+0x30/0x30 [55699.826306] [] ? ptlrpc_handle_rs+0x5f0/0x5f0 [ptlrpc] [55699.833938] [] kthread+0xd1/0xe0 [55699.839436] [] ? insert_kthread_work+0x40/0x40 [55699.846283] [] ret_from_fork_nospec_begin+0x21/0x21 [55699.853643] [] ? insert_kthread_work+0x40/0x40 [55699.860489] ptlrpc_hr00_007 S ffff995169365230 0 4823 2 0x00000080 [55699.868489] Call Trace: [55699.871248] [] schedule+0x29/0x70 [55699.876891] [] ptlrpc_hr_main+0x46c/0x560 [ptlrpc] [55699.884131] [] ? wake_up_atomic_t+0x30/0x30 [55699.890754] [] ? ptlrpc_handle_rs+0x5f0/0x5f0 [ptlrpc] [55699.898386] [] kthread+0xd1/0xe0 [55699.903878] [] ? insert_kthread_work+0x40/0x40 [55699.910727] [] ret_from_fork_nospec_begin+0x21/0x21 [55699.918060] [] ? insert_kthread_work+0x40/0x40 [55699.924890] ptlrpc_hr01_000 S ffff9951693620e0 0 4824 2 0x00000080 [55699.932847] Call Trace: [55699.935607] [] schedule+0x29/0x70 [55699.941264] [] ptlrpc_hr_main+0x46c/0x560 [ptlrpc] [55699.948503] [] ? wake_up_atomic_t+0x30/0x30 [55699.955126] [] ? ptlrpc_handle_rs+0x5f0/0x5f0 [ptlrpc] [55699.962757] [] kthread+0xd1/0xe0 [55699.968246] [] ? insert_kthread_work+0x40/0x40 [55699.975093] [] ret_from_fork_nospec_begin+0x21/0x21 [55699.982431] [] ? insert_kthread_work+0x40/0x40 [55699.989283] ptlrpc_hr01_001 S ffff99516c635230 0 4825 2 0x00000080 [55699.997301] Call Trace: [55700.000060] [] schedule+0x29/0x70 [55700.005730] [] ptlrpc_hr_main+0x46c/0x560 [ptlrpc] [55700.012969] [] ? wake_up_atomic_t+0x30/0x30 [55700.019606] [] ? ptlrpc_handle_rs+0x5f0/0x5f0 [ptlrpc] [55700.027240] [] kthread+0xd1/0xe0 [55700.032730] [] ? insert_kthread_work+0x40/0x40 [55700.039600] [] ret_from_fork_nospec_begin+0x21/0x21 [55700.046932] [] ? insert_kthread_work+0x40/0x40 [55700.053779] ptlrpc_hr01_002 S ffff99516c633150 0 4826 2 0x00000080 [55700.061756] Call Trace: [55700.064519] [] schedule+0x29/0x70 [55700.070174] [] ptlrpc_hr_main+0x46c/0x560 [ptlrpc] [55700.077428] [] ? wake_up_atomic_t+0x30/0x30 [55700.084040] [] ? ptlrpc_handle_rs+0x5f0/0x5f0 [ptlrpc] [55700.091691] [] kthread+0xd1/0xe0 [55700.097191] [] ? insert_kthread_work+0x40/0x40 [55700.104031] [] ret_from_fork_nospec_begin+0x21/0x21 [55700.111363] [] ? insert_kthread_work+0x40/0x40 [55700.118216] ptlrpc_hr01_003 S ffff99516c6341c0 0 4827 2 0x00000080 [55700.126220] Call Trace: [55700.128980] [] schedule+0x29/0x70 [55700.134656] [] ptlrpc_hr_main+0x46c/0x560 [ptlrpc] [55700.141885] [] ? wake_up_atomic_t+0x30/0x30 [55700.148505] [] ? ptlrpc_handle_rs+0x5f0/0x5f0 [ptlrpc] [55700.156131] [] kthread+0xd1/0xe0 [55700.161643] [] ? insert_kthread_work+0x40/0x40 [55700.168499] [] ret_from_fork_nospec_begin+0x21/0x21 [55700.175830] [] ? insert_kthread_work+0x40/0x40 [55700.182673] ptlrpc_hr01_004 S ffff99516c630000 0 4828 2 0x00000080 [55700.190662] Call Trace: [55700.193422] [] schedule+0x29/0x70 [55700.199066] [] ptlrpc_hr_main+0x46c/0x560 [ptlrpc] [55700.206314] [] ? wake_up_atomic_t+0x30/0x30 [55700.212926] [] ? ptlrpc_handle_rs+0x5f0/0x5f0 [ptlrpc] [55700.220576] [] kthread+0xd1/0xe0 [55700.226059] [] ? insert_kthread_work+0x40/0x40 [55700.232906] [] ret_from_fork_nospec_begin+0x21/0x21 [55700.240244] [] ? insert_kthread_work+0x40/0x40 [55700.247098] ptlrpc_hr01_005 S ffff99516c631070 0 4829 2 0x00000080 [55700.255098] Call Trace: [55700.257856] [] schedule+0x29/0x70 [55700.263506] [] ptlrpc_hr_main+0x46c/0x560 [ptlrpc] [55700.270747] [] ? wake_up_atomic_t+0x30/0x30 [55700.277356] [] ? ptlrpc_handle_rs+0x5f0/0x5f0 [ptlrpc] [55700.284983] [] kthread+0xd1/0xe0 [55700.290481] [] ? insert_kthread_work+0x40/0x40 [55700.297334] [] ret_from_fork_nospec_begin+0x21/0x21 [55700.304669] [] ? insert_kthread_work+0x40/0x40 [55700.311515] ptlrpc_hr01_006 S ffff99516c6320e0 0 4830 2 0x00000080 [55700.319512] Call Trace: [55700.322285] [] schedule+0x29/0x70 [55700.327941] [] ptlrpc_hr_main+0x46c/0x560 [ptlrpc] [55700.335186] [] ? wake_up_atomic_t+0x30/0x30 [55700.341806] [] ? ptlrpc_handle_rs+0x5f0/0x5f0 [ptlrpc] [55700.349448] [] kthread+0xd1/0xe0 [55700.354939] [] ? insert_kthread_work+0x40/0x40 [55700.361779] [] ret_from_fork_nospec_begin+0x21/0x21 [55700.369118] [] ? insert_kthread_work+0x40/0x40 [55700.375962] ptlrpc_hr01_007 S ffff995166f70000 0 4831 2 0x00000080 [55700.383973] Call Trace: [55700.386746] [] schedule+0x29/0x70 [55700.392401] [] ptlrpc_hr_main+0x46c/0x560 [ptlrpc] [55700.399659] [] ? wake_up_atomic_t+0x30/0x30 [55700.406284] [] ? ptlrpc_handle_rs+0x5f0/0x5f0 [ptlrpc] [55700.413910] [] kthread+0xd1/0xe0 [55700.419393] [] ? insert_kthread_work+0x40/0x40 [55700.426248] [] ret_from_fork_nospec_begin+0x21/0x21 [55700.433613] [] ? insert_kthread_work+0x40/0x40 [55700.440472] kiblnd_connd S ffff995166f762a0 0 4841 2 0x00000080 [55700.448477] Call Trace: [55700.451237] [] schedule+0x29/0x70 [55700.456825] [] schedule_timeout+0x168/0x2d0 [55700.463404] [] ? kiblnd_check_conns+0x52f/0x880 [ko2iblnd] [55700.471421] [] ? __internal_add_timer+0x130/0x130 [55700.478605] [] kiblnd_connd+0x5f9/0x9d0 [ko2iblnd] [55700.485840] [] ? __schedule+0x402/0x840 [55700.491997] [] ? wake_up_state+0x20/0x20 [55700.498274] [] ? kiblnd_cm_callback+0x23a0/0x23a0 [ko2iblnd] [55700.506490] [] kthread+0xd1/0xe0 [55700.511973] [] ? insert_kthread_work+0x40/0x40 [55700.518819] [] ret_from_fork_nospec_begin+0x21/0x21 [55700.526159] [] ? insert_kthread_work+0x40/0x40 [55700.533006] kiblnd_sd_00_00 S ffff994d6b750000 0 4842 2 0x00000080 [55700.541000] Call Trace: [55700.543759] [] schedule+0x29/0x70 [55700.549346] [] kiblnd_scheduler+0x32c/0x1190 [ko2iblnd] [55700.557052] [] ? put_prev_entity+0x31/0x400 [55700.563620] [] ? __switch_to+0xce/0x580 [55700.569788] [] ? wake_up_state+0x20/0x20 [55700.576065] [] ? kiblnd_cq_event+0x90/0x90 [ko2iblnd] [55700.583622] [] kthread+0xd1/0xe0 [55700.589119] [] ? insert_kthread_work+0x40/0x40 [55700.595951] [] ret_from_fork_nospec_begin+0x21/0x21 [55700.603289] [] ? insert_kthread_work+0x40/0x40 [55700.610146] kiblnd_sd_00_01 S ffff994d6b755230 0 4843 2 0x00000080 [55700.618161] Call Trace: [55700.620914] [] schedule+0x29/0x70 [55700.626523] [] kiblnd_scheduler+0x32c/0x1190 [ko2iblnd] [55700.634242] [] ? put_prev_entity+0x31/0x400 [55700.640804] [] ? __switch_to+0xce/0x580 [55700.646959] [] ? wake_up_state+0x20/0x20 [55700.653231] [] ? kiblnd_cq_event+0x90/0x90 [ko2iblnd] [55700.660751] [] kthread+0xd1/0xe0 [55700.666247] [] ? insert_kthread_work+0x40/0x40 [55700.673101] [] ret_from_fork_nospec_begin+0x21/0x21 [55700.680439] [] ? insert_kthread_work+0x40/0x40 [55700.687290] kiblnd_sd_00_02 S ffff994d6b7562a0 0 4844 2 0x00000080 [55700.695301] Call Trace: [55700.698066] [] schedule+0x29/0x70 [55700.703663] [] kiblnd_scheduler+0x32c/0x1190 [ko2iblnd] [55700.711390] [] ? put_prev_entity+0x31/0x400 [55700.717946] [] ? __switch_to+0xce/0x580 [55700.724114] [] ? wake_up_state+0x20/0x20 [55700.730390] [] ? kiblnd_cq_event+0x90/0x90 [ko2iblnd] [55700.737917] [] kthread+0xd1/0xe0 [55700.743414] [] ? insert_kthread_work+0x40/0x40 [55700.750263] [] ret_from_fork_nospec_begin+0x21/0x21 [55700.757615] [] ? insert_kthread_work+0x40/0x40 [55700.764454] kiblnd_sd_00_03 S ffff994d6b753150 0 4845 2 0x00000080 [55700.772420] Call Trace: [55700.775195] [] schedule+0x29/0x70 [55700.780780] [] kiblnd_scheduler+0x32c/0x1190 [ko2iblnd] [55700.788509] [] ? put_prev_entity+0x31/0x400 [55700.795065] [] ? __switch_to+0xce/0x580 [55700.801239] [] ? wake_up_state+0x20/0x20 [55700.807524] [] ? kiblnd_cq_event+0x90/0x90 [ko2iblnd] [55700.815065] [] kthread+0xd1/0xe0 [55700.820561] [] ? insert_kthread_work+0x40/0x40 [55700.827428] [] ret_from_fork_nospec_begin+0x21/0x21 [55700.834752] [] ? insert_kthread_work+0x40/0x40 [55700.841624] kiblnd_sd_01_00 S ffff994d6b7520e0 0 4846 2 0x00000080 [55700.849603] Call Trace: [55700.852369] [] schedule+0x29/0x70 [55700.857953] [] kiblnd_scheduler+0x32c/0x1190 [ko2iblnd] [55700.865676] [] ? put_prev_entity+0x31/0x400 [55700.872216] [] ? __switch_to+0xce/0x580 [55700.878394] [] ? wake_up_state+0x20/0x20 [55700.884651] [] ? kiblnd_cq_event+0x90/0x90 [ko2iblnd] [55700.892169] [] kthread+0xd1/0xe0 [55700.897660] [] ? insert_kthread_work+0x40/0x40 [55700.904535] [] ret_from_fork_nospec_begin+0x21/0x21 [55700.911865] [] ? insert_kthread_work+0x40/0x40 [55700.918710] kiblnd_sd_01_01 S ffff994d6b7541c0 0 4847 2 0x00000080 [55700.926685] Call Trace: [55700.929453] [] schedule+0x29/0x70 [55700.935053] [] kiblnd_scheduler+0x32c/0x1190 [ko2iblnd] [55700.942765] [] ? put_prev_entity+0x31/0x400 [55700.949328] [] ? __switch_to+0xce/0x580 [55700.955520] [] ? wake_up_state+0x20/0x20 [55700.961796] [] ? kiblnd_cq_event+0x90/0x90 [ko2iblnd] [55700.969330] [] kthread+0xd1/0xe0 [55700.974819] [] ? insert_kthread_work+0x40/0x40 [55700.981665] [] ret_from_fork_nospec_begin+0x21/0x21 [55700.988990] [] ? insert_kthread_work+0x40/0x40 [55700.995831] kiblnd_sd_01_02 S ffff995168115230 0 4848 2 0x00000080 [55701.003782] Call Trace: [55701.006548] [] schedule+0x29/0x70 [55701.012147] [] kiblnd_scheduler+0x32c/0x1190 [ko2iblnd] [55701.019859] [] ? put_prev_entity+0x31/0x400 [55701.026415] [] ? __switch_to+0xce/0x580 [55701.032599] [] ? wake_up_state+0x20/0x20 [55701.038861] [] ? kiblnd_cq_event+0x90/0x90 [ko2iblnd] [55701.046395] [] kthread+0xd1/0xe0 [55701.051868] [] ? insert_kthread_work+0x40/0x40 [55701.058714] [] ret_from_fork_nospec_begin+0x21/0x21 [55701.066053] [] ? insert_kthread_work+0x40/0x40 [55701.072899] kiblnd_sd_01_03 S ffff9951681162a0 0 4849 2 0x00000080 [55701.080834] Call Trace: [55701.083589] [] schedule+0x29/0x70 [55701.089189] [] kiblnd_scheduler+0x32c/0x1190 [ko2iblnd] [55701.096917] [] ? put_prev_entity+0x31/0x400 [55701.103466] [] ? __switch_to+0xce/0x580 [55701.109637] [] ? wake_up_state+0x20/0x20 [55701.115901] [] ? kiblnd_cq_event+0x90/0x90 [ko2iblnd] [55701.123424] [] kthread+0xd1/0xe0 [55701.128917] [] ? insert_kthread_work+0x40/0x40 [55701.135758] [] ret_from_fork_nospec_begin+0x21/0x21 [55701.143091] [] ? insert_kthread_work+0x40/0x40 [55701.149943] lnet_discovery S ffff9951681141c0 0 4850 2 0x00000080 [55701.157938] Call Trace: [55701.160685] [] schedule+0x29/0x70 [55701.166281] [] schedule_timeout+0x168/0x2d0 [55701.172831] [] ? __internal_add_timer+0x130/0x130 [55701.179992] [] lnet_peer_discovery+0xe9/0x1450 [lnet] [55701.187530] [] ? wake_up_atomic_t+0x30/0x30 [55701.194056] [] ? lnet_peer_merge_data+0xfa0/0xfa0 [lnet] [55701.201865] [] kthread+0xd1/0xe0 [55701.207364] [] ? insert_kthread_work+0x40/0x40 [55701.214219] [] ret_from_fork_nospec_begin+0x21/0x21 [55701.221574] [] ? insert_kthread_work+0x40/0x40 [55701.228421] monitor_thread S ffff995168113150 0 4851 2 0x00000080 [55701.236409] Call Trace: [55701.239176] [] schedule+0x29/0x70 [55701.244756] [] schedule_timeout+0x168/0x2d0 [55701.251320] [] ? __internal_add_timer+0x130/0x130 [55701.258454] [] wait_for_completion_interruptible_timeout+0x111/0x170 [55701.267443] [] ? wake_up_state+0x20/0x20 [55701.273716] [] lnet_monitor_thread+0x3df/0x490 [lnet] [55701.281262] [] ? lnet_recover_peer_nis+0x670/0x670 [lnet] [55701.289185] [] kthread+0xd1/0xe0 [55701.294639] [] ? insert_kthread_work+0x40/0x40 [55701.301478] [] ret_from_fork_nospec_begin+0x21/0x21 [55701.308782] [] ? insert_kthread_work+0x40/0x40 [55701.315628] ptlrpcd_rcv S ffff9951681120e0 0 4852 2 0x00000080 [55701.323592] Call Trace: [55701.326371] [] ? ktime_get_real_seconds+0xe/0x10 [libcfs] [55701.334339] [] ? ptlrpc_check_set+0x13c5/0x1ed0 [ptlrpc] [55701.342176] [] schedule+0x29/0x70 [55701.347757] [] schedule_timeout+0x168/0x2d0 [55701.354320] [] ? __internal_add_timer+0x130/0x130 [55701.361539] [] ptlrpcd+0x4ef/0x6a0 [ptlrpc] [55701.368099] [] ? __switch_to+0xce/0x580 [55701.374268] [] ? wake_up_atomic_t+0x30/0x30 [55701.380887] [] ? ptlrpcd_check+0x590/0x590 [ptlrpc] [55701.388227] [] kthread+0xd1/0xe0 [55701.393712] [] ? insert_kthread_work+0x40/0x40 [55701.400577] [] ret_from_fork_nospec_begin+0x21/0x21 [55701.407915] [] ? insert_kthread_work+0x40/0x40 [55701.414768] ptlrpcd_00_00 S ffff995168111070 0 4853 2 0x00000080 [55701.422735] Call Trace: [55701.425608] [] ? ptlrpcd_check+0x23d/0x590 [ptlrpc] [55701.432942] [] schedule+0x29/0x70 [55701.438612] [] ptlrpcd+0x575/0x6a0 [ptlrpc] [55701.445179] [] ? __switch_to+0xce/0x580 [55701.451349] [] ? wake_up_atomic_t+0x30/0x30 [55701.457971] [] ? ptlrpcd_check+0x590/0x590 [ptlrpc] [55701.465314] [] kthread+0xd1/0xe0 [55701.470812] [] ? insert_kthread_work+0x40/0x40 [55701.477668] [] ret_from_fork_nospec_begin+0x21/0x21 [55701.484999] [] ? insert_kthread_work+0x40/0x40 [55701.491830] ptlrpcd_00_01 S ffff995168110000 0 4854 2 0x00000080 [55701.499792] Call Trace: [55701.502635] [] ? ptlrpcd_check+0x23d/0x590 [ptlrpc] [55701.509961] [] schedule+0x29/0x70 [55701.515629] [] ptlrpcd+0x575/0x6a0 [ptlrpc] [55701.522189] [] ? __switch_to+0xce/0x580 [55701.528365] [] ? wake_up_atomic_t+0x30/0x30 [55701.534991] [] ? ptlrpcd_check+0x590/0x590 [ptlrpc] [55701.542341] [] kthread+0xd1/0xe0 [55701.547818] [] ? insert_kthread_work+0x40/0x40 [55701.554666] [] ret_from_fork_nospec_begin+0x21/0x21 [55701.561998] [] ? insert_kthread_work+0x40/0x40 [55701.568815] ptlrpcd_00_02 S ffff9951664d9070 0 4855 2 0x00000080 [55701.576778] Call Trace: [55701.579614] [] ? ptlrpcd_check+0x23d/0x590 [ptlrpc] [55701.586950] [] schedule+0x29/0x70 [55701.592615] [] ptlrpcd+0x575/0x6a0 [ptlrpc] [55701.599182] [] ? __switch_to+0xce/0x580 [55701.605357] [] ? wake_up_atomic_t+0x30/0x30 [55701.611969] [] ? ptlrpcd_check+0x590/0x590 [ptlrpc] [55701.619312] [] kthread+0xd1/0xe0 [55701.624804] [] ? insert_kthread_work+0x40/0x40 [55701.631652] [] ret_from_fork_nospec_begin+0x21/0x21 [55701.638983] [] ? insert_kthread_work+0x40/0x40 [55701.645804] ptlrpcd_00_03 S ffff9951664d8000 0 4856 2 0x00000080 [55701.653783] Call Trace: [55701.656621] [] ? ptlrpcd_check+0x23d/0x590 [ptlrpc] [55701.663963] [] schedule+0x29/0x70 [55701.669638] [] ptlrpcd+0x575/0x6a0 [ptlrpc] [55701.676206] [] ? __switch_to+0xce/0x580 [55701.682382] [] ? wake_up_atomic_t+0x30/0x30 [55701.689002] [] ? ptlrpcd_check+0x590/0x590 [ptlrpc] [55701.696330] [] kthread+0xd1/0xe0 [55701.701820] [] ? insert_kthread_work+0x40/0x40 [55701.708654] [] ret_from_fork_nospec_begin+0x21/0x21 [55701.715970] [] ? insert_kthread_work+0x40/0x40 [55701.722824] ptlrpcd_00_04 S ffff9951664de2a0 0 4857 2 0x00000080 [55701.730812] Call Trace: [55701.733643] [] ? ptlrpcd_check+0x23d/0x590 [ptlrpc] [55701.740977] [] schedule+0x29/0x70 [55701.746621] [] ptlrpcd+0x575/0x6a0 [ptlrpc] [55701.753187] [] ? __switch_to+0xce/0x580 [55701.759355] [] ? wake_up_atomic_t+0x30/0x30 [55701.765941] [] ? ptlrpcd_check+0x590/0x590 [ptlrpc] [55701.773291] [] kthread+0xd1/0xe0 [55701.778784] [] ? insert_kthread_work+0x40/0x40 [55701.785631] [] ret_from_fork_nospec_begin+0x21/0x21 [55701.792972] [] ? insert_kthread_work+0x40/0x40 [55701.799816] ptlrpcd_00_05 S ffff9951664dd230 0 4858 2 0x00000080 [55701.807788] Call Trace: [55701.810628] [] ? ptlrpcd_check+0x23d/0x590 [ptlrpc] [55701.817955] [] schedule+0x29/0x70 [55701.823623] [] ptlrpcd+0x575/0x6a0 [ptlrpc] [55701.830192] [] ? __switch_to+0xce/0x580 [55701.836355] [] ? wake_up_atomic_t+0x30/0x30 [55701.842976] [] ? ptlrpcd_check+0x590/0x590 [ptlrpc] [55701.850327] [] kthread+0xd1/0xe0 [55701.855817] [] ? insert_kthread_work+0x40/0x40 [55701.862671] [] ret_from_fork_nospec_begin+0x21/0x21 [55701.870009] [] ? insert_kthread_work+0x40/0x40 [55701.876848] ptlrpcd_00_06 S ffff9951664dc1c0 0 4859 2 0x00000080 [55701.884823] Call Trace: [55701.887648] [] ? ptlrpcd_check+0x23d/0x590 [ptlrpc] [55701.894973] [] schedule+0x29/0x70 [55701.900613] [] ptlrpcd+0x575/0x6a0 [ptlrpc] [55701.907175] [] ? __switch_to+0xce/0x580 [55701.913354] [] ? wake_up_atomic_t+0x30/0x30 [55701.919979] [] ? ptlrpcd_check+0x590/0x590 [ptlrpc] [55701.927331] [] kthread+0xd1/0xe0 [55701.932816] [] ? insert_kthread_work+0x40/0x40 [55701.939663] [] ret_from_fork_nospec_begin+0x21/0x21 [55701.947002] [] ? insert_kthread_work+0x40/0x40 [55701.953848] ptlrpcd_00_07 S ffff9951664db150 0 4860 2 0x00000080 [55701.961817] Call Trace: [55701.964636] [] ? ptlrpcd_check+0x23d/0x590 [ptlrpc] [55701.971955] [] schedule+0x29/0x70 [55701.977621] [] ptlrpcd+0x575/0x6a0 [ptlrpc] [55701.984188] [] ? __switch_to+0xce/0x580 [55701.990364] [] ? wake_up_atomic_t+0x30/0x30 [55701.996976] [] ? ptlrpcd_check+0x590/0x590 [ptlrpc] [55702.004311] [] kthread+0xd1/0xe0 [55702.009794] [] ? insert_kthread_work+0x40/0x40 [55702.016643] [] ret_from_fork_nospec_begin+0x21/0x21 [55702.023983] [] ? insert_kthread_work+0x40/0x40 [55702.030797] ptlrpcd_00_08 S ffff9951664da0e0 0 4861 2 0x00000080 [55702.038757] Call Trace: [55702.041607] [] ? ptlrpcd_check+0x23d/0x590 [ptlrpc] [55702.048948] [] schedule+0x29/0x70 [55702.054620] [] ptlrpcd+0x575/0x6a0 [ptlrpc] [55702.061179] [] ? __switch_to+0xce/0x580 [55702.067342] [] ? wake_up_atomic_t+0x30/0x30 [55702.073955] [] ? ptlrpcd_check+0x590/0x590 [ptlrpc] [55702.081299] [] kthread+0xd1/0xe0 [55702.086790] [] ? insert_kthread_work+0x40/0x40 [55702.093639] [] ret_from_fork_nospec_begin+0x21/0x21 [55702.100980] [] ? insert_kthread_work+0x40/0x40 [55702.107818] ptlrpcd_00_09 S ffff995151210000 0 4862 2 0x00000080 [55702.115793] Call Trace: [55702.118624] [] ? ptlrpcd_check+0x23d/0x590 [ptlrpc] [55702.125957] [] schedule+0x29/0x70 [55702.131611] [] ptlrpcd+0x575/0x6a0 [ptlrpc] [55702.138176] [] ? __switch_to+0xce/0x580 [55702.144352] [] ? wake_up_atomic_t+0x30/0x30 [55702.150961] [] ? ptlrpcd_check+0x590/0x590 [ptlrpc] [55702.158304] [] kthread+0xd1/0xe0 [55702.163786] [] ? insert_kthread_work+0x40/0x40 [55702.170640] [] ret_from_fork_nospec_begin+0x21/0x21 [55702.177979] [] ? insert_kthread_work+0x40/0x40 [55702.184830] ptlrpcd_00_10 S ffff995151211070 0 4863 2 0x00000080 [55702.192790] Call Trace: [55702.195619] [] ? ptlrpcd_check+0x23d/0x590 [ptlrpc] [55702.202954] [] schedule+0x29/0x70 [55702.208602] [] ptlrpcd+0x575/0x6a0 [ptlrpc] [55702.215166] [] ? __switch_to+0xce/0x580 [55702.221335] [] ? wake_up_atomic_t+0x30/0x30 [55702.227941] [] ? ptlrpcd_check+0x590/0x590 [ptlrpc] [55702.235292] [] kthread+0xd1/0xe0 [55702.240791] [] ? insert_kthread_work+0x40/0x40 [55702.247646] [] ret_from_fork_nospec_begin+0x21/0x21 [55702.254986] [] ? insert_kthread_work+0x40/0x40 [55702.261833] ptlrpcd_00_11 S ffff9951512120e0 0 4864 2 0x00000080 [55702.269791] Call Trace: [55702.272615] [] ? ptlrpcd_check+0x23d/0x590 [ptlrpc] [55702.279949] [] schedule+0x29/0x70 [55702.285602] [] ptlrpcd+0x575/0x6a0 [ptlrpc] [55702.292159] [] ? __switch_to+0xce/0x580 [55702.298335] [] ? wake_up_atomic_t+0x30/0x30 [55702.304953] [] ? ptlrpcd_check+0x590/0x590 [ptlrpc] [55702.312295] [] kthread+0xd1/0xe0 [55702.317787] [] ? insert_kthread_work+0x40/0x40 [55702.324626] [] ret_from_fork_nospec_begin+0x21/0x21 [55702.331958] [] ? insert_kthread_work+0x40/0x40 [55702.338805] ptlrpcd_00_12 S ffff995151213150 0 4865 2 0x00000080 [55702.346752] Call Trace: [55702.349556] [] ? ptlrpcd_check+0x23d/0x590 [ptlrpc] [55702.356884] [] schedule+0x29/0x70 [55702.362560] [] ptlrpcd+0x575/0x6a0 [ptlrpc] [55702.369113] [] ? __switch_to+0xce/0x580 [55702.375268] [] ? wake_up_atomic_t+0x30/0x30 [55702.381872] [] ? ptlrpcd_check+0x590/0x590 [ptlrpc] [55702.389214] [] kthread+0xd1/0xe0 [55702.394697] [] ? insert_kthread_work+0x40/0x40 [55702.401552] [] ret_from_fork_nospec_begin+0x21/0x21 [55702.408861] [] ? insert_kthread_work+0x40/0x40 [55702.415699] ptlrpcd_00_13 S ffff9951512141c0 0 4866 2 0x00000080 [55702.423649] Call Trace: [55702.426455] [] ? ptlrpcd_check+0x23d/0x590 [ptlrpc] [55702.433797] [] schedule+0x29/0x70 [55702.439469] [] ptlrpcd+0x575/0x6a0 [ptlrpc] [55702.446019] [] ? __switch_to+0xce/0x580 [55702.452167] [] ? wake_up_atomic_t+0x30/0x30 [55702.458753] [] ? ptlrpcd_check+0x590/0x590 [ptlrpc] [55702.466096] [] kthread+0xd1/0xe0 [55702.471581] [] ? insert_kthread_work+0x40/0x40 [55702.478455] [] ret_from_fork_nospec_begin+0x21/0x21 [55702.485801] [] ? insert_kthread_work+0x40/0x40 [55702.492641] ptlrpcd_00_14 S ffff995151215230 0 4867 2 0x00000080 [55702.500608] Call Trace: [55702.503446] [] ? ptlrpcd_check+0x23d/0x590 [ptlrpc] [55702.510780] [] schedule+0x29/0x70 [55702.516430] [] ptlrpcd+0x575/0x6a0 [ptlrpc] [55702.522997] [] ? __switch_to+0xce/0x580 [55702.529173] [] ? wake_up_atomic_t+0x30/0x30 [55702.535759] [] ? ptlrpcd_check+0x590/0x590 [ptlrpc] [55702.543107] [] kthread+0xd1/0xe0 [55702.548566] [] ? insert_kthread_work+0x40/0x40 [55702.555437] [] ret_from_fork_nospec_begin+0x21/0x21 [55702.562733] [] ? insert_kthread_work+0x40/0x40 [55702.569551] ptlrpcd_00_15 S ffff9951512162a0 0 4868 2 0x00000080 [55702.577488] Call Trace: [55702.580305] [] ? ptlrpcd_check+0x23d/0x590 [ptlrpc] [55702.587613] [] schedule+0x29/0x70 [55702.593255] [] ptlrpcd+0x575/0x6a0 [ptlrpc] [55702.599808] [] ? __switch_to+0xce/0x580 [55702.605976] [] ? wake_up_atomic_t+0x30/0x30 [55702.612571] [] ? ptlrpcd_check+0x590/0x590 [ptlrpc] [55702.619895] [] kthread+0xd1/0xe0 [55702.625410] [] ? insert_kthread_work+0x40/0x40 [55702.632249] [] ret_from_fork_nospec_begin+0x21/0x21 [55702.639573] [] ? insert_kthread_work+0x40/0x40 [55702.646387] ptlrpcd_01_00 S ffff995151200000 0 4869 2 0x00000080 [55702.654353] Call Trace: [55702.657175] [] ? ptlrpcd_check+0x23d/0x590 [ptlrpc] [55702.664500] [] schedule+0x29/0x70 [55702.670152] [] ptlrpcd+0x575/0x6a0 [ptlrpc] [55702.676685] [] ? __switch_to+0xce/0x580 [55702.682825] [] ? wake_up_atomic_t+0x30/0x30 [55702.689438] [] ? ptlrpcd_check+0x590/0x590 [ptlrpc] [55702.696782] [] kthread+0xd1/0xe0 [55702.702280] [] ? insert_kthread_work+0x40/0x40 [55702.709132] [] ret_from_fork_nospec_begin+0x21/0x21 [55702.716432] [] ? insert_kthread_work+0x40/0x40 [55702.723297] ptlrpcd_01_01 S ffff995151201070 0 4870 2 0x00000080 [55702.731273] Call Trace: [55702.734091] [] ? ptlrpcd_check+0x23d/0x590 [ptlrpc] [55702.741455] [] schedule+0x29/0x70 [55702.747112] [] ptlrpcd+0x575/0x6a0 [ptlrpc] [55702.753672] [] ? __switch_to+0xce/0x580 [55702.759849] [] ? wake_up_atomic_t+0x30/0x30 [55702.766487] [] ? ptlrpcd_check+0x590/0x590 [ptlrpc] [55702.773810] [] kthread+0xd1/0xe0 [55702.779283] [] ? insert_kthread_work+0x40/0x40 [55702.786129] [] ret_from_fork_nospec_begin+0x21/0x21 [55702.793450] [] ? insert_kthread_work+0x40/0x40 [55702.800279] ptlrpcd_01_02 S ffff9951512020e0 0 4871 2 0x00000080 [55702.808268] Call Trace: [55702.811105] [] ? ptlrpcd_check+0x23d/0x590 [ptlrpc] [55702.818420] [] schedule+0x29/0x70 [55702.824075] [] ptlrpcd+0x575/0x6a0 [ptlrpc] [55702.830609] [] ? __switch_to+0xce/0x580 [55702.836750] [] ? wake_up_atomic_t+0x30/0x30 [55702.843375] [] ? ptlrpcd_check+0x590/0x590 [ptlrpc] [55702.850675] [] kthread+0xd1/0xe0 [55702.856166] [] ? insert_kthread_work+0x40/0x40 [55702.863000] [] ret_from_fork_nospec_begin+0x21/0x21 [55702.870336] [] ? insert_kthread_work+0x40/0x40 [55702.877178] ptlrpcd_01_03 S ffff995151203150 0 4872 2 0x00000080 [55702.885183] Call Trace: [55702.888014] [] ? ptlrpcd_check+0x23d/0x590 [ptlrpc] [55702.895357] [] schedule+0x29/0x70 [55702.901034] [] ptlrpcd+0x575/0x6a0 [ptlrpc] [55702.907564] [] ? __switch_to+0xce/0x580 [55702.913705] [] ? wake_up_atomic_t+0x30/0x30 [55702.920309] [] ? ptlrpcd_check+0x590/0x590 [ptlrpc] [55702.927651] [] kthread+0xd1/0xe0 [55702.933151] [] ? insert_kthread_work+0x40/0x40 [55702.939983] [] ret_from_fork_nospec_begin+0x21/0x21 [55702.947308] [] ? insert_kthread_work+0x40/0x40 [55702.954158] ptlrpcd_01_04 S ffff9951512041c0 0 4873 2 0x00000080 [55702.962132] Call Trace: [55702.964957] [] ? ptlrpcd_check+0x23d/0x590 [ptlrpc] [55702.972285] [] schedule+0x29/0x70 [55702.977935] [] ptlrpcd+0x575/0x6a0 [ptlrpc] [55702.984502] [] ? __switch_to+0xce/0x580 [55702.990651] [] ? wake_up_atomic_t+0x30/0x30 [55702.997276] [] ? ptlrpcd_check+0x590/0x590 [ptlrpc] [55703.004577] [] kthread+0xd1/0xe0 [55703.010058] [] ? insert_kthread_work+0x40/0x40 [55703.016912] [] ret_from_fork_nospec_begin+0x21/0x21 [55703.024249] [] ? insert_kthread_work+0x40/0x40 [55703.031085] ptlrpcd_01_05 S ffff995151205230 0 4874 2 0x00000080 [55703.039051] Call Trace: [55703.041890] [] ? ptlrpcd_check+0x23d/0x590 [ptlrpc] [55703.049223] [] schedule+0x29/0x70 [55703.054851] [] ptlrpcd+0x575/0x6a0 [ptlrpc] [55703.061393] [] ? __switch_to+0xce/0x580 [55703.067522] [] ? wake_up_atomic_t+0x30/0x30 [55703.074148] [] ? ptlrpcd_check+0x590/0x590 [ptlrpc] [55703.081455] [] kthread+0xd1/0xe0 [55703.086958] [] ? insert_kthread_work+0x40/0x40 [55703.093777] [] ret_from_fork_nospec_begin+0x21/0x21 [55703.101115] [] ? insert_kthread_work+0x40/0x40 [55703.107961] ptlrpcd_01_06 S ffff9951512062a0 0 4875 2 0x00000080 [55703.115931] Call Trace: [55703.118738] [] ? ptlrpcd_check+0x23d/0x590 [ptlrpc] [55703.126087] [] schedule+0x29/0x70 [55703.131730] [] ptlrpcd+0x575/0x6a0 [ptlrpc] [55703.138306] [] ? __switch_to+0xce/0x580 [55703.144443] [] ? wake_up_atomic_t+0x30/0x30 [55703.151056] [] ? ptlrpcd_check+0x590/0x590 [ptlrpc] [55703.158429] [] kthread+0xd1/0xe0 [55703.163919] [] ? insert_kthread_work+0x40/0x40 [55703.170766] [] ret_from_fork_nospec_begin+0x21/0x21 [55703.178081] [] ? insert_kthread_work+0x40/0x40 [55703.184932] ptlrpcd_01_07 S ffff995151778000 0 4876 2 0x00000080 [55703.192880] Call Trace: [55703.195684] [] ? ptlrpcd_check+0x23d/0x590 [ptlrpc] [55703.203028] [] schedule+0x29/0x70 [55703.208650] [] ptlrpcd+0x575/0x6a0 [ptlrpc] [55703.215207] [] ? __switch_to+0xce/0x580 [55703.221395] [] ? wake_up_atomic_t+0x30/0x30 [55703.228012] [] ? ptlrpcd_check+0x590/0x590 [ptlrpc] [55703.235347] [] kthread+0xd1/0xe0 [55703.240827] [] ? insert_kthread_work+0x40/0x40 [55703.247640] [] ret_from_fork_nospec_begin+0x21/0x21 [55703.254979] [] ? insert_kthread_work+0x40/0x40 [55703.261803] ptlrpcd_01_08 S ffff995151779070 0 4877 2 0x00000080 [55703.269775] Call Trace: [55703.272607] [] ? ptlrpcd_check+0x23d/0x590 [ptlrpc] [55703.279940] [] schedule+0x29/0x70 [55703.285569] [] ptlrpcd+0x575/0x6a0 [ptlrpc] [55703.292111] [] ? __switch_to+0xce/0x580 [55703.298272] [] ? wake_up_atomic_t+0x30/0x30 [55703.304892] [] ? ptlrpcd_check+0x590/0x590 [ptlrpc] [55703.312235] [] kthread+0xd1/0xe0 [55703.317700] [] ? insert_kthread_work+0x40/0x40 [55703.324520] [] ret_from_fork_nospec_begin+0x21/0x21 [55703.331845] [] ? insert_kthread_work+0x40/0x40 [55703.338691] ptlrpcd_01_09 S ffff99515177a0e0 0 4878 2 0x00000080 [55703.346645] Call Trace: [55703.349470] [] ? ptlrpcd_check+0x23d/0x590 [ptlrpc] [55703.356789] [] schedule+0x29/0x70 [55703.362452] [] ptlrpcd+0x575/0x6a0 [ptlrpc] [55703.368995] [] ? __switch_to+0xce/0x580 [55703.375171] [] ? wake_up_atomic_t+0x30/0x30 [55703.381758] [] ? ptlrpcd_check+0x590/0x590 [ptlrpc] [55703.389109] [] kthread+0xd1/0xe0 [55703.394566] [] ? insert_kthread_work+0x40/0x40 [55703.401444] [] ret_from_fork_nospec_begin+0x21/0x21 [55703.408742] [] ? insert_kthread_work+0x40/0x40 [55703.415555] ptlrpcd_01_10 S ffff99515177b150 0 4879 2 0x00000080 [55703.423482] Call Trace: [55703.426294] [] ? ptlrpcd_check+0x23d/0x590 [ptlrpc] [55703.433597] [] schedule+0x29/0x70 [55703.439221] [] ptlrpcd+0x575/0x6a0 [ptlrpc] [55703.445784] [] ? __switch_to+0xce/0x580 [55703.451946] [] ? wake_up_atomic_t+0x30/0x30 [55703.458564] [] ? ptlrpcd_check+0x590/0x590 [ptlrpc] [55703.465898] [] kthread+0xd1/0xe0 [55703.471377] [] ? insert_kthread_work+0x40/0x40 [55703.478216] [] ret_from_fork_nospec_begin+0x21/0x21 [55703.485541] [] ? insert_kthread_work+0x40/0x40 [55703.492381] ptlrpcd_01_11 S ffff99515177c1c0 0 4880 2 0x00000080 [55703.500356] Call Trace: [55703.503208] [] ? ptlrpcd_check+0x23d/0x590 [ptlrpc] [55703.510514] [] schedule+0x29/0x70 [55703.516157] [] ptlrpcd+0x575/0x6a0 [ptlrpc] [55703.522692] [] ? __switch_to+0xce/0x580 [55703.528851] [] ? wake_up_atomic_t+0x30/0x30 [55703.535464] [] ? ptlrpcd_check+0x590/0x590 [ptlrpc] [55703.542799] [] kthread+0xd1/0xe0 [55703.548289] [] ? insert_kthread_work+0x40/0x40 [55703.555129] [] ret_from_fork_nospec_begin+0x21/0x21 [55703.562434] [] ? insert_kthread_work+0x40/0x40 [55703.569280] ptlrpcd_01_12 S ffff99515177d230 0 4881 2 0x00000080 [55703.577241] Call Trace: [55703.580064] [] ? ptlrpcd_check+0x23d/0x590 [ptlrpc] [55703.587406] [] schedule+0x29/0x70 [55703.593063] [] ptlrpcd+0x575/0x6a0 [ptlrpc] [55703.599621] [] ? __switch_to+0xce/0x580 [55703.605791] [] ? wake_up_atomic_t+0x30/0x30 [55703.612425] [] ? ptlrpcd_check+0x590/0x590 [ptlrpc] [55703.619748] [] kthread+0xd1/0xe0 [55703.625221] [] ? insert_kthread_work+0x40/0x40 [55703.632074] [] ret_from_fork_nospec_begin+0x21/0x21 [55703.639398] [] ? insert_kthread_work+0x40/0x40 [55703.646226] ptlrpcd_01_13 S ffff99515177e2a0 0 4882 2 0x00000080 [55703.654236] Call Trace: [55703.657067] [] ? ptlrpcd_check+0x23d/0x590 [ptlrpc] [55703.664395] [] schedule+0x29/0x70 [55703.670035] [] ptlrpcd+0x575/0x6a0 [ptlrpc] [55703.676569] [] ? __switch_to+0xce/0x580 [55703.682706] [] ? wake_up_atomic_t+0x30/0x30 [55703.689325] [] ? ptlrpcd_check+0x590/0x590 [ptlrpc] [55703.696625] [] kthread+0xd1/0xe0 [55703.702117] [] ? insert_kthread_work+0x40/0x40 [55703.708955] [] ret_from_fork_nospec_begin+0x21/0x21 [55703.716271] [] ? insert_kthread_work+0x40/0x40 [55703.723123] ptlrpcd_01_14 S ffff9951516e0000 0 4883 2 0x00000080 [55703.731138] Call Trace: [55703.733973] [] ? ptlrpcd_check+0x23d/0x590 [ptlrpc] [55703.741325] [] schedule+0x29/0x70 [55703.746981] [] ptlrpcd+0x575/0x6a0 [ptlrpc] [55703.753514] [] ? __switch_to+0xce/0x580 [55703.759654] [] ? wake_up_atomic_t+0x30/0x30 [55703.766258] [] ? ptlrpcd_check+0x590/0x590 [ptlrpc] [55703.773592] [] kthread+0xd1/0xe0 [55703.779083] [] ? insert_kthread_work+0x40/0x40 [55703.785936] [] ret_from_fork_nospec_begin+0x21/0x21 [55703.793258] [] ? insert_kthread_work+0x40/0x40 [55703.800099] ptlrpcd_01_15 S ffff9951516e1070 0 4884 2 0x00000080 [55703.808061] Call Trace: [55703.810876] [] ? ptlrpcd_check+0x23d/0x590 [ptlrpc] [55703.818224] [] schedule+0x29/0x70 [55703.823874] [] ptlrpcd+0x575/0x6a0 [ptlrpc] [55703.830431] [] ? __switch_to+0xce/0x580 [55703.836594] [] ? wake_up_atomic_t+0x30/0x30 [55703.843220] [] ? ptlrpcd_check+0x590/0x590 [ptlrpc] [55703.850528] [] kthread+0xd1/0xe0 [55703.856007] [] ? insert_kthread_work+0x40/0x40 [55703.862862] [] ret_from_fork_nospec_begin+0x21/0x21 [55703.870201] [] ? insert_kthread_work+0x40/0x40 [55703.877038] kmmpd-dm-0 S ffff9951516e20e0 0 4885 2 0x00000080 [55703.885022] Call Trace: [55703.887790] [] schedule+0x29/0x70 [55703.893389] [] schedule_timeout+0x168/0x2d0 [55703.899924] [] ? __internal_add_timer+0x130/0x130 [55703.907080] [] ? write_mmp_block+0x12a/0x160 [ldiskfs] [55703.914683] [] schedule_timeout_interruptible+0x1e/0x20 [55703.922393] [] kmmpd+0x216/0x430 [ldiskfs] [55703.928860] [] ? __dump_mmp_msg+0x70/0x70 [ldiskfs] [55703.936196] [] kthread+0xd1/0xe0 [55703.941679] [] ? insert_kthread_work+0x40/0x40 [55703.948497] [] ret_from_fork_nospec_begin+0x21/0x21 [55703.955814] [] ? insert_kthread_work+0x40/0x40 [55703.962663] jbd2/dm-0-8 S ffff9951516e3150 0 4886 2 0x00000080 [55703.970623] Call Trace: [55703.973378] [] ? task_rq_unlock+0x20/0x20 [55703.979735] [] schedule+0x29/0x70 [55703.985324] [] kjournald2+0x203/0x260 [jbd2] [55703.991993] [] ? wake_up_atomic_t+0x30/0x30 [55703.998554] [] ? commit_timeout+0x10/0x10 [jbd2] [55704.005560] [] kthread+0xd1/0xe0 [55704.011057] [] ? insert_kthread_work+0x40/0x40 [55704.017887] [] ret_from_fork_nospec_begin+0x21/0x21 [55704.025213] [] ? insert_kthread_work+0x40/0x40 [55704.032067] ldiskfs-rsv-con S ffff9951516e41c0 0 4887 2 0x00000080 [55704.040066] Call Trace: [55704.042841] [] schedule+0x29/0x70 [55704.048407] [] rescuer_thread+0x31e/0x3c0 [55704.054765] [] ? process_one_work+0x440/0x440 [55704.061507] [] kthread+0xd1/0xe0 [55704.067003] [] ? insert_kthread_work+0x40/0x40 [55704.073842] [] ret_from_fork_nospec_begin+0x21/0x21 [55704.081160] [] ? insert_kthread_work+0x40/0x40 [55704.087998] ldlm_cb00_000 S ffff9951516e5230 0 4890 2 0x00000080 [55704.095967] Call Trace: [55704.098696] [] schedule+0x29/0x70 [55704.104376] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55704.111898] [] ? __wake_up+0x13/0x20 [55704.117776] [] ? wake_up_atomic_t+0x30/0x30 [55704.124429] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55704.131507] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55704.139800] [] kthread+0xd1/0xe0 [55704.145270] [] ? insert_kthread_work+0x40/0x40 [55704.152123] [] ret_from_fork_nospec_begin+0x21/0x21 [55704.159420] [] ? insert_kthread_work+0x40/0x40 [55704.166275] ldlm_cb00_001 S ffff9951516e62a0 0 4891 2 0x00000080 [55704.174269] Call Trace: [55704.177022] [] ? __set_current_blocked+0x42/0x70 [55704.184068] [] schedule+0x29/0x70 [55704.189688] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55704.197221] [] ? __wake_up+0x13/0x20 [55704.203098] [] ? wake_up_atomic_t+0x30/0x30 [55704.209696] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55704.216791] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55704.225098] [] kthread+0xd1/0xe0 [55704.230560] [] ? insert_kthread_work+0x40/0x40 [55704.237380] [] ret_from_fork_nospec_begin+0x21/0x21 [55704.244690] [] ? insert_kthread_work+0x40/0x40 [55704.251501] ldlm_cb01_000 S ffff995151638000 0 4892 2 0x00000080 [55704.259446] Call Trace: [55704.262228] [] ? __set_current_blocked+0x42/0x70 [55704.269287] [] schedule+0x29/0x70 [55704.274944] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55704.282445] [] ? __wake_up+0x13/0x20 [55704.288298] [] ? wake_up_atomic_t+0x30/0x30 [55704.294931] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55704.302049] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55704.310384] [] kthread+0xd1/0xe0 [55704.315873] [] ? insert_kthread_work+0x40/0x40 [55704.322712] [] ret_from_fork_nospec_begin+0x21/0x21 [55704.330028] [] ? insert_kthread_work+0x40/0x40 [55704.336879] ldlm_cb01_001 S ffff995151639070 0 4893 2 0x00000080 [55704.344823] Call Trace: [55704.347563] [] ? __set_current_blocked+0x42/0x70 [55704.354580] [] schedule+0x29/0x70 [55704.360222] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55704.367753] [] ? __wake_up+0x13/0x20 [55704.373611] [] ? wake_up_atomic_t+0x30/0x30 [55704.380231] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55704.387319] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55704.395602] [] kthread+0xd1/0xe0 [55704.401098] [] ? insert_kthread_work+0x40/0x40 [55704.407928] [] ret_from_fork_nospec_begin+0x21/0x21 [55704.415291] [] ? insert_kthread_work+0x40/0x40 [55704.422131] ldlm_cn00_000 S ffff99515163a0e0 0 4894 2 0x00000080 [55704.430153] Call Trace: [55704.432928] [] ? __set_current_blocked+0x42/0x70 [55704.439976] [] schedule+0x29/0x70 [55704.445628] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55704.453154] [] ? __wake_up+0x13/0x20 [55704.459016] [] ? wake_up_atomic_t+0x30/0x30 [55704.465604] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55704.472692] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55704.480992] [] kthread+0xd1/0xe0 [55704.486452] [] ? insert_kthread_work+0x40/0x40 [55704.493314] [] ret_from_fork_nospec_begin+0x21/0x21 [55704.500618] [] ? insert_kthread_work+0x40/0x40 [55704.507426] ldlm_cn00_001 S ffff99515163b150 0 4895 2 0x00000080 [55704.515376] Call Trace: [55704.518137] [] ? _raw_spin_lock_irqsave+0x37/0x40 [55704.525252] [] schedule+0x29/0x70 [55704.530874] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55704.538389] [] ? __wake_up+0x13/0x20 [55704.544286] [] ? wake_up_atomic_t+0x30/0x30 [55704.550905] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55704.558009] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55704.566344] [] kthread+0xd1/0xe0 [55704.571840] [] ? insert_kthread_work+0x40/0x40 [55704.578651] [] ret_from_fork_nospec_begin+0x21/0x21 [55704.585990] [] ? insert_kthread_work+0x40/0x40 [55704.592825] ldlm_cn00_002 S ffff99515163c1c0 0 4896 2 0x00000080 [55704.600811] Call Trace: [55704.603558] [] ? __set_current_blocked+0x42/0x70 [55704.610584] [] schedule+0x29/0x70 [55704.616232] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55704.623761] [] ? __wake_up+0x13/0x20 [55704.629605] [] ? wake_up_atomic_t+0x30/0x30 [55704.636216] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55704.643303] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55704.651594] [] kthread+0xd1/0xe0 [55704.657069] [] ? insert_kthread_work+0x40/0x40 [55704.663922] [] ret_from_fork_nospec_begin+0x21/0x21 [55704.671279] [] ? insert_kthread_work+0x40/0x40 [55704.678123] ldlm_cn01_000 S ffff99515163d230 0 4897 2 0x00000080 [55704.686114] Call Trace: [55704.688881] [] ? __set_current_blocked+0x42/0x70 [55704.695912] [] schedule+0x29/0x70 [55704.701525] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55704.709069] [] ? __wake_up+0x13/0x20 [55704.714939] [] ? wake_up_atomic_t+0x30/0x30 [55704.721553] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55704.728633] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55704.736954] [] kthread+0xd1/0xe0 [55704.742451] [] ? insert_kthread_work+0x40/0x40 [55704.749309] [] ret_from_fork_nospec_begin+0x21/0x21 [55704.756638] [] ? insert_kthread_work+0x40/0x40 [55704.763477] ldlm_cn01_001 S ffff99515163e2a0 0 4898 2 0x00000080 [55704.771435] Call Trace: [55704.774208] [] ? _raw_spin_lock_irqsave+0x37/0x40 [55704.781355] [] schedule+0x29/0x70 [55704.787003] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55704.794548] [] ? __wake_up+0x13/0x20 [55704.800433] [] ? wake_up_atomic_t+0x30/0x30 [55704.807050] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55704.814166] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55704.822478] [] kthread+0xd1/0xe0 [55704.827969] [] ? insert_kthread_work+0x40/0x40 [55704.834824] [] ret_from_fork_nospec_begin+0x21/0x21 [55704.842163] [] ? insert_kthread_work+0x40/0x40 [55704.849017] ldlm_cn01_002 S ffff995152210000 0 4899 2 0x00000080 [55704.856997] Call Trace: [55704.859758] [] schedule+0x29/0x70 [55704.865426] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55704.872956] [] ? _raw_spin_lock+0x20/0x30 [55704.879346] [] ? wake_up_atomic_t+0x30/0x30 [55704.885973] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55704.893093] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55704.901407] [] kthread+0xd1/0xe0 [55704.906906] [] ? insert_kthread_work+0x40/0x40 [55704.913746] [] ret_from_fork_nospec_begin+0x21/0x21 [55704.921072] [] ? insert_kthread_work+0x40/0x40 [55704.927923] ldlm_bl_01 S ffff995152211070 0 4900 2 0x00000080 [55704.935912] Call Trace: [55704.938755] [] ? obd_stale_export_get+0x31/0x190 [obdclass] [55704.946855] [] schedule+0x29/0x70 [55704.952505] [] ldlm_bl_thread_main+0x709/0xa00 [ptlrpc] [55704.960253] [] ? wake_up_atomic_t+0x30/0x30 [55704.966870] [] ? ldlm_handle_bl_callback+0x3e0/0x3e0 [ptlrpc] [55704.975190] [] kthread+0xd1/0xe0 [55704.980667] [] ? insert_kthread_work+0x40/0x40 [55704.987520] [] ret_from_fork_nospec_begin+0x21/0x21 [55704.994859] [] ? insert_kthread_work+0x40/0x40 [55705.001706] ldlm_bl_02 S ffff9951522120e0 0 4901 2 0x00000080 [55705.009706] Call Trace: [55705.012487] [] ? obd_stale_export_get+0x31/0x190 [obdclass] [55705.020591] [] schedule+0x29/0x70 [55705.026257] [] ldlm_bl_thread_main+0x709/0xa00 [ptlrpc] [55705.033992] [] ? wake_up_atomic_t+0x30/0x30 [55705.040609] [] ? ldlm_handle_bl_callback+0x3e0/0x3e0 [ptlrpc] [55705.048922] [] kthread+0xd1/0xe0 [55705.054419] [] ? insert_kthread_work+0x40/0x40 [55705.061304] [] ret_from_fork_nospec_begin+0x21/0x21 [55705.068629] [] ? insert_kthread_work+0x40/0x40 [55705.075473] ldlm_elt S ffff995152213150 0 4902 2 0x00000080 [55705.083425] Call Trace: [55705.086194] [] schedule+0x29/0x70 [55705.091842] [] expired_lock_main+0x1c2/0xb20 [ptlrpc] [55705.099376] [] ? wake_up_atomic_t+0x30/0x30 [55705.105999] [] ? ldlm_add_waiting_lock+0x300/0x300 [ptlrpc] [55705.114103] [] kthread+0xd1/0xe0 [55705.119600] [] ? insert_kthread_work+0x40/0x40 [55705.126448] [] ret_from_fork_nospec_begin+0x21/0x21 [55705.133781] [] ? insert_kthread_work+0x40/0x40 [55705.140621] mgs_params_noti S ffff9951522141c0 0 4903 2 0x00000080 [55705.148583] Call Trace: [55705.151331] [] schedule+0x29/0x70 [55705.156922] [] mgs_ir_notify+0x1db/0x290 [mgs] [55705.163757] [] ? wake_up_atomic_t+0x30/0x30 [55705.170319] [] ? lprocfs_ir_set_state+0x170/0x170 [mgs] [55705.178053] [] kthread+0xd1/0xe0 [55705.183542] [] ? insert_kthread_work+0x40/0x40 [55705.190396] [] ret_from_fork_nospec_begin+0x21/0x21 [55705.197728] [] ? insert_kthread_work+0x40/0x40 [55705.204569] ll_mgs_0000 S ffff995152215230 0 4904 2 0x00000080 [55705.212543] Call Trace: [55705.215323] [] ? __set_current_blocked+0x42/0x70 [55705.222363] [] schedule+0x29/0x70 [55705.228001] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55705.235533] [] ? wake_up_atomic_t+0x30/0x30 [55705.242163] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55705.249281] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55705.257571] [] kthread+0xd1/0xe0 [55705.263069] [] ? insert_kthread_work+0x40/0x40 [55705.269927] [] ret_from_fork_nospec_begin+0x21/0x21 [55705.277248] [] ? insert_kthread_work+0x40/0x40 [55705.284095] ll_mgs_0001 S ffff9951522162a0 0 4905 2 0x00000080 [55705.292079] Call Trace: [55705.294822] [] ? __set_current_blocked+0x42/0x70 [55705.301870] [] schedule+0x29/0x70 [55705.307489] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55705.315028] [] ? __wake_up+0x13/0x20 [55705.320899] [] ? wake_up_atomic_t+0x30/0x30 [55705.327496] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55705.334570] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55705.342884] [] kthread+0xd1/0xe0 [55705.348367] [] ? insert_kthread_work+0x40/0x40 [55705.355226] [] ret_from_fork_nospec_begin+0x21/0x21 [55705.362552] [] ? insert_kthread_work+0x40/0x40 [55705.369400] ll_mgs_0002 S ffff995141a68000 0 4906 2 0x00000080 [55705.377377] Call Trace: [55705.380143] [] ? __set_current_blocked+0x42/0x70 [55705.387186] [] schedule+0x29/0x70 [55705.392833] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55705.400368] [] ? wake_up_atomic_t+0x30/0x30 [55705.406994] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55705.414103] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55705.422399] [] kthread+0xd1/0xe0 [55705.427883] [] ? insert_kthread_work+0x40/0x40 [55705.434738] [] ret_from_fork_nospec_begin+0x21/0x21 [55705.442076] [] ? insert_kthread_work+0x40/0x40 [55705.448928] ll_evictor S ffff995141a69070 0 4907 2 0x00000080 [55705.456933] Call Trace: [55705.459694] [] schedule+0x29/0x70 [55705.465368] [] ping_evictor_main+0x54e/0x700 [ptlrpc] [55705.472907] [] ? wake_up_atomic_t+0x30/0x30 [55705.479529] [] ? ptlrpc_del_timeout_client+0x190/0x190 [ptlrpc] [55705.488038] [] kthread+0xd1/0xe0 [55705.493529] [] ? insert_kthread_work+0x40/0x40 [55705.500371] [] ret_from_fork_nospec_begin+0x21/0x21 [55705.507695] [] ? insert_kthread_work+0x40/0x40 [55705.514540] ll_cfg_requeue S ffff995141a6a0e0 0 4908 2 0x00000080 [55705.522510] Call Trace: [55705.525282] [] schedule+0x29/0x70 [55705.530892] [] mgc_requeue_thread+0x5de/0x860 [mgc] [55705.538244] [] ? wake_up_atomic_t+0x30/0x30 [55705.544804] [] ? mgc_process_config+0x1870/0x1870 [mgc] [55705.552525] [] kthread+0xd1/0xe0 [55705.558023] [] ? insert_kthread_work+0x40/0x40 [55705.564863] [] ret_from_fork_nospec_begin+0x21/0x21 [55705.572204] [] ? insert_kthread_work+0x40/0x40 [55705.579057] mdt00_000 S ffff995141a6b150 0 4912 2 0x00000080 [55705.587084] Call Trace: [55705.589859] [] ? __set_current_blocked+0x42/0x70 [55705.596897] [] schedule+0x29/0x70 [55705.602548] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55705.610087] [] ? __wake_up+0x13/0x20 [55705.615971] [] ? wake_up_atomic_t+0x30/0x30 [55705.622585] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55705.629699] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55705.638012] [] kthread+0xd1/0xe0 [55705.643503] [] ? insert_kthread_work+0x40/0x40 [55705.650316] [] ret_from_fork_nospec_begin+0x21/0x21 [55705.657649] [] ? insert_kthread_work+0x40/0x40 [55705.664499] mdt00_001 S ffff995141a6c1c0 0 4913 2 0x00000080 [55705.672468] Call Trace: [55705.675238] [] schedule+0x29/0x70 [55705.680895] [] ldlm_completion_ast+0x62d/0x9b0 [ptlrpc] [55705.688621] [] ? wake_up_atomic_t+0x30/0x30 [55705.695249] [] ldlm_cli_enqueue_fini+0x9d0/0xe40 [ptlrpc] [55705.703236] [] ? lprocfs_counter_sub+0xc1/0x130 [obdclass] [55705.711332] [] ldlm_cli_enqueue+0x441/0xa20 [ptlrpc] [55705.718795] [] ? ldlm_expired_completion_wait+0x2a0/0x2a0 [ptlrpc] [55705.727572] [] ? mdt_obd_reconnect+0x1e0/0x1e0 [mdt] [55705.734974] [] osp_md_object_lock+0x162/0x2d0 [osp] [55705.742283] [] ? osp_update_request_destroy+0x42e/0x4b0 [osp] [55705.750583] [] lod_object_lock+0xf1/0x780 [lod] [55705.757525] [] ? osp_md_index_lookup+0x25a/0x870 [osp] [55705.765128] [] ? osp_attr_get+0x3e3/0x730 [osp] [55705.772113] [] ? lu_ucred+0x1e/0x30 [obdclass] [55705.778973] [] mdd_object_lock+0x3b/0xd0 [mdd] [55705.785824] [] mdt_remote_object_lock_try+0x1e4/0x530 [mdt] [55705.793922] [] ? __mdd_lookup.isra.17+0x2ab/0x450 [mdd] [55705.801641] [] mdt_object_lock_internal+0x18c/0x3f0 [mdt] [55705.809546] [] mdt_object_lock+0x20/0x30 [mdt] [55705.816416] [] mdt_create+0x78d/0xf90 [mdt] [55705.823015] [] ? lprocfs_stats_lock+0x24/0xd0 [obdclass] [55705.830859] [] mdt_reint_create+0x16b/0x360 [mdt] [55705.838007] [] mdt_reint_rec+0x83/0x210 [mdt] [55705.844756] [] mdt_reint_internal+0x7b0/0xba0 [mdt] [55705.852099] [] mdt_reint+0x67/0x140 [mdt] [55705.858547] [] tgt_request_handle+0x95a/0x1630 [ptlrpc] [55705.866298] [] ? ktime_get_real_seconds+0xe/0x10 [libcfs] [55705.874327] [] ptlrpc_server_handle_request+0x256/0xb10 [ptlrpc] [55705.883000] [] ? ptlrpc_wait_event+0x12e/0x5b0 [ptlrpc] [55705.890731] [] ? __wake_up+0x13/0x20 [55705.896617] [] ? wake_up_atomic_t+0x30/0x30 [55705.903238] [] ptlrpc_main+0xbb4/0x1550 [ptlrpc] [55705.910361] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55705.918666] [] kthread+0xd1/0xe0 [55705.924156] [] ? insert_kthread_work+0x40/0x40 [55705.931033] [] ret_from_fork_nospec_begin+0x21/0x21 [55705.938365] [] ? insert_kthread_work+0x40/0x40 [55705.945225] mdt00_002 S ffff995141a6d230 0 4914 2 0x00000080 [55705.953223] Call Trace: [55705.955982] [] ? __set_current_blocked+0x42/0x70 [55705.963029] [] schedule+0x29/0x70 [55705.968681] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55705.976249] [] ? __wake_up+0x13/0x20 [55705.982136] [] ? wake_up_atomic_t+0x30/0x30 [55705.988748] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55705.995854] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55706.004156] [] kthread+0xd1/0xe0 [55706.009672] [] ? insert_kthread_work+0x40/0x40 [55706.016526] [] ret_from_fork_nospec_begin+0x21/0x21 [55706.023859] [] ? insert_kthread_work+0x40/0x40 [55706.030689] mdt01_000 S ffff995141a6e2a0 0 4915 2 0x00000080 [55706.038665] Call Trace: [55706.041434] [] ? __set_current_blocked+0x42/0x70 [55706.048474] [] schedule+0x29/0x70 [55706.054126] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55706.061652] [] ? _raw_spin_lock+0x20/0x30 [55706.068010] [] ? wake_up_atomic_t+0x30/0x30 [55706.074637] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55706.081760] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55706.090070] [] kthread+0xd1/0xe0 [55706.095560] [] ? insert_kthread_work+0x40/0x40 [55706.102409] [] ret_from_fork_nospec_begin+0x21/0x21 [55706.109747] [] ? insert_kthread_work+0x40/0x40 [55706.116585] mdt01_001 S ffff995141fc0000 0 4916 2 0x00000080 [55706.124541] Call Trace: [55706.127301] [] ? __set_current_blocked+0x42/0x70 [55706.134344] [] schedule+0x29/0x70 [55706.139987] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55706.147526] [] ? __wake_up+0x13/0x20 [55706.153412] [] ? wake_up_atomic_t+0x30/0x30 [55706.160039] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55706.167157] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55706.175449] [] kthread+0xd1/0xe0 [55706.180947] [] ? insert_kthread_work+0x40/0x40 [55706.187790] [] ret_from_fork_nospec_begin+0x21/0x21 [55706.195129] [] ? insert_kthread_work+0x40/0x40 [55706.201968] mdt01_002 S ffff995141fc1070 0 4917 2 0x00000080 [55706.209949] Call Trace: [55706.212700] [] ? __set_current_blocked+0x42/0x70 [55706.219736] [] schedule+0x29/0x70 [55706.225387] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55706.232927] [] ? __wake_up+0x13/0x20 [55706.238805] [] ? wake_up_atomic_t+0x30/0x30 [55706.245424] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55706.252518] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55706.260810] [] kthread+0xd1/0xe0 [55706.266307] [] ? insert_kthread_work+0x40/0x40 [55706.273181] [] ret_from_fork_nospec_begin+0x21/0x21 [55706.280518] [] ? insert_kthread_work+0x40/0x40 [55706.287362] mdt_rdpg00_000 S ffff995141fc20e0 0 4918 2 0x00000080 [55706.295323] Call Trace: [55706.298076] [] ? _raw_spin_lock_irqsave+0x37/0x40 [55706.305212] [] schedule+0x29/0x70 [55706.310857] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55706.318384] [] ? __wake_up+0x13/0x20 [55706.324263] [] ? wake_up_atomic_t+0x30/0x30 [55706.330889] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55706.338005] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55706.346309] [] kthread+0xd1/0xe0 [55706.351807] [] ? insert_kthread_work+0x40/0x40 [55706.358654] [] ret_from_fork_nospec_begin+0x21/0x21 [55706.365983] [] ? insert_kthread_work+0x40/0x40 [55706.372828] mdt_rdpg00_001 S ffff995141fc3150 0 4919 2 0x00000080 [55706.380815] Call Trace: [55706.383577] [] ? __set_current_blocked+0x42/0x70 [55706.390611] [] schedule+0x29/0x70 [55706.396283] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55706.403807] [] ? __wake_up+0x13/0x20 [55706.409684] [] ? wake_up_atomic_t+0x30/0x30 [55706.416320] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55706.423427] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55706.431739] [] kthread+0xd1/0xe0 [55706.437255] [] ? insert_kthread_work+0x40/0x40 [55706.444095] [] ret_from_fork_nospec_begin+0x21/0x21 [55706.451430] [] ? insert_kthread_work+0x40/0x40 [55706.458288] mdt_rdpg01_000 S ffff995141fc41c0 0 4920 2 0x00000080 [55706.466294] Call Trace: [55706.469063] [] ? __set_current_blocked+0x42/0x70 [55706.476098] [] schedule+0x29/0x70 [55706.481738] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55706.489276] [] ? __wake_up+0x13/0x20 [55706.495167] [] ? wake_up_atomic_t+0x30/0x30 [55706.501803] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55706.508902] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55706.517226] [] kthread+0xd1/0xe0 [55706.522718] [] ? insert_kthread_work+0x40/0x40 [55706.529572] [] ret_from_fork_nospec_begin+0x21/0x21 [55706.536910] [] ? insert_kthread_work+0x40/0x40 [55706.543763] mdt_rdpg01_001 S ffff995141fc5230 0 4921 2 0x00000080 [55706.551770] Call Trace: [55706.554537] [] ? __set_current_blocked+0x42/0x70 [55706.561579] [] schedule+0x29/0x70 [55706.567273] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55706.574812] [] ? __wake_up+0x13/0x20 [55706.580680] [] ? wake_up_atomic_t+0x30/0x30 [55706.587310] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55706.594425] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55706.602738] [] kthread+0xd1/0xe0 [55706.608245] [] ? insert_kthread_work+0x40/0x40 [55706.615101] [] ret_from_fork_nospec_begin+0x21/0x21 [55706.622433] [] ? insert_kthread_work+0x40/0x40 [55706.629278] mdt_attr00_000 S ffff995141fc62a0 0 4922 2 0x00000080 [55706.637260] Call Trace: [55706.640034] [] ? __set_current_blocked+0x42/0x70 [55706.647081] [] schedule+0x29/0x70 [55706.652712] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55706.660245] [] ? wake_up_atomic_t+0x30/0x30 [55706.666872] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55706.673986] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55706.682292] [] kthread+0xd1/0xe0 [55706.687788] [] ? insert_kthread_work+0x40/0x40 [55706.694636] [] ret_from_fork_nospec_begin+0x21/0x21 [55706.701976] [] ? insert_kthread_work+0x40/0x40 [55706.708817] mdt_attr00_001 S ffff99514aa48000 0 4923 2 0x00000080 [55706.716799] Call Trace: [55706.719565] [] ? __set_current_blocked+0x42/0x70 [55706.726613] [] schedule+0x29/0x70 [55706.732271] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55706.739802] [] ? wake_up_atomic_t+0x30/0x30 [55706.746419] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55706.753528] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55706.761827] [] kthread+0xd1/0xe0 [55706.767318] [] ? insert_kthread_work+0x40/0x40 [55706.774195] [] ret_from_fork_nospec_begin+0x21/0x21 [55706.781535] [] ? insert_kthread_work+0x40/0x40 [55706.788374] mdt_attr01_000 S ffff99514aa49070 0 4924 2 0x00000080 [55706.796338] Call Trace: [55706.799123] [] ? __set_current_blocked+0x42/0x70 [55706.806195] [] schedule+0x29/0x70 [55706.811852] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55706.819382] [] ? wake_up_atomic_t+0x30/0x30 [55706.826009] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55706.833122] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55706.841427] [] kthread+0xd1/0xe0 [55706.846916] [] ? insert_kthread_work+0x40/0x40 [55706.853770] [] ret_from_fork_nospec_begin+0x21/0x21 [55706.861121] [] ? insert_kthread_work+0x40/0x40 [55706.867967] mdt_attr01_001 S ffff99514aa4a0e0 0 4925 2 0x00000080 [55706.875986] Call Trace: [55706.878762] [] ? __set_current_blocked+0x42/0x70 [55706.885808] [] schedule+0x29/0x70 [55706.891460] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55706.898985] [] ? wake_up_atomic_t+0x30/0x30 [55706.905598] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55706.912713] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55706.921024] [] kthread+0xd1/0xe0 [55706.926514] [] ? insert_kthread_work+0x40/0x40 [55706.933362] [] ret_from_fork_nospec_begin+0x21/0x21 [55706.940694] [] ? insert_kthread_work+0x40/0x40 [55706.947539] mdt_out00_000 S ffff99514aa4b150 0 4926 2 0x00000080 [55706.955520] Call Trace: [55706.958281] [] ? __set_current_blocked+0x42/0x70 [55706.965322] [] schedule+0x29/0x70 [55706.970980] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55706.978518] [] ? __wake_up+0x13/0x20 [55706.984391] [] ? wake_up_atomic_t+0x30/0x30 [55706.991019] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55706.998129] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55707.006437] [] kthread+0xd1/0xe0 [55707.011928] [] ? insert_kthread_work+0x40/0x40 [55707.018774] [] ret_from_fork_nospec_begin+0x21/0x21 [55707.026115] [] ? insert_kthread_work+0x40/0x40 [55707.032958] mdt_out00_001 S ffff99514aa4c1c0 0 4927 2 0x00000080 [55707.040941] Call Trace: [55707.043692] [] ? _raw_spin_lock_irqsave+0x37/0x40 [55707.050836] [] schedule+0x29/0x70 [55707.056485] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55707.064023] [] ? _raw_spin_lock+0x20/0x30 [55707.070378] [] ? wake_up_atomic_t+0x30/0x30 [55707.077004] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55707.084090] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55707.092388] [] kthread+0xd1/0xe0 [55707.097870] [] ? insert_kthread_work+0x40/0x40 [55707.104720] [] ret_from_fork_nospec_begin+0x21/0x21 [55707.112061] [] ? insert_kthread_work+0x40/0x40 [55707.118915] mdt_out01_000 S ffff99514aa4d230 0 4928 2 0x00000080 [55707.126913] Call Trace: [55707.129679] [] ? __set_current_blocked+0x42/0x70 [55707.136713] [] schedule+0x29/0x70 [55707.142361] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55707.149897] [] ? _raw_spin_lock+0x20/0x30 [55707.156248] [] ? wake_up_atomic_t+0x30/0x30 [55707.162854] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55707.169954] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55707.178261] [] kthread+0xd1/0xe0 [55707.183759] [] ? insert_kthread_work+0x40/0x40 [55707.190605] [] ret_from_fork_nospec_begin+0x21/0x21 [55707.197944] [] ? insert_kthread_work+0x40/0x40 [55707.204789] mdt_out01_001 S ffff99514aa4e2a0 0 4929 2 0x00000080 [55707.212764] Call Trace: [55707.215533] [] ? __set_current_blocked+0x42/0x70 [55707.222574] [] schedule+0x29/0x70 [55707.228236] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55707.235762] [] ? __wake_up+0x13/0x20 [55707.241641] [] ? wake_up_atomic_t+0x30/0x30 [55707.248272] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55707.255380] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55707.263693] [] kthread+0xd1/0xe0 [55707.269202] [] ? insert_kthread_work+0x40/0x40 [55707.276043] [] ret_from_fork_nospec_begin+0x21/0x21 [55707.283374] [] ? insert_kthread_work+0x40/0x40 [55707.290234] mdt_seqs_0000 S ffff995145b18000 0 4930 2 0x00000080 [55707.298242] Call Trace: [55707.301017] [] ? __set_current_blocked+0x42/0x70 [55707.308057] [] schedule+0x29/0x70 [55707.313702] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55707.321231] [] ? wake_up_atomic_t+0x30/0x30 [55707.327858] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55707.334966] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55707.343270] [] kthread+0xd1/0xe0 [55707.348755] [] ? insert_kthread_work+0x40/0x40 [55707.355604] [] ret_from_fork_nospec_begin+0x21/0x21 [55707.362930] [] ? insert_kthread_work+0x40/0x40 [55707.369778] mdt_seqs_0001 S ffff995145b19070 0 4931 2 0x00000080 [55707.377782] Call Trace: [55707.380543] [] ? __set_current_blocked+0x42/0x70 [55707.387583] [] schedule+0x29/0x70 [55707.393252] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55707.400790] [] ? wake_up_atomic_t+0x30/0x30 [55707.407402] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55707.414510] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55707.422823] [] kthread+0xd1/0xe0 [55707.428308] [] ? insert_kthread_work+0x40/0x40 [55707.435182] [] ret_from_fork_nospec_begin+0x21/0x21 [55707.442516] [] ? insert_kthread_work+0x40/0x40 [55707.449364] mdt_seqm_0000 S ffff995145b1a0e0 0 4932 2 0x00000080 [55707.457316] Call Trace: [55707.460090] [] ? __set_current_blocked+0x42/0x70 [55707.467151] [] schedule+0x29/0x70 [55707.472808] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55707.480338] [] ? wake_up_atomic_t+0x30/0x30 [55707.486965] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55707.494083] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55707.502394] [] kthread+0xd1/0xe0 [55707.507884] [] ? insert_kthread_work+0x40/0x40 [55707.514737] [] ret_from_fork_nospec_begin+0x21/0x21 [55707.522082] [] ? insert_kthread_work+0x40/0x40 [55707.528937] mdt_seqm_0001 S ffff995145b1b150 0 4933 2 0x00000080 [55707.536949] Call Trace: [55707.539710] [] ? __set_current_blocked+0x42/0x70 [55707.546757] [] schedule+0x29/0x70 [55707.552406] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55707.559923] [] ? wake_up_atomic_t+0x30/0x30 [55707.566542] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55707.573650] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55707.581954] [] kthread+0xd1/0xe0 [55707.587446] [] ? insert_kthread_work+0x40/0x40 [55707.594296] [] ret_from_fork_nospec_begin+0x21/0x21 [55707.601635] [] ? insert_kthread_work+0x40/0x40 [55707.608482] mdt_fld_0000 S ffff995145b1c1c0 0 4934 2 0x00000080 [55707.616423] Call Trace: [55707.619197] [] ? __set_current_blocked+0x42/0x70 [55707.626225] [] schedule+0x29/0x70 [55707.631884] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55707.639415] [] ? wake_up_atomic_t+0x30/0x30 [55707.646021] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55707.653136] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55707.661407] [] kthread+0xd1/0xe0 [55707.666864] [] ? insert_kthread_work+0x40/0x40 [55707.673704] [] ret_from_fork_nospec_begin+0x21/0x21 [55707.681030] [] ? insert_kthread_work+0x40/0x40 [55707.687883] mdt_fld_0001 S ffff995145b1d230 0 4935 2 0x00000080 [55707.695881] Call Trace: [55707.698656] [] ? __set_current_blocked+0x42/0x70 [55707.705696] [] schedule+0x29/0x70 [55707.711338] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55707.718838] [] ? __wake_up+0x13/0x20 [55707.724697] [] ? wake_up_atomic_t+0x30/0x30 [55707.731295] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55707.738408] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55707.746703] [] kthread+0xd1/0xe0 [55707.752159] [] ? insert_kthread_work+0x40/0x40 [55707.759001] [] ret_from_fork_nospec_begin+0x21/0x21 [55707.766300] [] ? insert_kthread_work+0x40/0x40 [55707.773122] mdt_io00_000 S ffff995145b1e2a0 0 4936 2 0x00000080 [55707.781129] Call Trace: [55707.783883] [] ? __set_current_blocked+0x42/0x70 [55707.790924] [] schedule+0x29/0x70 [55707.796545] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55707.804090] [] ? __wake_up+0x13/0x20 [55707.809968] [] ? wake_up_atomic_t+0x30/0x30 [55707.816585] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55707.823685] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55707.831995] [] kthread+0xd1/0xe0 [55707.837484] [] ? insert_kthread_work+0x40/0x40 [55707.844326] [] ret_from_fork_nospec_begin+0x21/0x21 [55707.851646] [] ? insert_kthread_work+0x40/0x40 [55707.858493] mdt_io00_001 S ffff99514f238000 0 4937 2 0x00000080 [55707.866454] Call Trace: [55707.869223] [] ? __set_current_blocked+0x42/0x70 [55707.876259] [] schedule+0x29/0x70 [55707.881907] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55707.889437] [] ? __wake_up+0x13/0x20 [55707.895291] [] ? wake_up_atomic_t+0x30/0x30 [55707.901912] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55707.909019] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55707.917324] [] kthread+0xd1/0xe0 [55707.922814] [] ? insert_kthread_work+0x40/0x40 [55707.929663] [] ret_from_fork_nospec_begin+0x21/0x21 [55707.937002] [] ? insert_kthread_work+0x40/0x40 [55707.943852] mdt_io00_002 S ffff99514f239070 0 4938 2 0x00000080 [55707.951829] Call Trace: [55707.954596] [] ? __set_current_blocked+0x42/0x70 [55707.961632] [] schedule+0x29/0x70 [55707.967281] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55707.974812] [] ? __wake_up+0x13/0x20 [55707.980678] [] ? wake_up_atomic_t+0x30/0x30 [55707.987300] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55707.994415] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55708.002727] [] kthread+0xd1/0xe0 [55708.008227] [] ? insert_kthread_work+0x40/0x40 [55708.015092] [] ret_from_fork_nospec_begin+0x21/0x21 [55708.022425] [] ? insert_kthread_work+0x40/0x40 [55708.029275] mdt_io01_000 S ffff99514f23a0e0 0 4939 2 0x00000080 [55708.037250] Call Trace: [55708.040021] [] ? __set_current_blocked+0x42/0x70 [55708.047108] [] schedule+0x29/0x70 [55708.052754] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55708.060270] [] ? __wake_up+0x13/0x20 [55708.066174] [] ? wake_up_atomic_t+0x30/0x30 [55708.072800] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55708.079908] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55708.088214] [] kthread+0xd1/0xe0 [55708.093704] [] ? insert_kthread_work+0x40/0x40 [55708.100545] [] ret_from_fork_nospec_begin+0x21/0x21 [55708.107862] [] ? insert_kthread_work+0x40/0x40 [55708.114709] mdt_io01_001 S ffff99514f23b150 0 4940 2 0x00000080 [55708.122693] Call Trace: [55708.125471] [] ? __set_current_blocked+0x42/0x70 [55708.132503] [] schedule+0x29/0x70 [55708.138172] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55708.145701] [] ? _raw_spin_lock+0x20/0x30 [55708.152090] [] ? wake_up_atomic_t+0x30/0x30 [55708.158733] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55708.165843] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55708.174152] [] kthread+0xd1/0xe0 [55708.179629] [] ? insert_kthread_work+0x40/0x40 [55708.186484] [] ret_from_fork_nospec_begin+0x21/0x21 [55708.193823] [] ? insert_kthread_work+0x40/0x40 [55708.200677] mdt_io01_002 S ffff99514f23c1c0 0 4941 2 0x00000080 [55708.208649] Call Trace: [55708.211409] [] ? __set_current_blocked+0x42/0x70 [55708.218449] [] schedule+0x29/0x70 [55708.224084] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55708.231600] [] ? __wake_up+0x13/0x20 [55708.237471] [] ? wake_up_atomic_t+0x30/0x30 [55708.244076] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55708.251210] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55708.259521] [] kthread+0xd1/0xe0 [55708.265039] [] ? insert_kthread_work+0x40/0x40 [55708.271879] [] ret_from_fork_nospec_begin+0x21/0x21 [55708.279212] [] ? insert_kthread_work+0x40/0x40 [55708.286096] mgs_soaked_noti S ffff99514f23d230 0 4942 2 0x00000080 [55708.294112] Call Trace: [55708.296881] [] schedule+0x29/0x70 [55708.302480] [] mgs_ir_notify+0x1db/0x290 [mgs] [55708.309307] [] ? wake_up_atomic_t+0x30/0x30 [55708.315867] [] ? lprocfs_ir_set_state+0x170/0x170 [mgs] [55708.323595] [] kthread+0xd1/0xe0 [55708.329109] [] ? insert_kthread_work+0x40/0x40 [55708.335957] [] ret_from_fork_nospec_begin+0x21/0x21 [55708.343289] [] ? insert_kthread_work+0x40/0x40 [55708.350128] qmt_reba_soaked S ffff995167e79070 0 4949 2 0x00000080 [55708.358102] Call Trace: [55708.360871] [] schedule+0x29/0x70 [55708.366480] [] qmt_reba_thread+0x377/0xaa0 [lquota] [55708.373822] [] ? qmt_glimpse_lock.isra.12+0x690/0x690 [lquota] [55708.382215] [] kthread+0xd1/0xe0 [55708.387698] [] ? insert_kthread_work+0x40/0x40 [55708.394540] [] ret_from_fork_nospec_begin+0x21/0x21 [55708.401872] [] ? insert_kthread_work+0x40/0x40 [55708.408711] osp_up1-0 S ffff995167e7a0e0 0 4952 2 0x00000080 [55708.416698] Call Trace: [55708.419477] [] ? osp_get_next_request+0x2d/0x1a0 [osp] [55708.427117] [] schedule+0x29/0x70 [55708.432713] [] osp_send_update_thread+0x1b5/0x450 [osp] [55708.440433] [] ? wake_up_atomic_t+0x30/0x30 [55708.447027] [] ? osp_invalidate_request+0x390/0x390 [osp] [55708.454950] [] kthread+0xd1/0xe0 [55708.460432] [] ? insert_kthread_work+0x40/0x40 [55708.467279] [] ret_from_fork_nospec_begin+0x21/0x21 [55708.474613] [] ? insert_kthread_work+0x40/0x40 [55708.481457] osp-pre-1-0 S ffff995167e7b150 0 4953 2 0x00000080 [55708.489433] Call Trace: [55708.492184] [] schedule+0x29/0x70 [55708.497780] [] osp_precreate_thread+0x76b/0x12a0 [osp] [55708.505403] [] ? wake_up_atomic_t+0x30/0x30 [55708.511966] [] ? osp_init_pre_fid+0x630/0x630 [osp] [55708.519302] [] kthread+0xd1/0xe0 [55708.524785] [] ? insert_kthread_work+0x40/0x40 [55708.531618] [] ret_from_fork_nospec_begin+0x21/0x21 [55708.538951] [] ? insert_kthread_work+0x40/0x40 [55708.545799] osp_up2-0 S ffff995167e7c1c0 0 4954 2 0x00000080 [55708.553764] Call Trace: [55708.556524] [] ? osp_get_next_request+0x2d/0x1a0 [osp] [55708.564134] [] schedule+0x29/0x70 [55708.569721] [] osp_send_update_thread+0x1b5/0x450 [osp] [55708.577450] [] ? wake_up_atomic_t+0x30/0x30 [55708.584013] [] ? osp_invalidate_request+0x390/0x390 [osp] [55708.591933] [] kthread+0xd1/0xe0 [55708.597423] [] ? insert_kthread_work+0x40/0x40 [55708.604262] [] ret_from_fork_nospec_begin+0x21/0x21 [55708.611593] [] ? insert_kthread_work+0x40/0x40 [55708.618439] osp-pre-2-0 S ffff995167e7d230 0 4955 2 0x00000080 [55708.626399] Call Trace: [55708.629167] [] schedule+0x29/0x70 [55708.634768] [] osp_precreate_thread+0x76b/0x12a0 [osp] [55708.642398] [] ? wake_up_atomic_t+0x30/0x30 [55708.648951] [] ? osp_init_pre_fid+0x630/0x630 [osp] [55708.656256] [] kthread+0xd1/0xe0 [55708.661724] [] ? insert_kthread_work+0x40/0x40 [55708.668569] [] ret_from_fork_nospec_begin+0x21/0x21 [55708.675894] [] ? insert_kthread_work+0x40/0x40 [55708.682745] osp_up3-0 S ffff995167e7e2a0 0 4956 2 0x00000080 [55708.690720] Call Trace: [55708.693493] [] ? osp_get_next_request+0x2d/0x1a0 [osp] [55708.701132] [] schedule+0x29/0x70 [55708.706725] [] osp_send_update_thread+0x1b5/0x450 [osp] [55708.714445] [] ? wake_up_atomic_t+0x30/0x30 [55708.721035] [] ? osp_invalidate_request+0x390/0x390 [osp] [55708.728941] [] kthread+0xd1/0xe0 [55708.734432] [] ? insert_kthread_work+0x40/0x40 [55708.741279] [] ret_from_fork_nospec_begin+0x21/0x21 [55708.748606] [] ? insert_kthread_work+0x40/0x40 [55708.755444] osp-pre-3-0 S ffff99515de88000 0 4957 2 0x00000080 [55708.763444] Call Trace: [55708.766218] [] schedule+0x29/0x70 [55708.771795] [] osp_precreate_thread+0x76b/0x12a0 [osp] [55708.779405] [] ? wake_up_atomic_t+0x30/0x30 [55708.785969] [] ? osp_init_pre_fid+0x630/0x630 [osp] [55708.793315] [] kthread+0xd1/0xe0 [55708.798812] [] ? insert_kthread_work+0x40/0x40 [55708.805660] [] ret_from_fork_nospec_begin+0x21/0x21 [55708.813000] [] ? insert_kthread_work+0x40/0x40 [55708.819846] osp-syn-0-0 S ffff99515de89070 0 4958 2 0x00000080 [55708.827826] Call Trace: [55708.830592] [] schedule+0x29/0x70 [55708.836178] [] osp_sync_process_queues+0x1681/0x1c20 [osp] [55708.844182] [] ? wake_up_atomic_t+0x30/0x30 [55708.850738] [] llog_process_thread+0x85f/0x1a10 [obdclass] [55708.858771] [] ? llog_cat_id2handle+0x3a8/0x620 [obdclass] [55708.866795] [] ? osp_sync_force+0x300/0x300 [osp] [55708.873965] [] llog_process_or_fork+0xcf/0x520 [obdclass] [55708.881924] [] ? llog_cat_process_common+0x119/0x420 [obdclass] [55708.890446] [] llog_cat_process_cb+0x239/0x250 [obdclass] [55708.898364] [] llog_process_thread+0x85f/0x1a10 [obdclass] [55708.906376] [] ? tracing_is_on+0x15/0x30 [55708.912648] [] ? tracing_record_cmdline+0x1d/0x120 [55708.919890] [] ? try_to_wake_up+0x190/0x390 [55708.926465] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [55708.935013] [] llog_process_or_fork+0xcf/0x520 [obdclass] [55708.942960] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [55708.951499] [] llog_cat_process_or_fork+0x1f1/0x370 [obdclass] [55708.959899] [] ? __wake_up_common_lock+0x91/0xc0 [55708.966955] [] ? osp_sync_force+0x300/0x300 [osp] [55708.974126] [] llog_cat_process+0x2e/0x30 [obdclass] [55708.981562] [] osp_sync_thread+0x550/0xb70 [osp] [55708.988588] [] ? __schedule+0x402/0x840 [55708.994771] [] ? osp_sync_process_committed+0xd40/0xd40 [osp] [55709.003084] [] kthread+0xd1/0xe0 [55709.008582] [] ? insert_kthread_work+0x40/0x40 [55709.015429] [] ret_from_fork_nospec_begin+0x21/0x21 [55709.022767] [] ? insert_kthread_work+0x40/0x40 [55709.029619] osp-pre-0-0 S ffff99515de8a0e0 0 4959 2 0x00000080 [55709.037625] Call Trace: [55709.040392] [] schedule+0x29/0x70 [55709.046010] [] osp_precreate_thread+0x76b/0x12a0 [osp] [55709.053639] [] ? wake_up_atomic_t+0x30/0x30 [55709.060195] [] ? osp_init_pre_fid+0x630/0x630 [osp] [55709.067515] [] kthread+0xd1/0xe0 [55709.073018] [] ? insert_kthread_work+0x40/0x40 [55709.079871] [] ret_from_fork_nospec_begin+0x21/0x21 [55709.087210] [] ? insert_kthread_work+0x40/0x40 [55709.094079] osp-syn-1-0 S ffff99515de8b150 0 4960 2 0x00000080 [55709.102082] Call Trace: [55709.104856] [] schedule+0x29/0x70 [55709.110440] [] osp_sync_process_queues+0x1681/0x1c20 [osp] [55709.118438] [] ? wake_up_atomic_t+0x30/0x30 [55709.125056] [] llog_process_thread+0x85f/0x1a10 [obdclass] [55709.133099] [] ? llog_cat_id2handle+0x3a8/0x620 [obdclass] [55709.141124] [] ? osp_sync_force+0x300/0x300 [osp] [55709.148283] [] llog_process_or_fork+0xcf/0x520 [obdclass] [55709.156217] [] ? llog_cat_process_common+0x119/0x420 [obdclass] [55709.164746] [] llog_cat_process_cb+0x239/0x250 [obdclass] [55709.172684] [] llog_process_thread+0x85f/0x1a10 [obdclass] [55709.180694] [] ? select_task_rq_fair+0x5a6/0x760 [55709.187735] [] ? try_to_wake_up+0x190/0x390 [55709.194330] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [55709.202840] [] llog_process_or_fork+0xcf/0x520 [obdclass] [55709.210782] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [55709.219318] [] llog_cat_process_or_fork+0x1f1/0x370 [obdclass] [55709.227718] [] ? __wake_up_common_lock+0x91/0xc0 [55709.234771] [] ? osp_sync_force+0x300/0x300 [osp] [55709.241933] [] llog_cat_process+0x2e/0x30 [obdclass] [55709.249367] [] osp_sync_thread+0x550/0xb70 [osp] [55709.256372] [] ? __schedule+0x402/0x840 [55709.262556] [] ? osp_sync_process_committed+0xd40/0xd40 [osp] [55709.270864] [] kthread+0xd1/0xe0 [55709.276318] [] ? insert_kthread_work+0x40/0x40 [55709.283128] [] ret_from_fork_nospec_begin+0x21/0x21 [55709.290425] [] ? insert_kthread_work+0x40/0x40 [55709.297255] osp-pre-1-0 S ffff99515de8c1c0 0 4961 2 0x00000080 [55709.305204] Call Trace: [55709.307992] [] schedule+0x29/0x70 [55709.313589] [] osp_precreate_thread+0x76b/0x12a0 [osp] [55709.321192] [] ? wake_up_atomic_t+0x30/0x30 [55709.327764] [] ? osp_init_pre_fid+0x630/0x630 [osp] [55709.335063] [] kthread+0xd1/0xe0 [55709.340547] [] ? insert_kthread_work+0x40/0x40 [55709.347401] [] ret_from_fork_nospec_begin+0x21/0x21 [55709.354740] [] ? insert_kthread_work+0x40/0x40 [55709.361593] kworker/24:1H S ffff99515de8d230 0 4962 2 0x00000080 [55709.369607] Call Trace: [55709.372377] [] ? process_one_work+0x21a/0x440 [55709.379128] [] schedule+0x29/0x70 [55709.384722] [] worker_thread+0x1d9/0x3c0 [55709.391007] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55709.398352] [] kthread+0xd1/0xe0 [55709.403834] [] ? insert_kthread_work+0x40/0x40 [55709.410688] [] ret_from_fork_nospec_begin+0x21/0x21 [55709.418034] [] ? insert_kthread_work+0x40/0x40 [55709.424883] osp-syn-2-0 S ffff99515de8e2a0 0 4963 2 0x00000080 [55709.432866] Call Trace: [55709.435633] [] schedule+0x29/0x70 [55709.441213] [] osp_sync_process_queues+0x1681/0x1c20 [osp] [55709.449226] [] ? wake_up_atomic_t+0x30/0x30 [55709.455802] [] llog_process_thread+0x85f/0x1a10 [obdclass] [55709.463863] [] ? llog_cat_id2handle+0x3a8/0x620 [obdclass] [55709.471884] [] ? osp_sync_force+0x300/0x300 [osp] [55709.479076] [] llog_process_or_fork+0xcf/0x520 [obdclass] [55709.487044] [] ? llog_cat_process_common+0x119/0x420 [obdclass] [55709.495570] [] llog_cat_process_cb+0x239/0x250 [obdclass] [55709.503493] [] llog_process_thread+0x85f/0x1a10 [obdclass] [55709.511498] [] ? tracing_is_on+0x15/0x30 [55709.517771] [] ? tracing_record_cmdline+0x1d/0x120 [55709.525024] [] ? try_to_wake_up+0x190/0x390 [55709.531619] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [55709.540138] [] llog_process_or_fork+0xcf/0x520 [obdclass] [55709.548079] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [55709.556588] [] llog_cat_process_or_fork+0x1f1/0x370 [obdclass] [55709.565014] [] ? __wake_up_common_lock+0x91/0xc0 [55709.572067] [] ? osp_sync_force+0x300/0x300 [osp] [55709.579226] [] llog_cat_process+0x2e/0x30 [obdclass] [55709.586661] [] osp_sync_thread+0x550/0xb70 [osp] [55709.593706] [] ? __schedule+0x402/0x840 [55709.599891] [] ? osp_sync_process_committed+0xd40/0xd40 [osp] [55709.608187] [] kthread+0xd1/0xe0 [55709.613682] [] ? insert_kthread_work+0x40/0x40 [55709.620529] [] ret_from_fork_nospec_begin+0x21/0x21 [55709.627860] [] ? insert_kthread_work+0x40/0x40 [55709.634704] osp-pre-2-0 S ffff9951412b0000 0 4964 2 0x00000080 [55709.642674] Call Trace: [55709.645428] [] schedule+0x29/0x70 [55709.651034] [] osp_precreate_thread+0x76b/0x12a0 [osp] [55709.658666] [] ? wake_up_atomic_t+0x30/0x30 [55709.665238] [] ? osp_init_pre_fid+0x630/0x630 [osp] [55709.672579] [] kthread+0xd1/0xe0 [55709.678075] [] ? insert_kthread_work+0x40/0x40 [55709.684951] [] ret_from_fork_nospec_begin+0x21/0x21 [55709.692274] [] ? insert_kthread_work+0x40/0x40 [55709.699119] osp-syn-3-0 S ffff9951412b1070 0 4965 2 0x00000080 [55709.707092] Call Trace: [55709.709852] [] schedule+0x29/0x70 [55709.715445] [] osp_sync_process_queues+0x1681/0x1c20 [osp] [55709.723467] [] ? wake_up_atomic_t+0x30/0x30 [55709.730069] [] llog_process_thread+0x85f/0x1a10 [obdclass] [55709.738122] [] ? llog_cat_id2handle+0x3a8/0x620 [obdclass] [55709.746140] [] ? osp_sync_force+0x300/0x300 [osp] [55709.753294] [] llog_process_or_fork+0xcf/0x520 [obdclass] [55709.761238] [] ? llog_cat_process_common+0x119/0x420 [obdclass] [55709.769755] [] llog_cat_process_cb+0x239/0x250 [obdclass] [55709.777699] [] llog_process_thread+0x85f/0x1a10 [obdclass] [55709.785705] [] ? tracing_is_on+0x15/0x30 [55709.792016] [] ? tracing_record_cmdline+0x1d/0x120 [55709.799264] [] ? try_to_wake_up+0x190/0x390 [55709.805854] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [55709.814379] [] llog_process_or_fork+0xcf/0x520 [obdclass] [55709.822309] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [55709.830809] [] llog_cat_process_or_fork+0x1f1/0x370 [obdclass] [55709.839197] [] ? __wake_up_common_lock+0x91/0xc0 [55709.846244] [] ? osp_sync_force+0x300/0x300 [osp] [55709.853418] [] llog_cat_process+0x2e/0x30 [obdclass] [55709.860870] [] osp_sync_thread+0x550/0xb70 [osp] [55709.867898] [] ? __schedule+0x402/0x840 [55709.874076] [] ? osp_sync_process_committed+0xd40/0xd40 [osp] [55709.882379] [] kthread+0xd1/0xe0 [55709.887868] [] ? insert_kthread_work+0x40/0x40 [55709.894723] [] ret_from_fork_nospec_begin+0x21/0x21 [55709.902062] [] ? insert_kthread_work+0x40/0x40 [55709.908903] osp-pre-3-0 S ffff9951412b20e0 0 4966 2 0x00000080 [55709.916943] Call Trace: [55709.919703] [] schedule+0x29/0x70 [55709.925303] [] osp_precreate_thread+0x76b/0x12a0 [osp] [55709.932932] [] ? wake_up_atomic_t+0x30/0x30 [55709.939494] [] ? osp_init_pre_fid+0x630/0x630 [osp] [55709.946825] [] kthread+0xd1/0xe0 [55709.952315] [] ? insert_kthread_work+0x40/0x40 [55709.959162] [] ret_from_fork_nospec_begin+0x21/0x21 [55709.966503] [] ? insert_kthread_work+0x40/0x40 [55709.973349] osp-syn-4-0 S ffff9951412b3150 0 4967 2 0x00000080 [55709.981316] Call Trace: [55709.984081] [] schedule+0x29/0x70 [55709.989681] [] osp_sync_process_queues+0x1681/0x1c20 [osp] [55709.997699] [] ? wake_up_atomic_t+0x30/0x30 [55710.004273] [] llog_process_thread+0x85f/0x1a10 [obdclass] [55710.012317] [] ? llog_cat_id2handle+0x3a8/0x620 [obdclass] [55710.020334] [] ? osp_sync_force+0x300/0x300 [osp] [55710.027493] [] llog_process_or_fork+0xcf/0x520 [obdclass] [55710.035431] [] ? llog_cat_process_common+0x119/0x420 [obdclass] [55710.043967] [] llog_cat_process_cb+0x239/0x250 [obdclass] [55710.051927] [] llog_process_thread+0x85f/0x1a10 [obdclass] [55710.059981] [] ? tracing_is_on+0x15/0x30 [55710.066246] [] ? tracing_record_cmdline+0x1d/0x120 [55710.073489] [] ? try_to_wake_up+0x190/0x390 [55710.080076] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [55710.088582] [] llog_process_or_fork+0xcf/0x520 [obdclass] [55710.096509] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [55710.105051] [] llog_cat_process_or_fork+0x1f1/0x370 [obdclass] [55710.113447] [] ? __wake_up_common_lock+0x91/0xc0 [55710.120495] [] ? osp_sync_force+0x300/0x300 [osp] [55710.127657] [] llog_cat_process+0x2e/0x30 [obdclass] [55710.135096] [] osp_sync_thread+0x550/0xb70 [osp] [55710.142136] [] ? __schedule+0x402/0x840 [55710.148304] [] ? osp_sync_process_committed+0xd40/0xd40 [osp] [55710.156600] [] kthread+0xd1/0xe0 [55710.162091] [] ? insert_kthread_work+0x40/0x40 [55710.168980] [] ret_from_fork_nospec_begin+0x21/0x21 [55710.176320] [] ? insert_kthread_work+0x40/0x40 [55710.183157] osp-pre-4-0 S ffff9951412b41c0 0 4968 2 0x00000080 [55710.191123] Call Trace: [55710.193889] [] schedule+0x29/0x70 [55710.199513] [] osp_precreate_thread+0x76b/0x12a0 [osp] [55710.207138] [] ? wake_up_atomic_t+0x30/0x30 [55710.213702] [] ? osp_init_pre_fid+0x630/0x630 [osp] [55710.221028] [] kthread+0xd1/0xe0 [55710.226524] [] ? insert_kthread_work+0x40/0x40 [55710.233371] [] ret_from_fork_nospec_begin+0x21/0x21 [55710.240711] [] ? insert_kthread_work+0x40/0x40 [55710.247566] osp-syn-5-0 S ffff9951412b5230 0 4969 2 0x00000080 [55710.255551] Call Trace: [55710.258317] [] schedule+0x29/0x70 [55710.263923] [] osp_sync_process_queues+0x1681/0x1c20 [osp] [55710.271969] [] ? wake_up_atomic_t+0x30/0x30 [55710.278550] [] llog_process_thread+0x85f/0x1a10 [obdclass] [55710.286593] [] ? llog_cat_id2handle+0x3a8/0x620 [obdclass] [55710.294601] [] ? osp_sync_force+0x300/0x300 [osp] [55710.301773] [] llog_process_or_fork+0xcf/0x520 [obdclass] [55710.309717] [] ? llog_cat_process_common+0x119/0x420 [obdclass] [55710.318246] [] llog_cat_process_cb+0x239/0x250 [obdclass] [55710.326179] [] llog_process_thread+0x85f/0x1a10 [obdclass] [55710.334197] [] ? tracing_is_on+0x15/0x30 [55710.340463] [] ? tracing_record_cmdline+0x1d/0x120 [55710.347692] [] ? try_to_wake_up+0x190/0x390 [55710.354266] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [55710.362799] [] llog_process_or_fork+0xcf/0x520 [obdclass] [55710.370753] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [55710.379283] [] llog_cat_process_or_fork+0x1f1/0x370 [obdclass] [55710.387692] [] ? __wake_up_common_lock+0x91/0xc0 [55710.394739] [] ? osp_sync_force+0x300/0x300 [osp] [55710.401930] [] llog_cat_process+0x2e/0x30 [obdclass] [55710.409359] [] osp_sync_thread+0x550/0xb70 [osp] [55710.416400] [] ? __schedule+0x402/0x840 [55710.422583] [] ? osp_sync_process_committed+0xd40/0xd40 [osp] [55710.430922] [] kthread+0xd1/0xe0 [55710.436404] [] ? insert_kthread_work+0x40/0x40 [55710.443250] [] ret_from_fork_nospec_begin+0x21/0x21 [55710.450582] [] ? insert_kthread_work+0x40/0x40 [55710.457429] osp-pre-5-0 S ffff9951412b62a0 0 4970 2 0x00000080 [55710.465408] Call Trace: [55710.468166] [] schedule+0x29/0x70 [55710.473759] [] osp_precreate_thread+0x76b/0x12a0 [osp] [55710.481382] [] ? wake_up_atomic_t+0x30/0x30 [55710.487969] [] ? osp_init_pre_fid+0x630/0x630 [osp] [55710.495294] [] kthread+0xd1/0xe0 [55710.500776] [] ? insert_kthread_work+0x40/0x40 [55710.507624] [] ret_from_fork_nospec_begin+0x21/0x21 [55710.514977] [] ? insert_kthread_work+0x40/0x40 [55710.521824] osp-syn-6-0 S ffff995141338000 0 4971 2 0x00000080 [55710.529811] Call Trace: [55710.532577] [] schedule+0x29/0x70 [55710.538170] [] osp_sync_process_queues+0x1681/0x1c20 [osp] [55710.546181] [] ? wake_up_atomic_t+0x30/0x30 [55710.552763] [] llog_process_thread+0x85f/0x1a10 [obdclass] [55710.560800] [] ? llog_cat_id2handle+0x3a8/0x620 [obdclass] [55710.568784] [] ? osp_sync_force+0x300/0x300 [osp] [55710.575981] [] llog_process_or_fork+0xcf/0x520 [obdclass] [55710.583923] [] ? llog_cat_process_common+0x119/0x420 [obdclass] [55710.592438] [] llog_cat_process_cb+0x239/0x250 [obdclass] [55710.600378] [] llog_process_thread+0x85f/0x1a10 [obdclass] [55710.608396] [] ? tracing_is_on+0x15/0x30 [55710.614668] [] ? tracing_record_cmdline+0x1d/0x120 [55710.621950] [] ? try_to_wake_up+0x190/0x390 [55710.628530] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [55710.637045] [] llog_process_or_fork+0xcf/0x520 [obdclass] [55710.645014] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [55710.653540] [] llog_cat_process_or_fork+0x1f1/0x370 [obdclass] [55710.661953] [] ? __wake_up_common_lock+0x91/0xc0 [55710.669009] [] ? osp_sync_force+0x300/0x300 [osp] [55710.676161] [] llog_cat_process+0x2e/0x30 [obdclass] [55710.683595] [] osp_sync_thread+0x550/0xb70 [osp] [55710.690644] [] ? __schedule+0x402/0x840 [55710.696818] [] ? osp_sync_process_committed+0xd40/0xd40 [osp] [55710.705120] [] kthread+0xd1/0xe0 [55710.710620] [] ? insert_kthread_work+0x40/0x40 [55710.717472] [] ret_from_fork_nospec_begin+0x21/0x21 [55710.724806] [] ? insert_kthread_work+0x40/0x40 [55710.731647] osp-pre-6-0 S ffff995141339070 0 4972 2 0x00000080 [55710.739631] Call Trace: [55710.742406] [] schedule+0x29/0x70 [55710.747999] [] osp_precreate_thread+0x76b/0x12a0 [osp] [55710.755614] [] ? wake_up_atomic_t+0x30/0x30 [55710.762176] [] ? osp_init_pre_fid+0x630/0x630 [osp] [55710.769511] [] kthread+0xd1/0xe0 [55710.775002] [] ? insert_kthread_work+0x40/0x40 [55710.781878] [] ret_from_fork_nospec_begin+0x21/0x21 [55710.789212] [] ? insert_kthread_work+0x40/0x40 [55710.796037] osp-syn-7-0 S ffff99514133a0e0 0 4973 2 0x00000080 [55710.803988] Call Trace: [55710.806748] [] schedule+0x29/0x70 [55710.812335] [] osp_sync_process_queues+0x1681/0x1c20 [osp] [55710.820341] [] ? wake_up_atomic_t+0x30/0x30 [55710.826959] [] llog_process_thread+0x85f/0x1a10 [obdclass] [55710.835001] [] ? llog_cat_id2handle+0x3a8/0x620 [obdclass] [55710.843032] [] ? osp_sync_force+0x300/0x300 [osp] [55710.850197] [] llog_process_or_fork+0xcf/0x520 [obdclass] [55710.858122] [] ? llog_cat_process_common+0x119/0x420 [obdclass] [55710.866637] [] llog_cat_process_cb+0x239/0x250 [obdclass] [55710.874590] [] llog_process_thread+0x85f/0x1a10 [obdclass] [55710.882606] [] ? tracing_is_on+0x15/0x30 [55710.888898] [] ? tracing_record_cmdline+0x1d/0x120 [55710.896132] [] ? try_to_wake_up+0x190/0x390 [55710.902723] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [55710.911259] [] llog_process_or_fork+0xcf/0x520 [obdclass] [55710.919204] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [55710.927711] [] llog_cat_process_or_fork+0x1f1/0x370 [obdclass] [55710.936098] [] ? __wake_up_common_lock+0x91/0xc0 [55710.943152] [] ? osp_sync_force+0x300/0x300 [osp] [55710.950325] [] llog_cat_process+0x2e/0x30 [obdclass] [55710.957765] [] osp_sync_thread+0x550/0xb70 [osp] [55710.964806] [] ? __schedule+0x402/0x840 [55710.970977] [] ? osp_sync_process_committed+0xd40/0xd40 [osp] [55710.979262] [] kthread+0xd1/0xe0 [55710.984758] [] ? insert_kthread_work+0x40/0x40 [55710.991611] [] ret_from_fork_nospec_begin+0x21/0x21 [55710.998957] [] ? insert_kthread_work+0x40/0x40 [55711.005812] osp-pre-7-0 S ffff99514133b150 0 4974 2 0x00000080 [55711.013785] Call Trace: [55711.016551] [] schedule+0x29/0x70 [55711.022138] [] osp_precreate_thread+0x76b/0x12a0 [osp] [55711.029769] [] ? wake_up_atomic_t+0x30/0x30 [55711.036319] [] ? osp_init_pre_fid+0x630/0x630 [osp] [55711.043651] [] kthread+0xd1/0xe0 [55711.049142] [] ? insert_kthread_work+0x40/0x40 [55711.055993] [] ret_from_fork_nospec_begin+0x21/0x21 [55711.063326] [] ? insert_kthread_work+0x40/0x40 [55711.070171] osp-syn-8-0 S ffff99514133c1c0 0 4975 2 0x00000080 [55711.078140] Call Trace: [55711.080937] [] schedule+0x29/0x70 [55711.086539] [] osp_sync_process_queues+0x1681/0x1c20 [osp] [55711.094559] [] ? wake_up_atomic_t+0x30/0x30 [55711.101139] [] llog_process_thread+0x85f/0x1a10 [obdclass] [55711.109182] [] ? llog_cat_id2handle+0x3a8/0x620 [obdclass] [55711.117193] [] ? osp_sync_force+0x300/0x300 [osp] [55711.124343] [] llog_process_or_fork+0xcf/0x520 [obdclass] [55711.132282] [] ? llog_cat_process_common+0x119/0x420 [obdclass] [55711.140799] [] llog_cat_process_cb+0x239/0x250 [obdclass] [55711.148732] [] llog_process_thread+0x85f/0x1a10 [obdclass] [55711.156723] [] ? tracing_is_on+0x15/0x30 [55711.162995] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [55711.171533] [] llog_process_or_fork+0xcf/0x520 [obdclass] [55711.179479] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [55711.187988] [] llog_cat_process_or_fork+0x1f1/0x370 [obdclass] [55711.196374] [] ? __wake_up_common_lock+0x91/0xc0 [55711.203429] [] ? osp_sync_force+0x300/0x300 [osp] [55711.210598] [] llog_cat_process+0x2e/0x30 [obdclass] [55711.218050] [] osp_sync_thread+0x550/0xb70 [osp] [55711.225092] [] ? __schedule+0x402/0x840 [55711.231232] [] ? osp_sync_process_committed+0xd40/0xd40 [osp] [55711.239539] [] kthread+0xd1/0xe0 [55711.245030] [] ? insert_kthread_work+0x40/0x40 [55711.251882] [] ret_from_fork_nospec_begin+0x21/0x21 [55711.259222] [] ? insert_kthread_work+0x40/0x40 [55711.266074] osp-pre-8-0 S ffff99514133d230 0 4976 2 0x00000080 [55711.274048] Call Trace: [55711.276808] [] schedule+0x29/0x70 [55711.282408] [] osp_precreate_thread+0x76b/0x12a0 [osp] [55711.290032] [] ? wake_up_atomic_t+0x30/0x30 [55711.296588] [] ? osp_init_pre_fid+0x630/0x630 [osp] [55711.303934] [] kthread+0xd1/0xe0 [55711.309431] [] ? insert_kthread_work+0x40/0x40 [55711.316256] [] ret_from_fork_nospec_begin+0x21/0x21 [55711.323581] [] ? insert_kthread_work+0x40/0x40 [55711.330424] osp-syn-9-0 S ffff99514133e2a0 0 4977 2 0x00000080 [55711.338430] Call Trace: [55711.341196] [] schedule+0x29/0x70 [55711.346798] [] osp_sync_process_queues+0x1681/0x1c20 [osp] [55711.354835] [] ? wake_up_atomic_t+0x30/0x30 [55711.361417] [] llog_process_thread+0x85f/0x1a10 [obdclass] [55711.369470] [] ? llog_cat_id2handle+0x3a8/0x620 [obdclass] [55711.377494] [] ? osp_sync_force+0x300/0x300 [osp] [55711.384664] [] llog_process_or_fork+0xcf/0x520 [obdclass] [55711.392601] [] ? llog_cat_process_common+0x119/0x420 [obdclass] [55711.401130] [] llog_cat_process_cb+0x239/0x250 [obdclass] [55711.409063] [] llog_process_thread+0x85f/0x1a10 [obdclass] [55711.417088] [] ? tracing_is_on+0x15/0x30 [55711.423353] [] ? tracing_record_cmdline+0x1d/0x120 [55711.430595] [] ? try_to_wake_up+0x190/0x390 [55711.437193] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [55711.445708] [] llog_process_or_fork+0xcf/0x520 [obdclass] [55711.453653] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [55711.462178] [] llog_cat_process_or_fork+0x1f1/0x370 [obdclass] [55711.470578] [] ? __wake_up_common_lock+0x91/0xc0 [55711.477633] [] ? osp_sync_force+0x300/0x300 [osp] [55711.484790] [] llog_cat_process+0x2e/0x30 [obdclass] [55711.492215] [] osp_sync_thread+0x550/0xb70 [osp] [55711.499249] [] ? __schedule+0x402/0x840 [55711.505432] [] ? osp_sync_process_committed+0xd40/0xd40 [osp] [55711.513735] [] kthread+0xd1/0xe0 [55711.519219] [] ? insert_kthread_work+0x40/0x40 [55711.526074] [] ret_from_fork_nospec_begin+0x21/0x21 [55711.533414] [] ? insert_kthread_work+0x40/0x40 [55711.540254] osp-pre-9-0 S ffff995141210000 0 4978 2 0x00000080 [55711.548241] Call Trace: [55711.551000] [] schedule+0x29/0x70 [55711.556578] [] osp_precreate_thread+0x76b/0x12a0 [osp] [55711.564188] [] ? wake_up_atomic_t+0x30/0x30 [55711.570747] [] ? osp_init_pre_fid+0x630/0x630 [osp] [55711.578086] [] kthread+0xd1/0xe0 [55711.583576] [] ? insert_kthread_work+0x40/0x40 [55711.590430] [] ret_from_fork_nospec_begin+0x21/0x21 [55711.597771] [] ? insert_kthread_work+0x40/0x40 [55711.604617] osp-syn-10-0 S ffff995141211070 0 4979 2 0x00000080 [55711.612596] Call Trace: [55711.615368] [] schedule+0x29/0x70 [55711.620940] [] osp_sync_process_queues+0x1681/0x1c20 [osp] [55711.628938] [] ? wake_up_atomic_t+0x30/0x30 [55711.635513] [] llog_process_thread+0x85f/0x1a10 [obdclass] [55711.643556] [] ? llog_cat_id2handle+0x3a8/0x620 [obdclass] [55711.651566] [] ? osp_sync_force+0x300/0x300 [osp] [55711.658737] [] llog_process_or_fork+0xcf/0x520 [obdclass] [55711.666681] [] ? llog_cat_process_common+0x119/0x420 [obdclass] [55711.675189] [] llog_cat_process_cb+0x239/0x250 [obdclass] [55711.683124] [] llog_process_thread+0x85f/0x1a10 [obdclass] [55711.691123] [] ? tracing_is_on+0x15/0x30 [55711.697415] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [55711.705960] [] llog_process_or_fork+0xcf/0x520 [obdclass] [55711.713947] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [55711.722461] [] llog_cat_process_or_fork+0x1f1/0x370 [obdclass] [55711.730893] [] ? __wake_up_common_lock+0x91/0xc0 [55711.737950] [] ? osp_sync_force+0x300/0x300 [osp] [55711.745096] [] llog_cat_process+0x2e/0x30 [obdclass] [55711.752535] [] osp_sync_thread+0x550/0xb70 [osp] [55711.759583] [] ? __schedule+0x402/0x840 [55711.765766] [] ? osp_sync_process_committed+0xd40/0xd40 [osp] [55711.774074] [] kthread+0xd1/0xe0 [55711.779569] [] ? insert_kthread_work+0x40/0x40 [55711.786417] [] ret_from_fork_nospec_begin+0x21/0x21 [55711.793754] [] ? insert_kthread_work+0x40/0x40 [55711.800601] osp-pre-10-0 S ffff9951412120e0 0 4980 2 0x00000080 [55711.808591] Call Trace: [55711.811364] [] schedule+0x29/0x70 [55711.816956] [] osp_precreate_thread+0x76b/0x12a0 [osp] [55711.824586] [] ? wake_up_atomic_t+0x30/0x30 [55711.831141] [] ? osp_init_pre_fid+0x630/0x630 [osp] [55711.838463] [] kthread+0xd1/0xe0 [55711.843947] [] ? insert_kthread_work+0x40/0x40 [55711.850812] [] ret_from_fork_nospec_begin+0x21/0x21 [55711.858136] [] ? insert_kthread_work+0x40/0x40 [55711.864977] osp-syn-11-0 S ffff995141213150 0 4981 2 0x00000080 [55711.872943] Call Trace: [55711.875705] [] schedule+0x29/0x70 [55711.881297] [] osp_sync_process_queues+0x1681/0x1c20 [osp] [55711.889308] [] ? wake_up_atomic_t+0x30/0x30 [55711.895913] [] llog_process_thread+0x85f/0x1a10 [obdclass] [55711.903978] [] ? llog_cat_id2handle+0x3a8/0x620 [obdclass] [55711.911997] [] ? osp_sync_force+0x300/0x300 [osp] [55711.919161] [] llog_process_or_fork+0xcf/0x520 [obdclass] [55711.927116] [] ? llog_cat_process_common+0x119/0x420 [obdclass] [55711.935650] [] llog_cat_process_cb+0x239/0x250 [obdclass] [55711.943593] [] llog_process_thread+0x85f/0x1a10 [obdclass] [55711.951590] [] ? tracing_is_on+0x15/0x30 [55711.957881] [] ? tracing_record_cmdline+0x1d/0x120 [55711.965124] [] ? try_to_wake_up+0x190/0x390 [55711.971694] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [55711.980222] [] llog_process_or_fork+0xcf/0x520 [obdclass] [55711.988157] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [55711.996676] [] llog_cat_process_or_fork+0x1f1/0x370 [obdclass] [55712.005081] [] ? __wake_up_common_lock+0x91/0xc0 [55712.012115] [] ? osp_sync_force+0x300/0x300 [osp] [55712.019280] [] llog_cat_process+0x2e/0x30 [obdclass] [55712.026719] [] osp_sync_thread+0x550/0xb70 [osp] [55712.033753] [] ? __schedule+0x402/0x840 [55712.039937] [] ? osp_sync_process_committed+0xd40/0xd40 [osp] [55712.048240] [] kthread+0xd1/0xe0 [55712.053737] [] ? insert_kthread_work+0x40/0x40 [55712.060578] [] ret_from_fork_nospec_begin+0x21/0x21 [55712.067903] [] ? insert_kthread_work+0x40/0x40 [55712.074751] osp-pre-11-0 S ffff9951412141c0 0 4982 2 0x00000080 [55712.082724] Call Trace: [55712.085482] [] schedule+0x29/0x70 [55712.091077] [] osp_precreate_thread+0x76b/0x12a0 [osp] [55712.098709] [] ? wake_up_atomic_t+0x30/0x30 [55712.105273] [] ? osp_init_pre_fid+0x630/0x630 [osp] [55712.112611] [] kthread+0xd1/0xe0 [55712.118102] [] ? insert_kthread_work+0x40/0x40 [55712.124948] [] ret_from_fork_nospec_begin+0x21/0x21 [55712.132274] [] ? insert_kthread_work+0x40/0x40 [55712.139105] osp-syn-12-0 S ffff995141215230 0 4983 2 0x00000080 [55712.147072] Call Trace: [55712.149858] [] schedule+0x29/0x70 [55712.155462] [] osp_sync_process_queues+0x1681/0x1c20 [osp] [55712.163480] [] ? wake_up_atomic_t+0x30/0x30 [55712.170053] [] llog_process_thread+0x85f/0x1a10 [obdclass] [55712.178085] [] ? llog_cat_id2handle+0x3a8/0x620 [obdclass] [55712.186094] [] ? osp_sync_force+0x300/0x300 [osp] [55712.193250] [] llog_process_or_fork+0xcf/0x520 [obdclass] [55712.201193] [] ? llog_cat_process_common+0x119/0x420 [obdclass] [55712.209702] [] llog_cat_process_cb+0x239/0x250 [obdclass] [55712.217633] [] llog_process_thread+0x85f/0x1a10 [obdclass] [55712.225644] [] ? tracing_is_on+0x15/0x30 [55712.231900] [] ? tracing_record_cmdline+0x1d/0x120 [55712.239131] [] ? try_to_wake_up+0x190/0x390 [55712.245721] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [55712.254237] [] llog_process_or_fork+0xcf/0x520 [obdclass] [55712.262161] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [55712.270682] [] llog_cat_process_or_fork+0x1f1/0x370 [obdclass] [55712.279067] [] ? __wake_up_common_lock+0x91/0xc0 [55712.286123] [] ? osp_sync_force+0x300/0x300 [osp] [55712.293295] [] llog_cat_process+0x2e/0x30 [obdclass] [55712.300739] [] osp_sync_thread+0x550/0xb70 [osp] [55712.307785] [] ? __schedule+0x402/0x840 [55712.313966] [] ? osp_sync_process_committed+0xd40/0xd40 [osp] [55712.322258] [] kthread+0xd1/0xe0 [55712.327741] [] ? insert_kthread_work+0x40/0x40 [55712.334597] [] ret_from_fork_nospec_begin+0x21/0x21 [55712.341929] [] ? insert_kthread_work+0x40/0x40 [55712.348795] osp-pre-12-0 S ffff9951412162a0 0 4984 2 0x00000080 [55712.356797] Call Trace: [55712.359577] [] schedule+0x29/0x70 [55712.365172] [] osp_precreate_thread+0x76b/0x12a0 [osp] [55712.372806] [] ? wake_up_atomic_t+0x30/0x30 [55712.379375] [] ? osp_init_pre_fid+0x630/0x630 [osp] [55712.386714] [] kthread+0xd1/0xe0 [55712.392197] [] ? insert_kthread_work+0x40/0x40 [55712.399019] [] ret_from_fork_nospec_begin+0x21/0x21 [55712.406344] [] ? insert_kthread_work+0x40/0x40 [55712.413198] osp-syn-13-0 S ffff995165f08000 0 4985 2 0x00000080 [55712.421186] Call Trace: [55712.423960] [] schedule+0x29/0x70 [55712.429550] [] osp_sync_process_queues+0x1681/0x1c20 [osp] [55712.437567] [] ? wake_up_atomic_t+0x30/0x30 [55712.444141] [] llog_process_thread+0x85f/0x1a10 [obdclass] [55712.452153] [] ? llog_cat_id2handle+0x3a8/0x620 [obdclass] [55712.460170] [] ? osp_sync_force+0x300/0x300 [osp] [55712.467340] [] llog_process_or_fork+0xcf/0x520 [obdclass] [55712.475281] [] ? llog_cat_process_common+0x119/0x420 [obdclass] [55712.483836] [] llog_cat_process_cb+0x239/0x250 [obdclass] [55712.491800] [] llog_process_thread+0x85f/0x1a10 [obdclass] [55712.499805] [] ? tracing_is_on+0x15/0x30 [55712.506073] [] ? tracing_record_cmdline+0x1d/0x120 [55712.513316] [] ? try_to_wake_up+0x190/0x390 [55712.519905] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [55712.528423] [] llog_process_or_fork+0xcf/0x520 [obdclass] [55712.536351] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [55712.544904] [] llog_cat_process_or_fork+0x1f1/0x370 [obdclass] [55712.553297] [] ? __wake_up_common_lock+0x91/0xc0 [55712.560352] [] ? osp_sync_force+0x300/0x300 [osp] [55712.567523] [] llog_cat_process+0x2e/0x30 [obdclass] [55712.574975] [] osp_sync_thread+0x550/0xb70 [osp] [55712.582018] [] ? __schedule+0x402/0x840 [55712.588179] [] ? osp_sync_process_committed+0xd40/0xd40 [osp] [55712.596476] [] kthread+0xd1/0xe0 [55712.601974] [] ? insert_kthread_work+0x40/0x40 [55712.608853] [] ret_from_fork_nospec_begin+0x21/0x21 [55712.616192] [] ? insert_kthread_work+0x40/0x40 [55712.623038] osp-pre-13-0 S ffff995165f09070 0 4986 2 0x00000080 [55712.631000] Call Trace: [55712.633784] [] schedule+0x29/0x70 [55712.639385] [] osp_precreate_thread+0x76b/0x12a0 [osp] [55712.646972] [] ? wake_up_atomic_t+0x30/0x30 [55712.653532] [] ? osp_init_pre_fid+0x630/0x630 [osp] [55712.660869] [] kthread+0xd1/0xe0 [55712.666366] [] ? insert_kthread_work+0x40/0x40 [55712.673221] [] ret_from_fork_nospec_begin+0x21/0x21 [55712.680550] [] ? insert_kthread_work+0x40/0x40 [55712.687358] osp-syn-14-0 S ffff995165f0a0e0 0 4987 2 0x00000080 [55712.695355] Call Trace: [55712.698120] [] schedule+0x29/0x70 [55712.703713] [] osp_sync_process_queues+0x1681/0x1c20 [osp] [55712.711750] [] ? wake_up_atomic_t+0x30/0x30 [55712.718326] [] llog_process_thread+0x85f/0x1a10 [obdclass] [55712.726369] [] ? llog_cat_id2handle+0x3a8/0x620 [obdclass] [55712.734401] [] ? osp_sync_force+0x300/0x300 [osp] [55712.741571] [] llog_process_or_fork+0xcf/0x520 [obdclass] [55712.749513] [] ? llog_cat_process_common+0x119/0x420 [obdclass] [55712.758039] [] llog_cat_process_cb+0x239/0x250 [obdclass] [55712.765995] [] llog_process_thread+0x85f/0x1a10 [obdclass] [55712.774009] [] ? tracing_is_on+0x15/0x30 [55712.780260] [] ? tracing_record_cmdline+0x1d/0x120 [55712.787504] [] ? try_to_wake_up+0x190/0x390 [55712.794092] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [55712.802626] [] llog_process_or_fork+0xcf/0x520 [obdclass] [55712.810559] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [55712.819081] [] llog_cat_process_or_fork+0x1f1/0x370 [obdclass] [55712.827474] [] ? __wake_up_common_lock+0x91/0xc0 [55712.834530] [] ? osp_sync_force+0x300/0x300 [osp] [55712.841686] [] llog_cat_process+0x2e/0x30 [obdclass] [55712.849116] [] osp_sync_thread+0x550/0xb70 [osp] [55712.856151] [] ? __schedule+0x402/0x840 [55712.862334] [] ? osp_sync_process_committed+0xd40/0xd40 [osp] [55712.870642] [] kthread+0xd1/0xe0 [55712.876125] [] ? insert_kthread_work+0x40/0x40 [55712.882973] [] ret_from_fork_nospec_begin+0x21/0x21 [55712.890313] [] ? insert_kthread_work+0x40/0x40 [55712.897161] osp-pre-14-0 S ffff995165f0b150 0 4988 2 0x00000080 [55712.905123] Call Trace: [55712.907875] [] schedule+0x29/0x70 [55712.913431] [] osp_precreate_thread+0x76b/0x12a0 [osp] [55712.921055] [] ? wake_up_atomic_t+0x30/0x30 [55712.927626] [] ? osp_init_pre_fid+0x630/0x630 [osp] [55712.934965] [] kthread+0xd1/0xe0 [55712.940455] [] ? insert_kthread_work+0x40/0x40 [55712.947308] [] ret_from_fork_nospec_begin+0x21/0x21 [55712.954632] [] ? insert_kthread_work+0x40/0x40 [55712.961483] osp-syn-15-0 S ffff995165f0c1c0 0 4989 2 0x00000080 [55712.969472] Call Trace: [55712.972216] [] schedule+0x29/0x70 [55712.977828] [] osp_sync_process_queues+0x1681/0x1c20 [osp] [55712.985843] [] ? wake_up_atomic_t+0x30/0x30 [55712.992426] [] llog_process_thread+0x85f/0x1a10 [obdclass] [55713.000467] [] ? llog_cat_id2handle+0x3a8/0x620 [obdclass] [55713.008489] [] ? osp_sync_force+0x300/0x300 [osp] [55713.015650] [] llog_process_or_fork+0xcf/0x520 [obdclass] [55713.023591] [] ? llog_cat_process_common+0x119/0x420 [obdclass] [55713.032122] [] llog_cat_process_cb+0x239/0x250 [obdclass] [55713.040055] [] llog_process_thread+0x85f/0x1a10 [obdclass] [55713.048066] [] ? tracing_is_on+0x15/0x30 [55713.054333] [] ? tracing_record_cmdline+0x1d/0x120 [55713.061575] [] ? try_to_wake_up+0x190/0x390 [55713.068150] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [55713.076677] [] llog_process_or_fork+0xcf/0x520 [obdclass] [55713.084613] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [55713.093136] [] llog_cat_process_or_fork+0x1f1/0x370 [obdclass] [55713.101534] [] ? __wake_up_common_lock+0x91/0xc0 [55713.108574] [] ? osp_sync_force+0x300/0x300 [osp] [55713.115753] [] llog_cat_process+0x2e/0x30 [obdclass] [55713.123190] [] osp_sync_thread+0x550/0xb70 [osp] [55713.130224] [] ? __schedule+0x402/0x840 [55713.136405] [] ? osp_sync_process_committed+0xd40/0xd40 [osp] [55713.144719] [] kthread+0xd1/0xe0 [55713.150210] [] ? insert_kthread_work+0x40/0x40 [55713.157057] [] ret_from_fork_nospec_begin+0x21/0x21 [55713.164385] [] ? insert_kthread_work+0x40/0x40 [55713.171232] osp-pre-15-0 S ffff995165f0d230 0 4990 2 0x00000080 [55713.179230] Call Trace: [55713.181995] [] schedule+0x29/0x70 [55713.187583] [] osp_precreate_thread+0x76b/0x12a0 [osp] [55713.195206] [] ? wake_up_atomic_t+0x30/0x30 [55713.201794] [] ? osp_init_pre_fid+0x630/0x630 [osp] [55713.209127] [] kthread+0xd1/0xe0 [55713.214624] [] ? insert_kthread_work+0x40/0x40 [55713.221479] [] ret_from_fork_nospec_begin+0x21/0x21 [55713.228831] [] ? insert_kthread_work+0x40/0x40 [55713.235672] mdt01_003 S ffff99514132a0e0 0 4994 2 0x00000080 [55713.243674] Call Trace: [55713.246448] [] ? __set_current_blocked+0x42/0x70 [55713.253485] [] schedule+0x29/0x70 [55713.259141] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55713.266679] [] ? __wake_up+0x13/0x20 [55713.272584] [] ? wake_up_atomic_t+0x30/0x30 [55713.279209] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55713.286317] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55713.294608] [] kthread+0xd1/0xe0 [55713.300069] [] ? insert_kthread_work+0x40/0x40 [55713.306881] [] ret_from_fork_nospec_begin+0x21/0x21 [55713.314211] [] ? insert_kthread_work+0x40/0x40 [55713.321035] lquota_wb_soake S ffff99514132b150 0 4995 2 0x00000080 [55713.328984] Call Trace: [55713.331748] [] schedule+0x29/0x70 [55713.337311] [] schedule_timeout+0x168/0x2d0 [55713.343860] [] ? __internal_add_timer+0x130/0x130 [55713.351009] [] qsd_upd_thread+0x977/0xc50 [lquota] [55713.358258] [] ? qsd_upd_add+0xe0/0xe0 [lquota] [55713.365203] [] kthread+0xd1/0xe0 [55713.370713] [] ? insert_kthread_work+0x40/0x40 [55713.377575] [] ret_from_fork_nospec_begin+0x21/0x21 [55713.384907] [] ? insert_kthread_work+0x40/0x40 [55713.391768] lquota_wb_soake S ffff99514132c1c0 0 4996 2 0x00000080 [55713.399775] Call Trace: [55713.402542] [] schedule+0x29/0x70 [55713.408124] [] schedule_timeout+0x168/0x2d0 [55713.414707] [] ? __internal_add_timer+0x130/0x130 [55713.421865] [] qsd_upd_thread+0x977/0xc50 [lquota] [55713.429105] [] ? qsd_upd_add+0xe0/0xe0 [lquota] [55713.436042] [] kthread+0xd1/0xe0 [55713.441533] [] ? insert_kthread_work+0x40/0x40 [55713.448385] [] ret_from_fork_nospec_begin+0x21/0x21 [55713.455743] [] ? insert_kthread_work+0x40/0x40 [55713.462596] dist_txn-0 D ffff99514132d230 0 4997 2 0x00000080 [55713.470581] Call Trace: [55713.473356] [] schedule+0x29/0x70 [55713.478914] [] rwsem_down_write_failed+0x215/0x3c0 [55713.486171] [] ? llog_osd_regular_fid_del_name_entry+0x272/0x500 [obdclass] [55713.495824] [] call_rwsem_down_write_failed+0x17/0x30 [55713.503357] [] down_write+0x2d/0x3d [55713.509168] [] llog_cancel_arr_rec+0x14c/0x970 [obdclass] [55713.517102] [] llog_cat_cancel_arr_rec+0xd4/0x470 [obdclass] [55713.525327] [] llog_cat_cancel_records+0x77/0x1c0 [obdclass] [55713.533614] [] distribute_txn_commit_thread+0x5a9/0xc90 [ptlrpc] [55713.542211] [] ? wake_up_atomic_t+0x30/0x30 [55713.548843] [] ? sub_trans_commit_cb+0x20/0x20 [ptlrpc] [55713.556562] [] kthread+0xd1/0xe0 [55713.562059] [] ? insert_kthread_work+0x40/0x40 [55713.568915] [] ret_from_fork_nospec_begin+0x21/0x21 [55713.576254] [] ? insert_kthread_work+0x40/0x40 [55713.583102] kworker/6:1H S ffff994975dd9070 0 5008 2 0x00000080 [55713.591083] Call Trace: [55713.593844] [] ? process_one_work+0x21a/0x440 [55713.600601] [] schedule+0x29/0x70 [55713.606188] [] worker_thread+0x1d9/0x3c0 [55713.612440] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55713.619772] [] kthread+0xd1/0xe0 [55713.625268] [] ? insert_kthread_work+0x40/0x40 [55713.632124] [] ret_from_fork_nospec_begin+0x21/0x21 [55713.639465] [] ? insert_kthread_work+0x40/0x40 [55713.646288] mdt00_003 S ffff994975ddb150 0 5009 2 0x00000080 [55713.654277] Call Trace: [55713.657045] [] ? __set_current_blocked+0x42/0x70 [55713.664086] [] schedule+0x29/0x70 [55713.669754] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55713.677283] [] ? __wake_up+0x13/0x20 [55713.683161] [] ? wake_up_atomic_t+0x30/0x30 [55713.689826] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55713.696945] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55713.705251] [] kthread+0xd1/0xe0 [55713.710763] [] ? insert_kthread_work+0x40/0x40 [55713.717622] [] ret_from_fork_nospec_begin+0x21/0x21 [55713.724946] [] ? insert_kthread_work+0x40/0x40 [55713.731793] mdt00_004 S ffff994975dda0e0 0 5125 2 0x00000080 [55713.739749] Call Trace: [55713.742516] [] ? __set_current_blocked+0x42/0x70 [55713.749556] [] schedule+0x29/0x70 [55713.755216] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55713.762781] [] ? __wake_up+0x13/0x20 [55713.768683] [] ? wake_up_atomic_t+0x30/0x30 [55713.775311] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55713.782428] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55713.790753] [] kthread+0xd1/0xe0 [55713.796251] [] ? insert_kthread_work+0x40/0x40 [55713.803098] [] ret_from_fork_nospec_begin+0x21/0x21 [55713.810437] [] ? insert_kthread_work+0x40/0x40 [55713.817289] mdt00_005 S ffff994975ddd230 0 5126 2 0x00000080 [55713.825287] Call Trace: [55713.828049] [] ? __set_current_blocked+0x42/0x70 [55713.835088] [] schedule+0x29/0x70 [55713.840760] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55713.848289] [] ? __wake_up+0x13/0x20 [55713.854168] [] ? wake_up_atomic_t+0x30/0x30 [55713.860797] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55713.867891] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55713.876183] [] kthread+0xd1/0xe0 [55713.881686] [] ? insert_kthread_work+0x40/0x40 [55713.888546] [] ret_from_fork_nospec_begin+0x21/0x21 [55713.895878] [] ? insert_kthread_work+0x40/0x40 [55713.902741] mdt_out01_002 S ffff994975dd8000 0 5131 2 0x00000080 [55713.910742] Call Trace: [55713.913517] [] ? __set_current_blocked+0x42/0x70 [55713.920558] [] schedule+0x29/0x70 [55713.926198] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55713.933738] [] ? __wake_up+0x13/0x20 [55713.939620] [] ? wake_up_atomic_t+0x30/0x30 [55713.946247] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55713.953364] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55713.961679] [] kthread+0xd1/0xe0 [55713.967168] [] ? insert_kthread_work+0x40/0x40 [55713.974009] [] ret_from_fork_nospec_begin+0x21/0x21 [55713.981346] [] ? insert_kthread_work+0x40/0x40 [55713.988186] mdt_rdpg01_002 S ffff994d68141070 0 5136 2 0x00000080 [55713.996168] Call Trace: [55713.998935] [] schedule+0x29/0x70 [55714.004581] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55714.012095] [] ? _raw_spin_lock+0x20/0x30 [55714.018468] [] ? wake_up_atomic_t+0x30/0x30 [55714.025097] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55714.032205] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55714.040516] [] kthread+0xd1/0xe0 [55714.046001] [] ? insert_kthread_work+0x40/0x40 [55714.052848] [] ret_from_fork_nospec_begin+0x21/0x21 [55714.060167] [] ? insert_kthread_work+0x40/0x40 [55714.067013] ldlm_cn01_003 S ffff994d681462a0 0 5138 2 0x00000080 [55714.074981] Call Trace: [55714.077761] [] ? _raw_spin_lock_irqsave+0x37/0x40 [55714.084907] [] schedule+0x29/0x70 [55714.090565] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55714.098097] [] ? __wake_up+0x13/0x20 [55714.103976] [] ? wake_up_atomic_t+0x30/0x30 [55714.110601] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55714.117714] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55714.126012] [] kthread+0xd1/0xe0 [55714.131511] [] ? insert_kthread_work+0x40/0x40 [55714.138366] [] ret_from_fork_nospec_begin+0x21/0x21 [55714.145726] [] ? insert_kthread_work+0x40/0x40 [55714.152587] mdt01_004 S ffff994d6b10b150 0 5139 2 0x00000080 [55714.160587] Call Trace: [55714.163354] [] ? __set_current_blocked+0x42/0x70 [55714.170403] [] schedule+0x29/0x70 [55714.176052] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55714.183589] [] ? __wake_up+0x13/0x20 [55714.189475] [] ? wake_up_atomic_t+0x30/0x30 [55714.196080] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55714.203197] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55714.211510] [] kthread+0xd1/0xe0 [55714.217010] [] ? insert_kthread_work+0x40/0x40 [55714.223859] [] ret_from_fork_nospec_begin+0x21/0x21 [55714.231198] [] ? insert_kthread_work+0x40/0x40 [55714.238044] mdt01_005 S ffff994d6b10d230 0 5140 2 0x00000080 [55714.246019] Call Trace: [55714.248779] [] ? __set_current_blocked+0x42/0x70 [55714.255821] [] schedule+0x29/0x70 [55714.261477] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55714.269014] [] ? __wake_up+0x13/0x20 [55714.274900] [] ? wake_up_atomic_t+0x30/0x30 [55714.281526] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55714.288643] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55714.296955] [] kthread+0xd1/0xe0 [55714.302437] [] ? insert_kthread_work+0x40/0x40 [55714.309292] [] ret_from_fork_nospec_begin+0x21/0x21 [55714.316614] [] ? insert_kthread_work+0x40/0x40 [55714.323488] mdt01_006 S ffff994d6a6fb150 0 5141 2 0x00000080 [55714.331487] Call Trace: [55714.334252] [] ? __set_current_blocked+0x42/0x70 [55714.341302] [] schedule+0x29/0x70 [55714.346953] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55714.354471] [] ? __wake_up+0x13/0x20 [55714.360358] [] ? wake_up_atomic_t+0x30/0x30 [55714.366978] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55714.374086] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55714.382398] [] kthread+0xd1/0xe0 [55714.387866] [] ? insert_kthread_work+0x40/0x40 [55714.394738] [] ret_from_fork_nospec_begin+0x21/0x21 [55714.402069] [] ? insert_kthread_work+0x40/0x40 [55714.408914] mdt00_006 S ffff994d6a6fe2a0 0 5142 2 0x00000080 [55714.416881] Call Trace: [55714.419651] [] ? __set_current_blocked+0x42/0x70 [55714.426673] [] schedule+0x29/0x70 [55714.432311] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55714.439834] [] ? __wake_up+0x13/0x20 [55714.445733] [] ? wake_up_atomic_t+0x30/0x30 [55714.452347] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55714.459462] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55714.467760] [] kthread+0xd1/0xe0 [55714.473236] [] ? insert_kthread_work+0x40/0x40 [55714.480088] [] ret_from_fork_nospec_begin+0x21/0x21 [55714.487427] [] ? insert_kthread_work+0x40/0x40 [55714.494272] ldlm_cn00_003 S ffff9951674062a0 0 5143 2 0x00000080 [55714.502243] Call Trace: [55714.505012] [] ? _raw_spin_lock_irqsave+0x37/0x40 [55714.512149] [] schedule+0x29/0x70 [55714.517802] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55714.525326] [] ? __wake_up+0x13/0x20 [55714.531210] [] ? wake_up_atomic_t+0x30/0x30 [55714.537830] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55714.544938] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55714.553248] [] kthread+0xd1/0xe0 [55714.558702] [] ? insert_kthread_work+0x40/0x40 [55714.565562] [] ret_from_fork_nospec_begin+0x21/0x21 [55714.572866] [] ? insert_kthread_work+0x40/0x40 [55714.579717] ldlm_cn01_004 S ffff9951674020e0 0 5144 2 0x00000080 [55714.587709] Call Trace: [55714.590476] [] ? _raw_spin_lock_irqsave+0x37/0x40 [55714.597621] [] schedule+0x29/0x70 [55714.603259] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55714.610790] [] ? _raw_spin_lock+0x20/0x30 [55714.617154] [] ? wake_up_atomic_t+0x30/0x30 [55714.623779] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55714.630887] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55714.639192] [] kthread+0xd1/0xe0 [55714.644658] [] ? insert_kthread_work+0x40/0x40 [55714.651498] [] ret_from_fork_nospec_begin+0x21/0x21 [55714.658832] [] ? insert_kthread_work+0x40/0x40 [55714.665697] mdt_out01_003 S ffff9951674041c0 0 5145 2 0x00000080 [55714.673706] Call Trace: [55714.676474] [] ? __set_current_blocked+0x42/0x70 [55714.683520] [] schedule+0x29/0x70 [55714.689157] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55714.696711] [] ? __wake_up+0x13/0x20 [55714.702591] [] ? wake_up_atomic_t+0x30/0x30 [55714.709227] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55714.716327] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55714.724651] [] kthread+0xd1/0xe0 [55714.730134] [] ? insert_kthread_work+0x40/0x40 [55714.736981] [] ret_from_fork_nospec_begin+0x21/0x21 [55714.744286] [] ? insert_kthread_work+0x40/0x40 [55714.751131] kworker/4:1H S ffff994d694c5230 0 5175 2 0x00000080 [55714.759090] Call Trace: [55714.761830] [] ? process_one_work+0x21a/0x440 [55714.768545] [] schedule+0x29/0x70 [55714.774107] [] worker_thread+0x1d9/0x3c0 [55714.780365] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55714.787706] [] kthread+0xd1/0xe0 [55714.793161] [] ? insert_kthread_work+0x40/0x40 [55714.799980] [] ret_from_fork_nospec_begin+0x21/0x21 [55714.807289] [] ? insert_kthread_work+0x40/0x40 [55714.814104] mdt_out01_004 S ffff994d694c62a0 0 5185 2 0x00000080 [55714.822046] Call Trace: [55714.824815] [] ? __set_current_blocked+0x42/0x70 [55714.831856] [] schedule+0x29/0x70 [55714.837507] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55714.845046] [] ? __wake_up+0x13/0x20 [55714.850932] [] ? wake_up_atomic_t+0x30/0x30 [55714.857551] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55714.864686] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55714.872995] [] kthread+0xd1/0xe0 [55714.878479] [] ? insert_kthread_work+0x40/0x40 [55714.885324] [] ret_from_fork_nospec_begin+0x21/0x21 [55714.892643] [] ? insert_kthread_work+0x40/0x40 [55714.899486] mdt_out01_005 S ffff994d694c41c0 0 5186 2 0x00000080 [55714.907479] Call Trace: [55714.910245] [] ? __set_current_blocked+0x42/0x70 [55714.917285] [] schedule+0x29/0x70 [55714.922921] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55714.930458] [] ? __wake_up+0x13/0x20 [55714.936344] [] ? wake_up_atomic_t+0x30/0x30 [55714.942955] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55714.950027] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55714.958328] [] kthread+0xd1/0xe0 [55714.963798] [] ? insert_kthread_work+0x40/0x40 [55714.970643] [] ret_from_fork_nospec_begin+0x21/0x21 [55714.977973] [] ? insert_kthread_work+0x40/0x40 [55714.984825] mdt_rdpg00_002 S ffff994d694c1070 0 5187 2 0x00000080 [55714.992783] Call Trace: [55714.995544] [] ? __set_current_blocked+0x42/0x70 [55715.002600] [] schedule+0x29/0x70 [55715.008267] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55715.015789] [] ? __wake_up+0x13/0x20 [55715.021691] [] ? wake_up_atomic_t+0x30/0x30 [55715.028298] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55715.035405] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55715.043702] [] kthread+0xd1/0xe0 [55715.049193] [] ? insert_kthread_work+0x40/0x40 [55715.056019] [] ret_from_fork_nospec_begin+0x21/0x21 [55715.063360] [] ? insert_kthread_work+0x40/0x40 [55715.070205] ldlm_cn01_005 S ffff994d694c0000 0 5188 2 0x00000080 [55715.078196] Call Trace: [55715.080956] [] ? __set_current_blocked+0x42/0x70 [55715.087989] [] schedule+0x29/0x70 [55715.093636] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55715.101187] [] ? __wake_up+0x13/0x20 [55715.107063] [] ? wake_up_atomic_t+0x30/0x30 [55715.113685] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55715.120793] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55715.129089] [] kthread+0xd1/0xe0 [55715.134594] [] ? insert_kthread_work+0x40/0x40 [55715.141441] [] ret_from_fork_nospec_begin+0x21/0x21 [55715.148758] [] ? insert_kthread_work+0x40/0x40 [55715.155606] ldlm_cn01_006 S ffff99516a910000 0 5189 2 0x00000080 [55715.163619] Call Trace: [55715.166395] [] ? __set_current_blocked+0x42/0x70 [55715.173434] [] schedule+0x29/0x70 [55715.179074] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55715.186617] [] ? __wake_up+0x13/0x20 [55715.192494] [] ? wake_up_atomic_t+0x30/0x30 [55715.199105] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55715.206198] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55715.214513] [] kthread+0xd1/0xe0 [55715.219991] [] ? insert_kthread_work+0x40/0x40 [55715.226823] [] ret_from_fork_nospec_begin+0x21/0x21 [55715.234148] [] ? insert_kthread_work+0x40/0x40 [55715.241000] kworker/21:1H S ffff994d6be762a0 0 5190 2 0x00000080 [55715.248957] Call Trace: [55715.251718] [] ? process_one_work+0x21a/0x440 [55715.258475] [] schedule+0x29/0x70 [55715.264049] [] worker_thread+0x1d9/0x3c0 [55715.270309] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55715.277649] [] kthread+0xd1/0xe0 [55715.283138] [] ? insert_kthread_work+0x40/0x40 [55715.289954] [] ret_from_fork_nospec_begin+0x21/0x21 [55715.297285] [] ? insert_kthread_work+0x40/0x40 [55715.304121] ldlm_cn01_007 S ffff994d6be75230 0 5191 2 0x00000080 [55715.312101] Call Trace: [55715.314868] [] ? __set_current_blocked+0x42/0x70 [55715.321899] [] schedule+0x29/0x70 [55715.327537] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55715.335082] [] ? _raw_spin_lock+0x20/0x30 [55715.341443] [] ? wake_up_atomic_t+0x30/0x30 [55715.348040] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55715.355157] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55715.363462] [] kthread+0xd1/0xe0 [55715.368959] [] ? insert_kthread_work+0x40/0x40 [55715.375796] [] ret_from_fork_nospec_begin+0x21/0x21 [55715.383129] [] ? insert_kthread_work+0x40/0x40 [55715.389968] ldlm_cn01_008 S ffff9951674520e0 0 5192 2 0x00000080 [55715.397923] Call Trace: [55715.400685] [] ? _raw_spin_lock_irqsave+0x37/0x40 [55715.407822] [] schedule+0x29/0x70 [55715.413463] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55715.421000] [] ? __wake_up+0x13/0x20 [55715.426885] [] ? wake_up_atomic_t+0x30/0x30 [55715.433495] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55715.440606] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55715.448912] [] kthread+0xd1/0xe0 [55715.454401] [] ? insert_kthread_work+0x40/0x40 [55715.461240] [] ret_from_fork_nospec_begin+0x21/0x21 [55715.468569] [] ? insert_kthread_work+0x40/0x40 [55715.475423] ldlm_cb00_002 S ffff995167451070 0 5193 2 0x00000080 [55715.483425] Call Trace: [55715.486185] [] ? __set_current_blocked+0x42/0x70 [55715.493225] [] schedule+0x29/0x70 [55715.498869] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55715.506407] [] ? __wake_up+0x13/0x20 [55715.512292] [] ? wake_up_atomic_t+0x30/0x30 [55715.518906] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55715.526017] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55715.534314] [] kthread+0xd1/0xe0 [55715.539784] [] ? insert_kthread_work+0x40/0x40 [55715.546649] [] ret_from_fork_nospec_begin+0x21/0x21 [55715.553979] [] ? insert_kthread_work+0x40/0x40 [55715.560825] mdt01_007 S ffff995166f75230 0 5194 2 0x00000080 [55715.568785] Call Trace: [55715.571568] [] schedule+0x29/0x70 [55715.577235] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55715.584757] [] ? __wake_up+0x13/0x20 [55715.590644] [] ? wake_up_atomic_t+0x30/0x30 [55715.597272] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55715.604365] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55715.612666] [] kthread+0xd1/0xe0 [55715.618155] [] ? insert_kthread_work+0x40/0x40 [55715.625002] [] ret_from_fork_nospec_begin+0x21/0x21 [55715.632333] [] ? insert_kthread_work+0x40/0x40 [55715.639169] mdt01_008 S ffff99516a9120e0 0 5195 2 0x00000080 [55715.647144] Call Trace: [55715.649905] [] ? __set_current_blocked+0x42/0x70 [55715.656948] [] schedule+0x29/0x70 [55715.662593] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55715.670125] [] ? __wake_up+0x13/0x20 [55715.675992] [] ? wake_up_atomic_t+0x30/0x30 [55715.682626] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55715.689741] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55715.698046] [] kthread+0xd1/0xe0 [55715.703556] [] ? insert_kthread_work+0x40/0x40 [55715.710420] [] ret_from_fork_nospec_begin+0x21/0x21 [55715.717751] [] ? insert_kthread_work+0x40/0x40 [55715.724584] mdt00_007 S ffff99516a915230 0 5196 2 0x00000080 [55715.732565] Call Trace: [55715.735341] [] ? __set_current_blocked+0x42/0x70 [55715.742368] [] schedule+0x29/0x70 [55715.748004] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55715.755522] [] ? __wake_up+0x13/0x20 [55715.761409] [] ? wake_up_atomic_t+0x30/0x30 [55715.768029] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55715.775137] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55715.783427] [] kthread+0xd1/0xe0 [55715.788919] [] ? insert_kthread_work+0x40/0x40 [55715.795744] [] ret_from_fork_nospec_begin+0x21/0x21 [55715.803076] [] ? insert_kthread_work+0x40/0x40 [55715.809928] ldlm_cb01_002 S ffff99515ab3c1c0 0 5197 2 0x00000080 [55715.817877] Call Trace: [55715.820641] [] ? _raw_spin_lock_irqsave+0x37/0x40 [55715.827773] [] schedule+0x29/0x70 [55715.833424] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55715.840949] [] ? wake_up_atomic_t+0x30/0x30 [55715.847572] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55715.854707] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55715.863005] [] kthread+0xd1/0xe0 [55715.868487] [] ? insert_kthread_work+0x40/0x40 [55715.875335] [] ret_from_fork_nospec_begin+0x21/0x21 [55715.882658] [] ? insert_kthread_work+0x40/0x40 [55715.889505] mdt01_009 S ffff994d6b10e2a0 0 5198 2 0x00000080 [55715.897476] Call Trace: [55715.900245] [] ? _raw_spin_lock_irqsave+0x37/0x40 [55715.907381] [] schedule+0x29/0x70 [55715.913011] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55715.920557] [] ? __wake_up+0x13/0x20 [55715.926440] [] ? wake_up_atomic_t+0x30/0x30 [55715.933068] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55715.940150] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55715.948470] [] kthread+0xd1/0xe0 [55715.953948] [] ? insert_kthread_work+0x40/0x40 [55715.960788] [] ret_from_fork_nospec_begin+0x21/0x21 [55715.968127] [] ? insert_kthread_work+0x40/0x40 [55715.974955] mdt00_008 S ffff994d6b10a0e0 0 5199 2 0x00000080 [55715.982923] Call Trace: [55715.985690] [] ? __set_current_blocked+0x42/0x70 [55715.992722] [] schedule+0x29/0x70 [55715.998363] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55716.005891] [] ? _raw_spin_lock+0x20/0x30 [55716.012248] [] ? wake_up_atomic_t+0x30/0x30 [55716.018851] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55716.025962] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55716.034265] [] kthread+0xd1/0xe0 [55716.039749] [] ? insert_kthread_work+0x40/0x40 [55716.046615] [] ret_from_fork_nospec_begin+0x21/0x21 [55716.053940] [] ? insert_kthread_work+0x40/0x40 [55716.060795] mdt00_009 S ffff994d6b109070 0 5200 2 0x00000080 [55716.068769] Call Trace: [55716.071561] [] ? __set_current_blocked+0x42/0x70 [55716.078620] [] schedule+0x29/0x70 [55716.084265] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55716.091779] [] ? __wake_up+0x13/0x20 [55716.097660] [] ? wake_up_atomic_t+0x30/0x30 [55716.104281] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55716.111389] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55716.119694] [] kthread+0xd1/0xe0 [55716.125183] [] ? insert_kthread_work+0x40/0x40 [55716.132006] [] ret_from_fork_nospec_begin+0x21/0x21 [55716.139345] [] ? insert_kthread_work+0x40/0x40 [55716.146190] mdt01_010 S ffff994d6a6f8000 0 5201 2 0x00000080 [55716.154182] Call Trace: [55716.156941] [] ? __set_current_blocked+0x42/0x70 [55716.163965] [] schedule+0x29/0x70 [55716.169623] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55716.177167] [] ? __wake_up+0x13/0x20 [55716.183040] [] ? wake_up_atomic_t+0x30/0x30 [55716.189680] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55716.196781] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55716.205086] [] kthread+0xd1/0xe0 [55716.210586] [] ? insert_kthread_work+0x40/0x40 [55716.217438] [] ret_from_fork_nospec_begin+0x21/0x21 [55716.224770] [] ? insert_kthread_work+0x40/0x40 [55716.231635] mdt_rdpg00_003 S ffff994d6a6fa0e0 0 5202 2 0x00000080 [55716.239609] Call Trace: [55716.242377] [] ? __set_current_blocked+0x42/0x70 [55716.249417] [] schedule+0x29/0x70 [55716.255063] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55716.262607] [] ? __wake_up+0x13/0x20 [55716.268481] [] ? wake_up_atomic_t+0x30/0x30 [55716.275102] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55716.282211] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55716.290516] [] kthread+0xd1/0xe0 [55716.296008] [] ? insert_kthread_work+0x40/0x40 [55716.302849] [] ret_from_fork_nospec_begin+0x21/0x21 [55716.310173] [] ? insert_kthread_work+0x40/0x40 [55716.317018] mdt_rdpg01_003 S ffff994d6a6fc1c0 0 5203 2 0x00000080 [55716.325004] Call Trace: [55716.327772] [] ? __set_current_blocked+0x42/0x70 [55716.334805] [] schedule+0x29/0x70 [55716.340456] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55716.347972] [] ? __wake_up+0x13/0x20 [55716.353843] [] ? wake_up_atomic_t+0x30/0x30 [55716.360457] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55716.367597] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55716.375902] [] kthread+0xd1/0xe0 [55716.381401] [] ? insert_kthread_work+0x40/0x40 [55716.388234] [] ret_from_fork_nospec_begin+0x21/0x21 [55716.395574] [] ? insert_kthread_work+0x40/0x40 [55716.402432] mdt_rdpg01_004 S ffff994d6c035230 0 5204 2 0x00000080 [55716.410419] Call Trace: [55716.413171] [] ? __set_current_blocked+0x42/0x70 [55716.420204] [] schedule+0x29/0x70 [55716.425845] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55716.433366] [] ? __wake_up+0x13/0x20 [55716.439253] [] ? wake_up_atomic_t+0x30/0x30 [55716.445876] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55716.452981] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55716.461286] [] kthread+0xd1/0xe0 [55716.466768] [] ? insert_kthread_work+0x40/0x40 [55716.473602] [] ret_from_fork_nospec_begin+0x21/0x21 [55716.480928] [] ? insert_kthread_work+0x40/0x40 [55716.487764] mdt_rdpg00_004 S ffff9951675a20e0 0 5205 2 0x00000080 [55716.495705] Call Trace: [55716.498468] [] ? __set_current_blocked+0x42/0x70 [55716.505529] [] schedule+0x29/0x70 [55716.511196] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55716.518725] [] ? __wake_up+0x13/0x20 [55716.524609] [] ? wake_up_atomic_t+0x30/0x30 [55716.531228] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55716.538337] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55716.546636] [] kthread+0xd1/0xe0 [55716.552134] [] ? insert_kthread_work+0x40/0x40 [55716.558946] [] ret_from_fork_nospec_begin+0x21/0x21 [55716.566270] [] ? insert_kthread_work+0x40/0x40 [55716.573114] ldlm_cn00_004 S ffff9951675a62a0 0 5206 2 0x00000080 [55716.581104] Call Trace: [55716.583870] [] ? _raw_spin_lock_irqsave+0x37/0x40 [55716.591008] [] schedule+0x29/0x70 [55716.596655] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55716.604176] [] ? __wake_up+0x13/0x20 [55716.610052] [] ? wake_up_atomic_t+0x30/0x30 [55716.616668] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55716.623767] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55716.632079] [] kthread+0xd1/0xe0 [55716.637595] [] ? insert_kthread_work+0x40/0x40 [55716.644428] [] ret_from_fork_nospec_begin+0x21/0x21 [55716.651727] [] ? insert_kthread_work+0x40/0x40 [55716.658577] ldlm_cn00_005 S ffff995166f720e0 0 5207 2 0x00000080 [55716.666554] Call Trace: [55716.669314] [] ? __set_current_blocked+0x42/0x70 [55716.676345] [] schedule+0x29/0x70 [55716.681970] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55716.689519] [] ? wake_up_atomic_t+0x30/0x30 [55716.696146] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55716.703254] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55716.711574] [] kthread+0xd1/0xe0 [55716.717059] [] ? insert_kthread_work+0x40/0x40 [55716.723891] [] ret_from_fork_nospec_begin+0x21/0x21 [55716.731230] [] ? insert_kthread_work+0x40/0x40 [55716.738076] ldlm_bl_03 S ffff995166f71070 0 5208 2 0x00000080 [55716.746082] Call Trace: [55716.748876] [] ? obd_stale_export_get+0x31/0x190 [obdclass] [55716.756969] [] schedule+0x29/0x70 [55716.762642] [] ldlm_bl_thread_main+0x709/0xa00 [ptlrpc] [55716.770350] [] ? wake_up_atomic_t+0x30/0x30 [55716.776935] [] ? ldlm_handle_bl_callback+0x3e0/0x3e0 [ptlrpc] [55716.785230] [] kthread+0xd1/0xe0 [55716.790685] [] ? insert_kthread_work+0x40/0x40 [55716.797497] [] ret_from_fork_nospec_begin+0x21/0x21 [55716.804801] [] ? insert_kthread_work+0x40/0x40 [55716.811626] ldlm_bl_04 S ffff995166f73150 0 5209 2 0x00000080 [55716.819566] Call Trace: [55716.822347] [] ? obd_stale_export_get+0x31/0x190 [obdclass] [55716.830460] [] schedule+0x29/0x70 [55716.836079] [] ldlm_bl_thread_main+0x709/0xa00 [ptlrpc] [55716.843782] [] ? wake_up_atomic_t+0x30/0x30 [55716.850393] [] ? ldlm_handle_bl_callback+0x3e0/0x3e0 [ptlrpc] [55716.858700] [] kthread+0xd1/0xe0 [55716.864182] [] ? insert_kthread_work+0x40/0x40 [55716.871032] [] ret_from_fork_nospec_begin+0x21/0x21 [55716.878358] [] ? insert_kthread_work+0x40/0x40 [55716.885206] ldlm_bl_05 S ffff994d681441c0 0 5210 2 0x00000080 [55716.893175] Call Trace: [55716.895980] [] ? obd_stale_export_get+0x31/0x190 [obdclass] [55716.904082] [] schedule+0x29/0x70 [55716.909731] [] ldlm_bl_thread_main+0x709/0xa00 [ptlrpc] [55716.917449] [] ? wake_up_atomic_t+0x30/0x30 [55716.924035] [] ? ldlm_handle_bl_callback+0x3e0/0x3e0 [ptlrpc] [55716.932346] [] kthread+0xd1/0xe0 [55716.937822] [] ? insert_kthread_work+0x40/0x40 [55716.944662] [] ret_from_fork_nospec_begin+0x21/0x21 [55716.951987] [] ? insert_kthread_work+0x40/0x40 [55716.958831] kworker/20:1H S ffff994d68143150 0 5211 2 0x00000080 [55716.966808] Call Trace: [55716.969583] [] ? process_one_work+0x21a/0x440 [55716.976327] [] schedule+0x29/0x70 [55716.981901] [] worker_thread+0x1d9/0x3c0 [55716.988153] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55716.995502] [] kthread+0xd1/0xe0 [55717.000945] [] ? insert_kthread_work+0x40/0x40 [55717.007792] [] ret_from_fork_nospec_begin+0x21/0x21 [55717.015124] [] ? insert_kthread_work+0x40/0x40 [55717.021970] mdt_out00_002 S ffff994d68145230 0 5212 2 0x00000080 [55717.029982] Call Trace: [55717.032761] [] ? __set_current_blocked+0x42/0x70 [55717.039788] [] schedule+0x29/0x70 [55717.045431] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55717.052928] [] ? __wake_up+0x13/0x20 [55717.058798] [] ? wake_up_atomic_t+0x30/0x30 [55717.065420] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55717.072548] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55717.080844] [] kthread+0xd1/0xe0 [55717.086341] [] ? insert_kthread_work+0x40/0x40 [55717.093195] [] ret_from_fork_nospec_begin+0x21/0x21 [55717.100512] [] ? insert_kthread_work+0x40/0x40 [55717.107380] mdt_out00_003 S ffff994d68140000 0 5213 2 0x00000080 [55717.115371] Call Trace: [55717.118140] [] ? __set_current_blocked+0x42/0x70 [55717.125180] [] schedule+0x29/0x70 [55717.130812] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55717.138335] [] ? __wake_up+0x13/0x20 [55717.144213] [] ? wake_up_atomic_t+0x30/0x30 [55717.150805] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55717.157915] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55717.166221] [] kthread+0xd1/0xe0 [55717.171699] [] ? insert_kthread_work+0x40/0x40 [55717.178549] [] ret_from_fork_nospec_begin+0x21/0x21 [55717.185880] [] ? insert_kthread_work+0x40/0x40 [55717.192716] ldlm_cb01_003 S ffff994d681420e0 0 5214 2 0x00000080 [55717.200671] Call Trace: [55717.203432] [] ? _raw_spin_lock_irqsave+0x37/0x40 [55717.210578] [] schedule+0x29/0x70 [55717.216206] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55717.223758] [] ? __wake_up+0x13/0x20 [55717.229637] [] ? wake_up_atomic_t+0x30/0x30 [55717.236247] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55717.243355] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55717.251634] [] kthread+0xd1/0xe0 [55717.257125] [] ? insert_kthread_work+0x40/0x40 [55717.263955] [] ret_from_fork_nospec_begin+0x21/0x21 [55717.271288] [] ? insert_kthread_work+0x40/0x40 [55717.278141] kworker/26:1H S ffff99516685c1c0 0 5215 2 0x00000080 [55717.286124] Call Trace: [55717.288899] [] ? process_one_work+0x21a/0x440 [55717.295650] [] schedule+0x29/0x70 [55717.301230] [] worker_thread+0x1d9/0x3c0 [55717.307482] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55717.314804] [] kthread+0xd1/0xe0 [55717.320292] [] ? insert_kthread_work+0x40/0x40 [55717.327127] [] ret_from_fork_nospec_begin+0x21/0x21 [55717.334457] [] ? insert_kthread_work+0x40/0x40 [55717.341319] mdt_out00_004 S ffff99516685b150 0 5216 2 0x00000080 [55717.349326] Call Trace: [55717.352100] [] ? __set_current_blocked+0x42/0x70 [55717.359139] [] schedule+0x29/0x70 [55717.364778] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55717.372304] [] ? __wake_up+0x13/0x20 [55717.378175] [] ? wake_up_atomic_t+0x30/0x30 [55717.384777] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55717.391892] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55717.400195] [] kthread+0xd1/0xe0 [55717.405693] [] ? insert_kthread_work+0x40/0x40 [55717.412533] [] ret_from_fork_nospec_begin+0x21/0x21 [55717.419851] [] ? insert_kthread_work+0x40/0x40 [55717.426698] ldlm_cn00_006 S ffff994d688f62a0 0 5217 2 0x00000080 [55717.434649] Call Trace: [55717.437411] [] ? __set_current_blocked+0x42/0x70 [55717.444465] [] schedule+0x29/0x70 [55717.450125] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55717.457648] [] ? __wake_up+0x13/0x20 [55717.463545] [] ? wake_up_atomic_t+0x30/0x30 [55717.470165] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55717.477273] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55717.485580] [] kthread+0xd1/0xe0 [55717.491069] [] ? insert_kthread_work+0x40/0x40 [55717.497903] [] ret_from_fork_nospec_begin+0x21/0x21 [55717.505236] [] ? insert_kthread_work+0x40/0x40 [55717.512079] mdt00_010 S ffff994d688f41c0 0 5220 2 0x00000080 [55717.520060] Call Trace: [55717.522813] [] ? __set_current_blocked+0x42/0x70 [55717.529852] [] schedule+0x29/0x70 [55717.535522] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55717.543052] [] ? __wake_up+0x13/0x20 [55717.548923] [] ? wake_up_atomic_t+0x30/0x30 [55717.555557] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55717.562666] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55717.570964] [] kthread+0xd1/0xe0 [55717.576478] [] ? insert_kthread_work+0x40/0x40 [55717.583331] [] ret_from_fork_nospec_begin+0x21/0x21 [55717.590657] [] ? insert_kthread_work+0x40/0x40 [55717.597529] ldlm_cn00_007 S ffff994d688f3150 0 5221 2 0x00000080 [55717.605498] Call Trace: [55717.608264] [] ? _raw_spin_lock_irqsave+0x37/0x40 [55717.615404] [] schedule+0x29/0x70 [55717.621055] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55717.628572] [] ? _raw_spin_lock+0x20/0x30 [55717.634926] [] ? wake_up_atomic_t+0x30/0x30 [55717.641558] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55717.648658] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55717.656965] [] kthread+0xd1/0xe0 [55717.662441] [] ? insert_kthread_work+0x40/0x40 [55717.669295] [] ret_from_fork_nospec_begin+0x21/0x21 [55717.676619] [] ? insert_kthread_work+0x40/0x40 [55717.683486] ldlm_cn01_009 S ffff994d688f1070 0 5222 2 0x00000080 [55717.691468] Call Trace: [55717.694246] [] ? __set_current_blocked+0x42/0x70 [55717.701293] [] schedule+0x29/0x70 [55717.706945] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55717.714496] [] ? _raw_spin_lock+0x20/0x30 [55717.720854] [] ? wake_up_atomic_t+0x30/0x30 [55717.727479] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55717.734606] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55717.742902] [] kthread+0xd1/0xe0 [55717.748378] [] ? insert_kthread_work+0x40/0x40 [55717.755231] [] ret_from_fork_nospec_begin+0x21/0x21 [55717.762559] [] ? insert_kthread_work+0x40/0x40 [55717.769411] ldlm_cn00_008 S ffff994d688f0000 0 5223 2 0x00000080 [55717.777372] Call Trace: [55717.780133] [] schedule+0x29/0x70 [55717.785777] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55717.793314] [] ? _raw_spin_lock+0x20/0x30 [55717.799686] [] ? wake_up_atomic_t+0x30/0x30 [55717.806293] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55717.813409] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55717.821716] [] kthread+0xd1/0xe0 [55717.827205] [] ? insert_kthread_work+0x40/0x40 [55717.834059] [] ret_from_fork_nospec_begin+0x21/0x21 [55717.841384] [] ? insert_kthread_work+0x40/0x40 [55717.848238] ldlm_cn01_010 S ffff994d688f5230 0 5397 2 0x00000080 [55717.856254] Call Trace: [55717.859021] [] ? __set_current_blocked+0x42/0x70 [55717.866061] [] schedule+0x29/0x70 [55717.871694] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55717.879223] [] ? __wake_up+0x13/0x20 [55717.885100] [] ? wake_up_atomic_t+0x30/0x30 [55717.891707] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55717.898803] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55717.907115] [] kthread+0xd1/0xe0 [55717.912596] [] ? insert_kthread_work+0x40/0x40 [55717.919476] [] ret_from_fork_nospec_begin+0x21/0x21 [55717.926817] [] ? insert_kthread_work+0x40/0x40 [55717.933656] ldlm_cn00_009 S ffff994d688f20e0 0 5398 2 0x00000080 [55717.941626] Call Trace: [55717.944416] [] ? __set_current_blocked+0x42/0x70 [55717.951490] [] schedule+0x29/0x70 [55717.957138] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55717.964645] [] ? __wake_up+0x13/0x20 [55717.970522] [] ? wake_up_atomic_t+0x30/0x30 [55717.977142] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55717.984241] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55717.992545] [] kthread+0xd1/0xe0 [55717.998042] [] ? insert_kthread_work+0x40/0x40 [55718.004882] [] ret_from_fork_nospec_begin+0x21/0x21 [55718.012206] [] ? insert_kthread_work+0x40/0x40 [55718.019060] ldlm_cb00_003 S ffff994975ead230 0 5401 2 0x00000080 [55718.027059] Call Trace: [55718.029827] [] ? __set_current_blocked+0x42/0x70 [55718.036867] [] schedule+0x29/0x70 [55718.042537] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55718.050066] [] ? __wake_up+0x13/0x20 [55718.055946] [] ? wake_up_atomic_t+0x30/0x30 [55718.062568] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55718.069668] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55718.077981] [] kthread+0xd1/0xe0 [55718.083489] [] ? insert_kthread_work+0x40/0x40 [55718.090334] [] ret_from_fork_nospec_begin+0x21/0x21 [55718.097666] [] ? insert_kthread_work+0x40/0x40 [55718.104506] ldlm_cn01_011 S ffff994975eaa0e0 0 5402 2 0x00000080 [55718.112503] Call Trace: [55718.115270] [] ? _raw_spin_lock_irqsave+0x37/0x40 [55718.122399] [] schedule+0x29/0x70 [55718.128056] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55718.135576] [] ? __wake_up+0x13/0x20 [55718.141462] [] ? wake_up_atomic_t+0x30/0x30 [55718.148081] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55718.155175] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55718.163487] [] kthread+0xd1/0xe0 [55718.168984] [] ? insert_kthread_work+0x40/0x40 [55718.175830] [] ret_from_fork_nospec_begin+0x21/0x21 [55718.183159] [] ? insert_kthread_work+0x40/0x40 [55718.190006] mdt_out01_006 S ffff994d6b108000 0 5403 2 0x00000080 [55718.198005] Call Trace: [55718.200770] [] ? _raw_spin_lock_irqsave+0x37/0x40 [55718.207906] [] schedule+0x29/0x70 [55718.213564] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55718.221093] [] ? _raw_spin_lock+0x20/0x30 [55718.227464] [] ? wake_up_atomic_t+0x30/0x30 [55718.234069] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55718.241190] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55718.249497] [] kthread+0xd1/0xe0 [55718.254987] [] ? insert_kthread_work+0x40/0x40 [55718.261827] [] ret_from_fork_nospec_begin+0x21/0x21 [55718.269166] [] ? insert_kthread_work+0x40/0x40 [55718.276002] ldlm_cn01_012 S ffff995168c59070 0 5406 2 0x00000080 [55718.283986] Call Trace: [55718.286755] [] ? __set_current_blocked+0x42/0x70 [55718.293787] [] schedule+0x29/0x70 [55718.299450] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55718.306981] [] ? __wake_up+0x13/0x20 [55718.312860] [] ? wake_up_atomic_t+0x30/0x30 [55718.319511] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55718.326620] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55718.334907] [] kthread+0xd1/0xe0 [55718.340409] [] ? insert_kthread_work+0x40/0x40 [55718.347263] [] ret_from_fork_nospec_begin+0x21/0x21 [55718.354596] [] ? insert_kthread_work+0x40/0x40 [55718.361459] mdt_out01_007 S ffff994975ea9070 0 5407 2 0x00000080 [55718.369453] Call Trace: [55718.372211] [] ? _raw_spin_lock_irqsave+0x37/0x40 [55718.379350] [] schedule+0x29/0x70 [55718.385008] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55718.392517] [] ? _raw_spin_lock+0x20/0x30 [55718.398881] [] ? wake_up_atomic_t+0x30/0x30 [55718.405515] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55718.412610] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55718.420924] [] kthread+0xd1/0xe0 [55718.426449] [] ? insert_kthread_work+0x40/0x40 [55718.433281] [] ret_from_fork_nospec_begin+0x21/0x21 [55718.440607] [] ? insert_kthread_work+0x40/0x40 [55718.447460] mdt_out00_005 S ffff994975eab150 0 5408 2 0x00000080 [55718.455456] Call Trace: [55718.458215] [] ? __set_current_blocked+0x42/0x70 [55718.465255] [] schedule+0x29/0x70 [55718.470892] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55718.478442] [] ? _raw_spin_lock+0x20/0x30 [55718.484803] [] ? wake_up_atomic_t+0x30/0x30 [55718.491439] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55718.498560] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55718.506856] [] kthread+0xd1/0xe0 [55718.512340] [] ? insert_kthread_work+0x40/0x40 [55718.519194] [] ret_from_fork_nospec_begin+0x21/0x21 [55718.526518] [] ? insert_kthread_work+0x40/0x40 [55718.533372] ldlm_cn00_010 S ffff994975ea8000 0 5409 2 0x00000080 [55718.541397] Call Trace: [55718.544163] [] schedule+0x29/0x70 [55718.549807] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55718.557347] [] ? _raw_spin_lock+0x20/0x30 [55718.563705] [] ? wake_up_atomic_t+0x30/0x30 [55718.570313] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55718.577449] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55718.585755] [] kthread+0xd1/0xe0 [55718.591252] [] ? insert_kthread_work+0x40/0x40 [55718.598096] [] ret_from_fork_nospec_begin+0x21/0x21 [55718.605434] [] ? insert_kthread_work+0x40/0x40 [55718.612274] ldlm_cn00_011 S ffff994975eac1c0 0 5562 2 0x00000080 [55718.620261] Call Trace: [55718.623029] [] ? _raw_spin_lock_irqsave+0x37/0x40 [55718.630151] [] schedule+0x29/0x70 [55718.635768] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55718.643291] [] ? wake_up_atomic_t+0x30/0x30 [55718.649892] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55718.657007] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55718.665313] [] kthread+0xd1/0xe0 [55718.670790] [] ? insert_kthread_work+0x40/0x40 [55718.677630] [] ret_from_fork_nospec_begin+0x21/0x21 [55718.684961] [] ? insert_kthread_work+0x40/0x40 [55718.691801] mdt01_011 S ffff994d6c031070 0 5565 2 0x00000080 [55718.699768] Call Trace: [55718.702535] [] schedule+0x29/0x70 [55718.708184] [] ldlm_completion_ast+0x62d/0x9b0 [ptlrpc] [55718.715893] [] ? wake_up_atomic_t+0x30/0x30 [55718.722510] [] ldlm_cli_enqueue_local+0x25c/0x850 [ptlrpc] [55718.730585] [] ? ldlm_expired_completion_wait+0x2a0/0x2a0 [ptlrpc] [55718.739422] [] ? mdt_object_alloc+0x2c0/0x2c0 [mdt] [55718.746752] [] mdt_object_local_lock+0x523/0xb60 [mdt] [55718.754398] [] ? mdt_object_alloc+0x2c0/0x2c0 [mdt] [55718.761792] [] ? ldlm_expired_completion_wait+0x2a0/0x2a0 [ptlrpc] [55718.770588] [] mdt_object_lock_internal+0x70/0x3f0 [mdt] [55718.778421] [] mdt_getattr_name_lock+0x985/0x1d60 [mdt] [55718.786202] [] ? __req_capsule_get+0x427/0x6b0 [ptlrpc] [55718.793943] [] ? old_init_ucred_common+0xdc/0x2e0 [mdt] [55718.801717] [] ? lustre_msg_get_flags+0x2c/0xa0 [ptlrpc] [55718.809546] [] mdt_intent_getattr+0x2b5/0x480 [mdt] [55718.816880] [] mdt_intent_opc+0x1ba/0xb40 [mdt] [55718.823890] [] ? lustre_msg_get_transno+0x20/0xf0 [ptlrpc] [55718.831910] [] ? mdt_intent_layout+0xe00/0xe00 [mdt] [55718.839366] [] mdt_intent_policy+0x1a4/0x360 [mdt] [55718.846659] [] ldlm_lock_enqueue+0x3cb/0xad0 [ptlrpc] [55718.854197] [] ? cfs_hash_bd_add_locked+0x63/0x80 [libcfs] [55718.862189] [] ? cfs_hash_add+0xbe/0x1a0 [libcfs] [55718.869402] [] ldlm_handle_enqueue0+0xa56/0x1610 [ptlrpc] [55718.877396] [] ? lustre_msg_buf_v2+0x140/0x1e0 [ptlrpc] [55718.885206] [] tgt_enqueue+0x62/0x210 [ptlrpc] [55718.892124] [] tgt_request_handle+0x95a/0x1630 [ptlrpc] [55718.899839] [] ? ktime_get_real_seconds+0xe/0x10 [libcfs] [55718.907807] [] ptlrpc_server_handle_request+0x256/0xb10 [ptlrpc] [55718.916483] [] ? ptlrpc_wait_event+0x12e/0x5b0 [ptlrpc] [55718.924200] [] ? __wake_up+0x13/0x20 [55718.930152] [] ? ptlrpc_server_handle_req_in+0x92a/0x1100 [ptlrpc] [55718.938949] [] ? wake_up_atomic_t+0x30/0x30 [55718.945570] [] ptlrpc_main+0xbb4/0x1550 [ptlrpc] [55718.952665] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55718.960961] [] kthread+0xd1/0xe0 [55718.966455] [] ? insert_kthread_work+0x40/0x40 [55718.973297] [] ret_from_fork_nospec_begin+0x21/0x21 [55718.980623] [] ? insert_kthread_work+0x40/0x40 [55718.987473] mdt00_011 S ffff994d6c0320e0 0 5566 2 0x00000080 [55718.995446] Call Trace: [55718.998208] [] ? __set_current_blocked+0x42/0x70 [55719.005255] [] schedule+0x29/0x70 [55719.010903] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55719.018436] [] ? __wake_up+0x13/0x20 [55719.024317] [] ? wake_up_atomic_t+0x30/0x30 [55719.030945] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55719.038033] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55719.046343] [] kthread+0xd1/0xe0 [55719.051829] [] ? insert_kthread_work+0x40/0x40 [55719.058673] [] ret_from_fork_nospec_begin+0x21/0x21 [55719.066013] [] ? insert_kthread_work+0x40/0x40 [55719.072856] mdt_rdpg00_005 S ffff995167455230 0 5681 2 0x00000080 [55719.080845] Call Trace: [55719.083603] [] ? __set_current_blocked+0x42/0x70 [55719.090638] [] schedule+0x29/0x70 [55719.096277] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55719.103811] [] ? __wake_up+0x13/0x20 [55719.109689] [] ? wake_up_atomic_t+0x30/0x30 [55719.116284] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55719.123403] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55719.131707] [] kthread+0xd1/0xe0 [55719.137198] [] ? insert_kthread_work+0x40/0x40 [55719.144052] [] ret_from_fork_nospec_begin+0x21/0x21 [55719.151391] [] ? insert_kthread_work+0x40/0x40 [55719.158237] mdt01_012 S ffff99515ab39070 0 5722 2 0x00000080 [55719.166249] Call Trace: [55719.169010] [] ? __set_current_blocked+0x42/0x70 [55719.176047] [] schedule+0x29/0x70 [55719.181690] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55719.189221] [] ? __wake_up+0x13/0x20 [55719.195106] [] ? wake_up_atomic_t+0x30/0x30 [55719.201725] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55719.208825] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55719.217128] [] kthread+0xd1/0xe0 [55719.222618] [] ? insert_kthread_work+0x40/0x40 [55719.229457] [] ret_from_fork_nospec_begin+0x21/0x21 [55719.236782] [] ? insert_kthread_work+0x40/0x40 [55719.243614] mdt00_012 S ffff99515ab38000 0 5723 2 0x00000080 [55719.251559] Call Trace: [55719.254333] [] schedule+0x29/0x70 [55719.259968] [] ldlm_completion_ast+0x62d/0x9b0 [ptlrpc] [55719.267678] [] ? wake_up_atomic_t+0x30/0x30 [55719.274281] [] ldlm_cli_enqueue_fini+0x9d0/0xe40 [ptlrpc] [55719.282252] [] ? lprocfs_counter_sub+0xc1/0x130 [obdclass] [55719.290311] [] ldlm_cli_enqueue+0x441/0xa20 [ptlrpc] [55719.297785] [] ? ldlm_expired_completion_wait+0x2a0/0x2a0 [ptlrpc] [55719.306583] [] ? mdt_obd_reconnect+0x1e0/0x1e0 [mdt] [55719.314008] [] osp_md_object_lock+0x162/0x2d0 [osp] [55719.321389] [] ? osp_update_request_destroy+0x42e/0x4b0 [osp] [55719.329710] [] lod_object_lock+0xf1/0x780 [lod] [55719.336672] [] ? osp_md_index_lookup+0x25a/0x870 [osp] [55719.344295] [] ? osp_attr_get+0x3e3/0x730 [osp] [55719.351294] [] ? lu_ucred+0x1e/0x30 [obdclass] [55719.358162] [] mdd_object_lock+0x3b/0xd0 [mdd] [55719.365011] [] mdt_remote_object_lock_try+0x1e4/0x530 [mdt] [55719.373105] [] ? __mdd_lookup.isra.17+0x2ab/0x450 [mdd] [55719.380832] [] mdt_object_lock_internal+0x18c/0x3f0 [mdt] [55719.388737] [] mdt_object_lock+0x20/0x30 [mdt] [55719.395595] [] mdt_create+0x78d/0xf90 [mdt] [55719.402184] [] ? lprocfs_stats_lock+0x24/0xd0 [obdclass] [55719.410024] [] mdt_reint_create+0x16b/0x360 [mdt] [55719.417164] [] mdt_reint_rec+0x83/0x210 [mdt] [55719.423921] [] mdt_reint_internal+0x7b0/0xba0 [mdt] [55719.431256] [] mdt_reint+0x67/0x140 [mdt] [55719.437668] [] tgt_request_handle+0x95a/0x1630 [ptlrpc] [55719.445406] [] ? ktime_get_real_seconds+0xe/0x10 [libcfs] [55719.453413] [] ptlrpc_server_handle_request+0x256/0xb10 [ptlrpc] [55719.462089] [] ? ptlrpc_wait_event+0x12e/0x5b0 [ptlrpc] [55719.469802] [] ? _raw_spin_lock+0x20/0x30 [55719.476165] [] ? wake_up_atomic_t+0x30/0x30 [55719.482781] [] ptlrpc_main+0xbb4/0x1550 [ptlrpc] [55719.489883] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55719.498182] [] kthread+0xd1/0xe0 [55719.503671] [] ? insert_kthread_work+0x40/0x40 [55719.510510] [] ret_from_fork_nospec_begin+0x21/0x21 [55719.517850] [] ? insert_kthread_work+0x40/0x40 [55719.524681] mdt01_013 S ffff99515ab3e2a0 0 5724 2 0x00000080 [55719.532635] Call Trace: [55719.535416] [] ? __set_current_blocked+0x42/0x70 [55719.542449] [] schedule+0x29/0x70 [55719.548095] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55719.555601] [] ? _raw_spin_lock+0x20/0x30 [55719.561965] [] ? wake_up_atomic_t+0x30/0x30 [55719.568561] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55719.575684] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55719.583990] [] kthread+0xd1/0xe0 [55719.589481] [] ? insert_kthread_work+0x40/0x40 [55719.596336] [] ret_from_fork_nospec_begin+0x21/0x21 [55719.603646] [] ? insert_kthread_work+0x40/0x40 [55719.610492] mdt_out01_008 S ffff995167405230 0 5725 2 0x00000080 [55719.618417] Call Trace: [55719.621191] [] ? __set_current_blocked+0x42/0x70 [55719.628219] [] schedule+0x29/0x70 [55719.633859] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55719.641394] [] ? __wake_up+0x13/0x20 [55719.647261] [] ? wake_up_atomic_t+0x30/0x30 [55719.653888] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55719.660987] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55719.669303] [] kthread+0xd1/0xe0 [55719.674793] [] ? insert_kthread_work+0x40/0x40 [55719.681635] [] ret_from_fork_nospec_begin+0x21/0x21 [55719.688967] [] ? insert_kthread_work+0x40/0x40 [55719.695806] mdt_out01_009 S ffff9951696ce2a0 0 5726 2 0x00000080 [55719.703767] Call Trace: [55719.706527] [] ? _raw_spin_lock_irqsave+0x37/0x40 [55719.713661] [] schedule+0x29/0x70 [55719.719323] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55719.726852] [] ? _raw_spin_lock+0x20/0x30 [55719.733206] [] ? wake_up_atomic_t+0x30/0x30 [55719.739820] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55719.746916] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55719.755214] [] kthread+0xd1/0xe0 [55719.760705] [] ? insert_kthread_work+0x40/0x40 [55719.767544] [] ret_from_fork_nospec_begin+0x21/0x21 [55719.774876] [] ? insert_kthread_work+0x40/0x40 [55719.781730] mdt_out01_010 S ffff994d6c0362a0 0 5727 2 0x00000080 [55719.789704] Call Trace: [55719.792445] [] ? __set_current_blocked+0x42/0x70 [55719.799472] [] schedule+0x29/0x70 [55719.805102] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55719.812615] [] ? __wake_up+0x13/0x20 [55719.818487] [] ? wake_up_atomic_t+0x30/0x30 [55719.825085] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55719.832179] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55719.840492] [] kthread+0xd1/0xe0 [55719.845986] [] ? insert_kthread_work+0x40/0x40 [55719.852825] [] ret_from_fork_nospec_begin+0x21/0x21 [55719.860151] [] ? insert_kthread_work+0x40/0x40 [55719.866997] mdt_out01_011 S ffff995167633150 0 5728 2 0x00000080 [55719.874958] Call Trace: [55719.877726] [] ? __set_current_blocked+0x42/0x70 [55719.884759] [] schedule+0x29/0x70 [55719.890422] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55719.897943] [] ? __wake_up+0x13/0x20 [55719.903831] [] ? wake_up_atomic_t+0x30/0x30 [55719.910469] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55719.917563] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55719.925859] [] kthread+0xd1/0xe0 [55719.931364] [] ? insert_kthread_work+0x40/0x40 [55719.938211] [] ret_from_fork_nospec_begin+0x21/0x21 [55719.945539] [] ? insert_kthread_work+0x40/0x40 [55719.952397] mdt_out01_012 S ffff99516c16e2a0 0 5729 2 0x00000080 [55719.960350] Call Trace: [55719.963118] [] ? __set_current_blocked+0x42/0x70 [55719.970166] [] schedule+0x29/0x70 [55719.975805] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55719.983344] [] ? __wake_up+0x13/0x20 [55719.989227] [] ? wake_up_atomic_t+0x30/0x30 [55719.995843] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55720.002929] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55720.011229] [] kthread+0xd1/0xe0 [55720.016722] [] ? insert_kthread_work+0x40/0x40 [55720.023563] [] ret_from_fork_nospec_begin+0x21/0x21 [55720.030903] [] ? insert_kthread_work+0x40/0x40 [55720.037747] mdt_out01_013 S ffff99516c16d230 0 5730 2 0x00000080 [55720.045732] Call Trace: [55720.048500] [] ? __set_current_blocked+0x42/0x70 [55720.055534] [] schedule+0x29/0x70 [55720.061177] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55720.068701] [] ? __wake_up+0x13/0x20 [55720.074568] [] ? wake_up_atomic_t+0x30/0x30 [55720.081179] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55720.088296] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55720.096599] [] kthread+0xd1/0xe0 [55720.102099] [] ? insert_kthread_work+0x40/0x40 [55720.108948] [] ret_from_fork_nospec_begin+0x21/0x21 [55720.116267] [] ? insert_kthread_work+0x40/0x40 [55720.123112] mdt_out01_014 S ffff99516c16c1c0 0 5731 2 0x00000080 [55720.131100] Call Trace: [55720.133862] [] ? __set_current_blocked+0x42/0x70 [55720.140897] [] schedule+0x29/0x70 [55720.146541] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55720.154069] [] ? __wake_up+0x13/0x20 [55720.159947] [] ? wake_up_atomic_t+0x30/0x30 [55720.166575] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55720.173674] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55720.181979] [] kthread+0xd1/0xe0 [55720.187455] [] ? insert_kthread_work+0x40/0x40 [55720.194282] [] ret_from_fork_nospec_begin+0x21/0x21 [55720.201595] [] ? insert_kthread_work+0x40/0x40 [55720.208442] mdt_out01_015 S ffff99516c16b150 0 5732 2 0x00000080 [55720.216377] Call Trace: [55720.219152] [] ? __set_current_blocked+0x42/0x70 [55720.226201] [] schedule+0x29/0x70 [55720.231849] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55720.239376] [] ? _raw_spin_lock+0x20/0x30 [55720.245741] [] ? wake_up_atomic_t+0x30/0x30 [55720.252362] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55720.259478] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55720.267769] [] kthread+0xd1/0xe0 [55720.273283] [] ? insert_kthread_work+0x40/0x40 [55720.280124] [] ret_from_fork_nospec_begin+0x21/0x21 [55720.287464] [] ? insert_kthread_work+0x40/0x40 [55720.294331] mdt_out01_016 S ffff99516c168000 0 5733 2 0x00000080 [55720.302330] Call Trace: [55720.305099] [] ? _raw_spin_lock_irqsave+0x37/0x40 [55720.312232] [] schedule+0x29/0x70 [55720.317872] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55720.325404] [] ? _raw_spin_lock+0x20/0x30 [55720.331755] [] ? wake_up_atomic_t+0x30/0x30 [55720.338393] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55720.345502] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55720.353806] [] kthread+0xd1/0xe0 [55720.359314] [] ? insert_kthread_work+0x40/0x40 [55720.366165] [] ret_from_fork_nospec_begin+0x21/0x21 [55720.373498] [] ? insert_kthread_work+0x40/0x40 [55720.380343] mdt_out01_017 S ffff99516c16a0e0 0 5734 2 0x00000080 [55720.388311] Call Trace: [55720.391080] [] ? __set_current_blocked+0x42/0x70 [55720.398111] [] schedule+0x29/0x70 [55720.403726] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55720.411265] [] ? __wake_up+0x13/0x20 [55720.417152] [] ? wake_up_atomic_t+0x30/0x30 [55720.423770] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55720.430867] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55720.439157] [] kthread+0xd1/0xe0 [55720.444641] [] ? insert_kthread_work+0x40/0x40 [55720.451473] [] ret_from_fork_nospec_begin+0x21/0x21 [55720.458797] [] ? insert_kthread_work+0x40/0x40 [55720.465642] mdt_out01_018 S ffff99516c169070 0 5735 2 0x00000080 [55720.473590] Call Trace: [55720.476350] [] ? _raw_spin_lock_irqsave+0x37/0x40 [55720.483480] [] schedule+0x29/0x70 [55720.489099] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55720.496636] [] ? __wake_up+0x13/0x20 [55720.502519] [] ? wake_up_atomic_t+0x30/0x30 [55720.509132] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55720.516234] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55720.524535] [] kthread+0xd1/0xe0 [55720.530006] [] ? insert_kthread_work+0x40/0x40 [55720.536840] [] ret_from_fork_nospec_begin+0x21/0x21 [55720.544178] [] ? insert_kthread_work+0x40/0x40 [55720.551034] mdt_out01_019 S ffff995168c5d230 0 5889 2 0x00000080 [55720.558992] Call Trace: [55720.561761] [] ? __set_current_blocked+0x42/0x70 [55720.568800] [] schedule+0x29/0x70 [55720.574425] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55720.581955] [] ? _raw_spin_lock+0x20/0x30 [55720.588302] [] ? wake_up_atomic_t+0x30/0x30 [55720.594921] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55720.602031] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55720.610355] [] kthread+0xd1/0xe0 [55720.615853] [] ? insert_kthread_work+0x40/0x40 [55720.622678] [] ret_from_fork_nospec_begin+0x21/0x21 [55720.630001] [] ? insert_kthread_work+0x40/0x40 [55720.636850] mdt_out01_020 S ffff99514fbbc1c0 0 5890 2 0x00000080 [55720.644802] Call Trace: [55720.647542] [] ? _raw_spin_lock_irqsave+0x37/0x40 [55720.654670] [] schedule+0x29/0x70 [55720.660306] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55720.667834] [] ? _raw_spin_lock+0x20/0x30 [55720.674208] [] ? wake_up_atomic_t+0x30/0x30 [55720.680835] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55720.687923] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55720.696251] [] kthread+0xd1/0xe0 [55720.701742] [] ? insert_kthread_work+0x40/0x40 [55720.708574] [] ret_from_fork_nospec_begin+0x21/0x21 [55720.715900] [] ? insert_kthread_work+0x40/0x40 [55720.722723] mdt_out01_021 S ffff99514fbbe2a0 0 5891 2 0x00000080 [55720.730713] Call Trace: [55720.733480] [] schedule+0x29/0x70 [55720.739127] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55720.746649] [] ? _raw_spin_lock+0x20/0x30 [55720.753021] [] ? wake_up_atomic_t+0x30/0x30 [55720.759633] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55720.766734] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55720.775048] [] kthread+0xd1/0xe0 [55720.780516] [] ? insert_kthread_work+0x40/0x40 [55720.787355] [] ret_from_fork_nospec_begin+0x21/0x21 [55720.794693] [] ? insert_kthread_work+0x40/0x40 [55720.801538] mdt_out01_022 S ffff994d6c033150 0 5895 2 0x00000080 [55720.809490] Call Trace: [55720.812263] [] ? __set_current_blocked+0x42/0x70 [55720.819330] [] schedule+0x29/0x70 [55720.824981] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55720.832502] [] ? __wake_up+0x13/0x20 [55720.838373] [] ? wake_up_atomic_t+0x30/0x30 [55720.844993] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55720.852088] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55720.860378] [] kthread+0xd1/0xe0 [55720.865875] [] ? insert_kthread_work+0x40/0x40 [55720.872713] [] ret_from_fork_nospec_begin+0x21/0x21 [55720.880044] [] ? insert_kthread_work+0x40/0x40 [55720.886889] mdt_rdpg01_005 S ffff994d6c030000 0 5898 2 0x00000080 [55720.894880] Call Trace: [55720.897650] [] ? _raw_spin_lock_irqsave+0x37/0x40 [55720.904788] [] schedule+0x29/0x70 [55720.910404] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55720.917929] [] ? __wake_up+0x13/0x20 [55720.923793] [] ? wake_up_atomic_t+0x30/0x30 [55720.930413] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55720.937521] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55720.945834] [] kthread+0xd1/0xe0 [55720.951319] [] ? insert_kthread_work+0x40/0x40 [55720.958158] [] ret_from_fork_nospec_begin+0x21/0x21 [55720.965493] [] ? insert_kthread_work+0x40/0x40 [55720.972316] mdt_rdpg00_006 S ffff994df9e6c1c0 0 5899 2 0x00000080 [55720.980278] Call Trace: [55720.983055] [] ? __set_current_blocked+0x42/0x70 [55720.990073] [] schedule+0x29/0x70 [55720.995715] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55721.003284] [] ? __wake_up+0x13/0x20 [55721.009162] [] ? wake_up_atomic_t+0x30/0x30 [55721.015783] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55721.022901] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55721.031182] [] kthread+0xd1/0xe0 [55721.036660] [] ? insert_kthread_work+0x40/0x40 [55721.043494] [] ret_from_fork_nospec_begin+0x21/0x21 [55721.050824] [] ? insert_kthread_work+0x40/0x40 [55721.057670] mdt_rdpg01_006 S ffff99516c0cb150 0 5900 2 0x00000080 [55721.065666] Call Trace: [55721.068425] [] ? _raw_spin_lock_irqsave+0x37/0x40 [55721.075549] [] schedule+0x29/0x70 [55721.081218] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55721.088760] [] ? wake_up_atomic_t+0x30/0x30 [55721.095350] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55721.102433] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55721.110730] [] kthread+0xd1/0xe0 [55721.116222] [] ? insert_kthread_work+0x40/0x40 [55721.123086] [] ret_from_fork_nospec_begin+0x21/0x21 [55721.130418] [] ? insert_kthread_work+0x40/0x40 [55721.137280] mdt_rdpg00_007 S ffff99516c0cd230 0 5901 2 0x00000080 [55721.145280] Call Trace: [55721.148040] [] ? _raw_spin_lock_irqsave+0x37/0x40 [55721.155186] [] schedule+0x29/0x70 [55721.160823] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55721.168339] [] ? __wake_up+0x13/0x20 [55721.174237] [] ? wake_up_atomic_t+0x30/0x30 [55721.180864] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55721.187958] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55721.196268] [] kthread+0xd1/0xe0 [55721.201764] [] ? insert_kthread_work+0x40/0x40 [55721.208604] [] ret_from_fork_nospec_begin+0x21/0x21 [55721.215943] [] ? insert_kthread_work+0x40/0x40 [55721.222787] mdt_rdpg00_008 S ffff99516c0cc1c0 0 5902 2 0x00000080 [55721.230761] Call Trace: [55721.233523] [] ? __set_current_blocked+0x42/0x70 [55721.240557] [] schedule+0x29/0x70 [55721.246188] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55721.253741] [] ? __wake_up+0x13/0x20 [55721.259612] [] ? wake_up_atomic_t+0x30/0x30 [55721.266236] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55721.273358] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55721.281631] [] kthread+0xd1/0xe0 [55721.287122] [] ? insert_kthread_work+0x40/0x40 [55721.293946] [] ret_from_fork_nospec_begin+0x21/0x21 [55721.301278] [] ? insert_kthread_work+0x40/0x40 [55721.308116] mdt_rdpg01_007 S ffff99516c0c8000 0 5903 2 0x00000080 [55721.316086] Call Trace: [55721.318861] [] ? __set_current_blocked+0x42/0x70 [55721.325899] [] schedule+0x29/0x70 [55721.331516] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55721.339032] [] ? __wake_up+0x13/0x20 [55721.344910] [] ? wake_up_atomic_t+0x30/0x30 [55721.351522] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55721.358622] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55721.366934] [] kthread+0xd1/0xe0 [55721.372409] [] ? insert_kthread_work+0x40/0x40 [55721.379278] [] ret_from_fork_nospec_begin+0x21/0x21 [55721.386610] [] ? insert_kthread_work+0x40/0x40 [55721.393449] mdt_rdpg00_009 S ffff99516c0c9070 0 5904 2 0x00000080 [55721.401400] Call Trace: [55721.404184] [] ? __set_current_blocked+0x42/0x70 [55721.411245] [] schedule+0x29/0x70 [55721.416889] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55721.424396] [] ? __wake_up+0x13/0x20 [55721.430279] [] ? wake_up_atomic_t+0x30/0x30 [55721.436898] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55721.443995] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55721.452289] [] kthread+0xd1/0xe0 [55721.457787] [] ? insert_kthread_work+0x40/0x40 [55721.464626] [] ret_from_fork_nospec_begin+0x21/0x21 [55721.471957] [] ? insert_kthread_work+0x40/0x40 [55721.478801] mdt_rdpg01_008 S ffff9951677ed230 0 5905 2 0x00000080 [55721.486791] Call Trace: [55721.489546] [] ? __set_current_blocked+0x42/0x70 [55721.496587] [] schedule+0x29/0x70 [55721.502221] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55721.509752] [] ? __wake_up+0x13/0x20 [55721.515624] [] ? wake_up_atomic_t+0x30/0x30 [55721.522242] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55721.529369] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55721.537667] [] kthread+0xd1/0xe0 [55721.543138] [] ? insert_kthread_work+0x40/0x40 [55721.549994] [] ret_from_fork_nospec_begin+0x21/0x21 [55721.557327] [] ? insert_kthread_work+0x40/0x40 [55721.564177] mdt_rdpg00_010 S ffff9951677ec1c0 0 5906 2 0x00000080 [55721.572173] Call Trace: [55721.574954] [] ? __set_current_blocked+0x42/0x70 [55721.581993] [] schedule+0x29/0x70 [55721.587629] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55721.595176] [] ? __wake_up+0x13/0x20 [55721.601070] [] ? wake_up_atomic_t+0x30/0x30 [55721.607681] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55721.614787] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55721.623091] [] kthread+0xd1/0xe0 [55721.628574] [] ? insert_kthread_work+0x40/0x40 [55721.635421] [] ret_from_fork_nospec_begin+0x21/0x21 [55721.642752] [] ? insert_kthread_work+0x40/0x40 [55721.649571] mdt_rdpg01_009 S ffff9951677eb150 0 5907 2 0x00000080 [55721.657523] Call Trace: [55721.660290] [] ? _raw_spin_lock_irqsave+0x37/0x40 [55721.667427] [] schedule+0x29/0x70 [55721.673050] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55721.680597] [] ? __wake_up+0x13/0x20 [55721.686461] [] ? wake_up_atomic_t+0x30/0x30 [55721.693090] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55721.700191] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55721.708491] [] kthread+0xd1/0xe0 [55721.713981] [] ? insert_kthread_work+0x40/0x40 [55721.720834] [] ret_from_fork_nospec_begin+0x21/0x21 [55721.728169] [] ? insert_kthread_work+0x40/0x40 [55721.735022] kworker/17:0 S ffff994d6a6c9070 0 5947 2 0x00000080 [55721.743016] Call Trace: [55721.745791] [] schedule+0x29/0x70 [55721.751372] [] worker_thread+0x1d9/0x3c0 [55721.757637] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55721.764976] [] kthread+0xd1/0xe0 [55721.770458] [] ? insert_kthread_work+0x40/0x40 [55721.777297] [] ret_from_fork_nospec_begin+0x21/0x21 [55721.784630] [] ? insert_kthread_work+0x40/0x40 [55721.791462] kworker/20:2 S ffff994d6a6ca0e0 0 5951 2 0x00000080 [55721.799428] Call Trace: [55721.802221] [] ? process_one_work+0x336/0x440 [55721.808972] [] schedule+0x29/0x70 [55721.814553] [] worker_thread+0x1d9/0x3c0 [55721.820825] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55721.828161] [] kthread+0xd1/0xe0 [55721.833660] [] ? insert_kthread_work+0x40/0x40 [55721.840508] [] ret_from_fork_nospec_begin+0x21/0x21 [55721.847837] [] ? insert_kthread_work+0x40/0x40 [55721.854660] mdt00_013 S ffff994d6a6cc1c0 0 6066 2 0x00000080 [55721.862634] Call Trace: [55721.865402] [] ? _raw_spin_lock_irqsave+0x37/0x40 [55721.872531] [] schedule+0x29/0x70 [55721.878182] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55721.885720] [] ? __wake_up+0x13/0x20 [55721.891583] [] ? wake_up_atomic_t+0x30/0x30 [55721.898216] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55721.905329] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55721.913619] [] kthread+0xd1/0xe0 [55721.919111] [] ? insert_kthread_work+0x40/0x40 [55721.925966] [] ret_from_fork_nospec_begin+0x21/0x21 [55721.933289] [] ? insert_kthread_work+0x40/0x40 [55721.940127] mdt01_014 S ffff99514fbba0e0 0 6067 2 0x00000080 [55721.948078] Call Trace: [55721.950847] [] ? __set_current_blocked+0x42/0x70 [55721.957896] [] schedule+0x29/0x70 [55721.963521] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55721.971044] [] ? __wake_up+0x13/0x20 [55721.976930] [] ? wake_up_atomic_t+0x30/0x30 [55721.983542] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55721.990641] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55721.998954] [] kthread+0xd1/0xe0 [55722.004425] [] ? insert_kthread_work+0x40/0x40 [55722.011273] [] ret_from_fork_nospec_begin+0x21/0x21 [55722.018612] [] ? insert_kthread_work+0x40/0x40 [55722.025451] mdt00_014 D ffff994d6892b150 0 6068 2 0x00000080 [55722.033412] Call Trace: [55722.036179] [] ? wake_up_state+0x20/0x20 [55722.042435] [] schedule+0x29/0x70 [55722.048011] [] lbug_with_loc+0x7d/0xa0 [libcfs] [55722.054963] [] llog_osd_write_rec+0x1395/0x14b0 [obdclass] [55722.062985] [] ? __wake_up_common_lock+0x91/0xc0 [55722.070048] [] llog_write_rec+0x273/0x540 [obdclass] [55722.077504] [] llog_cat_add_rec+0x220/0x880 [obdclass] [55722.085158] [] llog_add+0x162/0x1d0 [obdclass] [55722.092040] [] ? lprocfs_counter_add+0xf9/0x160 [obdclass] [55722.100131] [] sub_updates_write+0x2e8/0xdd7 [ptlrpc] [55722.107717] [] ? prepare_writing_updates.isra.12+0x139/0x14a [ptlrpc] [55722.116868] [] top_trans_stop+0x827/0xbc0 [ptlrpc] [55722.124113] [] ? lod_sub_ref_add+0x1be/0x450 [lod] [55722.131358] [] lod_trans_stop+0x25c/0x340 [lod] [55722.138313] [] ? mdd_changelog_ns_store+0x30/0x8d0 [mdd] [55722.146158] [] ? mdd_links_rename+0x242/0x420 [mdd] [55722.153503] [] mdd_trans_stop+0x2e/0x174 [mdd] [55722.160350] [] mdd_create+0x1395/0x17d0 [mdd] [55722.167113] [] mdt_create+0xaf9/0xf90 [mdt] [55722.173694] [] ? lprocfs_stats_lock+0x24/0xd0 [obdclass] [55722.181515] [] mdt_reint_create+0x16b/0x360 [mdt] [55722.188648] [] mdt_reint_rec+0x83/0x210 [mdt] [55722.195405] [] mdt_reint_internal+0x7b0/0xba0 [mdt] [55722.202755] [] mdt_reint+0x67/0x140 [mdt] [55722.209200] [] tgt_request_handle+0x95a/0x1630 [ptlrpc] [55722.216938] [] ? ktime_get_real_seconds+0xe/0x10 [libcfs] [55722.224924] [] ptlrpc_server_handle_request+0x256/0xb10 [ptlrpc] [55722.233581] [] ? ptlrpc_wait_event+0x12e/0x5b0 [ptlrpc] [55722.241296] [] ? __wake_up+0x13/0x20 [55722.247263] [] ? ptlrpc_server_handle_req_in+0x92a/0x1100 [ptlrpc] [55722.256045] [] ? wake_up_atomic_t+0x30/0x30 [55722.262666] [] ptlrpc_main+0xbb4/0x1550 [ptlrpc] [55722.269782] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55722.278089] [] kthread+0xd1/0xe0 [55722.283574] [] ? insert_kthread_work+0x40/0x40 [55722.290414] [] ret_from_fork_nospec_begin+0x21/0x21 [55722.297745] [] ? insert_kthread_work+0x40/0x40 [55722.304574] mdt01_015 S ffff994d6892e2a0 0 6069 2 0x00000080 [55722.312545] Call Trace: [55722.315307] [] ? __set_current_blocked+0x42/0x70 [55722.322334] [] schedule+0x29/0x70 [55722.327974] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55722.335519] [] ? __wake_up+0x13/0x20 [55722.341406] [] ? wake_up_atomic_t+0x30/0x30 [55722.348020] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55722.355133] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55722.363427] [] kthread+0xd1/0xe0 [55722.368917] [] ? insert_kthread_work+0x40/0x40 [55722.375772] [] ret_from_fork_nospec_begin+0x21/0x21 [55722.383112] [] ? insert_kthread_work+0x40/0x40 [55722.389957] mdt00_015 S ffff994d68929070 0 6070 2 0x00000080 [55722.397959] Call Trace: [55722.400727] [] ? __set_current_blocked+0x42/0x70 [55722.407753] [] schedule+0x29/0x70 [55722.413395] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55722.420925] [] ? __wake_up+0x13/0x20 [55722.426811] [] ? wake_up_atomic_t+0x30/0x30 [55722.433423] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55722.440531] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55722.448829] [] kthread+0xd1/0xe0 [55722.454311] [] ? insert_kthread_work+0x40/0x40 [55722.461180] [] ret_from_fork_nospec_begin+0x21/0x21 [55722.468500] [] ? insert_kthread_work+0x40/0x40 [55722.475345] mdt01_016 S ffff994d6892a0e0 0 6071 2 0x00000080 [55722.483287] Call Trace: [55722.486046] [] ? __set_current_blocked+0x42/0x70 [55722.493081] [] schedule+0x29/0x70 [55722.498738] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55722.506261] [] ? __wake_up+0x13/0x20 [55722.512156] [] ? wake_up_atomic_t+0x30/0x30 [55722.518788] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55722.525896] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55722.534212] [] kthread+0xd1/0xe0 [55722.539696] [] ? insert_kthread_work+0x40/0x40 [55722.546536] [] ret_from_fork_nospec_begin+0x21/0x21 [55722.553874] [] ? insert_kthread_work+0x40/0x40 [55722.560719] ldlm_cb00_004 S ffff994d67c53150 0 6074 2 0x00000080 [55722.568696] Call Trace: [55722.571451] [] ? __set_current_blocked+0x42/0x70 [55722.578472] [] schedule+0x29/0x70 [55722.584138] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55722.591675] [] ? __wake_up+0x13/0x20 [55722.597555] [] ? wake_up_atomic_t+0x30/0x30 [55722.604172] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55722.611282] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55722.619571] [] kthread+0xd1/0xe0 [55722.625057] [] ? insert_kthread_work+0x40/0x40 [55722.631911] [] ret_from_fork_nospec_begin+0x21/0x21 [55722.639219] [] ? insert_kthread_work+0x40/0x40 [55722.646053] ldlm_cb01_004 S ffff994d67c55230 0 6387 2 0x00000080 [55722.654041] Call Trace: [55722.656807] [] schedule+0x29/0x70 [55722.662457] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55722.669994] [] ? __wake_up+0x13/0x20 [55722.675874] [] ? wake_up_atomic_t+0x30/0x30 [55722.682467] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55722.689556] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55722.697855] [] kthread+0xd1/0xe0 [55722.703308] [] ? insert_kthread_work+0x40/0x40 [55722.710177] [] ret_from_fork_nospec_begin+0x21/0x21 [55722.717509] [] ? insert_kthread_work+0x40/0x40 [55722.724341] ldlm_cn01_013 S ffff994d67c51070 0 6546 2 0x00000080 [55722.732298] Call Trace: [55722.735066] [] ? __set_current_blocked+0x42/0x70 [55722.742131] [] schedule+0x29/0x70 [55722.747781] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55722.755302] [] ? _raw_spin_lock+0x20/0x30 [55722.761666] [] ? wake_up_atomic_t+0x30/0x30 [55722.768285] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55722.775384] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55722.783674] [] kthread+0xd1/0xe0 [55722.789182] [] ? insert_kthread_work+0x40/0x40 [55722.796022] [] ret_from_fork_nospec_begin+0x21/0x21 [55722.803356] [] ? insert_kthread_work+0x40/0x40 [55722.810197] mdt_io01_003 S ffff994d67c562a0 0 6551 2 0x00000080 [55722.818165] Call Trace: [55722.820933] [] ? __set_current_blocked+0x42/0x70 [55722.827958] [] schedule+0x29/0x70 [55722.833596] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55722.841166] [] ? __wake_up+0x13/0x20 [55722.847050] [] ? wake_up_atomic_t+0x30/0x30 [55722.853678] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55722.860788] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55722.869101] [] kthread+0xd1/0xe0 [55722.874596] [] ? insert_kthread_work+0x40/0x40 [55722.881443] [] ret_from_fork_nospec_begin+0x21/0x21 [55722.888774] [] ? insert_kthread_work+0x40/0x40 [55722.895619] mdt_io00_003 S ffff994d67c520e0 0 6552 2 0x00000080 [55722.903593] Call Trace: [55722.906368] [] ? __set_current_blocked+0x42/0x70 [55722.913414] [] schedule+0x29/0x70 [55722.919074] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55722.926600] [] ? __wake_up+0x13/0x20 [55722.932472] [] ? wake_up_atomic_t+0x30/0x30 [55722.939106] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55722.946239] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55722.954536] [] kthread+0xd1/0xe0 [55722.960035] [] ? insert_kthread_work+0x40/0x40 [55722.966889] [] ret_from_fork_nospec_begin+0x21/0x21 [55722.974219] [] ? insert_kthread_work+0x40/0x40 [55722.981087] mdt_io00_004 S ffff994d6804d230 0 6553 2 0x00000080 [55722.989129] Call Trace: [55722.991908] [] schedule+0x29/0x70 [55722.997561] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55723.005093] [] ? __wake_up+0x13/0x20 [55723.010989] [] ? wake_up_atomic_t+0x30/0x30 [55723.017594] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55723.024701] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55723.033004] [] kthread+0xd1/0xe0 [55723.038495] [] ? insert_kthread_work+0x40/0x40 [55723.045341] [] ret_from_fork_nospec_begin+0x21/0x21 [55723.052664] [] ? insert_kthread_work+0x40/0x40 [55723.059505] mdt_io01_004 S ffff994d68049070 0 6554 2 0x00000080 [55723.067465] Call Trace: [55723.070224] [] ? __set_current_blocked+0x42/0x70 [55723.077266] [] schedule+0x29/0x70 [55723.082917] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55723.090433] [] ? __wake_up+0x13/0x20 [55723.096311] [] ? wake_up_atomic_t+0x30/0x30 [55723.102928] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55723.110023] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55723.118333] [] kthread+0xd1/0xe0 [55723.123808] [] ? insert_kthread_work+0x40/0x40 [55723.130655] [] ret_from_fork_nospec_begin+0x21/0x21 [55723.137992] [] ? insert_kthread_work+0x40/0x40 [55723.144846] mdt_io01_005 S ffff994d68048000 0 6555 2 0x00000080 [55723.152826] Call Trace: [55723.155580] [] ? __set_current_blocked+0x42/0x70 [55723.162618] [] schedule+0x29/0x70 [55723.168273] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55723.175795] [] ? __wake_up+0x13/0x20 [55723.181673] [] ? wake_up_atomic_t+0x30/0x30 [55723.188280] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55723.195388] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55723.203685] [] kthread+0xd1/0xe0 [55723.209164] [] ? insert_kthread_work+0x40/0x40 [55723.216010] [] ret_from_fork_nospec_begin+0x21/0x21 [55723.223337] [] ? insert_kthread_work+0x40/0x40 [55723.230186] mdt_io00_005 S ffff994d6804b150 0 6556 2 0x00000080 [55723.238177] Call Trace: [55723.240945] [] ? __set_current_blocked+0x42/0x70 [55723.247994] [] schedule+0x29/0x70 [55723.253643] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55723.261155] [] ? __wake_up+0x13/0x20 [55723.267036] [] ? wake_up_atomic_t+0x30/0x30 [55723.273651] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55723.280757] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55723.289072] [] kthread+0xd1/0xe0 [55723.294571] [] ? insert_kthread_work+0x40/0x40 [55723.301417] [] ret_from_fork_nospec_begin+0x21/0x21 [55723.308756] [] ? insert_kthread_work+0x40/0x40 [55723.315579] mdt_io01_006 S ffff994d6804e2a0 0 6557 2 0x00000080 [55723.323554] Call Trace: [55723.326296] [] ? __set_current_blocked+0x42/0x70 [55723.333336] [] schedule+0x29/0x70 [55723.338974] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55723.346510] [] ? __wake_up+0x13/0x20 [55723.352379] [] ? wake_up_atomic_t+0x30/0x30 [55723.358998] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55723.366117] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55723.374439] [] kthread+0xd1/0xe0 [55723.379925] [] ? insert_kthread_work+0x40/0x40 [55723.386781] [] ret_from_fork_nospec_begin+0x21/0x21 [55723.394120] [] ? insert_kthread_work+0x40/0x40 [55723.400973] mdt_io00_006 S ffff994d6804a0e0 0 6558 2 0x00000080 [55723.408949] Call Trace: [55723.411709] [] ? __set_current_blocked+0x42/0x70 [55723.418750] [] schedule+0x29/0x70 [55723.424380] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55723.431902] [] ? __wake_up+0x13/0x20 [55723.437787] [] ? wake_up_atomic_t+0x30/0x30 [55723.444393] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55723.451487] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55723.459791] [] kthread+0xd1/0xe0 [55723.465267] [] ? insert_kthread_work+0x40/0x40 [55723.472126] [] ret_from_fork_nospec_begin+0x21/0x21 [55723.479465] [] ? insert_kthread_work+0x40/0x40 [55723.486319] mdt_io00_007 S ffff99516716e2a0 0 6559 2 0x00000080 [55723.494293] Call Trace: [55723.497076] [] ? __set_current_blocked+0x42/0x70 [55723.504143] [] schedule+0x29/0x70 [55723.509796] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55723.517308] [] ? __wake_up+0x13/0x20 [55723.523188] [] ? wake_up_atomic_t+0x30/0x30 [55723.529795] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55723.536914] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55723.545218] [] kthread+0xd1/0xe0 [55723.550704] [] ? insert_kthread_work+0x40/0x40 [55723.557549] [] ret_from_fork_nospec_begin+0x21/0x21 [55723.564888] [] ? insert_kthread_work+0x40/0x40 [55723.571733] mdt_io00_008 S ffff99516716a0e0 0 6560 2 0x00000080 [55723.579700] Call Trace: [55723.582462] [] ? __set_current_blocked+0x42/0x70 [55723.589503] [] schedule+0x29/0x70 [55723.595147] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55723.602689] [] ? __wake_up+0x13/0x20 [55723.608561] [] ? wake_up_atomic_t+0x30/0x30 [55723.615198] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55723.622306] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55723.630618] [] kthread+0xd1/0xe0 [55723.636130] [] ? insert_kthread_work+0x40/0x40 [55723.642980] [] ret_from_fork_nospec_begin+0x21/0x21 [55723.650279] [] ? insert_kthread_work+0x40/0x40 [55723.657136] mdt_io01_007 S ffff99516716c1c0 0 6599 2 0x00000080 [55723.665103] Call Trace: [55723.667870] [] ? __set_current_blocked+0x42/0x70 [55723.674910] [] schedule+0x29/0x70 [55723.680548] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55723.688084] [] ? __wake_up+0x13/0x20 [55723.693987] [] ? wake_up_atomic_t+0x30/0x30 [55723.700579] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55723.707678] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55723.715976] [] kthread+0xd1/0xe0 [55723.721451] [] ? insert_kthread_work+0x40/0x40 [55723.728290] [] ret_from_fork_nospec_begin+0x21/0x21 [55723.735630] [] ? insert_kthread_work+0x40/0x40 [55723.742473] mdt_io01_008 S ffff99516716b150 0 6600 2 0x00000080 [55723.750425] Call Trace: [55723.753194] [] ? __set_current_blocked+0x42/0x70 [55723.760237] [] schedule+0x29/0x70 [55723.765865] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55723.773391] [] ? __wake_up+0x13/0x20 [55723.779269] [] ? wake_up_atomic_t+0x30/0x30 [55723.785889] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55723.793003] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55723.801304] [] kthread+0xd1/0xe0 [55723.806774] [] ? insert_kthread_work+0x40/0x40 [55723.813628] [] ret_from_fork_nospec_begin+0x21/0x21 [55723.820967] [] ? insert_kthread_work+0x40/0x40 [55723.827814] mdt_rdpg01_010 S ffff994975e320e0 0 6715 2 0x00000080 [55723.835820] Call Trace: [55723.838581] [] ? __set_current_blocked+0x42/0x70 [55723.845620] [] schedule+0x29/0x70 [55723.851256] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55723.858787] [] ? __wake_up+0x13/0x20 [55723.864664] [] ? wake_up_atomic_t+0x30/0x30 [55723.871284] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55723.878401] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55723.886704] [] kthread+0xd1/0xe0 [55723.892186] [] ? insert_kthread_work+0x40/0x40 [55723.898998] [] ret_from_fork_nospec_begin+0x21/0x21 [55723.906353] [] ? insert_kthread_work+0x40/0x40 [55723.913201] mdt_rdpg00_011 S ffff994975e30000 0 6716 2 0x00000080 [55723.921151] Call Trace: [55723.923912] [] schedule+0x29/0x70 [55723.929552] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55723.937083] [] ? __wake_up+0x13/0x20 [55723.942971] [] ? wake_up_atomic_t+0x30/0x30 [55723.949579] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55723.956679] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55723.964971] [] kthread+0xd1/0xe0 [55723.970462] [] ? insert_kthread_work+0x40/0x40 [55723.977294] [] ret_from_fork_nospec_begin+0x21/0x21 [55723.984626] [] ? insert_kthread_work+0x40/0x40 [55723.991473] mdt_rdpg01_011 S ffff994975e31070 0 6718 2 0x00000080 [55723.999445] Call Trace: [55724.002211] [] ? __set_current_blocked+0x42/0x70 [55724.009261] [] schedule+0x29/0x70 [55724.014910] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55724.022440] [] ? wake_up_atomic_t+0x30/0x30 [55724.029070] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55724.036189] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55724.044471] [] kthread+0xd1/0xe0 [55724.049970] [] ? insert_kthread_work+0x40/0x40 [55724.056827] [] ret_from_fork_nospec_begin+0x21/0x21 [55724.064159] [] ? insert_kthread_work+0x40/0x40 [55724.071027] mdt_rdpg00_012 S ffff994975e33150 0 6719 2 0x00000080 [55724.079030] Call Trace: [55724.081796] [] ? _raw_spin_lock_irqsave+0x37/0x40 [55724.088921] [] schedule+0x29/0x70 [55724.094571] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55724.102113] [] ? __wake_up+0x13/0x20 [55724.107981] [] ? wake_up_atomic_t+0x30/0x30 [55724.114593] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55724.121703] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55724.130028] [] kthread+0xd1/0xe0 [55724.135525] [] ? insert_kthread_work+0x40/0x40 [55724.142365] [] ret_from_fork_nospec_begin+0x21/0x21 [55724.149706] [] ? insert_kthread_work+0x40/0x40 [55724.156538] mdt_rdpg01_012 S ffff994975e362a0 0 6720 2 0x00000080 [55724.164521] Call Trace: [55724.167289] [] ? __set_current_blocked+0x42/0x70 [55724.174315] [] schedule+0x29/0x70 [55724.179944] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55724.187468] [] ? _raw_spin_lock+0x20/0x30 [55724.193840] [] ? wake_up_atomic_t+0x30/0x30 [55724.200441] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55724.207561] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55724.215865] [] kthread+0xd1/0xe0 [55724.221355] [] ? insert_kthread_work+0x40/0x40 [55724.228186] [] ret_from_fork_nospec_begin+0x21/0x21 [55724.235497] [] ? insert_kthread_work+0x40/0x40 [55724.242345] mdt_rdpg01_013 S ffff994975e35230 0 6721 2 0x00000080 [55724.250305] Call Trace: [55724.253086] [] ? __set_current_blocked+0x42/0x70 [55724.260126] [] schedule+0x29/0x70 [55724.265769] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55724.273290] [] ? __wake_up+0x13/0x20 [55724.279167] [] ? wake_up_atomic_t+0x30/0x30 [55724.285786] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55724.292887] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55724.301193] [] kthread+0xd1/0xe0 [55724.306683] [] ? insert_kthread_work+0x40/0x40 [55724.313522] [] ret_from_fork_nospec_begin+0x21/0x21 [55724.320861] [] ? insert_kthread_work+0x40/0x40 [55724.327707] mdt_rdpg00_013 S ffff994ab9460000 0 6722 2 0x00000080 [55724.335694] Call Trace: [55724.338462] [] ? __set_current_blocked+0x42/0x70 [55724.345489] [] schedule+0x29/0x70 [55724.351147] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55724.358684] [] ? __wake_up+0x13/0x20 [55724.364546] [] ? wake_up_atomic_t+0x30/0x30 [55724.371164] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55724.378272] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55724.386576] [] kthread+0xd1/0xe0 [55724.392085] [] ? insert_kthread_work+0x40/0x40 [55724.398932] [] ret_from_fork_nospec_begin+0x21/0x21 [55724.406264] [] ? insert_kthread_work+0x40/0x40 [55724.413109] ldlm_bl_06 S ffff995166f741c0 0 6723 2 0x00000080 [55724.421093] Call Trace: [55724.423892] [] ? obd_stale_export_get+0x31/0x190 [obdclass] [55724.432027] [] schedule+0x29/0x70 [55724.437651] [] ldlm_bl_thread_main+0x709/0xa00 [ptlrpc] [55724.445374] [] ? wake_up_atomic_t+0x30/0x30 [55724.451974] [] ? ldlm_handle_bl_callback+0x3e0/0x3e0 [ptlrpc] [55724.460288] [] kthread+0xd1/0xe0 [55724.465777] [] ? insert_kthread_work+0x40/0x40 [55724.472631] [] ret_from_fork_nospec_begin+0x21/0x21 [55724.479958] [] ? insert_kthread_work+0x40/0x40 [55724.486810] mdt_out00_006 S ffff99516c2c20e0 0 7197 2 0x00000080 [55724.494818] Call Trace: [55724.497594] [] ? __set_current_blocked+0x42/0x70 [55724.504625] [] schedule+0x29/0x70 [55724.510276] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55724.517803] [] ? _raw_spin_lock+0x20/0x30 [55724.524150] [] ? wake_up_atomic_t+0x30/0x30 [55724.530778] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55724.537877] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55724.546182] [] kthread+0xd1/0xe0 [55724.551683] [] ? insert_kthread_work+0x40/0x40 [55724.558494] [] ret_from_fork_nospec_begin+0x21/0x21 [55724.565826] [] ? insert_kthread_work+0x40/0x40 [55724.572677] mdt00_016 S ffff99516c2c3150 0 7354 2 0x00000080 [55724.580665] Call Trace: [55724.583432] [] ? __set_current_blocked+0x42/0x70 [55724.590472] [] schedule+0x29/0x70 [55724.596108] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55724.603645] [] ? _raw_spin_lock+0x20/0x30 [55724.610015] [] ? wake_up_atomic_t+0x30/0x30 [55724.616647] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55724.623749] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55724.632056] [] kthread+0xd1/0xe0 [55724.637554] [] ? insert_kthread_work+0x40/0x40 [55724.644381] [] ret_from_fork_nospec_begin+0x21/0x21 [55724.651702] [] ? insert_kthread_work+0x40/0x40 [55724.658545] mdt01_017 S ffff99516c2c5230 0 7355 2 0x00000080 [55724.666539] Call Trace: [55724.669300] [] ? __set_current_blocked+0x42/0x70 [55724.676334] [] schedule+0x29/0x70 [55724.681989] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55724.689534] [] ? __wake_up+0x13/0x20 [55724.695415] [] ? wake_up_atomic_t+0x30/0x30 [55724.702053] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55724.709177] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55724.717482] [] kthread+0xd1/0xe0 [55724.722992] [] ? insert_kthread_work+0x40/0x40 [55724.729846] [] ret_from_fork_nospec_begin+0x21/0x21 [55724.737179] [] ? insert_kthread_work+0x40/0x40 [55724.744033] mdt01_018 S ffff99516c2c62a0 0 7356 2 0x00000080 [55724.751998] Call Trace: [55724.754750] [] ? __set_current_blocked+0x42/0x70 [55724.761799] [] schedule+0x29/0x70 [55724.767435] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55724.774965] [] ? __wake_up+0x13/0x20 [55724.780815] [] ? wake_up_atomic_t+0x30/0x30 [55724.787422] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55724.794530] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55724.802800] [] kthread+0xd1/0xe0 [55724.808277] [] ? insert_kthread_work+0x40/0x40 [55724.815113] [] ret_from_fork_nospec_begin+0x21/0x21 [55724.822439] [] ? insert_kthread_work+0x40/0x40 [55724.829262] mdt00_017 S ffff99516c2c41c0 0 7357 2 0x00000080 [55724.837216] Call Trace: [55724.839997] [] ? __set_current_blocked+0x42/0x70 [55724.847047] [] schedule+0x29/0x70 [55724.852696] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55724.860211] [] ? __wake_up+0x13/0x20 [55724.866088] [] ? wake_up_atomic_t+0x30/0x30 [55724.872715] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55724.879804] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55724.888112] [] kthread+0xd1/0xe0 [55724.893608] [] ? insert_kthread_work+0x40/0x40 [55724.900442] [] ret_from_fork_nospec_begin+0x21/0x21 [55724.907765] [] ? insert_kthread_work+0x40/0x40 [55724.914618] mdt00_018 S ffff99516c2c1070 0 7358 2 0x00000080 [55724.922613] Call Trace: [55724.925376] [] ? __set_current_blocked+0x42/0x70 [55724.932408] [] schedule+0x29/0x70 [55724.938091] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55724.945622] [] ? __wake_up+0x13/0x20 [55724.951493] [] ? wake_up_atomic_t+0x30/0x30 [55724.958133] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55724.965239] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55724.973553] [] kthread+0xd1/0xe0 [55724.979048] [] ? insert_kthread_work+0x40/0x40 [55724.985893] [] ret_from_fork_nospec_begin+0x21/0x21 [55724.993225] [] ? insert_kthread_work+0x40/0x40 [55725.000069] mdt01_019 S ffff99516c2c0000 0 7359 2 0x00000080 [55725.008039] Call Trace: [55725.010799] [] ? __set_current_blocked+0x42/0x70 [55725.017838] [] schedule+0x29/0x70 [55725.023475] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55725.031026] [] ? __wake_up+0x13/0x20 [55725.036912] [] ? wake_up_atomic_t+0x30/0x30 [55725.043523] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55725.050637] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55725.058954] [] kthread+0xd1/0xe0 [55725.064444] [] ? insert_kthread_work+0x40/0x40 [55725.071293] [] ret_from_fork_nospec_begin+0x21/0x21 [55725.078626] [] ? insert_kthread_work+0x40/0x40 [55725.085472] mdt00_019 S ffff9951680d8000 0 7360 2 0x00000080 [55725.093467] Call Trace: [55725.096241] [] ? _raw_spin_lock_irqsave+0x37/0x40 [55725.103361] [] schedule+0x29/0x70 [55725.109043] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55725.116573] [] ? __wake_up+0x13/0x20 [55725.122443] [] ? wake_up_atomic_t+0x30/0x30 [55725.129080] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55725.136181] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55725.144477] [] kthread+0xd1/0xe0 [55725.149975] [] ? insert_kthread_work+0x40/0x40 [55725.156829] [] ret_from_fork_nospec_begin+0x21/0x21 [55725.164126] [] ? insert_kthread_work+0x40/0x40 [55725.171007] mdt00_020 S ffff9951680dd230 0 7361 2 0x00000080 [55725.178976] Call Trace: [55725.181757] [] ? __set_current_blocked+0x42/0x70 [55725.188804] [] schedule+0x29/0x70 [55725.194456] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55725.201976] [] ? _raw_spin_lock+0x20/0x30 [55725.208341] [] ? wake_up_atomic_t+0x30/0x30 [55725.214961] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55725.222094] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55725.230399] [] kthread+0xd1/0xe0 [55725.235887] [] ? insert_kthread_work+0x40/0x40 [55725.242731] [] ret_from_fork_nospec_begin+0x21/0x21 [55725.250027] [] ? insert_kthread_work+0x40/0x40 [55725.256864] mdt01_020 S ffff9951680db150 0 7362 2 0x00000080 [55725.264829] Call Trace: [55725.267590] [] ? __set_current_blocked+0x42/0x70 [55725.274636] [] schedule+0x29/0x70 [55725.280254] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55725.287792] [] ? __wake_up+0x13/0x20 [55725.293653] [] ? wake_up_atomic_t+0x30/0x30 [55725.300241] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55725.307325] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55725.315628] [] kthread+0xd1/0xe0 [55725.321112] [] ? insert_kthread_work+0x40/0x40 [55725.327964] [] ret_from_fork_nospec_begin+0x21/0x21 [55725.335263] [] ? insert_kthread_work+0x40/0x40 [55725.342118] mdt01_021 S ffff9951680da0e0 0 7363 2 0x00000080 [55725.350078] Call Trace: [55725.352844] [] ? __set_current_blocked+0x42/0x70 [55725.359891] [] schedule+0x29/0x70 [55725.365535] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55725.373049] [] ? __wake_up+0x13/0x20 [55725.378906] [] ? wake_up_atomic_t+0x30/0x30 [55725.385530] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55725.392646] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55725.400984] [] kthread+0xd1/0xe0 [55725.406482] [] ? insert_kthread_work+0x40/0x40 [55725.413335] [] ret_from_fork_nospec_begin+0x21/0x21 [55725.420666] [] ? insert_kthread_work+0x40/0x40 [55725.427504] mdt00_021 S ffff994d6c7c62a0 0 7364 2 0x00000080 [55725.435491] Call Trace: [55725.438251] [] ? _raw_spin_lock_irqsave+0x37/0x40 [55725.445390] [] schedule+0x29/0x70 [55725.451020] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55725.458548] [] ? _raw_spin_lock+0x20/0x30 [55725.464922] [] ? wake_up_atomic_t+0x30/0x30 [55725.471552] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55725.478659] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55725.486967] [] kthread+0xd1/0xe0 [55725.492463] [] ? insert_kthread_work+0x40/0x40 [55725.499296] [] ret_from_fork_nospec_begin+0x21/0x21 [55725.506630] [] ? insert_kthread_work+0x40/0x40 [55725.513466] mdt01_022 S ffff994d6c7c5230 0 7365 2 0x00000080 [55725.521426] Call Trace: [55725.524178] [] ? __set_current_blocked+0x42/0x70 [55725.531217] [] schedule+0x29/0x70 [55725.536855] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55725.544394] [] ? __wake_up+0x13/0x20 [55725.550263] [] ? wake_up_atomic_t+0x30/0x30 [55725.556871] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55725.563985] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55725.572288] [] kthread+0xd1/0xe0 [55725.577779] [] ? insert_kthread_work+0x40/0x40 [55725.584632] [] ret_from_fork_nospec_begin+0x21/0x21 [55725.591948] [] ? insert_kthread_work+0x40/0x40 [55725.598793] ldlm_cn01_014 S ffff994d6a3bd230 0 7680 2 0x00000080 [55725.606759] Call Trace: [55725.609518] [] ? __set_current_blocked+0x42/0x70 [55725.616557] [] schedule+0x29/0x70 [55725.622188] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55725.629730] [] ? __wake_up+0x13/0x20 [55725.635599] [] ? wake_up_atomic_t+0x30/0x30 [55725.642194] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55725.649293] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55725.657588] [] kthread+0xd1/0xe0 [55725.663079] [] ? insert_kthread_work+0x40/0x40 [55725.669917] [] ret_from_fork_nospec_begin+0x21/0x21 [55725.677234] [] ? insert_kthread_work+0x40/0x40 [55725.684074] mdt_rdpg01_014 S ffff994d6a3ba0e0 0 7836 2 0x00000080 [55725.692020] Call Trace: [55725.694787] [] ? __set_current_blocked+0x42/0x70 [55725.701832] [] schedule+0x29/0x70 [55725.707456] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55725.715001] [] ? __wake_up+0x13/0x20 [55725.720907] [] ? wake_up_atomic_t+0x30/0x30 [55725.727542] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55725.734659] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55725.742970] [] kthread+0xd1/0xe0 [55725.748452] [] ? insert_kthread_work+0x40/0x40 [55725.755286] [] ret_from_fork_nospec_begin+0x21/0x21 [55725.762617] [] ? insert_kthread_work+0x40/0x40 [55725.769453] mdt01_023 S ffff99516cace2a0 0 7875 2 0x00000080 [55725.777405] Call Trace: [55725.780160] [] ? _raw_spin_lock_irqsave+0x37/0x40 [55725.787296] [] schedule+0x29/0x70 [55725.792941] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55725.800478] [] ? __wake_up+0x13/0x20 [55725.806349] [] ? wake_up_atomic_t+0x30/0x30 [55725.812977] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55725.820082] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55725.828371] [] kthread+0xd1/0xe0 [55725.833855] [] ? insert_kthread_work+0x40/0x40 [55725.840702] [] ret_from_fork_nospec_begin+0x21/0x21 [55725.848013] [] ? insert_kthread_work+0x40/0x40 [55725.854858] mdt01_024 S ffff99516cacd230 0 7876 2 0x00000080 [55725.862860] Call Trace: [55725.865638] [] ? __set_current_blocked+0x42/0x70 [55725.872677] [] schedule+0x29/0x70 [55725.878319] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55725.885847] [] ? _raw_spin_lock+0x20/0x30 [55725.892200] [] ? wake_up_atomic_t+0x30/0x30 [55725.898819] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55725.905929] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55725.914241] [] kthread+0xd1/0xe0 [55725.919738] [] ? insert_kthread_work+0x40/0x40 [55725.926586] [] ret_from_fork_nospec_begin+0x21/0x21 [55725.933929] [] ? insert_kthread_work+0x40/0x40 [55725.940792] mdt_fld_0002 S ffff994d678a20e0 0 9008 2 0x00000080 [55725.948808] Call Trace: [55725.951560] [] ? __set_current_blocked+0x42/0x70 [55725.958608] [] schedule+0x29/0x70 [55725.964238] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55725.971752] [] ? __wake_up+0x13/0x20 [55725.977624] [] ? wake_up_atomic_t+0x30/0x30 [55725.984243] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55725.991351] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55725.999662] [] kthread+0xd1/0xe0 [55726.005145] [] ? insert_kthread_work+0x40/0x40 [55726.011983] [] ret_from_fork_nospec_begin+0x21/0x21 [55726.019308] [] ? insert_kthread_work+0x40/0x40 [55726.026149] ldlm_cn01_015 S ffff994d6a3c9070 0 9413 2 0x00000080 [55726.034106] Call Trace: [55726.036860] [] ? __set_current_blocked+0x42/0x70 [55726.043944] [] schedule+0x29/0x70 [55726.049593] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55726.057116] [] ? __wake_up+0x13/0x20 [55726.062992] [] ? wake_up_atomic_t+0x30/0x30 [55726.069616] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55726.076722] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55726.085017] [] kthread+0xd1/0xe0 [55726.090516] [] ? insert_kthread_work+0x40/0x40 [55726.097354] [] ret_from_fork_nospec_begin+0x21/0x21 [55726.104684] [] ? insert_kthread_work+0x40/0x40 [55726.111532] ldlm_cn01_016 S ffff994d6a3cd230 0 9414 2 0x00000080 [55726.119529] Call Trace: [55726.122289] [] ? _raw_spin_lock_irqsave+0x37/0x40 [55726.129434] [] schedule+0x29/0x70 [55726.135076] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55726.142599] [] ? __wake_up+0x13/0x20 [55726.148469] [] ? wake_up_atomic_t+0x30/0x30 [55726.155081] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55726.162182] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55726.170495] [] kthread+0xd1/0xe0 [55726.175989] [] ? insert_kthread_work+0x40/0x40 [55726.182837] [] ret_from_fork_nospec_begin+0x21/0x21 [55726.190171] [] ? insert_kthread_work+0x40/0x40 [55726.197008] ldlm_cn01_017 S ffff994d6a3c8000 0 9415 2 0x00000080 [55726.204991] Call Trace: [55726.207745] [] ? __set_current_blocked+0x42/0x70 [55726.214783] [] schedule+0x29/0x70 [55726.220407] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55726.227938] [] ? _raw_spin_lock+0x20/0x30 [55726.234300] [] ? wake_up_atomic_t+0x30/0x30 [55726.240918] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55726.248049] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55726.256344] [] kthread+0xd1/0xe0 [55726.261830] [] ? insert_kthread_work+0x40/0x40 [55726.268686] [] ret_from_fork_nospec_begin+0x21/0x21 [55726.276002] [] ? insert_kthread_work+0x40/0x40 [55726.282871] ldlm_cn01_018 S ffff994d586e1070 0 9567 2 0x00000080 [55726.290872] Call Trace: [55726.293664] [] ? __set_current_blocked+0x42/0x70 [55726.300704] [] schedule+0x29/0x70 [55726.306362] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55726.313927] [] ? wake_up_atomic_t+0x30/0x30 [55726.320555] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55726.327649] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55726.335971] [] kthread+0xd1/0xe0 [55726.341452] [] ? insert_kthread_work+0x40/0x40 [55726.348277] [] ret_from_fork_nospec_begin+0x21/0x21 [55726.355595] [] ? insert_kthread_work+0x40/0x40 [55726.362438] ldlm_cn01_019 S ffff994d586e0000 0 9568 2 0x00000080 [55726.370428] Call Trace: [55726.373180] [] ? __set_current_blocked+0x42/0x70 [55726.380216] [] schedule+0x29/0x70 [55726.385846] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55726.393379] [] ? __wake_up+0x13/0x20 [55726.399250] [] ? wake_up_atomic_t+0x30/0x30 [55726.405879] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55726.412998] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55726.421296] [] kthread+0xd1/0xe0 [55726.426778] [] ? insert_kthread_work+0x40/0x40 [55726.433631] [] ret_from_fork_nospec_begin+0x21/0x21 [55726.440973] [] ? insert_kthread_work+0x40/0x40 [55726.447821] ldlm_cn01_020 S ffff994d586e20e0 0 9573 2 0x00000080 [55726.455813] Call Trace: [55726.458589] [] ? __set_current_blocked+0x42/0x70 [55726.465627] [] schedule+0x29/0x70 [55726.471255] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55726.478770] [] ? __wake_up+0x13/0x20 [55726.484657] [] ? wake_up_atomic_t+0x30/0x30 [55726.491284] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55726.498391] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55726.506694] [] kthread+0xd1/0xe0 [55726.512174] [] ? insert_kthread_work+0x40/0x40 [55726.519013] [] ret_from_fork_nospec_begin+0x21/0x21 [55726.526338] [] ? insert_kthread_work+0x40/0x40 [55726.533184] ldlm_cn01_021 S ffff994d25b38000 0 9574 2 0x00000080 [55726.541139] Call Trace: [55726.543917] [] ? __set_current_blocked+0x42/0x70 [55726.550970] [] schedule+0x29/0x70 [55726.556598] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55726.564113] [] ? __wake_up+0x13/0x20 [55726.569990] [] ? wake_up_atomic_t+0x30/0x30 [55726.576610] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55726.583710] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55726.592016] [] kthread+0xd1/0xe0 [55726.597500] [] ? insert_kthread_work+0x40/0x40 [55726.604324] [] ret_from_fork_nospec_begin+0x21/0x21 [55726.611649] [] ? insert_kthread_work+0x40/0x40 [55726.618495] mdt_io01_009 S ffff995167b51070 0 10527 2 0x00000080 [55726.626477] Call Trace: [55726.629238] [] ? __set_current_blocked+0x42/0x70 [55726.636265] [] schedule+0x29/0x70 [55726.641948] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55726.649467] [] ? __wake_up+0x13/0x20 [55726.655353] [] ? wake_up_atomic_t+0x30/0x30 [55726.661992] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55726.669101] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55726.677395] [] kthread+0xd1/0xe0 [55726.682901] [] ? insert_kthread_work+0x40/0x40 [55726.689740] [] ret_from_fork_nospec_begin+0x21/0x21 [55726.697080] [] ? insert_kthread_work+0x40/0x40 [55726.703942] ldlm_cb01_005 S ffff995167b520e0 0 10530 2 0x00000080 [55726.711918] Call Trace: [55726.714686] [] ? _raw_spin_lock_irqsave+0x37/0x40 [55726.721826] [] schedule+0x29/0x70 [55726.727429] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55726.734960] [] ? wake_up_atomic_t+0x30/0x30 [55726.741587] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55726.748681] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55726.756952] [] kthread+0xd1/0xe0 [55726.762441] [] ? insert_kthread_work+0x40/0x40 [55726.769268] [] ret_from_fork_nospec_begin+0x21/0x21 [55726.776603] [] ? insert_kthread_work+0x40/0x40 [55726.783427] kworker/0:2 S ffff994d6c0b41c0 0 11268 2 0x00000080 [55726.791395] Call Trace: [55726.794139] [] ? process_one_work+0x21a/0x440 [55726.800900] [] schedule+0x29/0x70 [55726.806471] [] worker_thread+0x1d9/0x3c0 [55726.812724] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55726.820038] [] kthread+0xd1/0xe0 [55726.825513] [] ? insert_kthread_work+0x40/0x40 [55726.832330] [] ret_from_fork_nospec_begin+0x21/0x21 [55726.839662] [] ? insert_kthread_work+0x40/0x40 [55726.846514] kworker/u306:1 S ffff99516c9ea0e0 0 12369 2 0x00000080 [55726.854498] Call Trace: [55726.857259] [] ? process_one_work+0x21a/0x440 [55726.864009] [] schedule+0x29/0x70 [55726.869595] [] worker_thread+0x1d9/0x3c0 [55726.875860] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55726.883191] [] kthread+0xd1/0xe0 [55726.888672] [] ? insert_kthread_work+0x40/0x40 [55726.895511] [] ret_from_fork_nospec_begin+0x21/0x21 [55726.902848] [] ? insert_kthread_work+0x40/0x40 [55726.909703] ldlm_cn00_012 S ffff9949759920e0 0 13273 2 0x00000080 [55726.917690] Call Trace: [55726.920455] [] ? __set_current_blocked+0x42/0x70 [55726.927486] [] schedule+0x29/0x70 [55726.933122] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55726.940661] [] ? __wake_up+0x13/0x20 [55726.946525] [] ? wake_up_atomic_t+0x30/0x30 [55726.953133] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55726.960254] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55726.968549] [] kthread+0xd1/0xe0 [55726.974032] [] ? insert_kthread_work+0x40/0x40 [55726.980888] [] ret_from_fork_nospec_begin+0x21/0x21 [55726.988198] [] ? insert_kthread_work+0x40/0x40 [55726.995043] ldlm_cb01_006 S ffff9949759941c0 0 13274 2 0x00000080 [55727.003002] Call Trace: [55727.005773] [] ? __set_current_blocked+0x42/0x70 [55727.012843] [] schedule+0x29/0x70 [55727.018500] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55727.026023] [] ? __wake_up+0x13/0x20 [55727.031914] [] ? wake_up_atomic_t+0x30/0x30 [55727.038537] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55727.045637] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55727.053920] [] kthread+0xd1/0xe0 [55727.059395] [] ? insert_kthread_work+0x40/0x40 [55727.066241] [] ret_from_fork_nospec_begin+0x21/0x21 [55727.073573] [] ? insert_kthread_work+0x40/0x40 [55727.080417] ldlm_cb01_007 S ffff994d69a55230 0 13275 2 0x00000080 [55727.088406] Call Trace: [55727.091157] [] ? _raw_spin_lock_irqsave+0x37/0x40 [55727.098281] [] schedule+0x29/0x70 [55727.103911] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55727.111448] [] ? __wake_up+0x13/0x20 [55727.117319] [] ? wake_up_atomic_t+0x30/0x30 [55727.123916] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55727.131043] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55727.139328] [] kthread+0xd1/0xe0 [55727.144844] [] ? insert_kthread_work+0x40/0x40 [55727.151693] [] ret_from_fork_nospec_begin+0x21/0x21 [55727.159024] [] ? insert_kthread_work+0x40/0x40 [55727.165870] ldlm_cb01_008 S ffff994d25b3e2a0 0 13316 2 0x00000080 [55727.173854] Call Trace: [55727.176628] [] ? __set_current_blocked+0x42/0x70 [55727.183654] [] schedule+0x29/0x70 [55727.189304] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55727.196850] [] ? __wake_up+0x13/0x20 [55727.202739] [] ? wake_up_atomic_t+0x30/0x30 [55727.209367] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55727.216475] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55727.224766] [] kthread+0xd1/0xe0 [55727.230248] [] ? insert_kthread_work+0x40/0x40 [55727.237088] [] ret_from_fork_nospec_begin+0x21/0x21 [55727.244405] [] ? insert_kthread_work+0x40/0x40 [55727.251251] ldlm_cb01_009 S ffff994d6a7ed230 0 13420 2 0x00000080 [55727.259225] Call Trace: [55727.261993] [] ? __set_current_blocked+0x42/0x70 [55727.269035] [] schedule+0x29/0x70 [55727.274683] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55727.282206] [] ? __wake_up+0x13/0x20 [55727.288071] [] ? wake_up_atomic_t+0x30/0x30 [55727.294693] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55727.301810] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55727.310117] [] kthread+0xd1/0xe0 [55727.315594] [] ? insert_kthread_work+0x40/0x40 [55727.322448] [] ret_from_fork_nospec_begin+0x21/0x21 [55727.329817] [] ? insert_kthread_work+0x40/0x40 [55727.336671] ldlm_cb01_010 S ffff994d6a7e8000 0 13421 2 0x00000080 [55727.344690] Call Trace: [55727.347451] [] ? __set_current_blocked+0x42/0x70 [55727.354482] [] schedule+0x29/0x70 [55727.360125] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55727.367663] [] ? __wake_up+0x13/0x20 [55727.373550] [] ? wake_up_atomic_t+0x30/0x30 [55727.380149] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55727.387264] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55727.395554] [] kthread+0xd1/0xe0 [55727.401045] [] ? insert_kthread_work+0x40/0x40 [55727.407896] [] ret_from_fork_nospec_begin+0x21/0x21 [55727.415221] [] ? insert_kthread_work+0x40/0x40 [55727.422068] ldlm_cb00_005 S ffff994d25b3d230 0 13425 2 0x00000080 [55727.430023] Call Trace: [55727.432798] [] ? __set_current_blocked+0x42/0x70 [55727.439860] [] schedule+0x29/0x70 [55727.445518] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55727.453047] [] ? __wake_up+0x13/0x20 [55727.458933] [] ? wake_up_atomic_t+0x30/0x30 [55727.465546] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55727.472651] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55727.480956] [] kthread+0xd1/0xe0 [55727.486445] [] ? insert_kthread_work+0x40/0x40 [55727.493286] [] ret_from_fork_nospec_begin+0x21/0x21 [55727.500611] [] ? insert_kthread_work+0x40/0x40 [55727.507441] ldlm_cb00_006 S ffff994d6b2b0000 0 13555 2 0x00000080 [55727.515417] Call Trace: [55727.518184] [] ? __set_current_blocked+0x42/0x70 [55727.525216] [] schedule+0x29/0x70 [55727.530885] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55727.538434] [] ? __wake_up+0x13/0x20 [55727.544306] [] ? wake_up_atomic_t+0x30/0x30 [55727.550939] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55727.558048] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55727.566353] [] kthread+0xd1/0xe0 [55727.571843] [] ? insert_kthread_work+0x40/0x40 [55727.578691] [] ret_from_fork_nospec_begin+0x21/0x21 [55727.586029] [] ? insert_kthread_work+0x40/0x40 [55727.592895] ldlm_cb00_007 S ffff994d6b2b1070 0 13724 2 0x00000080 [55727.600875] Call Trace: [55727.603635] [] ? __set_current_blocked+0x42/0x70 [55727.610663] [] schedule+0x29/0x70 [55727.616302] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55727.623842] [] ? __wake_up+0x13/0x20 [55727.629727] [] ? wake_up_atomic_t+0x30/0x30 [55727.636315] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55727.643418] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55727.651708] [] kthread+0xd1/0xe0 [55727.657205] [] ? insert_kthread_work+0x40/0x40 [55727.664012] [] ret_from_fork_nospec_begin+0x21/0x21 [55727.671353] [] ? insert_kthread_work+0x40/0x40 [55727.678190] ldlm_bl_07 S ffff994d67aae2a0 0 13872 2 0x00000080 [55727.686156] Call Trace: [55727.688939] [] ? obd_stale_export_get+0x31/0x190 [obdclass] [55727.697033] [] schedule+0x29/0x70 [55727.702691] [] ldlm_bl_thread_main+0x709/0xa00 [ptlrpc] [55727.710378] [] ? wake_up_atomic_t+0x30/0x30 [55727.716964] [] ? ldlm_handle_bl_callback+0x3e0/0x3e0 [ptlrpc] [55727.725235] [] kthread+0xd1/0xe0 [55727.730717] [] ? insert_kthread_work+0x40/0x40 [55727.737528] [] ret_from_fork_nospec_begin+0x21/0x21 [55727.744860] [] ? insert_kthread_work+0x40/0x40 [55727.751690] ldlm_cb01_011 S ffff994975995230 0 13984 2 0x00000080 [55727.759674] Call Trace: [55727.762448] [] ? __set_current_blocked+0x42/0x70 [55727.769447] [] schedule+0x29/0x70 [55727.775064] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55727.782559] [] ? __wake_up+0x13/0x20 [55727.788402] [] ? wake_up_atomic_t+0x30/0x30 [55727.795003] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55727.802070] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55727.810343] [] kthread+0xd1/0xe0 [55727.815800] [] ? insert_kthread_work+0x40/0x40 [55727.822654] [] ret_from_fork_nospec_begin+0x21/0x21 [55727.829972] [] ? insert_kthread_work+0x40/0x40 [55727.836812] mdt00_022 S ffff994d6a7e9070 0 14021 2 0x00000080 [55727.844811] Call Trace: [55727.847578] [] ? __set_current_blocked+0x42/0x70 [55727.854619] [] schedule+0x29/0x70 [55727.860259] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55727.867783] [] ? _raw_spin_lock+0x20/0x30 [55727.874114] [] ? wake_up_atomic_t+0x30/0x30 [55727.880689] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55727.887788] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55727.896060] [] kthread+0xd1/0xe0 [55727.901516] [] ? insert_kthread_work+0x40/0x40 [55727.908328] [] ret_from_fork_nospec_begin+0x21/0x21 [55727.915627] [] ? insert_kthread_work+0x40/0x40 [55727.922438] ldlm_cb00_008 S ffff994d67aa8000 0 14022 2 0x00000080 [55727.930351] Call Trace: [55727.933091] [] schedule+0x29/0x70 [55727.938698] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55727.946193] [] ? __wake_up+0x13/0x20 [55727.952039] [] ? wake_up_atomic_t+0x30/0x30 [55727.958624] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55727.965695] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55727.973966] [] kthread+0xd1/0xe0 [55727.979422] [] ? insert_kthread_work+0x40/0x40 [55727.986234] [] ret_from_fork_nospec_begin+0x21/0x21 [55727.993531] [] ? insert_kthread_work+0x40/0x40 [55728.000343] mdt_out00_007 S ffff995166d71070 0 14102 2 0x00000080 [55728.008252] Call Trace: [55728.010993] [] ? __set_current_blocked+0x42/0x70 [55728.018000] [] schedule+0x29/0x70 [55728.023632] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55728.031181] [] ? _raw_spin_lock+0x20/0x30 [55728.037544] [] ? wake_up_atomic_t+0x30/0x30 [55728.044128] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55728.051227] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55728.059518] [] kthread+0xd1/0xe0 [55728.065000] [] ? insert_kthread_work+0x40/0x40 [55728.071847] [] ret_from_fork_nospec_begin+0x21/0x21 [55728.079145] [] ? insert_kthread_work+0x40/0x40 [55728.085977] ldlm_cb01_012 S ffff995166d70000 0 14176 2 0x00000080 [55728.093938] Call Trace: [55728.096708] [] ? _raw_spin_lock_irqsave+0x37/0x40 [55728.103865] [] schedule+0x29/0x70 [55728.109506] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55728.117003] [] ? __wake_up+0x13/0x20 [55728.122848] [] ? wake_up_atomic_t+0x30/0x30 [55728.129433] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55728.136505] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55728.144774] [] kthread+0xd1/0xe0 [55728.150228] [] ? insert_kthread_work+0x40/0x40 [55728.157041] [] ret_from_fork_nospec_begin+0x21/0x21 [55728.164341] [] ? insert_kthread_work+0x40/0x40 [55728.171151] ldlm_cn01_022 S ffff994ab9e441c0 0 14395 2 0x00000080 [55728.179064] Call Trace: [55728.181816] [] ? _raw_spin_lock_irqsave+0x37/0x40 [55728.188923] [] schedule+0x29/0x70 [55728.194583] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55728.202096] [] ? wake_up_atomic_t+0x30/0x30 [55728.208713] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55728.215849] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55728.224153] [] kthread+0xd1/0xe0 [55728.229650] [] ? insert_kthread_work+0x40/0x40 [55728.236490] [] ret_from_fork_nospec_begin+0x21/0x21 [55728.243813] [] ? insert_kthread_work+0x40/0x40 [55728.250672] ldlm_cn00_013 S ffff994975eae2a0 0 15241 2 0x00000080 [55728.258671] Call Trace: [55728.261431] [] ? __set_current_blocked+0x42/0x70 [55728.268465] [] schedule+0x29/0x70 [55728.274111] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55728.281640] [] ? __wake_up+0x13/0x20 [55728.287526] [] ? wake_up_atomic_t+0x30/0x30 [55728.294146] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55728.301247] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55728.309559] [] kthread+0xd1/0xe0 [55728.315041] [] ? insert_kthread_work+0x40/0x40 [55728.321881] [] ret_from_fork_nospec_begin+0x21/0x21 [55728.329213] [] ? insert_kthread_work+0x40/0x40 [55728.336055] ldlm_cn00_014 S ffff995166d741c0 0 15242 2 0x00000080 [55728.344018] Call Trace: [55728.346809] [] ? __set_current_blocked+0x42/0x70 [55728.353858] [] schedule+0x29/0x70 [55728.359509] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55728.367031] [] ? __wake_up+0x13/0x20 [55728.372902] [] ? wake_up_atomic_t+0x30/0x30 [55728.379514] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55728.386620] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55728.394919] [] kthread+0xd1/0xe0 [55728.400417] [] ? insert_kthread_work+0x40/0x40 [55728.407259] [] ret_from_fork_nospec_begin+0x21/0x21 [55728.414590] [] ? insert_kthread_work+0x40/0x40 [55728.421443] ldlm_cn00_015 S ffff995166d75230 0 15243 2 0x00000080 [55728.429450] Call Trace: [55728.432216] [] schedule+0x29/0x70 [55728.437884] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55728.445383] [] ? _raw_spin_lock+0x20/0x30 [55728.451754] [] ? wake_up_atomic_t+0x30/0x30 [55728.458381] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55728.465490] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55728.473801] [] kthread+0xd1/0xe0 [55728.479305] [] ? insert_kthread_work+0x40/0x40 [55728.486153] [] ret_from_fork_nospec_begin+0x21/0x21 [55728.493486] [] ? insert_kthread_work+0x40/0x40 [55728.500322] ldlm_cn00_016 S ffff995166d73150 0 15244 2 0x00000080 [55728.508291] Call Trace: [55728.511050] [] schedule+0x29/0x70 [55728.516698] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55728.524221] [] ? _raw_spin_lock+0x20/0x30 [55728.530583] [] ? wake_up_atomic_t+0x30/0x30 [55728.537193] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55728.544302] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55728.552607] [] kthread+0xd1/0xe0 [55728.558060] [] ? insert_kthread_work+0x40/0x40 [55728.564908] [] ret_from_fork_nospec_begin+0x21/0x21 [55728.572226] [] ? insert_kthread_work+0x40/0x40 [55728.579065] ldlm_cn00_017 S ffff995166d762a0 0 15245 2 0x00000080 [55728.587029] Call Trace: [55728.589799] [] ? _raw_spin_lock_irqsave+0x37/0x40 [55728.596944] [] schedule+0x29/0x70 [55728.602594] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55728.610126] [] ? __wake_up+0x13/0x20 [55728.616011] [] ? wake_up_atomic_t+0x30/0x30 [55728.622631] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55728.629733] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55728.638029] [] kthread+0xd1/0xe0 [55728.643486] [] ? insert_kthread_work+0x40/0x40 [55728.650341] [] ret_from_fork_nospec_begin+0x21/0x21 [55728.657671] [] ? insert_kthread_work+0x40/0x40 [55728.664505] ldlm_cn00_018 S ffff995166d720e0 0 15246 2 0x00000080 [55728.672502] Call Trace: [55728.675276] [] ? _raw_spin_lock_irqsave+0x37/0x40 [55728.682403] [] schedule+0x29/0x70 [55728.688033] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55728.695577] [] ? _raw_spin_lock+0x20/0x30 [55728.701927] [] ? wake_up_atomic_t+0x30/0x30 [55728.708540] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55728.715641] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55728.723918] [] kthread+0xd1/0xe0 [55728.729411] [] ? insert_kthread_work+0x40/0x40 [55728.736258] [] ret_from_fork_nospec_begin+0x21/0x21 [55728.743556] [] ? insert_kthread_work+0x40/0x40 [55728.750367] ldlm_cn00_019 S ffff99516cb562a0 0 15247 2 0x00000080 [55728.758280] Call Trace: [55728.761022] [] ? __set_current_blocked+0x42/0x70 [55728.768062] [] schedule+0x29/0x70 [55728.773716] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55728.781240] [] ? _raw_spin_lock+0x20/0x30 [55728.787589] [] ? wake_up_atomic_t+0x30/0x30 [55728.794204] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55728.801293] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55728.809565] [] kthread+0xd1/0xe0 [55728.815019] [] ? insert_kthread_work+0x40/0x40 [55728.821859] [] ret_from_fork_nospec_begin+0x21/0x21 [55728.829157] [] ? insert_kthread_work+0x40/0x40 [55728.835973] mdt_out00_008 S ffff99516cb55230 0 15248 2 0x00000080 [55728.843890] Call Trace: [55728.846630] [] ? _raw_spin_lock_irqsave+0x37/0x40 [55728.853773] [] schedule+0x29/0x70 [55728.859418] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55728.866950] [] ? __wake_up+0x13/0x20 [55728.872825] [] ? wake_up_atomic_t+0x30/0x30 [55728.879452] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55728.886558] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55728.894831] [] kthread+0xd1/0xe0 [55728.900286] [] ? insert_kthread_work+0x40/0x40 [55728.907099] [] ret_from_fork_nospec_begin+0x21/0x21 [55728.914397] [] ? insert_kthread_work+0x40/0x40 [55728.921208] mdt_out00_009 S ffff99516cb541c0 0 15354 2 0x00000080 [55728.929119] Call Trace: [55728.931861] [] ? _raw_spin_lock_irqsave+0x37/0x40 [55728.938965] [] schedule+0x29/0x70 [55728.944581] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55728.952076] [] ? __wake_up+0x13/0x20 [55728.957921] [] ? wake_up_atomic_t+0x30/0x30 [55728.964494] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55728.971567] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55728.979849] [] kthread+0xd1/0xe0 [55728.985305] [] ? insert_kthread_work+0x40/0x40 [55728.992121] [] ret_from_fork_nospec_begin+0x21/0x21 [55728.999417] [] ? insert_kthread_work+0x40/0x40 [55729.006220] ldlm_cn00_020 S ffff99516836e2a0 0 15355 2 0x00000080 [55729.014133] Call Trace: [55729.016874] [] ? __set_current_blocked+0x42/0x70 [55729.023880] [] schedule+0x29/0x70 [55729.029495] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55729.036991] [] ? __wake_up+0x13/0x20 [55729.042835] [] ? wake_up_atomic_t+0x30/0x30 [55729.049422] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55729.056495] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55729.064809] [] kthread+0xd1/0xe0 [55729.070265] [] ? insert_kthread_work+0x40/0x40 [55729.077106] [] ret_from_fork_nospec_begin+0x21/0x21 [55729.084404] [] ? insert_kthread_work+0x40/0x40 [55729.091229] ldlm_cn00_021 S ffff995169cc3150 0 15356 2 0x00000080 [55729.099157] Call Trace: [55729.101898] [] schedule+0x29/0x70 [55729.107515] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55729.115046] [] ? __wake_up+0x13/0x20 [55729.120918] [] ? wake_up_atomic_t+0x30/0x30 [55729.127518] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55729.134608] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55729.142913] [] kthread+0xd1/0xe0 [55729.148391] [] ? insert_kthread_work+0x40/0x40 [55729.155205] [] ret_from_fork_nospec_begin+0x21/0x21 [55729.162501] [] ? insert_kthread_work+0x40/0x40 [55729.169306] mdt_out00_010 S ffff995169cc41c0 0 15393 2 0x00000080 [55729.177217] Call Trace: [55729.179957] [] ? __set_current_blocked+0x42/0x70 [55729.186961] [] schedule+0x29/0x70 [55729.192578] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55729.200073] [] ? __wake_up+0x13/0x20 [55729.205918] [] ? wake_up_atomic_t+0x30/0x30 [55729.212531] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55729.219620] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55729.227910] [] kthread+0xd1/0xe0 [55729.233399] [] ? insert_kthread_work+0x40/0x40 [55729.240247] [] ret_from_fork_nospec_begin+0x21/0x21 [55729.247586] [] ? insert_kthread_work+0x40/0x40 [55729.254426] ldlm_cn00_022 S ffff995169cc20e0 0 15541 2 0x00000080 [55729.262416] Call Trace: [55729.265192] [] ? __set_current_blocked+0x42/0x70 [55729.272241] [] schedule+0x29/0x70 [55729.277884] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55729.285414] [] ? __wake_up+0x13/0x20 [55729.291280] [] ? wake_up_atomic_t+0x30/0x30 [55729.297891] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55729.304954] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55729.313272] [] kthread+0xd1/0xe0 [55729.318741] [] ? insert_kthread_work+0x40/0x40 [55729.325588] [] ret_from_fork_nospec_begin+0x21/0x21 [55729.332884] [] ? insert_kthread_work+0x40/0x40 [55729.339725] mdt_out00_011 S ffff995169cc5230 0 15542 2 0x00000080 [55729.347696] Call Trace: [55729.350457] [] ? __set_current_blocked+0x42/0x70 [55729.357505] [] schedule+0x29/0x70 [55729.363150] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55729.370700] [] ? __wake_up+0x13/0x20 [55729.376579] [] ? wake_up_atomic_t+0x30/0x30 [55729.383196] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55729.390285] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55729.398590] [] kthread+0xd1/0xe0 [55729.404073] [] ? insert_kthread_work+0x40/0x40 [55729.410914] [] ret_from_fork_nospec_begin+0x21/0x21 [55729.418253] [] ? insert_kthread_work+0x40/0x40 [55729.425091] mdt_out00_012 S ffff995169cc0000 0 15544 2 0x00000080 [55729.433029] Call Trace: [55729.435796] [] ? __set_current_blocked+0x42/0x70 [55729.442836] [] schedule+0x29/0x70 [55729.448485] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55729.456008] [] ? __wake_up+0x13/0x20 [55729.461880] [] ? wake_up_atomic_t+0x30/0x30 [55729.468500] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55729.475597] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55729.483889] [] kthread+0xd1/0xe0 [55729.489387] [] ? insert_kthread_work+0x40/0x40 [55729.496235] [] ret_from_fork_nospec_begin+0x21/0x21 [55729.503567] [] ? insert_kthread_work+0x40/0x40 [55729.510420] mdt_out00_013 S ffff995141328000 0 15546 2 0x00000080 [55729.518382] Call Trace: [55729.521152] [] ? __set_current_blocked+0x42/0x70 [55729.528201] [] schedule+0x29/0x70 [55729.533860] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55729.541388] [] ? __wake_up+0x13/0x20 [55729.547260] [] ? wake_up_atomic_t+0x30/0x30 [55729.553872] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55729.560980] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55729.569292] [] kthread+0xd1/0xe0 [55729.574797] [] ? insert_kthread_work+0x40/0x40 [55729.581661] [] ret_from_fork_nospec_begin+0x21/0x21 [55729.588993] [] ? insert_kthread_work+0x40/0x40 [55729.595823] mdt_out00_014 S ffff99516915d230 0 15547 2 0x00000080 [55729.603792] Call Trace: [55729.606553] [] ? __set_current_blocked+0x42/0x70 [55729.613587] [] schedule+0x29/0x70 [55729.619225] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55729.626775] [] ? __wake_up+0x13/0x20 [55729.632678] [] ? wake_up_atomic_t+0x30/0x30 [55729.639297] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55729.646375] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55729.654723] [] kthread+0xd1/0xe0 [55729.660219] [] ? insert_kthread_work+0x40/0x40 [55729.667057] [] ret_from_fork_nospec_begin+0x21/0x21 [55729.674389] [] ? insert_kthread_work+0x40/0x40 [55729.681220] mdt_out00_015 S ffff99516915c1c0 0 15696 2 0x00000080 [55729.689186] Call Trace: [55729.691945] [] schedule+0x29/0x70 [55729.697603] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55729.705126] [] ? __wake_up+0x13/0x20 [55729.710999] [] ? wake_up_atomic_t+0x30/0x30 [55729.717615] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55729.724762] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55729.733058] [] kthread+0xd1/0xe0 [55729.738556] [] ? insert_kthread_work+0x40/0x40 [55729.745408] [] ret_from_fork_nospec_begin+0x21/0x21 [55729.752750] [] ? insert_kthread_work+0x40/0x40 [55729.759584] mdt_out00_016 S ffff995165efe2a0 0 15697 2 0x00000080 [55729.767585] Call Trace: [55729.770351] [] ? _raw_spin_lock_irqsave+0x37/0x40 [55729.777499] [] schedule+0x29/0x70 [55729.783142] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55729.790689] [] ? __wake_up+0x13/0x20 [55729.796566] [] ? wake_up_atomic_t+0x30/0x30 [55729.803179] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55729.810279] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55729.818584] [] kthread+0xd1/0xe0 [55729.824076] [] ? insert_kthread_work+0x40/0x40 [55729.830922] [] ret_from_fork_nospec_begin+0x21/0x21 [55729.838253] [] ? insert_kthread_work+0x40/0x40 [55729.845081] ldlm_cn00_023 S ffff99516c9ec1c0 0 16144 2 0x00000080 [55729.853041] Call Trace: [55729.855801] [] ? __set_current_blocked+0x42/0x70 [55729.862832] [] schedule+0x29/0x70 [55729.868447] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55729.875965] [] ? _raw_spin_lock+0x20/0x30 [55729.882329] [] ? wake_up_atomic_t+0x30/0x30 [55729.888948] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55729.896062] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55729.904366] [] kthread+0xd1/0xe0 [55729.909852] [] ? insert_kthread_work+0x40/0x40 [55729.916683] [] ret_from_fork_nospec_begin+0x21/0x21 [55729.924012] [] ? insert_kthread_work+0x40/0x40 [55729.930849] ldlm_cn00_024 S ffff99516c9eb150 0 16145 2 0x00000080 [55729.938787] Call Trace: [55729.941551] [] ? _raw_spin_lock_irqsave+0x37/0x40 [55729.948684] [] schedule+0x29/0x70 [55729.954330] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55729.961843] [] ? __wake_up+0x13/0x20 [55729.967727] [] ? wake_up_atomic_t+0x30/0x30 [55729.974353] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55729.981458] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55729.989762] [] kthread+0xd1/0xe0 [55729.995261] [] ? insert_kthread_work+0x40/0x40 [55730.002100] [] ret_from_fork_nospec_begin+0x21/0x21 [55730.009425] [] ? insert_kthread_work+0x40/0x40 [55730.016277] mdt_out00_017 S ffff995165efd230 0 16439 2 0x00000080 [55730.024267] Call Trace: [55730.027032] [] ? __set_current_blocked+0x42/0x70 [55730.034058] [] schedule+0x29/0x70 [55730.039726] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55730.047248] [] ? __wake_up+0x13/0x20 [55730.053119] [] ? wake_up_atomic_t+0x30/0x30 [55730.059720] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55730.066821] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55730.075123] [] kthread+0xd1/0xe0 [55730.080634] [] ? insert_kthread_work+0x40/0x40 [55730.087488] [] ret_from_fork_nospec_begin+0x21/0x21 [55730.094811] [] ? insert_kthread_work+0x40/0x40 [55730.101653] ldlm_cn00_025 S ffff995165efa0e0 0 16738 2 0x00000080 [55730.109653] Call Trace: [55730.112428] [] ? __set_current_blocked+0x42/0x70 [55730.119448] [] schedule+0x29/0x70 [55730.125092] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55730.132644] [] ? _raw_spin_lock+0x20/0x30 [55730.139013] [] ? wake_up_atomic_t+0x30/0x30 [55730.145643] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55730.152752] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55730.161050] [] kthread+0xd1/0xe0 [55730.166541] [] ? insert_kthread_work+0x40/0x40 [55730.173399] [] ret_from_fork_nospec_begin+0x21/0x21 [55730.180727] [] ? insert_kthread_work+0x40/0x40 [55730.187566] mdt_out00_018 S ffff994d05639070 0 16887 2 0x00000080 [55730.195537] Call Trace: [55730.198312] [] ? __set_current_blocked+0x42/0x70 [55730.205345] [] schedule+0x29/0x70 [55730.210994] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [55730.218517] [] ? __wake_up+0x13/0x20 [55730.224402] [] ? wake_up_atomic_t+0x30/0x30 [55730.231014] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [55730.238088] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [55730.246404] [] kthread+0xd1/0xe0 [55730.251881] [] ? insert_kthread_work+0x40/0x40 [55730.258721] [] ret_from_fork_nospec_begin+0x21/0x21 [55730.266051] [] ? insert_kthread_work+0x40/0x40 [55730.272897] kworker/u305:1 S ffff994d678a62a0 0 17930 2 0x00000080 [55730.280871] Call Trace: [55730.283660] [] ? start_worker+0x27/0x30 [55730.289842] [] ? manage_workers.isra.26+0x189/0x2a0 [55730.297172] [] schedule+0x29/0x70 [55730.302754] [] worker_thread+0x1d9/0x3c0 [55730.309019] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55730.316335] [] kthread+0xd1/0xe0 [55730.321817] [] ? insert_kthread_work+0x40/0x40 [55730.328673] [] ret_from_fork_nospec_begin+0x21/0x21 [55730.336003] [] ? insert_kthread_work+0x40/0x40 [55730.342848] ldlm_bl_08 S ffff9951696cd230 0 20243 2 0x00000080 [55730.350807] Call Trace: [55730.353641] [] ? obd_stale_export_get+0x31/0x190 [obdclass] [55730.361745] [] schedule+0x29/0x70 [55730.367404] [] ldlm_bl_thread_main+0x709/0xa00 [ptlrpc] [55730.375119] [] ? wake_up_atomic_t+0x30/0x30 [55730.381749] [] ? ldlm_handle_bl_callback+0x3e0/0x3e0 [ptlrpc] [55730.390046] [] kthread+0xd1/0xe0 [55730.395522] [] ? insert_kthread_work+0x40/0x40 [55730.402376] [] ret_from_fork_nospec_begin+0x21/0x21 [55730.409707] [] ? insert_kthread_work+0x40/0x40 [55730.416553] kworker/27:2 S ffff9951675a41c0 0 36484 2 0x00000080 [55730.424553] Call Trace: [55730.427321] [] ? process_one_work+0x336/0x440 [55730.434065] [] schedule+0x29/0x70 [55730.439650] [] worker_thread+0x1d9/0x3c0 [55730.445910] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55730.453233] [] kthread+0xd1/0xe0 [55730.458730] [] ? insert_kthread_work+0x40/0x40 [55730.465601] [] ret_from_fork_nospec_begin+0x21/0x21 [55730.472930] [] ? insert_kthread_work+0x40/0x40 [55730.479767] kworker/28:2 S ffff99516703d230 0 43111 2 0x00000080 [55730.487753] Call Trace: [55730.490520] [] ? process_one_work+0x336/0x440 [55730.497278] [] schedule+0x29/0x70 [55730.502850] [] worker_thread+0x1d9/0x3c0 [55730.509095] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55730.516412] [] kthread+0xd1/0xe0 [55730.521902] [] ? insert_kthread_work+0x40/0x40 [55730.528743] [] ret_from_fork_nospec_begin+0x21/0x21 [55730.536075] [] ? insert_kthread_work+0x40/0x40 [55730.542899] kworker/7:2 S ffff994cf8ed8000 0 55107 2 0x00000080 [55730.550857] Call Trace: [55730.553622] [] ? process_one_work+0x21a/0x440 [55730.560377] [] schedule+0x29/0x70 [55730.565953] [] worker_thread+0x1d9/0x3c0 [55730.572213] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55730.579531] [] kthread+0xd1/0xe0 [55730.585023] [] ? insert_kthread_work+0x40/0x40 [55730.591868] [] ret_from_fork_nospec_begin+0x21/0x21 [55730.599199] [] ? insert_kthread_work+0x40/0x40 [55730.606038] kworker/30:0 S ffff99516703a0e0 0 62917 2 0x00000080 [55730.614027] Call Trace: [55730.616795] [] ? process_one_work+0x336/0x440 [55730.623543] [] schedule+0x29/0x70 [55730.629138] [] worker_thread+0x1d9/0x3c0 [55730.635397] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55730.642715] [] kthread+0xd1/0xe0 [55730.648173] [] ? insert_kthread_work+0x40/0x40 [55730.655027] [] ret_from_fork_nospec_begin+0x21/0x21 [55730.662359] [] ? insert_kthread_work+0x40/0x40 [55730.669197] kworker/1:2 S ffff994ab96320e0 0 65913 2 0x00000080 [55730.677184] Call Trace: [55730.679951] [] schedule+0x29/0x70 [55730.685540] [] worker_thread+0x1d9/0x3c0 [55730.691799] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55730.699116] [] kthread+0xd1/0xe0 [55730.704631] [] ? insert_kthread_work+0x40/0x40 [55730.711499] [] ret_from_fork_nospec_begin+0x21/0x21 [55730.718830] [] ? insert_kthread_work+0x40/0x40 [55730.725690] kworker/25:0 S ffff995167915230 0 69540 2 0x00000080 [55730.733675] Call Trace: [55730.736450] [] schedule+0x29/0x70 [55730.742023] [] worker_thread+0x1d9/0x3c0 [55730.748289] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55730.755624] [] kthread+0xd1/0xe0 [55730.761111] [] ? insert_kthread_work+0x40/0x40 [55730.767958] [] ret_from_fork_nospec_begin+0x21/0x21 [55730.775289] [] ? insert_kthread_work+0x40/0x40 [55730.782116] kworker/22:1 S ffff994cf3a8b150 0 80536 2 0x00000080 [55730.790104] Call Trace: [55730.792877] [] schedule+0x29/0x70 [55730.798464] [] worker_thread+0x1d9/0x3c0 [55730.804730] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55730.812048] [] kthread+0xd1/0xe0 [55730.817531] [] ? insert_kthread_work+0x40/0x40 [55730.824363] [] ret_from_fork_nospec_begin+0x21/0x21 [55730.831687] [] ? insert_kthread_work+0x40/0x40 [55730.838516] kworker/u305:2 S ffff994cf3a88000 0 81272 2 0x00000080 [55730.846499] Call Trace: [55730.849274] [] ? __call_usermodehelper+0x4e/0x90 [55730.856310] [] ? process_one_work+0x21a/0x440 [55730.863053] [] schedule+0x29/0x70 [55730.868652] [] worker_thread+0x1d9/0x3c0 [55730.874907] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55730.882245] [] kthread+0xd1/0xe0 [55730.887727] [] ? insert_kthread_work+0x40/0x40 [55730.894581] [] ret_from_fork_nospec_begin+0x21/0x21 [55730.901911] [] ? insert_kthread_work+0x40/0x40 [55730.908750] kworker/4:0 S ffff994d678a5230 0 86138 2 0x00000080 [55730.916710] Call Trace: [55730.919484] [] schedule+0x29/0x70 [55730.925071] [] worker_thread+0x1d9/0x3c0 [55730.931329] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55730.938667] [] kthread+0xd1/0xe0 [55730.944142] [] ? insert_kthread_work+0x40/0x40 [55730.950982] [] ret_from_fork_nospec_begin+0x21/0x21 [55730.958314] [] ? insert_kthread_work+0x40/0x40 [55730.965141] kworker/3:0 S ffff994ab9539070 0 87234 2 0x00000080 [55730.973140] Call Trace: [55730.975913] [] schedule+0x29/0x70 [55730.981500] [] worker_thread+0x1d9/0x3c0 [55730.987761] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55730.995091] [] kthread+0xd1/0xe0 [55731.000580] [] ? insert_kthread_work+0x40/0x40 [55731.007442] [] ret_from_fork_nospec_begin+0x21/0x21 [55731.014774] [] ? insert_kthread_work+0x40/0x40 [55731.021607] kworker/6:0 S ffff994cf3a8d230 0 87861 2 0x00000080 [55731.029598] Call Trace: [55731.032364] [] schedule+0x29/0x70 [55731.037930] [] worker_thread+0x1d9/0x3c0 [55731.044180] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55731.051505] [] kthread+0xd1/0xe0 [55731.056990] [] ? insert_kthread_work+0x40/0x40 [55731.063828] [] ret_from_fork_nospec_begin+0x21/0x21 [55731.071167] [] ? insert_kthread_work+0x40/0x40 [55731.078005] kworker/19:1 S ffff9949e783b150 0 90654 2 0x00000080 [55731.085977] Call Trace: [55731.088746] [] ? start_worker+0x27/0x30 [55731.094910] [] ? manage_workers.isra.26+0x189/0x2a0 [55731.102239] [] schedule+0x29/0x70 [55731.107812] [] worker_thread+0x1d9/0x3c0 [55731.114070] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55731.121401] [] kthread+0xd1/0xe0 [55731.126883] [] ? insert_kthread_work+0x40/0x40 [55731.133722] [] ret_from_fork_nospec_begin+0x21/0x21 [55731.141045] [] ? insert_kthread_work+0x40/0x40 [55731.147877] kworker/18:2 S ffff9949e6e362a0 0 92656 2 0x00000080 [55731.155829] Call Trace: [55731.158598] [] ? process_one_work+0x336/0x440 [55731.165366] [] schedule+0x29/0x70 [55731.170952] [] worker_thread+0x1d9/0x3c0 [55731.177217] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55731.184534] [] kthread+0xd1/0xe0 [55731.190037] [] ? insert_kthread_work+0x40/0x40 [55731.196876] [] ret_from_fork_nospec_begin+0x21/0x21 [55731.204200] [] ? insert_kthread_work+0x40/0x40 [55731.211035] kworker/u304:1 S ffff9949e6e30000 0 92773 2 0x00000080 [55731.219007] Call Trace: [55731.221768] [] ? process_one_work+0x21a/0x440 [55731.228506] [] schedule+0x29/0x70 [55731.234099] [] worker_thread+0x1d9/0x3c0 [55731.240372] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55731.247698] [] kthread+0xd1/0xe0 [55731.253178] [] ? insert_kthread_work+0x40/0x40 [55731.260003] [] ret_from_fork_nospec_begin+0x21/0x21 [55731.267328] [] ? insert_kthread_work+0x40/0x40 [55731.274160] kworker/19:0 S ffff9949e6e31070 0 93708 2 0x00000080 [55731.282158] Call Trace: [55731.284927] [] ? process_one_work+0x21a/0x440 [55731.291667] [] schedule+0x29/0x70 [55731.297252] [] worker_thread+0x1d9/0x3c0 [55731.303509] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55731.310841] [] kthread+0xd1/0xe0 [55731.316329] [] ? insert_kthread_work+0x40/0x40 [55731.323158] [] ret_from_fork_nospec_begin+0x21/0x21 [55731.330473] [] ? insert_kthread_work+0x40/0x40 [55731.337317] kworker/7:0 S ffff9949e6e341c0 0 93793 2 0x00000080 [55731.345292] Call Trace: [55731.348046] [] schedule+0x29/0x70 [55731.353652] [] worker_thread+0x1d9/0x3c0 [55731.359918] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55731.367247] [] kthread+0xd1/0xe0 [55731.372731] [] ? insert_kthread_work+0x40/0x40 [55731.379575] [] ret_from_fork_nospec_begin+0x21/0x21 [55731.386891] [] ? insert_kthread_work+0x40/0x40 [55731.393738] kworker/2:1 S ffff994d6b2341c0 0 94141 2 0x00000080 [55731.401694] Call Trace: [55731.404454] [] schedule+0x29/0x70 [55731.410042] [] worker_thread+0x1d9/0x3c0 [55731.416308] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55731.423654] [] kthread+0xd1/0xe0 [55731.429143] [] ? insert_kthread_work+0x40/0x40 [55731.435975] [] ret_from_fork_nospec_begin+0x21/0x21 [55731.443304] [] ? insert_kthread_work+0x40/0x40 [55731.450143] kworker/5:0 S ffff994cf3a8c1c0 0 94181 2 0x00000080 [55731.458122] Call Trace: [55731.460864] [] schedule+0x29/0x70 [55731.466445] [] worker_thread+0x1d9/0x3c0 [55731.472704] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55731.480028] [] kthread+0xd1/0xe0 [55731.485539] [] ? insert_kthread_work+0x40/0x40 [55731.492380] [] ret_from_fork_nospec_begin+0x21/0x21 [55731.499690] [] ? insert_kthread_work+0x40/0x40 [55731.506560] pickup S ffff99514ebd41c0 0 94342 3230 0x00000080 [55731.514548] Call Trace: [55731.517328] [] schedule+0x29/0x70 [55731.522914] [] schedule_hrtimeout_range_clock+0xb2/0x150 [55731.530715] [] ? hrtimer_get_res+0x50/0x50 [55731.537165] [] ? schedule_hrtimeout_range_clock+0xa6/0x150 [55731.545182] [] schedule_hrtimeout_range+0x13/0x20 [55731.552315] [] ep_poll+0x23e/0x360 [55731.558000] [] ? wake_up_state+0x20/0x20 [55731.564256] [] SyS_epoll_wait+0xed/0x120 [55731.570521] [] ? system_call_after_swapgs+0xa2/0x146 [55731.577944] [] system_call_fastpath+0x25/0x2a [55731.584686] [] ? system_call_after_swapgs+0xae/0x146 [55731.592112] kworker/29:2 S ffff99514ebd5230 0 94877 2 0x00000080 [55731.600083] Call Trace: [55731.602851] [] ? process_one_work+0x336/0x440 [55731.609601] [] schedule+0x29/0x70 [55731.615201] [] worker_thread+0x1d9/0x3c0 [55731.621467] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55731.628794] [] kthread+0xd1/0xe0 [55731.634280] [] ? insert_kthread_work+0x40/0x40 [55731.641125] [] ret_from_fork_nospec_begin+0x21/0x21 [55731.648425] [] ? insert_kthread_work+0x40/0x40 [55731.655278] kworker/0:1 S ffff994d585f62a0 0 95067 2 0x00000080 [55731.663244] Call Trace: [55731.666013] [] ? process_one_work+0x21a/0x440 [55731.672764] [] schedule+0x29/0x70 [55731.678351] [] worker_thread+0x1d9/0x3c0 [55731.684633] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55731.691956] [] kthread+0xd1/0xe0 [55731.697446] [] ? insert_kthread_work+0x40/0x40 [55731.704293] [] ret_from_fork_nospec_begin+0x21/0x21 [55731.711629] [] ? insert_kthread_work+0x40/0x40 [55731.718467] kworker/u304:4 S ffff99514ebd0000 0 95456 2 0x00000080 [55731.726448] Call Trace: [55731.729215] [] ? process_one_work+0x21a/0x440 [55731.735950] [] schedule+0x29/0x70 [55731.741566] [] worker_thread+0x1d9/0x3c0 [55731.747837] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55731.755163] [] kthread+0xd1/0xe0 [55731.760645] [] ? insert_kthread_work+0x40/0x40 [55731.767496] [] ret_from_fork_nospec_begin+0x21/0x21 [55731.774821] [] ? insert_kthread_work+0x40/0x40 [55731.781655] kworker/19:2 S ffff994d6cd78000 0 95833 2 0x00000080 [55731.789621] Call Trace: [55731.792397] [] ? process_one_work+0x21a/0x440 [55731.799141] [] schedule+0x29/0x70 [55731.804727] [] worker_thread+0x1d9/0x3c0 [55731.810975] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55731.818306] [] kthread+0xd1/0xe0 [55731.823787] [] ? insert_kthread_work+0x40/0x40 [55731.830633] [] ret_from_fork_nospec_begin+0x21/0x21 [55731.837950] [] ? insert_kthread_work+0x40/0x40 [55731.844784] kworker/u304:0 S ffff99514ebd1070 0 95930 2 0x00000080 [55731.852746] Call Trace: [55731.855527] [] ? process_one_work+0x21a/0x440 [55731.862276] [] schedule+0x29/0x70 [55731.867840] [] worker_thread+0x1d9/0x3c0 [55731.874106] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55731.881436] [] kthread+0xd1/0xe0 [55731.886920] [] ? insert_kthread_work+0x40/0x40 [55731.893737] [] ret_from_fork_nospec_begin+0x21/0x21 [55731.901076] [] ? insert_kthread_work+0x40/0x40 [55731.907898] kworker/26:0 S ffff99514ebd62a0 0 95971 2 0x00000080 [55731.915865] Call Trace: [55731.918619] [] ? process_one_work+0x336/0x440 [55731.925362] [] schedule+0x29/0x70 [55731.930958] [] worker_thread+0x1d9/0x3c0 [55731.937231] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55731.944574] [] kthread+0xd1/0xe0 [55731.950070] [] ? insert_kthread_work+0x40/0x40 [55731.956916] [] ret_from_fork_nospec_begin+0x21/0x21 [55731.964234] [] ? insert_kthread_work+0x40/0x40 [55731.971063] sshd D ffff994d6c8120e0 0 96243 2957 0x00000080 [55731.979043] Call Trace: [55731.981803] [] ? account_entity_dequeue+0xae/0xd0 [55731.988933] [] schedule+0x29/0x70 [55731.994572] [] schedule_timeout+0x221/0x2d0 [55732.001137] [] ? __switch_to+0x151/0x580 [55732.007402] [] ? try_to_wake_up+0x190/0x390 [55732.013950] [] wait_for_completion+0xfd/0x140 [55732.020688] [] ? wake_up_state+0x20/0x20 [55732.026937] [] flush_work+0x10a/0x1b0 [55732.032912] [] ? move_linked_works+0x90/0x90 [55732.039573] [] tty_flush_to_ldisc+0x15/0x20 [55732.046133] [] n_tty_poll+0x6d/0x1d0 [55732.051990] [] tty_poll+0x75/0x90 [55732.057586] [] do_select+0x3a8/0x7c0 [55732.063472] [] ? get_target_pstate_use_performance+0x8f/0xc0 [55732.071701] [] ? __pollwait+0xf0/0xf0 [55732.077647] [] ? __pollwait+0xf0/0xf0 [55732.083610] [] ? __pollwait+0xf0/0xf0 [55732.089597] [] ? __pollwait+0xf0/0xf0 [55732.095582] [] ? tracing_is_on+0x15/0x30 [55732.101832] [] ? tracing_record_cmdline+0x1d/0x120 [55732.109063] [] ? probe_sched_wakeup+0x2b/0xa0 [55732.115791] [] ? ttwu_do_wakeup+0xb5/0xe0 [55732.122151] [] ? try_to_wake_up+0x190/0x390 [55732.128708] [] ? default_wake_function+0x12/0x20 [55732.135741] [] ? __wake_up_common+0x82/0x120 [55732.142385] [] ? __wake_up_common_lock+0x91/0xc0 [55732.149426] [] core_sys_select+0x1ff/0x340 [55732.155879] [] ? task_rq_unlock+0x20/0x20 [55732.162242] [] ? __wake_up+0x13/0x20 [55732.168119] [] ? tty_write_unlock+0x31/0x40 [55732.174667] [] ? tty_ldisc_deref+0x19/0x20 [55732.181126] [] ? tty_write+0x1eb/0x2c0 [55732.187183] [] ? n_tty_ioctl+0x100/0x100 [55732.193448] [] SyS_select+0xca/0x120 [55732.199333] [] ? system_call_after_swapgs+0xa2/0x146 [55732.206763] [] ? system_call_after_swapgs+0xae/0x146 [55732.214191] [] ? system_call_after_swapgs+0xa2/0x146 [55732.221602] [] ? system_call_after_swapgs+0xae/0x146 [55732.229024] [] system_call_fastpath+0x25/0x2a [55732.235752] [] ? system_call_after_swapgs+0xae/0x146 [55732.243172] bash R running task 0 96247 96243 0x00000088 [55732.251146] Call Trace: [55732.253912] [] sched_show_task+0xa8/0x110 [55732.260259] [] show_state_filter+0x82/0xd0 [55732.266720] [] sysrq_handle_showstate+0x10/0x20 [55732.273657] [] __handle_sysrq+0x10d/0x170 [55732.280013] [] write_sysrq_trigger+0x28/0x40 [55732.286655] [] proc_reg_write+0x40/0x80 [55732.292819] [] vfs_write+0xc0/0x1f0 [55732.298596] [] ? system_call_after_swapgs+0xae/0x146 [55732.306031] [] SyS_write+0x7f/0xf0 [55732.311700] [] ? system_call_after_swapgs+0xae/0x146 [55732.319121] [] system_call_fastpath+0x25/0x2a [55732.325870] [] ? system_call_after_swapgs+0xae/0x146 [55732.333288] kworker/u304:2 S ffff99516c2ba0e0 0 96542 2 0x00000080 [55732.341284] Call Trace: [55732.344057] [] ? process_one_work+0x21a/0x440 [55732.350799] [] schedule+0x29/0x70 [55732.356377] [] worker_thread+0x1d9/0x3c0 [55732.362639] [] ? manage_workers.isra.26+0x2a0/0x2a0 [55732.369955] [] kthread+0xd1/0xe0 [55732.375438] [] ? insert_kthread_work+0x40/0x40 [55732.382292] [] ret_from_fork_nospec_begin+0x21/0x21 [55732.389622] [] ? insert_kthread_work+0x40/0x40 [55732.396473] Sched Debug Version: v0.11, 3.10.0-1062.9.1.el7_lustre.x86_64 #1 [55732.404394] ktime : 55735503.055228 [55732.411622] sched_clk : 55732396.471208 [55732.418847] cpu_clk : 55732396.471248 [55732.426088] jiffies : 4350402828 [55732.432827] sched_clock_stable() : 1 [55732.440392] sysctl_sched [55732.443254] .sysctl_sched_latency : 24.000000 [55732.450189] .sysctl_sched_min_granularity : 3.000000 [55732.457025] .sysctl_sched_wakeup_granularity : 4.000000 [55732.463862] .sysctl_sched_child_runs_first : 0 [55732.470020] .sysctl_sched_features : 56955 [55732.476579] .sysctl_sched_tunable_scaling : 1 (logaritmic) [55732.485675] cpu#0, 2693.545 MHz [55732.489207] .nr_running : 0 [55732.494395] .load : 0 [55732.499581] .nr_switches : 5954212 [55732.505345] .nr_load_updates : 1235296 [55732.511132] .nr_uninterruptible : -441 [55732.516600] .next_balance : 4350.402917 [55732.522753] .curr->pid : 0 [55732.527941] .clock : 55732527.437122 [55732.534503] .cpu_load[0] : 0 [55732.539686] .cpu_load[1] : 0 [55732.544874] .cpu_load[2] : 0 [55732.550063] .cpu_load[3] : 0 [55732.555258] .cpu_load[4] : 0 [55732.560469] .avg_idle : 1000000 [55732.566261] .max_idle_balance_cost : 500000 [55732.573591] cfs_rq[0]:/ [55732.576320] .exec_clock : 0.000000 [55732.582168] .MIN_vruntime : 0.000001 [55732.587999] .min_vruntime : 84836.470092 [55732.594220] .max_vruntime : 0.000001 [55732.600043] .spread : 0.000000 [55732.605875] .spread0 : 0.000000 [55732.611706] .nr_spread_over : 0 [55732.616859] .nr_running : 0 [55732.622013] .load : 0 [55732.627165] .runnable_load_avg : 0 [55732.632316] .blocked_load_avg : 5 [55732.637467] .tg_load_avg : 0 [55732.642628] .tg_load_contrib : 0 [55732.647780] .tg_runnable_contrib : 0 [55732.652932] .tg->runnable_avg : 0 [55732.658092] .tg->cfs_bandwidth.timer_active: 0 [55732.663253] .throttled : 0 [55732.668413] .throttle_count : 0 [55732.673579] .avg->runnable_avg_sum : 258 [55732.678924] .avg->runnable_avg_period : 47244 [55732.686144] rt_rq[0]:/ [55732.688778] .rt_nr_running : 0 [55732.693931] .rt_throttled : 0 [55732.699082] .rt_time : 0.000000 [55732.704915] .rt_runtime : 950.000000 [55732.712599] runnable tasks: [55732.715715] task PID tree-key switches prio wait-time sum-exec sum-sleep [55732.727750] ---------------------------------------------------------------------------------------------------------- [55732.739696] kworker/0:0H 4 7500.982058 7 100 0.000000 0.055094 0.000000 0 / [55732.752100] ksoftirqd/0 6 84812.229269 13519 120 0.000000 360.905083 0.000000 0 / [55732.764497] migration/0 7 0.000000 1633 0 0.000000 1677.898935 0.000000 0 / [55732.776882] rcu_bh 8 101.090725 2 120 0.000000 0.003218 0.000000 0 / [55732.789282] rcu_sched 9 84836.491671 2100636 120 0.000000 51504.787200 0.000000 0 / [55732.801678] lru-add-drain 10 104.594027 2 100 0.000000 0.004938 0.000000 0 / [55732.814096] watchdog/0 11 0.000000 13938 0 0.000000 232.020253 0.000000 0 / [55732.826531] kswapd0 192 1831.601840 4 120 0.000000 0.113342 0.000000 0 / [55732.838967] kworker/0:1H 1051 84800.324872 19938 100 0.000000 471.493116 0.000000 0 / [55732.851403] zthr_procedure 2157 84826.121610 55672 139 0.000000 1114.204655 0.000000 0 / [55732.863809] zed 2286 10238.714800 9 120 0.000000 16.653132 0.000000 0 / [55732.876210] gssproxy 2379 10887.602863 1755 120 0.000000 185.248310 0.000000 0 / [55732.888636] dhclient 2468 76501.844462 89 120 0.000000 34.755620 0.000000 0 / [55732.901076] kiblnd_sd_00_00 4842 84824.913517 3360220 120 0.000000 78771.107086 0.000000 0 / [55732.913476] ptlrpcd_rcv 4852 84804.245104 3458 120 0.000000 259.059642 0.000000 0 / [55732.925893] ptlrpcd_00_10 4863 84782.214592 56620 120 0.000000 3072.770007 0.000000 0 / [55732.938297] ptlrpcd_00_14 4867 84804.276055 57711 120 0.000000 3205.003484 0.000000 0 / [55732.950729] mdt_out00_000 4926 48111.877983 64088 120 0.000000 5017.097037 0.000000 0 / [55732.963160] osp-pre-1-0 4953 84816.449621 11098 120 0.000000 460.801183 0.000000 0 / [55732.975566] osp_up2-0 4954 45489.433248 269322 120 0.000000 13728.223255 0.000000 0 / [55732.987995] osp-pre-3-0 4957 84820.433740 11097 120 0.000000 458.755538 0.000000 0 / [55733.000407] osp-syn-10-0 4979 50334.739308 13409 120 0.000000 367.001709 0.000000 0 / [55733.012851] osp-pre-12-0 4984 84820.435821 11084 120 0.000000 463.425129 0.000000 0 / [55733.025276] ldlm_bl_03 5208 84820.442013 38483 120 0.000000 1076.469838 0.000000 0 / [55733.037682] mdt_rdpg00_008 5902 48601.002511 12016 120 0.000000 823.305284 0.000000 0 / [55733.050113] mdt_io00_006 6558 28233.732812 395 120 0.000000 36.727895 0.000000 0 / [55733.062524] kworker/0:2 11268 84820.635691 35719 120 0.000000 2485.262377 0.000000 0 / [55733.074928] ldlm_cb00_008 14022 37033.244967 1732 120 0.000000 83.743678 0.000000 0 / [55733.087337] ldlm_cn00_013 15241 51529.890150 18461 120 0.000000 1032.771895 0.000000 0 / [55733.099755] ldlm_cn00_020 15355 47724.433368 15196 120 0.000000 885.824221 0.000000 0 / [55733.112169] mdt_out00_012 15544 51808.982137 34541 120 0.000000 2757.795919 0.000000 0 / [55733.124584] ldlm_cn00_023 16144 47724.651233 10690 120 0.000000 580.084493 0.000000 0 / [55733.137008] ldlm_bl_08 20243 84804.215943 6065 120 0.000000 278.855615 0.000000 0 / [55733.149413] kworker/0:1 95067 83478.942124 4 120 0.000000 0.093750 0.000000 0 / [55733.163529] cpu#1, 2693.545 MHz [55733.167076] .nr_running : 0 [55733.172252] .load : 0 [55733.177451] .nr_switches : 7761488 [55733.183228] .nr_load_updates : 2316299 [55733.189013] .nr_uninterruptible : -124604 [55733.194771] .next_balance : 4350.403595 [55733.200938] .curr->pid : 0 [55733.206125] .clock : 55733205.399622 [55733.212671] .cpu_load[0] : 0 [55733.217866] .cpu_load[1] : 0 [55733.223068] .cpu_load[2] : 0 [55733.228248] .cpu_load[3] : 0 [55733.233450] .cpu_load[4] : 0 [55733.238646] .avg_idle : 1000000 [55733.244426] .max_idle_balance_cost : 500000 [55733.251773] cfs_rq[1]:/ [55733.254502] .exec_clock : 0.000000 [55733.260334] .MIN_vruntime : 0.000001 [55733.266166] .min_vruntime : 79729.411891 [55733.272384] .max_vruntime : 0.000001 [55733.278242] .spread : 0.000000 [55733.284074] .spread0 : -5107.650743 [55733.290294] .nr_spread_over : 0 [55733.295447] .nr_running : 0 [55733.300599] .load : 0 [55733.305751] .runnable_load_avg : 0 [55733.310905] .blocked_load_avg : 0 [55733.316057] .tg_load_avg : 0 [55733.321209] .tg_load_contrib : 0 [55733.326362] .tg_runnable_contrib : 0 [55733.331516] .tg->runnable_avg : 0 [55733.336669] .tg->cfs_bandwidth.timer_active: 0 [55733.341821] .throttled : 0 [55733.346975] .throttle_count : 0 [55733.352129] .avg->runnable_avg_sum : 0 [55733.357282] .avg->runnable_avg_period : 47990 [55733.364484] rt_rq[1]:/ [55733.367122] .rt_nr_running : 0 [55733.372275] .rt_throttled : 0 [55733.377436] .rt_time : 0.050726 [55733.383269] .rt_runtime : 950.000000 [55733.390946] runnable tasks: [55733.394069] task PID tree-key switches prio wait-time sum-exec sum-sleep [55733.406106] ---------------------------------------------------------------------------------------------------------- [55733.418066] watchdog/1 12 -2.933397 13939 0 0.000000 268.527233 0.000000 0 / [55733.430456] migration/1 13 0.000000 289 0 0.000000 1174.675435 0.000000 0 / [55733.442853] ksoftirqd/1 14 79358.781607 10429 120 0.000000 207.843775 0.000000 0 / [55733.455255] kworker/1:0H 16 741.809629 10 100 0.000000 0.092431 0.000000 0 / [55733.467677] kworker/1:1 186 79717.544857 9134 120 0.000000 235.196595 0.000000 0 / [55733.480083] systemd-udevd 1233 44483.922047 1209 120 0.000000 1248.283494 0.000000 0 / [55733.492489] kworker/1:1H 1246 79688.048587 12727 100 0.000000 268.911109 0.000000 0 / [55733.504911] polkitd 2252 79717.693325 34199 120 0.000000 5324.254140 0.000000 0 / [55733.517313] rpc.gssd 2395 3819.436727 49 120 0.000000 6.768627 0.000000 0 / [55733.529717] tuned 3233 79718.026162 55840 120 0.000000 5486.033376 0.000000 0 / [55733.542118] ptlrpc_hr00_002 4818 41338.960338 22357 120 0.000000 551.963997 0.000000 0 / [55733.554529] kiblnd_connd 4841 79718.516153 940688 120 0.000000 31761.111581 0.000000 0 / [55733.566927] ldlm_cn00_002 4896 44961.484465 58857 120 0.000000 3635.548459 0.000000 0 / [55733.579337] osp-pre-0-0 4959 79717.456570 11091 120 0.000000 464.527866 0.000000 0 / [55733.591750] osp-syn-5-0 4969 42910.204301 13691 120 0.000000 381.010595 0.000000 0 / [55733.604152] osp-pre-15-0 4990 79717.443727 10996 120 0.000000 460.742159 0.000000 0 / [55733.616557] mdt00_005 5126 41298.402344 80547 120 0.000000 6426.641128 0.000000 0 / [55733.628969] mdt_rdpg00_002 5187 69184.046388 26304 120 0.000000 1429.873118 0.000000 0 / [55733.641372] ldlm_cn00_008 5223 40377.927968 37102 120 0.000000 2274.056911 0.000000 0 / [55733.653776] mdt_rdpg00_005 5681 41327.965787 10840 120 0.000000 817.447029 0.000000 0 / [55733.666170] mdt00_012 5723 39946.967567 78217 120 0.000000 7867.413979 0.000000 0 / [55733.678585] mdt_rdpg00_009 5904 41328.047807 17363 120 0.000000 1195.815033 0.000000 0 / [55733.691009] mdt_io00_008 6560 19111.602055 1410 120 0.000000 118.030225 0.000000 0 / [55733.703423] mdt00_021 7364 44434.798937 38150 120 0.000000 3343.058511 0.000000 0 / [55733.715828] ldlm_cn00_012 13273 73739.271273 30583 120 0.000000 1766.390578 0.000000 0 / [55733.728225] ldlm_cn00_015 15243 40987.119993 18110 120 0.000000 1077.666641 0.000000 0 / [55733.740633] mdt_out00_017 16439 44859.970845 24757 120 0.000000 1975.524496 0.000000 0 / [55733.753036] kworker/u305:1 17930 68437.715989 66 120 0.000000 3.647739 0.000000 0 / [55733.765453] kworker/1:2 65913 57724.971827 2 120 0.000000 0.067973 0.000000 0 / [55733.777866] kworker/u304:4 95456 79217.824867 10278 120 0.000000 629.227124 0.000000 0 / [55733.791974] cpu#2, 2693.545 MHz [55733.795488] .nr_running : 0 [55733.800649] .load : 0 [55733.805810] .nr_switches : 4247622 [55733.811553] .nr_load_updates : 1584386 [55733.817333] .nr_uninterruptible : 109772 [55733.822992] .next_balance : 4350.404224 [55733.829151] .curr->pid : 97136 [55733.834719] .clock : 55733834.325066 [55733.841271] .cpu_load[0] : 0 [55733.846445] .cpu_load[1] : 0 [55733.851606] .cpu_load[2] : 114 [55733.856962] .cpu_load[3] : 163 [55733.862317] .cpu_load[4] : 168 [55733.867671] .avg_idle : 1000000 [55733.873468] .max_idle_balance_cost : 500000 [55733.880775] cfs_rq[2]:/ [55733.883504] .exec_clock : 0.000000 [55733.889337] .MIN_vruntime : 0.000001 [55733.895170] .min_vruntime : 60359.512019 [55733.901390] .max_vruntime : 0.000001 [55733.907221] .spread : 0.000000 [55733.913054] .spread0 : -24484.977985 [55733.919382] .nr_spread_over : 0 [55733.924533] .nr_running : 0 [55733.929684] .load : 0 [55733.934836] .runnable_load_avg : 0 [55733.939988] .blocked_load_avg : 105 [55733.945333] .tg_load_avg : 0 [55733.950485] .tg_load_contrib : 0 [55733.955637] .tg_runnable_contrib : 0 [55733.960791] .tg->runnable_avg : 0 [55733.965937] .tg->cfs_bandwidth.timer_active: 0 [55733.971090] .throttled : 0 [55733.976242] .throttle_count : 0 [55733.981395] .avg->runnable_avg_sum : 3459 [55733.986837] .avg->runnable_avg_period : 46312 [55733.994044] rt_rq[2]:/ [55733.996676] .rt_nr_running : 0 [55734.001829] .rt_throttled : 0 [55734.006981] .rt_time : 0.000000 [55734.012814] .rt_runtime : 950.000000 [55734.020492] runnable tasks: [55734.023609] task PID tree-key switches prio wait-time sum-exec sum-sleep [55734.035646] ---------------------------------------------------------------------------------------------------------- [55734.047588] watchdog/2 18 -5.928926 13937 0 0.000000 243.611548 0.000000 0 / [55734.059985] migration/2 19 0.000000 452 0 0.000000 1140.472919 0.000000 0 / [55734.072371] ksoftirqd/2 20 59368.939360 7167 120 0.000000 117.509902 0.000000 0 / [55734.084772] kworker/2:0H 22 587.292047 10 100 0.000000 0.066886 0.000000 0 / [55734.097188] kworker/2:1H 1366 59962.362087 11687 100 0.000000 224.121789 0.000000 0 / [55734.109587] kworker/2:3 2178 60331.982261 24119 120 0.000000 1334.770849 0.000000 0 / [55734.121992] sshd 2957 60347.582946 7058 120 0.000000 2686.413544 0.000000 0 / [55734.134403] ptlrpc_hr00_000 4816 52987.926208 22360 120 0.000000 537.357068 0.000000 0 / [55734.146812] ptlrpcd_00_04 4857 59967.588268 56588 120 0.000000 3128.085227 0.000000 0 / [55734.159223] ll_evictor 4907 37962.351714 55 120 0.000000 295.179922 0.000000 0 / [55734.171621] mdt00_000 4912 59910.899830 88667 120 0.000000 8066.947704 0.000000 0 / [55734.184030] mdt_rdpg00_000 4918 37675.241114 22840 120 0.000000 1210.876153 0.000000 0 / [55734.196427] osp_up1-0 4952 31860.207010 347883 120 0.000000 18167.275461 0.000000 0 / [55734.208850] osp-pre-2-0 4955 37873.993003 4521 120 0.000000 191.174332 0.000000 0 / [55734.221251] mdt_rdpg00_004 5205 33695.186917 26833 120 0.000000 1563.209454 0.000000 0 / [55734.233658] mdt_fld_0002 9008 37984.927635 25 120 0.000000 2.064284 0.000000 0 / [55734.246053] mdt_out00_010 15393 33312.503562 36047 120 0.000000 2847.111275 0.000000 0 / [55734.258460] kworker/2:1 94141 57765.937706 2 120 0.000000 0.065646 0.000000 0 / [55734.272548] cpu#3, 2693.545 MHz [55734.276063] .nr_running : 0 [55734.281224] .load : 0 [55734.286385] .nr_switches : 2891283 [55734.292148] .nr_load_updates : 1329781 [55734.297920] .nr_uninterruptible : 13722 [55734.303497] .next_balance : 4350.404704 [55734.309627] .curr->pid : 0 [55734.314824] .clock : 55734314.306436 [55734.321379] .cpu_load[0] : 0 [55734.326540] .cpu_load[1] : 0 [55734.331702] .cpu_load[2] : 0 [55734.336890] .cpu_load[3] : 0 [55734.342052] .cpu_load[4] : 0 [55734.347212] .avg_idle : 402032 [55734.352891] .max_idle_balance_cost : 500000 [55734.360221] cfs_rq[3]:/ [55734.362951] .exec_clock : 0.000000 [55734.368784] .MIN_vruntime : 0.000001 [55734.374608] .min_vruntime : 52096.464425 [55734.380817] .max_vruntime : 0.000001 [55734.386648] .spread : 0.000000 [55734.392480] .spread0 : -32753.782936 [55734.398795] .nr_spread_over : 0 [55734.403949] .nr_running : 0 [55734.409102] .load : 0 [55734.414255] .runnable_load_avg : 0 [55734.419410] .blocked_load_avg : 0 [55734.424554] .tg_load_avg : 0 [55734.429706] .tg_load_contrib : 0 [55734.434858] .tg_runnable_contrib : 0 [55734.440017] .tg->runnable_avg : 0 [55734.445169] .tg->cfs_bandwidth.timer_active: 0 [55734.450351] .throttled : 0 [55734.455504] .throttle_count : 0 [55734.460657] .avg->runnable_avg_sum : 2969 [55734.466108] .avg->runnable_avg_period : 48048 [55734.473310] rt_rq[3]:/ [55734.475942] .rt_nr_running : 0 [55734.481094] .rt_throttled : 0 [55734.486247] .rt_time : 0.000000 [55734.492078] .rt_runtime : 950.000000 [55734.499763] runnable tasks: [55734.502880] task PID tree-key switches prio wait-time sum-exec sum-sleep [55734.514922] ---------------------------------------------------------------------------------------------------------- [55734.526869] watchdog/3 23 -5.931032 13937 0 0.000000 231.125719 0.000000 0 / [55734.539276] migration/3 24 0.000000 253 0 0.000000 1325.890930 0.000000 0 / [55734.551679] ksoftirqd/3 25 51611.732238 11351 120 0.000000 161.936504 0.000000 0 / [55734.564086] kworker/3:0H 27 2881.320410 8 100 0.000000 0.058871 0.000000 0 / [55734.576519] kworker/3:1 184 52079.023217 13934 120 0.000000 718.694932 0.000000 0 / [55734.588941] kworker/3:1H 1050 51977.305015 24671 100 0.000000 600.576241 0.000000 0 / [55734.601356] dbus-daemon 2259 52091.221455 96393 120 0.000000 28456.205532 0.000000 0 / [55734.613760] nfsv4.0-svc 3273 4702.931698 4 120 0.000000 0.199985 0.000000 0 / [55734.626169] automount 3362 51984.544972 8923 120 0.000000 399.513506 0.000000 0 / [55734.638593] ptlrpc_hr00_003 4819 29873.496720 22355 120 0.000000 543.133293 0.000000 0 / [55734.651014] ptlrpcd_00_01 4854 52051.394083 59577 120 0.000000 3087.964581 0.000000 0 / [55734.663434] ptlrpcd_00_05 4858 52051.602823 58395 120 0.000000 2939.344048 0.000000 0 / [55734.675827] ptlrpcd_00_07 4860 52061.429388 58683 120 0.000000 3016.149122 0.000000 0 / [55734.688253] ldlm_cb00_000 4890 20466.779935 30363 120 0.000000 1579.857820 0.000000 0 / [55734.700656] ldlm_cn00_000 4894 37430.122043 59423 120 0.000000 3643.486378 0.000000 0 / [55734.713087] ldlm_bl_02 4901 52039.252186 38577 120 0.000000 1186.994401 0.000000 0 / [55734.725509] mdt_seqm_0000 4932 37445.663401 5 120 0.000000 0.267029 0.000000 0 / [55734.737935] mdt_seqm_0001 4933 37445.679245 8 120 0.000000 0.571264 0.000000 0 / [55734.750354] mdt_fld_0000 4934 37756.194484 26 120 0.000000 1.493268 0.000000 0 / [55734.762783] osp-pre-10-0 4980 52062.427037 11043 120 0.000000 473.957848 0.000000 0 / [55734.775214] mdt00_015 6070 52050.924810 82491 120 0.000000 7352.541054 0.000000 0 / [55734.787622] mdt_out00_006 7197 29309.602592 59569 120 0.000000 4709.529330 0.000000 0 / [55734.800054] mdt00_020 7361 37750.942766 46486 120 0.000000 3931.644331 0.000000 0 / [55734.812463] ldlm_cn00_014 15242 37756.339029 15415 120 0.000000 927.028739 0.000000 0 / [55734.824884] ldlm_cn00_017 15245 29061.706322 18355 120 0.000000 1034.381244 0.000000 0 / [55734.837303] mdt_out00_014 15547 29324.186551 41702 120 0.000000 3303.474903 0.000000 0 / [55734.849707] ldlm_cn00_024 16145 34655.172971 7132 120 0.000000 336.161050 0.000000 0 / [55734.862140] kworker/3:0 87234 47827.384509 2 120 0.000000 0.064861 0.000000 0 / [55734.876263] cpu#4, 2693.545 MHz [55734.879768] .nr_running : 0 [55734.884938] .load : 0 [55734.890100] .nr_switches : 2875936 [55734.895878] .nr_load_updates : 1189178 [55734.901636] .nr_uninterruptible : 2385 [55734.907091] .next_balance : 4350.405308 [55734.913224] .curr->pid : 0 [55734.918414] .clock : 55734918.289187 [55734.924960] .cpu_load[0] : 0 [55734.930129] .cpu_load[1] : 0 [55734.935325] .cpu_load[2] : 0 [55734.940496] .cpu_load[3] : 0 [55734.945658] .cpu_load[4] : 0 [55734.950826] .avg_idle : 1000000 [55734.956575] .max_idle_balance_cost : 500000 [55734.963898] cfs_rq[4]:/ [55734.966627] .exec_clock : 0.000000 [55734.972458] .MIN_vruntime : 0.000001 [55734.978309] .min_vruntime : 47236.119705 [55734.984529] .max_vruntime : 0.000001 [55734.990353] .spread : 0.000000 [55734.996197] .spread0 : -37619.234045 [55735.002512] .nr_spread_over : 0 [55735.007665] .nr_running : 0 [55735.012818] .load : 0 [55735.017971] .runnable_load_avg : 0 [55735.023125] .blocked_load_avg : 31 [55735.028382] .tg_load_avg : 0 [55735.033535] .tg_load_contrib : 0 [55735.038687] .tg_runnable_contrib : 0 [55735.043840] .tg->runnable_avg : 0 [55735.048994] .tg->cfs_bandwidth.timer_active: 0 [55735.054139] .throttled : 0 [55735.059305] .throttle_count : 0 [55735.064458] .avg->runnable_avg_sum : 1449 [55735.069902] .avg->runnable_avg_period : 46353 [55735.077106] rt_rq[4]:/ [55735.079737] .rt_nr_running : 0 [55735.084889] .rt_throttled : 0 [55735.090043] .rt_time : 0.000000 [55735.095866] .rt_runtime : 950.000000 [55735.103553] runnable tasks: [55735.106668] task PID tree-key switches prio wait-time sum-exec sum-sleep [55735.118706] ---------------------------------------------------------------------------------------------------------- [55735.130654] watchdog/4 28 -8.931089 13937 0 0.000000 234.559509 0.000000 0 / [55735.143062] migration/4 29 0.000000 268 0 0.000000 1060.652863 0.000000 0 / [55735.155466] ksoftirqd/4 30 46994.676663 6553 120 0.000000 89.714657 0.000000 0 / [55735.167880] kworker/4:0H 32 1015.820535 9 100 0.000000 0.068874 0.000000 0 / [55735.180320] kworker/4:1 234 47219.415981 8876 120 0.000000 375.588546 0.000000 0 / [55735.192725] dbuf_evict 2159 47220.385034 55670 139 0.000000 1047.742535 0.000000 0 / [55735.205150] gdbus 2383 47219.348725 10671 120 0.000000 2591.685622 0.000000 0 / [55735.217572] rs:main Q:Reg 2972 47236.119705 34108 120 0.000000 4253.589018 0.000000 0 / [55735.229983] ptlrpc_hr00_006 4822 30789.503384 22358 120 0.000000 523.163825 0.000000 0 / [55735.242399] lnet_discovery 4850 47217.279518 55656 120 0.000000 1213.885701 0.000000 0 / [55735.254820] ptlrpcd_00_15 4868 47122.351447 60050 120 0.000000 3206.243099 0.000000 0 / [55735.267244] mdt00_002 4914 33297.556371 100707 120 0.000000 8658.081029 0.000000 0 / [55735.279654] mdt_rdpg00_001 4919 25441.820350 16131 120 0.000000 793.689954 0.000000 0 / [55735.292081] mdt_io00_001 4937 11960.933290 2434 120 0.000000 258.545020 0.000000 0 / [55735.304510] osp-pre-9-0 4978 47174.006451 11060 120 0.000000 482.415861 0.000000 0 / [55735.316919] osp-syn-11-0 4981 30803.501628 12999 120 0.000000 366.379979 0.000000 0 / [55735.329359] osp-pre-14-0 4988 47214.204528 11063 120 0.000000 494.031995 0.000000 0 / [55735.341800] kworker/4:1H 5175 46807.360156 12706 100 0.000000 291.569547 0.000000 0 / [55735.354220] ldlm_cn00_005 5207 44730.564068 55944 120 0.000000 3375.199352 0.000000 0 / [55735.366639] mdt00_011 5566 47108.099121 100087 120 0.000000 9106.063564 0.000000 0 / [55735.379038] mdt_io00_003 6552 11945.186569 1004 120 0.000000 66.326211 0.000000 0 / [55735.391431] mdt00_019 7360 27713.289033 74226 120 0.000000 6743.366532 0.000000 0 / [55735.403851] ldlm_cb00_005 13425 23265.033693 7873 120 0.000000 274.815311 0.000000 0 / [55735.416298] kworker/4:0 86138 43104.995766 2 120 0.000000 0.065848 0.000000 0 / [55735.430388] cpu#5, 2693.545 MHz [55735.433901] .nr_running : 0 [55735.439098] .load : 0 [55735.444300] .nr_switches : 6112778 [55735.450070] .nr_load_updates : 1344112 [55735.455847] .nr_uninterruptible : 1048 [55735.461344] .next_balance : 4350.405862 [55735.467494] .curr->pid : 0 [55735.472680] .clock : 55735472.254411 [55735.479227] .cpu_load[0] : 0 [55735.484417] .cpu_load[1] : 0 [55735.489614] .cpu_load[2] : 0 [55735.494801] .cpu_load[3] : 0 [55735.499983] .cpu_load[4] : 0 [55735.505178] .avg_idle : 590407 [55735.510860] .max_idle_balance_cost : 500000 [55735.518182] cfs_rq[5]:/ [55735.520909] .exec_clock : 0.000000 [55735.526741] .MIN_vruntime : 0.000001 [55735.532573] .min_vruntime : 67041.424251 [55735.538791] .max_vruntime : 0.000001 [55735.544623] .spread : 0.000000 [55735.550453] .spread0 : -17821.096622 [55735.556769] .nr_spread_over : 0 [55735.561922] .nr_running : 0 [55735.567076] .load : 0 [55735.572229] .runnable_load_avg : 0 [55735.577383] .blocked_load_avg : 0 [55735.582536] .tg_load_avg : 0 [55735.587689] .tg_load_contrib : 0 [55735.592842] .tg_runnable_contrib : 0 [55735.597996] .tg->runnable_avg : 0 [55735.603150] .tg->cfs_bandwidth.timer_active: 0 [55735.608303] .throttled : 0 [55735.613455] .throttle_count : 0 [55735.618609] .avg->runnable_avg_sum : 0 [55735.623762] .avg->runnable_avg_period : 46615 [55735.630963] rt_rq[5]:/ [55735.633595] .rt_nr_running : 0 [55735.638748] .rt_throttled : 0 [55735.643900] .rt_time : 0.000000 [55735.649731] .rt_runtime : 950.000000 [55735.657418] runnable tasks: [55735.660536] task PID tree-key switches prio wait-time sum-exec sum-sleep [55735.672578] ---------------------------------------------------------------------------------------------------------- [55735.684525] rcu_sched 9 67030.507752 2100743 120 0.000000 51507.634309 0.000000 0 / [55735.696911] watchdog/5 33 -8.930627 13937 0 0.000000 236.346765 0.000000 0 / [55735.709332] migration/5 34 0.000000 236 0 0.000000 1084.654320 0.000000 0 / [55735.721759] ksoftirqd/5 35 66582.577648 6633 120 0.000000 104.795670 0.000000 0 / [55735.734177] kworker/5:0H 37 1678.848548 9 100 0.000000 0.083067 0.000000 0 / [55735.746607] kworker/5:1 254 67029.719855 65327 120 0.000000 2324.651596 0.000000 0 / [55735.759042] systemd-logind 2538 67034.231229 75181 120 0.000000 13470.510502 0.000000 0 / [55735.771440] tuned 2960 65972.166656 152 120 0.000000 161.034580 0.000000 0 / [55735.783844] rsyslogd 2962 66491.590421 97 120 0.000000 12.515890 0.000000 0 / [55735.796268] kworker/5:1H 4805 66759.168578 11391 100 0.000000 214.287727 0.000000 0 / [55735.808675] ptlrpc_hr00_001 4817 61035.025776 22360 120 0.000000 544.720105 0.000000 0 / [55735.821097] ptlrpcd_00_06 4859 67029.535865 55767 120 0.000000 3098.269290 0.000000 0 / [55735.833527] ll_mgs_0001 4905 47100.033767 26589 120 0.000000 1986.621905 0.000000 0 / [55735.845961] mdt00_009 5200 67024.976296 124490 120 0.000000 10728.169115 0.000000 0 / [55735.858379] mdt_out00_004 5216 47220.845587 75088 120 0.000000 6055.672474 0.000000 0 / [55735.870801] ldlm_cn00_010 5409 47572.782484 55156 120 0.000000 3316.102403 0.000000 0 / [55735.883228] ldlm_cn00_011 5562 38366.811110 43519 120 0.000000 2649.041602 0.000000 0 / [55735.895644] mdt_rdpg00_010 5906 39692.160710 10502 120 0.000000 681.623568 0.000000 0 / [55735.908057] mdt00_013 6066 44646.776289 88194 120 0.000000 8287.273711 0.000000 0 / [55735.920469] mdt_io00_005 6556 13952.345297 1197 120 0.000000 54.142667 0.000000 0 / [55735.932884] mdt00_017 7357 47572.171530 65260 120 0.000000 5999.936621 0.000000 0 / [55735.945323] kworker/5:0 94181 65835.231501 2 120 0.000000 0.083688 0.000000 0 / [55735.957742] sshd 96243 66620.263793 125 120 0.000000 46.765464 0.000000 0 / [55735.971868] cpu#6, 2693.545 MHz [55735.975395] .nr_running : 0 [55735.980570] .load : 0 [55735.985766] .nr_switches : 4677677 [55735.991544] .nr_load_updates : 1225928 [55735.997331] .nr_uninterruptible : -2839 [55736.002906] .next_balance : 4350.406404 [55736.009071] .curr->pid : 0 [55736.014309] .clock : 55736014.218056 [55736.020874] .cpu_load[0] : 0 [55736.026063] .cpu_load[1] : 0 [55736.031271] .cpu_load[2] : 0 [55736.036443] .cpu_load[3] : 0 [55736.041632] .cpu_load[4] : 0 [55736.046821] .avg_idle : 912690 [55736.052494] .max_idle_balance_cost : 500000 [55736.059828] cfs_rq[6]:/ [55736.062556] .exec_clock : 0.000000 [55736.068388] .MIN_vruntime : 0.000001 [55736.074238] .min_vruntime : 59513.515322 [55736.080450] .max_vruntime : 0.000001 [55736.086272] .spread : 0.000000 [55736.092109] .spread0 : -25349.005551 [55736.098426] .nr_spread_over : 0 [55736.103583] .nr_running : 0 [55736.108735] .load : 0 [55736.113897] .runnable_load_avg : 0 [55736.119050] .blocked_load_avg : 0 [55736.124203] .tg_load_avg : 0 [55736.129377] .tg_load_contrib : 0 [55736.134530] .tg_runnable_contrib : 0 [55736.139683] .tg->runnable_avg : 0 [55736.144836] .tg->cfs_bandwidth.timer_active: 0 [55736.149989] .throttled : 0 [55736.155142] .throttle_count : 0 [55736.160301] .avg->runnable_avg_sum : 18 [55736.165558] .avg->runnable_avg_period : 47909 [55736.172760] rt_rq[6]:/ [55736.175391] .rt_nr_running : 0 [55736.180544] .rt_throttled : 0 [55736.185698] .rt_time : 0.000000 [55736.191532] .rt_runtime : 950.000000 [55736.199209] runnable tasks: [55736.202324] task PID tree-key switches prio wait-time sum-exec sum-sleep [55736.214360] ---------------------------------------------------------------------------------------------------------- [55736.226311] watchdog/6 38 -8.931082 13937 0 0.000000 232.248881 0.000000 0 / [55736.238719] migration/6 39 0.000000 622 0 0.000000 1077.152520 0.000000 0 / [55736.251134] ksoftirqd/6 40 59498.830247 16508 120 0.000000 298.581386 0.000000 0 / [55736.263527] kworker/6:0H 42 2045.014896 9 100 0.000000 0.098023 0.000000 0 / [55736.275948] kworker/6:1 235 59501.597176 9052 120 0.000000 365.567944 0.000000 0 / [55736.288346] jbd2/sda1-8 1109 59489.760085 14776 120 0.000000 1027.673240 0.000000 0 / [55736.300789] qmgr 3235 59159.301181 326 120 0.000000 53.220024 0.000000 0 / [55736.313226] ptlrpc_hr00_007 4823 38456.803739 22358 120 0.000000 542.378234 0.000000 0 / [55736.325636] kiblnd_sd_00_02 4844 59503.053974 3362048 120 0.000000 78718.011273 0.000000 0 / [55736.338048] ptlrpcd_00_02 4855 59471.896250 56125 120 0.000000 3065.185256 0.000000 0 / [55736.350458] ptlrpcd_00_03 4856 59471.774040 58713 120 0.000000 3121.247746 0.000000 0 / [55736.362876] ptlrpcd_00_15 4868 59501.677821 60052 120 0.000000 3206.405598 0.000000 0 / [55736.375285] mdt_io00_000 4936 7089.911915 12 120 0.000000 0.803158 0.000000 0 / [55736.387724] osp-pre-0-0 4959 59501.585381 11092 120 0.000000 464.597925 0.000000 0 / [55736.400142] osp-pre-11-0 4982 59475.425513 11013 120 0.000000 469.203946 0.000000 0 / [55736.412563] kworker/6:1H 5008 59489.575016 40750 100 0.000000 921.113052 0.000000 0 / [55736.424981] mdt00_004 5125 59471.678539 131683 120 0.000000 11598.077808 0.000000 0 / [55736.437419] ldlm_cb00_003 5401 20570.146913 29779 120 0.000000 1564.623408 0.000000 0 / [55736.449851] mdt_rdpg00_013 6722 35416.912421 12197 120 0.000000 858.943432 0.000000 0 / [55736.462282] ldlm_cn00_016 15244 39746.271354 21326 120 0.000000 1160.534900 0.000000 0 / [55736.474721] mdt_out00_009 15354 35013.682391 40170 120 0.000000 2991.787857 0.000000 0 / [55736.487152] kworker/6:0 87861 56586.346449 2 120 0.000000 0.065590 0.000000 0 / [55736.501241] cpu#7, 2693.545 MHz [55736.504782] .nr_running : 0 [55736.509947] .load : 0 [55736.515136] .nr_switches : 3175370 [55736.520891] .nr_load_updates : 1169895 [55736.526655] .nr_uninterruptible : 1520 [55736.532128] .next_balance : 4350.406933 [55736.538302] .curr->pid : 0 [55736.543499] .clock : 55736543.189412 [55736.550060] .cpu_load[0] : 0 [55736.555239] .cpu_load[1] : 0 [55736.560428] .cpu_load[2] : 0 [55736.565614] .cpu_load[3] : 0 [55736.570818] .cpu_load[4] : 0 [55736.576022] .avg_idle : 1000000 [55736.581791] .max_idle_balance_cost : 500000 [55736.589119] cfs_rq[7]:/ [55736.591849] .exec_clock : 0.000000 [55736.597681] .MIN_vruntime : 0.000001 [55736.603513] .min_vruntime : 52442.970092 [55736.609733] .max_vruntime : 0.000001 [55736.615563] .spread : 0.000000 [55736.621402] .spread0 : -32419.550781 [55736.627716] .nr_spread_over : 0 [55736.632868] .nr_running : 0 [55736.638020] .load : 0 [55736.643173] .runnable_load_avg : 0 [55736.648347] .blocked_load_avg : 0 [55736.653500] .tg_load_avg : 0 [55736.658653] .tg_load_contrib : 0 [55736.663807] .tg_runnable_contrib : 0 [55736.668960] .tg->runnable_avg : 0 [55736.674114] .tg->cfs_bandwidth.timer_active: 0 [55736.679266] .throttled : 0 [55736.684425] .throttle_count : 0 [55736.689579] .avg->runnable_avg_sum : 138 [55736.694916] .avg->runnable_avg_period : 47865 [55736.702118] rt_rq[7]:/ [55736.704748] .rt_nr_running : 0 [55736.709901] .rt_throttled : 0 [55736.715054] .rt_time : 0.000000 [55736.720886] .rt_runtime : 950.000000 [55736.728572] runnable tasks: [55736.731690] task PID tree-key switches prio wait-time sum-exec sum-sleep [55736.743728] ---------------------------------------------------------------------------------------------------------- [55736.755674] watchdog/7 43 -8.930314 13937 0 0.000000 227.012384 0.000000 0 / [55736.768093] migration/7 44 0.000000 234 0 0.000000 1319.863673 0.000000 0 / [55736.780492] ksoftirqd/7 45 52429.316112 6281 120 0.000000 95.721059 0.000000 0 / [55736.792897] kworker/7:0H 47 687.115838 9 100 0.000000 1.269636 0.000000 0 / [55736.805323] kipmi0 1344 1352.880252 39 139 0.000000 81.382565 0.000000 0 / [55736.817733] kworker/7:1H 1365 52429.288438 10533 100 0.000000 195.200939 0.000000 0 / [55736.830143] auditd 2223 52430.386572 55276 116 0.000000 5482.623086 0.000000 0 / [55736.842553] auditd 2224 52429.297299 3898 116 0.000000 345.903573 0.000000 0 / [55736.854972] kiblnd_sd_00_03 4845 52432.792685 3361185 120 0.000000 78763.280617 0.000000 0 / [55736.867396] ptlrpcd_00_11 4864 52430.393592 58029 120 0.000000 2915.463040 0.000000 0 / [55736.879823] kmmpd-dm-0 4885 52429.338750 22091 120 0.000000 593.125125 0.000000 0 / [55736.892250] ldlm_cb00_001 4891 19065.967989 25053 120 0.000000 1270.684275 0.000000 0 / [55736.904691] ll_cfg_requeue 4908 35995.384732 164 120 0.000000 14.346563 0.000000 0 / [55736.917120] mdt_io00_002 4938 13015.788027 2126 120 0.000000 233.728092 0.000000 0 / [55736.929547] osp-syn-3-0 4965 33192.066877 13759 120 0.000000 380.831665 0.000000 0 / [55736.941979] ldlm_bl_04 5209 52426.357466 38437 120 0.000000 1215.428484 0.000000 0 / [55736.954391] ldlm_bl_05 5210 52429.302498 37865 120 0.000000 1189.465610 0.000000 0 / [55736.966811] mdt00_010 5220 52426.430352 89049 120 0.000000 8518.367949 0.000000 0 / [55736.979242] ldlm_cn00_007 5221 28772.297345 65092 120 0.000000 4138.479931 0.000000 0 / [55736.991680] ldlm_cn00_009 5398 28772.329209 35061 120 0.000000 2160.546925 0.000000 0 / [55737.004106] mdt_rdpg00_007 5901 29822.229925 22410 120 0.000000 1600.719733 0.000000 0 / [55737.016519] kworker/7:2 55107 52431.042794 2569 120 0.000000 100.281522 0.000000 0 / [55737.028917] kworker/u305:2 81272 52430.276649 3608 120 0.000000 238.481999 0.000000 0 / [55737.041318] kworker/7:0 93793 50304.573720 2 120 0.000000 0.066970 0.000000 0 / [55737.055437] cpu#8, 2693.545 MHz [55737.058957] .nr_running : 0 [55737.064141] .load : 0 [55737.069322] .nr_switches : 5592918 [55737.075092] .nr_load_updates : 1366138 [55737.080878] .nr_uninterruptible : -75 [55737.086279] .next_balance : 4350.407487 [55737.092431] .curr->pid : 0 [55737.097621] .clock : 55737097.125735 [55737.104196] .cpu_load[0] : 0 [55737.109377] .cpu_load[1] : 0 [55737.114552] .cpu_load[2] : 0 [55737.119747] .cpu_load[3] : 0 [55737.124944] .cpu_load[4] : 0 [55737.130122] .avg_idle : 880111 [55737.135801] .max_idle_balance_cost : 500000 [55737.143130] cfs_rq[8]:/ [55737.145859] .exec_clock : 0.000000 [55737.151692] .MIN_vruntime : 0.000001 [55737.157525] .min_vruntime : 72699.263646 [55737.163735] .max_vruntime : 0.000001 [55737.169567] .spread : 0.000000 [55737.175399] .spread0 : -12163.257227 [55737.181715] .nr_spread_over : 0 [55737.186867] .nr_running : 0 [55737.192018] .load : 0 [55737.197171] .runnable_load_avg : 0 [55737.202323] .blocked_load_avg : 0 [55737.207475] .tg_load_avg : 0 [55737.212626] .tg_load_contrib : 0 [55737.217779] .tg_runnable_contrib : 0 [55737.222933] .tg->runnable_avg : 0 [55737.228085] .tg->cfs_bandwidth.timer_active: 0 [55737.233245] .throttled : 0 [55737.238398] .throttle_count : 0 [55737.243549] .avg->runnable_avg_sum : 23 [55737.248798] .avg->runnable_avg_period : 47899 [55737.256002] rt_rq[8]:/ [55737.258639] .rt_nr_running : 0 [55737.263792] .rt_throttled : 0 [55737.268945] .rt_time : 0.037898 [55737.274778] .rt_runtime : 950.000000 [55737.282463] runnable tasks: [55737.285579] task PID tree-key switches prio wait-time sum-exec sum-sleep [55737.297614] ---------------------------------------------------------------------------------------------------------- [55737.309554] kthreadd 2 72603.228707 1114 120 0.000000 48.292401 0.000000 1 / [55737.321962] watchdog/8 48 -11.905297 13938 0 0.000000 236.151855 0.000000 1 / [55737.334359] migration/8 49 0.000000 245 0 0.000000 1059.464943 0.000000 1 / [55737.346776] ksoftirqd/8 50 72638.294331 11969 120 0.000000 243.690969 0.000000 1 / [55737.359199] kworker/8:0 51 638.538693 22 120 0.000000 0.634908 0.000000 1 / [55737.371617] kworker/8:0H 52 638.532998 10 100 0.000000 0.049753 0.000000 1 / [55737.384056] kworker/8:1 205 72687.288531 5902 120 0.000000 343.836001 0.000000 1 / [55737.396458] multipathd 1254 0.000000 11144 0 0.000000 351.996099 0.000000 1 / [55737.408856] multipathd 1259 0.000000 175 0 0.000000 45.329380 0.000000 1 / [55737.421285] kworker/8:1H 2036 72510.903430 18630 100 0.000000 397.535498 0.000000 1 / [55737.433729] gssproxy 2368 72671.081077 1988 120 0.000000 84.526063 0.000000 1 / [55737.446166] munged 2990 72672.045102 975 120 0.000000 461.956508 0.000000 1 / [55737.458571] agetty 3358 753.902254 13 120 0.000000 8.763961 0.000000 1 / [55737.471009] kiblnd_sd_01_01 4847 72687.412434 6062421 120 0.000000 104677.976300 0.000000 1 / [55737.483414] ptlrpcd_01_09 4878 72687.434887 52144 120 0.000000 2316.694345 0.000000 1 / [55737.495812] ptlrpcd_01_10 4879 72687.415308 48990 120 0.000000 2321.089737 0.000000 1 / [55737.508226] mdt01_002 4917 72671.017443 127343 120 0.000000 11990.528213 0.000000 1 / [55737.520651] mdt_attr01_000 4924 764.591152 3 120 0.000000 0.233391 0.000000 1 / [55737.533073] mdt_attr01_001 4925 764.707470 3 120 0.000000 0.132807 0.000000 1 / [55737.545486] osp-pre-2-0 4964 72681.937027 11051 120 0.000000 507.628975 0.000000 1 / [55737.557908] osp-pre-13-0 4986 72687.358117 11055 120 0.000000 487.208357 0.000000 1 / [55737.570315] mdt01_004 5139 58544.471442 86169 120 0.000000 8077.795323 0.000000 1 / [55737.582736] mdt01_011 5565 64712.749788 70049 120 0.000000 6524.972976 0.000000 1 / [55737.595150] mdt_out01_009 5726 60283.432613 166850 120 0.000000 13777.047738 0.000000 1 / [55737.607586] mdt_out01_012 5729 72687.314657 172979 120 0.000000 13237.181331 0.000000 1 / [55737.620000] mdt_rdpg01_006 5900 58548.773794 15598 120 0.000000 1046.443041 0.000000 1 / [55737.632432] ldlm_cb01_004 6387 40392.249300 32688 120 0.000000 1857.877892 0.000000 1 / [55737.644839] mdt_io01_006 6557 23843.259882 1454 120 0.000000 123.546648 0.000000 1 / [55737.657269] ldlm_cn01_015 9413 64570.635339 66758 120 0.000000 4049.304337 0.000000 1 / [55737.671376] cpu#9, 2693.545 MHz [55737.674886] .nr_running : 0 [55737.680072] .load : 0 [55737.685255] .nr_switches : 5490654 [55737.691031] .nr_load_updates : 1255931 [55737.696815] .nr_uninterruptible : -123 [55737.702281] .next_balance : 4350.408103 [55737.708425] .curr->pid : 0 [55737.713623] .clock : 55737708.496704 [55737.720194] .cpu_load[0] : 0 [55737.725376] .cpu_load[1] : 0 [55737.730566] .cpu_load[2] : 0 [55737.735756] .cpu_load[3] : 0 [55737.740958] .cpu_load[4] : 0 [55737.746191] .avg_idle : 1000000 [55737.751977] .max_idle_balance_cost : 500000 [55737.759298] cfs_rq[9]:/ [55737.762019] .exec_clock : 0.000000 [55737.767850] .MIN_vruntime : 0.000001 [55737.773681] .min_vruntime : 74177.485180 [55737.779901] .max_vruntime : 0.000001 [55737.785733] .spread : 0.000000 [55737.791565] .spread0 : -10685.035693 [55737.797883] .nr_spread_over : 0 [55737.803034] .nr_running : 0 [55737.808196] .load : 0 [55737.813355] .runnable_load_avg : 0 [55737.818508] .blocked_load_avg : 0 [55737.823660] .tg_load_avg : 0 [55737.828813] .tg_load_contrib : 0 [55737.833967] .tg_runnable_contrib : 0 [55737.839127] .tg->runnable_avg : 0 [55737.844280] .tg->cfs_bandwidth.timer_active: 0 [55737.849434] .throttled : 0 [55737.854577] .throttle_count : 0 [55737.859730] .avg->runnable_avg_sum : 0 [55737.864882] .avg->runnable_avg_period : 47413 [55737.872086] rt_rq[9]:/ [55737.874717] .rt_nr_running : 0 [55737.879871] .rt_throttled : 0 [55737.885024] .rt_time : 0.023652 [55737.890856] .rt_runtime : 950.000000 [55737.898543] runnable tasks: [55737.901659] task PID tree-key switches prio wait-time sum-exec sum-sleep [55737.913696] ---------------------------------------------------------------------------------------------------------- [55737.925652] watchdog/9 54 -11.905397 13938 0 0.000000 224.292518 0.000000 1 / [55737.938047] migration/9 55 0.000000 234 0 0.000000 1084.253877 0.000000 1 / [55737.950459] ksoftirqd/9 56 73245.860053 13090 120 0.000000 265.630565 0.000000 1 / [55737.962864] kworker/9:0 57 1.662144 21 120 0.000000 0.134011 0.000000 1 / [55737.975275] kworker/9:0H 58 229.714995 9 100 0.000000 0.073437 0.000000 1 / [55737.987703] kworker/9:1 237 74164.720461 5792 120 0.000000 186.926707 0.000000 1 / [55738.000139] bioset 2026 241.714525 2 100 0.000000 0.054102 0.000000 1 / [55738.012567] kworker/9:1H 2030 74159.460732 21618 100 0.000000 466.071319 0.000000 1 / [55738.025009] kdmflush 2031 241.716755 2 100 0.000000 0.007821 0.000000 1 / [55738.037427] bioset 2033 241.718837 2 100 0.000000 0.008550 0.000000 1 / [55738.049859] sssd 2253 74164.736497 2054 120 0.000000 150.239278 0.000000 1 / [55738.062277] NetworkManager 2283 74177.485180 36374 120 0.000000 4425.743124 0.000000 1 / [55738.074678] gmain 2381 74165.537345 13933 120 0.000000 740.928124 0.000000 1 / [55738.087127] ptlrpc_hr01_004 4828 66156.367048 28077 120 0.000000 884.490067 0.000000 1 / [55738.099550] kiblnd_sd_01_00 4846 74171.487322 6065084 120 0.000000 104038.099868 0.000000 1 / [55738.111967] ptlrpcd_01_01 4870 74164.906901 51965 120 0.000000 2274.837833 0.000000 1 / [55738.124393] ptlrpcd_01_07 4876 74165.380262 51784 120 0.000000 2363.247377 0.000000 1 / [55738.136803] ldlm_cb01_000 4892 66156.446420 36475 120 0.000000 2072.521678 0.000000 1 / [55738.149229] ldlm_cn01_002 4899 66139.589466 105440 120 0.000000 5709.058829 0.000000 1 / [55738.161667] mdt_rdpg01_000 4920 72239.253707 29330 120 0.000000 1845.867724 0.000000 1 / [55738.174113] mdt_io01_000 4939 20883.863061 675 120 0.000000 66.153840 0.000000 1 / [55738.186552] osp-syn-12-0 4983 64649.121910 13843 120 0.000000 385.340154 0.000000 1 / [55738.198981] osp-syn-15-0 4989 64649.206090 13384 120 0.000000 389.735811 0.000000 1 / [55738.211402] mdt_rdpg01_002 5136 61972.789304 25174 120 0.000000 1614.030944 0.000000 1 / [55738.223822] mdt_out01_003 5145 63546.053643 171885 120 0.000000 14199.151072 0.000000 1 / [55738.236244] mdt01_008 5195 66156.610991 114121 120 0.000000 10031.415948 0.000000 1 / [55738.248681] mdt_rdpg01_004 5204 64647.757520 23766 120 0.000000 1379.205373 0.000000 1 / [55738.261101] ldlm_cn01_011 5402 66139.298191 80578 120 0.000000 4263.810227 0.000000 1 / [55738.273527] mdt_out01_006 5403 63556.716582 134877 120 0.000000 10570.171217 0.000000 1 / [55738.285951] ldlm_cn01_012 5406 66156.482752 95725 120 0.000000 5559.448585 0.000000 1 / [55738.298363] mdt_out01_018 5735 63482.336199 126724 120 0.000000 9345.039635 0.000000 1 / [55738.310784] mdt_out01_021 5891 63544.691311 181908 120 0.000000 14955.935789 0.000000 1 / [55738.323220] mdt_io01_008 6600 20883.798534 648 120 0.000000 58.502835 0.000000 1 / [55738.335658] mdt_rdpg01_011 6718 61998.103096 10278 120 0.000000 847.802860 0.000000 1 / [55738.348092] ldlm_cb01_011 13984 38600.043193 1893 120 0.000000 82.537410 0.000000 1 / [55738.362210] cpu#10, 2693.545 MHz [55738.365821] .nr_running : 4 [55738.371002] .load : 2048 [55738.376468] .nr_switches : 5623087 [55738.382245] .nr_load_updates : 1459954 [55738.388015] .nr_uninterruptible : -122 [55738.393497] .next_balance : 4350.408891 [55738.399669] .curr->pid : 96247 [55738.405246] .clock : 55670688.769518 [55738.411799] .cpu_load[0] : 2048 [55738.417265] .cpu_load[1] : 2048 [55738.422746] .cpu_load[2] : 2048 [55738.428212] .cpu_load[3] : 2048 [55738.433705] .cpu_load[4] : 2048 [55738.439173] .avg_idle : 1000000 [55738.444950] .max_idle_balance_cost : 500000 [55738.452268] cfs_rq[10]:/ [55738.455093] .exec_clock : 0.000000 [55738.460939] .MIN_vruntime : 66439.293433 [55738.467159] .min_vruntime : 66451.243149 [55738.473391] .max_vruntime : 66439.293433 [55738.479609] .spread : 0.000000 [55738.485440] .spread0 : -18411.277724 [55738.491756] .nr_spread_over : 0 [55738.496908] .nr_running : 2 [55738.502060] .load : 2048 [55738.507503] .runnable_load_avg : 244 [55738.512850] .blocked_load_avg : 0 [55738.518001] .tg_load_avg : 0 [55738.523160] .tg_load_contrib : 0 [55738.528312] .tg_runnable_contrib : 0 [55738.533466] .tg->runnable_avg : 0 [55738.538618] .tg->cfs_bandwidth.timer_active: 0 [55738.543771] .throttled : 0 [55738.548923] .throttle_count : 0 [55738.554082] .avg->runnable_avg_sum : 11590 [55738.559631] .avg->runnable_avg_period : 48819 [55738.566826] rt_rq[10]:/ [55738.569554] .rt_nr_running : 1 [55738.574705] .rt_throttled : 0 [55738.579857] .rt_time : 0.000000 [55738.585689] .rt_runtime : 950.000000 [55738.593375] runnable tasks: [55738.596490] task PID tree-key switches prio wait-time sum-exec sum-sleep [55738.608526] ---------------------------------------------------------------------------------------------------------- [55738.620480] watchdog/10 59 -11.906009 13921 0 0.000000 230.417896 0.000000 1 / [55738.632886] migration/10 60 0.000000 257 0 0.000000 1059.697935 0.000000 1 / [55738.645304] ksoftirqd/10 61 66299.238155 12876 120 0.000000 270.066598 0.000000 1 / [55738.657720] kworker/10:0H 63 1466.256925 9 100 0.000000 0.067043 0.000000 1 / [55738.670156] kworker/10:1 215 66439.293433 6245 120 0.000000 188.247037 0.000000 1 / [55738.682581] scsi_eh_3 1020 1579.090815 24 120 0.000000 0.715486 0.000000 1 / [55738.695013] kworker/u307:0 1055 184.331121 3 100 0.000000 0.056245 0.000000 1 / [55738.707425] kworker/u306:2 1147 66437.320559 18813 120 0.000000 10517.961669 0.000000 1 / [55738.719830] kworker/10:2 1209 249.307374 2 120 0.000000 0.044689 0.000000 1 / [55738.732249] kdmflush 2024 1395.423286 2 100 0.000000 0.007810 0.000000 1 / [55738.744662] bioset 2039 1395.425602 2 100 0.000000 0.007224 0.000000 1 / [55738.757088] kdmwork-253:3 2040 1467.894520 66 120 0.000000 1.646846 0.000000 1 / [55738.769516] kdmflush 2043 1395.432703 2 100 0.000000 0.007453 0.000000 1 / [55738.781951] kworker/10:1H 2189 66436.072711 20371 100 0.000000 438.633186 0.000000 1 / [55738.794384] automount 3556 2524.921019 24 120 0.000000 10.600209 0.000000 1 / [55738.806815] osp-syn-9-0 4977 61841.151325 13087 120 0.000000 367.822787 0.000000 1 / [55738.819264] mdt_out01_005 5186 61097.423228 174916 120 0.000000 13449.291724 0.000000 1 / [55738.831698] ldlm_cn01_005 5188 62430.834870 103168 120 0.000000 5698.791469 0.000000 1 / [55738.844120] mdt_rdpg01_008 5905 59453.231688 22503 120 0.000000 1651.212541 0.000000 1 / [55738.856555] ldlm_cn01_017 9415 62435.233473 50933 120 0.000000 3075.977247 0.000000 1 / [55738.868959] ldlm_cb01_012 14176 41038.439103 510 120 0.000000 28.067815 0.000000 1 / [55738.881395] R bash 96247 66455.098198 90 120 0.000000 55.308780 0.000000 1 / [55738.895498] cpu#11, 2693.545 MHz [55738.899128] .nr_running : 0 [55738.904289] .load : 0 [55738.909471] .nr_switches : 5773719 [55738.915224] .nr_load_updates : 1654044 [55738.920959] .nr_uninterruptible : -205 [55738.926426] .next_balance : 4350.409327 [55738.932599] .curr->pid : 0 [55738.937802] .clock : 55738937.008164 [55738.944349] .cpu_load[0] : 0 [55738.949530] .cpu_load[1] : 0 [55738.954724] .cpu_load[2] : 0 [55738.959912] .cpu_load[3] : 0 [55738.965120] .cpu_load[4] : 0 [55738.970300] .avg_idle : 1000000 [55738.976110] .max_idle_balance_cost : 500000 [55738.983452] cfs_rq[11]:/ [55738.986279] .exec_clock : 0.000000 [55738.992115] .MIN_vruntime : 0.000001 [55738.997948] .min_vruntime : 69976.079822 [55739.004160] .max_vruntime : 0.000001 [55739.009992] .spread : 0.000000 [55739.015823] .spread0 : -14887.644983 [55739.022139] .nr_spread_over : 0 [55739.027293] .nr_running : 0 [55739.032445] .load : 0 [55739.037598] .runnable_load_avg : 0 [55739.042749] .blocked_load_avg : 0 [55739.047901] .tg_load_avg : 0 [55739.053055] .tg_load_contrib : 0 [55739.058216] .tg_runnable_contrib : 0 [55739.063368] .tg->runnable_avg : 0 [55739.068520] .tg->cfs_bandwidth.timer_active: 0 [55739.073674] .throttled : 0 [55739.078828] .throttle_count : 0 [55739.083982] .avg->runnable_avg_sum : 47 [55739.089232] .avg->runnable_avg_period : 46925 [55739.096435] rt_rq[11]:/ [55739.099163] .rt_nr_running : 0 [55739.104314] .rt_throttled : 0 [55739.109467] .rt_time : 0.050152 [55739.115299] .rt_runtime : 950.000000 [55739.122987] runnable tasks: [55739.126102] task PID tree-key switches prio wait-time sum-exec sum-sleep [55739.138146] ---------------------------------------------------------------------------------------------------------- [55739.150106] watchdog/11 64 -11.906914 13938 0 0.000000 225.438046 0.000000 1 / [55739.162525] migration/11 65 0.000000 251 0 0.000000 1117.301826 0.000000 1 / [55739.174954] ksoftirqd/11 66 69962.912224 12478 120 0.000000 260.936256 0.000000 1 / [55739.187376] kworker/11:0H 68 348.380074 9 100 0.000000 0.054032 0.000000 1 / [55739.199795] kdevtmpfs 171 4303.105054 259 120 0.000000 5.249342 0.000000 1 / [55739.212202] kworker/11:1 217 312.457551 28 120 0.000000 0.476683 0.000000 1 / [55739.224635] kauditd 332 69969.567629 61057 120 0.000000 2440.716126 0.000000 1 / [55739.237040] multipathd 1251 0.000000 37 0 0.000000 15.653049 0.000000 1 / [55739.249458] multipathd 1258 0.000000 102671 0 0.000000 10300.437846 0.000000 1 / [55739.261875] kworker/11:2 1255 69964.319502 11626 120 0.000000 334.388423 0.000000 1 / [55739.274282] kdmflush 2037 360.379890 2 100 0.000000 0.008124 0.000000 1 / [55739.286681] kworker/11:1H 2048 69964.080930 31033 100 0.000000 651.991051 0.000000 1 / [55739.299116] rpcbind 2280 69963.068746 1870 120 0.000000 140.981098 0.000000 1 / [55739.311540] sssd_pam 2516 69964.217978 11152 120 0.000000 466.100733 0.000000 1 / [55739.323948] master 3230 69963.443793 3007 120 0.000000 284.141240 0.000000 1 / [55739.336361] crond 3324 69964.152939 1045 120 0.000000 134.166892 0.000000 1 / [55739.348779] kiblnd_sd_01_02 4848 69974.993100 6064237 120 0.000000 103334.872390 0.000000 1 / [55739.361182] ptlrpcd_01_00 4869 69964.302090 48859 120 0.000000 2317.058845 0.000000 1 / [55739.373609] ptlrpcd_01_12 4881 69964.328438 48678 120 0.000000 2265.030762 0.000000 1 / [55739.386026] jbd2/dm-0-8 4886 68547.754491 91691 120 0.000000 25533.665204 0.000000 1 / [55739.398462] mdt_rdpg01_001 4921 63819.595020 23743 120 0.000000 1469.806940 0.000000 1 / [55739.410884] osp-syn-2-0 4963 63820.371069 13892 120 0.000000 371.711861 0.000000 1 / [55739.423304] osp-pre-4-0 4968 69964.142793 11080 120 0.000000 469.441891 0.000000 1 / [55739.435707] osp-syn-8-0 4975 63820.869693 14093 120 0.000000 388.736302 0.000000 1 / [55739.448131] mdt01_003 4994 64217.321636 87158 120 0.000000 8760.312005 0.000000 1 / [55739.460554] mdt_out01_002 5131 63168.116082 127573 120 0.000000 9504.151786 0.000000 1 / [55739.472990] mdt_out01_014 5731 63175.042567 100766 120 0.000000 7473.643052 0.000000 1 / [55739.485446] mdt_out01_022 5895 65037.945801 211342 120 0.000000 16495.249079 0.000000 1 / [55739.497859] mdt_rdpg01_005 5898 61635.724252 17991 120 0.000000 1272.977413 0.000000 1 / [55739.510260] mdt01_018 7356 69963.429812 81980 120 0.000000 7587.948507 0.000000 1 / [55739.522686] mdt_rdpg01_014 7836 61635.044262 14633 120 0.000000 1111.408552 0.000000 1 / [55739.535082] ldlm_cb01_009 13420 43030.393870 7092 120 0.000000 285.284350 0.000000 1 / [55739.549212] cpu#12, 2693.545 MHz [55739.552820] .nr_running : 0 [55739.558004] .load : 0 [55739.563201] .nr_switches : 5537402 [55739.568974] .nr_load_updates : 1463068 [55739.574757] .nr_uninterruptible : 8 [55739.579932] .next_balance : 4350.409981 [55739.586110] .curr->pid : 0 [55739.591299] .clock : 55739590.964266 [55739.597852] .cpu_load[0] : 0 [55739.603072] .cpu_load[1] : 0 [55739.608270] .cpu_load[2] : 0 [55739.613450] .cpu_load[3] : 0 [55739.618631] .cpu_load[4] : 0 [55739.623825] .avg_idle : 1000000 [55739.629595] .max_idle_balance_cost : 500000 [55739.636931] cfs_rq[12]:/ [55739.639758] .exec_clock : 0.000000 [55739.645590] .MIN_vruntime : 0.000001 [55739.651428] .min_vruntime : 101733.015636 [55739.657744] .max_vruntime : 0.000001 [55739.663584] .spread : 0.000000 [55739.669422] .spread0 : 16869.290831 [55739.675641] .nr_spread_over : 0 [55739.680793] .nr_running : 0 [55739.685944] .load : 0 [55739.691096] .runnable_load_avg : 0 [55739.696255] .blocked_load_avg : 0 [55739.701408] .tg_load_avg : 0 [55739.706561] .tg_load_contrib : 0 [55739.711713] .tg_runnable_contrib : 0 [55739.716866] .tg->runnable_avg : 0 [55739.722026] .tg->cfs_bandwidth.timer_active: 0 [55739.727179] .throttled : 0 [55739.732332] .throttle_count : 0 [55739.737484] .avg->runnable_avg_sum : 8 [55739.742639] .avg->runnable_avg_period : 47219 [55739.749837] rt_rq[12]:/ [55739.752567] .rt_nr_running : 0 [55739.757719] .rt_throttled : 0 [55739.762873] .rt_time : 0.000000 [55739.768706] .rt_runtime : 950.000000 [55739.776385] runnable tasks: [55739.779502] task PID tree-key switches prio wait-time sum-exec sum-sleep [55739.791538] ---------------------------------------------------------------------------------------------------------- [55739.803492] watchdog/12 69 -11.906921 13938 0 0.000000 235.977611 0.000000 1 / [55739.815890] migration/12 70 0.000000 264 0 0.000000 1274.599532 0.000000 1 / [55739.828308] ksoftirqd/12 71 97745.629807 12765 120 0.000000 258.360240 0.000000 1 / [55739.840718] kworker/12:0H 73 129.587628 8 100 0.000000 0.169181 0.000000 1 / [55739.853142] kworker/12:1 255 101721.025144 7768 120 0.000000 232.108942 0.000000 1 / [55739.865548] scsi_eh_4 1022 582.288373 23 120 0.000000 0.858762 0.000000 1 / [55739.877956] scsi_eh_5 1024 582.287629 23 120 0.000000 0.644580 0.000000 1 / [55739.890380] kworker/12:1H 1102 101123.561775 19630 100 0.000000 421.693771 0.000000 1 / [55739.902792] multipathd 1252 560.138329 36 120 0.000000 3.932406 0.000000 1 / [55739.915208] irqbalance 2256 101733.015636 6388 120 0.000000 47095.228193 0.000000 1 / [55739.927613] sssd_be 2447 101721.074279 13141 120 0.000000 1507.117356 0.000000 1 / [55739.940010] sssd_ssh 2517 101721.056832 25215 120 0.000000 1666.943728 0.000000 1 / [55739.952414] xinetd 2981 588.421210 17 120 0.000000 14.843930 0.000000 1 / [55739.964843] kworker/12:2 4425 2199.707555 2 120 0.000000 0.020654 0.000000 1 / [55739.977277] ptlrpcd_01_03 4872 101713.349073 52258 120 0.000000 2286.503977 0.000000 1 / [55739.989701] ldlm_cb01_001 4893 74981.536547 34923 120 0.000000 1929.082890 0.000000 1 / [55740.002132] osp_up3-0 4956 59432.987154 33233 120 0.000000 1841.595574 0.000000 1 / [55740.014565] osp-pre-1-0 4961 101713.176352 11066 120 0.000000 473.020100 0.000000 1 / [55740.026984] osp-syn-4-0 4967 69362.903700 14259 120 0.000000 377.862066 0.000000 1 / [55740.039392] osp-pre-4-0 4968 101721.140333 11081 120 0.000000 469.503617 0.000000 1 / [55740.051827] mdt01_007 5194 60902.830310 126303 120 0.000000 11675.690784 0.000000 1 / [55740.064231] mdt_rdpg01_003 5203 60928.594208 17803 120 0.000000 1019.251763 0.000000 1 / [55740.076625] mdt_out01_008 5725 74993.555886 187941 120 0.000000 14896.713977 0.000000 1 / [55740.089053] mdt_io01_007 6599 23707.264687 2091 120 0.000000 154.722634 0.000000 1 / [55740.101474] mdt01_020 7362 60905.362722 43785 120 0.000000 3815.369078 0.000000 1 / [55740.113892] ldlm_cb01_008 13316 41757.855564 5713 120 0.000000 227.037386 0.000000 1 / [55740.128013] cpu#13, 2693.545 MHz [55740.131642] .nr_running : 0 [55740.136813] .load : 0 [55740.142000] .nr_switches : 5506499 [55740.147769] .nr_load_updates : 1273375 [55740.153553] .nr_uninterruptible : 33 [55740.158853] .next_balance : 4350.410561 [55740.165013] .curr->pid : 0 [55740.170201] .clock : 55740169.930665 [55740.176761] .cpu_load[0] : 0 [55740.181964] .cpu_load[1] : 0 [55740.187145] .cpu_load[2] : 0 [55740.192334] .cpu_load[3] : 0 [55740.197538] .cpu_load[4] : 0 [55740.202710] .avg_idle : 1000000 [55740.208478] .max_idle_balance_cost : 500000 [55740.215804] cfs_rq[13]:/ [55740.218629] .exec_clock : 0.000000 [55740.224459] .MIN_vruntime : 0.000001 [55740.230292] .min_vruntime : 66399.861786 [55740.236503] .max_vruntime : 0.000001 [55740.242335] .spread : 0.000000 [55740.248167] .spread0 : -18465.938735 [55740.254482] .nr_spread_over : 0 [55740.259640] .nr_running : 0 [55740.264792] .load : 0 [55740.269965] .runnable_load_avg : 0 [55740.275125] .blocked_load_avg : 0 [55740.280268] .tg_load_avg : 0 [55740.285421] .tg_load_contrib : 0 [55740.290573] .tg_runnable_contrib : 0 [55740.295731] .tg->runnable_avg : 0 [55740.300883] .tg->cfs_bandwidth.timer_active: 0 [55740.306047] .throttled : 0 [55740.311200] .throttle_count : 0 [55740.316353] .avg->runnable_avg_sum : 0 [55740.321505] .avg->runnable_avg_period : 46873 [55740.328700] rt_rq[13]:/ [55740.331430] .rt_nr_running : 0 [55740.336581] .rt_throttled : 0 [55740.341733] .rt_time : 0.000000 [55740.347565] .rt_runtime : 950.000000 [55740.355253] runnable tasks: [55740.358371] task PID tree-key switches prio wait-time sum-exec sum-sleep [55740.370407] ---------------------------------------------------------------------------------------------------------- [55740.382354] watchdog/13 74 -11.906721 13938 0 0.000000 227.275349 0.000000 1 / [55740.394743] migration/13 75 0.000000 245 0 0.000000 1058.581071 0.000000 1 / [55740.407166] ksoftirqd/13 76 65801.164379 12516 120 0.000000 252.864861 0.000000 1 / [55740.419599] kworker/13:0 77 -8.866462 21 120 0.000000 0.185922 0.000000 1 / [55740.432017] kworker/13:0H 78 409.226616 9 100 0.000000 0.046970 0.000000 1 / [55740.444454] kworker/13:1 238 66387.976486 5015 120 0.000000 138.430743 0.000000 1 / [55740.456877] scsi_eh_6 1026 440.222597 23 120 0.000000 0.883451 0.000000 1 / [55740.469300] kworker/13:1H 2071 65903.958969 18985 100 0.000000 417.446025 0.000000 1 / [55740.481733] ptlrpc_hr01_001 4825 60481.757133 28069 120 0.000000 894.853379 0.000000 1 / [55740.494156] ptlrpc_hr01_005 4829 61210.382947 28072 120 0.000000 887.784317 0.000000 1 / [55740.506596] ptlrpcd_01_06 4875 66388.034388 48984 120 0.000000 2337.702489 0.000000 1 / [55740.519014] ptlrpcd_01_08 4877 66388.068761 48578 120 0.000000 2317.081145 0.000000 1 / [55740.531441] ll_mgs_0000 4904 66388.824723 57386 120 0.000000 4155.827232 0.000000 1 / [55740.543854] osp-pre-6-0 4972 66387.918365 11056 120 0.000000 513.955684 0.000000 1 / [55740.556250] osp-syn-7-0 4973 60482.093227 12594 120 0.000000 395.320787 0.000000 1 / [55740.568670] osp-pre-7-0 4974 66387.895458 11017 120 0.000000 487.574356 0.000000 1 / [55740.581083] osp-pre-13-0 4986 66388.002817 11056 120 0.000000 487.254917 0.000000 1 / [55740.593496] mdt_out01_015 5732 61211.066163 153020 120 0.000000 11654.851180 0.000000 1 / [55740.605924] mdt01_014 6067 61209.760203 128822 120 0.000000 11754.976386 0.000000 1 / [55740.618373] mdt_io01_005 6555 22192.707857 1378 120 0.000000 121.370819 0.000000 1 / [55740.630796] ldlm_cn01_016 9414 60749.567503 48756 120 0.000000 2912.862564 0.000000 1 / [55740.643222] ldlm_cn01_018 9567 65855.859613 54460 120 0.000000 3345.084564 0.000000 1 / [55740.657361] cpu#14, 2693.545 MHz [55740.661017] .nr_running : 0 [55740.666185] .load : 0 [55740.671375] .nr_switches : 5559930 [55740.677146] .nr_load_updates : 1343526 [55740.682909] .nr_uninterruptible : 49 [55740.688205] .next_balance : 4350.411090 [55740.694357] .curr->pid : 0 [55740.699546] .clock : 55740698.894233 [55740.706105] .cpu_load[0] : 0 [55740.711309] .cpu_load[1] : 0 [55740.716504] .cpu_load[2] : 0 [55740.721685] .cpu_load[3] : 0 [55740.726880] .cpu_load[4] : 0 [55740.732069] .avg_idle : 1000000 [55740.737852] .max_idle_balance_cost : 500000 [55740.745171] cfs_rq[14]:/ [55740.748001] .exec_clock : 0.000000 [55740.753833] .MIN_vruntime : 0.000001 [55740.759666] .min_vruntime : 83644.011173 [55740.765884] .max_vruntime : 0.000001 [55740.771714] .spread : 0.000000 [55740.777548] .spread0 : -1221.789348 [55740.783759] .nr_spread_over : 0 [55740.788933] .nr_running : 0 [55740.794085] .load : 0 [55740.799237] .runnable_load_avg : 0 [55740.804390] .blocked_load_avg : 0 [55740.809543] .tg_load_avg : 0 [55740.814694] .tg_load_contrib : 0 [55740.819848] .tg_runnable_contrib : 0 [55740.825000] .tg->runnable_avg : 0 [55740.830159] .tg->cfs_bandwidth.timer_active: 0 [55740.835311] .throttled : 0 [55740.840463] .throttle_count : 0 [55740.845617] .avg->runnable_avg_sum : 33 [55740.850866] .avg->runnable_avg_period : 46845 [55740.858076] rt_rq[14]:/ [55740.860804] .rt_nr_running : 0 [55740.865957] .rt_throttled : 0 [55740.871110] .rt_time : 0.000000 [55740.876950] .rt_runtime : 950.000000 [55740.884634] runnable tasks: [55740.887749] task PID tree-key switches prio wait-time sum-exec sum-sleep [55740.899785] ---------------------------------------------------------------------------------------------------------- [55740.911733] watchdog/14 79 -11.909581 13938 0 0.000000 333.295978 0.000000 1 / [55740.924132] migration/14 80 0.000000 337 0 0.000000 1150.637459 0.000000 1 / [55740.936546] ksoftirqd/14 81 81716.195375 12027 120 0.000000 241.211742 0.000000 1 / [55740.948954] kworker/14:0 82 -8.903663 21 120 0.000000 0.148609 0.000000 1 / [55740.961353] kworker/14:0H 83 309.981509 9 100 0.000000 0.048196 0.000000 1 / [55740.973796] kworker/14:1 239 83632.028018 4891 120 0.000000 486.583872 0.000000 1 / [55740.986193] scsi_eh_2 1018 426.974252 23 120 0.000000 0.967922 0.000000 1 / [55740.998618] kworker/14:1H 1699 81503.660836 19063 100 0.000000 405.793795 0.000000 1 / [55741.011045] ptlrpcd_01_04 4873 83537.865066 48811 120 0.000000 2302.814670 0.000000 1 / [55741.023460] ldlm_bl_01 4900 83616.574315 38564 120 0.000000 980.110228 0.000000 1 / [55741.035874] ll_mgs_0002 4906 83624.827769 81395 120 0.000000 5974.449717 0.000000 1 / [55741.048283] mdt_out01_000 4928 59307.425671 233362 120 0.000000 18122.322696 0.000000 1 / [55741.060696] mdt_io01_001 4940 21526.755488 680 120 0.000000 59.610376 0.000000 1 / [55741.073147] osp-pre-2-0 4964 83603.833313 11052 120 0.000000 507.689988 0.000000 1 / [55741.085557] ldlm_cn01_010 5397 72569.477096 159989 120 0.000000 8095.134371 0.000000 1 / [55741.097984] mdt01_012 5722 36927.863950 25073 120 0.000000 2477.061843 0.000000 1 / [55741.110418] mdt_io01_003 6551 21527.535434 3059 120 0.000000 273.830184 0.000000 1 / [55741.122829] mdt01_023 7875 57301.751400 73529 120 0.000000 7739.229784 0.000000 1 / [55741.135237] kworker/u306:1 12369 72493.366595 13 120 0.000000 0.993769 0.000000 1 / [55741.149353] cpu#15, 2693.545 MHz [55741.153001] .nr_running : 0 [55741.158165] .load : 0 [55741.163317] .nr_switches : 5527103 [55741.169074] .nr_load_updates : 1284397 [55741.174862] .nr_uninterruptible : 48 [55741.180133] .next_balance : 4350.411582 [55741.186298] .curr->pid : 0 [55741.191486] .clock : 55741186.334914 [55741.198038] .cpu_load[0] : 0 [55741.203213] .cpu_load[1] : 0 [55741.208410] .cpu_load[2] : 0 [55741.213614] .cpu_load[3] : 0 [55741.218795] .cpu_load[4] : 0 [55741.224000] .avg_idle : 1000000 [55741.229778] .max_idle_balance_cost : 500000 [55741.237108] cfs_rq[15]:/ [55741.239934] .exec_clock : 0.000000 [55741.245765] .MIN_vruntime : 0.000001 [55741.251603] .min_vruntime : 81072.783486 [55741.257823] .max_vruntime : 0.000001 [55741.263655] .spread : 0.000000 [55741.269487] .spread0 : -3794.456164 [55741.275706] .nr_spread_over : 0 [55741.280858] .nr_running : 0 [55741.286011] .load : 0 [55741.291165] .runnable_load_avg : 0 [55741.296317] .blocked_load_avg : 0 [55741.301468] .tg_load_avg : 0 [55741.306621] .tg_load_contrib : 0 [55741.311774] .tg_runnable_contrib : 0 [55741.316927] .tg->runnable_avg : 0 [55741.322080] .tg->cfs_bandwidth.timer_active: 0 [55741.327231] .throttled : 0 [55741.332383] .throttle_count : 0 [55741.337534] .avg->runnable_avg_sum : 3 [55741.342686] .avg->runnable_avg_period : 47205 [55741.349888] rt_rq[15]:/ [55741.352616] .rt_nr_running : 0 [55741.357768] .rt_throttled : 0 [55741.362923] .rt_time : 0.023746 [55741.368753] .rt_runtime : 950.000000 [55741.376439] runnable tasks: [55741.379554] task PID tree-key switches prio wait-time sum-exec sum-sleep [55741.391589] ---------------------------------------------------------------------------------------------------------- [55741.403545] watchdog/15 84 -11.909427 13939 0 0.000000 237.801703 0.000000 1 / [55741.415945] migration/15 85 0.000000 245 0 0.000000 1401.722415 0.000000 1 / [55741.428357] ksoftirqd/15 86 79531.753816 11913 120 0.000000 248.231354 0.000000 1 / [55741.440762] kworker/15:0 87 -8.907160 20 120 0.000000 0.144889 0.000000 1 / [55741.453184] kworker/15:0H 88 454.689999 9 100 0.000000 0.049145 0.000000 1 / [55741.465622] khungtaskd 173 81036.976057 466 120 0.000000 1887.833822 0.000000 1 / [55741.478028] khugepaged 195 81072.783486 5576 139 0.000000 264.029499 0.000000 1 / [55741.490429] kworker/15:1 213 81061.957702 31294 120 0.000000 11336.261620 0.000000 1 / [55741.502846] kworker/15:1H 2050 80876.767107 18715 100 0.000000 401.597504 0.000000 1 / [55741.515279] rpc.statd 2973 735.148876 13 120 0.000000 56.214892 0.000000 1 / [55741.527698] automount 3361 81055.772658 2986 120 0.000000 149.594079 0.000000 1 / [55741.540117] ptlrpc_hr01_002 4826 63033.647346 28072 120 0.000000 880.657529 0.000000 1 / [55741.552553] ptlrpc_hr01_003 4827 63033.665552 28076 120 0.000000 871.060229 0.000000 1 / [55741.564980] ptlrpcd_01_02 4871 81058.586371 48696 120 0.000000 2317.202898 0.000000 1 / [55741.577393] ptlrpcd_01_05 4874 81058.514507 51996 120 0.000000 2290.927564 0.000000 1 / [55741.589823] ptlrpcd_01_11 4880 81060.898695 52228 120 0.000000 2250.766413 0.000000 1 / [55741.602228] ptlrpcd_01_13 4882 81060.847329 52174 120 0.000000 2281.325836 0.000000 1 / [55741.614626] ptlrpcd_01_14 4883 81060.968079 48831 120 0.000000 2273.624450 0.000000 1 / [55741.627026] mdt01_001 4916 65721.446663 89461 120 0.000000 8508.389281 0.000000 1 / [55741.639443] mdt_out01_001 4929 60888.008334 224470 120 0.000000 17366.367002 0.000000 1 / [55741.651857] mdt_io01_002 4941 21648.056583 2120 120 0.000000 236.526813 0.000000 1 / [55741.664286] osp-syn-13-0 4985 63036.000597 13995 120 0.000000 383.111490 0.000000 1 / [55741.676720] lquota_wb_soake 4996 81058.455315 928 120 0.000000 22.071775 0.000000 1 / [55741.689133] mdt_out01_004 5185 81061.169428 211933 120 0.000000 16511.048173 0.000000 1 / [55741.701538] ldlm_cn01_008 5192 65306.779923 112889 120 0.000000 6430.592312 0.000000 1 / [55741.713972] ldlm_cb01_002 5197 39186.716115 41448 120 0.000000 2348.919606 0.000000 1 / [55741.726403] mdt01_009 5198 59185.479941 150788 120 0.000000 13847.606052 0.000000 1 / [55741.738827] mdt01_010 5201 64756.571905 140605 120 0.000000 13434.023082 0.000000 1 / [55741.751241] mdt_out01_007 5407 60883.099985 164997 120 0.000000 12564.991272 0.000000 1 / [55741.763657] mdt_out01_012 5729 81060.999220 172982 120 0.000000 13237.346054 0.000000 1 / [55741.776063] mdt01_015 6069 81061.081302 93498 120 0.000000 9046.763495 0.000000 1 / [55741.788459] mdt_rdpg01_010 6715 77775.257560 15739 120 0.000000 1230.660876 0.000000 1 / [55741.800867] mdt01_021 7363 59148.967666 112904 120 0.000000 10314.868674 0.000000 1 / [55741.813273] mdt01_022 7365 59160.876128 120999 120 0.000000 11085.192256 0.000000 1 / [55741.825690] ldlm_cn01_019 9568 79601.155117 49905 120 0.000000 3119.490605 0.000000 1 / [55741.838101] mdt_io01_009 10527 21648.254970 326 120 0.000000 27.851407 0.000000 1 / [55741.850532] ldlm_bl_07 13872 81058.456132 13665 120 0.000000 234.298519 0.000000 1 / [55741.864650] cpu#16, 2693.545 MHz [55741.868259] .nr_running : 0 [55741.873462] .load : 0 [55741.878652] .nr_switches : 600939 [55741.884314] .nr_load_updates : 511324 [55741.889988] .nr_uninterruptible : -18 [55741.895380] .next_balance : 4350.412297 [55741.901543] .curr->pid : 0 [55741.906733] .clock : 55741905.835510 [55741.913257] .cpu_load[0] : 0 [55741.918461] .cpu_load[1] : 0 [55741.923649] .cpu_load[2] : 0 [55741.928832] .cpu_load[3] : 0 [55741.934026] .cpu_load[4] : 0 [55741.939206] .avg_idle : 780961 [55741.944893] .max_idle_balance_cost : 500000 [55741.952244] cfs_rq[16]:/ [55741.955062] .exec_clock : 0.000000 [55741.960895] .MIN_vruntime : 0.000001 [55741.966727] .min_vruntime : 34795.653182 [55741.972946] .max_vruntime : 0.000001 [55741.978777] .spread : 0.000000 [55741.984608] .spread0 : -50075.070320 [55741.990925] .nr_spread_over : 0 [55741.996084] .nr_running : 0 [55742.001238] .load : 0 [55742.006390] .runnable_load_avg : 0 [55742.011541] .blocked_load_avg : 0 [55742.016694] .tg_load_avg : 0 [55742.021860] .tg_load_contrib : 0 [55742.027022] .tg_runnable_contrib : 0 [55742.032176] .tg->runnable_avg : 0 [55742.037327] .tg->cfs_bandwidth.timer_active: 0 [55742.042481] .throttled : 0 [55742.047635] .throttle_count : 0 [55742.052795] .avg->runnable_avg_sum : 32 [55742.058044] .avg->runnable_avg_period : 47344 [55742.065246] rt_rq[16]:/ [55742.067976] .rt_nr_running : 0 [55742.073129] .rt_throttled : 0 [55742.078281] .rt_time : 0.000000 [55742.084113] .rt_runtime : 950.000000 [55742.091801] runnable tasks: [55742.094916] task PID tree-key switches prio wait-time sum-exec sum-sleep [55742.106958] ---------------------------------------------------------------------------------------------------------- [55742.118929] watchdog/16 89 -11.916300 13940 0 0.000000 208.093586 0.000000 0 / [55742.131333] migration/16 90 0.000000 1397 0 0.000000 1082.474976 0.000000 0 / [55742.143731] ksoftirqd/16 91 34797.974820 1042 120 0.000000 9.498761 0.000000 0 / [55742.156121] kworker/16:0 92 -8.896089 21 120 0.000000 0.155659 0.000000 0 / [55742.168534] kworker/16:0H 93 567.702815 9 100 0.000000 0.103348 0.000000 0 / [55742.180953] kworker/16:1 240 34783.745180 3691 120 0.000000 187.275461 0.000000 0 / [55742.193365] kdmwork-253:0 2021 34783.691667 185411 120 0.000000 11175.285286 0.000000 0 / [55742.205778] kworker/16:1H 2366 34783.653567 2300 100 0.000000 41.065199 0.000000 0 / [55742.218186] sshd 2957 34784.604702 7060 120 0.000000 2687.365064 0.000000 0 / [55742.230581] ntpd 3976 34699.887083 2883 120 0.000000 296.594016 0.000000 0 / [55742.243006] ptlrpc_hr00_004 4820 19122.181016 22356 120 0.000000 547.396501 0.000000 0 / [55742.255431] ldlm_cn00_001 4895 19708.038367 53046 120 0.000000 2971.596143 0.000000 0 / [55742.267858] lquota_wb_soake 4995 34758.777011 928 120 0.000000 22.383806 0.000000 0 / [55742.280280] mdt00_007 5196 21622.348582 107094 120 0.000000 9450.490489 0.000000 0 / [55742.292704] mdt00_018 7358 34783.679113 35643 120 0.000000 3368.504528 0.000000 0 / [55742.305133] ldlm_cn00_018 15246 15828.636700 7434 120 0.000000 402.859247 0.000000 0 / [55742.317565] sshd 97171 34810.024673 9 120 0.000000 19.181678 0.000000 0 / [55742.331645] cpu#17, 2693.545 MHz [55742.335256] .nr_running : 0 [55742.340416] .load : 0 [55742.345597] .nr_switches : 831013 [55742.351242] .nr_load_updates : 1067776 [55742.356985] .nr_uninterruptible : -576 [55742.362433] .next_balance : 4350.412769 [55742.368564] .curr->pid : 0 [55742.373726] .clock : 55742372.774441 [55742.380262] .cpu_load[0] : 0 [55742.385466] .cpu_load[1] : 0 [55742.390671] .cpu_load[2] : 0 [55742.395851] .cpu_load[3] : 0 [55742.401016] .cpu_load[4] : 0 [55742.406190] .avg_idle : 1000000 [55742.411954] .max_idle_balance_cost : 500000 [55742.419261] cfs_rq[17]:/ [55742.422087] .exec_clock : 0.000000 [55742.427920] .MIN_vruntime : 0.000001 [55742.433753] .min_vruntime : 884051.978084 [55742.440071] .max_vruntime : 0.000001 [55742.445904] .spread : 0.000000 [55742.451735] .spread0 : 799169.290567 [55742.458052] .nr_spread_over : 0 [55742.463206] .nr_running : 0 [55742.468350] .load : 0 [55742.473501] .runnable_load_avg : 0 [55742.478653] .blocked_load_avg : 417 [55742.484001] .tg_load_avg : 0 [55742.489152] .tg_load_contrib : 0 [55742.494304] .tg_runnable_contrib : 0 [55742.499457] .tg->runnable_avg : 0 [55742.504611] .tg->cfs_bandwidth.timer_active: 0 [55742.509763] .throttled : 0 [55742.514915] .throttle_count : 0 [55742.520067] .avg->runnable_avg_sum : 4664 [55742.525510] .avg->runnable_avg_period : 46222 [55742.532714] rt_rq[17]:/ [55742.535443] .rt_nr_running : 0 [55742.540596] .rt_throttled : 0 [55742.545748] .rt_time : 0.000000 [55742.551580] .rt_runtime : 950.000000 [55742.559267] runnable tasks: [55742.562384] task PID tree-key switches prio wait-time sum-exec sum-sleep [55742.574422] ---------------------------------------------------------------------------------------------------------- [55742.586389] watchdog/17 94 -11.932909 13939 0 0.000000 218.414573 0.000000 0 / [55742.598777] migration/17 95 0.000000 23853 0 0.000000 1555.448019 0.000000 0 / [55742.611168] ksoftirqd/17 96 883733.408602 30797 120 0.000000 562.217763 0.000000 0 / [55742.623567] kworker/17:0H 98 5211.885497 9 100 0.000000 0.065065 0.000000 0 / [55742.635964] kworker/17:1 187 883982.605760 7281 120 0.000000 1143.194085 0.000000 0 / [55742.648394] spl_system_task 2085 3779.934364 2 100 0.000000 0.009135 0.000000 0 / [55742.660797] arc_prune 2155 4116.646976 2 120 0.000000 0.031048 0.000000 0 / [55742.673185] zthr_procedure 2156 4129.169028 2 139 0.000000 0.070095 0.000000 0 / [55742.685588] dbu_evict 2158 4153.743149 2 120 0.000000 0.071240 0.000000 0 / [55742.697977] z_vdev_file 2175 4180.120968 2 139 0.000000 0.090984 0.000000 0 / [55742.710382] gmain 2281 4748.069655 2 120 0.000000 0.203201 0.000000 0 / [55742.722784] gssproxy 2375 5125.782673 1 120 0.000000 0.095756 0.000000 0 / [55742.735187] gssproxy 2378 5137.813718 1 120 0.000000 0.031051 0.000000 0 / [55742.747587] kworker/17:1H 2406 883733.372905 43953 100 0.000000 988.407824 0.000000 0 / [55742.759978] mlx4_en 2470 5475.327902 2 100 0.000000 0.067307 0.000000 0 / [55742.772374] tuned 3237 8258.328992 2 120 0.000000 0.386218 0.000000 0 / [55742.784798] ptlrpcd_00_00 4853 883982.350404 55362 120 0.000000 2981.801089 0.000000 0 / [55742.797219] ldiskfs-rsv-con 4887 17946.691411 2 100 0.000000 0.079909 0.000000 0 / [55742.809620] ldlm_elt 4902 18067.332270 2 120 0.000000 0.012087 0.000000 0 / [55742.822015] mdt00_001 4913 164380.948599 96674 120 0.000000 9238.828912 0.000000 0 / [55742.834417] mdt_attr00_000 4922 18236.742937 2 120 0.000000 0.107034 0.000000 0 / [55742.846817] mdt_seqs_0000 4930 18321.210205 2 120 0.000000 0.107568 0.000000 0 / [55742.859205] mdt_fld_0001 4935 410083.330501 18 120 0.000000 1.067419 0.000000 0 / [55742.871614] qmt_reba_soaked 4949 18503.643947 2 120 0.000000 0.046748 0.000000 0 / [55742.884013] osp-pre-10-0 4980 883982.186547 11045 120 0.000000 474.052702 0.000000 0 / [55742.896433] osp-pre-11-0 4982 883982.157443 11015 120 0.000000 469.333638 0.000000 0 / [55742.908828] osp-syn-14-0 4987 310534.378272 12552 120 0.000000 378.259654 0.000000 0 / [55742.921235] mdt00_003 5009 409736.536178 103225 120 0.000000 8645.921474 0.000000 0 / [55742.933637] kworker/17:0 5947 27776.723148 2 120 0.000000 0.042091 0.000000 0 / [55742.946032] mdt_rdpg00_012 6719 174575.541160 15015 120 0.000000 1072.619959 0.000000 0 / [55742.958435] mdt00_016 7354 385699.373580 37637 120 0.000000 3438.170082 0.000000 0 / [55742.970834] mdt00_022 14021 174029.926421 29127 120 0.000000 2374.825727 0.000000 0 / [55742.983264] mdt_out00_011 15542 173657.048086 45589 120 0.000000 3776.317543 0.000000 0 / [55742.995651] ldlm_cn00_025 16738 410083.344267 6451 120 0.000000 343.861271 0.000000 0 / [55743.008057] bash 97174 884062.273773 14 120 0.000000 18.438572 0.000000 0 / [55743.022151] cpu#18, 2693.545 MHz [55743.025758] .nr_running : 0 [55743.030935] .load : 0 [55743.036117] .nr_switches : 688039 [55743.041812] .nr_load_updates : 562214 [55743.047493] .nr_uninterruptible : -370 [55743.052959] .next_balance : 4350.413457 [55743.059091] .curr->pid : 0 [55743.064264] .clock : 55743063.744875 [55743.070806] .cpu_load[0] : 0 [55743.075965] .cpu_load[1] : 0 [55743.081139] .cpu_load[2] : 0 [55743.086299] .cpu_load[3] : 0 [55743.091460] .cpu_load[4] : 124 [55743.096811] .avg_idle : 1000000 [55743.102553] .max_idle_balance_cost : 500000 [55743.109858] cfs_rq[18]:/ [55743.112683] .exec_clock : 0.000000 [55743.118516] .MIN_vruntime : 0.000001 [55743.124347] .min_vruntime : 89413.211177 [55743.130566] .max_vruntime : 0.000001 [55743.136399] .spread : 0.000000 [55743.142221] .spread0 : 4530.523660 [55743.148343] .nr_spread_over : 0 [55743.153496] .nr_running : 0 [55743.158648] .load : 0 [55743.163803] .runnable_load_avg : 0 [55743.168947] .blocked_load_avg : 1860 [55743.174391] .tg_load_avg : 0 [55743.179543] .tg_load_contrib : 0 [55743.184697] .tg_runnable_contrib : 0 [55743.189849] .tg->runnable_avg : 0 [55743.195008] .tg->cfs_bandwidth.timer_active: 0 [55743.200162] .throttled : 0 [55743.205315] .throttle_count : 0 [55743.210467] .avg->runnable_avg_sum : 3221 [55743.215912] .avg->runnable_avg_period : 47064 [55743.223121] rt_rq[18]:/ [55743.225850] .rt_nr_running : 0 [55743.231006] .rt_throttled : 0 [55743.236160] .rt_time : 0.000000 [55743.241993] .rt_runtime : 950.000000 [55743.249671] runnable tasks: [55743.252796] task PID tree-key switches prio wait-time sum-exec sum-sleep [55743.264837] ---------------------------------------------------------------------------------------------------------- [55743.276815] watchdog/18 99 -11.924400 13940 0 0.000000 215.225612 0.000000 0 / [55743.289261] migration/18 100 0.000000 3170 0 0.000000 1092.616008 0.000000 0 / [55743.301668] ksoftirqd/18 101 89233.011329 13121 120 0.000000 199.899047 0.000000 0 / [55743.314070] kworker/18:0H 103 2351.660656 9 100 0.000000 0.052185 0.000000 0 / [55743.326500] kworker/18:1 241 89233.075868 5357 120 0.000000 215.151534 0.000000 0 / [55743.338919] spl_delay_taskq 2086 1954.890060 2 100 0.000000 0.010257 0.000000 0 / [55743.351344] spl_dynamic_tas 2087 1966.893964 2 100 0.000000 0.007374 0.000000 0 / [55743.363765] spl_kmem_cache 2088 2004.276910 3 100 0.000000 0.180387 0.000000 0 / [55743.376185] kworker/18:1H 2367 81624.645436 10965 100 0.000000 186.467663 0.000000 0 / [55743.388584] gssproxy 2376 2388.326639 1 120 0.000000 0.067180 0.000000 0 / [55743.401009] mlx5_ib_sigerr_ 2501 2683.009063 2 100 0.000000 0.067713 0.000000 0 / [55743.413420] ipoib_wq 2557 2841.679475 2 100 0.000000 0.051100 0.000000 0 / [55743.425836] rdma_cm 2583 2950.763034 2 100 0.000000 0.012101 0.000000 0 / [55743.438251] gmain 3232 3504.427013 1 120 0.000000 0.087388 0.000000 0 / [55743.450689] nfsiod 3007 3268.991925 2 100 0.000000 0.009106 0.000000 0 / [55743.463115] ptlrpc_hr00_005 4821 42528.422601 22354 120 0.000000 538.950340 0.000000 0 / [55743.475548] ptlrpcd_00_08 4861 89233.142353 55589 120 0.000000 3009.014205 0.000000 0 / [55743.487987] mdt_attr00_001 4923 5363.440305 2 120 0.000000 0.094670 0.000000 0 / [55743.500414] osp-syn-1-0 4960 42528.664544 14332 120 0.000000 371.726948 0.000000 0 / [55743.512855] ldlm_cn00_003 5143 30937.555922 56104 120 0.000000 3218.342402 0.000000 0 / [55743.525291] mdt_out00_002 5212 30764.438759 73635 120 0.000000 6043.852391 0.000000 0 / [55743.537699] ldlm_cn00_006 5217 50375.541927 36162 120 0.000000 2202.992227 0.000000 0 / [55743.550123] ldlm_cb00_004 6074 20358.804759 24933 120 0.000000 1250.507522 0.000000 0 / [55743.562531] mdt_rdpg00_011 6716 77595.549822 8426 120 0.000000 633.173726 0.000000 0 / [55743.574963] kworker/18:2 92656 85628.633335 4 120 0.000000 0.062513 0.000000 0 / [55743.589068] cpu#19, 2693.545 MHz [55743.592678] .nr_running : 0 [55743.597844] .load : 0 [55743.603020] .nr_switches : 2881930 [55743.608762] .nr_load_updates : 860296 [55743.614449] .nr_uninterruptible : 59 [55743.619753] .next_balance : 4350.414021 [55743.625893] .curr->pid : 0 [55743.631076] .clock : 55743630.721699 [55743.637630] .cpu_load[0] : 0 [55743.642812] .cpu_load[1] : 0 [55743.647987] .cpu_load[2] : 0 [55743.653153] .cpu_load[3] : 0 [55743.658340] .cpu_load[4] : 0 [55743.663544] .avg_idle : 713529 [55743.669225] .max_idle_balance_cost : 500000 [55743.676534] cfs_rq[19]:/ [55743.679361] .exec_clock : 0.000000 [55743.685194] .MIN_vruntime : 0.000001 [55743.691016] .min_vruntime : 54144.567089 [55743.697235] .max_vruntime : 0.000001 [55743.703066] .spread : 0.000000 [55743.708897] .spread0 : -30741.582096 [55743.715213] .nr_spread_over : 0 [55743.720367] .nr_running : 0 [55743.725519] .load : 0 [55743.730671] .runnable_load_avg : 0 [55743.735823] .blocked_load_avg : 12 [55743.741072] .tg_load_avg : 0 [55743.746225] .tg_load_contrib : 0 [55743.751376] .tg_runnable_contrib : 0 [55743.756530] .tg->runnable_avg : 0 [55743.761683] .tg->cfs_bandwidth.timer_active: 0 [55743.766836] .throttled : 0 [55743.771989] .throttle_count : 0 [55743.777142] .avg->runnable_avg_sum : 11 [55743.782390] .avg->runnable_avg_period : 46658 [55743.789595] rt_rq[19]:/ [55743.792324] .rt_nr_running : 0 [55743.797476] .rt_throttled : 0 [55743.802630] .rt_time : 0.000000 [55743.808462] .rt_runtime : 950.000000 [55743.816150] runnable tasks: [55743.819264] task PID tree-key switches prio wait-time sum-exec sum-sleep [55743.831300] ---------------------------------------------------------------------------------------------------------- [55743.843257] watchdog/19 104 -11.923173 13940 0 0.000000 224.258878 0.000000 0 / [55743.855656] migration/19 105 0.000000 1535 0 0.000000 1071.847541 0.000000 0 / [55743.868055] ksoftirqd/19 106 53163.329789 780 120 0.000000 13.247188 0.000000 0 / [55743.880463] kworker/19:0H 108 1553.031844 9 100 0.000000 0.122395 0.000000 0 / [55743.892877] kworker/u308:0 1056 53215.016726 159872 100 0.000000 5084.741072 0.000000 0 / [55743.905313] mcelog 2325 1548.963273 1 120 0.000000 1.533175 0.000000 0 / [55743.917726] kworker/19:1H 2365 20192.161241 1715 100 0.000000 44.425700 0.000000 0 / [55743.930147] automount 3320 2153.001103 179 120 0.000000 144.512301 0.000000 0 / [55743.942579] kworker/u308:1 3848 54132.568052 298530 100 0.000000 8909.726297 0.000000 0 / [55743.954983] mdt_out00_001 4927 20192.177846 57329 120 0.000000 4298.576124 0.000000 0 / [55743.967426] mdt_out00_005 5408 20193.539430 63939 120 0.000000 5277.135389 0.000000 0 / [55743.979841] mdt00_014 6068 18795.948090 71798 120 0.000000 7135.371582 0.000000 0 / [55743.992264] mdt_io00_004 6553 7517.485037 346 120 0.000000 28.392653 0.000000 0 / [55744.004689] mdt_out00_008 15248 20189.704309 38481 120 0.000000 3105.698199 0.000000 0 / [55744.017101] mdt_out00_016 15697 20199.943326 30115 120 0.000000 2617.322293 0.000000 0 / [55744.029531] kworker/19:1 90654 52982.068696 23461 120 0.000000 1266.227991 0.000000 0 / [55744.041950] kworker/u304:1 92773 54133.612302 36028 120 0.000000 2232.727864 0.000000 0 / [55744.054358] kworker/19:0 93708 53380.161532 16184 120 0.000000 877.708170 0.000000 0 / [55744.066766] kworker/19:2 95833 54132.775352 9194 120 0.000000 493.289306 0.000000 0 / [55744.079167] kworker/u304:0 95930 54132.587478 10428 120 0.000000 636.769030 0.000000 0 / [55744.093265] cpu#20, 2693.545 MHz [55744.096903] .nr_running : 0 [55744.102066] .load : 0 [55744.107239] .nr_switches : 1137948 [55744.112996] .nr_load_updates : 566587 [55744.118642] .nr_uninterruptible : 20 [55744.123914] .next_balance : 4350.414526 [55744.130079] .curr->pid : 0 [55744.135267] .clock : 55744134.696439 [55744.141830] .cpu_load[0] : 0 [55744.147011] .cpu_load[1] : 0 [55744.152200] .cpu_load[2] : 0 [55744.157396] .cpu_load[3] : 0 [55744.162579] .cpu_load[4] : 0 [55744.167777] .avg_idle : 899687 [55744.173452] .max_idle_balance_cost : 500000 [55744.180781] cfs_rq[20]:/ [55744.183613] .exec_clock : 0.000000 [55744.189446] .MIN_vruntime : 0.000001 [55744.195278] .min_vruntime : 51577.058627 [55744.201497] .max_vruntime : 0.000001 [55744.207328] .spread : 0.000000 [55744.213161] .spread0 : -33309.090558 [55744.219468] .nr_spread_over : 0 [55744.224620] .nr_running : 0 [55744.229776] .load : 0 [55744.234936] .runnable_load_avg : 0 [55744.240089] .blocked_load_avg : 0 [55744.245240] .tg_load_avg : 0 [55744.250394] .tg_load_contrib : 0 [55744.255547] .tg_runnable_contrib : 0 [55744.260711] .tg->runnable_avg : 0 [55744.265863] .tg->cfs_bandwidth.timer_active: 0 [55744.271015] .throttled : 0 [55744.276169] .throttle_count : 0 [55744.281320] .avg->runnable_avg_sum : 0 [55744.286472] .avg->runnable_avg_period : 46831 [55744.293675] rt_rq[20]:/ [55744.296427] .rt_nr_running : 0 [55744.301581] .rt_throttled : 0 [55744.306733] .rt_time : 0.000000 [55744.312564] .rt_runtime : 950.000000 [55744.320251] runnable tasks: [55744.323368] task PID tree-key switches prio wait-time sum-exec sum-sleep [55744.335403] ---------------------------------------------------------------------------------------------------------- [55744.347359] watchdog/20 109 -11.933003 13939 0 0.000000 211.152949 0.000000 0 / [55744.359766] migration/20 110 0.000000 2876 0 0.000000 1093.933286 0.000000 0 / [55744.372191] ksoftirqd/20 111 50514.813718 2291 120 0.000000 32.639251 0.000000 0 / [55744.384610] kworker/20:0H 113 2254.354850 9 100 0.000000 0.111565 0.000000 0 / [55744.397027] kworker/20:1 242 51565.113019 3717 120 0.000000 209.318241 0.000000 0 / [55744.409446] ptlrpcd_00_09 4862 51032.336310 59038 120 0.000000 3014.510099 0.000000 0 / [55744.421858] osp-syn-0-0 4958 24063.669875 13660 120 0.000000 377.676016 0.000000 0 / [55744.434281] mdt00_008 5199 27127.698331 94755 120 0.000000 8523.874028 0.000000 0 / [55744.446703] kworker/20:1H 5211 44950.787447 4193 100 0.000000 104.597455 0.000000 0 / [55744.459124] kworker/20:2 5951 2935.518979 3 120 0.000000 0.211485 0.000000 0 / [55744.471548] ldlm_cb00_007 13724 12304.668639 5521 120 0.000000 197.841382 0.000000 0 / [55744.483958] mdt_out00_007 14102 18198.653616 42572 120 0.000000 3259.364951 0.000000 0 / [55744.496399] mdt_out00_013 15546 18195.820973 32470 120 0.000000 2603.501184 0.000000 0 / [55744.510516] cpu#21, 2693.545 MHz [55744.514148] .nr_running : 0 [55744.519330] .load : 0 [55744.524518] .nr_switches : 1138511 [55744.530273] .nr_load_updates : 879719 [55744.535954] .nr_uninterruptible : 41 [55744.541255] .next_balance : 4350.414943 [55744.547413] .curr->pid : 0 [55744.552603] .clock : 55744551.663399 [55744.559151] .cpu_load[0] : 0 [55744.564334] .cpu_load[1] : 0 [55744.569523] .cpu_load[2] : 0 [55744.574710] .cpu_load[3] : 0 [55744.579898] .cpu_load[4] : 0 [55744.585086] .avg_idle : 1000000 [55744.590863] .max_idle_balance_cost : 500000 [55744.598197] cfs_rq[21]:/ [55744.601024] .exec_clock : 0.000000 [55744.606855] .MIN_vruntime : 0.000001 [55744.612688] .min_vruntime : 35554.322921 [55744.618916] .max_vruntime : 0.000001 [55744.624751] .spread : 0.000000 [55744.630581] .spread0 : -49331.826264 [55744.636897] .nr_spread_over : 0 [55744.642050] .nr_running : 0 [55744.647202] .load : 0 [55744.652354] .runnable_load_avg : 0 [55744.657506] .blocked_load_avg : 0 [55744.662678] .tg_load_avg : 0 [55744.667830] .tg_load_contrib : 0 [55744.672983] .tg_runnable_contrib : 0 [55744.678136] .tg->runnable_avg : 0 [55744.683290] .tg->cfs_bandwidth.timer_active: 0 [55744.688444] .throttled : 0 [55744.693596] .throttle_count : 0 [55744.698757] .avg->runnable_avg_sum : 3 [55744.703910] .avg->runnable_avg_period : 46697 [55744.711119] rt_rq[21]:/ [55744.713848] .rt_nr_running : 0 [55744.719000] .rt_throttled : 0 [55744.724152] .rt_time : 0.000000 [55744.729983] .rt_runtime : 950.000000 [55744.737668] runnable tasks: [55744.740783] task PID tree-key switches prio wait-time sum-exec sum-sleep [55744.752820] ---------------------------------------------------------------------------------------------------------- [55744.764778] watchdog/21 114 -11.923267 13940 0 0.000000 215.020389 0.000000 0 / [55744.777181] migration/21 115 0.000000 1175 0 0.000000 1091.845151 0.000000 0 / [55744.789590] ksoftirqd/21 116 34559.157843 5218 120 0.000000 80.087902 0.000000 0 / [55744.801991] kworker/21:0 117 -8.890812 21 120 0.000000 0.160892 0.000000 0 / [55744.814404] kworker/21:0H 118 1673.606629 9 100 0.000000 0.079416 0.000000 0 / [55744.826830] kworker/21:1 245 35542.445365 3692 120 0.000000 223.350392 0.000000 0 / [55744.839262] kworker/21:1H 5190 21973.948226 8844 100 0.000000 191.365992 0.000000 0 / [55744.851669] mdt00_009 5200 35542.436320 124494 120 0.000000 10728.496575 0.000000 0 / [55744.864069] mdt_rdpg00_003 5202 17303.812543 31712 120 0.000000 1921.301788 0.000000 0 / [55744.876485] ldlm_cb00_006 13555 14484.729232 6568 120 0.000000 224.773306 0.000000 0 / [55744.888917] ldlm_cn00_022 15541 16993.111255 7471 120 0.000000 413.271311 0.000000 0 / [55744.901347] mdt_out00_018 16887 16868.050932 16078 120 0.000000 1307.860985 0.000000 0 / [55744.915443] cpu#22, 2693.545 MHz [55744.919074] .nr_running : 0 [55744.924240] .load : 0 [55744.929443] .nr_switches : 1751500 [55744.935200] .nr_load_updates : 1401871 [55744.940948] .nr_uninterruptible : -167 [55744.946444] .next_balance : 4350.415348 [55744.952607] .curr->pid : 0 [55744.957797] .clock : 55744957.642079 [55744.964342] .cpu_load[0] : 0 [55744.969531] .cpu_load[1] : 0 [55744.974724] .cpu_load[2] : 0 [55744.979914] .cpu_load[3] : 0 [55744.985109] .cpu_load[4] : 0 [55744.990290] .avg_idle : 1000000 [55744.996060] .max_idle_balance_cost : 500000 [55745.003397] cfs_rq[22]:/ [55745.006223] .exec_clock : 0.000000 [55745.012056] .MIN_vruntime : 0.000001 [55745.017879] .min_vruntime : 46420.642261 [55745.024098] .max_vruntime : 0.000001 [55745.029930] .spread : 0.000000 [55745.035762] .spread0 : -38465.506924 [55745.042077] .nr_spread_over : 0 [55745.047228] .nr_running : 0 [55745.052379] .load : 0 [55745.057533] .runnable_load_avg : 0 [55745.062686] .blocked_load_avg : 0 [55745.067839] .tg_load_avg : 0 [55745.072991] .tg_load_contrib : 0 [55745.078143] .tg_runnable_contrib : 0 [55745.083294] .tg->runnable_avg : 0 [55745.088446] .tg->cfs_bandwidth.timer_active: 0 [55745.093600] .throttled : 0 [55745.098753] .throttle_count : 0 [55745.103905] .avg->runnable_avg_sum : 0 [55745.109057] .avg->runnable_avg_period : 47799 [55745.116257] rt_rq[22]:/ [55745.118985] .rt_nr_running : 0 [55745.124138] .rt_throttled : 0 [55745.129289] .rt_time : 0.000000 [55745.135123] .rt_runtime : 950.000000 [55745.142801] runnable tasks: [55745.145915] task PID tree-key switches prio wait-time sum-exec sum-sleep [55745.157950] ---------------------------------------------------------------------------------------------------------- [55745.169902] watchdog/22 119 -11.933223 13939 0 0.000000 219.927869 0.000000 0 / [55745.182296] migration/22 120 0.000000 2027 0 0.000000 1100.944234 0.000000 0 / [55745.194711] ksoftirqd/22 121 46352.275793 10752 120 0.000000 198.604771 0.000000 0 / [55745.207148] kworker/22:0H 123 692.599797 7 100 0.000000 0.046402 0.000000 0 / [55745.219560] kworker/22:1H 1052 45517.620433 20369 100 0.000000 458.683077 0.000000 0 / [55745.231973] kdmwork-253:1 2027 1194.676295 98 120 0.000000 3.221881 0.000000 0 / [55745.244402] kworker/22:2 3849 46408.724243 10331 120 0.000000 303.920220 0.000000 0 / [55745.256801] ptlrpcd_rcv 4852 46369.485605 3459 120 0.000000 259.077879 0.000000 0 / [55745.269209] mgs_soaked_noti 4942 34182.790079 245 118 0.000000 35.568949 0.000000 0 / [55745.281643] ldlm_cb00_002 5193 12453.474907 24958 120 0.000000 1280.010837 0.000000 0 / [55745.294070] ldlm_cn00_004 5206 24920.951470 39810 120 0.000000 2248.012602 0.000000 0 / [55745.306506] mdt_io00_007 6559 8611.678960 218 120 0.000000 15.511972 0.000000 0 / [55745.318933] mdt_out00_015 15696 18090.801373 32595 120 0.000000 2901.086187 0.000000 0 / [55745.331342] kworker/22:1 80536 43017.409554 2 120 0.000000 0.071487 0.000000 0 / [55745.345442] cpu#23, 2693.545 MHz [55745.349065] .nr_running : 0 [55745.354246] .load : 0 [55745.359449] .nr_switches : 5215151 [55745.365218] .nr_load_updates : 703905 [55745.370904] .nr_uninterruptible : -718 [55745.376400] .next_balance : 4350.415778 [55745.382558] .curr->pid : 0 [55745.387753] .clock : 55745387.610201 [55745.394314] .cpu_load[0] : 0 [55745.399504] .cpu_load[1] : 0 [55745.404701] .cpu_load[2] : 0 [55745.409888] .cpu_load[3] : 0 [55745.415084] .cpu_load[4] : 0 [55745.420272] .avg_idle : 1000000 [55745.426043] .max_idle_balance_cost : 500000 [55745.433389] cfs_rq[23]:/ [55745.436216] .exec_clock : 0.000000 [55745.442039] .MIN_vruntime : 0.000001 [55745.447871] .min_vruntime : 66105.358482 [55745.454089] .max_vruntime : 0.000001 [55745.459922] .spread : 0.000000 [55745.465754] .spread0 : -18780.790703 [55745.472068] .nr_spread_over : 0 [55745.477223] .nr_running : 0 [55745.482375] .load : 0 [55745.487528] .runnable_load_avg : 0 [55745.492692] .blocked_load_avg : 0 [55745.497842] .tg_load_avg : 0 [55745.502996] .tg_load_contrib : 0 [55745.508150] .tg_runnable_contrib : 0 [55745.513303] .tg->runnable_avg : 0 [55745.518456] .tg->cfs_bandwidth.timer_active: 0 [55745.523629] .throttled : 0 [55745.528780] .throttle_count : 0 [55745.533933] .avg->runnable_avg_sum : 0 [55745.539085] .avg->runnable_avg_period : 46176 [55745.546296] rt_rq[23]:/ [55745.549025] .rt_nr_running : 0 [55745.554176] .rt_throttled : 0 [55745.559329] .rt_time : 0.020535 [55745.565160] .rt_runtime : 950.000000 [55745.572847] runnable tasks: [55745.575963] task PID tree-key switches prio wait-time sum-exec sum-sleep [55745.587998] ---------------------------------------------------------------------------------------------------------- [55745.599958] watchdog/23 124 -11.920560 13941 0 0.000000 207.959182 0.000000 0 / [55745.612344] migration/23 125 0.000000 1981 0 0.000000 1106.663805 0.000000 0 / [55745.624736] ksoftirqd/23 126 62073.548969 6886 120 0.000000 99.295299 0.000000 0 / [55745.637136] kworker/23:0H 128 1131.286392 9 100 0.000000 0.115551 0.000000 0 / [55745.649561] kworker/23:1 244 66093.621483 5079 120 0.000000 264.266965 0.000000 0 / [55745.661957] scsi_eh_1 1015 162.114103 7 120 0.000000 0.242255 0.000000 0 / [55745.674368] ib_nl_sa_wq 1060 162.073691 2 100 0.000000 0.060295 0.000000 0 / [55745.686782] mlx4_ib_mcg 1062 174.085936 2 100 0.000000 0.013373 0.000000 0 / [55745.699212] kworker/23:1H 2364 45067.923737 15660 100 0.000000 285.124255 0.000000 0 / [55745.711635] sssd_pac 2518 66093.497180 11148 120 0.000000 466.580097 0.000000 0 / [55745.724048] munged 2975 1378.153141 11 120 0.000000 3.065501 0.000000 0 / [55745.736471] kworker/23:2 3316 1559.762156 3 120 0.000000 0.072916 0.000000 0 / [55745.748882] automount 3552 2276.585607 6 120 0.000000 3.588481 0.000000 0 / [55745.761317] monitor_thread 4851 66093.749276 55791 120 0.000000 2290.208720 0.000000 0 / [55745.773730] mdt00_006 5142 66093.845170 101774 120 0.000000 9189.232128 0.000000 0 / [55745.786137] mdt_out00_003 5213 45068.318731 79923 120 0.000000 6575.332678 0.000000 0 / [55745.798546] mdt_rdpg00_006 5899 45325.761908 17431 120 0.000000 1277.842057 0.000000 0 / [55745.810975] ldlm_cn00_019 15247 45146.758160 11548 120 0.000000 617.230616 0.000000 0 / [55745.823389] ldlm_cn00_021 15356 47980.736396 10545 120 0.000000 552.606665 0.000000 0 / [55745.835800] kworker/u305:2 81272 66093.811642 3614 120 0.000000 238.935159 0.000000 0 / [55745.849892] cpu#24, 2693.545 MHz [55745.853507] .nr_running : 0 [55745.858701] .load : 0 [55745.863889] .nr_switches : 3613215 [55745.869684] .nr_load_updates : 743284 [55745.875357] .nr_uninterruptible : 200 [55745.880732] .next_balance : 4350.416282 [55745.886903] .curr->pid : 0 [55745.892092] .clock : 55745886.958260 [55745.898655] .cpu_load[0] : 0 [55745.903843] .cpu_load[1] : 0 [55745.909032] .cpu_load[2] : 0 [55745.914219] .cpu_load[3] : 0 [55745.919422] .cpu_load[4] : 0 [55745.924621] .avg_idle : 1000000 [55745.930397] .max_idle_balance_cost : 500000 [55745.937716] cfs_rq[24]:/ [55745.940543] .exec_clock : 0.000000 [55745.946368] .MIN_vruntime : 0.000001 [55745.952199] .min_vruntime : 37429.981541 [55745.958417] .max_vruntime : 0.000001 [55745.964248] .spread : 0.000000 [55745.970081] .spread0 : -47456.167644 [55745.976388] .nr_spread_over : 0 [55745.981539] .nr_running : 0 [55745.986690] .load : 0 [55745.991843] .runnable_load_avg : 0 [55745.996995] .blocked_load_avg : 0 [55746.002148] .tg_load_avg : 0 [55746.007301] .tg_load_contrib : 0 [55746.012455] .tg_runnable_contrib : 0 [55746.017608] .tg->runnable_avg : 0 [55746.022761] .tg->cfs_bandwidth.timer_active: 0 [55746.027914] .throttled : 0 [55746.033068] .throttle_count : 0 [55746.038221] .avg->runnable_avg_sum : 0 [55746.043381] .avg->runnable_avg_period : 47141 [55746.050585] rt_rq[24]:/ [55746.053312] .rt_nr_running : 0 [55746.058465] .rt_throttled : 0 [55746.063619] .rt_time : 0.000000 [55746.069450] .rt_runtime : 950.000000 [55746.077137] runnable tasks: [55746.080260] task PID tree-key switches prio wait-time sum-exec sum-sleep [55746.092303] ---------------------------------------------------------------------------------------------------------- [55746.104260] watchdog/24 129 -11.914499 13940 0 0.000000 214.485203 0.000000 1 / [55746.116660] migration/24 130 0.000000 330 0 0.000000 1069.930258 0.000000 1 / [55746.129061] ksoftirqd/24 131 37410.244547 593 120 0.000000 19.960366 0.000000 1 / [55746.141471] kworker/24:0 132 -8.837534 21 120 0.000000 0.214649 0.000000 1 / [55746.153889] kworker/24:0H 133 1107.726018 9 100 0.000000 0.061879 0.000000 1 / [55746.166319] kworker/24:1 246 37418.001990 1978 120 0.000000 54.407956 0.000000 1 / [55746.178749] multipathd 2022 0.000000 3 0 0.000000 1.021600 0.000000 1 / [55746.191147] multipathd 2028 0.000000 2 0 0.000000 0.444859 0.000000 1 / [55746.203569] multipathd 2035 0.000000 2 0 0.000000 0.664387 0.000000 1 / [55746.215988] multipathd 2041 0.000000 2 0 0.000000 0.397042 0.000000 1 / [55746.228407] multipathd 2047 0.000000 2 0 0.000000 0.776034 0.000000 1 / [55746.240853] mgs_params_noti 4903 1046.872619 2 118 0.000000 0.070196 0.000000 1 / [55746.253272] mdt_seqs_0001 4931 1095.273508 2 120 0.000000 0.045422 0.000000 1 / [55746.265705] kworker/24:1H 4962 33288.886331 559 100 0.000000 11.366725 0.000000 1 / [55746.278121] ldlm_cn01_009 5222 35758.344287 103357 120 0.000000 6102.421025 0.000000 1 / [55746.290540] mdt_out01_010 5727 35230.635930 101882 120 0.000000 7828.401486 0.000000 1 / [55746.302959] mdt_out01_017 5734 35232.803648 123465 120 0.000000 9023.625343 0.000000 1 / [55746.315374] mdt_out01_020 5890 35221.829482 174045 120 0.000000 13912.127289 0.000000 1 / [55746.327795] ldlm_cb01_010 13421 23889.484084 5978 120 0.000000 232.486009 0.000000 1 / [55746.341898] cpu#25, 2693.545 MHz [55746.345527] .nr_running : 0 [55746.350695] .load : 0 [55746.355883] .nr_switches : 3522351 [55746.361665] .nr_load_updates : 1467335 [55746.367436] .nr_uninterruptible : 288 [55746.372804] .next_balance : 4350.416774 [55746.378969] .curr->pid : 0 [55746.384159] .clock : 55746383.523827 [55746.390713] .cpu_load[0] : 0 [55746.395893] .cpu_load[1] : 0 [55746.401073] .cpu_load[2] : 0 [55746.406269] .cpu_load[3] : 0 [55746.411457] .cpu_load[4] : 0 [55746.416630] .avg_idle : 1000000 [55746.422415] .max_idle_balance_cost : 500000 [55746.429738] cfs_rq[25]:/ [55746.432570] .exec_clock : 0.000000 [55746.438411] .MIN_vruntime : 0.000001 [55746.444242] .min_vruntime : 952515.401886 [55746.450570] .max_vruntime : 0.000001 [55746.456408] .spread : 0.000000 [55746.462241] .spread0 : 867629.252701 [55746.468563] .nr_spread_over : 0 [55746.473716] .nr_running : 0 [55746.478869] .load : 0 [55746.484021] .runnable_load_avg : 0 [55746.489174] .blocked_load_avg : 0 [55746.494325] .tg_load_avg : 0 [55746.499478] .tg_load_contrib : 0 [55746.504631] .tg_runnable_contrib : 0 [55746.509788] .tg->runnable_avg : 0 [55746.514940] .tg->cfs_bandwidth.timer_active: 0 [55746.520093] .throttled : 0 [55746.525246] .throttle_count : 0 [55746.530399] .avg->runnable_avg_sum : 0 [55746.535565] .avg->runnable_avg_period : 47626 [55746.542776] rt_rq[25]:/ [55746.545505] .rt_nr_running : 0 [55746.550657] .rt_throttled : 0 [55746.555810] .rt_time : 0.000000 [55746.561647] .rt_runtime : 950.000000 [55746.569332] runnable tasks: [55746.572449] task PID tree-key switches prio wait-time sum-exec sum-sleep [55746.584485] ---------------------------------------------------------------------------------------------------------- [55746.596442] watchdog/25 134 -11.913019 13940 0 0.000000 221.910956 0.000000 1 / [55746.608836] migration/25 135 0.000000 20616 0 0.000000 1282.825327 0.000000 1 / [55746.621248] ksoftirqd/25 136 952222.845805 11487 120 0.000000 344.740036 0.000000 1 / [55746.633655] kworker/25:0H 138 4925.770567 9 100 0.000000 0.044968 0.000000 1 / [55746.646074] netns 172 35.354837 2 100 0.000000 0.016231 0.000000 1 / [55746.658493] writeback 174 59.379745 2 100 0.000000 0.013296 0.000000 1 / [55746.670895] kintegrityd 175 71.390794 2 100 0.000000 0.012189 0.000000 1 / [55746.683296] bioset 176 83.401472 2 100 0.000000 0.011811 0.000000 1 / [55746.695701] bioset 177 95.412645 2 100 0.000000 0.012273 0.000000 1 / [55746.708106] bioset 178 107.424014 2 100 0.000000 0.012420 0.000000 1 / [55746.720514] kblockd 179 119.435425 2 100 0.000000 0.012420 0.000000 1 / [55746.732920] md 181 143.457201 2 100 0.000000 0.013055 0.000000 1 / [55746.745325] edac-poller 182 155.469074 2 100 0.000000 0.013095 0.000000 1 / [55746.757732] watchdogd 183 167.480278 2 100 0.000000 0.012366 0.000000 1 / [55746.770149] kswapd1 193 408.558970 3 120 0.000000 0.049859 0.000000 1 / [55746.782548] ksmd 194 299.851432 2 125 0.000000 0.016345 0.000000 1 / [55746.794979] crypto 196 324.073050 2 100 0.000000 0.019801 0.000000 1 / [55746.807388] kthrotld 204 420.526342 2 100 0.000000 0.022294 0.000000 1 / [55746.819789] kmpath_rdacd 209 459.064486 2 100 0.000000 0.021144 0.000000 1 / [55746.832191] kaluad 210 471.081663 2 100 0.000000 0.018096 0.000000 1 / [55746.844608] kpsmoused 214 507.145650 2 100 0.000000 0.031408 0.000000 1 / [55746.857037] ipv6_addrconf 216 531.165273 2 100 0.000000 0.012530 0.000000 1 / [55746.869461] deferwq 230 651.632646 2 100 0.000000 0.026199 0.000000 1 / [55746.881868] kworker/25:1 247 952503.435038 5442 120 0.000000 210.346670 0.000000 1 / [55746.894280] scsi_eh_0 1006 1962.241213 2 120 0.000000 0.018069 0.000000 1 / [55746.906692] scsi_tmf_0 1007 1974.294388 2 100 0.000000 0.054205 0.000000 1 / [55746.919108] mlx4_health 1014 1998.448937 2 100 0.000000 0.047462 0.000000 1 / [55746.931515] scsi_tmf_1 1016 2010.456078 2 100 0.000000 0.008310 0.000000 1 / [55746.943923] scsi_wq_1 1017 2022.489602 2 100 0.000000 0.034710 0.000000 1 / [55746.956323] scsi_tmf_2 1019 2046.553105 2 100 0.000000 0.010505 0.000000 1 / [55746.968712] scsi_tmf_3 1021 2070.567508 2 100 0.000000 0.006146 0.000000 1 / [55746.981108] scsi_tmf_4 1023 2094.590068 2 100 0.000000 0.014160 0.000000 1 / [55746.993501] scsi_tmf_5 1025 2118.600672 2 100 0.000000 0.005990 0.000000 1 / [55747.005900] scsi_tmf_6 1027 2142.611716 2 100 0.000000 0.006260 0.000000 1 / [55747.018299] scsi_eh_7 1028 10189.281987 23 120 0.000000 0.588356 0.000000 1 / [55747.030699] scsi_tmf_7 1029 2166.622360 2 100 0.000000 0.006073 0.000000 1 / [55747.043106] ttm_swap 1037 2190.779865 2 100 0.000000 0.113122 0.000000 1 / [55747.055518] poll_mpt2sas0_s 1043 2221.661024 2 100 0.000000 0.070815 0.000000 1 / [55747.067934] ib-comp-wq 1054 2318.282067 2 100 0.000000 0.067321 0.000000 1 / [55747.080336] kworker/u309:0 1057 2354.417022 3 100 0.000000 0.052375 0.000000 1 / [55747.092757] ib-comp-unb-wq 1058 2366.457074 2 100 0.000000 0.041770 0.000000 1 / [55747.105170] ib_mcast 1059 2378.487593 2 100 0.000000 0.031682 0.000000 1 / [55747.117588] mlx4_ib 1061 2390.557617 2 100 0.000000 0.071823 0.000000 1 / [55747.130001] ib_mad1 1063 2402.633598 2 100 0.000000 0.078277 0.000000 1 / [55747.142421] to_fifo 1064 2414.660607 2 100 0.000000 0.028103 0.000000 1 / [55747.154838] ib_mad2 1065 2426.723715 2 100 0.000000 0.065400 0.000000 1 / [55747.167260] to_fifo 1066 2438.749942 2 100 0.000000 0.027443 0.000000 1 / [55747.179669] ext4-rsv-conver 1110 2578.262158 2 100 0.000000 0.063431 0.000000 1 / [55747.192085] rpciod 1219 3071.160946 2 100 0.000000 0.025535 0.000000 1 / [55747.204493] xprtiod 1220 3083.172743 2 100 0.000000 0.012894 0.000000 1 / [55747.216900] lvmetad 1221 3085.503139 4 120 0.000000 4.618681 0.000000 1 / [55747.229303] kmpathd 1241 3193.063956 2 100 0.000000 0.056314 0.000000 1 / [55747.241716] kmpath_handlerd 1242 3205.122306 2 100 0.000000 0.060226 0.000000 1 / [55747.254139] bioset 2020 4851.635783 2 100 0.000000 0.007368 0.000000 1 / [55747.266552] kworker/25:1H 2075 633396.069973 746 100 0.000000 13.101004 0.000000 1 / [55747.278975] polkitd 2289 5737.021972 1 120 0.000000 0.164124 0.000000 1 / [55747.291388] JS GC Helper 2290 5749.233631 4 120 0.000000 0.211665 0.000000 1 / [55747.303801] JS Sour~ Thread 2291 5761.564260 5 120 0.000000 0.176508 0.000000 1 / [55747.316214] polkitd 2292 5773.584906 3 120 0.000000 0.229154 0.000000 1 / [55747.328636] zed 2301 5836.405864 1 120 0.000000 0.065802 0.000000 1 / [55747.341042] zed 2302 5848.471234 1 120 0.000000 0.065376 0.000000 1 / [55747.353464] tuned 3309 10493.687623 3 120 0.000000 1.525685 0.000000 1 / [55747.365879] munged 2991 9332.230861 1 120 0.000000 0.022428 0.000000 1 / [55747.378291] munged 2992 9344.245369 1 120 0.000000 0.014514 0.000000 1 / [55747.390706] automount 3555 12306.625284 4 120 0.000000 0.752114 0.000000 1 / [55747.403121] automount 3557 12337.660405 1 120 0.000000 0.706420 0.000000 1 / [55747.415530] agetty 3355 11850.149154 7 120 0.000000 14.728254 0.000000 1 / [55747.427945] ptlrpc_hr01_006 4830 331303.960521 28075 120 0.000000 885.070585 0.000000 1 / [55747.440374] ldlm_cn01_003 5138 428247.302965 107944 120 0.000000 5923.410858 0.000000 1 / [55747.452808] mdt_out01_011 5728 216321.738269 213948 120 0.000000 17670.684722 0.000000 1 / [55747.465222] mdt_rdpg01_007 5903 193890.336969 15632 120 0.000000 1155.945185 0.000000 1 / [55747.477642] mdt01_017 7355 193243.456460 33657 120 0.000000 3200.905420 0.000000 1 / [55747.490071] ldlm_cn01_022 14395 427888.544664 42214 120 0.000000 2456.887044 0.000000 1 / [55747.502484] kworker/25:0 69540 676421.361268 2 120 0.000000 0.048424 0.000000 1 / [55747.514888] pickup 94342 952501.054985 31 120 0.000000 18.810859 0.000000 1 / [55747.528993] cpu#26, 2693.545 MHz [55747.532600] .nr_running : 0 [55747.537768] .load : 0 [55747.542937] .nr_switches : 3354416 [55747.548722] .nr_load_updates : 836437 [55747.554411] .nr_uninterruptible : 159 [55747.559794] .next_balance : 4350.417960 [55747.565959] .curr->pid : 0 [55747.571141] .clock : 55747566.002769 [55747.577679] .cpu_load[0] : 0 [55747.582853] .cpu_load[1] : 0 [55747.588042] .cpu_load[2] : 0 [55747.593222] .cpu_load[3] : 0 [55747.598387] .cpu_load[4] : 0 [55747.603585] .avg_idle : 1000000 [55747.609360] .max_idle_balance_cost : 500000 [55747.616690] cfs_rq[26]:/ [55747.619514] .exec_clock : 0.000000 [55747.625353] .MIN_vruntime : 0.000001 [55747.631184] .min_vruntime : 133341.726928 [55747.637507] .max_vruntime : 0.000001 [55747.643345] .spread : 0.000000 [55747.649177] .spread0 : 48455.466077 [55747.655397] .nr_spread_over : 0 [55747.660551] .nr_running : 0 [55747.665696] .load : 0 [55747.670849] .runnable_load_avg : 0 [55747.676003] .blocked_load_avg : 0 [55747.681155] .tg_load_avg : 0 [55747.686308] .tg_load_contrib : 0 [55747.691461] .tg_runnable_contrib : 0 [55747.696623] .tg->runnable_avg : 0 [55747.701775] .tg->cfs_bandwidth.timer_active: 0 [55747.706929] .throttled : 0 [55747.712082] .throttle_count : 0 [55747.717234] .avg->runnable_avg_sum : 0 [55747.722387] .avg->runnable_avg_period : 47973 [55747.729591] rt_rq[26]:/ [55747.732318] .rt_nr_running : 0 [55747.737484] .rt_throttled : 0 [55747.742637] .rt_time : 0.000000 [55747.748484] .rt_runtime : 950.000000 [55747.756172] runnable tasks: [55747.759290] task PID tree-key switches prio wait-time sum-exec sum-sleep [55747.771325] ---------------------------------------------------------------------------------------------------------- [55747.783277] watchdog/26 139 -11.914021 13940 0 0.000000 219.200286 0.000000 1 / [55747.795687] migration/26 140 0.000000 1220 0 0.000000 1080.397648 0.000000 1 / [55747.808100] ksoftirqd/26 141 133312.563018 6683 120 0.000000 173.365336 0.000000 1 / [55747.820515] kworker/26:0H 143 5249.426496 12 100 0.000000 0.102101 0.000000 1 / [55747.832969] kworker/26:1 250 133329.741720 8251 120 0.000000 516.259577 0.000000 1 / [55747.845398] mlx4 1012 541.551219 2 100 0.000000 0.008770 0.000000 1 / [55747.857818] kdmflush 2005 1142.281321 2 100 0.000000 0.007043 0.000000 1 / [55747.870252] kworker/26:1H 5215 89125.013184 526 100 0.000000 10.059274 0.000000 1 / [55747.882691] mdt01_019 7359 50078.367145 46391 120 0.000000 4356.455397 0.000000 1 / [55747.895103] ldlm_cb01_006 13274 33762.342343 4600 120 0.000000 195.749778 0.000000 1 / [55747.907539] kworker/26:0 95971 132249.641121 5 120 0.000000 0.100363 0.000000 1 / [55747.921678] cpu#27, 2693.545 MHz [55747.925308] .nr_running : 0 [55747.930498] .load : 0 [55747.935700] .nr_switches : 3519333 [55747.941485] .nr_load_updates : 821893 [55747.947128] .nr_uninterruptible : 221 [55747.952534] .next_balance : 4350.418354 [55747.958705] .curr->pid : 0 [55747.963894] .clock : 55747958.749313 [55747.970433] .cpu_load[0] : 0 [55747.975610] .cpu_load[1] : 0 [55747.980792] .cpu_load[2] : 0 [55747.985997] .cpu_load[3] : 0 [55747.991186] .cpu_load[4] : 0 [55747.996360] .avg_idle : 1000000 [55748.002144] .max_idle_balance_cost : 500000 [55748.009475] cfs_rq[27]:/ [55748.012300] .exec_clock : 0.000000 [55748.018139] .MIN_vruntime : 0.000001 [55748.023970] .min_vruntime : 41096.428709 [55748.030188] .max_vruntime : 0.000001 [55748.036028] .spread : 0.000000 [55748.041861] .spread0 : -43792.835670 [55748.048177] .nr_spread_over : 0 [55748.053338] .nr_running : 0 [55748.058492] .load : 0 [55748.063645] .runnable_load_avg : 0 [55748.068804] .blocked_load_avg : 0 [55748.073957] .tg_load_avg : 0 [55748.079115] .tg_load_contrib : 0 [55748.084267] .tg_runnable_contrib : 0 [55748.089424] .tg->runnable_avg : 0 [55748.094577] .tg->cfs_bandwidth.timer_active: 0 [55748.099736] .throttled : 0 [55748.104890] .throttle_count : 0 [55748.110043] .avg->runnable_avg_sum : 0 [55748.115196] .avg->runnable_avg_period : 46499 [55748.122391] rt_rq[27]:/ [55748.125122] .rt_nr_running : 0 [55748.130274] .rt_throttled : 0 [55748.135427] .rt_time : 0.000000 [55748.141258] .rt_runtime : 950.000000 [55748.148943] runnable tasks: [55748.152058] task PID tree-key switches prio wait-time sum-exec sum-sleep [55748.164095] ---------------------------------------------------------------------------------------------------------- [55748.176048] watchdog/27 144 -11.911488 13940 0 0.000000 217.655458 0.000000 1 / [55748.188446] migration/27 145 0.000000 458 0 0.000000 1103.081379 0.000000 1 / [55748.200865] ksoftirqd/27 146 40928.307806 807 120 0.000000 19.753670 0.000000 1 / [55748.213278] kworker/27:0H 148 1465.200749 9 100 0.000000 0.038919 0.000000 1 / [55748.225705] kworker/27:1 251 41084.447471 4664 120 0.000000 103.593478 0.000000 1 / [55748.238124] multipathd 1253 0.000000 33 0 0.000000 3.780795 0.000000 1 / [55748.250546] kdmwork-253:2 2034 1487.795562 36 120 0.000000 0.382197 0.000000 1 / [55748.262964] bioset 2044 1443.017688 2 100 0.000000 0.005262 0.000000 1 / [55748.275367] kdmwork-253:4 2045 1526.456891 66 120 0.000000 0.621878 0.000000 1 / [55748.287785] kworker/27:1H 2057 40717.376835 5620 100 0.000000 113.811803 0.000000 1 / [55748.300206] zvol 2154 1613.496283 2 100 0.000000 0.046722 0.000000 1 / [55748.312632] gssproxy 2377 1863.565559 1 120 0.000000 0.066786 0.000000 1 / [55748.325053] atd 3321 40854.077409 18 120 0.000000 6.918729 0.000000 1 / [55748.337476] ptlrpc_hr01_000 4824 38096.858132 28074 120 0.000000 885.518165 0.000000 1 / [55748.349894] ptlrpc_hr01_007 4831 38096.823200 28073 120 0.000000 877.935259 0.000000 1 / [55748.362339] mdt01_000 4915 36759.882799 105582 120 0.000000 9863.763703 0.000000 1 / [55748.374761] osp-syn-6-0 4971 38097.072216 13441 120 0.000000 390.654736 0.000000 1 / [55748.387196] dist_txn-0 4997 35250.113095 101058 120 0.000000 5753.380124 0.000000 1 / [55748.399608] mdt01_005 5140 36635.112635 118478 120 0.000000 11025.155269 0.000000 1 / [55748.412016] ldlm_cn01_007 5191 38875.471709 108263 120 0.000000 6075.296732 0.000000 1 / [55748.424450] mdt_rdpg01_009 5907 36820.398745 11688 120 0.000000 821.950354 0.000000 1 / [55748.436909] kworker/27:2 36484 38238.002146 3 120 0.000000 0.058524 0.000000 1 / [55748.451041] cpu#28, 2693.545 MHz [55748.454650] .nr_running : 0 [55748.459811] .load : 0 [55748.465015] .nr_switches : 3478730 [55748.470778] .nr_load_updates : 720431 [55748.476478] .nr_uninterruptible : 198 [55748.481874] .next_balance : 4350.418884 [55748.488029] .curr->pid : 0 [55748.493231] .clock : 55748488.096577 [55748.499757] .cpu_load[0] : 0 [55748.504946] .cpu_load[1] : 0 [55748.510126] .cpu_load[2] : 0 [55748.515293] .cpu_load[3] : 0 [55748.520498] .cpu_load[4] : 0 [55748.525688] .avg_idle : 1000000 [55748.531469] .max_idle_balance_cost : 500000 [55748.538801] cfs_rq[28]:/ [55748.541628] .exec_clock : 0.000000 [55748.547460] .MIN_vruntime : 0.000001 [55748.553291] .min_vruntime : 48343.871012 [55748.559509] .max_vruntime : 0.000001 [55748.565340] .spread : 0.000000 [55748.571171] .spread0 : -36545.393367 [55748.577493] .nr_spread_over : 0 [55748.582646] .nr_running : 0 [55748.587798] .load : 0 [55748.592950] .runnable_load_avg : 0 [55748.598103] .blocked_load_avg : 0 [55748.603255] .tg_load_avg : 0 [55748.608426] .tg_load_contrib : 0 [55748.613580] .tg_runnable_contrib : 0 [55748.618731] .tg->runnable_avg : 0 [55748.623886] .tg->cfs_bandwidth.timer_active: 0 [55748.629039] .throttled : 0 [55748.634192] .throttle_count : 0 [55748.639345] .avg->runnable_avg_sum : 0 [55748.644498] .avg->runnable_avg_period : 46651 [55748.651693] rt_rq[28]:/ [55748.654425] .rt_nr_running : 0 [55748.659578] .rt_throttled : 0 [55748.664730] .rt_time : 0.000000 [55748.670563] .rt_runtime : 950.000000 [55748.678248] runnable tasks: [55748.681365] task PID tree-key switches prio wait-time sum-exec sum-sleep [55748.693418] ---------------------------------------------------------------------------------------------------------- [55748.705375] watchdog/28 149 -11.913266 13940 0 0.000000 217.508037 0.000000 1 / [55748.717776] migration/28 150 0.000000 1064 0 0.000000 1069.514235 0.000000 1 / [55748.730174] ksoftirqd/28 151 48169.656414 476 120 0.000000 13.671201 0.000000 1 / [55748.742589] kworker/28:0H 153 1256.849934 10 100 0.000000 0.621386 0.000000 1 / [55748.755000] kworker/28:1 252 48331.921924 2703 120 0.000000 84.365240 0.000000 1 / [55748.767422] ata_sff 982 286.778746 2 100 0.000000 0.020917 0.000000 1 / [55748.779846] kworker/28:1H 2053 36098.771238 370 100 0.000000 6.653404 0.000000 1 / [55748.792279] ipoib_wq 2556 1605.723980 2 100 0.000000 0.071831 0.000000 1 / [55748.804701] ldlm_cn01_000 4897 42484.188338 144410 120 0.000000 7141.656685 0.000000 1 / [55748.817111] ldlm_cb01_003 5214 27792.888831 47934 120 0.000000 2763.697231 0.000000 1 / [55748.829520] mdt01_013 5724 38283.713711 74081 120 0.000000 6931.868194 0.000000 1 / [55748.841938] mdt_out01_013 5730 42484.155926 154584 120 0.000000 11533.263088 0.000000 1 / [55748.854366] mdt_rdpg01_013 6721 38420.581130 12884 120 0.000000 886.162422 0.000000 1 / [55748.866780] ldlm_cn01_021 9574 42197.200785 45740 120 0.000000 2709.730957 0.000000 1 / [55748.879197] kworker/28:2 43111 42137.272306 3 120 0.000000 0.101013 0.000000 1 / [55748.893286] cpu#29, 2693.545 MHz [55748.896917] .nr_running : 0 [55748.902099] .load : 0 [55748.907288] .nr_switches : 3712714 [55748.913051] .nr_load_updates : 757122 [55748.918719] .nr_uninterruptible : 148 [55748.924103] .next_balance : 4350.419326 [55748.930254] .curr->pid : 0 [55748.935464] .clock : 55748930.307325 [55748.942005] .cpu_load[0] : 0 [55748.947193] .cpu_load[1] : 0 [55748.952410] .cpu_load[2] : 0 [55748.957616] .cpu_load[3] : 0 [55748.962806] .cpu_load[4] : 0 [55748.967994] .avg_idle : 1000000 [55748.973771] .max_idle_balance_cost : 500000 [55748.981107] cfs_rq[29]:/ [55748.983934] .exec_clock : 0.000000 [55748.989766] .MIN_vruntime : 0.000001 [55748.995596] .min_vruntime : 40284.166466 [55749.001816] .max_vruntime : 0.000001 [55749.007649] .spread : 0.000000 [55749.013482] .spread0 : -44607.909202 [55749.019798] .nr_spread_over : 0 [55749.024950] .nr_running : 0 [55749.030102] .load : 0 [55749.035254] .runnable_load_avg : 0 [55749.040407] .blocked_load_avg : 0 [55749.045569] .tg_load_avg : 0 [55749.050714] .tg_load_contrib : 0 [55749.055866] .tg_runnable_contrib : 0 [55749.061020] .tg->runnable_avg : 0 [55749.066171] .tg->cfs_bandwidth.timer_active: 0 [55749.071325] .throttled : 0 [55749.076485] .throttle_count : 0 [55749.081637] .avg->runnable_avg_sum : 0 [55749.086789] .avg->runnable_avg_period : 47315 [55749.093986] rt_rq[29]:/ [55749.096715] .rt_nr_running : 0 [55749.101869] .rt_throttled : 0 [55749.107022] .rt_time : 0.000000 [55749.112854] .rt_runtime : 950.000000 [55749.120540] runnable tasks: [55749.123656] task PID tree-key switches prio wait-time sum-exec sum-sleep [55749.135691] ---------------------------------------------------------------------------------------------------------- [55749.147650] watchdog/29 154 -11.914769 13940 0 0.000000 215.811349 0.000000 1 / [55749.160038] migration/29 155 0.000000 373 0 0.000000 1280.995712 0.000000 1 / [55749.172449] ksoftirqd/29 156 40202.656228 681 120 0.000000 15.525933 0.000000 1 / [55749.184866] kworker/29:0H 158 1265.322902 9 100 0.000000 0.075377 0.000000 1 / [55749.197303] kworker/29:1 248 40270.931717 2174 120 0.000000 82.325455 0.000000 1 / [55749.209730] kworker/29:1H 1955 36710.215832 647 100 0.000000 12.023144 0.000000 1 / [55749.222179] ldlm_cn01_004 5144 38922.522914 109066 120 0.000000 6186.545203 0.000000 1 / [55749.234609] mdt_io01_004 6554 17410.563179 2732 120 0.000000 241.685311 0.000000 1 / [55749.247010] mdt_rdpg01_012 6720 37250.073350 19319 120 0.000000 1435.132286 0.000000 1 / [55749.259403] ldlm_cn01_014 7680 38926.289697 69253 120 0.000000 3961.441765 0.000000 1 / [55749.271821] kworker/29:2 94877 40204.797301 3 120 0.000000 0.088295 0.000000 1 / [55749.285928] cpu#30, 2693.545 MHz [55749.289566] .nr_running : 0 [55749.294742] .load : 0 [55749.299923] .nr_switches : 3747944 [55749.305675] .nr_load_updates : 753759 [55749.311392] .nr_uninterruptible : 154 [55749.316736] .next_balance : 4350.419724 [55749.322865] .curr->pid : 0 [55749.328063] .clock : 55749322.915576 [55749.334570] .cpu_load[0] : 0 [55749.339751] .cpu_load[1] : 0 [55749.344944] .cpu_load[2] : 0 [55749.350134] .cpu_load[3] : 0 [55749.355309] .cpu_load[4] : 0 [55749.360504] .avg_idle : 1000000 [55749.366287] .max_idle_balance_cost : 500000 [55749.373612] cfs_rq[30]:/ [55749.376441] .exec_clock : 0.000000 [55749.382272] .MIN_vruntime : 0.000001 [55749.388103] .min_vruntime : 38261.077267 [55749.394322] .max_vruntime : 0.000001 [55749.400154] .spread : 0.000000 [55749.405987] .spread0 : -46630.998401 [55749.412295] .nr_spread_over : 0 [55749.417446] .nr_running : 0 [55749.422604] .load : 0 [55749.427758] .runnable_load_avg : 0 [55749.432916] .blocked_load_avg : 0 [55749.438070] .tg_load_avg : 0 [55749.443228] .tg_load_contrib : 0 [55749.448381] .tg_runnable_contrib : 0 [55749.453542] .tg->runnable_avg : 0 [55749.458695] .tg->cfs_bandwidth.timer_active: 0 [55749.463849] .throttled : 0 [55749.469002] .throttle_count : 0 [55749.474156] .avg->runnable_avg_sum : 4 [55749.479308] .avg->runnable_avg_period : 47392 [55749.486503] rt_rq[30]:/ [55749.489230] .rt_nr_running : 0 [55749.494383] .rt_throttled : 0 [55749.499542] .rt_time : 0.020471 [55749.505374] .rt_runtime : 950.000000 [55749.513081] runnable tasks: [55749.516196] task PID tree-key switches prio wait-time sum-exec sum-sleep [55749.528231] ---------------------------------------------------------------------------------------------------------- [55749.540192] watchdog/30 159 -11.915094 13941 0 0.000000 213.222610 0.000000 1 / [55749.552590] migration/30 160 0.000000 314 0 0.000000 1055.100242 0.000000 1 / [55749.565007] ksoftirqd/30 161 37812.316158 729 120 0.000000 16.617176 0.000000 1 / [55749.577407] kworker/30:0H 163 584.132350 9 100 0.000000 0.051160 0.000000 1 / [55749.589857] kworker/30:1 249 38216.127333 1849 120 0.000000 71.903143 0.000000 1 / [55749.602293] kworker/30:1H 2052 36212.209254 689 100 0.000000 11.269180 0.000000 1 / [55749.614703] kiblnd_sd_01_03 4849 38261.077267 6066782 120 0.000000 103762.538462 0.000000 1 / [55749.627105] ldlm_cn01_001 4898 36359.793897 91200 120 0.000000 5186.107910 0.000000 1 / [55749.639532] ldlm_cn01_006 5189 36356.151360 88780 120 0.000000 4923.574999 0.000000 1 / [55749.651953] mdt01_016 6071 35485.984939 129620 120 0.000000 12361.883726 0.000000 1 / [55749.664354] ldlm_cn01_013 6546 36365.209573 76582 120 0.000000 4436.000873 0.000000 1 / [55749.676788] mdt01_024 7876 23226.956134 21731 120 0.000000 2526.746636 0.000000 1 / [55749.689206] ldlm_cb01_005 10530 24165.052385 20722 120 0.000000 1142.769202 0.000000 1 / [55749.701629] kworker/30:0 62917 36918.349046 3 120 0.000000 0.075676 0.000000 1 / [55749.715753] cpu#31, 2693.545 MHz [55749.719377] .nr_running : 0 [55749.724573] .load : 0 [55749.729776] .nr_switches : 3729105 [55749.735547] .nr_load_updates : 862479 [55749.741237] .nr_uninterruptible : 196 [55749.746612] .next_balance : 4350.420148 [55749.752770] .curr->pid : 0 [55749.757951] .clock : 55749757.312989 [55749.764488] .cpu_load[0] : 0 [55749.769663] .cpu_load[1] : 0 [55749.774860] .cpu_load[2] : 0 [55749.780046] .cpu_load[3] : 0 [55749.785221] .cpu_load[4] : 0 [55749.790424] .avg_idle : 1000000 [55749.796202] .max_idle_balance_cost : 500000 [55749.803529] cfs_rq[31]:/ [55749.806355] .exec_clock : 0.000000 [55749.812193] .MIN_vruntime : 0.000001 [55749.818024] .min_vruntime : 40062.187555 [55749.824243] .max_vruntime : 0.000001 [55749.830076] .spread : 0.000000 [55749.835907] .spread0 : -44829.888113 [55749.842224] .nr_spread_over : 0 [55749.847377] .nr_running : 0 [55749.852528] .load : 0 [55749.857680] .runnable_load_avg : 0 [55749.862833] .blocked_load_avg : 0 [55749.867987] .tg_load_avg : 0 [55749.873140] .tg_load_contrib : 0 [55749.878293] .tg_runnable_contrib : 0 [55749.883446] .tg->runnable_avg : 0 [55749.888598] .tg->cfs_bandwidth.timer_active: 0 [55749.893751] .throttled : 0 [55749.898905] .throttle_count : 0 [55749.904058] .avg->runnable_avg_sum : 0 [55749.909212] .avg->runnable_avg_period : 47990 [55749.916413] rt_rq[31]:/ [55749.919149] .rt_nr_running : 0 [55749.924300] .rt_throttled : 0 [55749.929452] .rt_time : 0.000000 [55749.935285] .rt_runtime : 950.000000 [55749.942972] runnable tasks: [55749.946087] task PID tree-key switches prio wait-time sum-exec sum-sleep [55749.958122] ---------------------------------------------------------------------------------------------------------- [55749.970072] watchdog/31 164 -11.912293 13941 0 0.000000 216.494667 0.000000 1 / [55749.982456] migration/31 165 0.000000 498 0 0.000000 699.780144 0.000000 1 / [55749.994866] ksoftirqd/31 166 35642.398218 535 120 0.000000 14.129209 0.000000 1 / [55750.007273] kworker/31:0 167 688.129101 21 120 0.000000 0.119881 0.000000 1 / [55750.019691] kworker/31:0H 168 1460.769161 9 100 0.000000 0.076003 0.000000 1 / [55750.032107] kworker/31:1 253 40050.204770 1822 120 0.000000 54.794570 0.000000 1 / [55750.044572] kworker/31:1H 2181 33796.649577 497 100 0.000000 10.417187 0.000000 1 / [55750.057007] sssd_nss 2515 40060.511370 32863 120 0.000000 3778.326243 0.000000 1 / [55750.069431] mdt_out01_016 5733 36301.795027 151986 120 0.000000 12081.372277 0.000000 1 / [55750.081858] mdt_out01_019 5889 36368.805990 171135 120 0.000000 13694.848086 0.000000 1 / [55750.094263] ldlm_cn01_020 9573 38193.641373 143341 120 0.000000 7484.885977 0.000000 1 / [55750.106682] ldlm_cb01_007 13275 24928.331426 6192 120 0.000000 252.623014 0.000000 1 / [55750.121273] INFO: rcu_sched detected stalls on CPUs/tasks: { 11} (detected by 11, t=6 jiffies, g=1459895, c=1459894, q=83395) [55750.133970] Task dump for CPU 11: [55750.137675] systemd-journal R running task 0 1194 1 0x00000000 [55750.145570] Call Trace: [55750.148307] [] sched_show_task+0xa8/0x110 [55750.155327] [] dump_cpu_task+0x39/0x70 [55750.161358] [] rcu_dump_cpu_stacks+0x90/0xd0 [55750.167975] [] rcu_check_callbacks+0x6f2/0x730 [55750.174806] [] ? tick_sched_do_timer+0x50/0x50 [55750.181612] [] update_process_times+0x46/0x80 [55750.188319] [] tick_sched_handle+0x30/0x70 [55750.194734] [] tick_sched_timer+0x39/0x80 [55750.201070] [] __hrtimer_run_queues+0x10e/0x270 [55750.207970] [] hrtimer_interrupt+0xaf/0x1d0 [55750.214489] [] local_apic_timer_interrupt+0x3b/0x60 [55750.221796] [] smp_apic_timer_interrupt+0x43/0x60 [55750.228890] [] apic_timer_interrupt+0x16a/0x170