[ 6.029790] Asymmetric key parser 'x509' registered [ 6.035360] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) [ 6.043829] io scheduler noop registered [ 6.048231] io scheduler deadline registered (default) [ 6.054065] io scheduler cfq registered [ 6.058363] io scheduler mq-deadline registered [ 6.063429] io scheduler kyber registered [ 6.068834] pcieport 0000:00:01.0: irq 25 for MSI/MSI-X [ 6.069195] pcieport 0000:00:01.1: irq 26 for MSI/MSI-X [ 6.069524] pcieport 0000:00:02.0: irq 27 for MSI/MSI-X [ 6.069865] pcieport 0000:00:02.2: irq 28 for MSI/MSI-X [ 6.070242] pcieport 0000:00:03.0: irq 29 for MSI/MSI-X [ 6.070576] pcieport 0000:00:11.0: irq 30 for MSI/MSI-X [ 6.070906] pcieport 0000:00:1c.0: irq 31 for MSI/MSI-X [ 6.071259] pcieport 0000:00:1c.7: irq 32 for MSI/MSI-X [ 6.071636] pcieport 0000:80:01.0: irq 34 for MSI/MSI-X [ 6.071837] pcieport 0000:80:02.0: irq 35 for MSI/MSI-X [ 6.072057] pcieport 0000:80:03.0: irq 36 for MSI/MSI-X [ 6.072272] pcieport 0000:80:03.2: irq 37 for MSI/MSI-X [ 6.072455] pcieport 0000:00:01.0: Signaling PME through PCIe PME interrupt [ 6.080245] pcie_pme 0000:00:01.0:pcie001: service driver pcie_pme loaded [ 6.080277] pcieport 0000:00:01.1: Signaling PME through PCIe PME interrupt [ 6.088065] pci 0000:02:00.0: Signaling PME through PCIe PME interrupt [ 6.095368] pci 0000:02:00.1: Signaling PME through PCIe PME interrupt [ 6.102674] pci 0000:02:00.2: Signaling PME through PCIe PME interrupt [ 6.109975] pci 0000:02:00.3: Signaling PME through PCIe PME interrupt [ 6.117278] pcie_pme 0000:00:01.1:pcie001: service driver pcie_pme loaded [ 6.117309] pcieport 0000:00:02.0: Signaling PME through PCIe PME interrupt [ 6.125096] pci 0000:04:00.0: Signaling PME through PCIe PME interrupt [ 6.132399] pcie_pme 0000:00:02.0:pcie001: service driver pcie_pme loaded [ 6.132433] pcieport 0000:00:02.2: Signaling PME through PCIe PME interrupt [ 6.140219] pcie_pme 0000:00:02.2:pcie001: service driver pcie_pme loaded [ 6.140249] pcieport 0000:00:03.0: Signaling PME through PCIe PME interrupt [ 6.148028] pci 0000:06:00.0: Signaling PME through PCIe PME interrupt [ 6.155328] pcie_pme 0000:00:03.0:pcie001: service driver pcie_pme loaded [ 6.155361] pcieport 0000:00:11.0: Signaling PME through PCIe PME interrupt [ 6.163148] pci 0000:07:00.0: Signaling PME through PCIe PME interrupt [ 6.170443] pci 0000:07:00.3: Signaling PME through PCIe PME interrupt [ 6.177746] pcie_pme 0000:00:11.0:pcie001: service driver pcie_pme loaded [ 6.177779] pcieport 0000:00:1c.0: Signaling PME through PCIe PME interrupt [ 6.185565] pcie_pme 0000:00:1c.0:pcie001: service driver pcie_pme loaded [ 6.185596] pcieport 0000:00:1c.7: Signaling PME through PCIe PME interrupt [ 6.193382] pci 0000:09:00.0: Signaling PME through PCIe PME interrupt [ 6.200684] pcie_pme 0000:00:1c.7:pcie001: service driver pcie_pme loaded [ 6.200721] pcieport 0000:80:01.0: Signaling PME through PCIe PME interrupt [ 6.208503] pcie_pme 0000:80:01.0:pcie001: service driver pcie_pme loaded [ 6.208540] pcieport 0000:80:02.0: Signaling PME through PCIe PME interrupt [ 6.216330] pcie_pme 0000:80:02.0:pcie001: service driver pcie_pme loaded [ 6.216365] pcieport 0000:80:03.0: Signaling PME through PCIe PME interrupt [ 6.224155] pcie_pme 0000:80:03.0:pcie001: service driver pcie_pme loaded [ 6.224190] pcieport 0000:80:03.2: Signaling PME through PCIe PME interrupt [ 6.231980] pcie_pme 0000:80:03.2:pcie001: service driver pcie_pme loaded [ 6.232106] pci_hotplug: PCI Hot Plug PCI Core version: 0.5 [ 6.238360] pciehp: PCI Express Hot Plug Controller Driver version: 0.4 [ 6.245813] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 6.253501] intel_idle: MWAIT substates: 0x21120 [ 6.253504] intel_idle: v0.4.1 model 0x2D [ 6.253762] intel_idle: lapic_timer_reliable_states 0xffffffff [ 6.253963] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 [ 6.262227] ACPI: Power Button [PWRF] [ 6.266363] ACPI: Requesting acpi_cpufreq [ 6.308282] ERST: Error Record Serialization Table (ERST) support is initialized. [ 6.316675] pstore: Registered erst as persistent store backend [ 6.323482] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 6.331860] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 6.359601] 00:03: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A [ 6.386569] 00:04: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A [ 6.393348] Non-volatile memory driver v1.3 [ 6.398064] Linux agpgart interface v0.103 [ 6.402921] crash memory driver: version 1.1 [ 6.407959] rdac: device handler registered [ 6.412676] hp_sw: device handler registered [ 6.417457] emc: device handler registered [ 6.422164] alua: device handler registered [ 6.426900] libphy: Fixed MDIO Bus: probed [ 6.431544] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver [ 6.438867] ehci-pci: EHCI PCI platform driver [ 6.444089] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 6.449999] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1 [ 6.458298] ehci-pci 0000:00:1a.0: debug port 2 [ 6.467295] ehci-pci 0000:00:1a.0: cache line size of 64 is not supported [ 6.467316] ehci-pci 0000:00:1a.0: irq 22, io mem 0xd1020000 [ 6.478950] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 6.485436] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 3.10 [ 6.494666] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 6.502741] usb usb1: Product: EHCI Host Controller [ 6.508198] usb usb1: Manufacturer: Linux 3.10.0-1062.9.1.el7_lustre.x86_64 ehci_hcd [ 6.516844] usb usb1: SerialNumber: 0000:00:1a.0 [ 6.522130] hub 1-0:1.0: USB hub found [ 6.526333] hub 1-0:1.0: 2 ports detected [ 6.531070] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 6.536967] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2 [ 6.545253] ehci-pci 0000:00:1d.0: debug port 2 [ 6.554229] ehci-pci 0000:00:1d.0: cache line size of 64 is not supported [ 6.554251] ehci-pci 0000:00:1d.0: irq 20, io mem 0xd1010000 [ 6.565939] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 6.572407] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 3.10 [ 6.581634] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 6.589711] usb usb2: Product: EHCI Host Controller [ 6.595156] usb usb2: Manufacturer: Linux 3.10.0-1062.9.1.el7_lustre.x86_64 ehci_hcd [ 6.603822] usb usb2: SerialNumber: 0000:00:1d.0 [ 6.609081] hub 2-0:1.0: USB hub found [ 6.613289] hub 2-0:1.0: 2 ports detected [ 6.617902] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver [ 6.624829] ohci-pci: OHCI PCI platform driver [ 6.629821] uhci_hcd: USB Universal Host Controller Interface driver [ 6.637018] usbcore: registered new interface driver usbserial_generic [ 6.644324] usbserial: USB Serial support registered for generic [ 6.651095] i8042: PNP: No PS/2 controller found. Probing ports directly. [ 6.841936] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 6.865948] tsc: Refined TSC clocksource calibration: 2693.509 MHz [ 7.698423] i8042: No controller found [ 7.702656] Switched to clocksource tsc [ 7.702690] mousedev: PS/2 mouse device common for all mice [ 7.702817] rtc_cmos 00:01: RTC can wake from S4 [ 7.703072] rtc_cmos 00:01: rtc core: registered rtc_cmos as rtc0 [ 7.703131] rtc_cmos 00:01: alarms up to one month, y3k, 242 bytes nvram, hpet irqs [ 7.703190] intel_pstate: Intel P-state driver initializing [ 7.714388] cpuidle: using governor menu [ 7.715941] hidraw: raw HID events driver (C) Jiri Kosina [ 7.716184] usbcore: registered new interface driver usbhid [ 7.716185] usbhid: USB HID core driver [ 7.716454] drop_monitor: Initializing network drop monitor service [ 7.716829] TCP: cubic registered [ 7.716836] Initializing XFRM netlink socket [ 7.717259] NET: Registered protocol family 10 [ 7.718453] NET: Registered protocol family 17 [ 7.718465] mpls_gso: MPLS GSO support [ 7.720251] mce: Using 20 MCE banks [ 7.720349] microcode: sig=0x206d7, pf=0x1, revision=0x718 [ 7.725470] microcode: Microcode Update Driver: v2.01 , Peter Oruba [ 7.725685] PM: Hibernation image not present or could not be loaded. [ 7.725689] Loading compiled-in X.509 certificates [ 7.725734] Loaded X.509 cert 'CentOS Linux kpatch signing key: ea0413152cde1d98ebdca3fe6f0230904c9ef717' [ 7.725761] Loaded X.509 cert 'CentOS Linux Driver update signing key: 7f421ee0ab69461574bb358861dbe77762a4201b' [ 7.726830] Loaded X.509 cert 'CentOS Linux kernel signing key: 499979dac1e0e49a853a4a6c50dd7873025a2824' [ 7.726892] registered taskstats version 1 [ 7.732054] Key type trusted registered [ 7.736627] Key type encrypted registered [ 7.736741] IMA: No TPM chip found, activating TPM-bypass! (rc=-19) [ 7.737673] Magic number: 4:995:48 [ 7.737819] pci 0000:7f:0a.3: hash matches [ 7.738025] memory memory213: hash matches [ 7.738049] memory memory80: hash matches [ 7.739952] rtc_cmos 00:01: setting system clock to 2020-05-08 23:02:16 UTC (1588978936) [ 7.753951] usb 2-1: new high-speed USB device number 2 using ehci-pci [ 7.766496] usb 1-1: New USB device found, idVendor=8087, idProduct=0024, bcdDevice= 0.00 [ 7.766500] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 7.766904] hub 1-1:1.0: USB hub found [ 7.767113] hub 1-1:1.0: 6 ports detected [ 7.878504] usb 2-1: New USB device found, idVendor=8087, idProduct=0024, bcdDevice= 0.00 [ 7.878516] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 7.879065] hub 2-1:1.0: USB hub found [ 7.879234] hub 2-1:1.0: 8 ports detected [ 7.956476] Freeing unused kernel memory: 1980k freed [ 7.962890] Write protecting the kernel read-only data: 12288k [ 7.972047] Freeing unused kernel memory: 416k freed [ 7.980393] Freeing unused kernel memory: 552k freed [ 7.994100] random: systemd: uninitialized urandom read (16 bytes read) [ 8.003562] random: systemd: uninitialized urandom read (16 bytes read) [ 8.011007] random: systemd: uninitialized urandom read (16 bytes read) [ 8.020613] systemd[1]: systemd 219 running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 -SECCOMP +BLKID +ELFUTILS +KMOD +IDN) [ 8.041067] systemd[1]: Detected architecture x86-64. [ 8.046716] systemd[1]: Running in initial RAM disk. [ 8.062130] systemd[1]: Set hostname to . [ 8.143025] random: systemd: uninitialized urandom read (16 bytes read) [ 8.150476] random: systemd: uninitialized urandom read (16 bytes read) [ 8.156995] usb 2-1.4: new full-speed USB device number 3 using ehci-pci [ 8.165434] random: systemd: uninitialized urandom read (16 bytes read) [ 8.172976] random: systemd: uninitialized urandom read (16 bytes read) [ 8.181756] random: systemd: uninitialized urandom read (16 bytes read) [ 8.189465] random: systemd: uninitialized urandom read (16 bytes read) [ 8.197504] random: systemd: uninitialized urandom read (16 bytes read) [ 8.211115] systemd[1]: [/run/systemd/generator/dev-disk-by\x2duuid-22d622b0\x2d4b4e\x2d4561\x2dbb85\x2d66849f6620ac.device.d/timeout.conf:3] Unknown lvalue 'JobRunningTimeoutSec' in section 'Unit' [ 8.231777] systemd[1]: Reached target Timers. [ 8.242148] systemd[1]: Reached target Local File Systems. [ 8.255440] systemd[1]: Created slice Root Slice. [ 8.266165] systemd[1]: Listening on udev Kernel Socket. [ 8.267734] usb 2-1.4: New USB device found, idVendor=046b, idProduct=ff10, bcdDevice= 1.00 [ 8.267737] usb 2-1.4: New USB device strings: Mfr=1, Product=2, SerialNumber=3 [ 8.267740] usb 2-1.4: Product: Virtual Keyboard and Mouse [ 8.267742] usb 2-1.4: Manufacturer: American Megatrends Inc. [ 8.267744] usb 2-1.4: SerialNumber: serial [ 8.269565] input: American Megatrends Inc. Virtual Keyboard and Mouse as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.4/2-1.4:1.0/input/input1 [ 8.320505] hid-generic 0003:046B:FF10.0001: input,hidraw0: USB HID v1.10 Keyboard [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:1d.0-1.4/input0 [ 8.321918] input: American Megatrends Inc. Virtual Keyboard and Mouse as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.4/2-1.4:1.1/input/input2 [ 8.322411] hid-generic 0003:046B:FF10.0002: input,hidraw1: USB HID v1.10 Mouse [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:1d.0-1.4/input1 [ 8.376232] systemd[1]: Created slice System Slice. [ 8.387078] systemd[1]: Reached target Slices. [ 8.397058] systemd[1]: Reached target Swap. [ 8.407176] systemd[1]: Listening on Journal Socket. [ 8.419087] systemd[1]: Starting Journal Service... [ 8.431009] systemd[1]: Starting Create list of required static device nodes for the current kernel... [ 8.451102] systemd[1]: Listening on udev Control Socket. [ 8.464034] systemd[1]: Reached target Sockets. [ 8.475062] systemd[1]: Starting dracut cmdline hook... [ 8.486860] systemd[1]: Starting Setup Virtual Console... [ 8.499070] systemd[1]: Starting Apply Kernel Variables... [ 8.519610] systemd[1]: Started Journal Service. [ 8.803485] mlx_compat: loading out-of-tree module taints kernel. [ 8.812407] mlx_compat: module verification failed: signature and/or required key missing - tainting kernel [ 8.824000] dca service started, version 1.12.1 [ 8.829328] Compat-mlnx-ofed backport release: 34c46d3 [ 8.836375] Backport based on mlnx_ofed/mlnx-ofa_kernel-4.0.git 34c46d3 [ 8.845313] compat.git: mlnx_ofed/mlnx-ofa_kernel-4.0.git [ 8.855181] pps_core: LinuxPPS API ver. 1 registered [ 8.861543] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 8.876388] PTP clock support registered [ 8.884134] libata version 3.00 loaded. [ 8.895373] mpt3sas version 27.101.01.00 loaded [ 8.901757] mpt3sas_cm0: 64 BIT PCI BUS DMA ADDRESSING SUPPORTED, total mem (32680212 kB) [ 8.912678] isci: Intel(R) C600 SAS Controller Driver - version 1.2.0 [ 8.921013] isci 0000:07:00.0: driver configured for rev: 6 silicon [ 8.921038] resource sanity check: requesting [mem 0x000c8800-0x000d23ff], which spans more than PCI Bus 0000:00 [mem 0x000cc000-0x000cffff window] [ 8.921045] caller pci_map_biosrom+0x26/0x40 mapping multiple BARs [ 8.921049] isci 0000:07:00.0: OEM parameter table found in OROM [ 8.921056] isci 0000:07:00.0: OEM SAS parameters (version: 1.1) loaded (platform) [ 8.921353] isci 0000:07:00.0: SCU controller 0: phy 3-0 cables: {short, short, short, short} [ 8.924041] igb: Intel(R) Gigabit Ethernet Network Driver - version 5.6.0-k [ 8.924041] igb: Copyright (c) 2007-2014 Intel Corporation. [ 8.924185] mlx4_core: Mellanox ConnectX core driver v5.0-1.0.0.0 [ 8.924190] scsi host1: isci [ 8.924224] mlx4_core: Initializing 0000:04:00.0 [ 8.924372] ahci 0000:00:1f.2: version 3.0 [ 8.924381] igb 0000:02:00.0: irq 41 for MSI/MSI-X [ 8.924645] igb 0000:02:00.0: irq 41 for MSI/MSI-X [ 8.924663] igb 0000:02:00.0: irq 42 for MSI/MSI-X [ 8.924680] igb 0000:02:00.0: irq 43 for MSI/MSI-X [ 8.924696] igb 0000:02:00.0: irq 44 for MSI/MSI-X [ 8.924714] igb 0000:02:00.0: irq 45 for MSI/MSI-X [ 8.924731] igb 0000:02:00.0: irq 46 for MSI/MSI-X [ 8.924749] igb 0000:02:00.0: irq 47 for MSI/MSI-X [ 8.924767] igb 0000:02:00.0: irq 48 for MSI/MSI-X [ 8.924784] igb 0000:02:00.0: irq 49 for MSI/MSI-X [ 8.924928] ahci 0000:00:1f.2: irq 50 for MSI/MSI-X [ 8.924946] igb 0000:02:00.0: PHY reset is blocked due to SOL/IDER session. [ 8.925315] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 8.925319] ahci 0000:00:1f.2: flags: 64bit ncq sntf pm led clo pio slum part ems apst [ 8.926084] isci 0000:07:00.0: irq 51 for MSI/MSI-X [ 8.926101] isci 0000:07:00.0: irq 52 for MSI/MSI-X [ 8.937679] scsi host2: ahci [ 8.937798] scsi host3: ahci [ 8.937928] scsi host4: ahci [ 8.938111] scsi host5: ahci [ 8.938236] scsi host6: ahci [ 8.938341] scsi host7: ahci [ 8.938400] ata1: SATA max UDMA/133 abar m2048@0xd1000000 port 0xd1000100 irq 50 [ 8.938402] ata2: SATA max UDMA/133 abar m2048@0xd1000000 port 0xd1000180 irq 50 [ 8.938405] ata3: SATA max UDMA/133 abar m2048@0xd1000000 port 0xd1000200 irq 50 [ 8.938408] ata4: SATA max UDMA/133 abar m2048@0xd1000000 port 0xd1000280 irq 50 [ 8.938411] ata5: SATA max UDMA/133 abar m2048@0xd1000000 port 0xd1000300 irq 50 [ 8.938414] ata6: SATA max UDMA/133 abar m2048@0xd1000000 port 0xd1000380 irq 50 [ 8.963041] igb 0000:02:00.0: added PHC on eth0 [ 8.963043] igb 0000:02:00.0: Intel(R) Gigabit Ethernet Network Connection [ 8.963044] igb 0000:02:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:0b:0b [ 8.963117] igb 0000:02:00.0: eth0: PBA No: 100000-000 [ 8.963119] igb 0000:02:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 8.963418] igb 0000:02:00.1: irq 54 for MSI/MSI-X [ 8.963460] igb 0000:02:00.1: irq 54 for MSI/MSI-X [ 8.963477] igb 0000:02:00.1: irq 55 for MSI/MSI-X [ 8.963493] igb 0000:02:00.1: irq 56 for MSI/MSI-X [ 8.963509] igb 0000:02:00.1: irq 57 for MSI/MSI-X [ 8.963525] igb 0000:02:00.1: irq 58 for MSI/MSI-X [ 8.963541] igb 0000:02:00.1: irq 59 for MSI/MSI-X [ 8.963558] igb 0000:02:00.1: irq 60 for MSI/MSI-X [ 8.963575] igb 0000:02:00.1: irq 61 for MSI/MSI-X [ 8.963591] igb 0000:02:00.1: irq 62 for MSI/MSI-X [ 8.963619] igb 0000:02:00.1: PHY reset is blocked due to SOL/IDER session. [ 8.966428] mpt3sas_cm0: CurrentHostPageSize is 0: Setting default host page size to 4k [ 8.966446] mpt3sas_cm0: MSI-X vectors supported: 96, no of cores: 32, max_msix_vectors: -1 [ 8.966526] mpt3sas 0000:06:00.0: irq 63 for MSI/MSI-X [ 8.966544] mpt3sas 0000:06:00.0: irq 64 for MSI/MSI-X [ 8.966561] mpt3sas 0000:06:00.0: irq 65 for MSI/MSI-X [ 8.966577] mpt3sas 0000:06:00.0: irq 66 for MSI/MSI-X [ 8.966593] mpt3sas 0000:06:00.0: irq 67 for MSI/MSI-X [ 8.966621] mpt3sas 0000:06:00.0: irq 68 for MSI/MSI-X [ 8.966638] mpt3sas 0000:06:00.0: irq 69 for MSI/MSI-X [ 8.966654] mpt3sas 0000:06:00.0: irq 70 for MSI/MSI-X [ 8.966671] mpt3sas 0000:06:00.0: irq 71 for MSI/MSI-X [ 8.966687] mpt3sas 0000:06:00.0: irq 72 for MSI/MSI-X [ 8.966703] mpt3sas 0000:06:00.0: irq 73 for MSI/MSI-X [ 8.966719] mpt3sas 0000:06:00.0: irq 74 for MSI/MSI-X [ 8.966735] mpt3sas 0000:06:00.0: irq 75 for MSI/MSI-X [ 8.966752] mpt3sas 0000:06:00.0: irq 76 for MSI/MSI-X [ 8.966768] mpt3sas 0000:06:00.0: irq 77 for MSI/MSI-X [ 8.966783] mpt3sas 0000:06:00.0: irq 78 for MSI/MSI-X [ 8.966804] mpt3sas 0000:06:00.0: irq 79 for MSI/MSI-X [ 8.966822] mpt3sas 0000:06:00.0: irq 80 for MSI/MSI-X [ 8.966839] mpt3sas 0000:06:00.0: irq 81 for MSI/MSI-X [ 8.966856] mpt3sas 0000:06:00.0: irq 82 for MSI/MSI-X [ 8.966874] mpt3sas 0000:06:00.0: irq 83 for MSI/MSI-X [ 8.966908] mpt3sas 0000:06:00.0: irq 84 for MSI/MSI-X [ 8.966926] mpt3sas 0000:06:00.0: irq 85 for MSI/MSI-X [ 8.966943] mpt3sas 0000:06:00.0: irq 86 for MSI/MSI-X [ 8.966960] mpt3sas 0000:06:00.0: irq 87 for MSI/MSI-X [ 8.966977] mpt3sas 0000:06:00.0: irq 88 for MSI/MSI-X [ 8.966993] mpt3sas 0000:06:00.0: irq 89 for MSI/MSI-X [ 8.967012] mpt3sas 0000:06:00.0: irq 90 for MSI/MSI-X [ 8.967030] mpt3sas 0000:06:00.0: irq 91 for MSI/MSI-X [ 8.967047] mpt3sas 0000:06:00.0: irq 92 for MSI/MSI-X [ 8.967064] mpt3sas 0000:06:00.0: irq 93 for MSI/MSI-X [ 8.967082] mpt3sas 0000:06:00.0: irq 94 for MSI/MSI-X [ 8.967324] mpt3sas0-msix0: PCI-MSI-X enabled: IRQ 63 [ 8.967325] mpt3sas0-msix1: PCI-MSI-X enabled: IRQ 64 [ 8.967326] mpt3sas0-msix2: PCI-MSI-X enabled: IRQ 65 [ 8.967326] mpt3sas0-msix3: PCI-MSI-X enabled: IRQ 66 [ 8.967327] mpt3sas0-msix4: PCI-MSI-X enabled: IRQ 67 [ 8.967328] mpt3sas0-msix5: PCI-MSI-X enabled: IRQ 68 [ 8.967328] mpt3sas0-msix6: PCI-MSI-X enabled: IRQ 69 [ 8.967329] mpt3sas0-msix7: PCI-MSI-X enabled: IRQ 70 [ 8.967330] mpt3sas0-msix8: PCI-MSI-X enabled: IRQ 71 [ 8.967331] mpt3sas0-msix9: PCI-MSI-X enabled: IRQ 72 [ 8.967331] mpt3sas0-msix10: PCI-MSI-X enabled: IRQ 73 [ 8.967332] mpt3sas0-msix11: PCI-MSI-X enabled: IRQ 74 [ 8.967333] mpt3sas0-msix12: PCI-MSI-X enabled: IRQ 75 [ 8.967333] mpt3sas0-msix13: PCI-MSI-X enabled: IRQ 76 [ 8.967334] mpt3sas0-msix14: PCI-MSI-X enabled: IRQ 77 [ 8.967334] mpt3sas0-msix15: PCI-MSI-X enabled: IRQ 78 [ 8.967335] mpt3sas0-msix16: PCI-MSI-X enabled: IRQ 79 [ 8.967336] mpt3sas0-msix17: PCI-MSI-X enabled: IRQ 80 [ 8.967336] mpt3sas0-msix18: PCI-MSI-X enabled: IRQ 81 [ 8.967337] mpt3sas0-msix19: PCI-MSI-X enabled: IRQ 82 [ 8.967337] mpt3sas0-msix20: PCI-MSI-X enabled: IRQ 83 [ 8.967338] mpt3sas0-msix21: PCI-MSI-X enabled: IRQ 84 [ 8.967339] mpt3sas0-msix22: PCI-MSI-X enabled: IRQ 85 [ 8.967339] mpt3sas0-msix23: PCI-MSI-X enabled: IRQ 86 [ 8.967340] mpt3sas0-msix24: PCI-MSI-X enabled: IRQ 87 [ 8.967341] mpt3sas0-msix25: PCI-MSI-X enabled: IRQ 88 [ 8.967342] mpt3sas0-msix26: PCI-MSI-X enabled: IRQ 89 [ 8.967342] mpt3sas0-msix27: PCI-MSI-X enabled: IRQ 90 [ 8.967343] mpt3sas0-msix28: PCI-MSI-X enabled: IRQ 91 [ 8.967344] mpt3sas0-msix29: PCI-MSI-X enabled: IRQ 92 [ 8.967345] mpt3sas0-msix30: PCI-MSI-X enabled: IRQ 93 [ 8.967345] mpt3sas0-msix31: PCI-MSI-X enabled: IRQ 94 [ 8.967347] mpt3sas_cm0: iomem(0x00000000d0b00000), mapped(0xffffbd8243d00000), size(65536) [ 8.967348] mpt3sas_cm0: ioport(0x0000000000002000), size(256) [ 9.000565] igb 0000:02:00.1: added PHC on eth1 [ 9.000566] igb 0000:02:00.1: Intel(R) Gigabit Ethernet Network Connection [ 9.000568] igb 0000:02:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:0b:0c [ 9.000640] igb 0000:02:00.1: eth1: PBA No: 100000-000 [ 9.000642] igb 0000:02:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 9.000933] igb 0000:02:00.2: irq 96 for MSI/MSI-X [ 9.000978] igb 0000:02:00.2: irq 96 for MSI/MSI-X [ 9.000995] igb 0000:02:00.2: irq 97 for MSI/MSI-X [ 9.001021] igb 0000:02:00.2: irq 98 for MSI/MSI-X [ 9.001038] igb 0000:02:00.2: irq 99 for MSI/MSI-X [ 9.001054] igb 0000:02:00.2: irq 100 for MSI/MSI-X [ 9.001085] igb 0000:02:00.2: irq 101 for MSI/MSI-X [ 9.001101] igb 0000:02:00.2: irq 102 for MSI/MSI-X [ 9.001117] igb 0000:02:00.2: irq 103 for MSI/MSI-X [ 9.001133] igb 0000:02:00.2: irq 104 for MSI/MSI-X [ 9.021417] mpt3sas_cm0: CurrentHostPageSize is 0: Setting default host page size to 4k [ 9.021418] mpt3sas_cm0: sending message unit reset !! [ 9.022910] mpt3sas_cm0: message unit reset: SUCCESS [ 9.056460] igb 0000:02:00.2: added PHC on eth2 [ 9.056462] igb 0000:02:00.2: Intel(R) Gigabit Ethernet Network Connection [ 9.056464] igb 0000:02:00.2: eth2: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:0b:0d [ 9.056537] igb 0000:02:00.2: eth2: PBA No: 100000-000 [ 9.056539] igb 0000:02:00.2: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 9.056896] igb 0000:02:00.3: irq 106 for MSI/MSI-X [ 9.056944] igb 0000:02:00.3: irq 106 for MSI/MSI-X [ 9.056967] igb 0000:02:00.3: irq 107 for MSI/MSI-X [ 9.056984] igb 0000:02:00.3: irq 108 for MSI/MSI-X [ 9.057000] igb 0000:02:00.3: irq 109 for MSI/MSI-X [ 9.057017] igb 0000:02:00.3: irq 110 for MSI/MSI-X [ 9.057035] igb 0000:02:00.3: irq 111 for MSI/MSI-X [ 9.057051] igb 0000:02:00.3: irq 112 for MSI/MSI-X [ 9.057080] igb 0000:02:00.3: irq 113 for MSI/MSI-X [ 9.057096] igb 0000:02:00.3: irq 114 for MSI/MSI-X [ 9.058525] [TTM] Zone kernel: Available graphics memory: 16340106 kiB [ 9.058526] [TTM] Zone dma32: Available graphics memory: 2097152 kiB [ 9.058527] [TTM] Initializing pool allocator [ 9.058540] [TTM] Initializing DMA pool allocator [ 9.068060] random: fast init done [ 9.102968] fbcon: mgadrmfb (fb0) is primary device [ 9.114466] igb 0000:02:00.3: added PHC on eth3 [ 9.114467] igb 0000:02:00.3: Intel(R) Gigabit Ethernet Network Connection [ 9.114469] igb 0000:02:00.3: eth3: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:0b:0e [ 9.114543] igb 0000:02:00.3: eth3: PBA No: 100000-000 [ 9.114544] igb 0000:02:00.3: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 9.178954] mpt3sas_cm0: Allocated physical memory: size(10017 kB) [ 9.178956] mpt3sas_cm0: Current Controller Queue Depth(10176),Max Controller Queue Depth(10240) [ 9.178956] mpt3sas_cm0: Scatter Gather Elements per IO(128) [ 9.242914] ata1: SATA link down (SStatus 0 SControl 300) [ 9.242942] ata5: SATA link down (SStatus 0 SControl 300) [ 9.242961] ata2: SATA link down (SStatus 0 SControl 300) [ 9.242981] ata3: SATA link down (SStatus 0 SControl 300) [ 9.243000] ata6: SATA link down (SStatus 0 SControl 300) [ 9.243967] ata4: SATA link down (SStatus 0 SControl 300) [ 9.337202] Console: switching to colour frame buffer device 128x48 [ 9.339468] mpt3sas_cm0: _base_display_fwpkg_version: complete [ 9.340045] mpt3sas_cm0: LSISAS3008: FWVersion(04.00.03.00), ChipRevision(0x02), BiosVersion(08.09.00.00) [ 9.340046] mpt3sas_cm0: Intel(R) RAID Controller RS3GC008 [ 9.340052] mpt3sas_cm0: Protocol=(Initiator,Target), Capabilities=(TLR,EEDP,Snapshot Buffer,Diag Trace Buffer,Task Set Full,NCQ) [ 9.340181] scsi host0: Fusion MPT SAS Host [ 9.340933] mpt3sas_cm0: sending port enable !! [ 9.343290] mpt3sas_cm0: host_add: handle(0x0001), sas_addr(0x500605b00b72dac0), phys(8) [ 9.351931] mpt3sas_cm0: port enable: SUCCESS [ 9.352708] scsi 0:0:0:0: Direct-Access LSI INF-01-00 0820 PQ: 1 ANSI: 5 [ 9.352715] scsi 0:0:0:0: SSP: handle(0x0009), sas_addr(0x50080e51ff0d0010), phy(0), device_name(0x50080e51ff0d0010) [ 9.352718] scsi 0:0:0:0: enclosure logical id (0x500605b00b72dac0), slot(3) [ 9.352720] scsi 0:0:0:0: enclosure level(0x0000), connector name( ) [ 9.352724] scsi 0:0:0:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) [ 9.388569] mgag200 0000:09:00.0: fb0: mgadrmfb frame buffer device [ 9.398961] [drm] Initialized mgag200 1.0.0 20110418 for 0000:09:00.0 on minor 0 [ 10.165644] scsi 0:0:0:7: Direct-Access LSI Universal Xport 0820 PQ: 0 ANSI: 5 [ 10.174699] scsi 0:0:0:7: SSP: handle(0x0009), sas_addr(0x50080e51ff0d0010), phy(0), device_name(0x50080e51ff0d0010) [ 10.186444] scsi 0:0:0:7: enclosure logical id (0x500605b00b72dac0), slot(3) [ 10.194416] scsi 0:0:0:7: enclosure level(0x0000), connector name( ) [ 10.201914] scsi 0:0:0:7: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) [ 10.437971] sas: phy-1:0 added to port-1:0, phy_mask:0x1 (5001e676b0b0b000) [ 10.438003] sas: phy-1:1 added to port-1:1, phy_mask:0x2 (5001e676b0b0b001) [ 10.438019] sas: DOING DISCOVERY on port 0, pid:227 [ 10.438079] sas: Enter sas_scsi_recover_host busy: 0 failed: 0 [ 10.438264] sas: ata7: end_device-1:0: dev error handler [ 10.599672] ata7.00: ATA-8: ST500NM0011, SN02, max UDMA/133 [ 10.605901] ata7.00: 976773168 sectors, multi 0: LBA48 NCQ (depth 31/32) [ 10.614236] ata7.00: configured for UDMA/133 [ 10.619033] sas: --- Exit sas_scsi_recover_host: busy: 0 failed: 0 tries: 1 [ 10.631342] scsi 1:0:0:0: Direct-Access ATA ST500NM0011 SN02 PQ: 0 ANSI: 5 [ 14.166007] scsi 0:0:0:41: Direct-Access LSI INF-01-00 0820 PQ: 0 ANSI: 5 [ 14.175150] scsi 0:0:0:41: SSP: handle(0x0009), sas_addr(0x50080e51ff0d0010), phy(0), device_name(0x50080e51ff0d0010) [ 14.186990] scsi 0:0:0:41: enclosure logical id (0x500605b00b72dac0), slot(3) [ 14.195048] scsi 0:0:0:41: enclosure level(0x0000), connector name( ) [ 14.202647] scsi 0:0:0:41: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) [ 15.155800] sas: DONE DISCOVERY on port 0, pid:227, result:0 [ 15.155815] sas: DOING DISCOVERY on port 1, pid:227 [ 15.155868] sas: Enter sas_scsi_recover_host busy: 0 failed: 0 [ 15.155880] sas: ata7: end_device-1:0: dev error handler [ 15.155896] sas: ata8: end_device-1:1: dev error handler [ 15.316544] ata8.00: ATA-8: ST500NM0011, SN02, max UDMA/133 [ 15.322774] ata8.00: 976773168 sectors, multi 0: LBA48 NCQ (depth 31/32) [ 15.331105] ata8.00: configured for UDMA/133 [ 15.335886] sas: --- Exit sas_scsi_recover_host: busy: 0 failed: 0 tries: 1 [ 15.347089] scsi 1:0:1:0: Direct-Access ATA ST500NM0011 SN02 PQ: 0 ANSI: 5 [ 15.463156] mlx4_core 0000:04:00.0: Old device ETS support detected [ 15.470153] mlx4_core 0000:04:00.0: Consider upgrading device FW. [ 15.476956] mlx4_core 0000:04:00.0: DMFS high rate mode not supported [ 15.484136] mlx4_core: device is working in RoCE mode: Roce V1 [ 15.490652] mlx4_core: UD QP Gid type is: V1 [ 16.546476] mlx4_core 0000:04:00.0: 63.008 Gb/s available PCIe bandwidth (8 GT/s x8 link) [ 16.555781] mlx4_core 0000:04:00.0: irq 115 for MSI/MSI-X [ 16.555798] mlx4_core 0000:04:00.0: irq 116 for MSI/MSI-X [ 16.555815] mlx4_core 0000:04:00.0: irq 117 for MSI/MSI-X [ 16.555829] mlx4_core 0000:04:00.0: irq 118 for MSI/MSI-X [ 16.555848] mlx4_core 0000:04:00.0: irq 119 for MSI/MSI-X [ 16.555875] mlx4_core 0000:04:00.0: irq 120 for MSI/MSI-X [ 16.555890] mlx4_core 0000:04:00.0: irq 121 for MSI/MSI-X [ 16.555907] mlx4_core 0000:04:00.0: irq 122 for MSI/MSI-X [ 16.555922] mlx4_core 0000:04:00.0: irq 123 for MSI/MSI-X [ 16.555936] mlx4_core 0000:04:00.0: irq 124 for MSI/MSI-X [ 16.555951] mlx4_core 0000:04:00.0: irq 125 for MSI/MSI-X [ 16.555966] mlx4_core 0000:04:00.0: irq 126 for MSI/MSI-X [ 16.555980] mlx4_core 0000:04:00.0: irq 127 for MSI/MSI-X [ 16.555995] mlx4_core 0000:04:00.0: irq 128 for MSI/MSI-X [ 16.556009] mlx4_core 0000:04:00.0: irq 129 for MSI/MSI-X [ 16.556023] mlx4_core 0000:04:00.0: irq 130 for MSI/MSI-X [ 16.556037] mlx4_core 0000:04:00.0: irq 131 for MSI/MSI-X [ 16.556052] mlx4_core 0000:04:00.0: irq 132 for MSI/MSI-X [ 16.556067] mlx4_core 0000:04:00.0: irq 133 for MSI/MSI-X [ 16.556082] mlx4_core 0000:04:00.0: irq 134 for MSI/MSI-X [ 16.556096] mlx4_core 0000:04:00.0: irq 135 for MSI/MSI-X [ 16.556124] mlx4_core 0000:04:00.0: irq 136 for MSI/MSI-X [ 16.556138] mlx4_core 0000:04:00.0: irq 137 for MSI/MSI-X [ 16.556152] mlx4_core 0000:04:00.0: irq 138 for MSI/MSI-X [ 16.556167] mlx4_core 0000:04:00.0: irq 139 for MSI/MSI-X [ 16.556181] mlx4_core 0000:04:00.0: irq 140 for MSI/MSI-X [ 16.556196] mlx4_core 0000:04:00.0: irq 141 for MSI/MSI-X [ 16.556211] mlx4_core 0000:04:00.0: irq 142 for MSI/MSI-X [ 16.556225] mlx4_core 0000:04:00.0: irq 143 for MSI/MSI-X [ 16.556240] mlx4_core 0000:04:00.0: irq 144 for MSI/MSI-X [ 16.556254] mlx4_core 0000:04:00.0: irq 145 for MSI/MSI-X [ 16.556268] mlx4_core 0000:04:00.0: irq 146 for MSI/MSI-X [ 16.556282] mlx4_core 0000:04:00.0: irq 147 for MSI/MSI-X [ 16.556296] mlx4_core 0000:04:00.0: irq 148 for MSI/MSI-X [ 16.556311] mlx4_core 0000:04:00.0: irq 149 for MSI/MSI-X [ 16.556325] mlx4_core 0000:04:00.0: irq 150 for MSI/MSI-X [ 16.556340] mlx4_core 0000:04:00.0: irq 151 for MSI/MSI-X [ 16.556369] mlx4_core 0000:04:00.0: irq 152 for MSI/MSI-X [ 16.556383] mlx4_core 0000:04:00.0: irq 153 for MSI/MSI-X [ 16.556397] mlx4_core 0000:04:00.0: irq 154 for MSI/MSI-X [ 16.556411] mlx4_core 0000:04:00.0: irq 155 for MSI/MSI-X [ 16.556426] mlx4_core 0000:04:00.0: irq 156 for MSI/MSI-X [ 16.556441] mlx4_core 0000:04:00.0: irq 157 for MSI/MSI-X [ 16.556455] mlx4_core 0000:04:00.0: irq 158 for MSI/MSI-X [ 16.556469] mlx4_core 0000:04:00.0: irq 159 for MSI/MSI-X [ 16.556484] mlx4_core 0000:04:00.0: irq 160 for MSI/MSI-X [ 16.556498] mlx4_core 0000:04:00.0: irq 161 for MSI/MSI-X [ 16.556512] mlx4_core 0000:04:00.0: irq 162 for MSI/MSI-X [ 16.556527] mlx4_core 0000:04:00.0: irq 163 for MSI/MSI-X [ 16.556541] mlx4_core 0000:04:00.0: irq 164 for MSI/MSI-X [ 16.556556] mlx4_core 0000:04:00.0: irq 165 for MSI/MSI-X [ 16.556570] mlx4_core 0000:04:00.0: irq 166 for MSI/MSI-X [ 16.556585] mlx4_core 0000:04:00.0: irq 167 for MSI/MSI-X [ 16.556612] mlx4_core 0000:04:00.0: irq 168 for MSI/MSI-X [ 16.556626] mlx4_core 0000:04:00.0: irq 169 for MSI/MSI-X [ 16.556641] mlx4_core 0000:04:00.0: irq 170 for MSI/MSI-X [ 16.556655] mlx4_core 0000:04:00.0: irq 171 for MSI/MSI-X [ 16.556670] mlx4_core 0000:04:00.0: irq 172 for MSI/MSI-X [ 16.556685] mlx4_core 0000:04:00.0: irq 173 for MSI/MSI-X [ 16.556700] mlx4_core 0000:04:00.0: irq 174 for MSI/MSI-X [ 16.556714] mlx4_core 0000:04:00.0: irq 175 for MSI/MSI-X [ 16.556729] mlx4_core 0000:04:00.0: irq 176 for MSI/MSI-X [ 16.556743] mlx4_core 0000:04:00.0: irq 177 for MSI/MSI-X [ 16.556758] mlx4_core 0000:04:00.0: irq 178 for MSI/MSI-X [ 16.556772] mlx4_core 0000:04:00.0: irq 179 for MSI/MSI-X [ 16.811007] scsi 0:0:0:42: Direct-Access LSI INF-01-00 0820 PQ: 0 ANSI: 5 [ 16.820151] scsi 0:0:0:42: SSP: handle(0x0009), sas_addr(0x50080e51ff0d0010), phy(0), device_name(0x50080e51ff0d0010) [ 16.831993] scsi 0:0:0:42: enclosure logical id (0x500605b00b72dac0), slot(3) [ 16.840053] scsi 0:0:0:42: enclosure level(0x0000), connector name( ) [ 16.847649] scsi 0:0:0:42: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) [ 16.858065] mlx4_ib_add: mlx4_ib: Mellanox ConnectX InfiniBand driver v5.0-1.0.0.0 [ 16.868155] mlx4_ib_add: counter index 0 for port 1 allocated 0 [ 16.869782] sas: DONE DISCOVERY on port 1, pid:227, result:0 [ 16.875745] mlx4_ib_add: counter index 1 for port 2 allocated 0 [ 16.895061] sd 1:0:0:0: [sda] 976773168 512-byte logical blocks: (500 GB/465 GiB) [ 16.895126] sd 1:0:1:0: [sdb] 976773168 512-byte logical blocks: (500 GB/465 GiB) [ 16.895430] sd 1:0:1:0: [sdb] Write Protect is off [ 16.895434] sd 1:0:1:0: [sdb] Mode Sense: 00 3a 00 00 [ 16.895562] sd 1:0:1:0: [sdb] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 16.902195] sdb: [ 16.903215] sd 1:0:1:0: [sdb] Attached SCSI disk [ 16.934832] sd 1:0:0:0: [sda] Write Protect is off [ 16.940199] sd 1:0:0:0: [sda] Mode Sense: 00 3a 00 00 [ 16.940245] sd 1:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 16.963215] scsi 0:0:0:43: Direct-Access LSI INF-01-00 0820 PQ: 0 ANSI: 5 [ 16.969239] sda: sda1 sda2 [ 16.969883] sd 1:0:0:0: [sda] Attached SCSI disk [ 16.980651] scsi 0:0:0:43: SSP: handle(0x0009), sas_addr(0x50080e51ff0d0010), phy(0), device_name(0x50080e51ff0d0010) [ 16.992495] scsi 0:0:0:43: enclosure logical id (0x500605b00b72dac0), slot(3) [ 17.000563] scsi 0:0:0:43: enclosure level(0x0000), connector name( ) [ 17.008158] scsi 0:0:0:43: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) [ 17.029239] scsi 0:0:0:44: Direct-Access LSI INF-01-00 0820 PQ: 0 ANSI: 5 [ 17.038407] scsi 0:0:0:44: SSP: handle(0x0009), sas_addr(0x50080e51ff0d0010), phy(0), device_name(0x50080e51ff0d0010) [ 17.050253] scsi 0:0:0:44: enclosure logical id (0x500605b00b72dac0), slot(3) [ 17.058331] scsi 0:0:0:44: enclosure level(0x0000), connector name( ) [ 17.065936] scsi 0:0:0:44: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) [ 17.087241] scsi 0:0:0:45: Direct-Access LSI INF-01-00 0820 PQ: 0 ANSI: 5 [ 17.096410] scsi 0:0:0:45: SSP: handle(0x0009), sas_addr(0x50080e51ff0d0010), phy(0), device_name(0x50080e51ff0d0010) [ 17.108256] scsi 0:0:0:45: enclosure logical id (0x500605b00b72dac0), slot(3) [ 17.116323] scsi 0:0:0:45: enclosure level(0x0000), connector name( ) [ 17.123916] scsi 0:0:0:45: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) [ 17.148261] scsi 0:0:0:46: Direct-Access LSI INF-01-00 0820 PQ: 0 ANSI: 5 [ 17.157427] scsi 0:0:0:46: SSP: handle(0x0009), sas_addr(0x50080e51ff0d0010), phy(0), device_name(0x50080e51ff0d0010) [ 17.169274] scsi 0:0:0:46: enclosure logical id (0x500605b00b72dac0), slot(3) [ 17.177336] scsi 0:0:0:46: enclosure level(0x0000), connector name( ) [ 17.184956] scsi 0:0:0:46: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) [ 17.217926] scsi 0:0:1:0: Direct-Access LSI INF-01-00 0820 PQ: 1 ANSI: 5 [ 17.226994] scsi 0:0:1:0: SSP: handle(0x000a), sas_addr(0x50080e51fedb8010), phy(4), device_name(0x50080e51fedb8010) [ 17.238762] scsi 0:0:1:0: enclosure logical id (0x500605b00b72dac0), slot(7) [ 17.246719] scsi 0:0:1:0: enclosure level(0x0000), connector name( ) [ 17.254225] scsi 0:0:1:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) [ 17.277137] scsi 0:0:1:7: Direct-Access LSI Universal Xport 0820 PQ: 0 ANSI: 5 [ 17.286200] scsi 0:0:1:7: SSP: handle(0x000a), sas_addr(0x50080e51fedb8010), phy(4), device_name(0x50080e51fedb8010) [ 17.297959] scsi 0:0:1:7: enclosure logical id (0x500605b00b72dac0), slot(7) [ 17.305932] scsi 0:0:1:7: enclosure level(0x0000), connector name( ) [ 17.313433] scsi 0:0:1:7: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) [ 17.337233] scsi 0:0:1:41: Direct-Access LSI INF-01-00 0820 PQ: 0 ANSI: 5 [ 17.346382] scsi 0:0:1:41: SSP: handle(0x000a), sas_addr(0x50080e51fedb8010), phy(4), device_name(0x50080e51fedb8010) [ 17.358227] scsi 0:0:1:41: enclosure logical id (0x500605b00b72dac0), slot(7) [ 17.366295] scsi 0:0:1:41: enclosure level(0x0000), connector name( ) [ 17.373898] scsi 0:0:1:41: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) [ 17.395315] scsi 0:0:1:42: Direct-Access LSI INF-01-00 0820 PQ: 0 ANSI: 5 [ 17.404470] scsi 0:0:1:42: SSP: handle(0x000a), sas_addr(0x50080e51fedb8010), phy(4), device_name(0x50080e51fedb8010) [ 17.416315] scsi 0:0:1:42: enclosure logical id (0x500605b00b72dac0), slot(7) [ 17.424371] scsi 0:0:1:42: enclosure level(0x0000), connector name( ) [ 17.431964] scsi 0:0:1:42: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) [ 17.961179] scsi 0:0:1:43: Direct-Access LSI INF-01-00 0820 PQ: 0 ANSI: 5 [ 17.970342] scsi 0:0:1:43: SSP: handle(0x000a), sas_addr(0x50080e51fedb8010), phy(4), device_name(0x50080e51fedb8010) [ 17.982205] scsi 0:0:1:43: enclosure logical id (0x500605b00b72dac0), slot(7) [ 17.990282] scsi 0:0:1:43: enclosure level(0x0000), connector name( ) [ 17.997881] scsi 0:0:1:43: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) [ 18.019210] scsi 0:0:1:44: Direct-Access LSI INF-01-00 0820 PQ: 0 ANSI: 5 [ 18.028366] scsi 0:0:1:44: SSP: handle(0x000a), sas_addr(0x50080e51fedb8010), phy(4), device_name(0x50080e51fedb8010) [ 18.040212] scsi 0:0:1:44: enclosure logical id (0x500605b00b72dac0), slot(7) [ 18.048267] scsi 0:0:1:44: enclosure level(0x0000), connector name( ) [ 18.055860] scsi 0:0:1:44: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) [ 18.077179] scsi 0:0:1:45: Direct-Access LSI INF-01-00 0820 PQ: 0 ANSI: 5 [ 18.086333] scsi 0:0:1:45: SSP: handle(0x000a), sas_addr(0x50080e51fedb8010), phy(4), device_name(0x50080e51fedb8010) [ 18.098178] scsi 0:0:1:45: enclosure logical id (0x500605b00b72dac0), slot(7) [ 18.106240] scsi 0:0:1:45: enclosure level(0x0000), connector name( ) [ 18.113855] scsi 0:0:1:45: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) [ 18.135238] scsi 0:0:1:46: Direct-Access LSI INF-01-00 0820 PQ: 0 ANSI: 5 [ 18.144397] scsi 0:0:1:46: SSP: handle(0x000a), sas_addr(0x50080e51fedb8010), phy(4), device_name(0x50080e51fedb8010) [ 18.156243] scsi 0:0:1:46: enclosure logical id (0x500605b00b72dac0), slot(7) [ 18.164298] scsi 0:0:1:46: enclosure level(0x0000), connector name( ) [ 18.171898] scsi 0:0:1:46: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) [ 18.193764] scsi 0:0:0:0: rdac: LUN 0 (RDAC) (unowned) [ 18.200250] sd 0:0:0:7: [sdc] 40960 512-byte logical blocks: (20.9 MB/20.0 MiB) [ 18.200517] scsi 0:0:0:41: rdac: LUN 41 (RDAC) (owned) [ 18.200910] sd 0:0:0:41: [sdd] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB) [ 18.201059] scsi 0:0:0:42: rdac: LUN 42 (RDAC) (owned) [ 18.201180] sd 0:0:0:41: [sdd] Write Protect is off [ 18.201183] sd 0:0:0:41: [sdd] Mode Sense: 83 00 10 08 [ 18.201298] sd 0:0:0:41: [sdd] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 18.201323] sd 0:0:0:42: [sde] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB) [ 18.201602] scsi 0:0:0:43: rdac: LUN 43 (RDAC) (owned) [ 18.201615] sd 0:0:0:42: [sde] Write Protect is off [ 18.201619] sd 0:0:0:42: [sde] Mode Sense: 83 00 10 08 [ 18.201712] sd 0:0:0:42: [sde] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 18.201993] sd 0:0:0:43: [sdf] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB) [ 18.202203] scsi 0:0:0:44: rdac: LUN 44 (RDAC) (owned) [ 18.202478] sd 0:0:0:44: [sdg] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB) [ 18.202579] sd 0:0:0:43: [sdf] Write Protect is off [ 18.202583] sd 0:0:0:43: [sdf] Mode Sense: 83 00 10 08 [ 18.202692] sd 0:0:0:43: [sdf] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 18.202741] scsi 0:0:0:45: rdac: LUN 45 (RDAC) (owned) [ 18.202810] sd 0:0:0:44: [sdg] Write Protect is off [ 18.202814] sd 0:0:0:44: [sdg] Mode Sense: 83 00 10 08 [ 18.202934] sd 0:0:0:44: [sdg] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 18.203013] sd 0:0:0:45: [sdh] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB) [ 18.203089] sdd: [ 18.203330] scsi 0:0:0:46: rdac: LUN 46 (RDAC) (owned) [ 18.203349] sd 0:0:0:45: [sdh] Write Protect is off [ 18.203352] sd 0:0:0:45: [sdh] Mode Sense: 83 00 10 08 [ 18.203403] sde: [ 18.203455] sd 0:0:0:45: [sdh] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 18.203561] sd 0:0:0:46: [sdi] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB) [ 18.203815] sd 0:0:0:46: [sdi] Write Protect is off [ 18.203817] sd 0:0:0:46: [sdi] Mode Sense: 83 00 10 08 [ 18.203825] scsi 0:0:1:0: rdac: LUN 0 (RDAC) (unowned) [ 18.203957] sd 0:0:0:46: [sdi] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 18.204143] sd 0:0:0:42: [sde] Attached SCSI disk [ 18.204229] sd 0:0:0:41: [sdd] Attached SCSI disk [ 18.204341] sd 0:0:1:7: [sdj] 40960 512-byte logical blocks: (20.9 MB/20.0 MiB) [ 18.204537] sdf: [ 18.204557] scsi 0:0:1:41: rdac: LUN 41 (RDAC) (unowned) [ 18.204685] sd 0:0:1:7: [sdj] Write Protect is off [ 18.204689] sd 0:0:1:7: [sdj] Mode Sense: 83 00 10 08 [ 18.204771] sd 0:0:1:41: [sdk] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB) [ 18.204782] sd 0:0:1:7: [sdj] Write cache: disabled, read cache: enabled, supports DPO and FUA [ 18.204893] sd 0:0:0:44: [sdg] Attached SCSI disk [ 18.204922] random: crng init done [ 18.205048] sd 0:0:1:41: [sdk] Write Protect is off [ 18.205051] sd 0:0:1:41: [sdk] Mode Sense: 83 00 10 08 [ 18.205069] scsi 0:0:1:42: rdac: LUN 42 (RDAC) (unowned) [ 18.205140] sd 0:0:1:41: [sdk] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 18.205282] sd 0:0:0:43: [sdf] Attached SCSI disk [ 18.205296] sdh: [ 18.205297] sd 0:0:1:42: [sdl] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB) [ 18.205544] sd 0:0:1:42: [sdl] Write Protect is off [ 18.205547] sd 0:0:1:42: [sdl] Mode Sense: 83 00 10 08 [ 18.205569] sd 0:0:0:46: [sdi] Attached SCSI disk [ 18.205590] scsi 0:0:1:43: rdac: LUN 43 (RDAC) (unowned) [ 18.205646] sd 0:0:1:42: [sdl] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 18.205827] sd 0:0:1:43: [sdm] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB) [ 18.205923] sd 0:0:0:45: [sdh] Attached SCSI disk [ 18.206719] scsi 0:0:1:44: rdac: LUN 44 (RDAC) (unowned) [ 18.206755] sd 0:0:1:43: [sdm] Write Protect is off [ 18.206757] sd 0:0:1:43: [sdm] Mode Sense: 83 00 10 08 [ 18.206764] Dev sdk: unable to read RDB block 0 [ 18.206778] sdk: unable to read partition table [ 18.206847] sd 0:0:1:43: [sdm] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 18.206949] sd 0:0:1:44: [sdn] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB) [ 18.207094] Dev sdl: unable to read RDB block 0 [ 18.207107] sdl: unable to read partition table [ 18.207220] sd 0:0:1:44: [sdn] Write Protect is off [ 18.207222] scsi 0:0:1:45: rdac: LUN 45 (RDAC) (unowned) [ 18.207223] sd 0:0:1:44: [sdn] Mode Sense: 83 00 10 08 [ 18.207320] sd 0:0:1:44: [sdn] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 18.207455] sd 0:0:1:45: [sdo] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB) [ 18.207487] sd 0:0:1:41: [sdk] Attached SCSI disk [ 18.207713] scsi 0:0:1:46: rdac: LUN 46 (RDAC) (unowned) [ 18.207769] sd 0:0:1:45: [sdo] Write Protect is off [ 18.207772] sd 0:0:1:45: [sdo] Mode Sense: 83 00 10 08 [ 18.207781] sd 0:0:1:42: [sdl] Attached SCSI disk [ 18.207796] Dev sdm: unable to read RDB block 0 [ 18.207809] sdm: unable to read partition table [ 18.207867] sd 0:0:1:45: [sdo] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 18.207909] sd 0:0:1:46: [sdp] 31247843328 512-byte logical blocks: (15.9 TB/14.5 TiB) [ 18.208217] sd 0:0:1:46: [sdp] Write Protect is off [ 18.208220] sd 0:0:1:46: [sdp] Mode Sense: 83 00 10 08 [ 18.208304] Dev sdn: unable to read RDB block 0 [ 18.208318] sd 0:0:1:46: [sdp] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 18.208319] sdn: unable to read partition table [ 18.208477] sd 0:0:1:43: [sdm] Attached SCSI disk [ 18.208855] Dev sdo: unable to read RDB block 0 [ 18.208870] sdo: unable to read partition table [ 18.208994] sd 0:0:1:44: [sdn] Attached SCSI disk [ 18.209187] Dev sdp: unable to read RDB block 0 [ 18.209201] sdp: unable to read partition table [ 18.209502] sd 0:0:1:45: [sdo] Attached SCSI disk [ 18.209781] sd 0:0:1:46: [sdp] Attached SCSI disk [ 18.634799] sdj: [ 18.635408] sd 0:0:1:7: [sdj] Attached SCSI disk [ 18.738728] sd 0:0:0:7: [sdc] Write Protect is off [ 18.744109] sd 0:0:0:7: [sdc] Mode Sense: 83 00 10 08 [ 18.744274] sd 0:0:0:7: [sdc] Write cache: disabled, read cache: enabled, supports DPO and FUA [ 18.755083] sdc: [ 18.757898] sd 0:0:0:7: [sdc] Attached SCSI disk [ 21.606638] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null) [ 22.040212] systemd-journald[283]: Received SIGTERM from PID 1 (systemd). [ 22.441600] SELinux: Disabled at runtime. [ 22.446249] SELinux: Unregistering netfilter hooks [ 22.489743] type=1404 audit(1588978951.250:2): selinux=0 auid=4294967295 ses=4294967295 [ 22.745279] ip_tables: (C) 2000-2006 Netfilter Core Team [ 22.752033] systemd[1]: Inserted module 'ip_tables' [ 23.836895] RPC: Registered named UNIX socket transport module. [ 23.844676] RPC: Registered udp transport module. [ 23.851512] RPC: Registered tcp transport module. [ 23.858295] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 23.955104] EXT4-fs (sda1): re-mounted. Opts: (null) [ 24.184998] systemd-journald[1203]: Received request to flush runtime journal from PID 1 [ 24.353235] device-mapper: uevent: version 1.0.3 [ 24.358732] device-mapper: ioctl: 4.37.1-ioctl (2018-04-03) initialised: dm-devel@redhat.com [ 25.695028] acpi PNP0C14:00: duplicate WMI GUID 0E7AF9F2-44A1-4C6F-A4B0-A7678480DA61 (first instance was on PNP0C14:00) [ 25.707128] acpi PNP0C14:00: duplicate WMI GUID 0E7AF9F2-44A1-4C6F-A4B0-A7678480DA61 (first instance was on PNP0C14:00) [ 26.143391] IPMI message handler: version 39.2 [ 26.174394] ipmi device interface [ 26.213032] ipmi_si: IPMI System Interface driver [ 26.218311] ipmi_si dmi-ipmi-si.0: probing via SMBIOS [ 26.223970] ipmi_platform: ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0 [ 26.232057] ipmi_si: Adding SMBIOS-specified kcs state machine [ 26.238674] ipmi_si: Trying SMBIOS-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0 [ 26.265698] ioatdma: Intel(R) QuickData Technology Driver 4.00 [ 26.272513] ioatdma 0000:00:04.0: irq 181 for MSI/MSI-X [ 26.272798] igb 0000:02:00.0: DCA enabled [ 26.277323] igb 0000:02:00.1: DCA enabled [ 26.282005] ioatdma 0000:00:04.1: irq 183 for MSI/MSI-X [ 26.282214] igb 0000:02:00.2: DCA enabled [ 26.286722] igb 0000:02:00.3: DCA enabled [ 26.291430] ioatdma 0000:00:04.2: irq 184 for MSI/MSI-X [ 26.291842] ioatdma 0000:00:04.3: irq 185 for MSI/MSI-X [ 26.292167] ioatdma 0000:00:04.4: irq 186 for MSI/MSI-X [ 26.292489] ioatdma 0000:00:04.5: irq 187 for MSI/MSI-X [ 26.292813] ioatdma 0000:00:04.6: irq 188 for MSI/MSI-X [ 26.293121] ioatdma 0000:00:04.7: irq 189 for MSI/MSI-X [ 26.293523] ioatdma 0000:80:04.0: irq 191 for MSI/MSI-X [ 26.293909] ioatdma 0000:80:04.1: irq 193 for MSI/MSI-X [ 26.294176] ioatdma 0000:80:04.2: irq 194 for MSI/MSI-X [ 26.294456] ioatdma 0000:80:04.3: irq 195 for MSI/MSI-X [ 26.294723] ioatdma 0000:80:04.4: irq 196 for MSI/MSI-X [ 26.294982] ioatdma 0000:80:04.5: irq 197 for MSI/MSI-X [ 26.295234] ioatdma 0000:80:04.6: irq 198 for MSI/MSI-X [ 26.295494] ioatdma 0000:80:04.7: irq 199 for MSI/MSI-X [ 26.310590] ipmi_si dmi-ipmi-si.0: Found new BMC (man_id: 0x000157, prod_id: 0x0049, dev_id: 0x21) [ 26.370203] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [ 26.375079] ipmi_si dmi-ipmi-si.0: IPMI kcs interface initialized [ 26.385105] sd 1:0:0:0: Attached scsi generic sg0 type 0 [ 26.385988] i801_smbus 0000:07:00.3: Enabling SMBus device [ 26.386023] i801_smbus 0000:07:00.3: SMBus using PCI interrupt [ 26.408159] sd 1:0:1:0: Attached scsi generic sg1 type 0 [ 26.414178] scsi 0:0:0:0: Attached scsi generic sg2 type 0 [ 26.420363] sd 0:0:0:7: Attached scsi generic sg3 type 0 [ 26.426545] sd 0:0:0:41: Attached scsi generic sg4 type 0 [ 26.432621] ipmi_ssif: IPMI SSIF Interface driver [ 26.432686] sd 0:0:0:42: Attached scsi generic sg5 type 0 [ 26.432755] sd 0:0:0:43: Attached scsi generic sg6 type 0 [ 26.432802] sd 0:0:0:44: Attached scsi generic sg7 type 0 [ 26.432850] sd 0:0:0:45: Attached scsi generic sg8 type 0 [ 26.432899] sd 0:0:0:46: Attached scsi generic sg9 type 0 [ 26.432948] scsi 0:0:1:0: Attached scsi generic sg10 type 0 [ 26.433010] sd 0:0:1:7: Attached scsi generic sg11 type 0 [ 26.433065] sd 0:0:1:41: Attached scsi generic sg12 type 0 [ 26.433113] sd 0:0:1:42: Attached scsi generic sg13 type 0 [ 26.433159] sd 0:0:1:43: Attached scsi generic sg14 type 0 [ 26.433207] sd 0:0:1:44: Attached scsi generic sg15 type 0 [ 26.433255] sd 0:0:1:45: Attached scsi generic sg16 type 0 [ 26.433304] sd 0:0:1:46: Attached scsi generic sg17 type 0 [ 26.517122] input: PC Speaker as /devices/platform/pcspkr/input/input3 [ 26.524723] mei_me 0000:00:16.0: Device doesn't have valid ME Interface [ 26.532652] cryptd: max_cpu_qlen set to 1000 [ 26.550492] device-mapper: multipath round-robin: version 1.2.0 loaded [ 26.583549] AVX version of gcm_enc/dec engaged. [ 26.588634] AES CTR mode by8 optimization enabled [ 26.596540] alg: No test for __gcm-aes-aesni (__driver-gcm-aes-aesni) [ 26.603813] alg: No test for __generic-gcm-aes-aesni (__driver-generic-gcm-aes-aesni) [ 26.792863] kvm: disabled by bios [ 26.812070] kvm: disabled by bios [ 26.828075] kvm: disabled by bios [ 26.838147] intel_rapl: Found RAPL domain package [ 26.843403] intel_rapl: Found RAPL domain core [ 26.848370] intel_rapl: Found RAPL domain dram [ 26.853364] intel_rapl: Found RAPL domain package [ 26.858634] intel_rapl: Found RAPL domain core [ 26.858642] intel_rapl: Found RAPL domain dram [ 26.861416] kvm: disabled by bios [ 26.922996] kvm: disabled by bios [ 26.932347] sd 0:0:1:42: rdac: array soak-netapp5660-1, ctlr 1, queueing MODE_SELECT command [ 26.945888] kvm: disabled by bios [ 26.964121] kvm: disabled by bios [ 26.975754] kvm: disabled by bios [ 26.985708] kvm: disabled by bios [ 26.996650] kvm: disabled by bios [ 27.008923] kvm: disabled by bios [ 27.020968] kvm: disabled by bios [ 27.032603] kvm: disabled by bios [ 27.047679] kvm: disabled by bios [ 27.060621] kvm: disabled by bios [ 27.076631] kvm: disabled by bios [ 27.088646] kvm: disabled by bios [ 27.102992] kvm: disabled by bios [ 27.113565] kvm: disabled by bios [ 27.123550] kvm: disabled by bios [ 27.133567] kvm: disabled by bios [ 27.145858] kvm: disabled by bios [ 27.155814] kvm: disabled by bios [ 27.166646] kvm: disabled by bios [ 27.179643] kvm: disabled by bios [ 27.192731] kvm: disabled by bios [ 27.202614] kvm: disabled by bios [ 27.216644] kvm: disabled by bios [ 27.227574] kvm: disabled by bios [ 27.237632] kvm: disabled by bios [ 27.241435] iTCO_vendor_support: vendor-support=0 [ 27.254756] kvm: disabled by bios [ 27.265340] kvm: disabled by bios [ 27.269145] iTCO_wdt: Intel TCO WatchDog Timer Driver v1.11 [ 27.275419] iTCO_wdt: unable to reset NO_REBOOT flag, device disabled by hardware/BIOS [ 27.300055] EDAC sbridge: Seeking for: PCI ID 8086:3ca0 [ 27.300083] EDAC sbridge: Seeking for: PCI ID 8086:3ca0 [ 27.300098] EDAC sbridge: Seeking for: PCI ID 8086:3ca0 [ 27.300105] EDAC sbridge: Seeking for: PCI ID 8086:3ca8 [ 27.300115] EDAC sbridge: Seeking for: PCI ID 8086:3ca8 [ 27.300122] EDAC sbridge: Seeking for: PCI ID 8086:3ca8 [ 27.300126] EDAC sbridge: Seeking for: PCI ID 8086:3c71 [ 27.300135] EDAC sbridge: Seeking for: PCI ID 8086:3c71 [ 27.300141] EDAC sbridge: Seeking for: PCI ID 8086:3c71 [ 27.300145] EDAC sbridge: Seeking for: PCI ID 8086:3caa [ 27.300154] EDAC sbridge: Seeking for: PCI ID 8086:3caa [ 27.300161] EDAC sbridge: Seeking for: PCI ID 8086:3caa [ 27.300164] EDAC sbridge: Seeking for: PCI ID 8086:3cab [ 27.300173] EDAC sbridge: Seeking for: PCI ID 8086:3cab [ 27.300180] EDAC sbridge: Seeking for: PCI ID 8086:3cab [ 27.300183] EDAC sbridge: Seeking for: PCI ID 8086:3cac [ 27.300192] EDAC sbridge: Seeking for: PCI ID 8086:3cac [ 27.300199] EDAC sbridge: Seeking for: PCI ID 8086:3cac [ 27.300202] EDAC sbridge: Seeking for: PCI ID 8086:3cad [ 27.300212] EDAC sbridge: Seeking for: PCI ID 8086:3cad [ 27.300219] EDAC sbridge: Seeking for: PCI ID 8086:3cad [ 27.300222] EDAC sbridge: Seeking for: PCI ID 8086:3cb8 [ 27.300232] EDAC sbridge: Seeking for: PCI ID 8086:3cb8 [ 27.300239] EDAC sbridge: Seeking for: PCI ID 8086:3cb8 [ 27.300241] EDAC sbridge: Seeking for: PCI ID 8086:3cf4 [ 27.300249] EDAC sbridge: Seeking for: PCI ID 8086:3cf4 [ 27.300256] EDAC sbridge: Seeking for: PCI ID 8086:3cf4 [ 27.300260] EDAC sbridge: Seeking for: PCI ID 8086:3cf6 [ 27.300268] EDAC sbridge: Seeking for: PCI ID 8086:3cf6 [ 27.300275] EDAC sbridge: Seeking for: PCI ID 8086:3cf6 [ 27.300279] EDAC sbridge: Seeking for: PCI ID 8086:3cf5 [ 27.300287] EDAC sbridge: Seeking for: PCI ID 8086:3cf5 [ 27.300294] EDAC sbridge: Seeking for: PCI ID 8086:3cf5 [ 27.300469] EDAC MC0: Giving out device to 'sb_edac.c' 'Sandy Bridge SrcID#0_Ha#0': DEV 0000:7f:0e.0 [ 27.310811] EDAC MC1: Giving out device to 'sb_edac.c' 'Sandy Bridge SrcID#1_Ha#0': DEV 0000:ff:0e.0 [ 27.321009] EDAC sbridge: Ver: 1.1.2 [ 27.497290] icp: module license 'CDDL' taints kernel. [ 27.497310] icp: module license 'CDDL' taints kernel. [ 27.497311] Disabling lock debugging due to kernel taint [ 27.570967] sd 0:0:1:42: rdac: array soak-netapp5660-1, ctlr 1, MODE_SELECT completed [ 28.900793] device-mapper: table: 253:7: multipath: error getting device [ 28.908293] device-mapper: ioctl: error adding target to table [ 29.273810] Adding 16319484k swap on /dev/sda2. Priority:-2 extents:1 across:16319484k FS [ 29.659908] sd 0:0:0:7: [sdc] tag#0 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE [ 29.669149] sd 0:0:0:7: [sdc] tag#0 Sense Key : Illegal Request [current] [ 29.676835] sd 0:0:0:7: [sdc] tag#0 Add. Sense: Logical block address out of range [ 29.685294] sd 0:0:0:7: [sdc] tag#0 CDB: Read(10) 28 00 00 00 00 00 00 01 00 00 [ 29.693461] blk_update_request: critical target error, dev sdc, sector 0 [ 29.701439] sd 0:0:1:7: [sdj] tag#5 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE [ 29.710678] sd 0:0:1:7: [sdj] tag#5 Sense Key : Illegal Request [current] [ 29.718361] sd 0:0:1:7: [sdj] tag#5 Add. Sense: Logical block address out of range [ 29.726815] sd 0:0:1:7: [sdj] tag#5 CDB: Read(10) 28 00 00 00 00 00 00 01 00 00 [ 29.734975] blk_update_request: critical target error, dev sdj, sector 0 [ 30.034908] ZFS: Loaded module v0.8.3-1, ZFS pool version 5000, ZFS filesystem version 5 [ 30.145331] sd 0:0:1:46: rdac: array soak-netapp5660-1, ctlr 1, queueing MODE_SELECT command [ 30.170009] sd 0:0:0:42: [sde] tag#2 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE [ 30.179362] sd 0:0:0:42: [sde] tag#2 Sense Key : Illegal Request [current] [ 30.187146] sd 0:0:0:42: [sde] tag#2 <>ASC=0x94 ASCQ=0x1 [ 30.193952] sd 0:0:0:42: [sde] tag#2 CDB: Read(16) 88 00 00 00 00 00 00 00 00 00 00 00 01 00 00 00 [ 30.203955] blk_update_request: I/O error, dev sde, sector 0 [ 30.564995] type=1305 audit(1588978959.325:3): audit_pid=2294 old=0 auid=4294967295 ses=4294967295 res=1 [ 30.888182] sd 0:0:1:46: rdac: array soak-netapp5660-1, ctlr 1, MODE_SELECT completed [ 30.897276] sd 0:0:1:44: rdac: array soak-netapp5660-1, ctlr 1, queueing MODE_SELECT command [ 31.514576] sd 0:0:1:44: rdac: array soak-netapp5660-1, ctlr 1, MODE_SELECT completed [ 33.299732] mlx4_en: Mellanox ConnectX HCA Ethernet driver v5.0-1.0.0.0 [ 33.338722] IPv6: ADDRCONF(NETDEV_UP): ens2f0: link is not ready [ 33.366525] igb 0000:02:00.0 ens2f0: igb: ens2f0 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX [ 33.377397] IPv6: ADDRCONF(NETDEV_UP): ens2f0: link is not ready [ 33.384145] IPv6: ADDRCONF(NETDEV_CHANGE): ens2f0: link becomes ready [ 33.396517] IPv6: ADDRCONF(NETDEV_UP): ens2f1: link is not ready [ 33.424267] IPv6: ADDRCONF(NETDEV_UP): ens2f1: link is not ready [ 33.434475] IPv6: ADDRCONF(NETDEV_UP): ens2f2: link is not ready [ 33.493109] IPv6: ADDRCONF(NETDEV_UP): ens2f2: link is not ready [ 33.503962] IPv6: ADDRCONF(NETDEV_UP): ens2f3: link is not ready [ 33.561240] IPv6: ADDRCONF(NETDEV_UP): ens2f3: link is not ready [ 34.260990] card: mlx4_0, QP: 0x220, inline size: 120 [ 34.278014] card: mlx4_0, QP: 0x300, inline size: 120 [ 34.470167] IPv6: ADDRCONF(NETDEV_UP): ib1: link is not ready [ 34.490025] IPv6: ADDRCONF(NETDEV_UP): ib1: link is not ready [ 34.499680] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready [ 34.518412] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready [ 34.550598] ib0: enabling connected mode will cause multicast packet drops [ 34.558379] ib0: mtu > 4092 will cause multicast packet drops. [ 34.580328] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready [ 41.495832] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready [ 41.540663] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready [ 41.550305] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready [ 41.880962] FS-Cache: Loaded [ 41.974855] FS-Cache: Netfs 'nfs' registered for caching [ 41.996571] Key type dns_resolver registered [ 42.051233] NFS: Registering the id_resolver key type [ 42.056879] Key type id_resolver registered [ 42.061549] Key type id_legacy registered [ 59.788227] IPv6: ADDRCONF(NETDEV_CHANGE): ib0: link becomes ready [ 2272.717976] sd 0:0:1:44: rdac: array soak-netapp5660-1, ctlr 1, queueing MODE_SELECT command [ 2275.994993] sd 0:0:1:44: rdac: array soak-netapp5660-1, ctlr 1, MODE_SELECT completed [ 2312.734739] sd 0:0:1:44: rdac: array soak-netapp5660-1, ctlr 1, queueing MODE_SELECT command [ 2313.358306] sd 0:0:1:44: rdac: array soak-netapp5660-1, ctlr 1, MODE_SELECT completed [ 2352.748821] sd 0:0:1:44: rdac: array soak-netapp5660-1, ctlr 1, queueing MODE_SELECT command [ 2353.376419] sd 0:0:1:44: rdac: array soak-netapp5660-1, ctlr 1, MODE_SELECT completed [ 2372.837852] sd 0:0:1:44: rdac: array soak-netapp5660-1, ctlr 1, queueing MODE_SELECT command [ 2373.585840] sd 0:0:1:44: rdac: array soak-netapp5660-1, ctlr 1, MODE_SELECT completed [ 2572.902142] sd 0:0:1:44: rdac: array soak-netapp5660-1, ctlr 1, queueing MODE_SELECT command [ 2576.009401] sd 0:0:1:44: rdac: array soak-netapp5660-1, ctlr 1, MODE_SELECT completed [ 2859.767617] LNet: HW NUMA nodes: 2, HW CPU cores: 32, npartitions: 2 [ 2859.778171] alg: No test for adler32 (adler32-zlib) [ 2860.628463] Lustre: Lustre: Build Version: 2.13.53_18_g6706bfa [ 2860.828767] LNet: Using FMR for registration [ 2860.847397] LNet: Added LNI 192.168.1.111@o2ib [8/256/0/180] [ 2861.296825] LDISKFS-fs (dm-5): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,user_xattr,no_mbcache,nodelalloc [ 2862.611831] Lustre: osd-ldiskfs create tunables for soaked-MDT0003 [ 2863.111182] LustreError: 11-0: soaked-MDT0000-osp-MDT0003: operation mds_connect to node 192.168.1.108@o2ib failed: rc = -114 [ 2866.827889] LNet: 5186:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.104@o2ib: 0 seconds [ 2868.827678] LNet: 5186:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.104@o2ib: 2 seconds [ 2869.827624] LNet: 5186:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.104@o2ib: 3 seconds [ 2871.827496] LNet: 5186:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.104@o2ib: 5 seconds [ 2871.838867] LNet: 5186:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 1 previous similar message [ 2875.827213] LNet: 5186:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.105@o2ib: 9 seconds [ 2875.838576] LNet: 5186:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 2 previous similar messages [ 2883.826643] LNet: 5186:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.105@o2ib: 15 seconds [ 2883.838104] LNet: 5186:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 8 previous similar messages [ 2888.826988] LustreError: 137-5: soaked-MDT0002_UUID: not available for connect from 192.168.1.111@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2899.825525] LNet: 5186:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.107@o2ib: 31 seconds [ 2899.836987] LNet: 5186:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 15 previous similar messages [ 2931.823339] LNet: 5186:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.104@o2ib: 65 seconds [ 2931.834802] LNet: 5186:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 39 previous similar messages [ 2995.818791] LNet: 5186:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.107@o2ib: 32 seconds [ 2995.830254] LNet: 5186:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 77 previous similar messages [ 3000.888391] INFO: task mount.lustre:5150 blocked for more than 120 seconds. [ 3000.896184] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 3000.904938] mount.lustre D ffff9c81e9a362a0 0 5150 5149 0x00000082 [ 3000.912886] Call Trace: [ 3000.915711] [] ? class_config_dump_handler+0x7e0/0x7e0 [obdclass] [ 3000.924383] [] schedule+0x29/0x70 [ 3000.929960] [] schedule_timeout+0x221/0x2d0 [ 3000.936482] [] ? select_task_rq_fair+0x5a6/0x760 [ 3000.943533] [] ? class_config_dump_handler+0x7e0/0x7e0 [obdclass] [ 3000.952195] [] wait_for_completion+0xfd/0x140 [ 3000.958931] [] ? wake_up_state+0x20/0x20 [ 3000.965210] [] llog_process_or_fork+0x254/0x520 [obdclass] [ 3000.973228] [] llog_process+0x14/0x20 [obdclass] [ 3000.980292] [] class_config_parse_llog+0x125/0x350 [obdclass] [ 3000.988570] [] mgc_process_cfg_log+0x788/0xc40 [mgc] [ 3000.995975] [] mgc_process_log+0x3bf/0x920 [mgc] [ 3001.003008] [] ? class_config_dump_handler+0x7e0/0x7e0 [obdclass] [ 3001.011678] [] mgc_process_config+0xc63/0x1870 [mgc] [ 3001.019131] [] lustre_process_log+0x2d7/0xad0 [obdclass] [ 3001.026971] [] server_start_targets+0x12d4/0x2970 [obdclass] [ 3001.035166] [] ? lustre_start_mgc+0x257/0x2420 [obdclass] [ 3001.043054] [] ? kfree+0x106/0x140 [ 3001.048734] [] ? class_config_dump_handler+0x7e0/0x7e0 [obdclass] [ 3001.057410] [] server_fill_super+0x10cc/0x1890 [obdclass] [ 3001.065315] [] lustre_fill_super+0x498/0x990 [obdclass] [ 3001.073037] [] ? lustre_common_put_super+0x270/0x270 [obdclass] [ 3001.081512] [] mount_nodev+0x4f/0xb0 [ 3001.087377] [] lustre_mount+0x18/0x20 [obdclass] [ 3001.094378] [] mount_fs+0x3e/0x1b0 [ 3001.100041] [] vfs_kern_mount+0x67/0x110 [ 3001.106262] [] do_mount+0x1ef/0xce0 [ 3001.112034] [] ? __check_object_size+0x1ca/0x250 [ 3001.119036] [] ? kmem_cache_alloc_trace+0x3c/0x200 [ 3001.126242] [] SyS_mount+0x83/0xd0 [ 3001.131896] [] system_call_fastpath+0x25/0x2a [ 3001.138610] [] ? system_call_after_swapgs+0xae/0x146 [ 3047.870528] Lustre: soaked-MDT0003: Imperative Recovery enabled, recovery window shrunk from 300-900 down to 150-900 [ 3047.919562] Lustre: soaked-MDT0003: in recovery but waiting for the first client to connect [ 3048.117956] LustreError: 5353:0:(llog.c:636:llog_process_thread()) soaked-MDT0000-osp-MDT0003: [0xe193:0x11d43:0x2] Invalid record: index 20252 but expected 20250 [ 3048.134211] LustreError: 5353:0:(lod_dev.c:424:lod_sub_recovery_thread()) soaked-MDT0000-osp-MDT0003 get update log failed: rc = -34 [ 3053.996307] Lustre: soaked-MDT0003: Connection restored to (at 192.168.1.109@o2ib) [ 3054.005362] Lustre: 5356:0:(ldlm_lib.c:2162:target_recovery_overseer()) recovery is aborted, evict exports in recovery [ 3054.017366] Lustre: soaked-MDT0003: disconnecting 1 stale clients [ 3054.024359] Lustre: soaked-MDT0003: in recovery but waiting for the first client to connect [ 3056.414183] Lustre: soaked-MDT0003: Connection restored to soaked-MDT0003-lwp-OST0000_UUID (at 192.168.1.104@o2ib) [ 3056.425826] Lustre: Skipped 1 previous similar message [ 3056.932413] LustreError: 11-0: soaked-OST0000-osc-MDT0003: operation ost_connect to node 192.168.1.104@o2ib failed: rc = -16 [ 3056.945012] LustreError: Skipped 2 previous similar messages [ 3058.546921] Lustre: soaked-MDT0003: Connection restored to (at 192.168.1.110@o2ib) [ 3064.612299] Lustre: soaked-MDT0003: Connection restored to soaked-MDT0003-lwp-OST0001_UUID (at 192.168.1.105@o2ib) [ 3064.623944] Lustre: Skipped 2 previous similar messages [ 3071.383991] LustreError: 11-0: soaked-OST0001-osc-MDT0003: operation ost_connect to node 192.168.1.105@o2ib failed: rc = -16 [ 3072.806136] Lustre: soaked-MDT0003: Connection restored to soaked-MDT0003-lwp-OST0002_UUID (at 192.168.1.102@o2ib) [ 3085.361474] Lustre: soaked-MDT0003: Connection restored to soaked-MDT0003-lwp-OST0000_UUID (at 192.168.1.104@o2ib) [ 3085.373080] Lustre: Skipped 1 previous similar message [ 3087.870278] LustreError: 11-0: soaked-OST0003-osc-MDT0003: operation ost_connect to node 192.168.1.107@o2ib failed: rc = -16 [ 3096.173301] LustreError: 11-0: soaked-OST0005-osc-MDT0003: operation ost_connect to node 192.168.1.105@o2ib failed: rc = -16 [ 3096.185853] LustreError: Skipped 1 previous similar message [ 3105.191564] Lustre: soaked-MDT0003: Connection restored to soaked-MDT0003-lwp-OST0000_UUID (at 192.168.1.104@o2ib) [ 3105.203148] Lustre: Skipped 3 previous similar messages [ 3109.625151] LustreError: 11-0: soaked-OST0008-osc-MDT0003: operation ost_connect to node 192.168.1.104@o2ib failed: rc = -16 [ 3109.637703] LustreError: Skipped 2 previous similar messages [ 3135.070297] LustreError: 11-0: soaked-OST000d-osc-MDT0003: operation ost_connect to node 192.168.1.105@o2ib failed: rc = -16 [ 3135.082873] LustreError: Skipped 2 previous similar messages [ 3140.388979] Lustre: soaked-MDT0003: Connection restored to soaked-MDT0003-lwp-OST0003_UUID (at 192.168.1.107@o2ib) [ 3140.400586] Lustre: Skipped 6 previous similar messages [ 3205.636933] Lustre: soaked-MDT0003: Connection restored to 3f5e1058-cb46-4 (at 192.168.1.131@o2ib) [ 3205.646958] Lustre: Skipped 20 previous similar messages [177636.506964] LNetError: 5186:0:(o2iblnd_cb.c:3348:kiblnd_check_txs_locked()) Timed out tx: active_txs, 0 seconds [177636.518352] LNetError: 5186:0:(o2iblnd_cb.c:3423:kiblnd_check_conns()) Timed out RDMA with 192.168.1.105@o2ib (6): c: 4, oc: 0, rc: 8 [177636.532900] Lustre: 5218:0:(client.c:2229:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1589156571/real 1589156577] req@ffff9c81a5af7500 x1666168228668160/t0(0) o13->soaked-OST0009-osc-MDT0003@192.168.1.105@o2ib:7/4 lens 224/368 e 0 to 1 dl 1589156578 ref 1 fl Rpc:eXQr/0/ffffffff rc 0/-1 job:'' [177636.532932] Lustre: soaked-OST0001-osc-MDT0003: Connection to soaked-OST0001 (at 192.168.1.105@o2ib) was lost; in progress operations using this service will wait for recovery to complete [177636.584749] Lustre: 5218:0:(client.c:2229:ptlrpc_expire_one_request()) Skipped 3 previous similar messages [177637.596115] LNetError: 19062:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.105@o2ib) recovery failed with -113 [177638.596044] LNetError: 19733:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.105@o2ib) recovery failed with -113 [177640.595897] LNetError: 19733:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.105@o2ib) recovery failed with -113 [177640.609341] LNetError: 19733:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 1 previous similar message [177643.595674] LNetError: 14594:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.105@o2ib) recovery failed with -113 [177643.609120] LNetError: 14594:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 2 previous similar messages [177648.595324] LNetError: 19733:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.105@o2ib) recovery failed with -113 [177648.608771] LNetError: 19733:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 4 previous similar messages [177657.594704] LNetError: 19062:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.105@o2ib) recovery failed with -113 [177657.608170] LNetError: 19062:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 8 previous similar messages [177674.593476] LNetError: 14594:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.105@o2ib) recovery failed with -113 [177674.606959] LNetError: 14594:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 16 previous similar messages [177706.717244] LNetError: 14594:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.105@o2ib) recovery failed with -113 [177706.730704] LNetError: 14594:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 31 previous similar messages [177770.888801] LNetError: 19733:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.105@o2ib) recovery failed with -113 [177770.902255] LNetError: 19733:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 63 previous similar messages [177858.873931] Lustre: soaked-MDT0003: haven't heard from client soaked-MDT0003-lwp-OST0009_UUID (at 192.168.1.105@o2ib) in 228 seconds. I think it's dead, and I am evicting it. exp ffff9c81d1fc3400, cur 1589156799 expire 1589156649 last 1589156571 [177899.407774] LNetError: 19062:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.105@o2ib) recovery failed with -113 [177899.421227] LNetError: 19062:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 128 previous similar messages [177932.486171] LNet: 5186:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.105@o2ib: 1 seconds [177932.497639] LNet: 5186:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 68 previous similar messages [177953.484739] LNet: 5186:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.105@o2ib: 0 seconds [177953.496219] LNet: 5186:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 15 previous similar messages [177956.855553] Lustre: soaked-MDT0003: Connection restored to soaked-MDT0003-lwp-OST0000_UUID (at 192.168.1.104@o2ib) [177956.867243] Lustre: Skipped 3 previous similar messages [177973.709552] Lustre: soaked-MDT0003: Connection restored to soaked-MDT0003-lwp-OST0000_UUID (at 192.168.1.104@o2ib) [177973.721262] Lustre: Skipped 4 previous similar messages [177985.482468] LNet: 5186:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.105@o2ib: 1 seconds [177985.493938] LNet: 5186:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 4 previous similar messages [177997.673167] LustreError: 11-0: soaked-OST0009-osc-MDT0003: operation ost_statfs to node 192.168.1.104@o2ib failed: rc = -107 [177997.685868] LustreError: Skipped 1 previous similar message [177997.692217] Lustre: soaked-OST0009-osc-MDT0003: Connection to soaked-OST0009 (at 192.168.1.104@o2ib) was lost; in progress operations using this service will wait for recovery to complete [177997.710982] Lustre: Skipped 3 previous similar messages [178006.452367] Lustre: soaked-MDT0003: Connection restored to soaked-MDT0003-lwp-OST0001_UUID (at 192.168.1.105@o2ib) [178006.464096] Lustre: Skipped 2 previous similar messages [178011.688150] LustreError: 11-0: soaked-OST0001-osc-MDT0003: operation ost_statfs to node 192.168.1.104@o2ib failed: rc = -107 [178011.700860] Lustre: soaked-OST0001-osc-MDT0003: Connection to soaked-OST0001 (at 192.168.1.104@o2ib) was lost; in progress operations using this service will wait for recovery to complete [178016.855740] Lustre: soaked-OST0005-osc-MDT0003: Connection to soaked-OST0005 (at 192.168.1.104@o2ib) was lost; in progress operations using this service will wait for recovery to complete [178024.519297] LustreError: 11-0: soaked-OST000d-osc-MDT0003: operation ost_statfs to node 192.168.1.104@o2ib failed: rc = -107 [178024.531966] LustreError: Skipped 1 previous similar message [178024.538308] Lustre: soaked-OST000d-osc-MDT0003: Connection to soaked-OST000d (at 192.168.1.104@o2ib) was lost; in progress operations using this service will wait for recovery to complete [178174.852546] Lustre: soaked-OST0009-osc-MDT0003: Connection restored to 192.168.1.105@o2ib (at 192.168.1.105@o2ib) [178174.864141] Lustre: Skipped 5 previous similar messages [178229.399919] LustreError: 137-5: soaked-MDT0002_UUID: not available for connect from 192.168.1.126@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server. [178232.080279] LustreError: 137-5: soaked-MDT0002_UUID: not available for connect from 192.168.1.119@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server. [178232.100230] LustreError: Skipped 1 previous similar message [178235.168194] LustreError: 137-5: soaked-MDT0002_UUID: not available for connect from 192.168.1.120@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server. [178235.188116] LustreError: Skipped 1 previous similar message [178238.390802] LustreError: 137-5: soaked-MDT0002_UUID: not available for connect from 192.168.1.121@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server. [178238.410738] LustreError: Skipped 2 previous similar messages [178242.962548] LustreError: 137-5: soaked-MDT0002_UUID: not available for connect from 192.168.1.102@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server. [178242.982482] LustreError: Skipped 12 previous similar messages [178255.460660] LustreError: 137-5: soaked-MDT0002_UUID: not available for connect from 192.168.1.104@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server. [178255.480683] LustreError: Skipped 17 previous similar messages [178279.572419] LustreError: 137-5: soaked-MDT0002_UUID: not available for connect from 192.168.1.126@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server. [178308.459759] LNetError: 5186:0:(o2iblnd_cb.c:3348:kiblnd_check_txs_locked()) Timed out tx: active_txs, 0 seconds [178308.471135] LNetError: 5186:0:(o2iblnd_cb.c:3423:kiblnd_check_conns()) Timed out RDMA with 192.168.1.110@o2ib (107): c: 7, oc: 0, rc: 8 [178329.744978] LustreError: 137-5: soaked-MDT0002_UUID: not available for connect from 192.168.1.126@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server. [178329.764924] LustreError: Skipped 37 previous similar messages [178374.141272] sd 0:0:1:46: [sdp] tag#0 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE [178374.150733] sd 0:0:1:46: [sdp] tag#0 Sense Key : Illegal Request [current] [178374.158625] sd 0:0:1:46: [sdp] tag#0 <>ASC=0x94 ASCQ=0x1 [178374.165538] sd 0:0:1:46: [sdp] tag#0 CDB: Write(16) 8a 00 00 00 00 00 00 b1 23 78 00 00 00 08 00 00 [178374.175751] blk_update_request: I/O error, dev sdp, sector 11608952 [178374.182884] device-mapper: multipath: Failing path 8:240. [178374.440955] device-mapper: multipath: Reinstating path 8:240. [178380.459306] sd 0:0:1:42: rdac: array soak-netapp5660-1, ctlr 1, queueing MODE_SELECT command [178381.078683] sd 0:0:1:42: rdac: array soak-netapp5660-1, ctlr 1, MODE_SELECT completed [178383.632783] sd 0:0:1:46: rdac: array soak-netapp5660-1, ctlr 1, queueing MODE_SELECT command [178384.263495] sd 0:0:1:46: rdac: array soak-netapp5660-1, ctlr 1, MODE_SELECT completed [178395.349849] LustreError: 137-5: soaked-MDT0002_UUID: not available for connect from 192.168.1.141@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server. [178395.369793] LustreError: Skipped 62 previous similar messages [178530.435135] LustreError: 137-5: soaked-MDT0002_UUID: not available for connect from 192.168.1.126@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server. [178530.455081] LustreError: Skipped 92 previous similar messages [178616.970255] Lustre: soaked-MDT0003: Received new LWP connection from 192.168.1.110@o2ib, removing former export from same NID [178616.983099] Lustre: soaked-MDT0003: Connection restored to (at 192.168.1.110@o2ib) [178616.991775] Lustre: Skipped 1 previous similar message [178821.693715] Lustre: 5197:0:(client.c:2229:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1588981840/real 1588981840] req@ffff9c81d3230480 x1666168168384640/t0(0) o400->soaked-MDT0002-osp-MDT0003@192.168.1.110@o2ib:24/4 lens 224/224 e 6990 to 1 dl 1589157762 ref 1 fl Rpc:XQr/c0/ffffffff rc 0/-1 job:'' [180416.311632] LNetError: 5186:0:(o2iblnd_cb.c:3348:kiblnd_check_txs_locked()) Timed out tx: active_txs, 0 seconds [180416.323021] LNetError: 5186:0:(o2iblnd_cb.c:3423:kiblnd_check_conns()) Timed out RDMA with 192.168.1.104@o2ib (7): c: 4, oc: 0, rc: 8 [180416.337371] Lustre: 5224:0:(client.c:2229:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1589159352/real 1589159357] req@ffff9c81a5b65a00 x1666168229306560/t0(0) o13->soaked-OST000c-osc-MDT0003@192.168.1.104@o2ib:7/4 lens 224/368 e 0 to 1 dl 1589159359 ref 1 fl Rpc:eXQr/0/ffffffff rc 0/-1 job:'' [180416.337401] Lustre: soaked-OST0008-osc-MDT0003: Connection to soaked-OST0008 (at 192.168.1.104@o2ib) was lost; in progress operations using this service will wait for recovery to complete [180416.389260] Lustre: 5224:0:(client.c:2229:ptlrpc_expire_one_request()) Skipped 3 previous similar messages [180417.400865] LNetError: 14594:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.104@o2ib) recovery failed with -113 [180417.414316] LNetError: 14594:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 39 previous similar messages [180450.398490] LNetError: 19062:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.104@o2ib) recovery failed with -113 [180450.411930] LNetError: 19062:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 32 previous similar messages [180514.552026] LNetError: 14594:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.104@o2ib) recovery failed with -113 [180514.565456] LNetError: 14594:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 63 previous similar messages [180615.271008] Lustre: soaked-MDT0003: haven't heard from client soaked-MDT0003-lwp-OST0004_UUID (at 192.168.1.104@o2ib) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9c81d1fc0c00, cur 1589159556 expire 1589159406 last 1589159329 [180615.295688] Lustre: Skipped 3 previous similar messages [180643.070927] LNetError: 24299:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.104@o2ib) recovery failed with -113 [180643.084355] LNetError: 24299:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 128 previous similar messages [180717.290526] LNet: 5186:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.104@o2ib: 0 seconds [180717.301997] LNet: 5186:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 3 previous similar messages [180729.289698] LNet: 5186:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.104@o2ib: 0 seconds [180729.301168] LNet: 5186:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 13 previous similar messages [180735.164336] Lustre: soaked-MDT0003: Connection restored to soaked-MDT0003-lwp-OST0001_UUID (at 192.168.1.105@o2ib) [180748.288311] LNet: 5186:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.104@o2ib: 0 seconds [180748.299799] LNet: 5186:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 2 previous similar messages [180777.109746] LustreError: 11-0: soaked-OST0008-osc-MDT0003: operation ost_statfs to node 192.168.1.105@o2ib failed: rc = -107 [180777.122451] Lustre: soaked-OST0008-osc-MDT0003: Connection to soaked-OST0008 (at 192.168.1.105@o2ib) was lost; in progress operations using this service will wait for recovery to complete [180777.141216] Lustre: Skipped 3 previous similar messages [180785.285697] LNet: 5186:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.104@o2ib: 0 seconds [180785.297160] LNet: 5186:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 5 previous similar messages [180786.311980] Lustre: soaked-MDT0003: Connection restored to soaked-MDT0003-lwp-OST0000_UUID (at 192.168.1.104@o2ib) [180786.323689] Lustre: Skipped 7 previous similar messages [180787.860977] LustreError: 11-0: soaked-OST0000-osc-MDT0003: operation ost_statfs to node 192.168.1.105@o2ib failed: rc = -107 [180787.873665] Lustre: soaked-OST0000-osc-MDT0003: Connection to soaked-OST0000 (at 192.168.1.105@o2ib) was lost; in progress operations using this service will wait for recovery to complete [180795.588508] LustreError: 11-0: soaked-OST0004-osc-MDT0003: operation ost_statfs to node 192.168.1.105@o2ib failed: rc = -107 [180795.601210] Lustre: soaked-OST0004-osc-MDT0003: Connection to soaked-OST0004 (at 192.168.1.105@o2ib) was lost; in progress operations using this service will wait for recovery to complete [180806.451779] LustreError: 11-0: soaked-OST000c-osc-MDT0003: operation ost_statfs to node 192.168.1.105@o2ib failed: rc = -107 [180806.464480] Lustre: soaked-OST000c-osc-MDT0003: Connection to soaked-OST000c (at 192.168.1.105@o2ib) was lost; in progress operations using this service will wait for recovery to complete [183439.099069] LNetError: 5186:0:(o2iblnd_cb.c:3348:kiblnd_check_txs_locked()) Timed out tx: active_txs, 0 seconds [183439.110456] LNetError: 5186:0:(o2iblnd_cb.c:3423:kiblnd_check_conns()) Timed out RDMA with 192.168.1.104@o2ib (7): c: 4, oc: 0, rc: 8 [183439.124928] Lustre: 5219:0:(client.c:2229:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1589162375/real 1589162380] req@ffff9c81a9a31b00 x1666168230006272/t0(0) o13->soaked-OST000c-osc-MDT0003@192.168.1.104@o2ib:7/4 lens 224/368 e 0 to 1 dl 1589162382 ref 1 fl Rpc:eXQr/0/ffffffff rc 0/-1 job:'' [183439.124974] Lustre: soaked-OST0008-osc-MDT0003: Connection to soaked-OST0008 (at 192.168.1.104@o2ib) was lost; in progress operations using this service will wait for recovery to complete [183439.176792] Lustre: 5219:0:(client.c:2229:ptlrpc_expire_one_request()) Skipped 3 previous similar messages [183440.188228] LNetError: 19062:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.104@o2ib) recovery failed with -113 [183440.201681] LNetError: 19062:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 80 previous similar messages [183473.185914] LNetError: 24299:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.104@o2ib) recovery failed with -113 [183473.199359] LNetError: 24299:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 32 previous similar messages [183537.315425] LNetError: 19062:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.104@o2ib) recovery failed with -113 [183537.328874] LNetError: 19062:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 63 previous similar messages [183646.931667] Lustre: soaked-MDT0003: haven't heard from client soaked-MDT0003-lwp-OST0008_UUID (at 192.168.1.104@o2ib) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9c7da39f0400, cur 1589162588 expire 1589162438 last 1589162361 [183646.956071] Lustre: Skipped 3 previous similar messages [183665.834353] LNetError: 29263:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.104@o2ib) recovery failed with -113 [183665.847807] LNetError: 29263:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 128 previous similar messages [183742.077762] LNet: 5186:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.104@o2ib: 1 seconds [183754.076972] LNet: 5186:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.104@o2ib: 0 seconds [183754.088433] LNet: 5186:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 13 previous similar messages [183760.585655] Lustre: soaked-MDT0003: Connection restored to soaked-MDT0003-lwp-OST0001_UUID (at 192.168.1.105@o2ib) [183760.597353] Lustre: Skipped 7 previous similar messages [183769.919762] Lustre: soaked-MDT0003: Connection restored to soaked-MDT0003-lwp-OST0001_UUID (at 192.168.1.105@o2ib) [183769.931449] Lustre: Skipped 3 previous similar messages [183776.075384] LNet: 5186:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.104@o2ib: 1 seconds [183776.086845] LNet: 5186:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 3 previous similar messages [183796.321500] LustreError: 11-0: soaked-OST0008-osc-MDT0003: operation ost_statfs to node 192.168.1.105@o2ib failed: rc = -107 [183796.334197] Lustre: soaked-OST0008-osc-MDT0003: Connection to soaked-OST0008 (at 192.168.1.105@o2ib) was lost; in progress operations using this service will wait for recovery to complete [183796.352944] Lustre: Skipped 3 previous similar messages [183805.255353] Lustre: soaked-MDT0003: Connection restored to soaked-MDT0003-lwp-OST0000_UUID (at 192.168.1.104@o2ib) [183805.267053] Lustre: Skipped 3 previous similar messages [183811.344518] LustreError: 11-0: soaked-OST0000-osc-MDT0003: operation ost_statfs to node 192.168.1.105@o2ib failed: rc = -107 [183811.357224] Lustre: soaked-OST0000-osc-MDT0003: Connection to soaked-OST0000 (at 192.168.1.105@o2ib) was lost; in progress operations using this service will wait for recovery to complete [183816.672066] LustreError: 11-0: soaked-OST0004-osc-MDT0003: operation ost_statfs to node 192.168.1.105@o2ib failed: rc = -107 [183828.239228] LustreError: 11-0: soaked-OST000c-osc-MDT0003: operation ost_statfs to node 192.168.1.105@o2ib failed: rc = -107 [183828.251935] Lustre: soaked-OST000c-osc-MDT0003: Connection to soaked-OST000c (at 192.168.1.105@o2ib) was lost; in progress operations using this service will wait for recovery to complete [183828.270700] Lustre: Skipped 1 previous similar message [183843.842099] Lustre: soaked-OST000c-osc-MDT0003: Connection restored to 192.168.1.104@o2ib (at 192.168.1.104@o2ib) [183843.853714] Lustre: Skipped 6 previous similar messages [185656.943025] LNetError: 5186:0:(o2iblnd_cb.c:3348:kiblnd_check_txs_locked()) Timed out tx: active_txs, 0 seconds [185656.954413] LNetError: 5186:0:(o2iblnd_cb.c:3423:kiblnd_check_conns()) Timed out RDMA with 192.168.1.107@o2ib (8): c: 4, oc: 0, rc: 8 [185656.968892] Lustre: 5222:0:(client.c:2229:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1589164593/real 1589164598] req@ffff9c81af677500 x1666168230516800/t0(0) o13->soaked-OST000f-osc-MDT0003@192.168.1.107@o2ib:7/4 lens 224/368 e 0 to 1 dl 1589164600 ref 1 fl Rpc:eXQr/0/ffffffff rc 0/-1 job:'' [185656.968955] Lustre: soaked-OST0007-osc-MDT0003: Connection to soaked-OST0007 (at 192.168.1.107@o2ib) was lost; in progress operations using this service will wait for recovery to complete [185657.020751] Lustre: 5222:0:(client.c:2229:ptlrpc_expire_one_request()) Skipped 3 previous similar messages [185658.032237] LNetError: 24299:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.107@o2ib) recovery failed with -113 [185658.045661] LNetError: 24299:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 81 previous similar messages [185691.029943] LNetError: 34147:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.107@o2ib) recovery failed with -113 [185691.043399] LNetError: 34147:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 32 previous similar messages [185755.143367] LNetError: 29263:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.107@o2ib) recovery failed with -113 [185755.156793] LNetError: 29263:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 63 previous similar messages [185875.580389] Lustre: soaked-MDT0003: haven't heard from client soaked-MDT0003-lwp-OST0003_UUID (at 192.168.1.107@o2ib) in 228 seconds. I think it's dead, and I am evicting it. exp ffff9c7dd7987000, cur 1589164817 expire 1589164667 last 1589164589 [185875.604851] Lustre: Skipped 3 previous similar messages [185883.662365] LNetError: 29263:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.107@o2ib) recovery failed with -113 [185883.675799] LNetError: 29263:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 128 previous similar messages [185954.922067] LNet: 5186:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.107@o2ib: 0 seconds [185954.933545] LNet: 5186:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 5 previous similar messages [185961.921611] LNet: 5186:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.107@o2ib: 0 seconds [185961.933065] LNet: 5186:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 1 previous similar message [185974.920689] LNet: 5186:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.107@o2ib: 0 seconds [185974.932174] LNet: 5186:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 13 previous similar messages [185994.919253] LNet: 5186:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.107@o2ib: 0 seconds [185994.930724] LNet: 5186:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 3 previous similar messages [186027.916957] LNet: 5186:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.107@o2ib: 0 seconds [186027.928417] LNet: 5186:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 18 previous similar messages [186054.875290] Lustre: soaked-MDT0003: Connection restored to soaked-MDT0003-lwp-OST0003_UUID (at 192.168.1.107@o2ib) [186065.149607] Lustre: soaked-MDT0003: Connection restored to soaked-MDT0003-lwp-OST0003_UUID (at 192.168.1.107@o2ib) [186065.161311] Lustre: Skipped 2 previous similar messages [188966.710229] LNetError: 5186:0:(o2iblnd_cb.c:3348:kiblnd_check_txs_locked()) Timed out tx: active_txs, 0 seconds [188966.721624] LNetError: 5186:0:(o2iblnd_cb.c:3423:kiblnd_check_conns()) Timed out RDMA with 192.168.1.105@o2ib (8): c: 4, oc: 0, rc: 8 [188966.736052] Lustre: 5222:0:(client.c:2229:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1589167903/real 1589167908] req@ffff9c81d3231200 x1666168231279232/t0(0) o13->soaked-OST0009-osc-MDT0003@192.168.1.105@o2ib:7/4 lens 224/368 e 0 to 1 dl 1589167910 ref 1 fl Rpc:eXQr/0/ffffffff rc 0/-1 job:'' [188966.736088] Lustre: soaked-OST0005-osc-MDT0003: Connection to soaked-OST0005 (at 192.168.1.105@o2ib) was lost; in progress operations using this service will wait for recovery to complete [188966.736091] Lustre: Skipped 3 previous similar messages [188966.793880] Lustre: 5222:0:(client.c:2229:ptlrpc_expire_one_request()) Skipped 3 previous similar messages [188967.805399] LNetError: 34147:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.105@o2ib) recovery failed with -113 [188967.818827] LNetError: 34147:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 85 previous similar messages [189000.803073] LNetError: 24299:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.105@o2ib) recovery failed with -113 [189000.816492] LNetError: 24299:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 32 previous similar messages [189064.863579] LNetError: 29263:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.105@o2ib) recovery failed with -113 [189064.877045] LNetError: 29263:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 63 previous similar messages [189171.772985] Lustre: soaked-MDT0003: haven't heard from client soaked-MDT0003-lwp-OST0009_UUID (at 192.168.1.105@o2ib) in 229 seconds. I think it's dead, and I am evicting it. exp ffff9c7dcac39c00, cur 1589168113 expire 1589167963 last 1589167884 [189171.797982] Lustre: Skipped 3 previous similar messages [189193.381651] LNetError: 34147:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.105@o2ib) recovery failed with -113 [189193.395115] LNetError: 34147:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 128 previous similar messages [189253.690070] LNet: 5186:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.105@o2ib: 0 seconds [189253.701533] LNet: 5186:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 4 previous similar messages [189265.689242] LNet: 5186:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.105@o2ib: 0 seconds [189265.700712] LNet: 5186:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 1 previous similar message [189284.687937] LNet: 5186:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.105@o2ib: 0 seconds [189284.699400] LNet: 5186:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 14 previous similar messages [189318.685523] LNet: 5186:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.105@o2ib: 7 seconds [189318.697005] LNet: 5186:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 5 previous similar messages [189360.082764] Lustre: soaked-MDT0003: Connection restored to soaked-MDT0003-lwp-OST0001_UUID (at 192.168.1.105@o2ib) [189360.094448] Lustre: Skipped 4 previous similar messages [189364.319292] Lustre: soaked-MDT0003: Connection restored to soaked-MDT0003-lwp-OST0001_UUID (at 192.168.1.105@o2ib) [189369.421836] Lustre: soaked-OST0001-osc-MDT0003: Connection restored to 192.168.1.105@o2ib (at 192.168.1.105@o2ib) [189379.136918] Lustre: soaked-OST0005-osc-MDT0003: Connection restored to 192.168.1.105@o2ib (at 192.168.1.105@o2ib) [189379.148511] Lustre: Skipped 3 previous similar messages [192288.476618] LNetError: 5186:0:(o2iblnd_cb.c:3348:kiblnd_check_txs_locked()) Timed out tx: active_txs, 0 seconds [192288.488007] LNetError: 5186:0:(o2iblnd_cb.c:3423:kiblnd_check_conns()) Timed out RDMA with 192.168.1.108@o2ib (5): c: 6, oc: 0, rc: 8 [192288.502438] Lustre: 5218:0:(client.c:2229:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1589171225/real 1589171230] req@ffff9c81a5ab5100 x1666168232157376/t0(0) o41->soaked-MDT0000-osp-MDT0003@192.168.1.108@o2ib:24/4 lens 224/368 e 0 to 1 dl 1589171232 ref 1 fl Rpc:eXQr/0/ffffffff rc 0/-1 job:'' [192288.535675] Lustre: soaked-MDT0000-osp-MDT0003: Connection to soaked-MDT0000 (at 192.168.1.108@o2ib) was lost; in progress operations using this service will wait for recovery to complete [192288.554427] Lustre: Skipped 2 previous similar messages [192289.560841] LNetError: 29263:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.108@o2ib) recovery failed with -113 [192289.574284] LNetError: 29263:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 72 previous similar messages [192313.595014] Lustre: 5225:0:(client.c:2229:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1589171255/real 1589171255] req@ffff9c81b1846c00 x1666168232164224/t0(0) o400->MGC192.168.1.108@o2ib@192.168.1.108@o2ib:26/25 lens 224/224 e 0 to 1 dl 1589171262 ref 1 fl Rpc:eXNQr/0/ffffffff rc 0/-1 job:'' [192313.595033] Lustre: soaked-MDT0000-lwp-MDT0003: Connection to soaked-MDT0000 (at 192.168.1.108@o2ib) was lost; in progress operations using this service will wait for recovery to complete [192313.646761] Lustre: 5225:0:(client.c:2229:ptlrpc_expire_one_request()) Skipped 1 previous similar message [192313.657573] LustreError: 166-1: MGC192.168.1.108@o2ib: Connection to MGS (at 192.168.1.108@o2ib) was lost; in progress operations using this service will fail [192321.673555] LNetError: 24299:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.108@o2ib) recovery failed with -113 [192321.686980] LNetError: 24299:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 31 previous similar messages [192385.829101] LNetError: 29263:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.108@o2ib) recovery failed with -113 [192385.842535] LNetError: 29263:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 63 previous similar messages [192504.461433] LNet: 5186:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.108@o2ib: 0 seconds [192504.472914] LNet: 5186:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 18 previous similar messages [192512.460863] LNet: 5186:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.108@o2ib: 8 seconds [192512.472334] LNet: 5186:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 6 previous similar messages [192514.460755] LNetError: 5186:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.108@o2ib) recovery failed with -110 [192514.474090] LNetError: 5186:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 121 previous similar messages [192533.459432] LNet: 5186:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.108@o2ib: 1 seconds [192533.470913] LNet: 5186:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 12 previous similar messages [192566.457113] LNet: 5186:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.108@o2ib: 22 seconds [192566.468671] LNet: 5186:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 12 previous similar messages [192631.452531] LNet: 5186:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.108@o2ib: 0 seconds [192631.464011] LNet: 5186:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 26 previous similar messages [192759.730165] Lustre: soaked-MDT0003: Received new LWP connection from 192.168.1.108@o2ib, removing former export from same NID [192759.742979] Lustre: soaked-MDT0003: Connection restored to (at 192.168.1.108@o2ib) [192759.751654] Lustre: Skipped 1 previous similar message [192790.301428] Lustre: soaked-MDT0000-lwp-MDT0003: Connection restored to 192.168.1.108@o2ib (at 192.168.1.108@o2ib) [192840.469405] Lustre: Evicted from MGS (at 192.168.1.108@o2ib) after server handle changed from 0xb76fab02f29ce86c to 0xb79f1255889f8347 [192840.483381] Lustre: MGC192.168.1.108@o2ib: Connection restored to 192.168.1.108@o2ib (at 192.168.1.108@o2ib) [195549.247497] LNetError: 5186:0:(o2iblnd_cb.c:3348:kiblnd_check_txs_locked()) Timed out tx: active_txs, 0 seconds [195549.258883] LNetError: 5186:0:(o2iblnd_cb.c:3423:kiblnd_check_conns()) Timed out RDMA with 192.168.1.109@o2ib (11): c: 7, oc: 0, rc: 8 [195549.273437] Lustre: 5203:0:(client.c:2229:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1589174485/real 1589174491] req@ffff9c7da4214380 x1666168232884480/t0(0) o41->soaked-MDT0001-osp-MDT0003@192.168.1.109@o2ib:24/4 lens 224/368 e 0 to 1 dl 1589174492 ref 1 fl Rpc:eXQr/0/ffffffff rc 0/-1 job:'' [195549.306666] Lustre: soaked-MDT0001-osp-MDT0003: Connection to soaked-MDT0001 (at 192.168.1.109@o2ib) was lost; in progress operations using this service will wait for recovery to complete [195550.325747] LNetError: 47322:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.109@o2ib) recovery failed with -113 [195550.339196] LNetError: 47322:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 50 previous similar messages [195582.323466] LNetError: 48938:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.109@o2ib) recovery failed with -113 [195582.336922] LNetError: 48938:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 31 previous similar messages [195646.439969] LNetError: 29263:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.109@o2ib) recovery failed with -113 [195646.453431] LNetError: 29263:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 63 previous similar messages [195755.233037] LNet: 5186:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.109@o2ib: 0 seconds [195755.244507] LNet: 5186:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 31 previous similar messages [195766.269378] Lustre: soaked-MDT0003: haven't heard from client soaked-MDT0001-mdtlov_UUID (at 192.168.1.109@o2ib) in 228 seconds. I think it's dead, and I am evicting it. exp ffff9c81e6fbb800, cur 1589174708 expire 1589174558 last 1589174480 [195766.293527] Lustre: Skipped 3 previous similar messages [195776.231564] LNet: 5186:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.109@o2ib: 0 seconds [195776.243024] LNet: 5186:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 7 previous similar messages [195776.253500] LNetError: 5186:0:(lib-move.c:3680:lnet_handle_recovery_reply()) peer NI (192.168.1.109@o2ib) recovery failed with -110 [195776.266824] LNetError: 5186:0:(lib-move.c:3680:lnet_handle_recovery_reply()) Skipped 108 previous similar messages [195810.229204] LNet: 5186:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.109@o2ib: 0 seconds [195810.240665] LNet: 5186:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 12 previous similar messages [195875.224630] LNet: 5186:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.109@o2ib: 2 seconds [195875.236092] LNet: 5186:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 19 previous similar messages [196004.706987] Lustre: soaked-MDT0003: Connection restored to (at 192.168.1.109@o2ib) [198394.680612] LustreError: 137-5: soaked-MDT0002_UUID: not available for connect from 192.168.1.125@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server. [198394.700540] LustreError: Skipped 81 previous similar messages [198444.853216] LustreError: 137-5: soaked-MDT0002_UUID: not available for connect from 192.168.1.125@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server. [198444.873121] LustreError: Skipped 39 previous similar messages [198468.042486] LNetError: 5186:0:(o2iblnd_cb.c:3348:kiblnd_check_txs_locked()) Timed out tx: active_txs, 0 seconds [198468.053874] LNetError: 5186:0:(o2iblnd_cb.c:3423:kiblnd_check_conns()) Timed out RDMA with 192.168.1.110@o2ib (106): c: 7, oc: 0, rc: 8 [198511.535095] LustreError: 137-5: soaked-MDT0002_UUID: not available for connect from 192.168.1.108@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server. [198511.555016] LustreError: Skipped 73 previous similar messages [198542.729269] sd 0:0:1:46: [sdp] tag#0 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE [198542.738727] sd 0:0:1:46: [sdp] tag#0 Sense Key : Illegal Request [current] [198542.746601] sd 0:0:1:46: [sdp] tag#0 <>ASC=0x94 ASCQ=0x1 [198542.753513] sd 0:0:1:46: [sdp] tag#0 CDB: Write(16) 8a 00 00 00 00 00 00 b1 23 78 00 00 00 08 00 00 [198542.763726] blk_update_request: I/O error, dev sdp, sector 11608952 [198542.771120] device-mapper: multipath: Failing path 8:240. [198546.002499] device-mapper: multipath: Failing path 8:240. [198546.013393] sd 0:0:1:42: rdac: array soak-netapp5660-1, ctlr 1, queueing MODE_SELECT command [198546.645901] sd 0:0:1:42: rdac: array soak-netapp5660-1, ctlr 1, MODE_SELECT completed [198547.009029] device-mapper: multipath: Reinstating path 8:240. [198547.034504] sd 0:0:1:46: rdac: array soak-netapp5660-1, ctlr 1, queueing MODE_SELECT command [198547.485436] sd 0:0:1:46: rdac: array soak-netapp5660-1, ctlr 1, MODE_SELECT completed [198567.360741] sd 0:0:1:44: [sdn] tag#0 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE [198567.370202] sd 0:0:1:44: [sdn] tag#0 Sense Key : Illegal Request [current] [198567.378078] sd 0:0:1:44: [sdn] tag#0 <>ASC=0x94 ASCQ=0x1 [198567.384987] sd 0:0:1:44: [sdn] tag#0 CDB: Synchronize Cache(10) 35 00 00 00 00 00 00 00 00 00 [198567.394653] device-mapper: multipath: Failing path 8:208. [198567.418664] LDISKFS-fs warning (device dm-1): ldiskfs_multi_mount_protect:321: MMP interval 42 higher than expected, please wait. [198572.030814] device-mapper: multipath: Reinstating path 8:208. [198572.039670] sd 0:0:1:44: rdac: array soak-netapp5660-1, ctlr 1, queueing MODE_SELECT command [198572.689441] sd 0:0:1:44: rdac: array soak-netapp5660-1, ctlr 1, MODE_SELECT completed [198610.320415] LDISKFS-fs (dm-1): recovery complete [198610.349234] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,user_xattr,no_mbcache,nodelalloc [198611.551243] Lustre: osd-ldiskfs create tunables for soaked-MDT0002 [198611.867681] Lustre: soaked-MDT0003: Received LWP connection from 192.168.1.111@o2ib, removing former export from 192.168.1.110@o2ib [198611.881181] Lustre: soaked-MDT0003: local client soaked-MDT0002-mdtlov_UUID w/o recovery [198611.890372] Lustre: soaked-MDT0003: Connection restored to (at 192.168.1.111@o2ib) [198612.041596] Lustre: soaked-MDT0002: Imperative Recovery enabled, recovery window shrunk from 300-900 down to 150-900 [198612.081739] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [198612.081884] Lustre: soaked-MDT0002: in recovery but waiting for the first client to connect [198612.081888] Lustre: Skipped 1 previous similar message [198612.593842] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [198612.606106] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 23 previous similar messages [198613.599590] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [198613.611855] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 51 previous similar messages [198613.740978] Lustre: soaked-MDT0002: Will be in recovery for at least 2:30, or until 27 clients reconnect [198613.751747] Lustre: soaked-MDT0002: Connection restored to (at 192.168.1.109@o2ib) [198613.910240] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (1 recovered, 0 in progress, and 0 evicted) to recover in 2:29 [198615.601276] Lustre: soaked-MDT0002: Denying connection for new client d987f90a-4342-4 (at 192.168.1.121@o2ib), waiting for 27 known clients (1 recovered, 0 in progress, and 0 evicted) to recover in 2:27 [198615.613081] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [198615.613085] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 106 previous similar messages [198617.056292] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (1 recovered, 0 in progress, and 0 evicted) to recover in 2:26 [198619.137397] Lustre: soaked-MDT0002: Denying connection for new client 9c8f77b9-bbac-4 (at 192.168.1.135@o2ib), waiting for 27 known clients (1 recovered, 0 in progress, and 0 evicted) to recover in 2:24 [198619.157595] Lustre: Skipped 11 previous similar messages [198619.620018] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [198619.632276] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 212 previous similar messages [198624.454057] Lustre: soaked-MDT0002: Denying connection for new client f2f8c2f1-1ada-4 (at 192.168.1.124@o2ib), waiting for 27 known clients (1 recovered, 0 in progress, and 0 evicted) to recover in 2:19 [198624.474254] Lustre: Skipped 9 previous similar messages [198624.607242] Lustre: soaked-MDT0002: Connection restored to soaked-MDT0003-lwp-OST0001_UUID (at 192.168.1.105@o2ib) [198624.607244] Lustre: soaked-MDT0002: Connection restored to soaked-MDT0003-lwp-OST0001_UUID (at 192.168.1.105@o2ib) [198624.630589] Lustre: Skipped 2 previous similar messages [198627.627879] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [198627.640148] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 417 previous similar messages [198636.965377] Lustre: soaked-MDT0002: Connection restored to (at 192.168.1.108@o2ib) [198637.474952] LustreError: 11-0: soaked-MDT0000-osp-MDT0003: operation ldlm_enqueue to node 192.168.1.108@o2ib failed: rc = -107 [198638.996240] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (2 recovered, 0 in progress, and 0 evicted) to recover in 2:04 [198639.016440] Lustre: Skipped 1 previous similar message [198643.642642] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [198643.654900] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 840 previous similar messages [198644.995760] Lustre: soaked-MDT0001-osp-MDT0003: Connection restored to 192.168.1.109@o2ib (at 192.168.1.109@o2ib) [198645.007347] Lustre: Skipped 1 previous similar message [198655.353492] Lustre: soaked-MDT0002: Connection restored to soaked-MDT0003-lwp-OST0002_UUID (at 192.168.1.102@o2ib) [198655.365167] Lustre: Skipped 8 previous similar messages [198662.152162] LustreError: 167-0: soaked-MDT0000-osp-MDT0003: This client was evicted by soaked-MDT0000; in progress operations using this service will fail. [198664.082599] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (2 recovered, 0 in progress, and 0 evicted) to recover in 1:39 [198664.102795] Lustre: Skipped 23 previous similar messages [198675.646572] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [198675.658813] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 1731 previous similar messages [198696.137808] Lustre: soaked-MDT0002: Denying connection for new client b9315bf9-0e20-4 (at 192.168.1.138@o2ib), waiting for 27 known clients (2 recovered, 0 in progress, and 0 evicted) to recover in 1:07 [198696.158014] Lustre: Skipped 27 previous similar messages [198739.648309] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [198739.660601] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 3519 previous similar messages [198764.427383] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (2 recovered, 0 in progress, and 0 evicted) to recover in 2:29 [198764.447580] Lustre: Skipped 67 previous similar messages [198852.064401] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [198867.641597] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [198867.653859] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 7070 previous similar messages [198896.405062] Lustre: soaked-MDT0002: Denying connection for new client e799dfde-7e1c-4 (at 192.168.1.125@o2ib), waiting for 27 known clients (2 recovered, 0 in progress, and 0 evicted) to recover in 10:17 [198896.425368] Lustre: Skipped 121 previous similar messages [198912.074191] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [198912.088764] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 2 previous similar messages [198972.094980] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [198972.109561] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 2 previous similar messages [198973.136936] Lustre: 5197:0:(client.c:2229:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1589157762/real 1589157762] req@ffff9c81a5e12880 x1666168228932736/t0(0) o400->soaked-MDT0002-osp-MDT0003@192.168.1.110@o2ib:24/4 lens 224/224 e 779 to 1 dl 1589177915 ref 1 fl Rpc:XQr/c0/ffffffff rc 0/-1 job:'' [198979.006536] LNet: 5186:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 0 seconds [198979.018008] LNet: 5186:0:(o2iblnd_cb.c:3394:kiblnd_check_conns()) Skipped 24 previous similar messages [199013.347462] Lustre: soaked-MDT0002: Connection restored to (at 192.168.1.111@o2ib) [199013.356125] Lustre: Skipped 5 previous similar messages [199013.363889] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [199013.378460] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 2 previous similar messages [199032.141738] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [199092.151536] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [199092.166114] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 2 previous similar messages [199123.636252] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [199123.648521] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 14103 previous similar messages [199152.172330] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [199152.186924] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 2 previous similar messages [199152.696397] Lustre: soaked-MDT0002: Denying connection for new client f447fe99-aa8f-4 (at 192.168.1.142@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) to recover in 6:00 [199152.716598] Lustre: Skipped 259 previous similar messages [199212.193106] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [199212.207693] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 2 previous similar messages [199332.209723] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [199332.224319] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 5 previous similar messages [199512.222019] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [199512.236616] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 8 previous similar messages [199635.601194] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [199635.613473] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 28257 previous similar messages [199667.531100] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 2:34 [199667.552271] Lustre: Skipped 481 previous similar messages [199812.225982] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [199812.240558] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 15 previous similar messages [200235.568978] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [200235.581248] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 33015 previous similar messages [200269.600375] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 12:36 [200269.621672] Lustre: Skipped 575 previous similar messages [200352.213018] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [200352.227607] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 26 previous similar messages [200835.542867] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [200835.555163] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 33153 previous similar messages [200871.669263] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 22:38 [200871.690538] Lustre: Skipped 575 previous similar messages [200952.195842] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [200952.210422] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [201435.509162] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [201435.521429] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 33029 previous similar messages [201473.738530] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 32:40 [201473.759800] Lustre: Skipped 575 previous similar messages [201552.178658] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [201552.193241] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [202035.469882] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [202035.482157] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 33027 previous similar messages [202075.807459] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 42:42 [202075.828730] Lustre: Skipped 575 previous similar messages [202152.163079] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [202152.177679] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [202635.438805] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [202635.451095] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 33058 previous similar messages [202677.876677] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 52:44 [202677.897953] Lustre: Skipped 575 previous similar messages [202752.145499] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [202752.160106] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [203235.412659] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [203235.424906] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 33097 previous similar messages [203279.945713] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 62:46 [203279.966992] Lustre: Skipped 575 previous similar messages [203352.128817] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [203352.143415] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [203657.636658] perf: interrupt took too long (2506 > 2500), lowering kernel.perf_event_max_sample_rate to 79000 [203835.374200] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [203835.386466] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 33076 previous similar messages [203882.014775] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 72:48 [203882.036072] Lustre: Skipped 575 previous similar messages [203952.111231] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [203952.125803] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [204435.332562] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [204435.344832] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 33121 previous similar messages [204484.083924] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 82:51 [204484.105189] Lustre: Skipped 575 previous similar messages [204552.093713] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [204552.108300] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [204980.189381] perf: interrupt took too long (3144 > 3132), lowering kernel.perf_event_max_sample_rate to 63000 [205035.292912] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [205035.305199] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 33111 previous similar messages [205086.153115] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 92:53 [205086.174405] Lustre: Skipped 575 previous similar messages [205152.078196] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [205152.092772] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [205635.257229] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [205635.269490] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 32975 previous similar messages [205688.222409] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 102:55 [205688.243808] Lustre: Skipped 575 previous similar messages [205752.060741] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [205752.075324] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [206235.229184] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [206235.241460] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 33077 previous similar messages [206290.291325] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 112:57 [206290.312702] Lustre: Skipped 575 previous similar messages [206352.043274] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [206352.057857] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [206835.187652] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [206835.199927] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 32999 previous similar messages [206892.360500] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 122:59 [206892.381869] Lustre: Skipped 575 previous similar messages [206952.025835] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [206952.040408] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [206969.581433] perf: interrupt took too long (3968 > 3930), lowering kernel.perf_event_max_sample_rate to 50000 [207435.144931] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [207435.157199] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 33134 previous similar messages [207494.429629] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 133:01 [207494.450982] Lustre: Skipped 575 previous similar messages [207552.008415] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [207552.022991] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [208035.111303] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [208035.123570] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 33037 previous similar messages [208096.498790] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 143:03 [208096.520153] Lustre: Skipped 575 previous similar messages [208151.991048] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [208152.005624] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [208635.079368] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [208635.091639] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 33021 previous similar messages [208698.568218] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 153:05 [208698.589594] Lustre: Skipped 575 previous similar messages [208751.973659] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [208751.988267] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [209235.056353] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [209235.068647] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 33029 previous similar messages [209300.637249] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 163:07 [209300.658637] Lustre: Skipped 575 previous similar messages [209351.956293] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [209351.970886] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [209835.029937] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [209835.042191] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 32798 previous similar messages [209902.706665] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 173:10 [209902.728027] Lustre: Skipped 575 previous similar messages [209951.938962] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [209951.953538] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [210280.291498] perf: interrupt took too long (4984 > 4960), lowering kernel.perf_event_max_sample_rate to 40000 [210435.001226] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [210435.013524] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 33003 previous similar messages [210504.775840] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 183:12 [210504.797203] Lustre: Skipped 575 previous similar messages [210551.921164] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [210551.935742] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [211034.969053] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [211034.981330] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 33097 previous similar messages [211106.845912] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 193:14 [211106.867276] Lustre: Skipped 575 previous similar messages [211151.903052] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [211151.917630] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [211634.943271] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [211634.955554] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 35114 previous similar messages [211708.914798] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 203:16 [211708.936163] Lustre: Skipped 575 previous similar messages [211751.884941] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [211751.899536] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [212234.905145] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [212234.917411] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 37785 previous similar messages [212310.983358] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 213:18 [212311.004739] Lustre: Skipped 575 previous similar messages [212351.867004] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [212351.881597] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [212834.867371] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [212834.879628] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 37289 previous similar messages [212913.052135] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 223:20 [212913.073496] Lustre: Skipped 575 previous similar messages [212951.849004] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [212951.863575] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [213434.839627] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [213434.851914] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 33551 previous similar messages [213515.121081] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 233:22 [213515.142452] Lustre: Skipped 575 previous similar messages [213551.832167] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [213551.846741] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [214034.801257] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [214034.813513] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 33154 previous similar messages [214117.189979] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 243:24 [214117.211353] Lustre: Skipped 575 previous similar messages [214151.814382] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [214151.828968] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [214634.760134] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [214634.772417] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 33009 previous similar messages [214719.258628] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 253:26 [214719.279998] Lustre: Skipped 575 previous similar messages [214751.798579] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [214751.813168] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [215095.357475] perf: interrupt took too long (6262 > 6230), lowering kernel.perf_event_max_sample_rate to 31000 [215234.720213] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [215234.732496] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 32971 previous similar messages [215321.327435] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 263:29 [215321.348807] Lustre: Skipped 575 previous similar messages [215351.780700] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [215351.795294] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [215834.683291] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [215834.695542] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 32877 previous similar messages [215923.396415] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 273:31 [215923.417777] Lustre: Skipped 575 previous similar messages [215951.762829] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [215951.777402] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [216434.655639] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [216434.667935] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 33036 previous similar messages [216525.465628] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 283:33 [216525.486987] Lustre: Skipped 575 previous similar messages [216551.744973] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [216551.759555] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [217034.622605] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [217034.634880] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 32719 previous similar messages [217127.534720] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 293:35 [217127.556099] Lustre: Skipped 575 previous similar messages [217151.727140] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [217151.741711] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [217634.579864] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [217634.592132] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 32932 previous similar messages [217729.603843] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 303:37 [217729.625206] Lustre: Skipped 575 previous similar messages [217751.709353] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [217751.723924] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [218234.543289] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [218234.555544] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 32967 previous similar messages [218331.673081] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 313:39 [218331.694459] Lustre: Skipped 575 previous similar messages [218351.691615] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [218351.706192] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [218834.501853] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [218834.514114] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 33019 previous similar messages [218933.742223] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 323:41 [218933.763622] Lustre: Skipped 575 previous similar messages [218951.673859] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [218951.688448] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [219434.463510] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [219434.475779] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 33137 previous similar messages [219535.811140] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 333:43 [219535.832510] Lustre: Skipped 575 previous similar messages [219551.657133] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [219551.671707] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [220034.422843] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [220034.435131] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 33025 previous similar messages [220137.880415] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 343:45 [220137.901790] Lustre: Skipped 575 previous similar messages [220151.639454] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [220151.654047] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [220634.380979] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [220634.393248] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 32894 previous similar messages [220739.949201] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 353:48 [220739.970575] Lustre: Skipped 575 previous similar messages [220751.621828] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [220751.636409] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [221234.352649] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [221234.364945] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 32929 previous similar messages [221342.018307] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 363:50 [221342.039684] Lustre: Skipped 575 previous similar messages [221351.604170] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [221351.618757] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [221834.327073] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [221834.339337] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 33121 previous similar messages [221944.087944] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 373:52 [221944.109322] Lustre: Skipped 575 previous similar messages [221951.586649] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [221951.601220] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [222032.062041] perf: interrupt took too long (7883 > 7827), lowering kernel.perf_event_max_sample_rate to 25000 [222434.295926] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [222434.308182] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 33072 previous similar messages [222546.157527] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 383:54 [222546.178901] Lustre: Skipped 575 previous similar messages [222551.569037] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [222551.583616] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [223034.255583] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [223034.267854] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 32962 previous similar messages [223148.227032] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 393:56 [223148.248420] Lustre: Skipped 575 previous similar messages [223151.551417] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [223151.566000] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [223634.219466] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [223634.231734] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 32936 previous similar messages [223750.296459] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 403:58 [223750.317826] Lustre: Skipped 575 previous similar messages [223751.533828] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [223751.548409] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [224234.187950] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [224234.200221] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 32927 previous similar messages [224351.516259] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [224351.530849] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [224352.365860] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 414:00 [224352.387227] Lustre: Skipped 575 previous similar messages [224834.146892] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [224834.159167] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 32974 previous similar messages [224951.499661] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [224951.514235] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [224954.435334] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 424:02 [224954.456700] Lustre: Skipped 575 previous similar messages [225434.116301] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [225434.128581] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 33057 previous similar messages [225551.482089] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [225551.496677] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [225556.505232] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 434:04 [225556.526624] Lustre: Skipped 575 previous similar messages [226034.081974] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [226034.094252] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 36403 previous similar messages [226151.464539] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [226151.479107] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [226158.575089] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 444:07 [226158.596518] Lustre: Skipped 575 previous similar messages [226634.053414] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [226634.065694] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 38017 previous similar messages [226751.446896] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [226751.461479] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [226760.644774] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 454:09 [226760.666150] Lustre: Skipped 575 previous similar messages [227234.026721] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [227234.038984] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 35034 previous similar messages [227351.430412] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [227351.445051] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [227362.714538] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 464:11 [227362.735909] Lustre: Skipped 575 previous similar messages [227833.989720] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [227834.001988] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 33167 previous similar messages [227951.413176] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [227951.427751] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [227964.784151] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 474:13 [227964.805525] Lustre: Skipped 575 previous similar messages [228433.948067] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [228433.960332] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 32892 previous similar messages [228551.395835] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [228551.410424] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [228566.853796] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 484:15 [228566.875161] Lustre: Skipped 575 previous similar messages [229033.918953] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [229033.931249] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 33047 previous similar messages [229151.378548] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [229151.393114] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [229168.923153] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 494:17 [229168.944519] Lustre: Skipped 575 previous similar messages [229633.882841] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [229633.895111] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 32955 previous similar messages [229751.361212] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [229751.375791] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [229770.992873] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 504:19 [229771.014252] Lustre: Skipped 575 previous similar messages [230233.855951] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [230233.868235] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 32996 previous similar messages [230351.343859] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [230351.358456] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [230373.062467] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 514:21 [230373.083847] Lustre: Skipped 575 previous similar messages [230833.822619] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [230833.834874] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 32953 previous similar messages [230951.327456] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [230951.342058] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [230975.131921] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 524:23 [230975.153309] Lustre: Skipped 575 previous similar messages [231433.781775] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [231433.794045] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 33045 previous similar messages [231551.310062] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [231551.324636] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [231577.201512] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 534:26 [231577.222913] Lustre: Skipped 575 previous similar messages [232033.756384] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [232033.768672] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 33030 previous similar messages [232151.292693] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [232151.307294] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [232179.271309] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 544:28 [232179.292680] Lustre: Skipped 575 previous similar messages [232633.717028] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [232633.729267] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 33083 previous similar messages [232751.275260] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [232751.289837] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [232781.340740] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 554:30 [232781.362124] Lustre: Skipped 575 previous similar messages [233233.679068] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [233233.691319] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 32927 previous similar messages [233351.258794] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [233351.273384] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [233383.410354] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 564:32 [233383.431760] Lustre: Skipped 575 previous similar messages [233833.635983] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [233833.648255] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 33064 previous similar messages [233951.241342] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [233951.255927] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [233985.479435] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 574:34 [233985.500804] Lustre: Skipped 575 previous similar messages [234433.603835] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [234433.616118] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 33102 previous similar messages [234551.223787] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [234551.238361] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [234587.548898] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 584:36 [234587.570261] Lustre: Skipped 575 previous similar messages [235033.566941] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [235033.579217] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 33142 previous similar messages [235151.206242] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [235151.220832] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [235189.618272] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 594:38 [235189.639640] Lustre: Skipped 575 previous similar messages [235633.538877] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [235633.551137] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 33079 previous similar messages [235751.188699] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [235751.203276] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [235791.687556] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 604:40 [235791.708916] Lustre: Skipped 575 previous similar messages [236233.506747] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [236233.519019] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 32918 previous similar messages [236351.171191] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [236351.185788] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [236393.756842] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 614:42 [236393.778215] Lustre: Skipped 575 previous similar messages [236833.476295] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [236833.488575] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 32983 previous similar messages [236951.153636] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [236951.168222] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [236995.826071] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 624:45 [236995.847433] Lustre: Skipped 575 previous similar messages [237433.436495] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [237433.448753] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 33066 previous similar messages [237551.136177] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [237551.150769] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [237597.895284] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 634:47 [237597.916645] Lustre: Skipped 575 previous similar messages [238033.397637] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [238033.409935] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 32950 previous similar messages [238151.118605] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [238151.133216] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [238199.964496] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 644:49 [238199.985862] Lustre: Skipped 575 previous similar messages [238633.358468] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [238633.370744] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 33053 previous similar messages [238751.101150] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [238751.115743] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [238802.033707] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 654:51 [238802.055069] Lustre: Skipped 575 previous similar messages [239233.329623] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [239233.341873] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 32964 previous similar messages [239351.083610] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [239351.098204] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [239404.102787] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 664:53 [239404.124161] Lustre: Skipped 575 previous similar messages [239833.290669] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [239833.302944] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 32970 previous similar messages [239951.066061] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [239951.080650] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [240006.171816] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 674:55 [240006.193183] Lustre: Skipped 575 previous similar messages [240433.258260] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [240433.270554] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 33083 previous similar messages [240551.049598] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [240551.064185] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [240608.241048] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 684:57 [240608.262429] Lustre: Skipped 575 previous similar messages [241033.222142] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [241033.234409] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 34523 previous similar messages [241151.033148] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [241151.047734] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [241210.310347] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 694:59 [241210.331738] Lustre: Skipped 575 previous similar messages [241633.195848] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [241633.208117] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 33051 previous similar messages [241751.016693] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [241751.031277] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [241812.379790] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 705:01 [241812.401156] Lustre: Skipped 575 previous similar messages [242233.170528] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [242233.182791] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 33017 previous similar messages [242350.999247] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [242351.013838] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [242414.449310] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 715:04 [242414.470694] Lustre: Skipped 575 previous similar messages [242833.133967] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [242833.146231] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 32958 previous similar messages [242950.981837] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [242950.996440] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [243016.518759] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 725:06 [243016.540140] Lustre: Skipped 575 previous similar messages [243433.102431] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [243433.114692] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 33051 previous similar messages [243550.964462] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [243550.979061] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [243618.588204] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 735:08 [243618.609564] Lustre: Skipped 575 previous similar messages [244033.072118] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [244033.084372] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 33033 previous similar messages [244150.946992] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [244150.961566] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [244220.657632] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 745:10 [244220.679005] Lustre: Skipped 575 previous similar messages [244633.031435] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [244633.043718] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 33063 previous similar messages [244750.929675] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [244750.944264] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [244822.727179] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 755:12 [244822.748541] Lustre: Skipped 575 previous similar messages [245232.993858] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [245233.006159] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 32937 previous similar messages [245350.912318] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [245350.926906] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [245424.796883] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 765:14 [245424.818245] Lustre: Skipped 575 previous similar messages [245808.660264] perf: interrupt took too long (9903 > 9853), lowering kernel.perf_event_max_sample_rate to 20000 [245832.962947] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [245832.975211] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 33047 previous similar messages [245950.895006] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [245950.909606] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [246026.866045] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 775:16 [246026.887410] Lustre: Skipped 575 previous similar messages [246432.928060] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [246432.940330] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 32974 previous similar messages [246550.877668] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [246550.892274] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [246628.935709] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 785:18 [246628.957073] Lustre: Skipped 575 previous similar messages [247032.886384] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [247032.898674] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 33002 previous similar messages [247150.860343] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [247150.874917] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [247231.005343] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 795:20 [247231.026717] Lustre: Skipped 575 previous similar messages [247632.848002] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [247632.860287] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 33153 previous similar messages [247750.843061] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [247750.857637] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [247833.075094] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 805:23 [247833.096469] Lustre: Skipped 575 previous similar messages [248232.820457] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [248232.832733] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 32939 previous similar messages [248350.826823] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [248350.841398] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [248435.144602] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 815:25 [248435.165964] Lustre: Skipped 575 previous similar messages [248832.784406] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [248832.796657] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 33021 previous similar messages [248950.810588] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [248950.825188] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [249037.214306] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 825:27 [249037.235694] Lustre: Skipped 575 previous similar messages [249432.755559] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [249432.767846] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 33084 previous similar messages [249550.793299] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [249550.807874] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [249639.283883] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 835:29 [249639.305258] Lustre: Skipped 575 previous similar messages [250032.729746] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [250032.742025] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 33823 previous similar messages [250150.776012] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [250150.790603] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [250241.353494] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 845:31 [250241.374867] Lustre: Skipped 575 previous similar messages [250632.697686] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [250632.709962] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 33107 previous similar messages [250750.759754] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [250750.774329] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [250843.422921] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 855:33 [250843.444282] Lustre: Skipped 575 previous similar messages [251232.666670] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [251232.678968] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 32998 previous similar messages [251350.742443] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [251350.757016] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [251445.492349] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 865:35 [251445.513730] Lustre: Skipped 575 previous similar messages [251832.626363] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [251832.638626] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 32918 previous similar messages [251950.725135] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [251950.739711] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [252047.562094] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 875:37 [252047.583471] Lustre: Skipped 575 previous similar messages [252432.594254] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [252432.606533] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 33033 previous similar messages [252550.707813] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [252550.722388] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [252649.631624] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 885:39 [252649.653002] Lustre: Skipped 575 previous similar messages [253032.569448] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [253032.581714] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 33009 previous similar messages [253150.690514] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [253150.705088] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [253251.701293] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 895:42 [253251.722679] Lustre: Skipped 575 previous similar messages [253632.533588] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [253632.545867] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 33063 previous similar messages [253750.673213] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [253750.687790] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [253853.770722] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 905:44 [253853.792071] Lustre: Skipped 575 previous similar messages [254232.504107] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [254232.516391] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 32993 previous similar messages [254350.655808] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [254350.670383] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [254455.840441] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 915:46 [254455.861804] Lustre: Skipped 575 previous similar messages [254832.473673] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [254832.485941] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 32809 previous similar messages [254950.638378] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) soaked-MDT0002: extended recovery timer reached hard limit: 900, extend: 1 [254950.652950] Lustre: 49685:0:(ldlm_lib.c:1862:extend_recovery_timer()) Skipped 29 previous similar messages [255057.909916] Lustre: soaked-MDT0002: Denying connection for new client 7401a5c1-c4fe-4 (at 192.168.1.130@o2ib), waiting for 27 known clients (3 recovered, 0 in progress, and 0 evicted) already passed deadline 925:48 [255057.931285] Lustre: Skipped 575 previous similar messages [255279.684256] SysRq : Show State [255279.687801] task PC stack pid father [255279.694529] systemd S ffff9c7e7a580000 0 1 0 0x00000000 [255279.702533] Call Trace: [255279.705374] [] schedule+0x29/0x70 [255279.711019] [] schedule_hrtimeout_range_clock+0x12d/0x150 [255279.718993] [] ? ep_scan_ready_list.isra.7+0x1b9/0x1f0 [255279.726673] [] schedule_hrtimeout_range+0x13/0x20 [255279.733866] [] ep_poll+0x23e/0x360 [255279.739607] [] ? wake_up_state+0x20/0x20 [255279.745929] [] SyS_epoll_wait+0xed/0x120 [255279.752261] [] ? system_call_after_swapgs+0xa2/0x146 [255279.759759] [] system_call_fastpath+0x25/0x2a [255279.766575] [] ? system_call_after_swapgs+0xae/0x146 [255279.774061] kthreadd S ffff9c7e7a581070 0 2 0 0x00000000 [255279.782103] Call Trace: [255279.784935] [] schedule+0x29/0x70 [255279.790580] [] kthreadd+0x315/0x320 [255279.796419] [] ? kthread_create_on_cpu+0x60/0x60 [255279.803521] [] ret_from_fork_nospec_begin+0x21/0x21 [255279.810910] [] ? kthread_create_on_cpu+0x60/0x60 [255279.818006] kworker/0:0H S ffff9c7b39c69070 0 4 2 0x00000000 [255279.826011] Call Trace: [255279.828849] [] ? process_one_work+0x21a/0x440 [255279.835655] [] schedule+0x29/0x70 [255279.841312] [] worker_thread+0x1d9/0x3c0 [255279.847648] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255279.855028] [] kthread+0xd1/0xe0 [255279.860573] [] ? insert_kthread_work+0x40/0x40 [255279.867488] [] ret_from_fork_nospec_begin+0x21/0x21 [255279.874878] [] ? insert_kthread_work+0x40/0x40 [255279.881807] ksoftirqd/0 S ffff9c7b39c6b150 0 6 2 0x00000000 [255279.889808] Call Trace: [255279.892642] [] schedule+0x29/0x70 [255279.898293] [] smpboot_thread_fn+0xe2/0x1a0 [255279.904916] [] ? lg_double_unlock+0x40/0x40 [255279.911539] [] kthread+0xd1/0xe0 [255279.917087] [] ? insert_kthread_work+0x40/0x40 [255279.923993] [] ret_from_fork_nospec_begin+0x21/0x21 [255279.931381] [] ? insert_kthread_work+0x40/0x40 [255279.938283] migration/0 S ffff9c7b39c6c1c0 0 7 2 0x00000000 [255279.946296] Call Trace: [255279.949136] [] schedule+0x29/0x70 [255279.954785] [] smpboot_thread_fn+0xe2/0x1a0 [255279.961398] [] ? lg_double_unlock+0x40/0x40 [255279.968010] [] kthread+0xd1/0xe0 [255279.973562] [] ? insert_kthread_work+0x40/0x40 [255279.980464] [] ret_from_fork_nospec_begin+0x21/0x21 [255279.987853] [] ? insert_kthread_work+0x40/0x40 [255279.994756] rcu_bh S ffff9c7b39c6d230 0 8 2 0x00000000 [255280.002756] Call Trace: [255280.005600] [] ? __switch_to+0xce/0x580 [255280.011824] [] schedule+0x29/0x70 [255280.017478] [] rcu_gp_kthread+0xb2/0x720 [255280.023800] [] ? wake_up_atomic_t+0x30/0x30 [255280.030414] [] ? rcu_gp_fqs+0x90/0x90 [255280.036445] [] kthread+0xd1/0xe0 [255280.042003] [] ? insert_kthread_work+0x40/0x40 [255280.048904] [] ret_from_fork_nospec_begin+0x21/0x21 [255280.056291] [] ? insert_kthread_work+0x40/0x40 [255280.063193] rcu_sched S ffff9c7b39c6e2a0 0 9 2 0x00000000 [255280.071218] Call Trace: [255280.074070] [] schedule+0x29/0x70 [255280.079725] [] schedule_timeout+0x168/0x2d0 [255280.086340] [] ? __internal_add_timer+0x130/0x130 [255280.093536] [] ? prepare_to_wait+0x56/0x90 [255280.100053] [] rcu_gp_kthread+0x359/0x720 [255280.106471] [] ? wake_up_atomic_t+0x30/0x30 [255280.113087] [] ? rcu_gp_fqs+0x90/0x90 [255280.119117] [] kthread+0xd1/0xe0 [255280.124671] [] ? insert_kthread_work+0x40/0x40 [255280.131587] [] ret_from_fork_nospec_begin+0x21/0x21 [255280.138976] [] ? insert_kthread_work+0x40/0x40 [255280.145881] lru-add-drain S ffff9c7b39c88000 0 10 2 0x00000000 [255280.153873] Call Trace: [255280.156711] [] schedule+0x29/0x70 [255280.162354] [] rescuer_thread+0x31e/0x3c0 [255280.168771] [] ? process_one_work+0x440/0x440 [255280.175577] [] kthread+0xd1/0xe0 [255280.181132] [] ? insert_kthread_work+0x40/0x40 [255280.188041] [] ret_from_fork_nospec_begin+0x21/0x21 [255280.195430] [] ? insert_kthread_work+0x40/0x40 [255280.202332] watchdog/0 S ffff9c7b39c89070 0 11 2 0x00000000 [255280.210343] Call Trace: [255280.213181] [] ? local_clock+0x25/0x30 [255280.219307] [] ? running_clock+0x9/0x10 [255280.225531] [] ? sched_clock+0x9/0x10 [255280.231562] [] schedule+0x29/0x70 [255280.237205] [] smpboot_thread_fn+0xe2/0x1a0 [255280.243816] [] ? lg_double_unlock+0x40/0x40 [255280.250429] [] kthread+0xd1/0xe0 [255280.255981] [] ? insert_kthread_work+0x40/0x40 [255280.262884] [] ret_from_fork_nospec_begin+0x21/0x21 [255280.270282] [] ? insert_kthread_work+0x40/0x40 [255280.277186] watchdog/1 S ffff9c7b39e88000 0 12 2 0x00000000 [255280.285179] Call Trace: [255280.288013] [] ? touch_nmi_watchdog+0x30/0x30 [255280.294820] [] ? sched_clock+0x9/0x10 [255280.300851] [] schedule+0x29/0x70 [255280.306506] [] smpboot_thread_fn+0xe2/0x1a0 [255280.313119] [] ? lg_double_unlock+0x40/0x40 [255280.319731] [] kthread+0xd1/0xe0 [255280.325279] [] ? insert_kthread_work+0x40/0x40 [255280.332191] [] ret_from_fork_nospec_begin+0x21/0x21 [255280.339582] [] ? insert_kthread_work+0x40/0x40 [255280.346485] migration/1 S ffff9c7b39e89070 0 13 2 0x00000000 [255280.354517] Call Trace: [255280.357349] [] ? cpu_stop_unpark+0x50/0x50 [255280.363865] [] schedule+0x29/0x70 [255280.369508] [] smpboot_thread_fn+0xe2/0x1a0 [255280.376134] [] ? lg_double_unlock+0x40/0x40 [255280.382760] [] kthread+0xd1/0xe0 [255280.388298] [] ? insert_kthread_work+0x40/0x40 [255280.395201] [] ret_from_fork_nospec_begin+0x21/0x21 [255280.402590] [] ? insert_kthread_work+0x40/0x40 [255280.409495] ksoftirqd/1 S ffff9c7b39e8a0e0 0 14 2 0x00000000 [255280.417516] Call Trace: [255280.420348] [] schedule+0x29/0x70 [255280.425993] [] smpboot_thread_fn+0xe2/0x1a0 [255280.432606] [] ? lg_double_unlock+0x40/0x40 [255280.439224] [] kthread+0xd1/0xe0 [255280.444762] [] ? insert_kthread_work+0x40/0x40 [255280.451677] [] ret_from_fork_nospec_begin+0x21/0x21 [255280.459065] [] ? insert_kthread_work+0x40/0x40 [255280.465980] kworker/1:0H S ffff9c7b39e8c1c0 0 16 2 0x00000000 [255280.474001] Call Trace: [255280.476834] [] ? process_one_work+0x21a/0x440 [255280.483652] [] schedule+0x29/0x70 [255280.489303] [] worker_thread+0x1d9/0x3c0 [255280.495624] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255280.503012] [] kthread+0xd1/0xe0 [255280.508571] [] ? insert_kthread_work+0x40/0x40 [255280.515473] [] ret_from_fork_nospec_begin+0x21/0x21 [255280.522873] [] ? insert_kthread_work+0x40/0x40 [255280.529777] watchdog/2 S ffff9c7b39e8e2a0 0 18 2 0x00000000 [255280.537779] Call Trace: [255280.540623] [] ? local_clock+0x25/0x30 [255280.546750] [] ? running_clock+0x9/0x10 [255280.552997] [] ? sched_clock+0x9/0x10 [255280.559034] [] schedule+0x29/0x70 [255280.564677] [] smpboot_thread_fn+0xe2/0x1a0 [255280.571289] [] ? lg_double_unlock+0x40/0x40 [255280.577915] [] kthread+0xd1/0xe0 [255280.583460] [] ? insert_kthread_work+0x40/0x40 [255280.590376] [] ret_from_fork_nospec_begin+0x21/0x21 [255280.597766] [] ? insert_kthread_work+0x40/0x40 [255280.604667] migration/2 S ffff9c7b39458000 0 19 2 0x00000000 [255280.612676] Call Trace: [255280.615508] [] schedule+0x29/0x70 [255280.621153] [] smpboot_thread_fn+0xe2/0x1a0 [255280.627765] [] ? lg_double_unlock+0x40/0x40 [255280.634379] [] kthread+0xd1/0xe0 [255280.639946] [] ? insert_kthread_work+0x40/0x40 [255280.646850] [] ret_from_fork_nospec_begin+0x21/0x21 [255280.654252] [] ? insert_kthread_work+0x40/0x40 [255280.661168] ksoftirqd/2 S ffff9c7b39459070 0 20 2 0x00000000 [255280.669188] Call Trace: [255280.672019] [] schedule+0x29/0x70 [255280.677661] [] smpboot_thread_fn+0xe2/0x1a0 [255280.684275] [] ? lg_double_unlock+0x40/0x40 [255280.690886] [] kthread+0xd1/0xe0 [255280.696433] [] ? insert_kthread_work+0x40/0x40 [255280.703336] [] ret_from_fork_nospec_begin+0x21/0x21 [255280.710726] [] ? insert_kthread_work+0x40/0x40 [255280.717629] kworker/2:0H S ffff9c7b3945b150 0 22 2 0x00000000 [255280.725665] Call Trace: [255280.728499] [] ? process_one_work+0x21a/0x440 [255280.735304] [] schedule+0x29/0x70 [255280.740958] [] worker_thread+0x1d9/0x3c0 [255280.747281] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255280.754673] [] kthread+0xd1/0xe0 [255280.760220] [] ? insert_kthread_work+0x40/0x40 [255280.767122] [] ret_from_fork_nospec_begin+0x21/0x21 [255280.774511] [] ? insert_kthread_work+0x40/0x40 [255280.781412] watchdog/3 S ffff9c7b3945c1c0 0 23 2 0x00000000 [255280.789422] Call Trace: [255280.792255] [] ? local_clock+0x25/0x30 [255280.798385] [] ? running_clock+0x9/0x10 [255280.804610] [] ? sched_clock+0x9/0x10 [255280.810641] [] schedule+0x29/0x70 [255280.816283] [] smpboot_thread_fn+0xe2/0x1a0 [255280.822895] [] ? lg_double_unlock+0x40/0x40 [255280.829509] [] kthread+0xd1/0xe0 [255280.835056] [] ? insert_kthread_work+0x40/0x40 [255280.841979] [] ret_from_fork_nospec_begin+0x21/0x21 [255280.849367] [] ? insert_kthread_work+0x40/0x40 [255280.856269] migration/3 S ffff9c7b3945d230 0 24 2 0x00000000 [255280.864259] Call Trace: [255280.867089] [] ? cpu_stop_queue_work+0xe0/0xe0 [255280.873992] [] schedule+0x29/0x70 [255280.879641] [] smpboot_thread_fn+0xe2/0x1a0 [255280.886253] [] ? lg_double_unlock+0x40/0x40 [255280.892878] [] kthread+0xd1/0xe0 [255280.898423] [] ? insert_kthread_work+0x40/0x40 [255280.905326] [] ret_from_fork_nospec_begin+0x21/0x21 [255280.912733] [] ? insert_kthread_work+0x40/0x40 [255280.919646] ksoftirqd/3 S ffff9c7b3945e2a0 0 25 2 0x00000000 [255280.927641] Call Trace: [255280.930474] [] schedule+0x29/0x70 [255280.936130] [] smpboot_thread_fn+0xe2/0x1a0 [255280.942749] [] ? lg_double_unlock+0x40/0x40 [255280.949360] [] kthread+0xd1/0xe0 [255280.954908] [] ? insert_kthread_work+0x40/0x40 [255280.961828] [] ret_from_fork_nospec_begin+0x21/0x21 [255280.969216] [] ? insert_kthread_work+0x40/0x40 [255280.976126] kworker/3:0H S ffff9c7b39499070 0 27 2 0x00000000 [255280.984137] Call Trace: [255280.986982] [] ? process_one_work+0x21a/0x440 [255280.993802] [] schedule+0x29/0x70 [255280.999455] [] worker_thread+0x1d9/0x3c0 [255281.005778] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255281.013166] [] kthread+0xd1/0xe0 [255281.018714] [] ? insert_kthread_work+0x40/0x40 [255281.025618] [] ret_from_fork_nospec_begin+0x21/0x21 [255281.033006] [] ? insert_kthread_work+0x40/0x40 [255281.039908] watchdog/4 S ffff9c7b3949a0e0 0 28 2 0x00000000 [255281.047896] Call Trace: [255281.050731] [] ? sched_clock+0x9/0x10 [255281.056764] [] schedule+0x29/0x70 [255281.062419] [] smpboot_thread_fn+0xe2/0x1a0 [255281.069032] [] ? lg_double_unlock+0x40/0x40 [255281.075655] [] kthread+0xd1/0xe0 [255281.081200] [] ? insert_kthread_work+0x40/0x40 [255281.088114] [] ret_from_fork_nospec_begin+0x21/0x21 [255281.095503] [] ? insert_kthread_work+0x40/0x40 [255281.102405] migration/4 S ffff9c7b3949b150 0 29 2 0x00000000 [255281.110404] Call Trace: [255281.113236] [] schedule+0x29/0x70 [255281.118880] [] smpboot_thread_fn+0xe2/0x1a0 [255281.125490] [] ? lg_double_unlock+0x40/0x40 [255281.132102] [] kthread+0xd1/0xe0 [255281.137650] [] ? insert_kthread_work+0x40/0x40 [255281.144554] [] ret_from_fork_nospec_begin+0x21/0x21 [255281.151943] [] ? insert_kthread_work+0x40/0x40 [255281.158854] ksoftirqd/4 S ffff9c7b3949c1c0 0 30 2 0x00000000 [255281.166843] Call Trace: [255281.169695] [] schedule+0x29/0x70 [255281.175340] [] smpboot_thread_fn+0xe2/0x1a0 [255281.181954] [] ? lg_double_unlock+0x40/0x40 [255281.188581] [] kthread+0xd1/0xe0 [255281.194131] [] ? insert_kthread_work+0x40/0x40 [255281.201034] [] ret_from_fork_nospec_begin+0x21/0x21 [255281.208429] [] ? insert_kthread_work+0x40/0x40 [255281.215344] kworker/4:0H S ffff9c7b3949e2a0 0 32 2 0x00000000 [255281.223350] Call Trace: [255281.226183] [] ? process_one_work+0x21a/0x440 [255281.233013] [] schedule+0x29/0x70 [255281.238655] [] worker_thread+0x1d9/0x3c0 [255281.244978] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255281.252366] [] kthread+0xd1/0xe0 [255281.257911] [] ? insert_kthread_work+0x40/0x40 [255281.264834] [] ret_from_fork_nospec_begin+0x21/0x21 [255281.272236] [] ? insert_kthread_work+0x40/0x40 [255281.279140] watchdog/5 S ffff9c7b39528000 0 33 2 0x00000000 [255281.287140] Call Trace: [255281.289972] [] ? local_clock+0x25/0x30 [255281.296114] [] ? running_clock+0x9/0x10 [255281.302338] [] ? sched_clock+0x9/0x10 [255281.308379] [] schedule+0x29/0x70 [255281.314022] [] smpboot_thread_fn+0xe2/0x1a0 [255281.320643] [] ? lg_double_unlock+0x40/0x40 [255281.327262] [] kthread+0xd1/0xe0 [255281.332808] [] ? insert_kthread_work+0x40/0x40 [255281.339731] [] ret_from_fork_nospec_begin+0x21/0x21 [255281.347120] [] ? insert_kthread_work+0x40/0x40 [255281.354029] migration/5 S ffff9c7b39529070 0 34 2 0x00000000 [255281.362048] Call Trace: [255281.364880] [] ? cpu_stop_queue_work+0xe0/0xe0 [255281.371782] [] schedule+0x29/0x70 [255281.377437] [] smpboot_thread_fn+0xe2/0x1a0 [255281.384048] [] ? lg_double_unlock+0x40/0x40 [255281.390661] [] kthread+0xd1/0xe0 [255281.396214] [] ? insert_kthread_work+0x40/0x40 [255281.403119] [] ret_from_fork_nospec_begin+0x21/0x21 [255281.410505] [] ? insert_kthread_work+0x40/0x40 [255281.417406] ksoftirqd/5 S ffff9c7b3952a0e0 0 35 2 0x00000000 [255281.425397] Call Trace: [255281.428228] [] schedule+0x29/0x70 [255281.433871] [] smpboot_thread_fn+0xe2/0x1a0 [255281.440484] [] ? lg_double_unlock+0x40/0x40 [255281.447096] [] kthread+0xd1/0xe0 [255281.452642] [] ? insert_kthread_work+0x40/0x40 [255281.459558] [] ret_from_fork_nospec_begin+0x21/0x21 [255281.466945] [] ? insert_kthread_work+0x40/0x40 [255281.473861] kworker/5:0H S ffff9c7b3952c1c0 0 37 2 0x00000000 [255281.481854] Call Trace: [255281.484697] [] ? process_one_work+0x21a/0x440 [255281.491515] [] schedule+0x29/0x70 [255281.497157] [] worker_thread+0x1d9/0x3c0 [255281.503479] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255281.510872] [] kthread+0xd1/0xe0 [255281.516419] [] ? insert_kthread_work+0x40/0x40 [255281.523324] [] ret_from_fork_nospec_begin+0x21/0x21 [255281.530715] [] ? insert_kthread_work+0x40/0x40 [255281.537629] watchdog/6 S ffff9c7b3952d230 0 38 2 0x00000000 [255281.545634] Call Trace: [255281.548468] [] ? local_clock+0x25/0x30 [255281.554598] [] ? running_clock+0x9/0x10 [255281.560823] [] ? sched_clock+0x9/0x10 [255281.566852] [] schedule+0x29/0x70 [255281.572506] [] smpboot_thread_fn+0xe2/0x1a0 [255281.579118] [] ? lg_double_unlock+0x40/0x40 [255281.585732] [] kthread+0xd1/0xe0 [255281.591278] [] ? insert_kthread_work+0x40/0x40 [255281.598190] [] ret_from_fork_nospec_begin+0x21/0x21 [255281.605577] [] ? insert_kthread_work+0x40/0x40 [255281.612491] migration/6 S ffff9c7b3952e2a0 0 39 2 0x00000000 [255281.620512] Call Trace: [255281.623349] [] schedule+0x29/0x70 [255281.628998] [] smpboot_thread_fn+0xe2/0x1a0 [255281.635612] [] ? lg_double_unlock+0x40/0x40 [255281.642224] [] kthread+0xd1/0xe0 [255281.647773] [] ? insert_kthread_work+0x40/0x40 [255281.654676] [] ret_from_fork_nospec_begin+0x21/0x21 [255281.662066] [] ? insert_kthread_work+0x40/0x40 [255281.668978] ksoftirqd/6 S ffff9c7b39570000 0 40 2 0x00000000 [255281.676990] Call Trace: [255281.679829] [] schedule+0x29/0x70 [255281.685473] [] smpboot_thread_fn+0xe2/0x1a0 [255281.692098] [] ? lg_double_unlock+0x40/0x40 [255281.698728] [] kthread+0xd1/0xe0 [255281.704273] [] ? insert_kthread_work+0x40/0x40 [255281.711176] [] ret_from_fork_nospec_begin+0x21/0x21 [255281.718567] [] ? insert_kthread_work+0x40/0x40 [255281.725468] kworker/6:0H S ffff9c7b395720e0 0 42 2 0x00000000 [255281.733483] Call Trace: [255281.736328] [] ? process_one_work+0x21a/0x440 [255281.743123] [] schedule+0x29/0x70 [255281.748770] [] worker_thread+0x1d9/0x3c0 [255281.755099] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255281.762500] [] kthread+0xd1/0xe0 [255281.768045] [] ? insert_kthread_work+0x40/0x40 [255281.774948] [] ret_from_fork_nospec_begin+0x21/0x21 [255281.782337] [] ? insert_kthread_work+0x40/0x40 [255281.789251] watchdog/7 S ffff9c7b39573150 0 43 2 0x00000000 [255281.797254] Call Trace: [255281.800100] [] ? local_clock+0x25/0x30 [255281.806229] [] ? running_clock+0x9/0x10 [255281.812452] [] ? sched_clock+0x9/0x10 [255281.818482] [] schedule+0x29/0x70 [255281.824136] [] smpboot_thread_fn+0xe2/0x1a0 [255281.830748] [] ? lg_double_unlock+0x40/0x40 [255281.837361] [] kthread+0xd1/0xe0 [255281.842921] [] ? insert_kthread_work+0x40/0x40 [255281.849826] [] ret_from_fork_nospec_begin+0x21/0x21 [255281.857213] [] ? insert_kthread_work+0x40/0x40 [255281.864117] migration/7 S ffff9c7b395741c0 0 44 2 0x00000000 [255281.872118] Call Trace: [255281.874967] [] ? cpu_stop_unpark+0x50/0x50 [255281.881485] [] schedule+0x29/0x70 [255281.887129] [] smpboot_thread_fn+0xe2/0x1a0 [255281.893769] [] ? lg_double_unlock+0x40/0x40 [255281.900387] [] kthread+0xd1/0xe0 [255281.905932] [] ? insert_kthread_work+0x40/0x40 [255281.912848] [] ret_from_fork_nospec_begin+0x21/0x21 [255281.920247] [] ? insert_kthread_work+0x40/0x40 [255281.927155] ksoftirqd/7 S ffff9c7b39575230 0 45 2 0x00000000 [255281.935167] Call Trace: [255281.937998] [] schedule+0x29/0x70 [255281.943660] [] smpboot_thread_fn+0xe2/0x1a0 [255281.950274] [] ? lg_double_unlock+0x40/0x40 [255281.956884] [] kthread+0xd1/0xe0 [255281.962430] [] ? insert_kthread_work+0x40/0x40 [255281.969333] [] ret_from_fork_nospec_begin+0x21/0x21 [255281.976734] [] ? insert_kthread_work+0x40/0x40 [255281.983639] kworker/7:0H S ffff9c7b395d8000 0 47 2 0x00000000 [255281.991673] Call Trace: [255281.994504] [] ? process_one_work+0x21a/0x440 [255282.001322] [] schedule+0x29/0x70 [255282.006966] [] worker_thread+0x1d9/0x3c0 [255282.013294] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255282.020696] [] kthread+0xd1/0xe0 [255282.026234] [] ? insert_kthread_work+0x40/0x40 [255282.033139] [] ret_from_fork_nospec_begin+0x21/0x21 [255282.040526] [] ? insert_kthread_work+0x40/0x40 [255282.047428] watchdog/8 S ffff9c7e7a7be2a0 0 48 2 0x00000000 [255282.055428] Call Trace: [255282.058272] [] ? sched_clock+0x9/0x10 [255282.064315] [] schedule+0x29/0x70 [255282.069977] [] smpboot_thread_fn+0xe2/0x1a0 [255282.076603] [] ? lg_double_unlock+0x40/0x40 [255282.083207] [] kthread+0xd1/0xe0 [255282.088754] [] ? insert_kthread_work+0x40/0x40 [255282.095657] [] ret_from_fork_nospec_begin+0x21/0x21 [255282.103065] [] ? insert_kthread_work+0x40/0x40 [255282.109979] migration/8 S ffff9c7e7a7bd230 0 49 2 0x00000000 [255282.117978] Call Trace: [255282.120818] [] schedule+0x29/0x70 [255282.126475] [] smpboot_thread_fn+0xe2/0x1a0 [255282.133086] [] ? lg_double_unlock+0x40/0x40 [255282.139713] [] kthread+0xd1/0xe0 [255282.145261] [] ? insert_kthread_work+0x40/0x40 [255282.152162] [] ret_from_fork_nospec_begin+0x21/0x21 [255282.159570] [] ? insert_kthread_work+0x40/0x40 [255282.166478] ksoftirqd/8 S ffff9c7e7a7bc1c0 0 50 2 0x00000000 [255282.174479] Call Trace: [255282.177310] [] schedule+0x29/0x70 [255282.182954] [] smpboot_thread_fn+0xe2/0x1a0 [255282.189578] [] ? lg_double_unlock+0x40/0x40 [255282.196190] [] kthread+0xd1/0xe0 [255282.201747] [] ? insert_kthread_work+0x40/0x40 [255282.208650] [] ret_from_fork_nospec_begin+0x21/0x21 [255282.216038] [] ? insert_kthread_work+0x40/0x40 [255282.222943] kworker/8:0 S ffff9c7e7a7bb150 0 51 2 0x00000000 [255282.230952] Call Trace: [255282.233810] [] ? process_one_work+0x21a/0x440 [255282.240632] [] schedule+0x29/0x70 [255282.246290] [] worker_thread+0x1d9/0x3c0 [255282.252613] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255282.260013] [] kthread+0xd1/0xe0 [255282.265560] [] ? insert_kthread_work+0x40/0x40 [255282.272464] [] ret_from_fork_nospec_begin+0x21/0x21 [255282.279854] [] ? insert_kthread_work+0x40/0x40 [255282.286757] kworker/8:0H S ffff9c7e7a7ba0e0 0 52 2 0x00000000 [255282.294763] Call Trace: [255282.297597] [] ? process_one_work+0x21a/0x440 [255282.304401] [] schedule+0x29/0x70 [255282.310050] [] worker_thread+0x1d9/0x3c0 [255282.316374] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255282.323766] [] kthread+0xd1/0xe0 [255282.329313] [] ? insert_kthread_work+0x40/0x40 [255282.336217] [] ret_from_fork_nospec_begin+0x21/0x21 [255282.343604] [] ? insert_kthread_work+0x40/0x40 [255282.350524] watchdog/9 S ffff9c7e79978000 0 54 2 0x00000000 [255282.358547] Call Trace: [255282.361378] [] ? running_clock+0x9/0x10 [255282.367615] [] ? sched_clock+0x9/0x10 [255282.373647] [] schedule+0x29/0x70 [255282.379290] [] smpboot_thread_fn+0xe2/0x1a0 [255282.385902] [] ? lg_double_unlock+0x40/0x40 [255282.392525] [] kthread+0xd1/0xe0 [255282.398070] [] ? insert_kthread_work+0x40/0x40 [255282.404986] [] ret_from_fork_nospec_begin+0x21/0x21 [255282.412388] [] ? insert_kthread_work+0x40/0x40 [255282.419289] migration/9 S ffff9c7e79979070 0 55 2 0x00000000 [255282.427279] Call Trace: [255282.430102] [] schedule+0x29/0x70 [255282.435745] [] smpboot_thread_fn+0xe2/0x1a0 [255282.442365] [] ? lg_double_unlock+0x40/0x40 [255282.448977] [] kthread+0xd1/0xe0 [255282.454536] [] ? insert_kthread_work+0x40/0x40 [255282.461439] [] ret_from_fork_nospec_begin+0x21/0x21 [255282.468841] [] ? insert_kthread_work+0x40/0x40 [255282.475754] ksoftirqd/9 S ffff9c7e7997a0e0 0 56 2 0x00000000 [255282.483763] Call Trace: [255282.486599] [] schedule+0x29/0x70 [255282.492242] [] smpboot_thread_fn+0xe2/0x1a0 [255282.498863] [] ? lg_double_unlock+0x40/0x40 [255282.505475] [] kthread+0xd1/0xe0 [255282.511023] [] ? insert_kthread_work+0x40/0x40 [255282.517927] [] ret_from_fork_nospec_begin+0x21/0x21 [255282.525325] [] ? insert_kthread_work+0x40/0x40 [255282.532226] kworker/9:0H S ffff9c7e7997c1c0 0 58 2 0x00000000 [255282.540263] Call Trace: [255282.543095] [] ? process_one_work+0x21a/0x440 [255282.549914] [] schedule+0x29/0x70 [255282.555568] [] worker_thread+0x1d9/0x3c0 [255282.561903] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255282.569293] [] kthread+0xd1/0xe0 [255282.574839] [] ? insert_kthread_work+0x40/0x40 [255282.581741] [] ret_from_fork_nospec_begin+0x21/0x21 [255282.589130] [] ? insert_kthread_work+0x40/0x40 [255282.596033] watchdog/10 S ffff9c7e7997d230 0 59 2 0x00000000 [255282.604035] Call Trace: [255282.606870] [] ? sched_clock+0x9/0x10 [255282.612913] [] schedule+0x29/0x70 [255282.618555] [] smpboot_thread_fn+0xe2/0x1a0 [255282.625174] [] ? lg_double_unlock+0x40/0x40 [255282.631786] [] kthread+0xd1/0xe0 [255282.637334] [] ? insert_kthread_work+0x40/0x40 [255282.644238] [] ret_from_fork_nospec_begin+0x21/0x21 [255282.651627] [] ? insert_kthread_work+0x40/0x40 [255282.658535] migration/10 S ffff9c7e7997e2a0 0 60 2 0x00000000 [255282.666534] Call Trace: [255282.669378] [] schedule+0x29/0x70 [255282.675021] [] smpboot_thread_fn+0xe2/0x1a0 [255282.681633] [] ? lg_double_unlock+0x40/0x40 [255282.688259] [] kthread+0xd1/0xe0 [255282.693819] [] ? insert_kthread_work+0x40/0x40 [255282.700713] [] ret_from_fork_nospec_begin+0x21/0x21 [255282.708115] [] ? insert_kthread_work+0x40/0x40 [255282.715036] ksoftirqd/10 S ffff9c7e799c0000 0 61 2 0x00000000 [255282.723030] Call Trace: [255282.725867] [] schedule+0x29/0x70 [255282.731510] [] smpboot_thread_fn+0xe2/0x1a0 [255282.738122] [] ? lg_double_unlock+0x40/0x40 [255282.744734] [] kthread+0xd1/0xe0 [255282.750279] [] ? insert_kthread_work+0x40/0x40 [255282.757181] [] ret_from_fork_nospec_begin+0x21/0x21 [255282.764570] [] ? insert_kthread_work+0x40/0x40 [255282.771479] kworker/10:0H S ffff9c7e799c20e0 0 63 2 0x00000000 [255282.779470] Call Trace: [255282.782316] [] ? process_one_work+0x21a/0x440 [255282.789125] [] schedule+0x29/0x70 [255282.794767] [] worker_thread+0x1d9/0x3c0 [255282.801091] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255282.808477] [] kthread+0xd1/0xe0 [255282.814024] [] ? insert_kthread_work+0x40/0x40 [255282.820929] [] ret_from_fork_nospec_begin+0x21/0x21 [255282.828322] [] ? insert_kthread_work+0x40/0x40 [255282.835214] watchdog/11 S ffff9c7e799c3150 0 64 2 0x00000000 [255282.843247] Call Trace: [255282.846080] [] ? sched_clock+0x9/0x10 [255282.852111] [] schedule+0x29/0x70 [255282.857767] [] smpboot_thread_fn+0xe2/0x1a0 [255282.864380] [] ? lg_double_unlock+0x40/0x40 [255282.870992] [] kthread+0xd1/0xe0 [255282.876549] [] ? insert_kthread_work+0x40/0x40 [255282.883452] [] ret_from_fork_nospec_begin+0x21/0x21 [255282.890853] [] ? insert_kthread_work+0x40/0x40 [255282.897769] migration/11 S ffff9c7e799c41c0 0 65 2 0x00000000 [255282.905788] Call Trace: [255282.908618] [] schedule+0x29/0x70 [255282.914261] [] smpboot_thread_fn+0xe2/0x1a0 [255282.920886] [] ? lg_double_unlock+0x40/0x40 [255282.927499] [] kthread+0xd1/0xe0 [255282.933047] [] ? insert_kthread_work+0x40/0x40 [255282.939950] [] ret_from_fork_nospec_begin+0x21/0x21 [255282.947339] [] ? insert_kthread_work+0x40/0x40 [255282.954248] ksoftirqd/11 S ffff9c7e799c5230 0 66 2 0x00000000 [255282.962250] Call Trace: [255282.965081] [] schedule+0x29/0x70 [255282.970738] [] smpboot_thread_fn+0xe2/0x1a0 [255282.977342] [] ? lg_double_unlock+0x40/0x40 [255282.983954] [] kthread+0xd1/0xe0 [255282.989501] [] ? insert_kthread_work+0x40/0x40 [255282.996417] [] ret_from_fork_nospec_begin+0x21/0x21 [255283.003814] [] ? insert_kthread_work+0x40/0x40 [255283.010715] kworker/11:0H S ffff9c7e79a38000 0 68 2 0x00000000 [255283.018713] Call Trace: [255283.021556] [] ? process_one_work+0x21a/0x440 [255283.028364] [] schedule+0x29/0x70 [255283.034022] [] worker_thread+0x1d9/0x3c0 [255283.040358] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255283.047739] [] kthread+0xd1/0xe0 [255283.053285] [] ? insert_kthread_work+0x40/0x40 [255283.060193] [] ret_from_fork_nospec_begin+0x21/0x21 [255283.067572] [] ? insert_kthread_work+0x40/0x40 [255283.074473] watchdog/12 R running task 0 69 2 0x00000000 [255283.082481] Call Trace: [255283.085314] [] ? touch_nmi_watchdog+0x30/0x30 [255283.092121] [] ? sched_clock+0x9/0x10 [255283.098152] [] schedule+0x29/0x70 [255283.103796] [] smpboot_thread_fn+0xe2/0x1a0 [255283.110409] [] ? lg_double_unlock+0x40/0x40 [255283.117025] [] kthread+0xd1/0xe0 [255283.122571] [] ? insert_kthread_work+0x40/0x40 [255283.129476] [] ret_from_fork_nospec_begin+0x21/0x21 [255283.136866] [] ? insert_kthread_work+0x40/0x40 [255283.143779] migration/12 R running task 0 70 2 0x00000000 [255283.151787] Call Trace: [255283.154630] [] schedule+0x29/0x70 [255283.160273] [] smpboot_thread_fn+0xe2/0x1a0 [255283.166900] [] ? lg_double_unlock+0x40/0x40 [255283.173524] [] kthread+0xd1/0xe0 [255283.179071] [] ? insert_kthread_work+0x40/0x40 [255283.185978] [] ret_from_fork_nospec_begin+0x21/0x21 [255283.193379] [] ? insert_kthread_work+0x40/0x40 [255283.200280] ksoftirqd/12 R running task 0 71 2 0x00000000 [255283.208278] Call Trace: [255283.211118] [] schedule+0x29/0x70 [255283.216762] [] smpboot_thread_fn+0xe2/0x1a0 [255283.223374] [] ? lg_double_unlock+0x40/0x40 [255283.229985] [] kthread+0xd1/0xe0 [255283.235532] [] ? insert_kthread_work+0x40/0x40 [255283.242436] [] ret_from_fork_nospec_begin+0x21/0x21 [255283.249836] [] ? insert_kthread_work+0x40/0x40 [255283.256761] kworker/12:0 S ffff9c7e79a3c1c0 0 72 2 0x00000000 [255283.264788] Call Trace: [255283.267619] [] ? process_one_work+0x21a/0x440 [255283.274426] [] schedule+0x29/0x70 [255283.280071] [] worker_thread+0x1d9/0x3c0 [255283.286406] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255283.293795] [] kthread+0xd1/0xe0 [255283.299341] [] ? insert_kthread_work+0x40/0x40 [255283.306252] [] ret_from_fork_nospec_begin+0x21/0x21 [255283.313651] [] ? insert_kthread_work+0x40/0x40 [255283.320566] kworker/12:0H S ffff9c7e79a3d230 0 73 2 0x00000000 [255283.328571] Call Trace: [255283.331402] [] ? process_one_work+0x21a/0x440 [255283.338209] [] schedule+0x29/0x70 [255283.343853] [] worker_thread+0x1d9/0x3c0 [255283.350187] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255283.357575] [] kthread+0xd1/0xe0 [255283.363120] [] ? insert_kthread_work+0x40/0x40 [255283.370024] [] ret_from_fork_nospec_begin+0x21/0x21 [255283.377424] [] ? insert_kthread_work+0x40/0x40 [255283.384326] watchdog/13 S ffff9c7e79a3e2a0 0 74 2 0x00000000 [255283.392329] Call Trace: [255283.395160] [] ? sched_clock+0x9/0x10 [255283.401201] [] schedule+0x29/0x70 [255283.406843] [] smpboot_thread_fn+0xe2/0x1a0 [255283.413457] [] ? lg_double_unlock+0x40/0x40 [255283.420072] [] kthread+0xd1/0xe0 [255283.425618] [] ? insert_kthread_work+0x40/0x40 [255283.432524] [] ret_from_fork_nospec_begin+0x21/0x21 [255283.439912] [] ? insert_kthread_work+0x40/0x40 [255283.446821] migration/13 S ffff9c7e79aa0000 0 75 2 0x00000000 [255283.454829] Call Trace: [255283.457660] [] schedule+0x29/0x70 [255283.463302] [] smpboot_thread_fn+0xe2/0x1a0 [255283.469922] [] ? lg_double_unlock+0x40/0x40 [255283.476547] [] kthread+0xd1/0xe0 [255283.482092] [] ? insert_kthread_work+0x40/0x40 [255283.488996] [] ret_from_fork_nospec_begin+0x21/0x21 [255283.496383] [] ? insert_kthread_work+0x40/0x40 [255283.503286] ksoftirqd/13 S ffff9c7e79aa1070 0 76 2 0x00000000 [255283.511296] Call Trace: [255283.514134] [] schedule+0x29/0x70 [255283.519778] [] smpboot_thread_fn+0xe2/0x1a0 [255283.526391] [] ? lg_double_unlock+0x40/0x40 [255283.533028] [] kthread+0xd1/0xe0 [255283.538573] [] ? insert_kthread_work+0x40/0x40 [255283.545489] [] ret_from_fork_nospec_begin+0x21/0x21 [255283.552875] [] ? insert_kthread_work+0x40/0x40 [255283.559778] kworker/13:0 S ffff9c7e79aa20e0 0 77 2 0x00000000 [255283.567790] Call Trace: [255283.570627] [] ? process_one_work+0x21a/0x440 [255283.577434] [] schedule+0x29/0x70 [255283.583077] [] worker_thread+0x1d9/0x3c0 [255283.589402] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255283.596790] [] kthread+0xd1/0xe0 [255283.602339] [] ? insert_kthread_work+0x40/0x40 [255283.609241] [] ret_from_fork_nospec_begin+0x21/0x21 [255283.616628] [] ? insert_kthread_work+0x40/0x40 [255283.623530] kworker/13:0H S ffff9c7e79aa3150 0 78 2 0x00000000 [255283.631540] Call Trace: [255283.634371] [] ? process_one_work+0x21a/0x440 [255283.641177] [] schedule+0x29/0x70 [255283.646821] [] worker_thread+0x1d9/0x3c0 [255283.653142] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255283.660531] [] kthread+0xd1/0xe0 [255283.666076] [] ? insert_kthread_work+0x40/0x40 [255283.672979] [] ret_from_fork_nospec_begin+0x21/0x21 [255283.680389] [] ? insert_kthread_work+0x40/0x40 [255283.687290] watchdog/14 S ffff9c7e79aa41c0 0 79 2 0x00000000 [255283.695288] Call Trace: [255283.698111] [] ? sched_clock+0x9/0x10 [255283.704142] [] schedule+0x29/0x70 [255283.709786] [] smpboot_thread_fn+0xe2/0x1a0 [255283.716428] [] ? lg_double_unlock+0x40/0x40 [255283.723039] [] kthread+0xd1/0xe0 [255283.728586] [] ? insert_kthread_work+0x40/0x40 [255283.735492] [] ret_from_fork_nospec_begin+0x21/0x21 [255283.742897] [] ? insert_kthread_work+0x40/0x40 [255283.749798] migration/14 S ffff9c7e79aa5230 0 80 2 0x00000000 [255283.757809] Call Trace: [255283.760653] [] schedule+0x29/0x70 [255283.766296] [] smpboot_thread_fn+0xe2/0x1a0 [255283.772909] [] ? lg_double_unlock+0x40/0x40 [255283.779537] [] kthread+0xd1/0xe0 [255283.785083] [] ? insert_kthread_work+0x40/0x40 [255283.791985] [] ret_from_fork_nospec_begin+0x21/0x21 [255283.799372] [] ? insert_kthread_work+0x40/0x40 [255283.806273] ksoftirqd/14 S ffff9c7e79aa62a0 0 81 2 0x00000000 [255283.814300] Call Trace: [255283.817131] [] schedule+0x29/0x70 [255283.822776] [] smpboot_thread_fn+0xe2/0x1a0 [255283.829393] [] ? lg_double_unlock+0x40/0x40 [255283.836005] [] kthread+0xd1/0xe0 [255283.841553] [] ? insert_kthread_work+0x40/0x40 [255283.848457] [] ret_from_fork_nospec_begin+0x21/0x21 [255283.855858] [] ? insert_kthread_work+0x40/0x40 [255283.862774] kworker/14:0 S ffff9c7e79ae0000 0 82 2 0x00000000 [255283.870778] Call Trace: [255283.873624] [] ? start_worker+0x27/0x30 [255283.879859] [] ? manage_workers.isra.26+0x189/0x2a0 [255283.887260] [] schedule+0x29/0x70 [255283.892902] [] worker_thread+0x1d9/0x3c0 [255283.899222] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255283.906610] [] kthread+0xd1/0xe0 [255283.912157] [] ? insert_kthread_work+0x40/0x40 [255283.919059] [] ret_from_fork_nospec_begin+0x21/0x21 [255283.926460] [] ? insert_kthread_work+0x40/0x40 [255283.933375] kworker/14:0H S ffff9c7e79ae1070 0 83 2 0x00000000 [255283.941380] Call Trace: [255283.944211] [] ? process_one_work+0x21a/0x440 [255283.951019] [] schedule+0x29/0x70 [255283.956663] [] worker_thread+0x1d9/0x3c0 [255283.962998] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255283.970377] [] kthread+0xd1/0xe0 [255283.975924] [] ? insert_kthread_work+0x40/0x40 [255283.982829] [] ret_from_fork_nospec_begin+0x21/0x21 [255283.990253] [] ? insert_kthread_work+0x40/0x40 [255283.997154] watchdog/15 S ffff9c7e79ae20e0 0 84 2 0x00000000 [255284.005164] Call Trace: [255284.007996] [] ? native_sched_clock_from_tsc+0x70/0x70 [255284.015674] [] ? sched_clock+0x9/0x10 [255284.021708] [] schedule+0x29/0x70 [255284.027356] [] smpboot_thread_fn+0xe2/0x1a0 [255284.033968] [] ? lg_double_unlock+0x40/0x40 [255284.040581] [] kthread+0xd1/0xe0 [255284.046126] [] ? insert_kthread_work+0x40/0x40 [255284.053030] [] ret_from_fork_nospec_begin+0x21/0x21 [255284.060447] [] ? insert_kthread_work+0x40/0x40 [255284.067349] migration/15 S ffff9c7e79ae3150 0 85 2 0x00000000 [255284.075347] Call Trace: [255284.078170] [] schedule+0x29/0x70 [255284.083818] [] smpboot_thread_fn+0xe2/0x1a0 [255284.090443] [] ? lg_double_unlock+0x40/0x40 [255284.097054] [] kthread+0xd1/0xe0 [255284.102600] [] ? insert_kthread_work+0x40/0x40 [255284.109518] [] ret_from_fork_nospec_begin+0x21/0x21 [255284.116918] [] ? insert_kthread_work+0x40/0x40 [255284.123822] ksoftirqd/15 S ffff9c7e79ae41c0 0 86 2 0x00000000 [255284.131823] Call Trace: [255284.134655] [] schedule+0x29/0x70 [255284.140297] [] smpboot_thread_fn+0xe2/0x1a0 [255284.146911] [] ? lg_double_unlock+0x40/0x40 [255284.153523] [] kthread+0xd1/0xe0 [255284.159070] [] ? insert_kthread_work+0x40/0x40 [255284.165974] [] ret_from_fork_nospec_begin+0x21/0x21 [255284.173361] [] ? insert_kthread_work+0x40/0x40 [255284.180263] kworker/15:0H S ffff9c7e79ae62a0 0 88 2 0x00000000 [255284.188266] Call Trace: [255284.191100] [] ? process_one_work+0x21a/0x440 [255284.197917] [] schedule+0x29/0x70 [255284.203562] [] worker_thread+0x1d9/0x3c0 [255284.209892] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255284.217299] [] kthread+0xd1/0xe0 [255284.222845] [] ? insert_kthread_work+0x40/0x40 [255284.229747] [] ret_from_fork_nospec_begin+0x21/0x21 [255284.237137] [] ? insert_kthread_work+0x40/0x40 [255284.244040] watchdog/16 S ffff9c7b395de2a0 0 89 2 0x00000000 [255284.252028] Call Trace: [255284.254879] [] ? local_clock+0x25/0x30 [255284.261006] [] ? running_clock+0x9/0x10 [255284.267230] [] ? sched_clock+0x9/0x10 [255284.273269] [] schedule+0x29/0x70 [255284.278910] [] smpboot_thread_fn+0xe2/0x1a0 [255284.285530] [] ? lg_double_unlock+0x40/0x40 [255284.292141] [] kthread+0xd1/0xe0 [255284.297685] [] ? insert_kthread_work+0x40/0x40 [255284.304588] [] ret_from_fork_nospec_begin+0x21/0x21 [255284.311976] [] ? insert_kthread_work+0x40/0x40 [255284.318880] migration/16 S ffff9c7b395dd230 0 90 2 0x00000000 [255284.326913] Call Trace: [255284.329753] [] schedule+0x29/0x70 [255284.335408] [] smpboot_thread_fn+0xe2/0x1a0 [255284.342021] [] ? lg_double_unlock+0x40/0x40 [255284.348646] [] kthread+0xd1/0xe0 [255284.354194] [] ? insert_kthread_work+0x40/0x40 [255284.361096] [] ret_from_fork_nospec_begin+0x21/0x21 [255284.368488] [] ? insert_kthread_work+0x40/0x40 [255284.375409] ksoftirqd/16 S ffff9c7b395dc1c0 0 91 2 0x00000000 [255284.383419] Call Trace: [255284.386249] [] schedule+0x29/0x70 [255284.391906] [] smpboot_thread_fn+0xe2/0x1a0 [255284.398519] [] ? lg_double_unlock+0x40/0x40 [255284.405130] [] kthread+0xd1/0xe0 [255284.410676] [] ? insert_kthread_work+0x40/0x40 [255284.417579] [] ret_from_fork_nospec_begin+0x21/0x21 [255284.424967] [] ? insert_kthread_work+0x40/0x40 [255284.431869] kworker/16:0H S ffff9c7b395da0e0 0 93 2 0x00000000 [255284.439919] Call Trace: [255284.442752] [] ? process_one_work+0x21a/0x440 [255284.449570] [] schedule+0x29/0x70 [255284.455213] [] worker_thread+0x1d9/0x3c0 [255284.461534] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255284.468921] [] kthread+0xd1/0xe0 [255284.474480] [] ? insert_kthread_work+0x40/0x40 [255284.481400] [] ret_from_fork_nospec_begin+0x21/0x21 [255284.488794] [] ? insert_kthread_work+0x40/0x40 [255284.495696] watchdog/17 S ffff9c7b395d9070 0 94 2 0x00000000 [255284.503707] Call Trace: [255284.506539] [] ? local_clock+0x25/0x30 [255284.512677] [] ? running_clock+0x9/0x10 [255284.518902] [] ? sched_clock+0x9/0x10 [255284.524932] [] schedule+0x29/0x70 [255284.530583] [] smpboot_thread_fn+0xe2/0x1a0 [255284.537194] [] ? lg_double_unlock+0x40/0x40 [255284.543809] [] kthread+0xd1/0xe0 [255284.549363] [] ? insert_kthread_work+0x40/0x40 [255284.556265] [] ret_from_fork_nospec_begin+0x21/0x21 [255284.563658] [] ? insert_kthread_work+0x40/0x40 [255284.570552] migration/17 S ffff9c7b39688000 0 95 2 0x00000000 [255284.578574] Call Trace: [255284.581407] [] schedule+0x29/0x70 [255284.587052] [] smpboot_thread_fn+0xe2/0x1a0 [255284.593678] [] ? lg_double_unlock+0x40/0x40 [255284.600289] [] kthread+0xd1/0xe0 [255284.605837] [] ? insert_kthread_work+0x40/0x40 [255284.612741] [] ret_from_fork_nospec_begin+0x21/0x21 [255284.620141] [] ? insert_kthread_work+0x40/0x40 [255284.627054] ksoftirqd/17 S ffff9c7b39689070 0 96 2 0x00000000 [255284.635054] Call Trace: [255284.637884] [] schedule+0x29/0x70 [255284.643527] [] smpboot_thread_fn+0xe2/0x1a0 [255284.650139] [] ? lg_double_unlock+0x40/0x40 [255284.656752] [] kthread+0xd1/0xe0 [255284.662298] [] ? insert_kthread_work+0x40/0x40 [255284.669201] [] ret_from_fork_nospec_begin+0x21/0x21 [255284.676590] [] ? insert_kthread_work+0x40/0x40 [255284.683493] kworker/17:0H S ffff9c7b3968b150 0 98 2 0x00000000 [255284.691497] Call Trace: [255284.694332] [] ? process_one_work+0x21a/0x440 [255284.701138] [] schedule+0x29/0x70 [255284.706797] [] worker_thread+0x1d9/0x3c0 [255284.713129] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255284.720516] [] kthread+0xd1/0xe0 [255284.726064] [] ? insert_kthread_work+0x40/0x40 [255284.732974] [] ret_from_fork_nospec_begin+0x21/0x21 [255284.740374] [] ? insert_kthread_work+0x40/0x40 [255284.747275] watchdog/18 S ffff9c7b3968c1c0 0 99 2 0x00000000 [255284.755275] Call Trace: [255284.758109] [] ? local_clock+0x25/0x30 [255284.764248] [] ? running_clock+0x9/0x10 [255284.770473] [] ? sched_clock+0x9/0x10 [255284.776504] [] schedule+0x29/0x70 [255284.782148] [] smpboot_thread_fn+0xe2/0x1a0 [255284.788765] [] ? lg_double_unlock+0x40/0x40 [255284.795377] [] kthread+0xd1/0xe0 [255284.800923] [] ? insert_kthread_work+0x40/0x40 [255284.807839] [] ret_from_fork_nospec_begin+0x21/0x21 [255284.815256] [] ? insert_kthread_work+0x40/0x40 [255284.822171] migration/18 S ffff9c7b3968d230 0 100 2 0x00000000 [255284.830169] Call Trace: [255284.833003] [] schedule+0x29/0x70 [255284.838645] [] smpboot_thread_fn+0xe2/0x1a0 [255284.845258] [] ? lg_double_unlock+0x40/0x40 [255284.851872] [] kthread+0xd1/0xe0 [255284.857432] [] ? insert_kthread_work+0x40/0x40 [255284.864327] [] ret_from_fork_nospec_begin+0x21/0x21 [255284.871720] [] ? insert_kthread_work+0x40/0x40 [255284.878624] ksoftirqd/18 S ffff9c7b3968e2a0 0 101 2 0x00000000 [255284.886633] Call Trace: [255284.889477] [] schedule+0x29/0x70 [255284.895122] [] smpboot_thread_fn+0xe2/0x1a0 [255284.901744] [] ? lg_double_unlock+0x40/0x40 [255284.908357] [] kthread+0xd1/0xe0 [255284.913905] [] ? insert_kthread_work+0x40/0x40 [255284.920808] [] ret_from_fork_nospec_begin+0x21/0x21 [255284.928212] [] ? insert_kthread_work+0x40/0x40 [255284.935116] kworker/18:0H S ffff9c7b396d1070 0 103 2 0x00000000 [255284.943119] Call Trace: [255284.945952] [] ? process_one_work+0x21a/0x440 [255284.952781] [] schedule+0x29/0x70 [255284.958434] [] worker_thread+0x1d9/0x3c0 [255284.964768] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255284.972158] [] kthread+0xd1/0xe0 [255284.977705] [] ? insert_kthread_work+0x40/0x40 [255284.984609] [] ret_from_fork_nospec_begin+0x21/0x21 [255284.991997] [] ? insert_kthread_work+0x40/0x40 [255284.998915] watchdog/19 S ffff9c7b396d20e0 0 104 2 0x00000000 [255285.006929] Call Trace: [255285.009777] [] ? sched_clock+0x9/0x10 [255285.015806] [] schedule+0x29/0x70 [255285.021449] [] smpboot_thread_fn+0xe2/0x1a0 [255285.028063] [] ? lg_double_unlock+0x40/0x40 [255285.034687] [] kthread+0xd1/0xe0 [255285.040245] [] ? insert_kthread_work+0x40/0x40 [255285.047171] [] ret_from_fork_nospec_begin+0x21/0x21 [255285.054567] [] ? insert_kthread_work+0x40/0x40 [255285.061469] migration/19 S ffff9c7b396d3150 0 105 2 0x00000000 [255285.069464] Call Trace: [255285.072296] [] schedule+0x29/0x70 [255285.077946] [] smpboot_thread_fn+0xe2/0x1a0 [255285.084561] [] ? lg_double_unlock+0x40/0x40 [255285.091187] [] kthread+0xd1/0xe0 [255285.096738] [] ? insert_kthread_work+0x40/0x40 [255285.103635] [] ret_from_fork_nospec_begin+0x21/0x21 [255285.111025] [] ? insert_kthread_work+0x40/0x40 [255285.117925] ksoftirqd/19 S ffff9c7b396d41c0 0 106 2 0x00000000 [255285.125950] Call Trace: [255285.128797] [] schedule+0x29/0x70 [255285.134447] [] smpboot_thread_fn+0xe2/0x1a0 [255285.141073] [] ? lg_double_unlock+0x40/0x40 [255285.147698] [] kthread+0xd1/0xe0 [255285.153245] [] ? insert_kthread_work+0x40/0x40 [255285.160149] [] ret_from_fork_nospec_begin+0x21/0x21 [255285.167538] [] ? insert_kthread_work+0x40/0x40 [255285.174440] kworker/19:0H S ffff9c7b396d62a0 0 108 2 0x00000000 [255285.182474] Call Trace: [255285.185307] [] ? process_one_work+0x21a/0x440 [255285.192126] [] schedule+0x29/0x70 [255285.197770] [] worker_thread+0x1d9/0x3c0 [255285.204095] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255285.211496] [] kthread+0xd1/0xe0 [255285.217053] [] ? insert_kthread_work+0x40/0x40 [255285.223956] [] ret_from_fork_nospec_begin+0x21/0x21 [255285.231358] [] ? insert_kthread_work+0x40/0x40 [255285.238251] watchdog/20 S ffff9c7b39748000 0 109 2 0x00000000 [255285.246247] Call Trace: [255285.249091] [] ? touch_nmi_watchdog+0x30/0x30 [255285.255899] [] ? sched_clock+0x9/0x10 [255285.261931] [] schedule+0x29/0x70 [255285.267576] [] smpboot_thread_fn+0xe2/0x1a0 [255285.274189] [] ? lg_double_unlock+0x40/0x40 [255285.280817] [] kthread+0xd1/0xe0 [255285.286370] [] ? insert_kthread_work+0x40/0x40 [255285.293288] [] ret_from_fork_nospec_begin+0x21/0x21 [255285.300678] [] ? insert_kthread_work+0x40/0x40 [255285.307582] migration/20 S ffff9c7b39749070 0 110 2 0x00000000 [255285.315599] Call Trace: [255285.318431] [] schedule+0x29/0x70 [255285.324080] [] smpboot_thread_fn+0xe2/0x1a0 [255285.330716] [] ? lg_double_unlock+0x40/0x40 [255285.337328] [] kthread+0xd1/0xe0 [255285.342875] [] ? insert_kthread_work+0x40/0x40 [255285.349779] [] ret_from_fork_nospec_begin+0x21/0x21 [255285.357167] [] ? insert_kthread_work+0x40/0x40 [255285.364069] ksoftirqd/20 S ffff9c7b3974a0e0 0 111 2 0x00000000 [255285.372095] Call Trace: [255285.374926] [] schedule+0x29/0x70 [255285.380582] [] smpboot_thread_fn+0xe2/0x1a0 [255285.387203] [] ? lg_double_unlock+0x40/0x40 [255285.393816] [] kthread+0xd1/0xe0 [255285.399376] [] ? insert_kthread_work+0x40/0x40 [255285.406278] [] ret_from_fork_nospec_begin+0x21/0x21 [255285.413679] [] ? insert_kthread_work+0x40/0x40 [255285.420583] kworker/20:0H S ffff9c7b3974c1c0 0 113 2 0x00000000 [255285.428601] Call Trace: [255285.431444] [] ? process_one_work+0x21a/0x440 [255285.438251] [] schedule+0x29/0x70 [255285.443894] [] worker_thread+0x1d9/0x3c0 [255285.450237] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255285.457635] [] kthread+0xd1/0xe0 [255285.463214] [] ? insert_kthread_work+0x40/0x40 [255285.470120] [] ret_from_fork_nospec_begin+0x21/0x21 [255285.477511] [] ? insert_kthread_work+0x40/0x40 [255285.484418] watchdog/21 S ffff9c7b3974d230 0 114 2 0x00000000 [255285.492417] Call Trace: [255285.495250] [] ? watchdog_cleanup+0x10/0x10 [255285.501864] [] ? sched_clock+0x9/0x10 [255285.507895] [] schedule+0x29/0x70 [255285.513539] [] smpboot_thread_fn+0xe2/0x1a0 [255285.520153] [] ? lg_double_unlock+0x40/0x40 [255285.526780] [] kthread+0xd1/0xe0 [255285.532333] [] ? insert_kthread_work+0x40/0x40 [255285.539236] [] ret_from_fork_nospec_begin+0x21/0x21 [255285.546632] [] ? insert_kthread_work+0x40/0x40 [255285.553535] migration/21 S ffff9c7b3974e2a0 0 115 2 0x00000000 [255285.561543] Call Trace: [255285.564374] [] schedule+0x29/0x70 [255285.570031] [] smpboot_thread_fn+0xe2/0x1a0 [255285.576644] [] ? lg_double_unlock+0x40/0x40 [255285.583256] [] kthread+0xd1/0xe0 [255285.588818] [] ? insert_kthread_work+0x40/0x40 [255285.595730] [] ret_from_fork_nospec_begin+0x21/0x21 [255285.603140] [] ? insert_kthread_work+0x40/0x40 [255285.610045] ksoftirqd/21 S ffff9c7b397b0000 0 116 2 0x00000000 [255285.618066] Call Trace: [255285.620897] [] schedule+0x29/0x70 [255285.626542] [] smpboot_thread_fn+0xe2/0x1a0 [255285.633169] [] ? lg_double_unlock+0x40/0x40 [255285.639772] [] kthread+0xd1/0xe0 [255285.645318] [] ? insert_kthread_work+0x40/0x40 [255285.652259] [] ret_from_fork_nospec_begin+0x21/0x21 [255285.659654] [] ? insert_kthread_work+0x40/0x40 [255285.666559] kworker/21:0H S ffff9c7b397b20e0 0 118 2 0x00000000 [255285.674574] Call Trace: [255285.677407] [] ? process_one_work+0x21a/0x440 [255285.684215] [] schedule+0x29/0x70 [255285.689861] [] worker_thread+0x1d9/0x3c0 [255285.696185] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255285.703588] [] kthread+0xd1/0xe0 [255285.709138] [] ? insert_kthread_work+0x40/0x40 [255285.716043] [] ret_from_fork_nospec_begin+0x21/0x21 [255285.723433] [] ? insert_kthread_work+0x40/0x40 [255285.730354] watchdog/22 S ffff9c7b397b3150 0 119 2 0x00000000 [255285.738332] Call Trace: [255285.741169] [] ? local_clock+0x25/0x30 [255285.747297] [] ? running_clock+0x9/0x10 [255285.753520] [] ? sched_clock+0x9/0x10 [255285.759552] [] schedule+0x29/0x70 [255285.765208] [] smpboot_thread_fn+0xe2/0x1a0 [255285.771823] [] ? lg_double_unlock+0x40/0x40 [255285.778436] [] kthread+0xd1/0xe0 [255285.783998] [] ? insert_kthread_work+0x40/0x40 [255285.790903] [] ret_from_fork_nospec_begin+0x21/0x21 [255285.798303] [] ? insert_kthread_work+0x40/0x40 [255285.805206] migration/22 S ffff9c7b397b41c0 0 120 2 0x00000000 [255285.813215] Call Trace: [255285.816051] [] schedule+0x29/0x70 [255285.821696] [] smpboot_thread_fn+0xe2/0x1a0 [255285.828309] [] ? lg_double_unlock+0x40/0x40 [255285.834922] [] kthread+0xd1/0xe0 [255285.840484] [] ? insert_kthread_work+0x40/0x40 [255285.847387] [] ret_from_fork_nospec_begin+0x21/0x21 [255285.854787] [] ? insert_kthread_work+0x40/0x40 [255285.861695] ksoftirqd/22 S ffff9c7b397b5230 0 121 2 0x00000000 [255285.869715] Call Trace: [255285.872549] [] schedule+0x29/0x70 [255285.878195] [] smpboot_thread_fn+0xe2/0x1a0 [255285.884809] [] ? lg_double_unlock+0x40/0x40 [255285.891423] [] kthread+0xd1/0xe0 [255285.896985] [] ? insert_kthread_work+0x40/0x40 [255285.903898] [] ret_from_fork_nospec_begin+0x21/0x21 [255285.911298] [] ? insert_kthread_work+0x40/0x40 [255285.918202] kworker/22:0H S ffff9c7b39000000 0 123 2 0x00000000 [255285.926222] Call Trace: [255285.929056] [] ? process_one_work+0x21a/0x440 [255285.935863] [] schedule+0x29/0x70 [255285.941521] [] worker_thread+0x1d9/0x3c0 [255285.947846] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255285.955236] [] kthread+0xd1/0xe0 [255285.960796] [] ? insert_kthread_work+0x40/0x40 [255285.967713] [] ret_from_fork_nospec_begin+0x21/0x21 [255285.975115] [] ? insert_kthread_work+0x40/0x40 [255285.982021] watchdog/23 S ffff9c7b39001070 0 124 2 0x00000000 [255285.990024] Call Trace: [255285.992858] [] ? local_clock+0x25/0x30 [255285.998989] [] ? running_clock+0x9/0x10 [255286.005213] [] ? sched_clock+0x9/0x10 [255286.011252] [] schedule+0x29/0x70 [255286.016895] [] smpboot_thread_fn+0xe2/0x1a0 [255286.023509] [] ? lg_double_unlock+0x40/0x40 [255286.030123] [] kthread+0xd1/0xe0 [255286.035673] [] ? insert_kthread_work+0x40/0x40 [255286.042577] [] ret_from_fork_nospec_begin+0x21/0x21 [255286.049978] [] ? insert_kthread_work+0x40/0x40 [255286.056883] migration/23 S ffff9c7b390020e0 0 125 2 0x00000000 [255286.064897] Call Trace: [255286.067729] [] ? cpu_stop_queue_work+0xe0/0xe0 [255286.074634] [] schedule+0x29/0x70 [255286.080292] [] smpboot_thread_fn+0xe2/0x1a0 [255286.086905] [] ? lg_double_unlock+0x40/0x40 [255286.093530] [] kthread+0xd1/0xe0 [255286.099077] [] ? insert_kthread_work+0x40/0x40 [255286.105981] [] ret_from_fork_nospec_begin+0x21/0x21 [255286.113381] [] ? insert_kthread_work+0x40/0x40 [255286.120294] ksoftirqd/23 S ffff9c7b39003150 0 126 2 0x00000000 [255286.128304] Call Trace: [255286.131127] [] schedule+0x29/0x70 [255286.136782] [] smpboot_thread_fn+0xe2/0x1a0 [255286.143396] [] ? lg_double_unlock+0x40/0x40 [255286.150022] [] kthread+0xd1/0xe0 [255286.155583] [] ? insert_kthread_work+0x40/0x40 [255286.162517] [] ret_from_fork_nospec_begin+0x21/0x21 [255286.169909] [] ? insert_kthread_work+0x40/0x40 [255286.176813] kworker/23:0H S ffff9c7b39005230 0 128 2 0x00000000 [255286.184819] Call Trace: [255286.187655] [] ? process_one_work+0x21a/0x440 [255286.194464] [] schedule+0x29/0x70 [255286.200120] [] worker_thread+0x1d9/0x3c0 [255286.206442] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255286.213831] [] kthread+0xd1/0xe0 [255286.219390] [] ? insert_kthread_work+0x40/0x40 [255286.226308] [] ret_from_fork_nospec_begin+0x21/0x21 [255286.233698] [] ? insert_kthread_work+0x40/0x40 [255286.240602] watchdog/24 S ffff9c7e79b58000 0 129 2 0x00000000 [255286.248607] Call Trace: [255286.251438] [] ? sched_clock+0x9/0x10 [255286.257471] [] schedule+0x29/0x70 [255286.263113] [] smpboot_thread_fn+0xe2/0x1a0 [255286.269746] [] ? lg_double_unlock+0x40/0x40 [255286.276357] [] kthread+0xd1/0xe0 [255286.281907] [] ? insert_kthread_work+0x40/0x40 [255286.288810] [] ret_from_fork_nospec_begin+0x21/0x21 [255286.296210] [] ? insert_kthread_work+0x40/0x40 [255286.303114] migration/24 S ffff9c7e79b59070 0 130 2 0x00000000 [255286.311126] Call Trace: [255286.313960] [] schedule+0x29/0x70 [255286.319603] [] smpboot_thread_fn+0xe2/0x1a0 [255286.326221] [] ? lg_double_unlock+0x40/0x40 [255286.332836] [] kthread+0xd1/0xe0 [255286.338385] [] ? insert_kthread_work+0x40/0x40 [255286.345310] [] ret_from_fork_nospec_begin+0x21/0x21 [255286.352700] [] ? insert_kthread_work+0x40/0x40 [255286.359631] ksoftirqd/24 S ffff9c7e79b5a0e0 0 131 2 0x00000000 [255286.367658] Call Trace: [255286.370491] [] schedule+0x29/0x70 [255286.376148] [] smpboot_thread_fn+0xe2/0x1a0 [255286.382761] [] ? lg_double_unlock+0x40/0x40 [255286.389386] [] kthread+0xd1/0xe0 [255286.394932] [] ? insert_kthread_work+0x40/0x40 [255286.401835] [] ret_from_fork_nospec_begin+0x21/0x21 [255286.409239] [] ? insert_kthread_work+0x40/0x40 [255286.416144] kworker/24:0 S ffff9c7e79b5b150 0 132 2 0x00000000 [255286.424170] Call Trace: [255286.427005] [] ? process_one_work+0x21a/0x440 [255286.433813] [] schedule+0x29/0x70 [255286.439478] [] worker_thread+0x1d9/0x3c0 [255286.445811] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255286.453200] [] kthread+0xd1/0xe0 [255286.458775] [] ? insert_kthread_work+0x40/0x40 [255286.465686] [] ret_from_fork_nospec_begin+0x21/0x21 [255286.473089] [] ? insert_kthread_work+0x40/0x40 [255286.479992] kworker/24:0H S ffff9c7e79b5c1c0 0 133 2 0x00000000 [255286.488009] Call Trace: [255286.490842] [] ? process_one_work+0x21a/0x440 [255286.497666] [] schedule+0x29/0x70 [255286.503310] [] worker_thread+0x1d9/0x3c0 [255286.509644] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255286.517034] [] kthread+0xd1/0xe0 [255286.522592] [] ? insert_kthread_work+0x40/0x40 [255286.529499] [] ret_from_fork_nospec_begin+0x21/0x21 [255286.536888] [] ? insert_kthread_work+0x40/0x40 [255286.543792] watchdog/25 S ffff9c7e79b5d230 0 134 2 0x00000000 [255286.551802] Call Trace: [255286.554636] [] ? local_clock+0x25/0x30 [255286.560771] [] ? running_clock+0x9/0x10 [255286.566997] [] ? sched_clock+0x9/0x10 [255286.573028] [] schedule+0x29/0x70 [255286.578687] [] smpboot_thread_fn+0xe2/0x1a0 [255286.585299] [] ? lg_double_unlock+0x40/0x40 [255286.591913] [] kthread+0xd1/0xe0 [255286.597459] [] ? insert_kthread_work+0x40/0x40 [255286.604362] [] ret_from_fork_nospec_begin+0x21/0x21 [255286.611755] [] ? insert_kthread_work+0x40/0x40 [255286.618667] migration/25 S ffff9c7e79b5e2a0 0 135 2 0x00000000 [255286.626658] Call Trace: [255286.629492] [] ? cpu_stop_queue_work+0xe0/0xe0 [255286.636408] [] schedule+0x29/0x70 [255286.642058] [] smpboot_thread_fn+0xe2/0x1a0 [255286.648680] [] ? lg_double_unlock+0x40/0x40 [255286.655294] [] kthread+0xd1/0xe0 [255286.660841] [] ? insert_kthread_work+0x40/0x40 [255286.667757] [] ret_from_fork_nospec_begin+0x21/0x21 [255286.675151] [] ? insert_kthread_work+0x40/0x40 [255286.682056] ksoftirqd/25 S ffff9c7e79bb8000 0 136 2 0x00000000 [255286.690066] Call Trace: [255286.692897] [] schedule+0x29/0x70 [255286.698540] [] smpboot_thread_fn+0xe2/0x1a0 [255286.705152] [] ? lg_double_unlock+0x40/0x40 [255286.711765] [] kthread+0xd1/0xe0 [255286.717313] [] ? insert_kthread_work+0x40/0x40 [255286.724216] [] ret_from_fork_nospec_begin+0x21/0x21 [255286.731605] [] ? insert_kthread_work+0x40/0x40 [255286.738510] kworker/25:0H S ffff9c7e79bba0e0 0 138 2 0x00000000 [255286.746527] Call Trace: [255286.749360] [] ? process_one_work+0x21a/0x440 [255286.756176] [] schedule+0x29/0x70 [255286.761821] [] worker_thread+0x1d9/0x3c0 [255286.768148] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255286.775536] [] kthread+0xd1/0xe0 [255286.781084] [] ? insert_kthread_work+0x40/0x40 [255286.787988] [] ret_from_fork_nospec_begin+0x21/0x21 [255286.795380] [] ? insert_kthread_work+0x40/0x40 [255286.802283] watchdog/26 S ffff9c7e79bbb150 0 139 2 0x00000000 [255286.810283] Call Trace: [255286.813115] [] ? sched_clock+0x9/0x10 [255286.819150] [] schedule+0x29/0x70 [255286.824793] [] smpboot_thread_fn+0xe2/0x1a0 [255286.831408] [] ? lg_double_unlock+0x40/0x40 [255286.838044] [] kthread+0xd1/0xe0 [255286.843592] [] ? insert_kthread_work+0x40/0x40 [255286.850520] [] ret_from_fork_nospec_begin+0x21/0x21 [255286.857909] [] ? insert_kthread_work+0x40/0x40 [255286.864814] migration/26 S ffff9c7e79bbc1c0 0 140 2 0x00000000 [255286.872816] Call Trace: [255286.875656] [] ? cpu_stop_unpark+0x50/0x50 [255286.882172] [] schedule+0x29/0x70 [255286.887818] [] smpboot_thread_fn+0xe2/0x1a0 [255286.894431] [] ? lg_double_unlock+0x40/0x40 [255286.901044] [] kthread+0xd1/0xe0 [255286.906606] [] ? insert_kthread_work+0x40/0x40 [255286.913510] [] ret_from_fork_nospec_begin+0x21/0x21 [255286.920899] [] ? insert_kthread_work+0x40/0x40 [255286.927803] ksoftirqd/26 S ffff9c7e79bbd230 0 141 2 0x00000000 [255286.935799] Call Trace: [255286.938646] [] schedule+0x29/0x70 [255286.944291] [] smpboot_thread_fn+0xe2/0x1a0 [255286.950904] [] ? lg_double_unlock+0x40/0x40 [255286.957518] [] kthread+0xd1/0xe0 [255286.963080] [] ? insert_kthread_work+0x40/0x40 [255286.969983] [] ret_from_fork_nospec_begin+0x21/0x21 [255286.977384] [] ? insert_kthread_work+0x40/0x40 [255286.984299] kworker/26:0H S ffff9c7e79408000 0 143 2 0x00000000 [255286.992326] Call Trace: [255286.995164] [] ? process_one_work+0x21a/0x440 [255287.001973] [] schedule+0x29/0x70 [255287.007616] [] worker_thread+0x1d9/0x3c0 [255287.013938] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255287.021328] [] kthread+0xd1/0xe0 [255287.026876] [] ? insert_kthread_work+0x40/0x40 [255287.033782] [] ret_from_fork_nospec_begin+0x21/0x21 [255287.041172] [] ? insert_kthread_work+0x40/0x40 [255287.048087] watchdog/27 S ffff9c7e79409070 0 144 2 0x00000000 [255287.056104] Call Trace: [255287.058935] [] ? sched_clock+0x9/0x10 [255287.064970] [] schedule+0x29/0x70 [255287.070635] [] smpboot_thread_fn+0xe2/0x1a0 [255287.077248] [] ? lg_double_unlock+0x40/0x40 [255287.083860] [] kthread+0xd1/0xe0 [255287.089408] [] ? insert_kthread_work+0x40/0x40 [255287.096315] [] ret_from_fork_nospec_begin+0x21/0x21 [255287.103716] [] ? insert_kthread_work+0x40/0x40 [255287.110637] migration/27 S ffff9c7e7940a0e0 0 145 2 0x00000000 [255287.118643] Call Trace: [255287.121473] [] schedule+0x29/0x70 [255287.127119] [] smpboot_thread_fn+0xe2/0x1a0 [255287.133733] [] ? lg_double_unlock+0x40/0x40 [255287.140345] [] kthread+0xd1/0xe0 [255287.145896] [] ? insert_kthread_work+0x40/0x40 [255287.152804] [] ret_from_fork_nospec_begin+0x21/0x21 [255287.160192] [] ? insert_kthread_work+0x40/0x40 [255287.167095] ksoftirqd/27 S ffff9c7e7940b150 0 146 2 0x00000000 [255287.175113] Call Trace: [255287.177935] [] schedule+0x29/0x70 [255287.183590] [] smpboot_thread_fn+0xe2/0x1a0 [255287.190203] [] ? lg_double_unlock+0x40/0x40 [255287.196817] [] kthread+0xd1/0xe0 [255287.202364] [] ? insert_kthread_work+0x40/0x40 [255287.209270] [] ret_from_fork_nospec_begin+0x21/0x21 [255287.216667] [] ? insert_kthread_work+0x40/0x40 [255287.223585] kworker/27:0 S ffff9c7e7940c1c0 0 147 2 0x00000000 [255287.231581] Call Trace: [255287.234422] [] ? process_one_work+0x21a/0x440 [255287.241229] [] schedule+0x29/0x70 [255287.246882] [] worker_thread+0x1d9/0x3c0 [255287.253211] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255287.260614] [] kthread+0xd1/0xe0 [255287.266190] [] ? insert_kthread_work+0x40/0x40 [255287.273105] [] ret_from_fork_nospec_begin+0x21/0x21 [255287.280499] [] ? insert_kthread_work+0x40/0x40 [255287.287392] kworker/27:0H S ffff9c7e7940d230 0 148 2 0x00000000 [255287.295413] Call Trace: [255287.298247] [] ? process_one_work+0x21a/0x440 [255287.305055] [] schedule+0x29/0x70 [255287.310699] [] worker_thread+0x1d9/0x3c0 [255287.317045] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255287.324431] [] kthread+0xd1/0xe0 [255287.329979] [] ? insert_kthread_work+0x40/0x40 [255287.336896] [] ret_from_fork_nospec_begin+0x21/0x21 [255287.344286] [] ? insert_kthread_work+0x40/0x40 [255287.351189] watchdog/28 S ffff9c7e7940e2a0 0 149 2 0x00000000 [255287.359211] Call Trace: [255287.362048] [] ? sched_clock+0x9/0x10 [255287.368072] [] schedule+0x29/0x70 [255287.373718] [] smpboot_thread_fn+0xe2/0x1a0 [255287.380334] [] ? lg_double_unlock+0x40/0x40 [255287.386947] [] kthread+0xd1/0xe0 [255287.392496] [] ? insert_kthread_work+0x40/0x40 [255287.399399] [] ret_from_fork_nospec_begin+0x21/0x21 [255287.406789] [] ? insert_kthread_work+0x40/0x40 [255287.413691] migration/28 S ffff9c7e79478000 0 150 2 0x00000000 [255287.421708] Call Trace: [255287.424540] [] schedule+0x29/0x70 [255287.430185] [] smpboot_thread_fn+0xe2/0x1a0 [255287.436810] [] ? lg_double_unlock+0x40/0x40 [255287.443425] [] kthread+0xd1/0xe0 [255287.448974] [] ? insert_kthread_work+0x40/0x40 [255287.455879] [] ret_from_fork_nospec_begin+0x21/0x21 [255287.463270] [] ? insert_kthread_work+0x40/0x40 [255287.470196] ksoftirqd/28 S ffff9c7e79479070 0 151 2 0x00000000 [255287.478185] Call Trace: [255287.481029] [] schedule+0x29/0x70 [255287.486674] [] smpboot_thread_fn+0xe2/0x1a0 [255287.493286] [] ? lg_double_unlock+0x40/0x40 [255287.499910] [] kthread+0xd1/0xe0 [255287.505468] [] ? insert_kthread_work+0x40/0x40 [255287.512376] [] ret_from_fork_nospec_begin+0x21/0x21 [255287.519765] [] ? insert_kthread_work+0x40/0x40 [255287.526667] kworker/28:0H S ffff9c7e7947b150 0 153 2 0x00000000 [255287.534694] Call Trace: [255287.537549] [] ? process_one_work+0x21a/0x440 [255287.544362] [] schedule+0x29/0x70 [255287.550012] [] worker_thread+0x1d9/0x3c0 [255287.556334] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255287.563722] [] kthread+0xd1/0xe0 [255287.569270] [] ? insert_kthread_work+0x40/0x40 [255287.576175] [] ret_from_fork_nospec_begin+0x21/0x21 [255287.583568] [] ? insert_kthread_work+0x40/0x40 [255287.590470] watchdog/29 S ffff9c7e7947c1c0 0 154 2 0x00000000 [255287.598482] Call Trace: [255287.601305] [] ? local_clock+0x25/0x30 [255287.607457] [] ? running_clock+0x9/0x10 [255287.613682] [] ? sched_clock+0x9/0x10 [255287.619722] [] schedule+0x29/0x70 [255287.625378] [] smpboot_thread_fn+0xe2/0x1a0 [255287.631992] [] ? lg_double_unlock+0x40/0x40 [255287.638613] [] kthread+0xd1/0xe0 [255287.644162] [] ? insert_kthread_work+0x40/0x40 [255287.651079] [] ret_from_fork_nospec_begin+0x21/0x21 [255287.658471] [] ? insert_kthread_work+0x40/0x40 [255287.665384] migration/29 S ffff9c7e7947d230 0 155 2 0x00000000 [255287.673410] Call Trace: [255287.676242] [] schedule+0x29/0x70 [255287.681885] [] smpboot_thread_fn+0xe2/0x1a0 [255287.688501] [] ? lg_double_unlock+0x40/0x40 [255287.695139] [] kthread+0xd1/0xe0 [255287.700698] [] ? insert_kthread_work+0x40/0x40 [255287.707601] [] ret_from_fork_nospec_begin+0x21/0x21 [255287.714989] [] ? insert_kthread_work+0x40/0x40 [255287.721905] ksoftirqd/29 S ffff9c7e7947e2a0 0 156 2 0x00000000 [255287.729903] Call Trace: [255287.732735] [] schedule+0x29/0x70 [255287.738379] [] smpboot_thread_fn+0xe2/0x1a0 [255287.744991] [] ? lg_double_unlock+0x40/0x40 [255287.751606] [] kthread+0xd1/0xe0 [255287.757165] [] ? insert_kthread_work+0x40/0x40 [255287.764069] [] ret_from_fork_nospec_begin+0x21/0x21 [255287.771459] [] ? insert_kthread_work+0x40/0x40 [255287.778361] kworker/29:0H S ffff9c7e794c1070 0 158 2 0x00000000 [255287.786397] Call Trace: [255287.789236] [] ? process_one_work+0x21a/0x440 [255287.796044] [] schedule+0x29/0x70 [255287.801689] [] worker_thread+0x1d9/0x3c0 [255287.808026] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255287.815427] [] kthread+0xd1/0xe0 [255287.820974] [] ? insert_kthread_work+0x40/0x40 [255287.827879] [] ret_from_fork_nospec_begin+0x21/0x21 [255287.835273] [] ? insert_kthread_work+0x40/0x40 [255287.842187] watchdog/30 S ffff9c7e794c20e0 0 159 2 0x00000000 [255287.850207] Call Trace: [255287.853043] [] ? local_clock+0x25/0x30 [255287.859172] [] ? running_clock+0x9/0x10 [255287.865398] [] ? sched_clock+0x9/0x10 [255287.871443] [] schedule+0x29/0x70 [255287.877086] [] smpboot_thread_fn+0xe2/0x1a0 [255287.883703] [] ? lg_double_unlock+0x40/0x40 [255287.890316] [] kthread+0xd1/0xe0 [255287.895865] [] ? insert_kthread_work+0x40/0x40 [255287.902783] [] ret_from_fork_nospec_begin+0x21/0x21 [255287.910177] [] ? insert_kthread_work+0x40/0x40 [255287.917081] migration/30 S ffff9c7e794c3150 0 160 2 0x00000000 [255287.925093] Call Trace: [255287.927924] [] schedule+0x29/0x70 [255287.933570] [] smpboot_thread_fn+0xe2/0x1a0 [255287.940191] [] ? lg_double_unlock+0x40/0x40 [255287.946804] [] kthread+0xd1/0xe0 [255287.952350] [] ? insert_kthread_work+0x40/0x40 [255287.959256] [] ret_from_fork_nospec_begin+0x21/0x21 [255287.966645] [] ? insert_kthread_work+0x40/0x40 [255287.973548] ksoftirqd/30 S ffff9c7e794c41c0 0 161 2 0x00000000 [255287.981573] Call Trace: [255287.984403] [] schedule+0x29/0x70 [255287.990047] [] smpboot_thread_fn+0xe2/0x1a0 [255287.996674] [] ? lg_double_unlock+0x40/0x40 [255288.003291] [] kthread+0xd1/0xe0 [255288.008849] [] ? insert_kthread_work+0x40/0x40 [255288.015753] [] ret_from_fork_nospec_begin+0x21/0x21 [255288.023153] [] ? insert_kthread_work+0x40/0x40 [255288.030056] kworker/30:0 S ffff9c7e794c5230 0 162 2 0x00000000 [255288.038073] Call Trace: [255288.040904] [] ? process_one_work+0x21a/0x440 [255288.047711] [] schedule+0x29/0x70 [255288.053365] [] worker_thread+0x1d9/0x3c0 [255288.059695] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255288.067083] [] kthread+0xd1/0xe0 [255288.072633] [] ? insert_kthread_work+0x40/0x40 [255288.079547] [] ret_from_fork_nospec_begin+0x21/0x21 [255288.086937] [] ? insert_kthread_work+0x40/0x40 [255288.093841] kworker/30:0H S ffff9c7e794c62a0 0 163 2 0x00000000 [255288.101853] Call Trace: [255288.104686] [] ? process_one_work+0x21a/0x440 [255288.111494] [] schedule+0x29/0x70 [255288.117138] [] worker_thread+0x1d9/0x3c0 [255288.123463] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255288.130854] [] kthread+0xd1/0xe0 [255288.136406] [] ? insert_kthread_work+0x40/0x40 [255288.143311] [] ret_from_fork_nospec_begin+0x21/0x21 [255288.150703] [] ? insert_kthread_work+0x40/0x40 [255288.157604] watchdog/31 S ffff9c7e79538000 0 164 2 0x00000000 [255288.165595] Call Trace: [255288.168432] [] ? sched_clock+0x9/0x10 [255288.174464] [] schedule+0x29/0x70 [255288.180109] [] smpboot_thread_fn+0xe2/0x1a0 [255288.186722] [] ? lg_double_unlock+0x40/0x40 [255288.193335] [] kthread+0xd1/0xe0 [255288.198899] [] ? insert_kthread_work+0x40/0x40 [255288.205803] [] ret_from_fork_nospec_begin+0x21/0x21 [255288.213233] [] ? insert_kthread_work+0x40/0x40 [255288.220135] migration/31 S ffff9c7e79539070 0 165 2 0x00000000 [255288.228123] Call Trace: [255288.230956] [] schedule+0x29/0x70 [255288.236611] [] smpboot_thread_fn+0xe2/0x1a0 [255288.243229] [] ? lg_double_unlock+0x40/0x40 [255288.249844] [] kthread+0xd1/0xe0 [255288.255392] [] ? insert_kthread_work+0x40/0x40 [255288.262309] [] ret_from_fork_nospec_begin+0x21/0x21 [255288.269710] [] ? insert_kthread_work+0x40/0x40 [255288.276613] ksoftirqd/31 S ffff9c7e7953a0e0 0 166 2 0x00000000 [255288.284622] Call Trace: [255288.287453] [] schedule+0x29/0x70 [255288.293099] [] smpboot_thread_fn+0xe2/0x1a0 [255288.299726] [] ? lg_double_unlock+0x40/0x40 [255288.306339] [] kthread+0xd1/0xe0 [255288.311907] [] ? insert_kthread_work+0x40/0x40 [255288.318811] [] ret_from_fork_nospec_begin+0x21/0x21 [255288.326202] [] ? insert_kthread_work+0x40/0x40 [255288.333108] kworker/31:0H S ffff9c7e7953c1c0 0 168 2 0x00000000 [255288.341107] Call Trace: [255288.343939] [] ? start_worker+0x27/0x30 [255288.350176] [] ? manage_workers.isra.26+0x189/0x2a0 [255288.357565] [] schedule+0x29/0x70 [255288.363210] [] worker_thread+0x1d9/0x3c0 [255288.369536] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255288.376916] [] kthread+0xd1/0xe0 [255288.382480] [] ? insert_kthread_work+0x40/0x40 [255288.389384] [] ret_from_fork_nospec_begin+0x21/0x21 [255288.396783] [] ? insert_kthread_work+0x40/0x40 [255288.403687] kdevtmpfs S ffff9c7defce8000 0 171 2 0x00000000 [255288.411687] Call Trace: [255288.414511] [] schedule+0x29/0x70 [255288.420172] [] devtmpfsd+0x16d/0x180 [255288.426120] [] ? handle_create.isra.2+0x220/0x220 [255288.433316] [] kthread+0xd1/0xe0 [255288.438862] [] ? insert_kthread_work+0x40/0x40 [255288.445767] [] ret_from_fork_nospec_begin+0x21/0x21 [255288.453157] [] ? insert_kthread_work+0x40/0x40 [255288.460062] netns S ffff9c81ee45ac80 0 172 2 0x00000000 [255288.468069] Call Trace: [255288.470900] [] schedule+0x29/0x70 [255288.476556] [] rescuer_thread+0x31e/0x3c0 [255288.482988] [] ? process_one_work+0x440/0x440 [255288.489787] [] kthread+0xd1/0xe0 [255288.495338] [] ? insert_kthread_work+0x40/0x40 [255288.502253] [] ret_from_fork_nospec_begin+0x21/0x21 [255288.509643] [] ? insert_kthread_work+0x40/0x40 [255288.516550] khungtaskd S ffff9c7defcea0e0 0 173 2 0x00000000 [255288.524568] Call Trace: [255288.527417] [] schedule+0x29/0x70 [255288.533062] [] schedule_timeout+0x168/0x2d0 [255288.539676] [] ? __internal_add_timer+0x130/0x130 [255288.546871] [] schedule_timeout_interruptible+0x1e/0x20 [255288.554659] [] watchdog+0x4c/0x2c0 [255288.560413] [] ? reset_hung_task_detector+0x20/0x20 [255288.567803] [] kthread+0xd1/0xe0 [255288.573350] [] ? insert_kthread_work+0x40/0x40 [255288.580254] [] ret_from_fork_nospec_begin+0x21/0x21 [255288.587641] [] ? insert_kthread_work+0x40/0x40 [255288.594551] writeback S ffff9c81ee45ac80 0 174 2 0x00000000 [255288.602573] Call Trace: [255288.605413] [] schedule+0x29/0x70 [255288.611071] [] rescuer_thread+0x31e/0x3c0 [255288.617492] [] ? process_one_work+0x440/0x440 [255288.624311] [] kthread+0xd1/0xe0 [255288.629858] [] ? insert_kthread_work+0x40/0x40 [255288.636761] [] ret_from_fork_nospec_begin+0x21/0x21 [255288.644150] [] ? insert_kthread_work+0x40/0x40 [255288.651056] kintegrityd S ffff9c81ee45ac80 0 175 2 0x00000000 [255288.659049] Call Trace: [255288.661882] [] schedule+0x29/0x70 [255288.667541] [] rescuer_thread+0x31e/0x3c0 [255288.673961] [] ? process_one_work+0x440/0x440 [255288.680769] [] kthread+0xd1/0xe0 [255288.686316] [] ? insert_kthread_work+0x40/0x40 [255288.693227] [] ret_from_fork_nospec_begin+0x21/0x21 [255288.700619] [] ? insert_kthread_work+0x40/0x40 [255288.707538] bioset S ffff9c81ee45ac80 0 176 2 0x00000000 [255288.715531] Call Trace: [255288.718363] [] schedule+0x29/0x70 [255288.724015] [] rescuer_thread+0x31e/0x3c0 [255288.730434] [] ? process_one_work+0x440/0x440 [255288.737254] [] kthread+0xd1/0xe0 [255288.742801] [] ? insert_kthread_work+0x40/0x40 [255288.749715] [] ret_from_fork_nospec_begin+0x21/0x21 [255288.757104] [] ? insert_kthread_work+0x40/0x40 [255288.764008] bioset S ffff9c81ee45ac80 0 177 2 0x00000000 [255288.772017] Call Trace: [255288.774852] [] schedule+0x29/0x70 [255288.780499] [] rescuer_thread+0x31e/0x3c0 [255288.786930] [] ? process_one_work+0x440/0x440 [255288.793763] [] kthread+0xd1/0xe0 [255288.799312] [] ? insert_kthread_work+0x40/0x40 [255288.806232] [] ret_from_fork_nospec_begin+0x21/0x21 [255288.813621] [] ? insert_kthread_work+0x40/0x40 [255288.820525] bioset S ffff9c81ee45ac80 0 178 2 0x00000000 [255288.828540] Call Trace: [255288.831372] [] schedule+0x29/0x70 [255288.837037] [] rescuer_thread+0x31e/0x3c0 [255288.843459] [] ? process_one_work+0x440/0x440 [255288.850293] [] kthread+0xd1/0xe0 [255288.855841] [] ? insert_kthread_work+0x40/0x40 [255288.862744] [] ret_from_fork_nospec_begin+0x21/0x21 [255288.870154] [] ? insert_kthread_work+0x40/0x40 [255288.877058] kblockd S ffff9c81ee45ac80 0 179 2 0x00000000 [255288.885059] Call Trace: [255288.887892] [] schedule+0x29/0x70 [255288.893536] [] rescuer_thread+0x31e/0x3c0 [255288.899956] [] ? process_one_work+0x440/0x440 [255288.906761] [] kthread+0xd1/0xe0 [255288.912321] [] ? insert_kthread_work+0x40/0x40 [255288.919224] [] ret_from_fork_nospec_begin+0x21/0x21 [255288.926614] [] ? insert_kthread_work+0x40/0x40 [255288.933517] md S ffff9c81ee45ac80 0 181 2 0x00000000 [255288.941520] Call Trace: [255288.944351] [] schedule+0x29/0x70 [255288.950008] [] rescuer_thread+0x31e/0x3c0 [255288.956429] [] ? process_one_work+0x440/0x440 [255288.963235] [] kthread+0xd1/0xe0 [255288.968789] [] ? insert_kthread_work+0x40/0x40 [255288.975705] [] ret_from_fork_nospec_begin+0x21/0x21 [255288.983108] [] ? insert_kthread_work+0x40/0x40 [255288.990013] edac-poller S ffff9c81ee45ac80 0 182 2 0x00000000 [255288.998006] Call Trace: [255289.000836] [] schedule+0x29/0x70 [255289.006482] [] rescuer_thread+0x31e/0x3c0 [255289.012915] [] ? process_one_work+0x440/0x440 [255289.019723] [] kthread+0xd1/0xe0 [255289.025273] [] ? insert_kthread_work+0x40/0x40 [255289.032188] [] ret_from_fork_nospec_begin+0x21/0x21 [255289.039589] [] ? insert_kthread_work+0x40/0x40 [255289.046486] watchdogd S ffff9c81ee45ac80 0 183 2 0x00000000 [255289.054522] Call Trace: [255289.057355] [] schedule+0x29/0x70 [255289.063019] [] rescuer_thread+0x31e/0x3c0 [255289.069437] [] ? process_one_work+0x440/0x440 [255289.076245] [] kthread+0xd1/0xe0 [255289.081794] [] ? insert_kthread_work+0x40/0x40 [255289.088699] [] ret_from_fork_nospec_begin+0x21/0x21 [255289.096092] [] ? insert_kthread_work+0x40/0x40 [255289.102988] kswapd0 S ffff9c7deea1ac80 0 190 2 0x00000000 [255289.111000] Call Trace: [255289.113833] [] ? calculate_normal_threshold+0x27/0x50 [255289.121415] [] schedule+0x29/0x70 [255289.127088] [] kswapd+0x38f/0x440 [255289.132741] [] ? wake_up_atomic_t+0x30/0x30 [255289.139363] [] ? balance_pgdat+0x5e0/0x5e0 [255289.145885] [] kthread+0xd1/0xe0 [255289.151450] [] ? insert_kthread_work+0x40/0x40 [255289.158354] [] ret_from_fork_nospec_begin+0x21/0x21 [255289.165742] [] ? insert_kthread_work+0x40/0x40 [255289.172646] kswapd1 S ffff9c81ee45ac80 0 191 2 0x00000000 [255289.180643] Call Trace: [255289.183480] [] ? calculate_normal_threshold+0x27/0x50 [255289.191061] [] schedule+0x29/0x70 [255289.196706] [] kswapd+0x38f/0x440 [255289.202363] [] ? wake_up_atomic_t+0x30/0x30 [255289.208983] [] ? balance_pgdat+0x5e0/0x5e0 [255289.215500] [] kthread+0xd1/0xe0 [255289.221059] [] ? insert_kthread_work+0x40/0x40 [255289.227955] [] ret_from_fork_nospec_begin+0x21/0x21 [255289.235344] [] ? insert_kthread_work+0x40/0x40 [255289.242258] ksmd S ffff9c81ee45ac80 0 192 2 0x00000000 [255289.250272] Call Trace: [255289.253103] [] schedule+0x29/0x70 [255289.258748] [] ksm_scan_thread+0x16a/0x240 [255289.265263] [] ? wake_up_atomic_t+0x30/0x30 [255289.271883] [] ? ksm_do_scan+0x11c0/0x11c0 [255289.278400] [] kthread+0xd1/0xe0 [255289.283961] [] ? insert_kthread_work+0x40/0x40 [255289.290887] [] ret_from_fork_nospec_begin+0x21/0x21 [255289.298279] [] ? insert_kthread_work+0x40/0x40 [255289.305187] khugepaged S ffff9c7ded0cd230 0 193 2 0x00000000 [255289.313177] Call Trace: [255289.316018] [] schedule+0x29/0x70 [255289.321665] [] schedule_timeout+0x168/0x2d0 [255289.328279] [] ? __internal_add_timer+0x130/0x130 [255289.335476] [] khugepaged+0x226/0x490 [255289.341508] [] ? wake_up_atomic_t+0x30/0x30 [255289.348123] [] ? khugepaged_scan_mm_slot+0xfb0/0xfb0 [255289.355610] [] kthread+0xd1/0xe0 [255289.361156] [] ? insert_kthread_work+0x40/0x40 [255289.368059] [] ret_from_fork_nospec_begin+0x21/0x21 [255289.375447] [] ? insert_kthread_work+0x40/0x40 [255289.382350] crypto S ffff9c81ee45ac80 0 194 2 0x00000000 [255289.390340] Call Trace: [255289.393187] [] schedule+0x29/0x70 [255289.398834] [] rescuer_thread+0x31e/0x3c0 [255289.405255] [] ? process_one_work+0x440/0x440 [255289.412062] [] kthread+0xd1/0xe0 [255289.417609] [] ? insert_kthread_work+0x40/0x40 [255289.424512] [] ret_from_fork_nospec_begin+0x21/0x21 [255289.431915] [] ? insert_kthread_work+0x40/0x40 [255289.438824] kthrotld S ffff9c81ee45ac80 0 202 2 0x00000000 [255289.446831] Call Trace: [255289.449664] [] schedule+0x29/0x70 [255289.455309] [] rescuer_thread+0x31e/0x3c0 [255289.461740] [] ? process_one_work+0x440/0x440 [255289.468546] [] kthread+0xd1/0xe0 [255289.474093] [] ? insert_kthread_work+0x40/0x40 [255289.481021] [] ret_from_fork_nospec_begin+0x21/0x21 [255289.488425] [] ? insert_kthread_work+0x40/0x40 [255289.495328] kworker/8:1 S ffff9c81ed2d0000 0 203 2 0x00000000 [255289.503349] Call Trace: [255289.506180] [] ? process_one_work+0x21a/0x440 [255289.512985] [] schedule+0x29/0x70 [255289.518629] [] worker_thread+0x1d9/0x3c0 [255289.524952] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255289.532357] [] kthread+0xd1/0xe0 [255289.537904] [] ? insert_kthread_work+0x40/0x40 [255289.544810] [] ret_from_fork_nospec_begin+0x21/0x21 [255289.552211] [] ? insert_kthread_work+0x40/0x40 [255289.559114] kmpath_rdacd S ffff9c81ee45ac80 0 207 2 0x00000000 [255289.567115] Call Trace: [255289.569947] [] schedule+0x29/0x70 [255289.575604] [] rescuer_thread+0x31e/0x3c0 [255289.582025] [] ? process_one_work+0x440/0x440 [255289.588831] [] kthread+0xd1/0xe0 [255289.594379] [] ? insert_kthread_work+0x40/0x40 [255289.601283] [] ret_from_fork_nospec_begin+0x21/0x21 [255289.608674] [] ? insert_kthread_work+0x40/0x40 [255289.615578] kaluad S ffff9c81ee45ac80 0 208 2 0x00000000 [255289.623597] Call Trace: [255289.626430] [] schedule+0x29/0x70 [255289.632075] [] rescuer_thread+0x31e/0x3c0 [255289.638497] [] ? process_one_work+0x440/0x440 [255289.645305] [] kthread+0xd1/0xe0 [255289.650852] [] ? insert_kthread_work+0x40/0x40 [255289.657757] [] ret_from_fork_nospec_begin+0x21/0x21 [255289.665147] [] ? insert_kthread_work+0x40/0x40 [255289.672049] kworker/15:1 S ffff9c81ed2d1070 0 210 2 0x00000000 [255289.680070] Call Trace: [255289.682904] [] ? process_one_work+0x21a/0x440 [255289.689710] [] schedule+0x29/0x70 [255289.695355] [] worker_thread+0x1d9/0x3c0 [255289.701693] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255289.709082] [] kthread+0xd1/0xe0 [255289.714629] [] ? insert_kthread_work+0x40/0x40 [255289.721539] [] ret_from_fork_nospec_begin+0x21/0x21 [255289.728928] [] ? insert_kthread_work+0x40/0x40 [255289.735832] kpsmoused S ffff9c81ee45ac80 0 211 2 0x00000000 [255289.743837] Call Trace: [255289.746669] [] schedule+0x29/0x70 [255289.752312] [] rescuer_thread+0x31e/0x3c0 [255289.758732] [] ? process_one_work+0x440/0x440 [255289.765547] [] kthread+0xd1/0xe0 [255289.771097] [] ? insert_kthread_work+0x40/0x40 [255289.778001] [] ret_from_fork_nospec_begin+0x21/0x21 [255289.785391] [] ? insert_kthread_work+0x40/0x40 [255289.792311] ipv6_addrconf S ffff9c81ee45ac80 0 212 2 0x00000000 [255289.800313] Call Trace: [255289.803144] [] schedule+0x29/0x70 [255289.808787] [] rescuer_thread+0x31e/0x3c0 [255289.815219] [] ? process_one_work+0x440/0x440 [255289.822029] [] kthread+0xd1/0xe0 [255289.827591] [] ? insert_kthread_work+0x40/0x40 [255289.834513] [] ret_from_fork_nospec_begin+0x21/0x21 [255289.841914] [] ? insert_kthread_work+0x40/0x40 [255289.848817] kworker/10:1 S ffff9c81ecf70000 0 213 2 0x00000000 [255289.856842] Call Trace: [255289.859674] [] ? process_one_work+0x21a/0x440 [255289.866482] [] schedule+0x29/0x70 [255289.872129] [] worker_thread+0x1d9/0x3c0 [255289.878458] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255289.885859] [] kthread+0xd1/0xe0 [255289.891407] [] ? insert_kthread_work+0x40/0x40 [255289.898311] [] ret_from_fork_nospec_begin+0x21/0x21 [255289.905701] [] ? insert_kthread_work+0x40/0x40 [255289.912618] deferwq S ffff9c81ee45ac80 0 226 2 0x00000000 [255289.920625] Call Trace: [255289.923471] [] schedule+0x29/0x70 [255289.929116] [] rescuer_thread+0x31e/0x3c0 [255289.935545] [] ? process_one_work+0x440/0x440 [255289.942351] [] kthread+0xd1/0xe0 [255289.947898] [] ? insert_kthread_work+0x40/0x40 [255289.954802] [] ret_from_fork_nospec_begin+0x21/0x21 [255289.962189] [] ? insert_kthread_work+0x40/0x40 [255289.969094] kworker/9:1 S ffff9c81ec4c0000 0 234 2 0x00000000 [255289.977094] Call Trace: [255289.979926] [] ? process_one_work+0x21a/0x440 [255289.986733] [] schedule+0x29/0x70 [255289.992376] [] worker_thread+0x1d9/0x3c0 [255289.998704] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255290.006094] [] kthread+0xd1/0xe0 [255290.011655] [] ? insert_kthread_work+0x40/0x40 [255290.018572] [] ret_from_fork_nospec_begin+0x21/0x21 [255290.025963] [] ? insert_kthread_work+0x40/0x40 [255290.032864] kworker/12:1 R running task 0 235 2 0x00000000 [255290.040881] Call Trace: [255290.043714] [] ? process_one_work+0x21a/0x440 [255290.050533] [] schedule+0x29/0x70 [255290.056176] [] worker_thread+0x1d9/0x3c0 [255290.062498] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255290.069912] [] kthread+0xd1/0xe0 [255290.075457] [] ? insert_kthread_work+0x40/0x40 [255290.082362] [] ret_from_fork_nospec_begin+0x21/0x21 [255290.089764] [] ? insert_kthread_work+0x40/0x40 [255290.096659] kworker/13:1 S ffff9c81ec4c20e0 0 236 2 0x00000000 [255290.104717] Call Trace: [255290.107550] [] ? process_one_work+0x21a/0x440 [255290.114356] [] schedule+0x29/0x70 [255290.120012] [] worker_thread+0x1d9/0x3c0 [255290.126329] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255290.133718] [] kthread+0xd1/0xe0 [255290.139267] [] ? insert_kthread_work+0x40/0x40 [255290.146172] [] ret_from_fork_nospec_begin+0x21/0x21 [255290.153563] [] ? insert_kthread_work+0x40/0x40 [255290.160466] kworker/16:1 S ffff9c7deca2e2a0 0 238 2 0x00000000 [255290.168489] Call Trace: [255290.171328] [] ? process_one_work+0x21a/0x440 [255290.178134] [] schedule+0x29/0x70 [255290.183789] [] worker_thread+0x1d9/0x3c0 [255290.190115] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255290.197497] [] kthread+0xd1/0xe0 [255290.203047] [] ? insert_kthread_work+0x40/0x40 [255290.209974] [] ret_from_fork_nospec_begin+0x21/0x21 [255290.217370] [] ? insert_kthread_work+0x40/0x40 [255290.224274] kworker/18:1 S ffff9c7deca2d230 0 239 2 0x00000000 [255290.232331] Call Trace: [255290.235165] [] ? process_one_work+0x21a/0x440 [255290.241984] [] schedule+0x29/0x70 [255290.247629] [] worker_thread+0x1d9/0x3c0 [255290.253953] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255290.261343] [] kthread+0xd1/0xe0 [255290.266889] [] ? insert_kthread_work+0x40/0x40 [255290.273792] [] ret_from_fork_nospec_begin+0x21/0x21 [255290.281194] [] ? insert_kthread_work+0x40/0x40 [255290.288098] kworker/19:1 S ffff9c7deca2b150 0 241 2 0x00000000 [255290.296103] Call Trace: [255290.298935] [] ? process_one_work+0x21a/0x440 [255290.305741] [] schedule+0x29/0x70 [255290.311399] [] worker_thread+0x1d9/0x3c0 [255290.317731] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255290.325120] [] kthread+0xd1/0xe0 [255290.330668] [] ? insert_kthread_work+0x40/0x40 [255290.337575] [] ret_from_fork_nospec_begin+0x21/0x21 [255290.344977] [] ? insert_kthread_work+0x40/0x40 [255290.351884] kworker/21:1 S ffff9c7deca2a0e0 0 242 2 0x00000000 [255290.359878] Call Trace: [255290.362724] [] ? process_one_work+0x21a/0x440 [255290.369543] [] schedule+0x29/0x70 [255290.375187] [] worker_thread+0x1d9/0x3c0 [255290.381517] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255290.388905] [] kthread+0xd1/0xe0 [255290.394453] [] ? insert_kthread_work+0x40/0x40 [255290.401387] [] ret_from_fork_nospec_begin+0x21/0x21 [255290.408776] [] ? insert_kthread_work+0x40/0x40 [255290.415678] kworker/23:1 S ffff9c7deca50000 0 243 2 0x00000000 [255290.423694] Call Trace: [255290.426526] [] ? process_one_work+0x21a/0x440 [255290.433332] [] schedule+0x29/0x70 [255290.438975] [] worker_thread+0x1d9/0x3c0 [255290.445298] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255290.452693] [] kthread+0xd1/0xe0 [255290.458242] [] ? insert_kthread_work+0x40/0x40 [255290.465147] [] ret_from_fork_nospec_begin+0x21/0x21 [255290.472536] [] ? insert_kthread_work+0x40/0x40 [255290.479441] kworker/22:1 S ffff9c7deca51070 0 244 2 0x00000000 [255290.487431] Call Trace: [255290.490264] [] ? process_one_work+0x21a/0x440 [255290.497091] [] schedule+0x29/0x70 [255290.502736] [] worker_thread+0x1d9/0x3c0 [255290.509058] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255290.516445] [] kthread+0xd1/0xe0 [255290.521999] [] ? insert_kthread_work+0x40/0x40 [255290.528924] [] ret_from_fork_nospec_begin+0x21/0x21 [255290.536306] [] ? insert_kthread_work+0x40/0x40 [255290.543209] kworker/24:1 S ffff9c81ec4c62a0 0 245 2 0x00000000 [255290.551223] Call Trace: [255290.554058] [] ? process_one_work+0x21a/0x440 [255290.560886] [] schedule+0x29/0x70 [255290.566538] [] worker_thread+0x1d9/0x3c0 [255290.572863] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255290.580250] [] kthread+0xd1/0xe0 [255290.585799] [] ? insert_kthread_work+0x40/0x40 [255290.592704] [] ret_from_fork_nospec_begin+0x21/0x21 [255290.600094] [] ? insert_kthread_work+0x40/0x40 [255290.607012] kworker/28:1 S ffff9c81ec4c5230 0 246 2 0x00000000 [255290.615019] Call Trace: [255290.617851] [] ? process_one_work+0x21a/0x440 [255290.624658] [] schedule+0x29/0x70 [255290.630316] [] worker_thread+0x1d9/0x3c0 [255290.636652] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255290.644040] [] kthread+0xd1/0xe0 [255290.649597] [] ? insert_kthread_work+0x40/0x40 [255290.656499] [] ret_from_fork_nospec_begin+0x21/0x21 [255290.663887] [] ? insert_kthread_work+0x40/0x40 [255290.670790] kworker/26:1 S ffff9c81ec4c41c0 0 247 2 0x00000000 [255290.678788] Call Trace: [255290.681623] [] ? process_one_work+0x21a/0x440 [255290.688450] [] schedule+0x29/0x70 [255290.694094] [] worker_thread+0x1d9/0x3c0 [255290.700419] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255290.707852] [] kthread+0xd1/0xe0 [255290.713399] [] ? insert_kthread_work+0x40/0x40 [255290.720316] [] ret_from_fork_nospec_begin+0x21/0x21 [255290.727697] [] ? insert_kthread_work+0x40/0x40 [255290.734601] kworker/29:1 S ffff9c81ec4e8000 0 248 2 0x00000000 [255290.742611] Call Trace: [255290.745466] [] ? process_one_work+0x21a/0x440 [255290.752287] [] schedule+0x29/0x70 [255290.757931] [] worker_thread+0x1d9/0x3c0 [255290.764267] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255290.771657] [] kthread+0xd1/0xe0 [255290.777204] [] ? insert_kthread_work+0x40/0x40 [255290.784109] [] ret_from_fork_nospec_begin+0x21/0x21 [255290.791502] [] ? insert_kthread_work+0x40/0x40 [255290.798415] kworker/27:1 S ffff9c81ec4e9070 0 249 2 0x00000000 [255290.806424] Call Trace: [255290.809254] [] ? process_one_work+0x21a/0x440 [255290.816072] [] schedule+0x29/0x70 [255290.821716] [] worker_thread+0x1d9/0x3c0 [255290.828041] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255290.835430] [] kthread+0xd1/0xe0 [255290.840982] [] ? insert_kthread_work+0x40/0x40 [255290.847885] [] ret_from_fork_nospec_begin+0x21/0x21 [255290.855274] [] ? insert_kthread_work+0x40/0x40 [255290.862186] kworker/30:1 S ffff9c81ec4ea0e0 0 250 2 0x00000000 [255290.870195] Call Trace: [255290.873033] [] ? process_one_work+0x21a/0x440 [255290.879841] [] schedule+0x29/0x70 [255290.885487] [] worker_thread+0x1d9/0x3c0 [255290.891811] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255290.899211] [] kthread+0xd1/0xe0 [255290.904760] [] ? insert_kthread_work+0x40/0x40 [255290.911664] [] ret_from_fork_nospec_begin+0x21/0x21 [255290.919053] [] ? insert_kthread_work+0x40/0x40 [255290.925957] kworker/31:1 S ffff9c81ec4eb150 0 251 2 0x00000000 [255290.933972] Call Trace: [255290.936807] [] ? process_one_work+0x21a/0x440 [255290.943613] [] schedule+0x29/0x70 [255290.949257] [] worker_thread+0x1d9/0x3c0 [255290.955582] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255290.962970] [] kthread+0xd1/0xe0 [255290.968519] [] ? insert_kthread_work+0x40/0x40 [255290.975431] [] ret_from_fork_nospec_begin+0x21/0x21 [255290.982820] [] ? insert_kthread_work+0x40/0x40 [255290.989724] kworker/25:1 S ffff9c81ec4ec1c0 0 252 2 0x00000000 [255290.997729] Call Trace: [255291.000564] [] ? process_one_work+0x21a/0x440 [255291.007373] [] schedule+0x29/0x70 [255291.013019] [] worker_thread+0x1d9/0x3c0 [255291.019344] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255291.026743] [] kthread+0xd1/0xe0 [255291.032289] [] ? insert_kthread_work+0x40/0x40 [255291.039192] [] ret_from_fork_nospec_begin+0x21/0x21 [255291.046591] [] ? insert_kthread_work+0x40/0x40 [255291.053494] kworker/11:1 S ffff9c81ec500000 0 254 2 0x00000000 [255291.061495] Call Trace: [255291.064333] [] ? process_one_work+0x21a/0x440 [255291.071149] [] schedule+0x29/0x70 [255291.076806] [] worker_thread+0x1d9/0x3c0 [255291.083121] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255291.090525] [] kthread+0xd1/0xe0 [255291.096072] [] ? insert_kthread_work+0x40/0x40 [255291.102989] [] ret_from_fork_nospec_begin+0x21/0x21 [255291.110368] [] ? insert_kthread_work+0x40/0x40 [255291.117281] kauditd S ffff9c81ec501070 0 318 2 0x00000000 [255291.125285] Call Trace: [255291.128109] [] ? task_rq_unlock+0x20/0x20 [255291.134531] [] schedule+0x29/0x70 [255291.140200] [] kauditd_thread+0x184/0x1e0 [255291.146628] [] ? wake_up_state+0x20/0x20 [255291.152956] [] ? audit_printk_skb+0x70/0x70 [255291.159571] [] kthread+0xd1/0xe0 [255291.165132] [] ? insert_kthread_work+0x40/0x40 [255291.172036] [] ret_from_fork_nospec_begin+0x21/0x21 [255291.179430] [] ? insert_kthread_work+0x40/0x40 [255291.186339] ata_sff S ffff9c81ee55ac80 0 903 2 0x00000000 [255291.194361] Call Trace: [255291.197193] [] schedule+0x29/0x70 [255291.202838] [] rescuer_thread+0x31e/0x3c0 [255291.209271] [] ? process_one_work+0x440/0x440 [255291.216077] [] kthread+0xd1/0xe0 [255291.221636] [] ? insert_kthread_work+0x40/0x40 [255291.228539] [] ret_from_fork_nospec_begin+0x21/0x21 [255291.235930] [] ? insert_kthread_work+0x40/0x40 [255291.242845] scsi_eh_0 S ffff9c81ee5dac80 0 1005 2 0x00000000 [255291.250843] Call Trace: [255291.253667] [] schedule+0x29/0x70 [255291.259315] [] scsi_error_handler+0xa3/0x8b0 [255291.266035] [] ? scsi_eh_get_sense+0x250/0x250 [255291.272968] [] kthread+0xd1/0xe0 [255291.278516] [] ? insert_kthread_work+0x40/0x40 [255291.285419] [] ret_from_fork_nospec_begin+0x21/0x21 [255291.292820] [] ? insert_kthread_work+0x40/0x40 [255291.299723] scsi_tmf_0 S ffff9c81ee5dac80 0 1006 2 0x00000000 [255291.307725] Call Trace: [255291.310558] [] schedule+0x29/0x70 [255291.316202] [] rescuer_thread+0x31e/0x3c0 [255291.322625] [] ? process_one_work+0x440/0x440 [255291.329433] [] kthread+0xd1/0xe0 [255291.334979] [] ? insert_kthread_work+0x40/0x40 [255291.341908] [] ret_from_fork_nospec_begin+0x21/0x21 [255291.349301] [] ? insert_kthread_work+0x40/0x40 [255291.356226] scsi_eh_1 S ffff9c7deec5ac80 0 1010 2 0x00000000 [255291.364224] Call Trace: [255291.367057] [] ? __scsi_iterate_devices+0x75/0x90 [255291.374273] [] schedule+0x29/0x70 [255291.379926] [] scsi_error_handler+0xa3/0x8b0 [255291.386638] [] ? scsi_eh_get_sense+0x250/0x250 [255291.393556] [] kthread+0xd1/0xe0 [255291.399115] [] ? insert_kthread_work+0x40/0x40 [255291.406018] [] ret_from_fork_nospec_begin+0x21/0x21 [255291.413412] [] ? insert_kthread_work+0x40/0x40 [255291.420315] scsi_tmf_1 S ffff9c81ee5dac80 0 1011 2 0x00000000 [255291.428351] Call Trace: [255291.431183] [] schedule+0x29/0x70 [255291.436829] [] rescuer_thread+0x31e/0x3c0 [255291.443250] [] ? process_one_work+0x440/0x440 [255291.450070] [] kthread+0xd1/0xe0 [255291.455624] [] ? insert_kthread_work+0x40/0x40 [255291.462538] [] ret_from_fork_nospec_begin+0x21/0x21 [255291.469926] [] ? insert_kthread_work+0x40/0x40 [255291.476830] mlx4 S ffff9c81ee5dac80 0 1012 2 0x00000000 [255291.484835] Call Trace: [255291.487666] [] schedule+0x29/0x70 [255291.493322] [] rescuer_thread+0x31e/0x3c0 [255291.499748] [] ? process_one_work+0x440/0x440 [255291.506555] [] kthread+0xd1/0xe0 [255291.512102] [] ? insert_kthread_work+0x40/0x40 [255291.519005] [] ret_from_fork_nospec_begin+0x21/0x21 [255291.526402] [] ? insert_kthread_work+0x40/0x40 [255291.533309] scsi_wq_1 S ffff9c81ee5dac80 0 1013 2 0x00000000 [255291.541327] Call Trace: [255291.544159] [] schedule+0x29/0x70 [255291.549803] [] rescuer_thread+0x31e/0x3c0 [255291.556221] [] ? process_one_work+0x440/0x440 [255291.563029] [] kthread+0xd1/0xe0 [255291.568578] [] ? insert_kthread_work+0x40/0x40 [255291.575483] [] ret_from_fork_nospec_begin+0x21/0x21 [255291.582885] [] ? insert_kthread_work+0x40/0x40 [255291.589779] mlx4_health S ffff9c81ee5dac80 0 1014 2 0x00000000 [255291.597795] Call Trace: [255291.600631] [] schedule+0x29/0x70 [255291.606279] [] rescuer_thread+0x31e/0x3c0 [255291.612697] [] ? process_one_work+0x440/0x440 [255291.619512] [] kthread+0xd1/0xe0 [255291.625069] [] ? insert_kthread_work+0x40/0x40 [255291.631982] [] ret_from_fork_nospec_begin+0x21/0x21 [255291.639371] [] ? insert_kthread_work+0x40/0x40 [255291.646284] scsi_eh_2 S ffff9c81e8a2c1c0 0 1015 2 0x00000000 [255291.654306] Call Trace: [255291.657161] [] ? __scsi_iterate_devices+0x68/0x90 [255291.664365] [] schedule+0x29/0x70 [255291.670011] [] scsi_error_handler+0xa3/0x8b0 [255291.676724] [] ? scsi_eh_get_sense+0x250/0x250 [255291.683641] [] kthread+0xd1/0xe0 [255291.689179] [] ? insert_kthread_work+0x40/0x40 [255291.696106] [] ret_from_fork_nospec_begin+0x21/0x21 [255291.703509] [] ? insert_kthread_work+0x40/0x40 [255291.710413] scsi_tmf_2 S ffff9c81ee5dac80 0 1016 2 0x00000000 [255291.718414] Call Trace: [255291.721250] [] schedule+0x29/0x70 [255291.726894] [] rescuer_thread+0x31e/0x3c0 [255291.733322] [] ? process_one_work+0x440/0x440 [255291.740135] [] kthread+0xd1/0xe0 [255291.745695] [] ? insert_kthread_work+0x40/0x40 [255291.752590] [] ret_from_fork_nospec_begin+0x21/0x21 [255291.759983] [] ? insert_kthread_work+0x40/0x40 [255291.766887] scsi_eh_3 S ffff9c81e8a28000 0 1017 2 0x00000000 [255291.774909] Call Trace: [255291.777739] [] ? __scsi_iterate_devices+0x68/0x90 [255291.784950] [] schedule+0x29/0x70 [255291.790593] [] scsi_error_handler+0xa3/0x8b0 [255291.797311] [] ? scsi_eh_get_sense+0x250/0x250 [255291.804228] [] kthread+0xd1/0xe0 [255291.809778] [] ? insert_kthread_work+0x40/0x40 [255291.816693] [] ret_from_fork_nospec_begin+0x21/0x21 [255291.824082] [] ? insert_kthread_work+0x40/0x40 [255291.830984] scsi_tmf_3 S ffff9c81ee5dac80 0 1018 2 0x00000000 [255291.838984] Call Trace: [255291.841816] [] schedule+0x29/0x70 [255291.847459] [] rescuer_thread+0x31e/0x3c0 [255291.853880] [] ? process_one_work+0x440/0x440 [255291.860686] [] kthread+0xd1/0xe0 [255291.866232] [] ? insert_kthread_work+0x40/0x40 [255291.873138] [] ret_from_fork_nospec_begin+0x21/0x21 [255291.880527] [] ? insert_kthread_work+0x40/0x40 [255291.887432] scsi_eh_4 S ffff9c81e8a29070 0 1019 2 0x00000000 [255291.895461] Call Trace: [255291.898304] [] ? __scsi_iterate_devices+0x68/0x90 [255291.905500] [] schedule+0x29/0x70 [255291.911153] [] scsi_error_handler+0xa3/0x8b0 [255291.917867] [] ? scsi_eh_get_sense+0x250/0x250 [255291.924771] [] kthread+0xd1/0xe0 [255291.930318] [] ? insert_kthread_work+0x40/0x40 [255291.937222] [] ret_from_fork_nospec_begin+0x21/0x21 [255291.944611] [] ? insert_kthread_work+0x40/0x40 [255291.951523] scsi_tmf_4 S ffff9c81ee5dac80 0 1020 2 0x00000000 [255291.959549] Call Trace: [255291.962381] [] schedule+0x29/0x70 [255291.968026] [] rescuer_thread+0x31e/0x3c0 [255291.974446] [] ? process_one_work+0x440/0x440 [255291.981254] [] kthread+0xd1/0xe0 [255291.986802] [] ? insert_kthread_work+0x40/0x40 [255291.993725] [] ret_from_fork_nospec_begin+0x21/0x21 [255292.001127] [] ? insert_kthread_work+0x40/0x40 [255292.008031] scsi_eh_5 S ffff9c81ec5141c0 0 1021 2 0x00000000 [255292.016030] Call Trace: [255292.018862] [] ? __scsi_iterate_devices+0x68/0x90 [255292.026059] [] schedule+0x29/0x70 [255292.031701] [] scsi_error_handler+0xa3/0x8b0 [255292.038423] [] ? scsi_eh_get_sense+0x250/0x250 [255292.045328] [] kthread+0xd1/0xe0 [255292.050875] [] ? insert_kthread_work+0x40/0x40 [255292.057778] [] ret_from_fork_nospec_begin+0x21/0x21 [255292.065168] [] ? insert_kthread_work+0x40/0x40 [255292.072070] scsi_tmf_5 S ffff9c81ee5dac80 0 1022 2 0x00000000 [255292.080080] Call Trace: [255292.082911] [] schedule+0x29/0x70 [255292.088555] [] rescuer_thread+0x31e/0x3c0 [255292.094976] [] ? process_one_work+0x440/0x440 [255292.101796] [] kthread+0xd1/0xe0 [255292.107352] [] ? insert_kthread_work+0x40/0x40 [255292.114269] [] ret_from_fork_nospec_begin+0x21/0x21 [255292.121668] [] ? insert_kthread_work+0x40/0x40 [255292.128571] scsi_eh_6 S ffff9c81e83462a0 0 1023 2 0x00000000 [255292.136582] Call Trace: [255292.139414] [] ? __scsi_iterate_devices+0x68/0x90 [255292.146609] [] schedule+0x29/0x70 [255292.152255] [] scsi_error_handler+0xa3/0x8b0 [255292.158967] [] ? scsi_eh_get_sense+0x250/0x250 [255292.165883] [] kthread+0xd1/0xe0 [255292.171431] [] ? insert_kthread_work+0x40/0x40 [255292.178355] [] ret_from_fork_nospec_begin+0x21/0x21 [255292.185755] [] ? insert_kthread_work+0x40/0x40 [255292.192678] scsi_tmf_6 S ffff9c81ee5dac80 0 1024 2 0x00000000 [255292.200669] Call Trace: [255292.203503] [] schedule+0x29/0x70 [255292.209166] [] rescuer_thread+0x31e/0x3c0 [255292.215586] [] ? process_one_work+0x440/0x440 [255292.222403] [] kthread+0xd1/0xe0 [255292.227960] [] ? insert_kthread_work+0x40/0x40 [255292.234874] [] ret_from_fork_nospec_begin+0x21/0x21 [255292.242266] [] ? insert_kthread_work+0x40/0x40 [255292.249167] scsi_eh_7 S ffff9c81e83441c0 0 1025 2 0x00000000 [255292.257157] Call Trace: [255292.259989] [] ? __scsi_iterate_devices+0x68/0x90 [255292.267183] [] schedule+0x29/0x70 [255292.272843] [] scsi_error_handler+0xa3/0x8b0 [255292.279556] [] ? scsi_eh_get_sense+0x250/0x250 [255292.286473] [] kthread+0xd1/0xe0 [255292.292010] [] ? insert_kthread_work+0x40/0x40 [255292.298913] [] ret_from_fork_nospec_begin+0x21/0x21 [255292.306305] [] ? insert_kthread_work+0x40/0x40 [255292.313209] scsi_tmf_7 S ffff9c81ee5dac80 0 1026 2 0x00000000 [255292.321230] Call Trace: [255292.324062] [] schedule+0x29/0x70 [255292.329706] [] rescuer_thread+0x31e/0x3c0 [255292.336140] [] ? process_one_work+0x440/0x440 [255292.342952] [] kthread+0xd1/0xe0 [255292.348490] [] ? insert_kthread_work+0x40/0x40 [255292.355396] [] ret_from_fork_nospec_begin+0x21/0x21 [255292.362786] [] ? insert_kthread_work+0x40/0x40 [255292.369695] ttm_swap S ffff9c81ee5dac80 0 1033 2 0x00000000 [255292.377689] Call Trace: [255292.380520] [] schedule+0x29/0x70 [255292.386175] [] rescuer_thread+0x31e/0x3c0 [255292.392594] [] ? process_one_work+0x440/0x440 [255292.399402] [] kthread+0xd1/0xe0 [255292.404949] [] ? insert_kthread_work+0x40/0x40 [255292.411865] [] ret_from_fork_nospec_begin+0x21/0x21 [255292.419256] [] ? insert_kthread_work+0x40/0x40 [255292.426160] kworker/0:1H S ffff9c7dec793150 0 1048 2 0x00000000 [255292.434176] Call Trace: [255292.437022] [] ? process_one_work+0x21a/0x440 [255292.443831] [] schedule+0x29/0x70 [255292.449476] [] worker_thread+0x1d9/0x3c0 [255292.455800] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255292.463195] [] kthread+0xd1/0xe0 [255292.468741] [] ? insert_kthread_work+0x40/0x40 [255292.475657] [] ret_from_fork_nospec_begin+0x21/0x21 [255292.483046] [] ? insert_kthread_work+0x40/0x40 [255292.489962] kworker/16:1H S ffff9c7deca90000 0 1049 2 0x00000000 [255292.497964] Call Trace: [255292.500811] [] ? process_one_work+0x21a/0x440 [255292.507618] [] schedule+0x29/0x70 [255292.513280] [] worker_thread+0x1d9/0x3c0 [255292.519603] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255292.526993] [] kthread+0xd1/0xe0 [255292.532545] [] ? insert_kthread_work+0x40/0x40 [255292.539451] [] ret_from_fork_nospec_begin+0x21/0x21 [255292.546845] [] ? insert_kthread_work+0x40/0x40 [255292.553769] kworker/1:1H S ffff9c7deca91070 0 1050 2 0x00000000 [255292.561781] Call Trace: [255292.564627] [] ? process_one_work+0x21a/0x440 [255292.571436] [] schedule+0x29/0x70 [255292.577080] [] worker_thread+0x1d9/0x3c0 [255292.583403] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255292.590793] [] kthread+0xd1/0xe0 [255292.596353] [] ? insert_kthread_work+0x40/0x40 [255292.603264] [] ret_from_fork_nospec_begin+0x21/0x21 [255292.610654] [] ? insert_kthread_work+0x40/0x40 [255292.617557] ib-comp-wq S ffff9c7deec5ac80 0 1053 2 0x00000000 [255292.625580] Call Trace: [255292.628414] [] schedule+0x29/0x70 [255292.634059] [] rescuer_thread+0x31e/0x3c0 [255292.640481] [] ? process_one_work+0x440/0x440 [255292.647289] [] kthread+0xd1/0xe0 [255292.652849] [] ? insert_kthread_work+0x40/0x40 [255292.659753] [] ret_from_fork_nospec_begin+0x21/0x21 [255292.667156] [] ? insert_kthread_work+0x40/0x40 [255292.674061] kworker/u307:0 S ffff9c7deeb5ac80 0 1054 2 0x00000000 [255292.682054] Call Trace: [255292.684886] [] schedule+0x29/0x70 [255292.690543] [] worker_thread+0x1d9/0x3c0 [255292.696858] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255292.704251] [] kthread+0xd1/0xe0 [255292.709801] [] ? insert_kthread_work+0x40/0x40 [255292.716703] [] ret_from_fork_nospec_begin+0x21/0x21 [255292.724091] [] ? insert_kthread_work+0x40/0x40 [255292.730996] kworker/u308:0 S ffff9c7deca95230 0 1055 2 0x00000000 [255292.739017] Call Trace: [255292.741898] [] ? ib_cq_poll_work+0x45/0x60 [ib_core] [255292.749396] [] ? process_one_work+0x21a/0x440 [255292.756232] [] schedule+0x29/0x70 [255292.761876] [] worker_thread+0x1d9/0x3c0 [255292.768202] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255292.775606] [] kthread+0xd1/0xe0 [255292.781152] [] ? insert_kthread_work+0x40/0x40 [255292.788073] [] ret_from_fork_nospec_begin+0x21/0x21 [255292.795476] [] ? insert_kthread_work+0x40/0x40 [255292.802386] kworker/u309:0 S ffff9c81ee21ac80 0 1056 2 0x00000000 [255292.810391] Call Trace: [255292.813236] [] schedule+0x29/0x70 [255292.818894] [] worker_thread+0x1d9/0x3c0 [255292.825225] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255292.832638] [] kthread+0xd1/0xe0 [255292.838183] [] ? insert_kthread_work+0x40/0x40 [255292.845085] [] ret_from_fork_nospec_begin+0x21/0x21 [255292.852474] [] ? insert_kthread_work+0x40/0x40 [255292.859378] ib-comp-unb-wq S ffff9c7deec5ac80 0 1057 2 0x00000000 [255292.867359] Call Trace: [255292.870191] [] schedule+0x29/0x70 [255292.875841] [] rescuer_thread+0x31e/0x3c0 [255292.882280] [] ? process_one_work+0x440/0x440 [255292.889086] [] kthread+0xd1/0xe0 [255292.894647] [] ? insert_kthread_work+0x40/0x40 [255292.901572] [] ret_from_fork_nospec_begin+0x21/0x21 [255292.908966] [] ? insert_kthread_work+0x40/0x40 [255292.915869] ib_mcast S ffff9c7deec5ac80 0 1058 2 0x00000000 [255292.923885] Call Trace: [255292.926717] [] schedule+0x29/0x70 [255292.932362] [] rescuer_thread+0x31e/0x3c0 [255292.938784] [] ? process_one_work+0x440/0x440 [255292.945593] [] kthread+0xd1/0xe0 [255292.951152] [] ? insert_kthread_work+0x40/0x40 [255292.958049] [] ret_from_fork_nospec_begin+0x21/0x21 [255292.965449] [] ? insert_kthread_work+0x40/0x40 [255292.972354] ib_nl_sa_wq S ffff9c7deec5ac80 0 1059 2 0x00000000 [255292.980356] Call Trace: [255292.983189] [] schedule+0x29/0x70 [255292.988834] [] rescuer_thread+0x31e/0x3c0 [255292.995256] [] ? process_one_work+0x440/0x440 [255293.002063] [] kthread+0xd1/0xe0 [255293.007609] [] ? insert_kthread_work+0x40/0x40 [255293.014518] [] ret_from_fork_nospec_begin+0x21/0x21 [255293.021907] [] ? insert_kthread_work+0x40/0x40 [255293.028825] mlx4_ib S ffff9c7deec5ac80 0 1060 2 0x00000000 [255293.036850] Call Trace: [255293.039689] [] schedule+0x29/0x70 [255293.045335] [] rescuer_thread+0x31e/0x3c0 [255293.051756] [] ? process_one_work+0x440/0x440 [255293.058576] [] kthread+0xd1/0xe0 [255293.064122] [] ? insert_kthread_work+0x40/0x40 [255293.071026] [] ret_from_fork_nospec_begin+0x21/0x21 [255293.078417] [] ? insert_kthread_work+0x40/0x40 [255293.085321] mlx4_ib_mcg S ffff9c7deec5ac80 0 1061 2 0x00000000 [255293.093321] Call Trace: [255293.096153] [] schedule+0x29/0x70 [255293.101796] [] rescuer_thread+0x31e/0x3c0 [255293.108219] [] ? process_one_work+0x440/0x440 [255293.115025] [] kthread+0xd1/0xe0 [255293.120572] [] ? insert_kthread_work+0x40/0x40 [255293.127479] [] ret_from_fork_nospec_begin+0x21/0x21 [255293.134875] [] ? insert_kthread_work+0x40/0x40 [255293.141778] ib_mad1 S ffff9c7deec5ac80 0 1068 2 0x00000000 [255293.149779] Call Trace: [255293.152632] [] schedule+0x29/0x70 [255293.158275] [] rescuer_thread+0x31e/0x3c0 [255293.164696] [] ? process_one_work+0x440/0x440 [255293.171502] [] kthread+0xd1/0xe0 [255293.177048] [] ? insert_kthread_work+0x40/0x40 [255293.183952] [] ret_from_fork_nospec_begin+0x21/0x21 [255293.191341] [] ? insert_kthread_work+0x40/0x40 [255293.198244] to_fifo S ffff9c7deec5ac80 0 1069 2 0x00000000 [255293.206246] Call Trace: [255293.209077] [] schedule+0x29/0x70 [255293.214721] [] rescuer_thread+0x31e/0x3c0 [255293.221142] [] ? process_one_work+0x440/0x440 [255293.227948] [] kthread+0xd1/0xe0 [255293.233508] [] ? insert_kthread_work+0x40/0x40 [255293.240411] [] ret_from_fork_nospec_begin+0x21/0x21 [255293.247800] [] ? insert_kthread_work+0x40/0x40 [255293.254738] ib_mad2 S ffff9c81ee5dac80 0 1070 2 0x00000000 [255293.262751] Call Trace: [255293.265596] [] schedule+0x29/0x70 [255293.271261] [] rescuer_thread+0x31e/0x3c0 [255293.277686] [] ? process_one_work+0x440/0x440 [255293.284494] [] kthread+0xd1/0xe0 [255293.290040] [] ? insert_kthread_work+0x40/0x40 [255293.296945] [] ret_from_fork_nospec_begin+0x21/0x21 [255293.304334] [] ? insert_kthread_work+0x40/0x40 [255293.311237] to_fifo S ffff9c81ee5dac80 0 1071 2 0x00000000 [255293.319263] Call Trace: [255293.322095] [] schedule+0x29/0x70 [255293.327739] [] rescuer_thread+0x31e/0x3c0 [255293.334159] [] ? process_one_work+0x440/0x440 [255293.340965] [] kthread+0xd1/0xe0 [255293.346512] [] ? insert_kthread_work+0x40/0x40 [255293.353417] [] ret_from_fork_nospec_begin+0x21/0x21 [255293.360808] [] ? insert_kthread_work+0x40/0x40 [255293.367729] poll_mpt3sas0_s S ffff9c7deec5ac80 0 1077 2 0x00000000 [255293.375727] Call Trace: [255293.378559] [] schedule+0x29/0x70 [255293.384209] [] rescuer_thread+0x31e/0x3c0 [255293.390629] [] ? process_one_work+0x440/0x440 [255293.397436] [] kthread+0xd1/0xe0 [255293.402983] [] ? insert_kthread_work+0x40/0x40 [255293.409886] [] ret_from_fork_nospec_begin+0x21/0x21 [255293.417289] [] ? insert_kthread_work+0x40/0x40 [255293.424195] jbd2/sda1-8 S ffff9c81eb31e2a0 0 1116 2 0x00000000 [255293.432211] Call Trace: [255293.435048] [] ? task_rq_unlock+0x20/0x20 [255293.441467] [] schedule+0x29/0x70 [255293.447119] [] kjournald2+0x203/0x260 [jbd2] [255293.453830] [] ? wake_up_atomic_t+0x30/0x30 [255293.460461] [] ? commit_timeout+0x10/0x10 [jbd2] [255293.467558] [] kthread+0xd1/0xe0 [255293.473104] [] ? insert_kthread_work+0x40/0x40 [255293.480009] [] ret_from_fork_nospec_begin+0x21/0x21 [255293.487412] [] ? insert_kthread_work+0x40/0x40 [255293.494328] ext4-rsv-conver S ffff9c7deec5ac80 0 1117 2 0x00000000 [255293.502334] Call Trace: [255293.505189] [] schedule+0x29/0x70 [255293.510838] [] rescuer_thread+0x31e/0x3c0 [255293.517268] [] ? process_one_work+0x440/0x440 [255293.524075] [] kthread+0xd1/0xe0 [255293.529633] [] ? insert_kthread_work+0x40/0x40 [255293.536538] [] ret_from_fork_nospec_begin+0x21/0x21 [255293.543929] [] ? insert_kthread_work+0x40/0x40 [255293.550839] kworker/8:1H S ffff9c81cce7c1c0 0 1184 2 0x00000000 [255293.558857] Call Trace: [255293.561688] [] ? process_one_work+0x21a/0x440 [255293.568495] [] schedule+0x29/0x70 [255293.574143] [] worker_thread+0x1d9/0x3c0 [255293.580467] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255293.587869] [] kthread+0xd1/0xe0 [255293.593421] [] ? insert_kthread_work+0x40/0x40 [255293.600326] [] ret_from_fork_nospec_begin+0x21/0x21 [255293.607716] [] ? insert_kthread_work+0x40/0x40 [255293.614618] kworker/3:1H S ffff9c7de8bbe2a0 0 1200 2 0x00000000 [255293.622631] Call Trace: [255293.625463] [] ? process_one_work+0x21a/0x440 [255293.632270] [] schedule+0x29/0x70 [255293.637915] [] worker_thread+0x1d9/0x3c0 [255293.644238] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255293.651639] [] kthread+0xd1/0xe0 [255293.657191] [] ? insert_kthread_work+0x40/0x40 [255293.664094] [] ret_from_fork_nospec_begin+0x21/0x21 [255293.671482] [] ? insert_kthread_work+0x40/0x40 [255293.678386] kworker/2:1H S ffff9c7de8bbd230 0 1202 2 0x00000000 [255293.686386] Call Trace: [255293.689233] [] ? process_one_work+0x21a/0x440 [255293.696053] [] schedule+0x29/0x70 [255293.701709] [] worker_thread+0x1d9/0x3c0 [255293.708032] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255293.715425] [] kthread+0xd1/0xe0 [255293.720987] [] ? insert_kthread_work+0x40/0x40 [255293.727895] [] ret_from_fork_nospec_begin+0x21/0x21 [255293.735279] [] ? insert_kthread_work+0x40/0x40 [255293.742183] systemd-journal R running task 0 1203 1 0x00000000 [255293.750178] Call Trace: [255293.753010] [] schedule+0x29/0x70 [255293.758657] [] schedule_hrtimeout_range_clock+0x12d/0x150 [255293.766621] [] ? ep_scan_ready_list.isra.7+0x1b9/0x1f0 [255293.774299] [] schedule_hrtimeout_range+0x13/0x20 [255293.781506] [] ep_poll+0x23e/0x360 [255293.787260] [] ? do_truncate+0x88/0xc0 [255293.793395] [] ? __sb_start_write+0x58/0x120 [255293.800106] [] ? wake_up_state+0x20/0x20 [255293.806433] [] SyS_epoll_wait+0xed/0x120 [255293.812763] [] ? system_call_after_swapgs+0xa2/0x146 [255293.820251] [] system_call_fastpath+0x25/0x2a [255293.827073] [] ? system_call_after_swapgs+0xae/0x146 [255293.834558] rpciod S ffff9c7deec5ac80 0 1217 2 0x00000000 [255293.842568] Call Trace: [255293.845401] [] schedule+0x29/0x70 [255293.851046] [] rescuer_thread+0x31e/0x3c0 [255293.857467] [] ? process_one_work+0x440/0x440 [255293.864286] [] kthread+0xd1/0xe0 [255293.869834] [] ? insert_kthread_work+0x40/0x40 [255293.876744] [] ret_from_fork_nospec_begin+0x21/0x21 [255293.884146] [] ? insert_kthread_work+0x40/0x40 [255293.891042] xprtiod S ffff9c7deec5ac80 0 1218 2 0x00000000 [255293.899081] Call Trace: [255293.901913] [] schedule+0x29/0x70 [255293.907559] [] rescuer_thread+0x31e/0x3c0 [255293.913979] [] ? process_one_work+0x440/0x440 [255293.920785] [] kthread+0xd1/0xe0 [255293.926335] [] ? insert_kthread_work+0x40/0x40 [255293.933230] [] ret_from_fork_nospec_begin+0x21/0x21 [255293.940625] [] ? insert_kthread_work+0x40/0x40 [255293.947527] lvmetad S ffff9c81ee31ac80 0 1230 1 0x00000000 [255293.955530] Call Trace: [255293.958374] [] schedule+0x29/0x70 [255293.964018] [] schedule_hrtimeout_range_clock+0x12d/0x150 [255293.971991] [] ? add_wait_queue+0x3c/0x50 [255293.978429] [] ? __pollwait+0x7f/0xf0 [255293.984473] [] ? list_del+0xd/0x30 [255293.990223] [] schedule_hrtimeout_range+0x13/0x20 [255293.997419] [] poll_schedule_timeout+0x55/0xc0 [255294.004335] [] do_select+0x6d1/0x7c0 [255294.010284] [] ? __pollwait+0xf0/0xf0 [255294.016330] [] ? list_del+0xd/0x30 [255294.022083] [] ? __rmqueue+0x8a/0x460 [255294.028115] [] ? zone_statistics+0x88/0xa0 [255294.034634] [] core_sys_select+0x1ff/0x340 [255294.041161] [] ? enqueue_entity+0x2ef/0xbe0 [255294.047774] [] ? cpumask_next_and+0x35/0x50 [255294.054388] [] ? enqueue_task_fair+0x208/0x6c0 [255294.061293] [] ? sched_clock_cpu+0x85/0xc0 [255294.067811] [] ? recalc_sigpending+0x1b/0x70 [255294.074533] [] ? __set_task_blocked+0x41/0xa0 [255294.081341] [] ? __set_current_blocked+0x42/0x70 [255294.088441] [] SyS_pselect6+0x153/0x260 [255294.094687] [] ? system_call_after_swapgs+0xa2/0x146 [255294.102171] [] ? system_call_after_swapgs+0xae/0x146 [255294.109676] [] ? system_call_after_swapgs+0xa2/0x146 [255294.117162] [] ? system_call_after_swapgs+0xae/0x146 [255294.124649] [] system_call_fastpath+0x25/0x2a [255294.131458] [] ? system_call_after_swapgs+0xae/0x146 [255294.138943] kworker/5:1H S ffff9c7de8bba0e0 0 1240 2 0x00000000 [255294.146976] Call Trace: [255294.149810] [] ? process_one_work+0x21a/0x440 [255294.156617] [] schedule+0x29/0x70 [255294.162261] [] worker_thread+0x1d9/0x3c0 [255294.168582] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255294.176000] [] kthread+0xd1/0xe0 [255294.181548] [] ? insert_kthread_work+0x40/0x40 [255294.188452] [] ret_from_fork_nospec_begin+0x21/0x21 [255294.195855] [] ? insert_kthread_work+0x40/0x40 [255294.202758] kmpathd S ffff9c7deec5ac80 0 1248 2 0x00000000 [255294.210789] Call Trace: [255294.213612] [] schedule+0x29/0x70 [255294.219266] [] rescuer_thread+0x31e/0x3c0 [255294.225687] [] ? process_one_work+0x440/0x440 [255294.232507] [] kthread+0xd1/0xe0 [255294.238054] [] ? insert_kthread_work+0x40/0x40 [255294.244958] [] ret_from_fork_nospec_begin+0x21/0x21 [255294.252348] [] ? insert_kthread_work+0x40/0x40 [255294.259252] kmpath_handlerd S ffff9c7deec5ac80 0 1249 2 0x00000000 [255294.267259] Call Trace: [255294.270091] [] schedule+0x29/0x70 [255294.275734] [] rescuer_thread+0x31e/0x3c0 [255294.282153] [] ? process_one_work+0x440/0x440 [255294.288973] [] kthread+0xd1/0xe0 [255294.294520] [] ? insert_kthread_work+0x40/0x40 [255294.301437] [] ret_from_fork_nospec_begin+0x21/0x21 [255294.308817] [] ? insert_kthread_work+0x40/0x40 [255294.315724] multipathd S ffff9c7deca562a0 0 1258 1 0x00000000 [255294.323756] Call Trace: [255294.326580] [] schedule+0x29/0x70 [255294.332239] [] futex_wait_queue_me+0xc6/0x130 [255294.339054] [] futex_wait+0x17b/0x280 [255294.345091] [] do_futex+0x106/0x5a0 [255294.350942] [] ? mntput+0x24/0x40 [255294.356605] [] ? __fput+0x186/0x260 [255294.362453] [] SyS_futex+0x80/0x190 [255294.368295] [] ? system_call_after_swapgs+0xa2/0x146 [255294.375784] [] ? system_call_after_swapgs+0xae/0x146 [255294.383279] [] ? system_call_after_swapgs+0xa2/0x146 [255294.390771] [] ? system_call_after_swapgs+0xae/0x146 [255294.398257] [] ? system_call_after_swapgs+0xa2/0x146 [255294.405741] [] ? system_call_after_swapgs+0xae/0x146 [255294.413230] [] system_call_fastpath+0x25/0x2a [255294.420037] [] ? system_call_after_swapgs+0xae/0x146 [255294.427524] multipathd S ffff9c79f5f220e0 0 1259 1 0x00000000 [255294.435536] Call Trace: [255294.438377] [] schedule+0x29/0x70 [255294.444021] [] futex_wait_queue_me+0xc6/0x130 [255294.450828] [] futex_wait+0x17b/0x280 [255294.456861] [] do_futex+0x106/0x5a0 [255294.462726] [] SyS_futex+0x80/0x190 [255294.468575] [] ? system_call_after_swapgs+0xa2/0x146 [255294.476067] [] ? system_call_after_swapgs+0xae/0x146 [255294.483578] [] ? system_call_after_swapgs+0xa2/0x146 [255294.491066] [] ? system_call_after_swapgs+0xae/0x146 [255294.498566] [] ? system_call_after_swapgs+0xa2/0x146 [255294.506052] [] ? system_call_after_swapgs+0xae/0x146 [255294.513538] [] system_call_fastpath+0x25/0x2a [255294.520347] [] ? system_call_after_swapgs+0xae/0x146 [255294.527843] multipathd S ffff9c79f5f21070 0 1260 1 0x00000000 [255294.535877] Call Trace: [255294.538713] [] schedule+0x29/0x70 [255294.544350] [] schedule_hrtimeout_range_clock+0x12d/0x150 [255294.552322] [] ? add_wait_queue+0x3c/0x50 [255294.558740] [] ? __pollwait+0x7f/0xf0 [255294.564771] [] schedule_hrtimeout_range+0x13/0x20 [255294.571965] [] poll_schedule_timeout+0x55/0xc0 [255294.578869] [] do_sys_poll+0x48d/0x590 [255294.585013] [] ? netlink_recvmsg+0x212/0x490 [255294.591724] [] ? plist_add+0x91/0xd0 [255294.597659] [] ? enqueue_pushable_task+0x6d/0x90 [255294.604759] [] ? tracing_is_on+0x15/0x30 [255294.611104] [] ? tracing_record_cmdline+0x1d/0x120 [255294.618410] [] ? __pollwait+0xf0/0xf0 [255294.624442] [] ? try_to_wake_up+0x190/0x390 [255294.631075] [] ? wake_up_q+0x5b/0x80 [255294.637011] [] ? futex_wake_op+0x3b5/0x640 [255294.643529] [] ? do_futex+0x17a/0x5a0 [255294.649563] [] ? _raw_spin_unlock_bh+0x1e/0x20 [255294.656468] [] ? release_sock+0x120/0x170 [255294.662901] [] ? system_call_after_swapgs+0xae/0x146 [255294.670385] [] SyS_poll+0x74/0x110 [255294.676126] [] ? system_call_after_swapgs+0xa2/0x146 [255294.683614] [] ? system_call_after_swapgs+0xae/0x146 [255294.691108] [] system_call_fastpath+0x25/0x2a [255294.697915] [] ? system_call_after_swapgs+0xae/0x146 [255294.705399] multipathd S ffff9c79f5f20000 0 1261 1 0x00000000 [255294.713399] Call Trace: [255294.716234] [] ? hrtimer_start_range_ns+0x1fd/0x3c0 [255294.723629] [] schedule+0x29/0x70 [255294.729272] [] schedule_hrtimeout_range_clock+0xb2/0x150 [255294.737148] [] ? hrtimer_get_res+0x50/0x50 [255294.743663] [] ? schedule_hrtimeout_range_clock+0xa6/0x150 [255294.751729] [] schedule_hrtimeout_range+0x13/0x20 [255294.758923] [] poll_schedule_timeout+0x55/0xc0 [255294.765829] [] do_sys_poll+0x48d/0x590 [255294.771959] [] ? add_page_to_unevictable_list+0xc8/0x100 [255294.779836] [] ? page_add_new_anon_rmap+0x12d/0x170 [255294.787231] [] ? handle_pte_fault+0x6b4/0xe20 [255294.794059] [] ? alloc_pages_current+0x98/0x110 [255294.801063] [] ? __pollwait+0xf0/0xf0 [255294.807104] [] ? __enqueue_entity+0x78/0x80 [255294.813718] [] ? enqueue_entity+0x2ef/0xbe0 [255294.820343] [] ? enqueue_task_fair+0x208/0x6c0 [255294.827240] [] ? sched_clock_cpu+0x85/0xc0 [255294.833756] [] ? check_preempt_curr+0x80/0xa0 [255294.840579] [] ? ttwu_do_wakeup+0x19/0xe0 [255294.846997] [] ? ttwu_do_activate+0x6f/0x80 [255294.853610] [] ? __kmalloc+0x55/0x230 [255294.859642] [] ? recalc_sigpending+0x1b/0x70 [255294.866352] [] ? __set_task_blocked+0x41/0xa0 [255294.873172] [] SyS_ppoll+0xee/0x1f0 [255294.879009] [] system_call_fastpath+0x25/0x2a [255294.885817] [] ? system_call_after_swapgs+0xae/0x146 [255294.893304] multipathd S ffff9c79f5f241c0 0 1264 1 0x00000000 [255294.901315] Call Trace: [255294.904152] [] ? hrtimer_start_range_ns+0x1fd/0x3c0 [255294.911544] [] schedule+0x29/0x70 [255294.917180] [] do_nanosleep+0x70/0x100 [255294.923312] [] hrtimer_nanosleep+0xbb/0x180 [255294.929928] [] ? hrtimer_get_res+0x50/0x50 [255294.936445] [] ? do_nanosleep+0x5b/0x100 [255294.942773] [] SyS_nanosleep+0x96/0xb0 [255294.948915] [] system_call_fastpath+0x25/0x2a [255294.955726] [] ? system_call_after_swapgs+0xae/0x146 [255294.963202] multipathd S ffff9c79f5f23150 0 1265 1 0x00000000 [255294.971203] Call Trace: [255294.974055] [] schedule+0x29/0x70 [255294.979699] [] futex_wait_queue_me+0xc6/0x130 [255294.986508] [] futex_wait+0x17b/0x280 [255294.992539] [] ? mntput+0x24/0x40 [255294.998184] [] ? path_openat+0x176/0x5a0 [255295.004511] [] do_futex+0x106/0x5a0 [255295.010348] [] ? mntput+0x24/0x40 [255295.016005] [] ? __fput+0x186/0x260 [255295.021857] [] SyS_futex+0x80/0x190 [255295.027701] [] ? system_call_after_swapgs+0xa2/0x146 [255295.035185] [] ? system_call_after_swapgs+0xae/0x146 [255295.042696] [] ? system_call_after_swapgs+0xa2/0x146 [255295.050182] [] ? system_call_after_swapgs+0xae/0x146 [255295.057668] [] ? system_call_after_swapgs+0xa2/0x146 [255295.065153] [] ? system_call_after_swapgs+0xae/0x146 [255295.072669] [] system_call_fastpath+0x25/0x2a [255295.079481] [] ? system_call_after_swapgs+0xae/0x146 [255295.086984] multipathd S ffff9c81ccf4abc0 0 1445 1 0x00000000 [255295.094990] Call Trace: [255295.097822] [] schedule+0x29/0x70 [255295.103475] [] dm_wait_event+0xa1/0xf0 [dm_mod] [255295.110477] [] ? strlcpy+0x42/0x60 [255295.116217] [] ? wake_up_atomic_t+0x30/0x30 [255295.122851] [] dev_wait+0x50/0xd0 [dm_mod] [255295.129375] [] ctl_ioctl+0x24e/0x550 [dm_mod] [255295.136189] [] ? table_deps+0x1a0/0x1a0 [dm_mod] [255295.143291] [] dm_ctl_ioctl+0xe/0x20 [dm_mod] [255295.150103] [] do_vfs_ioctl+0x3a0/0x5a0 [255295.156330] [] ? __set_task_blocked+0x41/0xa0 [255295.163142] [] ? __set_current_blocked+0x42/0x70 [255295.170250] [] SyS_ioctl+0xa1/0xc0 [255295.175990] [] ? system_call_after_swapgs+0xa2/0x146 [255295.183489] [] system_call_fastpath+0x25/0x2a [255295.190289] [] ? system_call_after_swapgs+0xae/0x146 [255295.197807] multipathd S ffff9c79f62c3150 0 1458 1 0x00000000 [255295.205805] Call Trace: [255295.208635] [] schedule+0x29/0x70 [255295.214284] [] dm_wait_event+0xa1/0xf0 [dm_mod] [255295.221285] [] ? strlcpy+0x42/0x60 [255295.227028] [] ? wake_up_atomic_t+0x30/0x30 [255295.233675] [] dev_wait+0x50/0xd0 [dm_mod] [255295.240197] [] ctl_ioctl+0x24e/0x550 [dm_mod] [255295.247009] [] ? table_deps+0x1a0/0x1a0 [dm_mod] [255295.254118] [] dm_ctl_ioctl+0xe/0x20 [dm_mod] [255295.260930] [] do_vfs_ioctl+0x3a0/0x5a0 [255295.267164] [] ? __set_task_blocked+0x41/0xa0 [255295.273971] [] ? __set_current_blocked+0x42/0x70 [255295.281085] [] SyS_ioctl+0xa1/0xc0 [255295.286828] [] ? system_call_after_swapgs+0xa2/0x146 [255295.294325] [] system_call_fastpath+0x25/0x2a [255295.301140] [] ? system_call_after_swapgs+0xae/0x146 [255295.308625] multipathd S ffff9c7deec1ac80 0 1467 1 0x00000000 [255295.316634] Call Trace: [255295.319471] [] schedule+0x29/0x70 [255295.325140] [] dm_wait_event+0xa1/0xf0 [dm_mod] [255295.332141] [] ? strlcpy+0x42/0x60 [255295.337881] [] ? wake_up_atomic_t+0x30/0x30 [255295.344501] [] dev_wait+0x50/0xd0 [dm_mod] [255295.351024] [] ctl_ioctl+0x24e/0x550 [dm_mod] [255295.357842] [] ? table_deps+0x1a0/0x1a0 [dm_mod] [255295.364957] [] dm_ctl_ioctl+0xe/0x20 [dm_mod] [255295.371766] [] do_vfs_ioctl+0x3a0/0x5a0 [255295.378009] [] ? __set_task_blocked+0x41/0xa0 [255295.384839] [] ? __set_current_blocked+0x42/0x70 [255295.391946] [] SyS_ioctl+0xa1/0xc0 [255295.397687] [] ? system_call_after_swapgs+0xa2/0x146 [255295.405172] [] system_call_fastpath+0x25/0x2a [255295.411977] [] ? system_call_after_swapgs+0xae/0x146 [255295.419475] multipathd S ffff9c7deec1ac80 0 1473 1 0x00000000 [255295.427461] Call Trace: [255295.430295] [] schedule+0x29/0x70 [255295.435956] [] dm_wait_event+0xa1/0xf0 [dm_mod] [255295.442955] [] ? strlcpy+0x42/0x60 [255295.448702] [] ? wake_up_atomic_t+0x30/0x30 [255295.455332] [] dev_wait+0x50/0xd0 [dm_mod] [255295.461855] [] ctl_ioctl+0x24e/0x550 [dm_mod] [255295.468663] [] ? enqueue_entity+0x2ef/0xbe0 [255295.475296] [] ? table_deps+0x1a0/0x1a0 [dm_mod] [255295.482399] [] dm_ctl_ioctl+0xe/0x20 [dm_mod] [255295.489212] [] do_vfs_ioctl+0x3a0/0x5a0 [255295.495441] [] ? __set_task_blocked+0x41/0xa0 [255295.502258] [] ? __set_current_blocked+0x42/0x70 [255295.509370] [] SyS_ioctl+0xa1/0xc0 [255295.515132] [] ? system_call_after_swapgs+0xa2/0x146 [255295.522619] [] system_call_fastpath+0x25/0x2a [255295.529439] [] ? system_call_after_swapgs+0xae/0x146 [255295.536951] multipathd S ffff9c7deec1ac80 0 1478 1 0x00000000 [255295.544955] Call Trace: [255295.547788] [] schedule+0x29/0x70 [255295.553466] [] dm_wait_event+0xa1/0xf0 [dm_mod] [255295.560476] [] ? strlcpy+0x42/0x60 [255295.566231] [] ? wake_up_atomic_t+0x30/0x30 [255295.572849] [] dev_wait+0x50/0xd0 [dm_mod] [255295.579369] [] ctl_ioctl+0x24e/0x550 [dm_mod] [255295.586181] [] ? table_deps+0x1a0/0x1a0 [dm_mod] [255295.593287] [] dm_ctl_ioctl+0xe/0x20 [dm_mod] [255295.600105] [] do_vfs_ioctl+0x3a0/0x5a0 [255295.606348] [] ? __set_task_blocked+0x41/0xa0 [255295.613170] [] ? __set_current_blocked+0x42/0x70 [255295.620279] [] SyS_ioctl+0xa1/0xc0 [255295.626031] [] ? system_call_after_swapgs+0xa2/0x146 [255295.633540] [] system_call_fastpath+0x25/0x2a [255295.640347] [] ? system_call_after_swapgs+0xae/0x146 [255295.647845] multipathd S ffff9c79f62c41c0 0 1483 1 0x00000000 [255295.655844] Call Trace: [255295.658678] [] schedule+0x29/0x70 [255295.664327] [] dm_wait_event+0xa1/0xf0 [dm_mod] [255295.671329] [] ? strlcpy+0x42/0x60 [255295.677069] [] ? wake_up_atomic_t+0x30/0x30 [255295.683687] [] dev_wait+0x50/0xd0 [dm_mod] [255295.690234] [] ctl_ioctl+0x24e/0x550 [dm_mod] [255295.697054] [] ? table_deps+0x1a0/0x1a0 [dm_mod] [255295.704158] [] dm_ctl_ioctl+0xe/0x20 [dm_mod] [255295.710987] [] do_vfs_ioctl+0x3a0/0x5a0 [255295.717222] [] ? __set_task_blocked+0x41/0xa0 [255295.724040] [] ? __set_current_blocked+0x42/0x70 [255295.731141] [] SyS_ioctl+0xa1/0xc0 [255295.736880] [] ? system_call_after_swapgs+0xa2/0x146 [255295.744381] [] system_call_fastpath+0x25/0x2a [255295.751200] [] ? system_call_after_swapgs+0xae/0x146 [255295.758685] multipathd S ffff9c81ccf4abc0 0 1499 1 0x00000000 [255295.766712] Call Trace: [255295.769550] [] schedule+0x29/0x70 [255295.775196] [] dm_wait_event+0xa1/0xf0 [dm_mod] [255295.782199] [] ? strlcpy+0x42/0x60 [255295.787949] [] ? wake_up_atomic_t+0x30/0x30 [255295.794580] [] dev_wait+0x50/0xd0 [dm_mod] [255295.801102] [] ctl_ioctl+0x24e/0x550 [dm_mod] [255295.807927] [] ? table_deps+0x1a0/0x1a0 [dm_mod] [255295.815045] [] dm_ctl_ioctl+0xe/0x20 [dm_mod] [255295.821866] [] do_vfs_ioctl+0x3a0/0x5a0 [255295.828113] [] ? __set_task_blocked+0x41/0xa0 [255295.834910] [] ? __set_current_blocked+0x42/0x70 [255295.842016] [] SyS_ioctl+0xa1/0xc0 [255295.847770] [] ? system_call_after_swapgs+0xa2/0x146 [255295.855253] [] system_call_fastpath+0x25/0x2a [255295.862073] [] ? system_call_after_swapgs+0xae/0x146 [255295.869575] kworker/17:4 S ffff9c7defced230 0 1263 2 0x00000000 [255295.877575] Call Trace: [255295.880438] [] ? process_one_work+0x21a/0x440 [255295.887246] [] schedule+0x29/0x70 [255295.892890] [] worker_thread+0x1d9/0x3c0 [255295.899214] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255295.906604] [] kthread+0xd1/0xe0 [255295.912149] [] ? insert_kthread_work+0x40/0x40 [255295.919056] [] ret_from_fork_nospec_begin+0x21/0x21 [255295.926446] [] ? insert_kthread_work+0x40/0x40 [255295.933361] systemd-udevd S ffff9c7de8af8000 0 1267 1 0x00000000 [255295.941362] Call Trace: [255295.944218] [] ? kmem_cache_alloc+0x35/0x1f0 [255295.950930] [] schedule+0x29/0x70 [255295.956591] [] schedule_hrtimeout_range_clock+0x12d/0x150 [255295.964573] [] ? ep_scan_ready_list.isra.7+0x1b9/0x1f0 [255295.972254] [] schedule_hrtimeout_range+0x13/0x20 [255295.979461] [] ep_poll+0x23e/0x360 [255295.985200] [] ? do_unlinkat+0xf1/0x2d0 [255295.991426] [] ? wake_up_state+0x20/0x20 [255295.997772] [] SyS_epoll_wait+0xed/0x120 [255296.004098] [] ? system_call_after_swapgs+0xa2/0x146 [255296.011585] [] system_call_fastpath+0x25/0x2a [255296.018393] [] ? system_call_after_swapgs+0xae/0x146 [255296.025884] kipmi0 S ffff9c7defcee2a0 0 1349 2 0x00000000 [255296.033898] Call Trace: [255296.036731] [] schedule+0x29/0x70 [255296.042381] [] ipmi_thread+0x15c/0x220 [ipmi_si] [255296.049491] [] ? cleanup_one_si+0x60/0x60 [ipmi_si] [255296.056895] [] kthread+0xd1/0xe0 [255296.062472] [] ? insert_kthread_work+0x40/0x40 [255296.069389] [] ret_from_fork_nospec_begin+0x21/0x21 [255296.076777] [] ? insert_kthread_work+0x40/0x40 [255296.083683] kdmflush S ffff9c7deec5ac80 0 1410 2 0x00000000 [255296.091673] Call Trace: [255296.094527] [] schedule+0x29/0x70 [255296.100173] [] rescuer_thread+0x31e/0x3c0 [255296.106593] [] ? process_one_work+0x440/0x440 [255296.113402] [] kthread+0xd1/0xe0 [255296.118956] [] ? insert_kthread_work+0x40/0x40 [255296.125878] [] ret_from_fork_nospec_begin+0x21/0x21 [255296.133269] [] ? insert_kthread_work+0x40/0x40 [255296.140173] bioset S ffff9c7deeb5ac80 0 1442 2 0x00000000 [255296.148201] Call Trace: [255296.151031] [] schedule+0x29/0x70 [255296.156677] [] rescuer_thread+0x31e/0x3c0 [255296.163099] [] ? process_one_work+0x440/0x440 [255296.169905] [] kthread+0xd1/0xe0 [255296.175474] [] ? insert_kthread_work+0x40/0x40 [255296.182371] [] ret_from_fork_nospec_begin+0x21/0x21 [255296.189761] [] ? insert_kthread_work+0x40/0x40 [255296.196665] kdmwork-253:0 S ffff9c81ee25ac80 0 1443 2 0x00000000 [255296.204675] Call Trace: [255296.207506] [] schedule+0x29/0x70 [255296.213172] [] kthread_worker_fn+0xf7/0x180 [255296.219785] [] ? kthread_stop+0xf0/0xf0 [255296.226010] [] kthread+0xd1/0xe0 [255296.231557] [] ? insert_kthread_work+0x40/0x40 [255296.238460] [] ret_from_fork_nospec_begin+0x21/0x21 [255296.245850] [] ? insert_kthread_work+0x40/0x40 [255296.252767] kdmflush S ffff9c7deed9ac80 0 1451 2 0x00000000 [255296.260767] Call Trace: [255296.263598] [] schedule+0x29/0x70 [255296.269243] [] rescuer_thread+0x31e/0x3c0 [255296.275664] [] ? process_one_work+0x440/0x440 [255296.282472] [] kthread+0xd1/0xe0 [255296.288019] [] ? insert_kthread_work+0x40/0x40 [255296.294930] [] ret_from_fork_nospec_begin+0x21/0x21 [255296.302325] [] ? insert_kthread_work+0x40/0x40 [255296.309230] bioset S ffff9c7deed9ac80 0 1453 2 0x00000000 [255296.317236] Call Trace: [255296.320080] [] schedule+0x29/0x70 [255296.325715] [] rescuer_thread+0x31e/0x3c0 [255296.332140] [] ? process_one_work+0x440/0x440 [255296.338950] [] kthread+0xd1/0xe0 [255296.344548] [] ? insert_kthread_work+0x40/0x40 [255296.351443] [] ret_from_fork_nospec_begin+0x21/0x21 [255296.358832] [] ? insert_kthread_work+0x40/0x40 [255296.365750] kdmwork-253:1 S ffff9c79f6325230 0 1454 2 0x00000000 [255296.373774] Call Trace: [255296.376619] [] schedule+0x29/0x70 [255296.382277] [] kthread_worker_fn+0xf7/0x180 [255296.388883] [] ? kthread_stop+0xf0/0xf0 [255296.395132] [] kthread+0xd1/0xe0 [255296.400692] [] ? insert_kthread_work+0x40/0x40 [255296.407588] [] ret_from_fork_nospec_begin+0x21/0x21 [255296.414989] [] ? insert_kthread_work+0x40/0x40 [255296.421892] kdmflush S ffff9c7deea9ac80 0 1463 2 0x00000000 [255296.429891] Call Trace: [255296.432736] [] schedule+0x29/0x70 [255296.438382] [] rescuer_thread+0x31e/0x3c0 [255296.444815] [] ? process_one_work+0x440/0x440 [255296.451623] [] kthread+0xd1/0xe0 [255296.457170] [] ? insert_kthread_work+0x40/0x40 [255296.464075] [] ret_from_fork_nospec_begin+0x21/0x21 [255296.471462] [] ? insert_kthread_work+0x40/0x40 [255296.478367] bioset S ffff9c7deea9ac80 0 1464 2 0x00000000 [255296.486367] Call Trace: [255296.489200] [] schedule+0x29/0x70 [255296.494845] [] rescuer_thread+0x31e/0x3c0 [255296.501271] [] ? process_one_work+0x440/0x440 [255296.508077] [] kthread+0xd1/0xe0 [255296.513626] [] ? insert_kthread_work+0x40/0x40 [255296.520542] [] ret_from_fork_nospec_begin+0x21/0x21 [255296.527932] [] ? insert_kthread_work+0x40/0x40 [255296.534846] kdmwork-253:2 S ffff9c7deea9ac80 0 1465 2 0x00000000 [255296.542849] Call Trace: [255296.545672] [] schedule+0x29/0x70 [255296.551318] [] kthread_worker_fn+0xf7/0x180 [255296.557934] [] ? kthread_stop+0xf0/0xf0 [255296.564166] [] kthread+0xd1/0xe0 [255296.569717] [] ? insert_kthread_work+0x40/0x40 [255296.576613] [] ret_from_fork_nospec_begin+0x21/0x21 [255296.584017] [] ? insert_kthread_work+0x40/0x40 [255296.590925] kdmflush S ffff9c7deed9ac80 0 1470 2 0x00000000 [255296.598929] Call Trace: [255296.601760] [] schedule+0x29/0x70 [255296.607424] [] rescuer_thread+0x31e/0x3c0 [255296.613843] [] ? process_one_work+0x440/0x440 [255296.620663] [] kthread+0xd1/0xe0 [255296.626211] [] ? insert_kthread_work+0x40/0x40 [255296.633126] [] ret_from_fork_nospec_begin+0x21/0x21 [255296.640516] [] ? insert_kthread_work+0x40/0x40 [255296.647420] bioset S ffff9c7deeddac80 0 1471 2 0x00000000 [255296.655433] Call Trace: [255296.658264] [] schedule+0x29/0x70 [255296.663907] [] rescuer_thread+0x31e/0x3c0 [255296.670345] [] ? process_one_work+0x440/0x440 [255296.677157] [] kthread+0xd1/0xe0 [255296.682705] [] ? insert_kthread_work+0x40/0x40 [255296.689630] [] ret_from_fork_nospec_begin+0x21/0x21 [255296.697036] [] ? insert_kthread_work+0x40/0x40 [255296.703941] kdmwork-253:3 S ffff9c7de9760000 0 1472 2 0x00000000 [255296.711946] Call Trace: [255296.714788] [] schedule+0x29/0x70 [255296.720433] [] kthread_worker_fn+0xf7/0x180 [255296.727047] [] ? kthread_stop+0xf0/0xf0 [255296.733271] [] kthread+0xd1/0xe0 [255296.738842] [] ? insert_kthread_work+0x40/0x40 [255296.745747] [] ret_from_fork_nospec_begin+0x21/0x21 [255296.753134] [] ? insert_kthread_work+0x40/0x40 [255296.760037] kdmflush S ffff9c7deeddac80 0 1475 2 0x00000000 [255296.768065] Call Trace: [255296.770909] [] schedule+0x29/0x70 [255296.776544] [] rescuer_thread+0x31e/0x3c0 [255296.782967] [] ? process_one_work+0x440/0x440 [255296.789772] [] kthread+0xd1/0xe0 [255296.795321] [] ? insert_kthread_work+0x40/0x40 [255296.802223] [] ret_from_fork_nospec_begin+0x21/0x21 [255296.809614] [] ? insert_kthread_work+0x40/0x40 [255296.816526] bioset S ffff9c7deeddac80 0 1476 2 0x00000000 [255296.824563] Call Trace: [255296.827396] [] schedule+0x29/0x70 [255296.833039] [] rescuer_thread+0x31e/0x3c0 [255296.839460] [] ? process_one_work+0x440/0x440 [255296.846265] [] kthread+0xd1/0xe0 [255296.851823] [] ? insert_kthread_work+0x40/0x40 [255296.858731] [] ret_from_fork_nospec_begin+0x21/0x21 [255296.866113] [] ? insert_kthread_work+0x40/0x40 [255296.873017] kdmwork-253:4 S ffff9c7deea5ac80 0 1477 2 0x00000000 [255296.881009] Call Trace: [255296.883845] [] schedule+0x29/0x70 [255296.889494] [] kthread_worker_fn+0xf7/0x180 [255296.896106] [] ? kthread_stop+0xf0/0xf0 [255296.902345] [] kthread+0xd1/0xe0 [255296.907899] [] ? insert_kthread_work+0x40/0x40 [255296.914805] [] ret_from_fork_nospec_begin+0x21/0x21 [255296.922205] [] ? insert_kthread_work+0x40/0x40 [255296.929108] kdmflush S ffff9c81ee45ac80 0 1479 2 0x00000000 [255296.937110] Call Trace: [255296.939951] [] schedule+0x29/0x70 [255296.945609] [] rescuer_thread+0x31e/0x3c0 [255296.952030] [] ? process_one_work+0x440/0x440 [255296.958837] [] kthread+0xd1/0xe0 [255296.964383] [] ? insert_kthread_work+0x40/0x40 [255296.971286] [] ret_from_fork_nospec_begin+0x21/0x21 [255296.978674] [] ? insert_kthread_work+0x40/0x40 [255296.985578] bioset S ffff9c7deeddac80 0 1480 2 0x00000000 [255296.993575] Call Trace: [255296.996423] [] schedule+0x29/0x70 [255297.002081] [] rescuer_thread+0x31e/0x3c0 [255297.008506] [] ? process_one_work+0x440/0x440 [255297.015317] [] kthread+0xd1/0xe0 [255297.020869] [] ? insert_kthread_work+0x40/0x40 [255297.027774] [] ret_from_fork_nospec_begin+0x21/0x21 [255297.035165] [] ? insert_kthread_work+0x40/0x40 [255297.042068] kdmwork-253:5 S ffff9c7de792c1c0 0 1481 2 0x00000000 [255297.050067] Call Trace: [255297.052917] [] schedule+0x29/0x70 [255297.058565] [] kthread_worker_fn+0xf7/0x180 [255297.065179] [] ? kthread_stop+0xf0/0xf0 [255297.071419] [] kthread+0xd1/0xe0 [255297.076968] [] ? insert_kthread_work+0x40/0x40 [255297.083898] [] ret_from_fork_nospec_begin+0x21/0x21 [255297.091287] [] ? insert_kthread_work+0x40/0x40 [255297.098188] kworker/9:1H S ffff9c81ec4ed230 0 1482 2 0x00000000 [255297.106197] Call Trace: [255297.109028] [] ? process_one_work+0x21a/0x440 [255297.115848] [] schedule+0x29/0x70 [255297.121492] [] worker_thread+0x1d9/0x3c0 [255297.127816] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255297.135206] [] kthread+0xd1/0xe0 [255297.140766] [] ? insert_kthread_work+0x40/0x40 [255297.147671] [] ret_from_fork_nospec_begin+0x21/0x21 [255297.155059] [] ? insert_kthread_work+0x40/0x40 [255297.161961] kdmflush S ffff9c7deea5ac80 0 1494 2 0x00000000 [255297.169960] Call Trace: [255297.172804] [] schedule+0x29/0x70 [255297.178448] [] rescuer_thread+0x31e/0x3c0 [255297.184871] [] ? process_one_work+0x440/0x440 [255297.191683] [] kthread+0xd1/0xe0 [255297.197229] [] ? insert_kthread_work+0x40/0x40 [255297.204132] [] ret_from_fork_nospec_begin+0x21/0x21 [255297.211520] [] ? insert_kthread_work+0x40/0x40 [255297.218436] bioset S ffff9c7deea5ac80 0 1497 2 0x00000000 [255297.226438] Call Trace: [255297.229271] [] schedule+0x29/0x70 [255297.234935] [] rescuer_thread+0x31e/0x3c0 [255297.241355] [] ? process_one_work+0x440/0x440 [255297.248160] [] kthread+0xd1/0xe0 [255297.253708] [] ? insert_kthread_work+0x40/0x40 [255297.260625] [] ret_from_fork_nospec_begin+0x21/0x21 [255297.268015] [] ? insert_kthread_work+0x40/0x40 [255297.274927] kdmwork-253:6 S ffff9c7deea9ac80 0 1498 2 0x00000000 [255297.282962] Call Trace: [255297.285793] [] schedule+0x29/0x70 [255297.291451] [] kthread_worker_fn+0xf7/0x180 [255297.298063] [] ? kthread_stop+0xf0/0xf0 [255297.304295] [] kthread+0xd1/0xe0 [255297.309842] [] ? insert_kthread_work+0x40/0x40 [255297.316758] [] ret_from_fork_nospec_begin+0x21/0x21 [255297.324149] [] ? insert_kthread_work+0x40/0x40 [255297.331053] kworker/15:1H S ffff9c81e9a28000 0 2098 2 0x00000000 [255297.339067] Call Trace: [255297.341898] [] ? process_one_work+0x21a/0x440 [255297.348724] [] schedule+0x29/0x70 [255297.354368] [] worker_thread+0x1d9/0x3c0 [255297.360690] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255297.368079] [] kthread+0xd1/0xe0 [255297.373636] [] ? insert_kthread_work+0x40/0x40 [255297.380540] [] ret_from_fork_nospec_begin+0x21/0x21 [255297.387934] [] ? insert_kthread_work+0x40/0x40 [255297.394836] kworker/13:1H S ffff9c81e9a29070 0 2100 2 0x00000000 [255297.402851] Call Trace: [255297.405683] [] ? process_one_work+0x21a/0x440 [255297.412490] [] schedule+0x29/0x70 [255297.418135] [] worker_thread+0x1d9/0x3c0 [255297.424458] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255297.431844] [] kthread+0xd1/0xe0 [255297.437392] [] ? insert_kthread_work+0x40/0x40 [255297.444296] [] ret_from_fork_nospec_begin+0x21/0x21 [255297.451684] [] ? insert_kthread_work+0x40/0x40 [255297.458600] kworker/11:1H S ffff9c81e9a2a0e0 0 2101 2 0x00000000 [255297.466598] Call Trace: [255297.469445] [] ? process_one_work+0x21a/0x440 [255297.476251] [] schedule+0x29/0x70 [255297.481906] [] worker_thread+0x1d9/0x3c0 [255297.488234] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255297.495622] [] kthread+0xd1/0xe0 [255297.501171] [] ? insert_kthread_work+0x40/0x40 [255297.508074] [] ret_from_fork_nospec_begin+0x21/0x21 [255297.515475] [] ? insert_kthread_work+0x40/0x40 [255297.522391] kworker/4:1H S ffff9c7b39168000 0 2102 2 0x00000000 [255297.530389] Call Trace: [255297.533234] [] ? process_one_work+0x21a/0x440 [255297.540041] [] schedule+0x29/0x70 [255297.545685] [] worker_thread+0x1d9/0x3c0 [255297.552017] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255297.559406] [] kthread+0xd1/0xe0 [255297.564967] [] ? insert_kthread_work+0x40/0x40 [255297.571872] [] ret_from_fork_nospec_begin+0x21/0x21 [255297.579261] [] ? insert_kthread_work+0x40/0x40 [255297.586168] kworker/6:1H S ffff9c7b3916a0e0 0 2103 2 0x00000000 [255297.594184] Call Trace: [255297.597029] [] ? process_one_work+0x21a/0x440 [255297.603826] [] schedule+0x29/0x70 [255297.609470] [] worker_thread+0x1d9/0x3c0 [255297.615793] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255297.623183] [] kthread+0xd1/0xe0 [255297.628731] [] ? insert_kthread_work+0x40/0x40 [255297.635636] [] ret_from_fork_nospec_begin+0x21/0x21 [255297.643028] [] ? insert_kthread_work+0x40/0x40 [255297.649955] kworker/7:1H S ffff9c79f62c5230 0 2104 2 0x00000000 [255297.657963] Call Trace: [255297.660808] [] ? process_one_work+0x21a/0x440 [255297.667611] [] schedule+0x29/0x70 [255297.673255] [] worker_thread+0x1d9/0x3c0 [255297.679578] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255297.686965] [] kthread+0xd1/0xe0 [255297.692513] [] ? insert_kthread_work+0x40/0x40 [255297.699430] [] ret_from_fork_nospec_begin+0x21/0x21 [255297.706820] [] ? insert_kthread_work+0x40/0x40 [255297.713723] kworker/14:1H S ffff9c81e9a2e2a0 0 2105 2 0x00000000 [255297.721731] Call Trace: [255297.724568] [] ? process_one_work+0x21a/0x440 [255297.731376] [] schedule+0x29/0x70 [255297.737021] [] worker_thread+0x1d9/0x3c0 [255297.743343] [] ? __kthread_parkme+0x64/0x80 [255297.749955] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255297.757343] [] kthread+0xd1/0xe0 [255297.762891] [] ? insert_kthread_work+0x40/0x40 [255297.769795] [] ret_from_fork_nospec_begin+0x21/0x21 [255297.777185] [] ? insert_kthread_work+0x40/0x40 [255297.784088] kworker/23:1H S ffff9c7de8afb150 0 2106 2 0x00000000 [255297.792115] Call Trace: [255297.794955] [] ? process_one_work+0x21a/0x440 [255297.801764] [] schedule+0x29/0x70 [255297.807435] [] worker_thread+0x1d9/0x3c0 [255297.813758] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255297.821145] [] kthread+0xd1/0xe0 [255297.826693] [] ? insert_kthread_work+0x40/0x40 [255297.833609] [] ret_from_fork_nospec_begin+0x21/0x21 [255297.840997] [] ? insert_kthread_work+0x40/0x40 [255297.847902] kworker/12:1H S ffff9c81ebae8000 0 2107 2 0x00000000 [255297.855923] Call Trace: [255297.858755] [] ? process_one_work+0x21a/0x440 [255297.865562] [] schedule+0x29/0x70 [255297.871207] [] worker_thread+0x1d9/0x3c0 [255297.877538] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255297.884928] [] kthread+0xd1/0xe0 [255297.890483] [] ? insert_kthread_work+0x40/0x40 [255297.897385] [] ret_from_fork_nospec_begin+0x21/0x21 [255297.904775] [] ? insert_kthread_work+0x40/0x40 [255297.911677] kworker/17:1H S ffff9c7de8af9070 0 2124 2 0x00000000 [255297.919677] Call Trace: [255297.922509] [] ? process_one_work+0x21a/0x440 [255297.929314] [] schedule+0x29/0x70 [255297.934959] [] worker_thread+0x1d9/0x3c0 [255297.941281] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255297.948682] [] kthread+0xd1/0xe0 [255297.954228] [] ? insert_kthread_work+0x40/0x40 [255297.961131] [] ret_from_fork_nospec_begin+0x21/0x21 [255297.968518] [] ? insert_kthread_work+0x40/0x40 [255297.975421] kworker/26:1H S ffff9c81ebaed230 0 2125 2 0x00000000 [255297.983432] Call Trace: [255297.986265] [] ? process_one_work+0x21a/0x440 [255297.993072] [] schedule+0x29/0x70 [255297.998728] [] worker_thread+0x1d9/0x3c0 [255298.005042] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255298.012432] [] kthread+0xd1/0xe0 [255298.017995] [] ? insert_kthread_work+0x40/0x40 [255298.024901] [] ret_from_fork_nospec_begin+0x21/0x21 [255298.032304] [] ? insert_kthread_work+0x40/0x40 [255298.039208] kworker/27:1H S ffff9c81e9718000 0 2126 2 0x00000000 [255298.047209] Call Trace: [255298.050043] [] ? process_one_work+0x21a/0x440 [255298.056870] [] schedule+0x29/0x70 [255298.062525] [] worker_thread+0x1d9/0x3c0 [255298.068855] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255298.076264] [] kthread+0xd1/0xe0 [255298.081818] [] ? insert_kthread_work+0x40/0x40 [255298.088723] [] ret_from_fork_nospec_begin+0x21/0x21 [255298.096111] [] ? insert_kthread_work+0x40/0x40 [255298.103026] spl_system_task S ffff9c81ee45ac80 0 2183 2 0x00000000 [255298.111025] Call Trace: [255298.113850] [] ? task_rq_unlock+0x20/0x20 [255298.120277] [] schedule+0x29/0x70 [255298.125938] [] taskq_thread+0x4a2/0x4f0 [spl] [255298.132746] [] ? wake_up_state+0x20/0x20 [255298.139089] [] ? taskq_thread_spawn+0x60/0x60 [spl] [255298.146478] [] kthread+0xd1/0xe0 [255298.152027] [] ? insert_kthread_work+0x40/0x40 [255298.158933] [] ret_from_fork_nospec_begin+0x21/0x21 [255298.166321] [] ? insert_kthread_work+0x40/0x40 [255298.173225] spl_delay_taskq S ffff9c81ee45ac80 0 2184 2 0x00000000 [255298.181222] Call Trace: [255298.184059] [] ? task_rq_unlock+0x20/0x20 [255298.190492] [] schedule+0x29/0x70 [255298.196131] [] taskq_thread+0x4a2/0x4f0 [spl] [255298.202939] [] ? wake_up_state+0x20/0x20 [255298.209264] [] ? taskq_thread_spawn+0x60/0x60 [spl] [255298.216654] [] kthread+0xd1/0xe0 [255298.222214] [] ? insert_kthread_work+0x40/0x40 [255298.229118] [] ret_from_fork_nospec_begin+0x21/0x21 [255298.236510] [] ? insert_kthread_work+0x40/0x40 [255298.243426] spl_dynamic_tas S ffff9c81ee45ac80 0 2185 2 0x00000000 [255298.251426] Call Trace: [255298.254250] [] ? task_rq_unlock+0x20/0x20 [255298.260669] [] schedule+0x29/0x70 [255298.266328] [] taskq_thread+0x4a2/0x4f0 [spl] [255298.273139] [] ? wake_up_state+0x20/0x20 [255298.279465] [] ? taskq_thread_spawn+0x60/0x60 [spl] [255298.286860] [] kthread+0xd1/0xe0 [255298.292420] [] ? insert_kthread_work+0x40/0x40 [255298.299316] [] ret_from_fork_nospec_begin+0x21/0x21 [255298.306707] [] ? insert_kthread_work+0x40/0x40 [255298.313609] spl_kmem_cache S ffff9c81ee45ac80 0 2186 2 0x00000000 [255298.321614] Call Trace: [255298.324464] [] ? task_rq_unlock+0x20/0x20 [255298.330896] [] schedule+0x29/0x70 [255298.336535] [] taskq_thread+0x4a2/0x4f0 [spl] [255298.343343] [] ? wake_up_state+0x20/0x20 [255298.349667] [] ? __spl_cache_grow+0x2c0/0x2c0 [spl] [255298.357057] [] ? taskq_thread_spawn+0x60/0x60 [spl] [255298.364446] [] kthread+0xd1/0xe0 [255298.369993] [] ? insert_kthread_work+0x40/0x40 [255298.376895] [] ret_from_fork_nospec_begin+0x21/0x21 [255298.384302] [] ? insert_kthread_work+0x40/0x40 [255298.391205] zvol S ffff9c7deed1ac80 0 2236 2 0x00000000 [255298.399193] Call Trace: [255298.402026] [] ? task_rq_unlock+0x20/0x20 [255298.408444] [] schedule+0x29/0x70 [255298.414089] [] taskq_thread+0x4a2/0x4f0 [spl] [255298.420895] [] ? wake_up_state+0x20/0x20 [255298.427239] [] ? taskq_thread_spawn+0x60/0x60 [spl] [255298.434650] [] kthread+0xd1/0xe0 [255298.440197] [] ? insert_kthread_work+0x40/0x40 [255298.447100] [] ret_from_fork_nospec_begin+0x21/0x21 [255298.454493] [] ? insert_kthread_work+0x40/0x40 [255298.461388] arc_prune S ffff9c81ee45ac80 0 2239 2 0x00000000 [255298.469404] Call Trace: [255298.472249] [] ? task_rq_unlock+0x20/0x20 [255298.478668] [] schedule+0x29/0x70 [255298.484314] [] taskq_thread+0x4a2/0x4f0 [spl] [255298.491133] [] ? wake_up_state+0x20/0x20 [255298.497474] [] ? taskq_thread_spawn+0x60/0x60 [spl] [255298.504877] [] kthread+0xd1/0xe0 [255298.510424] [] ? insert_kthread_work+0x40/0x40 [255298.517335] [] ret_from_fork_nospec_begin+0x21/0x21 [255298.524725] [] ? insert_kthread_work+0x40/0x40 [255298.531641] zthr_procedure S ffff9c81ee45ac80 0 2240 2 0x00000000 [255298.539647] Call Trace: [255298.542482] [] schedule+0x29/0x70 [255298.548130] [] cv_wait_common+0x125/0x150 [spl] [255298.555122] [] ? wake_up_atomic_t+0x30/0x30 [255298.561740] [] __cv_wait_sig+0x15/0x40 [spl] [255298.568528] [] zthr_procedure+0x7f/0x140 [zfs] [255298.575481] [] ? zrl_is_locked+0x20/0x20 [zfs] [255298.582394] [] thread_generic_wrapper+0x73/0x80 [spl] [255298.589982] [] ? __thread_exit+0x20/0x20 [spl] [255298.596899] [] kthread+0xd1/0xe0 [255298.602449] [] ? insert_kthread_work+0x40/0x40 [255298.609367] [] ret_from_fork_nospec_begin+0x21/0x21 [255298.616754] [] ? insert_kthread_work+0x40/0x40 [255298.623657] zthr_procedure S ffff9c79f6b9e2a0 0 2241 2 0x00000000 [255298.631655] Call Trace: [255298.634509] [] schedule+0x29/0x70 [255298.640152] [] schedule_hrtimeout_range_clock+0xb2/0x150 [255298.648038] [] ? hrtimer_get_res+0x50/0x50 [255298.654546] [] ? schedule_hrtimeout_range_clock+0xa6/0x150 [255298.662626] [] schedule_hrtimeout_range+0x13/0x20 [255298.669841] [] __cv_timedwait_hires+0x123/0x210 [spl] [255298.677424] [] ? wake_up_atomic_t+0x30/0x30 [255298.684039] [] cv_timedwait_sig_hires+0x67/0x90 [spl] [255298.691684] [] zthr_procedure+0xeb/0x140 [zfs] [255298.698637] [] ? zrl_is_locked+0x20/0x20 [zfs] [255298.705562] [] thread_generic_wrapper+0x73/0x80 [spl] [255298.713156] [] ? __thread_exit+0x20/0x20 [spl] [255298.720069] [] kthread+0xd1/0xe0 [255298.725615] [] ? insert_kthread_work+0x40/0x40 [255298.732533] [] ret_from_fork_nospec_begin+0x21/0x21 [255298.739920] [] ? insert_kthread_work+0x40/0x40 [255298.746829] dbu_evict S ffff9c81ee45ac80 0 2242 2 0x00000000 [255298.754853] Call Trace: [255298.757686] [] ? task_rq_unlock+0x20/0x20 [255298.764107] [] schedule+0x29/0x70 [255298.769778] [] taskq_thread+0x4a2/0x4f0 [spl] [255298.776588] [] ? wake_up_state+0x20/0x20 [255298.782916] [] ? taskq_thread_spawn+0x60/0x60 [spl] [255298.790318] [] kthread+0xd1/0xe0 [255298.795874] [] ? insert_kthread_work+0x40/0x40 [255298.802779] [] ret_from_fork_nospec_begin+0x21/0x21 [255298.810167] [] ? insert_kthread_work+0x40/0x40 [255298.817069] dbuf_evict S ffff9c79f6b9b150 0 2243 2 0x00000000 [255298.825080] Call Trace: [255298.827928] [] schedule+0x29/0x70 [255298.833572] [] schedule_hrtimeout_range_clock+0xb2/0x150 [255298.841459] [] ? hrtimer_get_res+0x50/0x50 [255298.847968] [] ? schedule_hrtimeout_range_clock+0xa6/0x150 [255298.856037] [] schedule_hrtimeout_range+0x13/0x20 [255298.863235] [] __cv_timedwait_hires+0x123/0x210 [spl] [255298.870821] [] ? wake_up_atomic_t+0x30/0x30 [255298.877440] [] cv_timedwait_sig_hires+0x67/0x90 [spl] [255298.885062] [] dbuf_evict_thread+0x82/0x1e0 [zfs] [255298.892290] [] ? dbuf_sync_indirect+0x1b0/0x1b0 [zfs] [255298.899903] [] thread_generic_wrapper+0x73/0x80 [spl] [255298.907492] [] ? __thread_exit+0x20/0x20 [spl] [255298.914398] [] kthread+0xd1/0xe0 [255298.919945] [] ? insert_kthread_work+0x40/0x40 [255298.926847] [] ret_from_fork_nospec_begin+0x21/0x21 [255298.934236] [] ? insert_kthread_work+0x40/0x40 [255298.941139] kworker/24:1H S ffff9c81ecf71070 0 2244 2 0x00000000 [255298.949153] Call Trace: [255298.951993] [] ? process_one_work+0x21a/0x440 [255298.958813] [] schedule+0x29/0x70 [255298.964468] [] worker_thread+0x1d9/0x3c0 [255298.970807] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255298.978195] [] kthread+0xd1/0xe0 [255298.983743] [] ? insert_kthread_work+0x40/0x40 [255298.990651] [] ret_from_fork_nospec_begin+0x21/0x21 [255298.998040] [] ? insert_kthread_work+0x40/0x40 [255299.004955] kworker/10:1H S ffff9c81ecf741c0 0 2245 2 0x00000000 [255299.012956] Call Trace: [255299.015789] [] ? process_one_work+0x21a/0x440 [255299.022609] [] schedule+0x29/0x70 [255299.028264] [] worker_thread+0x1d9/0x3c0 [255299.034588] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255299.041975] [] kthread+0xd1/0xe0 [255299.047550] [] ? insert_kthread_work+0x40/0x40 [255299.054453] [] ret_from_fork_nospec_begin+0x21/0x21 [255299.061849] [] ? insert_kthread_work+0x40/0x40 [255299.068761] z_vdev_file S ffff9c81ee45ac80 0 2257 2 0x00000000 [255299.076741] Call Trace: [255299.079574] [] ? task_rq_unlock+0x20/0x20 [255299.085994] [] schedule+0x29/0x70 [255299.091645] [] taskq_thread+0x4a2/0x4f0 [spl] [255299.098466] [] ? wake_up_state+0x20/0x20 [255299.104793] [] ? taskq_thread_spawn+0x60/0x60 [spl] [255299.112187] [] kthread+0xd1/0xe0 [255299.117749] [] ? insert_kthread_work+0x40/0x40 [255299.124653] [] ret_from_fork_nospec_begin+0x21/0x21 [255299.132043] [] ? insert_kthread_work+0x40/0x40 [255299.138945] l2arc_feed S ffff9c7deca962a0 0 2258 2 0x00000000 [255299.146945] Call Trace: [255299.149778] [] schedule+0x29/0x70 [255299.155424] [] schedule_timeout+0x168/0x2d0 [255299.162036] [] ? __internal_add_timer+0x130/0x130 [255299.169238] [] __cv_timedwait_common+0xd2/0x190 [spl] [255299.176821] [] ? wake_up_atomic_t+0x30/0x30 [255299.183457] [] ? l2arc_evict+0x2c0/0x2c0 [zfs] [255299.190365] [] __cv_timedwait_sig+0x16/0x20 [spl] [255299.197574] [] l2arc_feed_thread+0x6f/0x460 [zfs] [255299.204773] [] ? kfree+0x106/0x140 [255299.210538] [] ? l2arc_evict+0x2c0/0x2c0 [zfs] [255299.217449] [] thread_generic_wrapper+0x73/0x80 [spl] [255299.225038] [] ? __thread_exit+0x20/0x20 [spl] [255299.231955] [] kthread+0xd1/0xe0 [255299.237504] [] ? insert_kthread_work+0x40/0x40 [255299.244421] [] ret_from_fork_nospec_begin+0x21/0x21 [255299.251810] [] ? insert_kthread_work+0x40/0x40 [255299.258730] auditd S ffff9c7dec763150 0 2294 1 0x00000000 [255299.266768] Call Trace: [255299.269621] [] schedule+0x29/0x70 [255299.275256] [] schedule_hrtimeout_range_clock+0xb2/0x150 [255299.283132] [] ? hrtimer_get_res+0x50/0x50 [255299.289649] [] ? schedule_hrtimeout_range_clock+0xa6/0x150 [255299.297741] [] schedule_hrtimeout_range+0x13/0x20 [255299.304964] [] ep_poll+0x23e/0x360 [255299.310708] [] ? wake_up_state+0x20/0x20 [255299.317031] [] SyS_epoll_wait+0xed/0x120 [255299.323357] [] ? system_call_after_swapgs+0xa2/0x146 [255299.330852] [] system_call_fastpath+0x25/0x2a [255299.337658] [] ? system_call_after_swapgs+0xae/0x146 [255299.345155] auditd S ffff9c81dfe9a0e0 0 2295 1 0x00000000 [255299.353164] Call Trace: [255299.355995] [] schedule+0x29/0x70 [255299.361648] [] futex_wait_queue_me+0xc6/0x130 [255299.368457] [] futex_wait+0x17b/0x280 [255299.374487] [] ? __schedule+0x402/0x840 [255299.380739] [] do_futex+0x106/0x5a0 [255299.386584] [] ? jbd2_complete_transaction+0x52/0xa0 [jbd2] [255299.394753] [] SyS_futex+0x80/0x190 [255299.400591] [] ? system_call_after_swapgs+0xa2/0x146 [255299.408077] [] ? system_call_after_swapgs+0xae/0x146 [255299.415562] [] ? system_call_after_swapgs+0xa2/0x146 [255299.423061] [] ? system_call_after_swapgs+0xae/0x146 [255299.430551] [] ? system_call_after_swapgs+0xa2/0x146 [255299.438028] [] ? system_call_after_swapgs+0xae/0x146 [255299.445535] [] system_call_fastpath+0x25/0x2a [255299.452341] [] ? system_call_after_swapgs+0xae/0x146 [255299.459833] polkitd S ffff9c7debabb150 0 2341 1 0x00000080 [255299.467840] Call Trace: [255299.470671] [] schedule+0x29/0x70 [255299.476312] [] schedule_hrtimeout_range_clock+0x12d/0x150 [255299.484296] [] ? _raw_spin_unlock_irqrestore+0x15/0x20 [255299.491977] [] ? add_wait_queue+0x3c/0x50 [255299.498398] [] schedule_hrtimeout_range+0x13/0x20 [255299.505593] [] poll_schedule_timeout+0x55/0xc0 [255299.512496] [] do_sys_poll+0x48d/0x590 [255299.518628] [] ? put_prev_entity+0x31/0x400 [255299.525242] [] ? __switch_to+0x151/0x580 [255299.531578] [] ? __enqueue_entity+0x78/0x80 [255299.538192] [] ? __pollwait+0xf0/0xf0 [255299.544234] [] ? __pollwait+0xf0/0xf0 [255299.550270] [] ? ttwu_do_activate+0x6f/0x80 [255299.556883] [] ? try_to_wake_up+0x190/0x390 [255299.563496] [] ? inotify_free_event+0xe/0x10 [255299.570205] [] ? kfree+0x106/0x140 [255299.575944] [] ? list_del+0xd/0x30 [255299.581684] [] ? remove_wait_queue+0x31/0x40 [255299.588394] [] ? eventfd_ctx_read+0x67/0x1e0 [255299.595114] [] ? system_call_after_swapgs+0xae/0x146 [255299.602612] [] SyS_poll+0x74/0x110 [255299.608352] [] ? system_call_after_swapgs+0xa2/0x146 [255299.615838] [] ? system_call_after_swapgs+0xae/0x146 [255299.623324] [] system_call_fastpath+0x25/0x2a [255299.630130] [] ? system_call_after_swapgs+0xae/0x146 [255299.637626] gmain S ffff9c81ee45ac80 0 2404 1 0x00000080 [255299.645648] Call Trace: [255299.648478] [] schedule+0x29/0x70 [255299.654120] [] schedule_hrtimeout_range_clock+0x12d/0x150 [255299.662090] [] ? add_wait_queue+0x3c/0x50 [255299.668508] [] schedule_hrtimeout_range+0x13/0x20 [255299.675716] [] poll_schedule_timeout+0x55/0xc0 [255299.682620] [] do_sys_poll+0x48d/0x590 [255299.688767] [] ? radix_tree_lookup_slot+0x22/0x50 [255299.695964] [] ? __find_get_page+0x1e/0xa0 [255299.702494] [] ? filemap_fault+0x17e/0x490 [255299.709025] [] ? ext4_filemap_fault+0x41/0x50 [ext4] [255299.716509] [] ? __pollwait+0xf0/0xf0 [255299.722539] [] ? __pollwait+0xf0/0xf0 [255299.728572] [] ? handle_pte_fault+0x22a/0xe20 [255299.735378] [] ? alloc_pages_current+0x98/0x110 [255299.742394] [] ? eventfd_ctx_read+0x67/0x1e0 [255299.749105] [] ? system_call_after_swapgs+0xae/0x146 [255299.756607] [] SyS_poll+0x74/0x110 [255299.762347] [] ? system_call_after_swapgs+0xa2/0x146 [255299.769833] [] ? system_call_after_swapgs+0xae/0x146 [255299.777319] [] system_call_fastpath+0x25/0x2a [255299.784126] [] ? system_call_after_swapgs+0xae/0x146 [255299.791612] gdbus S ffff9c7de8ffb150 0 2411 1 0x00000080 [255299.799591] Call Trace: [255299.802424] [] ? kmem_cache_free+0x1e2/0x200 [255299.809145] [] schedule+0x29/0x70 [255299.814787] [] schedule_hrtimeout_range_clock+0x12d/0x150 [255299.822766] [] ? add_wait_queue+0x3c/0x50 [255299.829197] [] ? add_wait_queue+0x3c/0x50 [255299.835615] [] schedule_hrtimeout_range+0x13/0x20 [255299.842810] [] poll_schedule_timeout+0x55/0xc0 [255299.849728] [] do_sys_poll+0x48d/0x590 [255299.855867] [] ? unix_stream_recvmsg+0x54/0x70 [255299.862771] [] ? unix_ioctl+0x70/0x70 [255299.868805] [] ? sock_recvmsg+0xc5/0x100 [255299.875128] [] ? __enqueue_entity+0x78/0x80 [255299.881748] [] ? __pollwait+0xf0/0xf0 [255299.887780] [] ? __pollwait+0xf0/0xf0 [255299.893814] [] ? ttwu_do_activate+0x6f/0x80 [255299.900427] [] ? try_to_wake_up+0x190/0x390 [255299.907044] [] ? default_wake_function+0x12/0x20 [255299.914142] [] ? pollwake+0x73/0x90 [255299.919980] [] ? wake_up_state+0x20/0x20 [255299.926304] [] ? __wake_up_common+0x82/0x120 [255299.933016] [] ? eventfd_ctx_read+0x67/0x1e0 [255299.939749] [] ? system_call_after_swapgs+0xae/0x146 [255299.947236] [] SyS_poll+0x74/0x110 [255299.952977] [] ? system_call_after_swapgs+0xa2/0x146 [255299.960461] [] ? system_call_after_swapgs+0xae/0x146 [255299.967961] [] system_call_fastpath+0x25/0x2a [255299.974790] [] ? system_call_after_swapgs+0xae/0x146 [255299.982278] polkitd S ffff9c81ee45ac80 0 2412 1 0x00000080 [255299.990277] Call Trace: [255299.993108] [] schedule+0x29/0x70 [255299.998753] [] schedule_hrtimeout_range_clock+0x12d/0x150 [255300.006737] [] ? add_wait_queue+0x3c/0x50 [255300.013147] [] schedule_hrtimeout_range+0x13/0x20 [255300.020360] [] poll_schedule_timeout+0x55/0xc0 [255300.027265] [] do_sys_poll+0x48d/0x590 [255300.033394] [] ? __enqueue_entity+0x78/0x80 [255300.040008] [] ? __alloc_pages_nodemask+0x184/0xbe0 [255300.047398] [] ? __alloc_pages_nodemask+0x184/0xbe0 [255300.054785] [] ? __pollwait+0xf0/0xf0 [255300.060819] [] ? sched_clock+0x9/0x10 [255300.066849] [] ? sched_clock_cpu+0x85/0xc0 [255300.073364] [] ? try_to_wake_up+0x190/0x390 [255300.079989] [] ? wake_up_q+0x5b/0x80 [255300.085925] [] ? futex_wake+0x90/0x180 [255300.092068] [] ? eventfd_ctx_read+0x67/0x1e0 [255300.098787] [] ? system_call_after_swapgs+0xae/0x146 [255300.106272] [] SyS_poll+0x74/0x110 [255300.112015] [] ? system_call_after_swapgs+0xa2/0x146 [255300.119522] [] ? system_call_after_swapgs+0xae/0x146 [255300.127007] [] system_call_fastpath+0x25/0x2a [255300.133815] [] ? system_call_after_swapgs+0xae/0x146 [255300.141302] JS GC Helper S ffff9c81ee45ac80 0 2413 1 0x00000080 [255300.149292] Call Trace: [255300.152145] [] schedule+0x29/0x70 [255300.157790] [] futex_wait_queue_me+0xc6/0x130 [255300.164599] [] futex_wait+0x17b/0x280 [255300.170641] [] ? handle_pte_fault+0x22a/0xe20 [255300.177449] [] ? alloc_pages_current+0x98/0x110 [255300.184480] [] do_futex+0x106/0x5a0 [255300.190324] [] SyS_futex+0x80/0x190 [255300.196162] [] ? system_call_after_swapgs+0xa2/0x146 [255300.203647] [] ? system_call_after_swapgs+0xae/0x146 [255300.211132] [] ? system_call_after_swapgs+0xa2/0x146 [255300.218638] [] ? system_call_after_swapgs+0xae/0x146 [255300.226124] [] ? system_call_after_swapgs+0xa2/0x146 [255300.233622] [] ? system_call_after_swapgs+0xae/0x146 [255300.241106] [] system_call_fastpath+0x25/0x2a [255300.247914] [] ? system_call_after_swapgs+0xae/0x146 [255300.255397] JS Sour~ Thread S ffff9c81ee31ac80 0 2414 1 0x00000080 [255300.263385] Call Trace: [255300.266240] [] schedule+0x29/0x70 [255300.271887] [] futex_wait_queue_me+0xc6/0x130 [255300.278693] [] futex_wait+0x17b/0x280 [255300.284749] [] ? page_add_new_anon_rmap+0xb8/0x170 [255300.292039] [] ? handle_pte_fault+0x6b4/0xe20 [255300.298846] [] ? get_futex_key+0x1c8/0x2c0 [255300.305365] [] do_futex+0x106/0x5a0 [255300.311204] [] ? cap_task_prctl+0x288/0x390 [255300.317820] [] ? yama_task_prctl+0x24/0x110 [255300.324431] [] ? cap_task_prctl+0x288/0x390 [255300.331055] [] ? strlcpy+0x42/0x60 [255300.336797] [] SyS_futex+0x80/0x190 [255300.342637] [] ? system_call_after_swapgs+0xa2/0x146 [255300.350123] [] ? system_call_after_swapgs+0xae/0x146 [255300.357607] [] ? system_call_after_swapgs+0xa2/0x146 [255300.365092] [] ? system_call_after_swapgs+0xae/0x146 [255300.372576] [] ? system_call_after_swapgs+0xa2/0x146 [255300.380064] [] ? system_call_after_swapgs+0xae/0x146 [255300.387550] [] system_call_fastpath+0x25/0x2a [255300.394358] [] ? system_call_after_swapgs+0xae/0x146 [255300.401845] polkitd S ffff9c7deed1ac80 0 2420 1 0x00000080 [255300.409866] Call Trace: [255300.412691] [] schedule+0x29/0x70 [255300.418343] [] schedule_hrtimeout_range_clock+0x12d/0x150 [255300.426313] [] ? add_wait_queue+0x3c/0x50 [255300.432733] [] schedule_hrtimeout_range+0x13/0x20 [255300.439932] [] poll_schedule_timeout+0x55/0xc0 [255300.446840] [] do_sys_poll+0x48d/0x590 [255300.452962] [] ? put_prev_entity+0x31/0x400 [255300.459575] [] ? __switch_to+0x151/0x580 [255300.465896] [] ? __schedule+0x402/0x840 [255300.472143] [] ? __pollwait+0xf0/0xf0 [255300.478174] [] ? futex_wait+0x195/0x280 [255300.484397] [] ? ttwu_do_wakeup+0x19/0xe0 [255300.490818] [] ? try_to_wake_up+0x190/0x390 [255300.497432] [] ? get_futex_key+0x1c8/0x2c0 [255300.503949] [] ? futex_wake+0x90/0x180 [255300.510082] [] ? eventfd_ctx_read+0x67/0x1e0 [255300.516792] [] ? system_call_after_swapgs+0xae/0x146 [255300.524276] [] SyS_poll+0x74/0x110 [255300.530020] [] ? system_call_after_swapgs+0xa2/0x146 [255300.537505] [] ? system_call_after_swapgs+0xae/0x146 [255300.544991] [] system_call_fastpath+0x25/0x2a [255300.551811] [] ? system_call_after_swapgs+0xae/0x146 [255300.559296] dbus-daemon S ffff9c7debabe2a0 0 2343 1 0x00000080 [255300.567306] Call Trace: [255300.570149] [] schedule+0x29/0x70 [255300.575797] [] schedule_hrtimeout_range_clock+0x12d/0x150 [255300.583768] [] ? ep_scan_ready_list.isra.7+0x1b9/0x1f0 [255300.591447] [] schedule_hrtimeout_range+0x13/0x20 [255300.598643] [] ep_poll+0x23e/0x360 [255300.604395] [] ? mntput+0x24/0x40 [255300.610046] [] ? wake_up_state+0x20/0x20 [255300.616380] [] SyS_epoll_wait+0xed/0x120 [255300.622702] [] ? system_call_after_swapgs+0xa2/0x146 [255300.630188] [] system_call_fastpath+0x25/0x2a [255300.637001] [] ? system_call_after_swapgs+0xae/0x146 [255300.644484] rpcbind S ffff9c7dd6f50000 0 2346 1 0x00000080 [255300.652481] Call Trace: [255300.655310] [] ? hrtimer_start_range_ns+0x1fd/0x3c0 [255300.662700] [] schedule+0x29/0x70 [255300.668354] [] schedule_hrtimeout_range_clock+0xb2/0x150 [255300.676230] [] ? hrtimer_get_res+0x50/0x50 [255300.682747] [] ? schedule_hrtimeout_range_clock+0xa6/0x150 [255300.690816] [] schedule_hrtimeout_range+0x13/0x20 [255300.698009] [] poll_schedule_timeout+0x55/0xc0 [255300.704926] [] do_sys_poll+0x48d/0x590 [255300.711057] [] ? task_rq_unlock+0x20/0x20 [255300.717477] [] ? __wake_up_sync_key+0x1d/0x20 [255300.724284] [] ? __pollwait+0xf0/0xf0 [255300.730321] [] ? __pollwait+0xf0/0xf0 [255300.736352] [] ? __pollwait+0xf0/0xf0 [255300.742396] [] ? __pollwait+0xf0/0xf0 [255300.748427] [] ? __pollwait+0xf0/0xf0 [255300.754469] [] ? __pollwait+0xf0/0xf0 [255300.760499] [] ? __pollwait+0xf0/0xf0 [255300.766533] [] ? ktime_get_ts64+0x52/0xf0 [255300.772951] [] SyS_poll+0x74/0x110 [255300.778691] [] system_call_fastpath+0x25/0x2a [255300.785527] [] ? system_call_after_swapgs+0xae/0x146 [255300.793013] zed S ffff9c81ee31ac80 0 2415 1 0x00000080 [255300.801017] Call Trace: [255300.803852] [] schedule+0x29/0x70 [255300.809498] [] cv_wait_common+0x125/0x150 [spl] [255300.816513] [] ? wake_up_atomic_t+0x30/0x30 [255300.823124] [] __cv_wait_sig+0x15/0x40 [spl] [255300.829889] [] zfs_zevent_wait+0x49/0x100 [zfs] [255300.836960] [] zfs_ioc_events_next+0x66/0xe0 [zfs] [255300.844313] [] zfsdev_ioctl+0x864/0x8c0 [zfs] [255300.851124] [] do_vfs_ioctl+0x3a0/0x5a0 [255300.857350] [] ? __do_page_fault+0x238/0x500 [255300.864062] [] SyS_ioctl+0xa1/0xc0 [255300.869805] [] ? system_call_after_swapgs+0xa2/0x146 [255300.877291] [] system_call_fastpath+0x25/0x2a [255300.884120] [] ? system_call_after_swapgs+0xae/0x146 [255300.891606] zed S ffff9c81ee55ac80 0 2468 1 0x00000080 [255300.899612] Call Trace: [255300.902456] [] schedule+0x29/0x70 [255300.908103] [] futex_wait_queue_me+0xc6/0x130 [255300.914911] [] futex_wait+0x17b/0x280 [255300.920944] [] ? handle_pte_fault+0x22a/0xe20 [255300.927752] [] ? put_prev_entity+0x31/0x400 [255300.934376] [] ? pick_next_task_fair+0x1c6/0x870 [255300.941488] [] do_futex+0x106/0x5a0 [255300.947336] [] SyS_futex+0x80/0x190 [255300.953185] [] ? system_call_after_swapgs+0xa2/0x146 [255300.960675] [] ? system_call_after_swapgs+0xae/0x146 [255300.968172] [] ? system_call_after_swapgs+0xa2/0x146 [255300.975665] [] ? system_call_after_swapgs+0xae/0x146 [255300.983153] [] ? system_call_after_swapgs+0xa2/0x146 [255300.990651] [] ? system_call_after_swapgs+0xae/0x146 [255300.998146] [] system_call_fastpath+0x25/0x2a [255301.004952] [] ? system_call_after_swapgs+0xae/0x146 [255301.012439] zed S ffff9c81ea063150 0 2469 1 0x00000080 [255301.020451] Call Trace: [255301.023294] [] schedule+0x29/0x70 [255301.028951] [] schedule_timeout+0x221/0x2d0 [255301.035581] [] ? prepare_to_wait_exclusive+0x56/0x90 [255301.043068] [] __skb_wait_for_more_packets+0x120/0x180 [255301.050750] [] ? datagram_poll+0x110/0x110 [255301.057269] [] __skb_recv_datagram+0x6f/0xd0 [255301.063985] [] skb_recv_datagram+0x43/0x60 [255301.070503] [] netlink_recvmsg+0x62/0x490 [255301.076922] [] sock_recvmsg+0xc5/0x100 [255301.083068] [] ? ext4_filemap_fault+0x41/0x50 [ext4] [255301.090555] [] ___sys_recvmsg+0x133/0x2d0 [255301.096974] [] ? handle_mm_fault+0x39d/0x9b0 [255301.103685] [] ? update_curr+0x14c/0x1e0 [255301.110007] [] __sys_recvmsg+0x51/0x90 [255301.116155] [] SyS_recvmsg+0x12/0x20 [255301.122100] [] system_call_fastpath+0x25/0x2a [255301.128907] [] ? system_call_after_swapgs+0xae/0x146 [255301.136392] irqbalance S ffff9c7a71211070 0 2416 1 0x00000080 [255301.144398] Call Trace: [255301.147246] [] ? hrtimer_start_range_ns+0x1fd/0x3c0 [255301.154634] [] schedule+0x29/0x70 [255301.160278] [] do_nanosleep+0x70/0x100 [255301.166412] [] hrtimer_nanosleep+0xbb/0x180 [255301.173027] [] ? hrtimer_get_res+0x50/0x50 [255301.179558] [] ? do_nanosleep+0x5b/0x100 [255301.185886] [] SyS_nanosleep+0x96/0xb0 [255301.192015] [] system_call_fastpath+0x25/0x2a [255301.198820] [] ? system_call_after_swapgs+0xae/0x146 [255301.206304] NetworkManager S ffff9c7a712120e0 0 2417 1 0x00000080 [255301.214329] Call Trace: [255301.217176] [] ? hrtimer_start_range_ns+0x1fd/0x3c0 [255301.224568] [] schedule+0x29/0x70 [255301.230212] [] schedule_hrtimeout_range_clock+0xb2/0x150 [255301.238090] [] ? hrtimer_get_res+0x50/0x50 [255301.244599] [] ? schedule_hrtimeout_range_clock+0xa6/0x150 [255301.252678] [] schedule_hrtimeout_range+0x13/0x20 [255301.259882] [] poll_schedule_timeout+0x55/0xc0 [255301.266786] [] do_sys_poll+0x48d/0x590 [255301.272920] [] ? put_prev_entity+0x31/0x400 [255301.279533] [] ? __switch_to+0x151/0x580 [255301.285856] [] ? __schedule+0x402/0x840 [255301.292080] [] ? get_futex_key+0x1c8/0x2c0 [255301.298599] [] ? __pollwait+0xf0/0xf0 [255301.304642] [] ? __pollwait+0xf0/0xf0 [255301.310673] [] ? __pollwait+0xf0/0xf0 [255301.316717] [] ? __pollwait+0xf0/0xf0 [255301.322761] [] ? __pollwait+0xf0/0xf0 [255301.328792] [] ? __pollwait+0xf0/0xf0 [255301.334838] [] ? __pollwait+0xf0/0xf0 [255301.340871] [] ? __pollwait+0xf0/0xf0 [255301.346903] [] ? ktime_get_ts64+0x52/0xf0 [255301.353335] [] SyS_poll+0x74/0x110 [255301.359067] [] system_call_fastpath+0x25/0x2a [255301.365874] [] ? system_call_after_swapgs+0xae/0x146 [255301.373358] gmain S ffff9c81eb309070 0 2491 1 0x00000080 [255301.381379] Call Trace: [255301.384208] [] ? hrtimer_start_range_ns+0x1fd/0x3c0 [255301.391609] [] schedule+0x29/0x70 [255301.397251] [] schedule_hrtimeout_range_clock+0xb2/0x150 [255301.405127] [] ? hrtimer_get_res+0x50/0x50 [255301.411642] [] ? schedule_hrtimeout_range_clock+0xa6/0x150 [255301.419727] [] schedule_hrtimeout_range+0x13/0x20 [255301.426920] [] poll_schedule_timeout+0x55/0xc0 [255301.433824] [] do_sys_poll+0x48d/0x590 [255301.439962] [] ? __d_lookup_rcu+0x50/0x160 [255301.446479] [] ? security_inode_permission+0x22/0x30 [255301.453967] [] ? __inode_permission+0x52/0xd0 [255301.460776] [] ? __pollwait+0xf0/0xf0 [255301.466816] [] ? __pollwait+0xf0/0xf0 [255301.472847] [] ? path_lookupat+0x1ea/0x8b0 [255301.479375] [] ? kmem_cache_alloc+0x35/0x1f0 [255301.486084] [] ? getname_flags+0x4f/0x1a0 [255301.492501] [] ? putname+0x3d/0x60 [255301.498242] [] ? user_path_at_empty+0x72/0xc0 [255301.505059] [] ? ktime_get_ts64+0x52/0xf0 [255301.511482] [] SyS_poll+0x74/0x110 [255301.517244] [] system_call_fastpath+0x25/0x2a [255301.524044] [] ? system_call_after_swapgs+0xae/0x146 [255301.531529] gdbus S ffff9c7debaba0e0 0 2494 1 0x00000080 [255301.539539] Call Trace: [255301.542370] [] ? kmem_cache_free+0x1e2/0x200 [255301.549080] [] schedule+0x29/0x70 [255301.554735] [] schedule_hrtimeout_range_clock+0x12d/0x150 [255301.562705] [] ? add_wait_queue+0x3c/0x50 [255301.569125] [] ? __pollwait+0x7f/0xf0 [255301.575158] [] ? add_wait_queue+0x3c/0x50 [255301.581580] [] schedule_hrtimeout_range+0x13/0x20 [255301.588776] [] poll_schedule_timeout+0x55/0xc0 [255301.595692] [] do_sys_poll+0x48d/0x590 [255301.601821] [] ? unix_stream_recvmsg+0x54/0x70 [255301.608735] [] ? unix_ioctl+0x70/0x70 [255301.614769] [] ? sock_recvmsg+0xc5/0x100 [255301.621106] [] ? __enqueue_entity+0x78/0x80 [255301.627730] [] ? __pollwait+0xf0/0xf0 [255301.633765] [] ? __pollwait+0xf0/0xf0 [255301.639794] [] ? __pollwait+0xf0/0xf0 [255301.645824] [] ? try_to_wake_up+0x190/0x390 [255301.652436] [] ? default_wake_function+0x12/0x20 [255301.659531] [] ? pollwake+0x73/0x90 [255301.665379] [] ? wake_up_state+0x20/0x20 [255301.671703] [] ? __wake_up_common+0x82/0x120 [255301.678418] [] ? eventfd_ctx_read+0x67/0x1e0 [255301.685129] [] ? system_call_after_swapgs+0xae/0x146 [255301.692617] [] SyS_poll+0x74/0x110 [255301.698357] [] ? system_call_after_swapgs+0xa2/0x146 [255301.705843] [] ? system_call_after_swapgs+0xae/0x146 [255301.713349] [] system_call_fastpath+0x25/0x2a [255301.720159] [] ? system_call_after_swapgs+0xae/0x146 [255301.727655] sssd S ffff9c7a71213150 0 2418 1 0x00000080 [255301.735660] Call Trace: [255301.738513] [] ? hrtimer_start_range_ns+0x1fd/0x3c0 [255301.745901] [] schedule+0x29/0x70 [255301.751546] [] schedule_hrtimeout_range_clock+0xb2/0x150 [255301.759426] [] ? hrtimer_get_res+0x50/0x50 [255301.765941] [] ? schedule_hrtimeout_range_clock+0xa6/0x150 [255301.774032] [] schedule_hrtimeout_range+0x13/0x20 [255301.781226] [] poll_schedule_timeout+0x55/0xc0 [255301.788131] [] do_sys_poll+0x48d/0x590 [255301.794268] [] ? sock_recvmsg+0xc5/0x100 [255301.800605] [] ? __pollwait+0xf0/0xf0 [255301.806657] [] ? __pollwait+0xf0/0xf0 [255301.812699] [] ? __pollwait+0xf0/0xf0 [255301.818729] [] ? __pollwait+0xf0/0xf0 [255301.824761] [] ? __pollwait+0xf0/0xf0 [255301.830792] [] ? __pollwait+0xf0/0xf0 [255301.836824] [] ? __pollwait+0xf0/0xf0 [255301.842853] [] ? __pollwait+0xf0/0xf0 [255301.848885] [] ? __pollwait+0xf0/0xf0 [255301.854916] [] SyS_poll+0x74/0x110 [255301.860666] [] system_call_fastpath+0x25/0x2a [255301.867475] [] ? system_call_after_swapgs+0xae/0x146 [255301.874961] mcelog S ffff9c81ee49ac80 0 2437 1 0x00000080 [255301.882982] Call Trace: [255301.885813] [] schedule+0x29/0x70 [255301.891479] [] schedule_hrtimeout_range_clock+0x12d/0x150 [255301.899450] [] ? add_wait_queue+0x3c/0x50 [255301.905868] [] ? add_wait_queue+0x3c/0x50 [255301.912286] [] schedule_hrtimeout_range+0x13/0x20 [255301.919491] [] poll_schedule_timeout+0x55/0xc0 [255301.926417] [] do_sys_poll+0x48d/0x590 [255301.932543] [] ? shmem_add_to_page_cache.isra.26+0xd0/0x120 [255301.940707] [] ? __radix_tree_lookup+0x84/0xf0 [255301.947611] [] ? radix_tree_lookup_slot+0x22/0x50 [255301.954805] [] ? __find_get_page+0x1e/0xa0 [255301.961322] [] ? filemap_fault+0x17e/0x490 [255301.967839] [] ? __pollwait+0xf0/0xf0 [255301.973869] [] ? __pollwait+0xf0/0xf0 [255301.979900] [] ? unlock_page+0x2b/0x30 [255301.986030] [] ? do_read_fault.isra.63+0x139/0x1b0 [255301.993321] [] ? handle_pte_fault+0x22a/0xe20 [255302.000129] [] ? arch_tlb_finish_mmu+0x47/0x80 [255302.007033] [] ? tlb_finish_mmu+0x23/0x30 [255302.013452] [] ? unmap_region+0xf4/0x140 [255302.019787] [] ? handle_mm_fault+0x39d/0x9b0 [255302.026502] [] ? recalc_sigpending+0x1b/0x70 [255302.033212] [] ? __set_task_blocked+0x41/0xa0 [255302.040030] [] SyS_ppoll+0xee/0x1f0 [255302.045866] [] ? system_call_after_swapgs+0xa2/0x146 [255302.053350] [] ? system_call_after_swapgs+0xae/0x146 [255302.060835] [] ? system_call_after_swapgs+0xa2/0x146 [255302.068333] [] ? system_call_after_swapgs+0xae/0x146 [255302.075832] [] system_call_fastpath+0x25/0x2a [255302.082654] [] ? system_call_after_swapgs+0xae/0x146 [255302.090163] gssproxy S ffff9c7dd6f541c0 0 2481 1 0x00000080 [255302.098178] Call Trace: [255302.101021] [] schedule+0x29/0x70 [255302.106671] [] schedule_hrtimeout_range_clock+0xb2/0x150 [255302.114549] [] ? hrtimer_get_res+0x50/0x50 [255302.121056] [] ? schedule_hrtimeout_range_clock+0xa6/0x150 [255302.129122] [] schedule_hrtimeout_range+0x13/0x20 [255302.136328] [] ep_poll+0x23e/0x360 [255302.142083] [] ? wake_up_state+0x20/0x20 [255302.148417] [] SyS_epoll_wait+0xed/0x120 [255302.154741] [] ? system_call_after_swapgs+0xa2/0x146 [255302.162227] [] system_call_fastpath+0x25/0x2a [255302.169044] [] ? system_call_after_swapgs+0xae/0x146 [255302.176534] gssproxy S ffff9c7deec5ac80 0 2484 1 0x00000080 [255302.184532] Call Trace: [255302.187363] [] schedule+0x29/0x70 [255302.193008] [] futex_wait_queue_me+0xc6/0x130 [255302.199817] [] futex_wait+0x17b/0x280 [255302.205848] [] ? handle_pte_fault+0x1a2/0xe20 [255302.212667] [] do_futex+0x106/0x5a0 [255302.218532] [] SyS_futex+0x80/0x190 [255302.224370] [] ? system_call_after_swapgs+0xa2/0x146 [255302.231858] [] ? system_call_after_swapgs+0xae/0x146 [255302.239343] [] ? system_call_after_swapgs+0xa2/0x146 [255302.246837] [] ? system_call_after_swapgs+0xae/0x146 [255302.254321] [] ? system_call_after_swapgs+0xa2/0x146 [255302.261806] [] ? system_call_after_swapgs+0xae/0x146 [255302.269296] [] system_call_fastpath+0x25/0x2a [255302.276107] [] ? system_call_after_swapgs+0xae/0x146 [255302.283588] gssproxy S ffff9c7deec9ac80 0 2485 1 0x00000080 [255302.291589] Call Trace: [255302.294413] [] schedule+0x29/0x70 [255302.300058] [] futex_wait_queue_me+0xc6/0x130 [255302.306880] [] futex_wait+0x17b/0x280 [255302.312913] [] ? handle_pte_fault+0x22a/0xe20 [255302.319720] [] ? put_prev_entity+0x31/0x400 [255302.326334] [] ? pick_next_task_fair+0x1c6/0x870 [255302.333444] [] do_futex+0x106/0x5a0 [255302.339284] [] SyS_futex+0x80/0x190 [255302.345132] [] ? system_call_after_swapgs+0xa2/0x146 [255302.352629] [] ? system_call_after_swapgs+0xae/0x146 [255302.360116] [] ? system_call_after_swapgs+0xa2/0x146 [255302.367602] [] ? system_call_after_swapgs+0xae/0x146 [255302.375088] [] ? system_call_after_swapgs+0xa2/0x146 [255302.382587] [] ? system_call_after_swapgs+0xae/0x146 [255302.390079] [] system_call_fastpath+0x25/0x2a [255302.396887] [] ? system_call_after_swapgs+0xae/0x146 [255302.404370] gssproxy S ffff9c81ee4dac80 0 2486 1 0x00000080 [255302.412379] Call Trace: [255302.415231] [] schedule+0x29/0x70 [255302.420875] [] futex_wait_queue_me+0xc6/0x130 [255302.427683] [] futex_wait+0x17b/0x280 [255302.433728] [] ? put_prev_entity+0x31/0x400 [255302.440340] [] ? pick_next_task_fair+0x1c6/0x870 [255302.447437] [] do_futex+0x106/0x5a0 [255302.453273] [] ? schedule+0x29/0x70 [255302.459120] [] ? do_exit+0x6ce/0xa50 [255302.465056] [] SyS_futex+0x80/0x190 [255302.470893] [] ? system_call_after_swapgs+0xa2/0x146 [255302.478378] [] ? system_call_after_swapgs+0xae/0x146 [255302.485862] [] ? system_call_after_swapgs+0xa2/0x146 [255302.493375] [] ? system_call_after_swapgs+0xae/0x146 [255302.500859] [] ? system_call_after_swapgs+0xa2/0x146 [255302.508344] [] ? system_call_after_swapgs+0xae/0x146 [255302.515835] [] system_call_fastpath+0x25/0x2a [255302.522642] [] ? system_call_after_swapgs+0xae/0x146 [255302.530133] gssproxy S ffff9c7deec5ac80 0 2487 1 0x00000080 [255302.538133] Call Trace: [255302.540976] [] schedule+0x29/0x70 [255302.546639] [] futex_wait_queue_me+0xc6/0x130 [255302.553449] [] futex_wait+0x17b/0x280 [255302.559481] [] ? put_prev_entity+0x31/0x400 [255302.566093] [] ? pick_next_task_fair+0x1c6/0x870 [255302.573206] [] do_futex+0x106/0x5a0 [255302.579045] [] ? schedule+0x29/0x70 [255302.584882] [] ? do_exit+0x6ce/0xa50 [255302.590829] [] SyS_futex+0x80/0x190 [255302.596679] [] ? system_call_after_swapgs+0xa2/0x146 [255302.604163] [] ? system_call_after_swapgs+0xae/0x146 [255302.611649] [] ? system_call_after_swapgs+0xa2/0x146 [255302.619136] [] ? system_call_after_swapgs+0xae/0x146 [255302.626620] [] ? system_call_after_swapgs+0xa2/0x146 [255302.634117] [] ? system_call_after_swapgs+0xae/0x146 [255302.641612] [] system_call_fastpath+0x25/0x2a [255302.648421] [] ? system_call_after_swapgs+0xae/0x146 [255302.655916] gssproxy S ffff9c79f6b20000 0 2488 1 0x00000080 [255302.663914] Call Trace: [255302.666747] [] schedule+0x29/0x70 [255302.672402] [] futex_wait_queue_me+0xc6/0x130 [255302.679223] [] futex_wait+0x17b/0x280 [255302.685255] [] ? __sb_end_write+0x31/0x70 [255302.691685] [] ? pipe_write+0x48f/0x540 [255302.697911] [] do_futex+0x106/0x5a0 [255302.703754] [] SyS_futex+0x80/0x190 [255302.709602] [] ? system_call_after_swapgs+0xa2/0x146 [255302.717090] [] ? system_call_after_swapgs+0xae/0x146 [255302.724574] [] ? system_call_after_swapgs+0xa2/0x146 [255302.732073] [] ? system_call_after_swapgs+0xae/0x146 [255302.739549] [] ? system_call_after_swapgs+0xa2/0x146 [255302.747036] [] ? system_call_after_swapgs+0xae/0x146 [255302.754531] [] system_call_fastpath+0x25/0x2a [255302.761349] [] ? system_call_after_swapgs+0xae/0x146 [255302.768834] kworker/25:1H S ffff9c81ebaea0e0 0 2482 2 0x00000080 [255302.776847] Call Trace: [255302.779677] [] ? process_one_work+0x21a/0x440 [255302.786489] [] schedule+0x29/0x70 [255302.792140] [] worker_thread+0x1d9/0x3c0 [255302.798464] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255302.805854] [] kthread+0xd1/0xe0 [255302.811412] [] ? insert_kthread_work+0x40/0x40 [255302.818323] [] ret_from_fork_nospec_begin+0x21/0x21 [255302.825712] [] ? insert_kthread_work+0x40/0x40 [255302.832617] rpc.gssd S ffff9c7debabd230 0 2490 1 0x00000080 [255302.840619] Call Trace: [255302.843453] [] ? call_rcu_sched+0x1d/0x20 [255302.849872] [] schedule+0x29/0x70 [255302.855538] [] schedule_hrtimeout_range_clock+0x12d/0x150 [255302.863513] [] ? ep_scan_ready_list.isra.7+0x1b9/0x1f0 [255302.871201] [] schedule_hrtimeout_range+0x13/0x20 [255302.878397] [] ep_poll+0x23e/0x360 [255302.884136] [] ? abort_exclusive_wait+0xa0/0xa0 [255302.891138] [] ? wake_up_state+0x20/0x20 [255302.897476] [] SyS_epoll_wait+0xed/0x120 [255302.903801] [] ? system_call_after_swapgs+0xa2/0x146 [255302.911289] [] system_call_fastpath+0x25/0x2a [255302.918103] [] ? system_call_after_swapgs+0xae/0x146 [255302.925594] mlx4_en S ffff9c81ee45ac80 0 2532 2 0x00000080 [255302.933623] Call Trace: [255302.936452] [] schedule+0x29/0x70 [255302.942094] [] rescuer_thread+0x31e/0x3c0 [255302.948523] [] ? process_one_work+0x440/0x440 [255302.955331] [] kthread+0xd1/0xe0 [255302.960877] [] ? insert_kthread_work+0x40/0x40 [255302.967784] [] ret_from_fork_nospec_begin+0x21/0x21 [255302.975174] [] ? insert_kthread_work+0x40/0x40 [255302.982075] sssd_be S ffff9c7dd6f55230 0 2537 2418 0x00000080 [255302.990086] Call Trace: [255302.992926] [] schedule+0x29/0x70 [255302.998576] [] schedule_hrtimeout_range_clock+0xb2/0x150 [255303.006451] [] ? hrtimer_get_res+0x50/0x50 [255303.012980] [] ? schedule_hrtimeout_range_clock+0xa6/0x150 [255303.021055] [] schedule_hrtimeout_range+0x13/0x20 [255303.028249] [] ep_poll+0x23e/0x360 [255303.033989] [] ? recalc_sigpending+0x1b/0x70 [255303.040700] [] ? wake_up_state+0x20/0x20 [255303.047029] [] SyS_epoll_wait+0xed/0x120 [255303.053363] [] ? system_call_after_swapgs+0xa2/0x146 [255303.060850] [] system_call_fastpath+0x25/0x2a [255303.067656] [] ? system_call_after_swapgs+0xae/0x146 [255303.075152] mlx5_ib_sigerr_ S ffff9c81ebaeb150 0 2561 2 0x00000080 [255303.083169] Call Trace: [255303.086001] [] schedule+0x29/0x70 [255303.091645] [] rescuer_thread+0x31e/0x3c0 [255303.098065] [] ? process_one_work+0x440/0x440 [255303.104872] [] kthread+0xd1/0xe0 [255303.110418] [] ? insert_kthread_work+0x40/0x40 [255303.117322] [] ret_from_fork_nospec_begin+0x21/0x21 [255303.124712] [] ? insert_kthread_work+0x40/0x40 [255303.131617] dhclient S ffff9c7a712141c0 0 2563 2417 0x00000080 [255303.139617] Call Trace: [255303.142462] [] schedule+0x29/0x70 [255303.148104] [] schedule_hrtimeout_range_clock+0xb2/0x150 [255303.155980] [] ? hrtimer_get_res+0x50/0x50 [255303.162508] [] ? schedule_hrtimeout_range_clock+0xa6/0x150 [255303.170575] [] schedule_hrtimeout_range+0x13/0x20 [255303.177768] [] poll_schedule_timeout+0x55/0xc0 [255303.184672] [] do_select+0x6d1/0x7c0 [255303.190615] [] ? __pollwait+0xf0/0xf0 [255303.196647] [] ? __pollwait+0xf0/0xf0 [255303.202679] [] ? kmem_cache_free+0x1e2/0x200 [255303.209397] [] ? kfree_skbmem+0x37/0x90 [255303.215622] [] ? consume_skb+0x34/0x90 [255303.221752] [] ? skb_consume_udp+0x23/0x80 [255303.228281] [] ? udp_recvmsg+0x2a4/0x480 [255303.234604] [] ? unlock_page+0x2b/0x30 [255303.240731] [] ? do_wp_page+0x19e/0x720 [255303.246956] [] ? __check_object_size+0x1ca/0x250 [255303.254053] [] core_sys_select+0x1ff/0x340 [255303.260576] [] ? handle_mm_fault+0x39d/0x9b0 [255303.267289] [] ? ktime_get_ts64+0x52/0xf0 [255303.273709] [] SyS_select+0xca/0x120 [255303.279642] [] system_call_fastpath+0x25/0x2a [255303.286452] [] ? system_call_after_swapgs+0xae/0x146 [255303.293936] sssd_nss S ffff9c7de8ff8000 0 2577 2418 0x00000080 [255303.301932] Call Trace: [255303.304755] [] schedule+0x29/0x70 [255303.310399] [] schedule_hrtimeout_range_clock+0xb2/0x150 [255303.318274] [] ? hrtimer_get_res+0x50/0x50 [255303.324790] [] ? schedule_hrtimeout_range_clock+0xa6/0x150 [255303.332857] [] schedule_hrtimeout_range+0x13/0x20 [255303.340051] [] ep_poll+0x23e/0x360 [255303.345793] [] ? recalc_sigpending+0x1b/0x70 [255303.352503] [] ? wake_up_state+0x20/0x20 [255303.358825] [] SyS_epoll_wait+0xed/0x120 [255303.365155] [] ? system_call_after_swapgs+0xa2/0x146 [255303.372642] [] system_call_fastpath+0x25/0x2a [255303.379474] [] ? system_call_after_swapgs+0xae/0x146 [255303.386957] sssd_pam S ffff9c7de8ffe2a0 0 2578 2418 0x00000080 [255303.394979] Call Trace: [255303.397809] [] schedule+0x29/0x70 [255303.403471] [] schedule_hrtimeout_range_clock+0xb2/0x150 [255303.411375] [] ? hrtimer_get_res+0x50/0x50 [255303.417892] [] ? schedule_hrtimeout_range_clock+0xa6/0x150 [255303.425984] [] schedule_hrtimeout_range+0x13/0x20 [255303.433171] [] ep_poll+0x23e/0x360 [255303.438923] [] ? recalc_sigpending+0x1b/0x70 [255303.445633] [] ? wake_up_state+0x20/0x20 [255303.451955] [] SyS_epoll_wait+0xed/0x120 [255303.458299] [] ? system_call_after_swapgs+0xa2/0x146 [255303.465782] [] system_call_fastpath+0x25/0x2a [255303.472588] [] ? system_call_after_swapgs+0xae/0x146 [255303.480070] sssd_ssh S ffff9c7de8ffc1c0 0 2579 2418 0x00000080 [255303.488092] Call Trace: [255303.490929] [] schedule+0x29/0x70 [255303.496574] [] schedule_hrtimeout_range_clock+0xb2/0x150 [255303.504451] [] ? hrtimer_get_res+0x50/0x50 [255303.510984] [] ? schedule_hrtimeout_range_clock+0xa6/0x150 [255303.519050] [] schedule_hrtimeout_range+0x13/0x20 [255303.526258] [] ep_poll+0x23e/0x360 [255303.531997] [] ? recalc_sigpending+0x1b/0x70 [255303.538708] [] ? wake_up_state+0x20/0x20 [255303.545029] [] SyS_epoll_wait+0xed/0x120 [255303.551352] [] ? system_call_after_swapgs+0xa2/0x146 [255303.558847] [] system_call_fastpath+0x25/0x2a [255303.565664] [] ? system_call_after_swapgs+0xae/0x146 [255303.573159] sssd_pac S ffff9c7de8ffd230 0 2580 2418 0x00000080 [255303.581169] Call Trace: [255303.584002] [] schedule+0x29/0x70 [255303.589648] [] schedule_hrtimeout_range_clock+0xb2/0x150 [255303.597524] [] ? hrtimer_get_res+0x50/0x50 [255303.604046] [] ? schedule_hrtimeout_range_clock+0xa6/0x150 [255303.612114] [] schedule_hrtimeout_range+0x13/0x20 [255303.619307] [] ep_poll+0x23e/0x360 [255303.625046] [] ? recalc_sigpending+0x1b/0x70 [255303.631757] [] ? wake_up_state+0x20/0x20 [255303.638081] [] SyS_epoll_wait+0xed/0x120 [255303.644409] [] ? system_call_after_swapgs+0xa2/0x146 [255303.651893] [] system_call_fastpath+0x25/0x2a [255303.658701] [] ? system_call_after_swapgs+0xae/0x146 [255303.666187] systemd-logind S ffff9c7dea47b150 0 2597 1 0x00000080 [255303.674225] Call Trace: [255303.677060] [] schedule+0x29/0x70 [255303.682716] [] schedule_hrtimeout_range_clock+0x12d/0x150 [255303.690680] [] ? ep_scan_ready_list.isra.7+0x1b9/0x1f0 [255303.698359] [] schedule_hrtimeout_range+0x13/0x20 [255303.705553] [] ep_poll+0x23e/0x360 [255303.711294] [] ? wake_up_state+0x20/0x20 [255303.717615] [] SyS_epoll_wait+0xed/0x120 [255303.723950] [] ? system_call_after_swapgs+0xa2/0x146 [255303.731427] [] system_call_fastpath+0x25/0x2a [255303.738246] [] ? system_call_after_swapgs+0xae/0x146 [255303.745730] ipoib_wq S ffff9c81ebae9070 0 2630 2 0x00000080 [255303.753722] Call Trace: [255303.756554] [] schedule+0x29/0x70 [255303.762198] [] rescuer_thread+0x31e/0x3c0 [255303.768635] [] ? process_one_work+0x440/0x440 [255303.775445] [] kthread+0xd1/0xe0 [255303.780991] [] ? insert_kthread_work+0x40/0x40 [255303.787909] [] ret_from_fork_nospec_begin+0x21/0x21 [255303.795298] [] ? insert_kthread_work+0x40/0x40 [255303.802219] ipoib_wq S ffff9c7de9ed8000 0 2631 2 0x00000080 [255303.810222] Call Trace: [255303.813055] [] schedule+0x29/0x70 [255303.818699] [] rescuer_thread+0x31e/0x3c0 [255303.825130] [] ? process_one_work+0x440/0x440 [255303.831936] [] kthread+0xd1/0xe0 [255303.837495] [] ? insert_kthread_work+0x40/0x40 [255303.844407] [] ret_from_fork_nospec_begin+0x21/0x21 [255303.851797] [] ? insert_kthread_work+0x40/0x40 [255303.858702] rdma_cm S ffff9c7deb84b150 0 2655 2 0x00000080 [255303.866721] Call Trace: [255303.869567] [] schedule+0x29/0x70 [255303.875211] [] rescuer_thread+0x31e/0x3c0 [255303.881635] [] ? process_one_work+0x440/0x440 [255303.888453] [] kthread+0xd1/0xe0 [255303.894000] [] ? insert_kthread_work+0x40/0x40 [255303.900933] [] ret_from_fork_nospec_begin+0x21/0x21 [255303.908326] [] ? insert_kthread_work+0x40/0x40 [255303.915228] rsyslogd S ffff9c79f61462a0 0 3036 1 0x00000080 [255303.923255] Call Trace: [255303.926097] [] schedule+0x29/0x70 [255303.931740] [] schedule_hrtimeout_range_clock+0xb2/0x150 [255303.939628] [] ? hrtimer_get_res+0x50/0x50 [255303.946143] [] ? schedule_hrtimeout_range_clock+0xa6/0x150 [255303.954222] [] schedule_hrtimeout_range+0x13/0x20 [255303.961430] [] poll_schedule_timeout+0x55/0xc0 [255303.968334] [] do_select+0x6d1/0x7c0 [255303.974267] [] ? do_page_add_anon_rmap+0x9a/0xc0 [255303.981398] [] ? task_scan_max+0x27/0x40 [255303.987720] [] ? task_numa_fault+0x8d0/0xbb0 [255303.994449] [] ? do_numa_page+0x1be/0x250 [255304.000870] [] ? handle_pte_fault+0x2b9/0xe20 [255304.007682] [] ? putback_lru_page+0x52/0xc0 [255304.014295] [] ? migrate_pages+0x531/0x7b0 [255304.020810] [] ? should_numa_migrate_memory+0x5b/0x150 [255304.028516] [] ? mpol_misplaced+0x18c/0x1e0 [255304.035128] [] ? handle_mm_fault+0x39d/0x9b0 [255304.041839] [] ? do_numa_page+0x1be/0x250 [255304.048259] [] core_sys_select+0x1ff/0x340 [255304.054776] [] ? handle_mm_fault+0x39d/0x9b0 [255304.061507] [] ? ktime_get_ts64+0x52/0xf0 [255304.067926] [] SyS_select+0xca/0x120 [255304.073859] [] system_call_fastpath+0x25/0x2a [255304.080666] [] ? system_call_after_swapgs+0xae/0x146 [255304.088151] in:imjournal S ffff9c81ccda62a0 0 3043 1 0x00000080 [255304.096149] Call Trace: [255304.098978] [] ? hrtimer_start_range_ns+0x1fd/0x3c0 [255304.106367] [] schedule+0x29/0x70 [255304.112009] [] schedule_hrtimeout_range_clock+0xb2/0x150 [255304.119884] [] ? hrtimer_get_res+0x50/0x50 [255304.126415] [] ? schedule_hrtimeout_range_clock+0xa6/0x150 [255304.134482] [] schedule_hrtimeout_range+0x13/0x20 [255304.141675] [] poll_schedule_timeout+0x55/0xc0 [255304.148586] [] do_sys_poll+0x48d/0x590 [255304.154717] [] ? __wake_up_common_lock+0x91/0xc0 [255304.161814] [] ? shmem_fault+0x84/0x1f0 [255304.168040] [] ? fsnotify_grab_connector+0x43/0x70 [255304.175332] [] ? __pollwait+0xf0/0xf0 [255304.181362] [] ? sched_clock+0x9/0x10 [255304.187397] [] ? sched_clock_cpu+0x85/0xc0 [255304.193913] [] ? try_to_wake_up+0x190/0x390 [255304.200528] [] ? wake_up_q+0x5b/0x80 [255304.206464] [] ? futex_wake_op+0x3b5/0x640 [255304.212992] [] ? do_futex+0x17a/0x5a0 [255304.219025] [] ? ktime_get_ts64+0x52/0xf0 [255304.225456] [] SyS_ppoll+0x1d3/0x1f0 [255304.231393] [] ? system_call_after_swapgs+0xa2/0x146 [255304.238880] [] ? system_call_after_swapgs+0xae/0x146 [255304.246377] [] system_call_fastpath+0x25/0x2a [255304.253184] [] ? system_call_after_swapgs+0xae/0x146 [255304.260669] rs:main Q:Reg S ffff9c81e7c51070 0 3046 1 0x00000080 [255304.268667] Call Trace: [255304.271513] [] schedule+0x29/0x70 [255304.277156] [] futex_wait_queue_me+0xc6/0x130 [255304.283964] [] futex_wait+0x17b/0x280 [255304.289995] [] ? generic_file_aio_write+0x77/0xa0 [255304.297201] [] ? ext4_file_write+0xd2/0x1e0 [ext4] [255304.304504] [] do_futex+0x106/0x5a0 [255304.310355] [] SyS_futex+0x80/0x190 [255304.316203] [] ? system_call_after_swapgs+0xa2/0x146 [255304.323689] [] ? system_call_after_swapgs+0xae/0x146 [255304.331175] [] ? system_call_after_swapgs+0xa2/0x146 [255304.338661] [] ? system_call_after_swapgs+0xae/0x146 [255304.346167] [] ? system_call_after_swapgs+0xa2/0x146 [255304.353652] [] ? system_call_after_swapgs+0xae/0x146 [255304.361164] [] system_call_fastpath+0x25/0x2a [255304.367970] [] ? system_call_after_swapgs+0xae/0x146 [255304.375456] sshd S ffff9c79f61420e0 0 3039 1 0x00000080 [255304.383458] Call Trace: [255304.386289] [] ? __rmqueue+0x8a/0x460 [255304.392345] [] schedule+0x29/0x70 [255304.397979] [] schedule_hrtimeout_range_clock+0x12d/0x150 [255304.405949] [] ? add_wait_queue+0x3c/0x50 [255304.412371] [] ? __pollwait+0x7f/0xf0 [255304.418424] [] schedule_hrtimeout_range+0x13/0x20 [255304.425631] [] poll_schedule_timeout+0x55/0xc0 [255304.432533] [] do_select+0x6d1/0x7c0 [255304.438468] [] ? __pollwait+0xf0/0xf0 [255304.444510] [] ? __pollwait+0xf0/0xf0 [255304.450541] [] ? __pollwait+0xf0/0xf0 [255304.456572] [] ? pagevec_lru_move_fn+0x10c/0x130 [255304.463670] [] ? lru_deactivate_file_fn+0x1d0/0x1d0 [255304.471059] [] ? __lru_cache_add+0x64/0x90 [255304.477576] [] ? lru_cache_add+0xe/0x10 [255304.483801] [] ? page_add_new_anon_rmap+0xb8/0x170 [255304.491113] [] ? wp_page_copy.isra.73+0x3d5/0x5b0 [255304.498312] [] ? do_wp_page+0xfb/0x720 [255304.504444] [] ? __check_object_size+0x1ca/0x250 [255304.511541] [] core_sys_select+0x1ff/0x340 [255304.518057] [] ? __d_free+0x35/0x40 [255304.523899] [] ? d_free+0x60/0x70 [255304.529532] [] ? __dentry_kill+0x130/0x190 [255304.536047] [] ? mntput+0x24/0x40 [255304.541691] [] ? __fput+0x186/0x260 [255304.547528] [] SyS_select+0xca/0x120 [255304.553461] [] ? system_call_after_swapgs+0xa2/0x146 [255304.560950] [] ? system_call_after_swapgs+0xae/0x146 [255304.568442] [] ? system_call_after_swapgs+0xa2/0x146 [255304.575928] [] ? system_call_after_swapgs+0xae/0x146 [255304.583413] [] system_call_fastpath+0x25/0x2a [255304.590220] [] ? system_call_after_swapgs+0xae/0x146 [255304.597716] tuned S ffff9c7dea47d230 0 3040 1 0x00000080 [255304.605715] Call Trace: [255304.608545] [] schedule+0x29/0x70 [255304.614188] [] schedule_hrtimeout_range_clock+0xb2/0x150 [255304.622075] [] ? hrtimer_get_res+0x50/0x50 [255304.628591] [] ? schedule_hrtimeout_range_clock+0xa6/0x150 [255304.636657] [] schedule_hrtimeout_range+0x13/0x20 [255304.643850] [] poll_schedule_timeout+0x55/0xc0 [255304.650777] [] do_select+0x6d1/0x7c0 [255304.656714] [] ? enqueue_entity+0x814/0xbe0 [255304.663330] [] ? intel_pstate_update_pstate.part.5+0x4b/0x60 [255304.671615] [] ? update_curr+0x14c/0x1e0 [255304.677957] [] ? account_entity_dequeue+0xae/0xd0 [255304.685152] [] ? dequeue_entity+0x11c/0x5c0 [255304.691765] [] ? put_prev_entity+0x31/0x400 [255304.698391] [] ? __switch_to+0x151/0x580 [255304.704724] [] ? __schedule+0x402/0x840 [255304.710949] [] ? schedule+0x29/0x70 [255304.716800] [] ? futex_wait_queue_me+0xd8/0x130 [255304.723801] [] ? futex_wait+0x195/0x280 [255304.730025] [] ? ttwu_do_wakeup+0xb5/0xe0 [255304.736445] [] core_sys_select+0x1ff/0x340 [255304.742962] [] ? try_to_wake_up+0x190/0x390 [255304.749588] [] ? do_futex+0x106/0x5a0 [255304.755619] [] ? __check_object_size+0x1ca/0x250 [255304.762718] [] ? ktime_get_ts64+0x52/0xf0 [255304.769138] [] SyS_select+0xca/0x120 [255304.775084] [] system_call_fastpath+0x25/0x2a [255304.781892] [] ? system_call_after_swapgs+0xae/0x146 [255304.789378] gmain S ffff9c7ded3f5230 0 3309 1 0x00000080 [255304.797394] Call Trace: [255304.800238] [] schedule+0x29/0x70 [255304.805881] [] schedule_hrtimeout_range_clock+0x12d/0x150 [255304.813863] [] ? add_wait_queue+0x3c/0x50 [255304.820281] [] schedule_hrtimeout_range+0x13/0x20 [255304.827491] [] poll_schedule_timeout+0x55/0xc0 [255304.834397] [] do_sys_poll+0x48d/0x590 [255304.840527] [] ? __alloc_pages_nodemask+0x184/0xbe0 [255304.847917] [] ? probe_sched_wakeup+0x2b/0xa0 [255304.854723] [] ? __alloc_pages_nodemask+0x184/0xbe0 [255304.862111] [] ? __pollwait+0xf0/0xf0 [255304.868154] [] ? handle_pte_fault+0x3d5/0xe20 [255304.874959] [] ? alloc_pages_current+0x98/0x110 [255304.881961] [] ? eventfd_ctx_read+0x67/0x1e0 [255304.888684] [] ? system_call_after_swapgs+0xae/0x146 [255304.896168] [] SyS_poll+0x74/0x110 [255304.901936] [] ? system_call_after_swapgs+0xa2/0x146 [255304.909422] [] ? system_call_after_swapgs+0xae/0x146 [255304.916920] [] system_call_fastpath+0x25/0x2a [255304.923729] [] ? system_call_after_swapgs+0xae/0x146 [255304.931225] tuned S ffff9c7ded3f62a0 0 3310 1 0x00000080 [255304.939228] Call Trace: [255304.942060] [] schedule+0x29/0x70 [255304.947702] [] schedule_hrtimeout_range_clock+0xb2/0x150 [255304.955577] [] ? hrtimer_get_res+0x50/0x50 [255304.962094] [] ? schedule_hrtimeout_range_clock+0xa6/0x150 [255304.970161] [] schedule_hrtimeout_range+0x13/0x20 [255304.977364] [] poll_schedule_timeout+0x55/0xc0 [255304.984267] [] do_select+0x6d1/0x7c0 [255304.990203] [] ? update_curr+0x14c/0x1e0 [255304.996523] [] ? account_entity_dequeue+0xae/0xd0 [255305.003728] [] ? dequeue_entity+0x11c/0x5c0 [255305.010345] [] ? put_prev_entity+0x31/0x400 [255305.016981] [] ? __switch_to+0x151/0x580 [255305.023303] [] ? __enqueue_entity+0x78/0x80 [255305.029916] [] ? enqueue_entity+0x2ef/0xbe0 [255305.036527] [] core_sys_select+0x1ff/0x340 [255305.043045] [] ? try_to_wake_up+0x190/0x390 [255305.049658] [] ? static_key_enabled+0x7/0x20 [255305.056389] [] ? __check_object_size+0x1ca/0x250 [255305.063488] [] ? ktime_get_ts64+0x52/0xf0 [255305.069918] [] SyS_select+0xca/0x120 [255305.075852] [] system_call_fastpath+0x25/0x2a [255305.082665] [] ? system_call_after_swapgs+0xae/0x146 [255305.090162] tuned S ffff9c7de79ea0e0 0 3314 1 0x00000080 [255305.098151] Call Trace: [255305.100989] [] schedule+0x29/0x70 [255305.106633] [] schedule_hrtimeout_range_clock+0x12d/0x150 [255305.114606] [] ? ep_scan_ready_list.isra.7+0x1b9/0x1f0 [255305.122294] [] schedule_hrtimeout_range+0x13/0x20 [255305.129494] [] ep_poll+0x23e/0x360 [255305.135234] [] ? wake_up_state+0x20/0x20 [255305.141565] [] SyS_epoll_wait+0xed/0x120 [255305.147889] [] ? system_call_after_swapgs+0xa2/0x146 [255305.155374] [] system_call_fastpath+0x25/0x2a [255305.162182] [] ? system_call_after_swapgs+0xae/0x146 [255305.169666] tuned S ffff9c7ded3f20e0 0 3390 1 0x00000080 [255305.177671] Call Trace: [255305.180493] [] schedule+0x29/0x70 [255305.186135] [] schedule_hrtimeout_range_clock+0x12d/0x150 [255305.194107] [] ? add_wait_queue+0x3c/0x50 [255305.200525] [] ? add_wait_queue+0x3c/0x50 [255305.206942] [] schedule_hrtimeout_range+0x13/0x20 [255305.214148] [] poll_schedule_timeout+0x55/0xc0 [255305.221060] [] do_sys_poll+0x48d/0x590 [255305.227191] [] ? put_prev_entity+0x31/0x400 [255305.233811] [] ? __switch_to+0x151/0x580 [255305.240134] [] ? __schedule+0x402/0x840 [255305.246360] [] ? get_futex_key+0x1c8/0x2c0 [255305.252874] [] ? __pollwait+0xf0/0xf0 [255305.258905] [] ? __pollwait+0xf0/0xf0 [255305.264948] [] ? sched_clock+0x9/0x10 [255305.270979] [] ? sched_clock_cpu+0x85/0xc0 [255305.277495] [] ? try_to_wake_up+0x190/0x390 [255305.284107] [] ? wake_up_q+0x5b/0x80 [255305.290040] [] ? futex_wake+0x90/0x180 [255305.296171] [] ? do_futex+0x12a/0x5a0 [255305.302201] [] ? system_call_after_swapgs+0xae/0x146 [255305.309701] [] SyS_poll+0x74/0x110 [255305.315442] [] ? system_call_after_swapgs+0xa2/0x146 [255305.322926] [] ? system_call_after_swapgs+0xae/0x146 [255305.330426] [] system_call_fastpath+0x25/0x2a [255305.337232] [] ? system_call_after_swapgs+0xae/0x146 [255305.344716] xinetd S ffff9c7de82562a0 0 3044 1 0x00000080 [255305.352732] Call Trace: [255305.355555] [] ? probe_sched_wakeup+0x2b/0xa0 [255305.362365] [] ? __alloc_skb+0x5d/0x2d0 [255305.368592] [] schedule+0x29/0x70 [255305.374236] [] schedule_hrtimeout_range_clock+0x12d/0x150 [255305.382221] [] ? add_wait_queue+0x3c/0x50 [255305.388639] [] schedule_hrtimeout_range+0x13/0x20 [255305.395845] [] poll_schedule_timeout+0x55/0xc0 [255305.402749] [] do_sys_poll+0x48d/0x590 [255305.408879] [] ? radix_tree_lookup_slot+0x22/0x50 [255305.416074] [] ? __find_get_page+0x1e/0xa0 [255305.422589] [] ? filemap_fault+0x17e/0x490 [255305.429117] [] ? __wake_up_sync_key+0x1d/0x20 [255305.435935] [] ? ext4_filemap_fault+0x41/0x50 [ext4] [255305.443422] [] ? __pollwait+0xf0/0xf0 [255305.449465] [] ? unlock_page+0x2b/0x30 [255305.455601] [] ? do_read_fault.isra.63+0x139/0x1b0 [255305.462898] [] ? handle_pte_fault+0x22a/0xe20 [255305.469710] [] ? handle_mm_fault+0x39d/0x9b0 [255305.476420] [] ? __do_page_fault+0x238/0x500 [255305.483141] [] ? system_call_after_swapgs+0xae/0x146 [255305.490629] [] SyS_poll+0x74/0x110 [255305.496371] [] ? system_call_after_swapgs+0xa2/0x146 [255305.503856] [] ? system_call_after_swapgs+0xae/0x146 [255305.511351] [] system_call_fastpath+0x25/0x2a [255305.518159] [] ? system_call_after_swapgs+0xae/0x146 [255305.525656] rpc.statd S ffff9c81ccda5230 0 3073 1 0x00000080 [255305.533658] Call Trace: [255305.536502] [] ? update_curr+0x14c/0x1e0 [255305.542825] [] schedule+0x29/0x70 [255305.548474] [] schedule_hrtimeout_range_clock+0x12d/0x150 [255305.556460] [] ? add_wait_queue+0x3c/0x50 [255305.562900] [] ? __pollwait+0x7f/0xf0 [255305.568932] [] schedule_hrtimeout_range+0x13/0x20 [255305.576131] [] poll_schedule_timeout+0x55/0xc0 [255305.583046] [] do_select+0x6d1/0x7c0 [255305.588982] [] ? __slab_free+0x9d/0x290 [255305.595230] [] ? __pollwait+0xf0/0xf0 [255305.601259] [] ? __pollwait+0xf0/0xf0 [255305.607292] [] ? __pollwait+0xf0/0xf0 [255305.613325] [] ? __pollwait+0xf0/0xf0 [255305.619372] [] ? __pollwait+0xf0/0xf0 [255305.625418] [] ? ext4_filemap_fault+0x41/0x50 [ext4] [255305.632906] [] ? __do_fault.isra.61+0x8a/0x100 [255305.639812] [] ? unlock_page+0x2b/0x30 [255305.645945] [] ? do_read_fault.isra.63+0x139/0x1b0 [255305.653238] [] core_sys_select+0x1ff/0x340 [255305.659769] [] ? handle_mm_fault+0x39d/0x9b0 [255305.666468] [] ? task_rq_unlock+0x20/0x20 [255305.672899] [] SyS_select+0xca/0x120 [255305.678833] [] ? system_call_after_swapgs+0xa2/0x146 [255305.686340] [] ? system_call_after_swapgs+0xae/0x146 [255305.693827] [] ? system_call_after_swapgs+0xa2/0x146 [255305.701313] [] ? system_call_after_swapgs+0xae/0x146 [255305.708829] [] system_call_fastpath+0x25/0x2a [255305.715628] [] ? system_call_after_swapgs+0xae/0x146 [255305.723123] munged S ffff9c7de8e75230 0 3078 1 0x00000080 [255305.731121] Call Trace: [255305.733952] [] schedule+0x29/0x70 [255305.739604] [] schedule_timeout+0x221/0x2d0 [255305.746231] [] ? __d_alloc+0x25/0x180 [255305.752263] [] ? prepare_to_wait_exclusive+0x56/0x90 [255305.759756] [] __skb_wait_for_more_packets+0x120/0x180 [255305.767437] [] ? datagram_poll+0x110/0x110 [255305.773953] [] __skb_recv_datagram+0x6f/0xd0 [255305.780665] [] skb_recv_datagram+0x43/0x60 [255305.787204] [] unix_accept+0x97/0x170 [255305.793237] [] SYSC_accept4+0x109/0x230 [255305.799476] [] ? __sb_end_write+0x31/0x70 [255305.805895] [] ? vfs_write+0x182/0x1f0 [255305.812024] [] ? system_call_after_swapgs+0xae/0x146 [255305.819518] [] ? system_call_after_swapgs+0xa2/0x146 [255305.827004] [] ? system_call_after_swapgs+0xae/0x146 [255305.834490] [] ? system_call_after_swapgs+0xa2/0x146 [255305.841975] [] ? system_call_after_swapgs+0xae/0x146 [255305.849461] [] SyS_accept4+0xe/0x10 [255305.855307] [] SyS_accept+0x10/0x20 [255305.861145] [] system_call_fastpath+0x25/0x2a [255305.867971] [] ? system_call_after_swapgs+0xae/0x146 [255305.875457] munged S ffff9c7a712162a0 0 3099 1 0x00000080 [255305.883466] Call Trace: [255305.886303] [] schedule+0x29/0x70 [255305.891958] [] futex_wait_queue_me+0xc6/0x130 [255305.898767] [] futex_wait+0x17b/0x280 [255305.904806] [] ? hrtimer_get_res+0x50/0x50 [255305.911336] [] ? futex_wait_queue_me+0xa4/0x130 [255305.918339] [] do_futex+0x106/0x5a0 [255305.924175] [] ? mntput+0x24/0x40 [255305.929820] [] ? __fput+0x186/0x260 [255305.935664] [] SyS_futex+0x80/0x190 [255305.941508] [] system_call_fastpath+0x25/0x2a [255305.948325] [] ? system_call_after_swapgs+0xae/0x146 [255305.955810] munged S ffff9c79f6b241c0 0 3100 1 0x00000080 [255305.963807] Call Trace: [255305.966640] [] schedule+0x29/0x70 [255305.972284] [] futex_wait_queue_me+0xc6/0x130 [255305.979094] [] futex_wait+0x17b/0x280 [255305.985126] [] ? put_prev_entity+0x31/0x400 [255305.991741] [] ? pick_next_task_fair+0x1c6/0x870 [255305.998840] [] ? tracing_is_on+0x15/0x30 [255306.005163] [] do_futex+0x106/0x5a0 [255306.010999] [] ? recalc_sigpending+0x1b/0x70 [255306.017710] [] ? __set_task_blocked+0x41/0xa0 [255306.024517] [] SyS_futex+0x80/0x190 [255306.030354] [] ? system_call_after_swapgs+0xa2/0x146 [255306.037843] [] ? system_call_after_swapgs+0xae/0x146 [255306.045326] [] ? system_call_after_swapgs+0xa2/0x146 [255306.052825] [] ? system_call_after_swapgs+0xae/0x146 [255306.060311] [] ? system_call_after_swapgs+0xa2/0x146 [255306.067795] [] ? system_call_after_swapgs+0xae/0x146 [255306.075304] [] system_call_fastpath+0x25/0x2a [255306.082111] [] ? system_call_after_swapgs+0xae/0x146 [255306.089608] munged S ffff9c79f6b23150 0 3101 1 0x00000080 [255306.097604] Call Trace: [255306.100448] [] schedule+0x29/0x70 [255306.106092] [] futex_wait_queue_me+0xc6/0x130 [255306.112899] [] futex_wait+0x17b/0x280 [255306.118931] [] do_futex+0x106/0x5a0 [255306.124781] [] ? recalc_sigpending+0x1b/0x70 [255306.131492] [] ? __set_task_blocked+0x41/0xa0 [255306.138325] [] SyS_futex+0x80/0x190 [255306.144174] [] ? system_call_after_swapgs+0xa2/0x146 [255306.151672] [] ? system_call_after_swapgs+0xae/0x146 [255306.159156] [] ? system_call_after_swapgs+0xa2/0x146 [255306.166642] [] ? system_call_after_swapgs+0xae/0x146 [255306.174129] [] ? system_call_after_swapgs+0xa2/0x146 [255306.181615] [] ? system_call_after_swapgs+0xae/0x146 [255306.189113] [] system_call_fastpath+0x25/0x2a [255306.195925] [] ? system_call_after_swapgs+0xae/0x146 [255306.203401] nfsiod S ffff9c81ede7b150 0 3128 2 0x00000080 [255306.211425] Call Trace: [255306.214257] [] schedule+0x29/0x70 [255306.219902] [] rescuer_thread+0x31e/0x3c0 [255306.226321] [] ? process_one_work+0x440/0x440 [255306.233128] [] kthread+0xd1/0xe0 [255306.238676] [] ? insert_kthread_work+0x40/0x40 [255306.245580] [] ret_from_fork_nospec_begin+0x21/0x21 [255306.252980] [] ? insert_kthread_work+0x40/0x40 [255306.259883] master S ffff9c81eccca0e0 0 3307 1 0x00000080 [255306.267897] Call Trace: [255306.270729] [] schedule+0x29/0x70 [255306.276372] [] schedule_hrtimeout_range_clock+0xb2/0x150 [255306.284247] [] ? hrtimer_get_res+0x50/0x50 [255306.290775] [] ? schedule_hrtimeout_range_clock+0xa6/0x150 [255306.298841] [] schedule_hrtimeout_range+0x13/0x20 [255306.306040] [] ep_poll+0x23e/0x360 [255306.311781] [] ? wake_up_state+0x20/0x20 [255306.318109] [] SyS_epoll_wait+0xed/0x120 [255306.324432] [] ? system_call_after_swapgs+0xa2/0x146 [255306.331932] [] system_call_fastpath+0x25/0x2a [255306.338738] [] ? system_call_after_swapgs+0xae/0x146 [255306.346226] qmgr S ffff9c81e95f20e0 0 3312 3307 0x00000080 [255306.354243] Call Trace: [255306.357075] [] schedule+0x29/0x70 [255306.362727] [] schedule_hrtimeout_range_clock+0xb2/0x150 [255306.370603] [] ? hrtimer_get_res+0x50/0x50 [255306.377119] [] ? schedule_hrtimeout_range_clock+0xa6/0x150 [255306.385200] [] schedule_hrtimeout_range+0x13/0x20 [255306.392394] [] ep_poll+0x23e/0x360 [255306.398137] [] ? mntput+0x24/0x40 [255306.403781] [] ? wake_up_state+0x20/0x20 [255306.410114] [] SyS_epoll_wait+0xed/0x120 [255306.416437] [] ? system_call_after_swapgs+0xa2/0x146 [255306.423921] [] system_call_fastpath+0x25/0x2a [255306.430730] [] ? system_call_after_swapgs+0xae/0x146 [255306.438214] nfsv4.0-svc S ffff9c81ede7d230 0 3330 2 0x00000080 [255306.446208] Call Trace: [255306.449042] [] ? sock_destroy_inode+0x2f/0x40 [255306.455851] [] ? destroy_inode+0x3b/0x60 [255306.462185] [] schedule+0x29/0x70 [255306.467841] [] schedule_timeout+0x221/0x2d0 [255306.474493] [] ? svc_xprt_free+0x77/0x90 [sunrpc] [255306.481697] [] svc_recv+0x980/0xa20 [sunrpc] [255306.488437] [] ? nfs_callback_authenticate+0x60/0x60 [nfsv4] [255306.496708] [] ? nfs_callback_authenticate+0x60/0x60 [nfsv4] [255306.504990] [] nfs4_callback_svc+0x33/0x60 [nfsv4] [255306.512301] [] kthread+0xd1/0xe0 [255306.517847] [] ? insert_kthread_work+0x40/0x40 [255306.524762] [] ret_from_fork_nospec_begin+0x21/0x21 [255306.532166] [] ? insert_kthread_work+0x40/0x40 [255306.539069] automount S ffff9c7de82541c0 0 3394 1 0x00000080 [255306.547070] Call Trace: [255306.549904] [] schedule+0x29/0x70 [255306.555546] [] schedule_hrtimeout_range_clock+0x12d/0x150 [255306.563525] [] ? sock_destroy_inode+0x2f/0x40 [255306.570341] [] ? recalc_sigpending+0x1b/0x70 [255306.577051] [] schedule_hrtimeout_range+0x13/0x20 [255306.584262] [] do_sigtimedwait+0x196/0x240 [255306.590790] [] SYSC_rt_sigtimedwait+0xb4/0x120 [255306.597708] [] ? mntput+0x24/0x40 [255306.603351] [] ? __fput+0x186/0x260 [255306.609202] [] ? system_call_after_swapgs+0xae/0x146 [255306.616689] [] ? system_call_after_swapgs+0xa2/0x146 [255306.624178] [] ? system_call_after_swapgs+0xae/0x146 [255306.631687] [] ? system_call_after_swapgs+0xa2/0x146 [255306.639171] [] ? system_call_after_swapgs+0xae/0x146 [255306.646677] [] ? system_call_after_swapgs+0xa2/0x146 [255306.654161] [] ? system_call_after_swapgs+0xae/0x146 [255306.661649] [] ? system_call_after_swapgs+0xa2/0x146 [255306.669147] [] ? system_call_after_swapgs+0xae/0x146 [255306.676631] [] SyS_rt_sigtimedwait+0xe/0x10 [255306.683266] [] system_call_fastpath+0x25/0x2a [255306.690074] [] ? system_call_after_swapgs+0xae/0x146 [255306.697558] automount S ffff9c7dea4f62a0 0 3437 1 0x00000080 [255306.705567] Call Trace: [255306.708388] [] schedule+0x29/0x70 [255306.714056] [] futex_wait_queue_me+0xc6/0x130 [255306.720862] [] futex_wait+0x17b/0x280 [255306.726895] [] ? hrtimer_get_res+0x50/0x50 [255306.733435] [] ? futex_wait_queue_me+0xa4/0x130 [255306.740435] [] do_futex+0x106/0x5a0 [255306.746274] [] SyS_futex+0x80/0x190 [255306.752110] [] system_call_fastpath+0x25/0x2a [255306.758918] [] ? system_call_after_swapgs+0xae/0x146 [255306.766402] automount S ffff9c7dea4f3150 0 3438 1 0x00000080 [255306.774404] Call Trace: [255306.777246] [] schedule+0x29/0x70 [255306.782897] [] futex_wait_queue_me+0xc6/0x130 [255306.789707] [] futex_wait+0x17b/0x280 [255306.795750] [] ? sched_slice.isra.56+0x66/0xc0 [255306.802655] [] ? get_futex_key+0x1c8/0x2c0 [255306.809187] [] do_futex+0x106/0x5a0 [255306.815025] [] ? check_preempt_curr+0x80/0xa0 [255306.821833] [] ? wake_up_new_task+0x131/0x1a0 [255306.828642] [] SyS_futex+0x80/0x190 [255306.834484] [] ? system_call_after_swapgs+0xa2/0x146 [255306.841985] [] ? system_call_after_swapgs+0xae/0x146 [255306.849469] [] ? system_call_after_swapgs+0xa2/0x146 [255306.856952] [] ? system_call_after_swapgs+0xae/0x146 [255306.864437] [] ? system_call_after_swapgs+0xa2/0x146 [255306.871922] [] ? system_call_after_swapgs+0xae/0x146 [255306.879407] [] system_call_fastpath+0x25/0x2a [255306.886236] [] ? system_call_after_swapgs+0xae/0x146 [255306.893711] automount S ffff9c79f635a0e0 0 3592 1 0x00000080 [255306.901698] Call Trace: [255306.904530] [] schedule+0x29/0x70 [255306.910174] [] schedule_hrtimeout_range_clock+0x12d/0x150 [255306.918148] [] ? add_wait_queue+0x3c/0x50 [255306.924565] [] schedule_hrtimeout_range+0x13/0x20 [255306.931772] [] poll_schedule_timeout+0x55/0xc0 [255306.938676] [] do_sys_poll+0x48d/0x590 [255306.944834] [] ? radix_tree_lookup_slot+0x22/0x50 [255306.952020] [] ? __find_get_page+0x1e/0xa0 [255306.958537] [] ? filemap_fault+0x17e/0x490 [255306.965061] [] ? enqueue_entity+0x2ef/0xbe0 [255306.971688] [] ? ext4_filemap_fault+0x41/0x50 [ext4] [255306.979190] [] ? __pollwait+0xf0/0xf0 [255306.985223] [] ? __pollwait+0xf0/0xf0 [255306.991259] [] ? __pollwait+0xf0/0xf0 [255306.997303] [] ? handle_pte_fault+0x22a/0xe20 [255307.004109] [] ? handle_mm_fault+0x39d/0x9b0 [255307.010832] [] ? __do_page_fault+0x238/0x500 [255307.017542] [] ? system_call_after_swapgs+0xae/0x146 [255307.025028] [] SyS_poll+0x74/0x110 [255307.030769] [] ? system_call_after_swapgs+0xa2/0x146 [255307.038256] [] ? system_call_after_swapgs+0xae/0x146 [255307.045784] [] system_call_fastpath+0x25/0x2a [255307.052591] [] ? system_call_after_swapgs+0xae/0x146 [255307.060077] automount S ffff9c79f635c1c0 0 3595 1 0x00000080 [255307.068092] Call Trace: [255307.070935] [] schedule+0x29/0x70 [255307.076579] [] schedule_hrtimeout_range_clock+0x12d/0x150 [255307.084551] [] ? add_wait_queue+0x3c/0x50 [255307.090971] [] schedule_hrtimeout_range+0x13/0x20 [255307.098164] [] poll_schedule_timeout+0x55/0xc0 [255307.105068] [] do_sys_poll+0x48d/0x590 [255307.111216] [] ? __d_lookup+0x7a/0x160 [255307.117344] [] ? __d_alloc+0x25/0x180 [255307.123389] [] ? mntput+0x24/0x40 [255307.129037] [] ? __enqueue_entity+0x78/0x80 [255307.135653] [] ? enqueue_entity+0x2ef/0xbe0 [255307.142281] [] ? select_task_rq_fair+0x5a6/0x760 [255307.149385] [] ? tracing_record_cmdline+0x1d/0x120 [255307.156675] [] ? __pollwait+0xf0/0xf0 [255307.162705] [] ? __pollwait+0xf0/0xf0 [255307.168735] [] ? __pollwait+0xf0/0xf0 [255307.174768] [] ? futex_wake_op+0x3b5/0x640 [255307.181290] [] ? do_futex+0x17a/0x5a0 [255307.187323] [] ? autofs_dev_ioctl+0x13/0x20 [255307.193936] [] ? do_vfs_ioctl+0x3a0/0x5a0 [255307.200353] [] ? system_call_after_swapgs+0xae/0x146 [255307.207838] [] SyS_poll+0x74/0x110 [255307.213578] [] ? system_call_after_swapgs+0xa2/0x146 [255307.221061] [] ? system_call_after_swapgs+0xae/0x146 [255307.228546] [] system_call_fastpath+0x25/0x2a [255307.235353] [] ? system_call_after_swapgs+0xae/0x146 [255307.242836] automount S ffff9c79f6359070 0 3596 1 0x00000080 [255307.250871] Call Trace: [255307.253702] [] schedule+0x29/0x70 [255307.259346] [] schedule_hrtimeout_range_clock+0x12d/0x150 [255307.267317] [] ? page_fault+0x28/0x30 [255307.273353] [] ? add_wait_queue+0x3c/0x50 [255307.279772] [] schedule_hrtimeout_range+0x13/0x20 [255307.286966] [] poll_schedule_timeout+0x55/0xc0 [255307.293871] [] do_sys_poll+0x48d/0x590 [255307.300025] [] ? put_prev_entity+0x31/0x400 [255307.306640] [] ? __switch_to+0x151/0x580 [255307.312963] [] ? __schedule+0x402/0x840 [255307.319189] [] ? __pollwait+0xf0/0xf0 [255307.325231] [] ? __pollwait+0xf0/0xf0 [255307.331263] [] ? __pollwait+0xf0/0xf0 [255307.337303] [] ? hrtimer_get_res+0x50/0x50 [255307.343820] [] ? get_futex_key+0x1c8/0x2c0 [255307.350338] [] ? futex_wake+0x90/0x180 [255307.356475] [] ? do_futex+0x12a/0x5a0 [255307.362520] [] ? check_preempt_curr+0x80/0xa0 [255307.369326] [] ? wake_up_new_task+0x131/0x1a0 [255307.376133] [] ? system_call_after_swapgs+0xae/0x146 [255307.383630] [] SyS_poll+0x74/0x110 [255307.389379] [] ? system_call_after_swapgs+0xa2/0x146 [255307.396864] [] ? system_call_after_swapgs+0xae/0x146 [255307.404351] [] system_call_fastpath+0x25/0x2a [255307.411162] [] ? system_call_after_swapgs+0xae/0x146 [255307.418646] automount S ffff9c7debab9070 0 3600 1 0x00000080 [255307.426655] Call Trace: [255307.429488] [] schedule+0x29/0x70 [255307.435132] [] schedule_hrtimeout_range_clock+0x12d/0x150 [255307.443104] [] ? kmem_cache_alloc_node_trace+0x3f/0x210 [255307.450880] [] ? add_wait_queue+0x3c/0x50 [255307.457299] [] schedule_hrtimeout_range+0x13/0x20 [255307.464493] [] poll_schedule_timeout+0x55/0xc0 [255307.471397] [] do_sys_poll+0x48d/0x590 [255307.477530] [] ? __d_lookup+0x7a/0x160 [255307.483657] [] ? mntput+0x24/0x40 [255307.489302] [] ? terminate_walk+0x49/0x50 [255307.495721] [] ? __enqueue_entity+0x78/0x80 [255307.502335] [] ? enqueue_entity+0x2ef/0xbe0 [255307.508947] [] ? path_mountpoint+0x359/0x430 [255307.515658] [] ? select_task_rq_fair+0x5a6/0x760 [255307.522756] [] ? tracing_record_cmdline+0x1d/0x120 [255307.530047] [] ? __pollwait+0xf0/0xf0 [255307.536079] [] ? __pollwait+0xf0/0xf0 [255307.542112] [] ? __pollwait+0xf0/0xf0 [255307.548147] [] ? futex_wake_op+0x3b5/0x640 [255307.554665] [] ? do_futex+0x17a/0x5a0 [255307.560697] [] ? autofs_dev_ioctl+0x13/0x20 [255307.567311] [] ? do_vfs_ioctl+0x3a0/0x5a0 [255307.573743] [] ? system_call_after_swapgs+0xae/0x146 [255307.581229] [] SyS_poll+0x74/0x110 [255307.586972] [] ? system_call_after_swapgs+0xa2/0x146 [255307.594456] [] ? system_call_after_swapgs+0xae/0x146 [255307.601940] [] system_call_fastpath+0x25/0x2a [255307.608746] [] ? system_call_after_swapgs+0xae/0x146 [255307.616238] crond S ffff9c7de8255230 0 3401 1 0x00000080 [255307.624257] Call Trace: [255307.627092] [] ? hrtimer_start_range_ns+0x1fd/0x3c0 [255307.634480] [] schedule+0x29/0x70 [255307.640123] [] do_nanosleep+0x70/0x100 [255307.646256] [] hrtimer_nanosleep+0xbb/0x180 [255307.652860] [] ? hrtimer_get_res+0x50/0x50 [255307.659386] [] ? do_nanosleep+0x5b/0x100 [255307.665707] [] SyS_nanosleep+0x96/0xb0 [255307.671837] [] system_call_fastpath+0x25/0x2a [255307.678656] [] ? system_call_after_swapgs+0xae/0x146 [255307.686145] atd S ffff9c79f6358000 0 3402 1 0x00000080 [255307.694173] Call Trace: [255307.697017] [] ? hrtimer_start_range_ns+0x1fd/0x3c0 [255307.704405] [] schedule+0x29/0x70 [255307.710059] [] do_nanosleep+0x70/0x100 [255307.716198] [] hrtimer_nanosleep+0xbb/0x180 [255307.722825] [] ? hrtimer_get_res+0x50/0x50 [255307.729331] [] ? do_nanosleep+0x5b/0x100 [255307.735653] [] SyS_nanosleep+0x96/0xb0 [255307.741793] [] system_call_fastpath+0x25/0x2a [255307.748599] [] ? system_call_after_swapgs+0xae/0x146 [255307.756085] agetty S ffff9c79f635d230 0 3422 1 0x00000080 [255307.764112] Call Trace: [255307.766957] [] schedule+0x29/0x70 [255307.772594] [] schedule_timeout+0x221/0x2d0 [255307.779208] [] ? flush_work+0x47/0x1b0 [255307.785347] [] ? serial8250_start_tx+0xa5/0xe0 [255307.792253] [] n_tty_read+0x2b0/0xd10 [255307.798287] [] ? task_rq_unlock+0x20/0x20 [255307.804718] [] ? wake_up_state+0x20/0x20 [255307.811039] [] tty_read+0x90/0x100 [255307.816788] [] vfs_read+0x9f/0x170 [255307.822530] [] SyS_read+0x7f/0xf0 [255307.828181] [] ? system_call_after_swapgs+0xae/0x146 [255307.835685] [] system_call_fastpath+0x25/0x2a [255307.842492] [] ? system_call_after_swapgs+0xae/0x146 [255307.850006] agetty S ffff9c79f635b150 0 3424 1 0x00000080 [255307.858038] Call Trace: [255307.860865] [] schedule+0x29/0x70 [255307.866509] [] schedule_timeout+0x221/0x2d0 [255307.873127] [] ? flush_work+0x47/0x1b0 [255307.879273] [] n_tty_read+0x2b0/0xd10 [255307.885317] [] ? task_rq_unlock+0x20/0x20 [255307.891750] [] ? wake_up_state+0x20/0x20 [255307.898076] [] tty_read+0x90/0x100 [255307.903820] [] vfs_read+0x9f/0x170 [255307.909570] [] SyS_read+0x7f/0xf0 [255307.915213] [] ? system_call_after_swapgs+0xae/0x146 [255307.922699] [] system_call_fastpath+0x25/0x2a [255307.929506] [] ? system_call_after_swapgs+0xae/0x146 [255307.936989] kworker/20:1H S ffff9c7de8aa9070 0 3620 2 0x00000080 [255307.944993] Call Trace: [255307.947826] [] ? process_one_work+0x21a/0x440 [255307.954644] [] schedule+0x29/0x70 [255307.960305] [] worker_thread+0x1d9/0x3c0 [255307.966627] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255307.974015] [] kthread+0xd1/0xe0 [255307.979564] [] ? insert_kthread_work+0x40/0x40 [255307.986467] [] ret_from_fork_nospec_begin+0x21/0x21 [255307.993858] [] ? insert_kthread_work+0x40/0x40 [255308.000763] kworker/u308:1 S ffff9c7deb1ed230 0 3885 2 0x00000080 [255308.008777] Call Trace: [255308.011608] [] schedule+0x29/0x70 [255308.017253] [] worker_thread+0x1d9/0x3c0 [255308.023582] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255308.030993] [] kthread+0xd1/0xe0 [255308.036543] [] ? insert_kthread_work+0x40/0x40 [255308.043452] [] ret_from_fork_nospec_begin+0x21/0x21 [255308.050853] [] ? insert_kthread_work+0x40/0x40 [255308.057757] ntpd S ffff9c7de9fca0e0 0 3994 1 0x00000080 [255308.065754] Call Trace: [255308.068598] [] schedule+0x29/0x70 [255308.074242] [] schedule_hrtimeout_range_clock+0xb2/0x150 [255308.082119] [] ? hrtimer_get_res+0x50/0x50 [255308.088628] [] ? schedule_hrtimeout_range_clock+0xa6/0x150 [255308.096701] [] schedule_hrtimeout_range+0x13/0x20 [255308.103896] [] poll_schedule_timeout+0x55/0xc0 [255308.110800] [] do_select+0x6d1/0x7c0 [255308.116735] [] ? put_cmsg+0xcd/0x150 [255308.122668] [] ? number.isra.2+0x323/0x360 [255308.129184] [] ? __pollwait+0xf0/0xf0 [255308.135222] [] ? __pollwait+0xf0/0xf0 [255308.141264] [] ? __pollwait+0xf0/0xf0 [255308.147295] [] ? __pollwait+0xf0/0xf0 [255308.153327] [] ? __pollwait+0xf0/0xf0 [255308.159358] [] ? __pollwait+0xf0/0xf0 [255308.165389] [] ? __pollwait+0xf0/0xf0 [255308.171419] [] ? __pollwait+0xf0/0xf0 [255308.177462] [] ? __pollwait+0xf0/0xf0 [255308.183492] [] core_sys_select+0x1ff/0x340 [255308.190019] [] ? __d_free+0x35/0x40 [255308.195855] [] ? d_free+0x60/0x70 [255308.201509] [] ? __dentry_kill+0x130/0x190 [255308.208025] [] ? ktime_get_ts64+0x52/0xf0 [255308.214443] [] SyS_select+0xca/0x120 [255308.220378] [] system_call_fastpath+0x25/0x2a [255308.227186] [] ? system_call_after_swapgs+0xae/0x146 [255308.234679] kworker/18:1H S ffff9c7deb1ea0e0 0 4707 2 0x00000080 [255308.242683] Call Trace: [255308.245529] [] ? process_one_work+0x21a/0x440 [255308.252336] [] schedule+0x29/0x70 [255308.257980] [] worker_thread+0x1d9/0x3c0 [255308.264303] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255308.271694] [] kthread+0xd1/0xe0 [255308.277242] [] ? insert_kthread_work+0x40/0x40 [255308.284157] [] ret_from_fork_nospec_begin+0x21/0x21 [255308.291556] [] ? insert_kthread_work+0x40/0x40 [255308.298467] kworker/22:1H S ffff9c7dea47e2a0 0 4812 2 0x00000080 [255308.306474] Call Trace: [255308.309305] [] ? process_one_work+0x21a/0x440 [255308.316113] [] schedule+0x29/0x70 [255308.321769] [] worker_thread+0x1d9/0x3c0 [255308.328096] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255308.335497] [] kthread+0xd1/0xe0 [255308.341058] [] ? insert_kthread_work+0x40/0x40 [255308.347964] [] ret_from_fork_nospec_begin+0x21/0x21 [255308.355353] [] ? insert_kthread_work+0x40/0x40 [255308.362255] kworker/28:1H S ffff9c81ede7c1c0 0 5065 2 0x00000080 [255308.370262] Call Trace: [255308.373098] [] ? process_one_work+0x21a/0x440 [255308.379904] [] schedule+0x29/0x70 [255308.385584] [] worker_thread+0x1d9/0x3c0 [255308.391907] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255308.399296] [] kthread+0xd1/0xe0 [255308.404843] [] ? insert_kthread_work+0x40/0x40 [255308.411747] [] ret_from_fork_nospec_begin+0x21/0x21 [255308.419156] [] ? insert_kthread_work+0x40/0x40 [255308.426060] kworker/29:1H S ffff9c81ede78000 0 5083 2 0x00000080 [255308.434081] Call Trace: [255308.436910] [] schedule+0x29/0x70 [255308.442555] [] worker_thread+0x1d9/0x3c0 [255308.448891] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255308.456279] [] kthread+0xd1/0xe0 [255308.461825] [] ? insert_kthread_work+0x40/0x40 [255308.468736] [] ret_from_fork_nospec_begin+0x21/0x21 [255308.476124] [] ? insert_kthread_work+0x40/0x40 [255308.483026] ptlrpc_hr00_000 S ffff9c81ede79070 0 5161 2 0x00000080 [255308.491033] Call Trace: [255308.493864] [] schedule+0x29/0x70 [255308.499597] [] ptlrpc_hr_main+0x46c/0x560 [ptlrpc] [255308.506892] [] ? wake_up_atomic_t+0x30/0x30 [255308.513564] [] ? ptlrpc_handle_rs+0x5f0/0x5f0 [ptlrpc] [255308.521259] [] kthread+0xd1/0xe0 [255308.526805] [] ? insert_kthread_work+0x40/0x40 [255308.533726] [] ret_from_fork_nospec_begin+0x21/0x21 [255308.541121] [] ? insert_kthread_work+0x40/0x40 [255308.548045] ptlrpc_hr00_001 S ffff9c81ede7e2a0 0 5162 2 0x00000080 [255308.556033] Call Trace: [255308.558864] [] schedule+0x29/0x70 [255308.564555] [] ptlrpc_hr_main+0x46c/0x560 [ptlrpc] [255308.571880] [] ? wake_up_atomic_t+0x30/0x30 [255308.578547] [] ? ptlrpc_handle_rs+0x5f0/0x5f0 [ptlrpc] [255308.586250] [] kthread+0xd1/0xe0 [255308.591798] [] ? insert_kthread_work+0x40/0x40 [255308.598712] [] ret_from_fork_nospec_begin+0x21/0x21 [255308.606102] [] ? insert_kthread_work+0x40/0x40 [255308.613009] ptlrpc_hr00_002 S ffff9c79f6b220e0 0 5163 2 0x00000080 [255308.621009] Call Trace: [255308.623858] [] schedule+0x29/0x70 [255308.629543] [] ptlrpc_hr_main+0x46c/0x560 [ptlrpc] [255308.636837] [] ? wake_up_atomic_t+0x30/0x30 [255308.643506] [] ? ptlrpc_handle_rs+0x5f0/0x5f0 [ptlrpc] [255308.651201] [] kthread+0xd1/0xe0 [255308.656750] [] ? insert_kthread_work+0x40/0x40 [255308.663659] [] ret_from_fork_nospec_begin+0x21/0x21 [255308.671050] [] ? insert_kthread_work+0x40/0x40 [255308.677968] ptlrpc_hr00_003 S ffff9c79f6b21070 0 5164 2 0x00000080 [255308.685981] Call Trace: [255308.688807] [] schedule+0x29/0x70 [255308.694492] [] ptlrpc_hr_main+0x46c/0x560 [ptlrpc] [255308.701788] [] ? wake_up_atomic_t+0x30/0x30 [255308.708454] [] ? ptlrpc_handle_rs+0x5f0/0x5f0 [ptlrpc] [255308.716135] [] kthread+0xd1/0xe0 [255308.721683] [] ? insert_kthread_work+0x40/0x40 [255308.728610] [] ret_from_fork_nospec_begin+0x21/0x21 [255308.736014] [] ? insert_kthread_work+0x40/0x40 [255308.742917] ptlrpc_hr00_004 S ffff9c7ded329070 0 5165 2 0x00000080 [255308.750940] Call Trace: [255308.753772] [] schedule+0x29/0x70 [255308.759461] [] ptlrpc_hr_main+0x46c/0x560 [ptlrpc] [255308.766769] [] ? wake_up_atomic_t+0x30/0x30 [255308.773430] [] ? ptlrpc_handle_rs+0x5f0/0x5f0 [ptlrpc] [255308.781120] [] kthread+0xd1/0xe0 [255308.786667] [] ? insert_kthread_work+0x40/0x40 [255308.793578] [] ret_from_fork_nospec_begin+0x21/0x21 [255308.800966] [] ? insert_kthread_work+0x40/0x40 [255308.807876] ptlrpc_hr00_005 S ffff9c7ded32c1c0 0 5166 2 0x00000080 [255308.815874] Call Trace: [255308.818705] [] schedule+0x29/0x70 [255308.824395] [] ptlrpc_hr_main+0x46c/0x560 [ptlrpc] [255308.831691] [] ? wake_up_atomic_t+0x30/0x30 [255308.838354] [] ? ptlrpc_handle_rs+0x5f0/0x5f0 [ptlrpc] [255308.846036] [] kthread+0xd1/0xe0 [255308.851582] [] ? insert_kthread_work+0x40/0x40 [255308.858484] [] ret_from_fork_nospec_begin+0x21/0x21 [255308.865873] [] ? insert_kthread_work+0x40/0x40 [255308.872797] ptlrpc_hr00_006 S ffff9c7ded32a0e0 0 5167 2 0x00000080 [255308.880795] Call Trace: [255308.883640] [] schedule+0x29/0x70 [255308.889341] [] ptlrpc_hr_main+0x46c/0x560 [ptlrpc] [255308.896637] [] ? wake_up_atomic_t+0x30/0x30 [255308.903275] [] ? ptlrpc_handle_rs+0x5f0/0x5f0 [ptlrpc] [255308.910957] [] kthread+0xd1/0xe0 [255308.916502] [] ? insert_kthread_work+0x40/0x40 [255308.923412] [] ret_from_fork_nospec_begin+0x21/0x21 [255308.930804] [] ? insert_kthread_work+0x40/0x40 [255308.937707] ptlrpc_hr00_007 S ffff9c7ded328000 0 5168 2 0x00000080 [255308.945695] Call Trace: [255308.948530] [] schedule+0x29/0x70 [255308.954234] [] ptlrpc_hr_main+0x46c/0x560 [ptlrpc] [255308.961541] [] ? wake_up_atomic_t+0x30/0x30 [255308.968211] [] ? ptlrpc_handle_rs+0x5f0/0x5f0 [ptlrpc] [255308.975906] [] kthread+0xd1/0xe0 [255308.981452] [] ? insert_kthread_work+0x40/0x40 [255308.988355] [] ret_from_fork_nospec_begin+0x21/0x21 [255308.995744] [] ? insert_kthread_work+0x40/0x40 [255309.002658] ptlrpc_hr01_000 S ffff9c7ded32b150 0 5169 2 0x00000080 [255309.010675] Call Trace: [255309.013507] [] schedule+0x29/0x70 [255309.019201] [] ptlrpc_hr_main+0x46c/0x560 [ptlrpc] [255309.026498] [] ? wake_up_atomic_t+0x30/0x30 [255309.033149] [] ? ptlrpc_handle_rs+0x5f0/0x5f0 [ptlrpc] [255309.040833] [] kthread+0xd1/0xe0 [255309.046378] [] ? insert_kthread_work+0x40/0x40 [255309.053282] [] ret_from_fork_nospec_begin+0x21/0x21 [255309.060671] [] ? insert_kthread_work+0x40/0x40 [255309.067609] ptlrpc_hr01_001 S ffff9c7de8ffa0e0 0 5170 2 0x00000080 [255309.075610] Call Trace: [255309.078433] [] schedule+0x29/0x70 [255309.084123] [] ptlrpc_hr_main+0x46c/0x560 [ptlrpc] [255309.091431] [] ? wake_up_atomic_t+0x30/0x30 [255309.098092] [] ? ptlrpc_handle_rs+0x5f0/0x5f0 [ptlrpc] [255309.105776] [] kthread+0xd1/0xe0 [255309.111316] [] ? insert_kthread_work+0x40/0x40 [255309.118230] [] ret_from_fork_nospec_begin+0x21/0x21 [255309.125631] [] ? insert_kthread_work+0x40/0x40 [255309.132568] ptlrpc_hr01_002 S ffff9c7de8ff9070 0 5171 2 0x00000080 [255309.140570] Call Trace: [255309.143412] [] schedule+0x29/0x70 [255309.149093] [] ptlrpc_hr_main+0x46c/0x560 [ptlrpc] [255309.156388] [] ? wake_up_atomic_t+0x30/0x30 [255309.163041] [] ? ptlrpc_handle_rs+0x5f0/0x5f0 [ptlrpc] [255309.170739] [] kthread+0xd1/0xe0 [255309.176291] [] ? insert_kthread_work+0x40/0x40 [255309.183195] [] ret_from_fork_nospec_begin+0x21/0x21 [255309.190590] [] ? insert_kthread_work+0x40/0x40 [255309.197509] ptlrpc_hr01_003 S ffff9c7dd6f51070 0 5172 2 0x00000080 [255309.205507] Call Trace: [255309.208361] [] schedule+0x29/0x70 [255309.214045] [] ptlrpc_hr_main+0x46c/0x560 [ptlrpc] [255309.221362] [] ? wake_up_atomic_t+0x30/0x30 [255309.228019] [] ? ptlrpc_handle_rs+0x5f0/0x5f0 [ptlrpc] [255309.235717] [] kthread+0xd1/0xe0 [255309.241263] [] ? insert_kthread_work+0x40/0x40 [255309.248169] [] ret_from_fork_nospec_begin+0x21/0x21 [255309.255566] [] ? insert_kthread_work+0x40/0x40 [255309.262499] ptlrpc_hr01_004 S ffff9c7dd6f53150 0 5173 2 0x00000080 [255309.270503] Call Trace: [255309.273336] [] schedule+0x29/0x70 [255309.279041] [] ptlrpc_hr_main+0x46c/0x560 [ptlrpc] [255309.286338] [] ? wake_up_atomic_t+0x30/0x30 [255309.292990] [] ? ptlrpc_handle_rs+0x5f0/0x5f0 [ptlrpc] [255309.300673] [] kthread+0xd1/0xe0 [255309.306220] [] ? insert_kthread_work+0x40/0x40 [255309.313145] [] ret_from_fork_nospec_begin+0x21/0x21 [255309.320532] [] ? insert_kthread_work+0x40/0x40 [255309.327437] ptlrpc_hr01_005 S ffff9c7dd6f562a0 0 5174 2 0x00000080 [255309.335447] Call Trace: [255309.338279] [] schedule+0x29/0x70 [255309.343973] [] ptlrpc_hr_main+0x46c/0x560 [ptlrpc] [255309.351268] [] ? wake_up_atomic_t+0x30/0x30 [255309.357930] [] ? ptlrpc_handle_rs+0x5f0/0x5f0 [ptlrpc] [255309.365612] [] kthread+0xd1/0xe0 [255309.371160] [] ? insert_kthread_work+0x40/0x40 [255309.378089] [] ret_from_fork_nospec_begin+0x21/0x21 [255309.385491] [] ? insert_kthread_work+0x40/0x40 [255309.392399] ptlrpc_hr01_006 S ffff9c7a730f8000 0 5175 2 0x00000080 [255309.400446] Call Trace: [255309.403278] [] schedule+0x29/0x70 [255309.408972] [] ptlrpc_hr_main+0x46c/0x560 [ptlrpc] [255309.416268] [] ? wake_up_atomic_t+0x30/0x30 [255309.422925] [] ? ptlrpc_handle_rs+0x5f0/0x5f0 [ptlrpc] [255309.430608] [] kthread+0xd1/0xe0 [255309.436157] [] ? insert_kthread_work+0x40/0x40 [255309.443068] [] ret_from_fork_nospec_begin+0x21/0x21 [255309.450457] [] ? insert_kthread_work+0x40/0x40 [255309.457360] ptlrpc_hr01_007 S ffff9c7a730f9070 0 5176 2 0x00000080 [255309.465364] Call Trace: [255309.468197] [] schedule+0x29/0x70 [255309.473892] [] ptlrpc_hr_main+0x46c/0x560 [ptlrpc] [255309.481194] [] ? wake_up_atomic_t+0x30/0x30 [255309.487857] [] ? ptlrpc_handle_rs+0x5f0/0x5f0 [ptlrpc] [255309.495541] [] kthread+0xd1/0xe0 [255309.501090] [] ? insert_kthread_work+0x40/0x40 [255309.507995] [] ret_from_fork_nospec_begin+0x21/0x21 [255309.515389] [] ? insert_kthread_work+0x40/0x40 [255309.522294] kiblnd_connd S ffff9c7de9f4d230 0 5186 2 0x00000080 [255309.530322] Call Trace: [255309.533154] [] schedule+0x29/0x70 [255309.538799] [] schedule_timeout+0x168/0x2d0 [255309.545427] [] ? kiblnd_check_conns+0x52f/0x880 [ko2iblnd] [255309.553496] [] ? __internal_add_timer+0x130/0x130 [255309.560696] [] kiblnd_connd+0x5f9/0x9d0 [ko2iblnd] [255309.567989] [] ? __schedule+0x402/0x840 [255309.574214] [] ? wake_up_state+0x20/0x20 [255309.580553] [] ? kiblnd_cm_callback+0x23a0/0x23a0 [ko2iblnd] [255309.588814] [] kthread+0xd1/0xe0 [255309.594361] [] ? insert_kthread_work+0x40/0x40 [255309.601263] [] ret_from_fork_nospec_begin+0x21/0x21 [255309.608653] [] ? insert_kthread_work+0x40/0x40 [255309.615561] kiblnd_sd_00_00 S ffff9c7de9f4a0e0 0 5187 2 0x00000080 [255309.623588] Call Trace: [255309.626419] [] schedule+0x29/0x70 [255309.632065] [] kiblnd_scheduler+0x32c/0x1190 [ko2iblnd] [255309.639862] [] ? put_prev_entity+0x31/0x400 [255309.646477] [] ? __switch_to+0xce/0x580 [255309.652715] [] ? wake_up_state+0x20/0x20 [255309.659051] [] ? kiblnd_cq_event+0x90/0x90 [ko2iblnd] [255309.666633] [] kthread+0xd1/0xe0 [255309.672192] [] ? insert_kthread_work+0x40/0x40 [255309.679097] [] ret_from_fork_nospec_begin+0x21/0x21 [255309.686484] [] ? insert_kthread_work+0x40/0x40 [255309.693387] kiblnd_sd_00_01 S ffff9c7de9f48000 0 5188 2 0x00000080 [255309.701387] Call Trace: [255309.704219] [] schedule+0x29/0x70 [255309.709865] [] kiblnd_scheduler+0x32c/0x1190 [ko2iblnd] [255309.717652] [] ? put_prev_entity+0x31/0x400 [255309.724264] [] ? __switch_to+0xce/0x580 [255309.730500] [] ? wake_up_state+0x20/0x20 [255309.736850] [] ? kiblnd_cq_event+0x90/0x90 [ko2iblnd] [255309.744434] [] kthread+0xd1/0xe0 [255309.749987] [] ? insert_kthread_work+0x40/0x40 [255309.756889] [] ret_from_fork_nospec_begin+0x21/0x21 [255309.764289] [] ? insert_kthread_work+0x40/0x40 [255309.771190] kiblnd_sd_00_02 S ffff9c7de9f4c1c0 0 5189 2 0x00000080 [255309.779199] Call Trace: [255309.782043] [] schedule+0x29/0x70 [255309.787690] [] kiblnd_scheduler+0x32c/0x1190 [ko2iblnd] [255309.795478] [] ? put_prev_entity+0x31/0x400 [255309.802089] [] ? __switch_to+0xce/0x580 [255309.808337] [] ? wake_up_state+0x20/0x20 [255309.814661] [] ? kiblnd_cq_event+0x90/0x90 [ko2iblnd] [255309.822257] [] kthread+0xd1/0xe0 [255309.827813] [] ? insert_kthread_work+0x40/0x40 [255309.834716] [] ret_from_fork_nospec_begin+0x21/0x21 [255309.842104] [] ? insert_kthread_work+0x40/0x40 [255309.849007] kiblnd_sd_00_03 S ffff9c7de9f4e2a0 0 5190 2 0x00000080 [255309.857022] Call Trace: [255309.859863] [] schedule+0x29/0x70 [255309.865509] [] kiblnd_scheduler+0x32c/0x1190 [ko2iblnd] [255309.873296] [] ? put_prev_entity+0x31/0x400 [255309.879909] [] ? __switch_to+0xce/0x580 [255309.886136] [] ? wake_up_state+0x20/0x20 [255309.892463] [] ? kiblnd_cq_event+0x90/0x90 [ko2iblnd] [255309.900054] [] kthread+0xd1/0xe0 [255309.905599] [] ? insert_kthread_work+0x40/0x40 [255309.912503] [] ret_from_fork_nospec_begin+0x21/0x21 [255309.919892] [] ? insert_kthread_work+0x40/0x40 [255309.926806] kiblnd_sd_01_00 W ffff9c7de9f4b150 0 5191 2 0x00000080 [255309.934818] Call Trace: [255309.937662] [] schedule+0x29/0x70 [255309.943324] [] kiblnd_scheduler+0x32c/0x1190 [ko2iblnd] [255309.951099] [] ? put_prev_entity+0x31/0x400 [255309.957712] [] ? __switch_to+0xce/0x580 [255309.963937] [] ? wake_up_state+0x20/0x20 [255309.970265] [] ? kiblnd_cq_event+0x90/0x90 [ko2iblnd] [255309.977848] [] kthread+0xd1/0xe0 [255309.983398] [] ? insert_kthread_work+0x40/0x40 [255309.990301] [] ret_from_fork_nospec_begin+0x21/0x21 [255309.997689] [] ? insert_kthread_work+0x40/0x40 [255310.004590] kiblnd_sd_01_01 R running task 0 5192 2 0x00000080 [255310.012587] Call Trace: [255310.015418] [] schedule+0x29/0x70 [255310.021066] [] kiblnd_scheduler+0x33b/0x1190 [ko2iblnd] [255310.028832] [] ? put_prev_entity+0x31/0x400 [255310.035446] [] ? __switch_to+0xce/0x580 [255310.041673] [] ? wake_up_state+0x20/0x20 [255310.048009] [] ? kiblnd_cq_event+0x90/0x90 [ko2iblnd] [255310.055593] [] kthread+0xd1/0xe0 [255310.061140] [] ? insert_kthread_work+0x40/0x40 [255310.068053] [] ret_from_fork_nospec_begin+0x21/0x21 [255310.075441] [] ? insert_kthread_work+0x40/0x40 [255310.082343] kiblnd_sd_01_02 S ffff9c7b39e8d230 0 5193 2 0x00000080 [255310.090334] Call Trace: [255310.093164] [] schedule+0x29/0x70 [255310.098839] [] kiblnd_scheduler+0x32c/0x1190 [ko2iblnd] [255310.106615] [] ? put_prev_entity+0x31/0x400 [255310.113228] [] ? __switch_to+0xce/0x580 [255310.119455] [] ? wake_up_state+0x20/0x20 [255310.125791] [] ? kiblnd_cq_event+0x90/0x90 [ko2iblnd] [255310.133374] [] kthread+0xd1/0xe0 [255310.138921] [] ? insert_kthread_work+0x40/0x40 [255310.145836] [] ret_from_fork_nospec_begin+0x21/0x21 [255310.153225] [] ? insert_kthread_work+0x40/0x40 [255310.160128] kiblnd_sd_01_03 R running task 0 5194 2 0x00000080 [255310.168119] Call Trace: [255310.170951] [] schedule+0x29/0x70 [255310.176605] [] kiblnd_scheduler+0x32c/0x1190 [ko2iblnd] [255310.184380] [] ? put_prev_entity+0x31/0x400 [255310.191005] [] ? __switch_to+0xce/0x580 [255310.197231] [] ? wake_up_state+0x20/0x20 [255310.203559] [] ? kiblnd_cq_event+0x90/0x90 [ko2iblnd] [255310.211143] [] kthread+0xd1/0xe0 [255310.216688] [] ? insert_kthread_work+0x40/0x40 [255310.223591] [] ret_from_fork_nospec_begin+0x21/0x21 [255310.230995] [] ? insert_kthread_work+0x40/0x40 [255310.237904] lnet_discovery S ffff9c81dfe9b150 0 5195 2 0x00000080 [255310.245914] Call Trace: [255310.248758] [] schedule+0x29/0x70 [255310.254403] [] schedule_timeout+0x168/0x2d0 [255310.261019] [] ? __internal_add_timer+0x130/0x130 [255310.268239] [] lnet_peer_discovery+0xe9/0x1450 [lnet] [255310.275836] [] ? wake_up_atomic_t+0x30/0x30 [255310.282465] [] ? lnet_peer_merge_data+0xfa0/0xfa0 [lnet] [255310.290350] [] kthread+0xd1/0xe0 [255310.295923] [] ? insert_kthread_work+0x40/0x40 [255310.302839] [] ret_from_fork_nospec_begin+0x21/0x21 [255310.310229] [] ? insert_kthread_work+0x40/0x40 [255310.317135] monitor_thread S ffff9c81dfe98000 0 5196 2 0x00000080 [255310.325132] Call Trace: [255310.327956] [] schedule+0x29/0x70 [255310.333599] [] schedule_timeout+0x168/0x2d0 [255310.340222] [] ? __internal_add_timer+0x130/0x130 [255310.347418] [] wait_for_completion_interruptible_timeout+0x111/0x170 [255310.356466] [] ? wake_up_state+0x20/0x20 [255310.362801] [] lnet_monitor_thread+0x3df/0x490 [lnet] [255310.370398] [] ? lnet_recover_peer_nis+0x670/0x670 [lnet] [255310.378368] [] kthread+0xd1/0xe0 [255310.383914] [] ? insert_kthread_work+0x40/0x40 [255310.390817] [] ret_from_fork_nospec_begin+0x21/0x21 [255310.398207] [] ? insert_kthread_work+0x40/0x40 [255310.405113] ptlrpcd_rcv S ffff9c7dbc208000 0 5197 2 0x00000080 [255310.413134] Call Trace: [255310.415993] [] ? ktime_get_real_seconds+0xe/0x10 [libcfs] [255310.424006] [] ? ptlrpc_check_set+0x13c5/0x1ed0 [ptlrpc] [255310.431893] [] schedule+0x29/0x70 [255310.437536] [] schedule_timeout+0x168/0x2d0 [255310.444152] [] ? __internal_add_timer+0x130/0x130 [255310.451402] [] ptlrpcd+0x4ef/0x6a0 [ptlrpc] [255310.458016] [] ? __switch_to+0xce/0x580 [255310.464242] [] ? wake_up_atomic_t+0x30/0x30 [255310.470914] [] ? ptlrpcd_check+0x590/0x590 [ptlrpc] [255310.478317] [] kthread+0xd1/0xe0 [255310.483858] [] ? insert_kthread_work+0x40/0x40 [255310.490773] [] ret_from_fork_nospec_begin+0x21/0x21 [255310.498162] [] ? insert_kthread_work+0x40/0x40 [255310.505066] ptlrpcd_00_00 S ffff9c7dbc209070 0 5198 2 0x00000080 [255310.513077] Call Trace: [255310.515965] [] ? ptlrpcd_check+0x23d/0x590 [ptlrpc] [255310.523377] [] schedule+0x29/0x70 [255310.529077] [] ptlrpcd+0x575/0x6a0 [ptlrpc] [255310.535715] [] ? __switch_to+0xce/0x580 [255310.541945] [] ? wake_up_atomic_t+0x30/0x30 [255310.548624] [] ? ptlrpcd_check+0x590/0x590 [ptlrpc] [255310.556014] [] kthread+0xd1/0xe0 [255310.561573] [] ? insert_kthread_work+0x40/0x40 [255310.568490] [] ret_from_fork_nospec_begin+0x21/0x21 [255310.575871] [] ? insert_kthread_work+0x40/0x40 [255310.582772] ptlrpcd_00_01 S ffff9c7dbc20a0e0 0 5199 2 0x00000080 [255310.590773] Call Trace: [255310.593643] [] ? ptlrpcd_check+0x23d/0x590 [ptlrpc] [255310.601034] [] schedule+0x29/0x70 [255310.606741] [] ptlrpcd+0x575/0x6a0 [ptlrpc] [255310.613357] [] ? __switch_to+0xce/0x580 [255310.619583] [] ? wake_up_atomic_t+0x30/0x30 [255310.626251] [] ? ptlrpcd_check+0x590/0x590 [ptlrpc] [255310.633655] [] kthread+0xd1/0xe0 [255310.639200] [] ? insert_kthread_work+0x40/0x40 [255310.646102] [] ret_from_fork_nospec_begin+0x21/0x21 [255310.653489] [] ? insert_kthread_work+0x40/0x40 [255310.660404] ptlrpcd_00_02 S ffff9c7dbc20b150 0 5200 2 0x00000080 [255310.668426] Call Trace: [255310.671315] [] ? ptlrpcd_check+0x23d/0x590 [ptlrpc] [255310.678722] [] schedule+0x29/0x70 [255310.684415] [] ptlrpcd+0x575/0x6a0 [ptlrpc] [255310.691044] [] ? __switch_to+0xce/0x580 [255310.697267] [] ? wake_up_atomic_t+0x30/0x30 [255310.703919] [] ? ptlrpcd_check+0x590/0x590 [ptlrpc] [255310.711318] [] kthread+0xd1/0xe0 [255310.716868] [] ? insert_kthread_work+0x40/0x40 [255310.723784] [] ret_from_fork_nospec_begin+0x21/0x21 [255310.731175] [] ? insert_kthread_work+0x40/0x40 [255310.738099] ptlrpcd_00_03 S ffff9c7dbc20c1c0 0 5201 2 0x00000080 [255310.746100] Call Trace: [255310.748997] [] ? ptlrpcd_check+0x23d/0x590 [ptlrpc] [255310.756400] [] schedule+0x29/0x70 [255310.762100] [] ptlrpcd+0x575/0x6a0 [ptlrpc] [255310.768714] [] ? __switch_to+0xce/0x580 [255310.774956] [] ? wake_up_atomic_t+0x30/0x30 [255310.781621] [] ? ptlrpcd_check+0x590/0x590 [ptlrpc] [255310.789013] [] kthread+0xd1/0xe0 [255310.794558] [] ? insert_kthread_work+0x40/0x40 [255310.801464] [] ret_from_fork_nospec_begin+0x21/0x21 [255310.808859] [] ? insert_kthread_work+0x40/0x40 [255310.815761] ptlrpcd_00_04 S ffff9c7dbc20d230 0 5202 2 0x00000080 [255310.823781] Call Trace: [255310.826666] [] ? ptlrpcd_check+0x23d/0x590 [ptlrpc] [255310.834065] [] schedule+0x29/0x70 [255310.839754] [] ptlrpcd+0x575/0x6a0 [ptlrpc] [255310.846371] [] ? __switch_to+0xce/0x580 [255310.852591] [] ? wake_up_atomic_t+0x30/0x30 [255310.859257] [] ? ptlrpcd_check+0x590/0x590 [ptlrpc] [255310.866662] [] kthread+0xd1/0xe0 [255310.872209] [] ? insert_kthread_work+0x40/0x40 [255310.879112] [] ret_from_fork_nospec_begin+0x21/0x21 [255310.886500] [] ? insert_kthread_work+0x40/0x40 [255310.893403] ptlrpcd_00_05 S ffff9c7dbc20e2a0 0 5203 2 0x00000080 [255310.901402] Call Trace: [255310.904287] [] ? ptlrpcd_check+0x23d/0x590 [ptlrpc] [255310.911680] [] schedule+0x29/0x70 [255310.917376] [] ptlrpcd+0x575/0x6a0 [ptlrpc] [255310.924008] [] ? __switch_to+0xce/0x580 [255310.930242] [] ? wake_up_atomic_t+0x30/0x30 [255310.936898] [] ? ptlrpcd_check+0x590/0x590 [ptlrpc] [255310.944296] [] kthread+0xd1/0xe0 [255310.949849] [] ? insert_kthread_work+0x40/0x40 [255310.956758] [] ret_from_fork_nospec_begin+0x21/0x21 [255310.964153] [] ? insert_kthread_work+0x40/0x40 [255310.971056] ptlrpcd_00_06 S ffff9c7dbc6d8000 0 5204 2 0x00000080 [255310.979052] Call Trace: [255310.981940] [] ? ptlrpcd_check+0x23d/0x590 [ptlrpc] [255310.989383] [] schedule+0x29/0x70 [255310.995081] [] ptlrpcd+0x575/0x6a0 [ptlrpc] [255311.001699] [] ? __switch_to+0xce/0x580 [255311.007916] [] ? wake_up_atomic_t+0x30/0x30 [255311.014583] [] ? ptlrpcd_check+0x590/0x590 [ptlrpc] [255311.021974] [] kthread+0xd1/0xe0 [255311.027521] [] ? insert_kthread_work+0x40/0x40 [255311.034423] [] ret_from_fork_nospec_begin+0x21/0x21 [255311.041835] [] ? insert_kthread_work+0x40/0x40 [255311.048737] ptlrpcd_00_07 S ffff9c7dbc6d9070 0 5205 2 0x00000080 [255311.056733] Call Trace: [255311.059620] [] ? ptlrpcd_check+0x23d/0x590 [ptlrpc] [255311.067025] [] schedule+0x29/0x70 [255311.072736] [] ptlrpcd+0x575/0x6a0 [ptlrpc] [255311.079354] [] ? __switch_to+0xce/0x580 [255311.085572] [] ? wake_up_atomic_t+0x30/0x30 [255311.092242] [] ? ptlrpcd_check+0x590/0x590 [ptlrpc] [255311.099634] [] kthread+0xd1/0xe0 [255311.105184] [] ? insert_kthread_work+0x40/0x40 [255311.112089] [] ret_from_fork_nospec_begin+0x21/0x21 [255311.119480] [] ? insert_kthread_work+0x40/0x40 [255311.126381] ptlrpcd_00_08 S ffff9c7dbc6da0e0 0 5206 2 0x00000080 [255311.134404] Call Trace: [255311.137286] [] ? ptlrpcd_check+0x23d/0x590 [ptlrpc] [255311.144690] [] schedule+0x29/0x70 [255311.150397] [] ptlrpcd+0x575/0x6a0 [ptlrpc] [255311.157018] [] ? __switch_to+0xce/0x580 [255311.163244] [] ? wake_up_atomic_t+0x30/0x30 [255311.169920] [] ? ptlrpcd_check+0x590/0x590 [ptlrpc] [255311.177324] [] kthread+0xd1/0xe0 [255311.182871] [] ? insert_kthread_work+0x40/0x40 [255311.189805] [] ret_from_fork_nospec_begin+0x21/0x21 [255311.197194] [] ? insert_kthread_work+0x40/0x40 [255311.204097] ptlrpcd_00_09 S ffff9c7dbc6db150 0 5207 2 0x00000080 [255311.212110] Call Trace: [255311.214985] [] ? ptlrpcd_check+0x23d/0x590 [ptlrpc] [255311.222398] [] schedule+0x29/0x70 [255311.228094] [] ptlrpcd+0x575/0x6a0 [ptlrpc] [255311.234712] [] ? __switch_to+0xce/0x580 [255311.240951] [] ? wake_up_atomic_t+0x30/0x30 [255311.247617] [] ? ptlrpcd_check+0x590/0x590 [ptlrpc] [255311.255009] [] kthread+0xd1/0xe0 [255311.260559] [] ? insert_kthread_work+0x40/0x40 [255311.267471] [] ret_from_fork_nospec_begin+0x21/0x21 [255311.274871] [] ? insert_kthread_work+0x40/0x40 [255311.281787] ptlrpcd_00_10 S ffff9c7dbc6dc1c0 0 5208 2 0x00000080 [255311.289775] Call Trace: [255311.292645] [] ? ptlrpcd_check+0x23d/0x590 [ptlrpc] [255311.300037] [] schedule+0x29/0x70 [255311.305728] [] ptlrpcd+0x575/0x6a0 [ptlrpc] [255311.312333] [] ? __switch_to+0xce/0x580 [255311.318560] [] ? wake_up_atomic_t+0x30/0x30 [255311.325214] [] ? ptlrpcd_check+0x590/0x590 [ptlrpc] [255311.332605] [] kthread+0xd1/0xe0 [255311.338165] [] ? insert_kthread_work+0x40/0x40 [255311.345069] [] ret_from_fork_nospec_begin+0x21/0x21 [255311.352460] [] ? insert_kthread_work+0x40/0x40 [255311.359364] ptlrpcd_00_11 S ffff9c7dbc6dd230 0 5209 2 0x00000080 [255311.367385] Call Trace: [255311.370259] [] ? ptlrpcd_check+0x23d/0x590 [ptlrpc] [255311.377667] [] schedule+0x29/0x70 [255311.383349] [] ptlrpcd+0x575/0x6a0 [ptlrpc] [255311.389988] [] ? __switch_to+0xce/0x580 [255311.396211] [] ? wake_up_atomic_t+0x30/0x30 [255311.402896] [] ? ptlrpcd_check+0x590/0x590 [ptlrpc] [255311.410306] [] kthread+0xd1/0xe0 [255311.415853] [] ? insert_kthread_work+0x40/0x40 [255311.422784] [] ret_from_fork_nospec_begin+0x21/0x21 [255311.430173] [] ? insert_kthread_work+0x40/0x40 [255311.437096] ptlrpcd_00_12 S ffff9c7dbc6de2a0 0 5210 2 0x00000080 [255311.445108] Call Trace: [255311.447979] [] ? ptlrpcd_check+0x23d/0x590 [ptlrpc] [255311.455370] [] schedule+0x29/0x70 [255311.461051] [] ptlrpcd+0x575/0x6a0 [ptlrpc] [255311.467667] [] ? __switch_to+0xce/0x580 [255311.473914] [] ? wake_up_atomic_t+0x30/0x30 [255311.480583] [] ? ptlrpcd_check+0x590/0x590 [ptlrpc] [255311.487975] [] kthread+0xd1/0xe0 [255311.493529] [] ? insert_kthread_work+0x40/0x40 [255311.500447] [] ret_from_fork_nospec_begin+0x21/0x21 [255311.507835] [] ? insert_kthread_work+0x40/0x40 [255311.514739] ptlrpcd_00_13 S ffff9c7dd3698000 0 5211 2 0x00000080 [255311.522745] Call Trace: [255311.525630] [] ? ptlrpcd_check+0x23d/0x590 [ptlrpc] [255311.533035] [] schedule+0x29/0x70 [255311.538718] [] ptlrpcd+0x575/0x6a0 [ptlrpc] [255311.545341] [] ? __switch_to+0xce/0x580 [255311.551580] [] ? wake_up_atomic_t+0x30/0x30 [255311.558248] [] ? ptlrpcd_check+0x590/0x590 [ptlrpc] [255311.565645] [] kthread+0xd1/0xe0 [255311.571196] [] ? insert_kthread_work+0x40/0x40 [255311.578093] [] ret_from_fork_nospec_begin+0x21/0x21 [255311.585493] [] ? insert_kthread_work+0x40/0x40 [255311.592397] ptlrpcd_00_14 S ffff9c7dd3699070 0 5212 2 0x00000080 [255311.600386] Call Trace: [255311.603269] [] ? ptlrpcd_check+0x23d/0x590 [ptlrpc] [255311.610661] [] schedule+0x29/0x70 [255311.616359] [] ptlrpcd+0x575/0x6a0 [ptlrpc] [255311.622984] [] ? __switch_to+0xce/0x580 [255311.629218] [] ? wake_up_atomic_t+0x30/0x30 [255311.635872] [] ? ptlrpcd_check+0x590/0x590 [ptlrpc] [255311.643276] [] kthread+0xd1/0xe0 [255311.648821] [] ? insert_kthread_work+0x40/0x40 [255311.655725] [] ret_from_fork_nospec_begin+0x21/0x21 [255311.663126] [] ? insert_kthread_work+0x40/0x40 [255311.670052] ptlrpcd_00_15 S ffff9c7de8e71070 0 5213 2 0x00000080 [255311.678061] Call Trace: [255311.680964] [] ? ptlrpcd_check+0x23d/0x590 [ptlrpc] [255311.688367] [] schedule+0x29/0x70 [255311.694067] [] ptlrpcd+0x575/0x6a0 [ptlrpc] [255311.700703] [] ? __switch_to+0xce/0x580 [255311.706936] [] ? wake_up_atomic_t+0x30/0x30 [255311.713603] [] ? ptlrpcd_check+0x590/0x590 [ptlrpc] [255311.721007] [] kthread+0xd1/0xe0 [255311.726555] [] ? insert_kthread_work+0x40/0x40 [255311.733466] [] ret_from_fork_nospec_begin+0x21/0x21 [255311.740870] [] ? insert_kthread_work+0x40/0x40 [255311.747772] ptlrpcd_01_00 S ffff9c7de8e73150 0 5214 2 0x00000080 [255311.755781] Call Trace: [255311.758660] [] ? ptlrpcd_check+0x23d/0x590 [ptlrpc] [255311.766050] [] schedule+0x29/0x70 [255311.771740] [] ptlrpcd+0x575/0x6a0 [ptlrpc] [255311.778366] [] ? __switch_to+0xce/0x580 [255311.784592] [] ? wake_up_atomic_t+0x30/0x30 [255311.791244] [] ? ptlrpcd_check+0x590/0x590 [ptlrpc] [255311.798648] [] kthread+0xd1/0xe0 [255311.804205] [] ? insert_kthread_work+0x40/0x40 [255311.811121] [] ret_from_fork_nospec_begin+0x21/0x21 [255311.818522] [] ? insert_kthread_work+0x40/0x40 [255311.825437] ptlrpcd_01_01 S ffff9c7de8e741c0 0 5215 2 0x00000080 [255311.833440] Call Trace: [255311.836323] [] ? ptlrpcd_check+0x23d/0x590 [ptlrpc] [255311.843721] [] schedule+0x29/0x70 [255311.849406] [] ptlrpcd+0x575/0x6a0 [ptlrpc] [255311.856036] [] ? __switch_to+0xce/0x580 [255311.862262] [] ? wake_up_atomic_t+0x30/0x30 [255311.868927] [] ? ptlrpcd_check+0x590/0x590 [ptlrpc] [255311.876318] [] kthread+0xd1/0xe0 [255311.881867] [] ? insert_kthread_work+0x40/0x40 [255311.888778] [] ret_from_fork_nospec_begin+0x21/0x21 [255311.896169] [] ? insert_kthread_work+0x40/0x40 [255311.903073] ptlrpcd_01_02 S ffff9c7de8e762a0 0 5216 2 0x00000080 [255311.911083] Call Trace: [255311.913954] [] ? ptlrpcd_check+0x23d/0x590 [ptlrpc] [255311.921335] [] schedule+0x29/0x70 [255311.927015] [] ptlrpcd+0x575/0x6a0 [ptlrpc] [255311.933643] [] ? __switch_to+0xce/0x580 [255311.939868] [] ? wake_up_atomic_t+0x30/0x30 [255311.946541] [] ? ptlrpcd_check+0x590/0x590 [ptlrpc] [255311.953944] [] kthread+0xd1/0xe0 [255311.959493] [] ? insert_kthread_work+0x40/0x40 [255311.966395] [] ret_from_fork_nospec_begin+0x21/0x21 [255311.973783] [] ? insert_kthread_work+0x40/0x40 [255311.980697] ptlrpcd_01_03 S ffff9c7de8e720e0 0 5217 2 0x00000080 [255311.988730] Call Trace: [255311.991617] [] ? ptlrpcd_check+0x23d/0x590 [ptlrpc] [255311.999011] [] schedule+0x29/0x70 [255312.004698] [] ptlrpcd+0x575/0x6a0 [ptlrpc] [255312.011327] [] ? __switch_to+0xce/0x580 [255312.017553] [] ? wake_up_atomic_t+0x30/0x30 [255312.024216] [] ? ptlrpcd_check+0x590/0x590 [ptlrpc] [255312.031607] [] kthread+0xd1/0xe0 [255312.037153] [] ? insert_kthread_work+0x40/0x40 [255312.044057] [] ret_from_fork_nospec_begin+0x21/0x21 [255312.051445] [] ? insert_kthread_work+0x40/0x40 [255312.058346] ptlrpcd_01_04 S ffff9c7de8e70000 0 5218 2 0x00000080 [255312.066360] Call Trace: [255312.069248] [] ? ptlrpcd_check+0x23d/0x590 [ptlrpc] [255312.076630] [] schedule+0x29/0x70 [255312.082326] [] ptlrpcd+0x575/0x6a0 [ptlrpc] [255312.088951] [] ? __switch_to+0xce/0x580 [255312.095175] [] ? wake_up_atomic_t+0x30/0x30 [255312.101841] [] ? ptlrpcd_check+0x590/0x590 [ptlrpc] [255312.109234] [] kthread+0xd1/0xe0 [255312.114782] [] ? insert_kthread_work+0x40/0x40 [255312.121684] [] ret_from_fork_nospec_begin+0x21/0x21 [255312.129073] [] ? insert_kthread_work+0x40/0x40 [255312.135974] ptlrpcd_01_05 S ffff9c79f6b9a0e0 0 5219 2 0x00000080 [255312.143998] Call Trace: [255312.146884] [] ? ptlrpcd_check+0x23d/0x590 [ptlrpc] [255312.154287] [] schedule+0x29/0x70 [255312.159988] [] ptlrpcd+0x575/0x6a0 [ptlrpc] [255312.166603] [] ? __switch_to+0xce/0x580 [255312.172836] [] ? wake_up_atomic_t+0x30/0x30 [255312.179504] [] ? ptlrpcd_check+0x590/0x590 [ptlrpc] [255312.186920] [] kthread+0xd1/0xe0 [255312.192484] [] ? insert_kthread_work+0x40/0x40 [255312.199402] [] ret_from_fork_nospec_begin+0x21/0x21 [255312.206805] [] ? insert_kthread_work+0x40/0x40 [255312.213706] ptlrpcd_01_06 S ffff9c7de7928000 0 5220 2 0x00000080 [255312.221718] Call Trace: [255312.224594] [] ? ptlrpcd_check+0x23d/0x590 [ptlrpc] [255312.231996] [] schedule+0x29/0x70 [255312.237667] [] ptlrpcd+0x575/0x6a0 [ptlrpc] [255312.244295] [] ? __switch_to+0xce/0x580 [255312.250523] [] ? wake_up_atomic_t+0x30/0x30 [255312.257196] [] ? ptlrpcd_check+0x590/0x590 [ptlrpc] [255312.264589] [] kthread+0xd1/0xe0 [255312.270136] [] ? insert_kthread_work+0x40/0x40 [255312.277040] [] ret_from_fork_nospec_begin+0x21/0x21 [255312.284429] [] ? insert_kthread_work+0x40/0x40 [255312.291330] ptlrpcd_01_07 S ffff9c7b390041c0 0 5221 2 0x00000080 [255312.299329] Call Trace: [255312.302200] [] ? ptlrpcd_check+0x23d/0x590 [ptlrpc] [255312.309592] [] schedule+0x29/0x70 [255312.315291] [] ptlrpcd+0x575/0x6a0 [ptlrpc] [255312.321899] [] ? __switch_to+0xce/0x580 [255312.328126] [] ? wake_up_atomic_t+0x30/0x30 [255312.334795] [] ? ptlrpcd_check+0x590/0x590 [ptlrpc] [255312.342186] [] kthread+0xd1/0xe0 [255312.347734] [] ? insert_kthread_work+0x40/0x40 [255312.354639] [] ret_from_fork_nospec_begin+0x21/0x21 [255312.362028] [] ? insert_kthread_work+0x40/0x40 [255312.368943] ptlrpcd_01_08 S ffff9c7b390062a0 0 5222 2 0x00000080 [255312.376972] Call Trace: [255312.379870] [] ? ptlrpcd_check+0x23d/0x590 [ptlrpc] [255312.387262] [] schedule+0x29/0x70 [255312.392957] [] ptlrpcd+0x575/0x6a0 [ptlrpc] [255312.399587] [] ? __switch_to+0xce/0x580 [255312.405813] [] ? wake_up_atomic_t+0x30/0x30 [255312.412472] [] ? ptlrpcd_check+0x590/0x590 [ptlrpc] [255312.419880] [] kthread+0xd1/0xe0 [255312.425431] [] ? insert_kthread_work+0x40/0x40 [255312.432339] [] ret_from_fork_nospec_begin+0x21/0x21 [255312.439733] [] ? insert_kthread_work+0x40/0x40 [255312.446637] ptlrpcd_01_09 S ffff9c7dade98000 0 5223 2 0x00000080 [255312.454646] Call Trace: [255312.457543] [] ? ptlrpcd_check+0x23d/0x590 [ptlrpc] [255312.464934] [] schedule+0x29/0x70 [255312.470615] [] ptlrpcd+0x575/0x6a0 [ptlrpc] [255312.477231] [] ? __switch_to+0xce/0x580 [255312.483457] [] ? wake_up_atomic_t+0x30/0x30 [255312.490117] [] ? ptlrpcd_check+0x590/0x590 [ptlrpc] [255312.497521] [] kthread+0xd1/0xe0 [255312.503068] [] ? insert_kthread_work+0x40/0x40 [255312.509981] [] ret_from_fork_nospec_begin+0x21/0x21 [255312.517378] [] ? insert_kthread_work+0x40/0x40 [255312.524281] ptlrpcd_01_10 S ffff9c7dade99070 0 5224 2 0x00000080 [255312.532282] Call Trace: [255312.535153] [] ? ptlrpcd_check+0x23d/0x590 [ptlrpc] [255312.542548] [] schedule+0x29/0x70 [255312.548248] [] ptlrpcd+0x575/0x6a0 [ptlrpc] [255312.554882] [] ? __switch_to+0xce/0x580 [255312.561107] [] ? wake_up_atomic_t+0x30/0x30 [255312.567774] [] ? ptlrpcd_check+0x590/0x590 [ptlrpc] [255312.575173] [] kthread+0xd1/0xe0 [255312.580721] [] ? insert_kthread_work+0x40/0x40 [255312.587624] [] ret_from_fork_nospec_begin+0x21/0x21 [255312.595013] [] ? insert_kthread_work+0x40/0x40 [255312.601915] ptlrpcd_01_11 S ffff9c7dade9a0e0 0 5225 2 0x00000080 [255312.609925] Call Trace: [255312.612818] [] ? ptlrpcd_check+0x23d/0x590 [ptlrpc] [255312.620216] [] schedule+0x29/0x70 [255312.625913] [] ptlrpcd+0x575/0x6a0 [ptlrpc] [255312.632540] [] ? __switch_to+0xce/0x580 [255312.638757] [] ? wake_up_atomic_t+0x30/0x30 [255312.645425] [] ? ptlrpcd_check+0x590/0x590 [ptlrpc] [255312.652820] [] kthread+0xd1/0xe0 [255312.658376] [] ? insert_kthread_work+0x40/0x40 [255312.665293] [] ret_from_fork_nospec_begin+0x21/0x21 [255312.672674] [] ? insert_kthread_work+0x40/0x40 [255312.679576] ptlrpcd_01_12 S ffff9c7dade9b150 0 5226 2 0x00000080 [255312.687595] Call Trace: [255312.690482] [] ? ptlrpcd_check+0x23d/0x590 [ptlrpc] [255312.697874] [] schedule+0x29/0x70 [255312.703572] [] ptlrpcd+0x575/0x6a0 [ptlrpc] [255312.710187] [] ? __switch_to+0xce/0x580 [255312.716426] [] ? wake_up_atomic_t+0x30/0x30 [255312.723090] [] ? ptlrpcd_check+0x590/0x590 [ptlrpc] [255312.730482] [] kthread+0xd1/0xe0 [255312.736040] [] ? insert_kthread_work+0x40/0x40 [255312.742945] [] ret_from_fork_nospec_begin+0x21/0x21 [255312.750349] [] ? insert_kthread_work+0x40/0x40 [255312.757262] ptlrpcd_01_13 S ffff9c7dade9c1c0 0 5227 2 0x00000080 [255312.765263] Call Trace: [255312.768143] [] ? ptlrpcd_check+0x23d/0x590 [ptlrpc] [255312.775537] [] schedule+0x29/0x70 [255312.781219] [] ptlrpcd+0x575/0x6a0 [ptlrpc] [255312.787833] [] ? __switch_to+0xce/0x580 [255312.794057] [] ? wake_up_atomic_t+0x30/0x30 [255312.800716] [] ? ptlrpcd_check+0x590/0x590 [ptlrpc] [255312.808106] [] kthread+0xd1/0xe0 [255312.813653] [] ? insert_kthread_work+0x40/0x40 [255312.820568] [] ret_from_fork_nospec_begin+0x21/0x21 [255312.827957] [] ? insert_kthread_work+0x40/0x40 [255312.834858] ptlrpcd_01_14 S ffff9c7dade9d230 0 5228 2 0x00000080 [255312.842897] Call Trace: [255312.845777] [] ? ptlrpcd_check+0x23d/0x590 [ptlrpc] [255312.853168] [] schedule+0x29/0x70 [255312.858881] [] ptlrpcd+0x575/0x6a0 [ptlrpc] [255312.865518] [] ? __switch_to+0xce/0x580 [255312.871742] [] ? wake_up_atomic_t+0x30/0x30 [255312.878409] [] ? ptlrpcd_check+0x590/0x590 [ptlrpc] [255312.885803] [] kthread+0xd1/0xe0 [255312.891351] [] ? insert_kthread_work+0x40/0x40 [255312.898256] [] ret_from_fork_nospec_begin+0x21/0x21 [255312.905650] [] ? insert_kthread_work+0x40/0x40 [255312.912553] ptlrpcd_01_15 S ffff9c7dade9e2a0 0 5229 2 0x00000080 [255312.920564] Call Trace: [255312.923465] [] ? ptlrpcd_check+0x23d/0x590 [ptlrpc] [255312.930863] [] schedule+0x29/0x70 [255312.936549] [] ptlrpcd+0x575/0x6a0 [ptlrpc] [255312.943165] [] ? __switch_to+0xce/0x580 [255312.949390] [] ? wake_up_atomic_t+0x30/0x30 [255312.956060] [] ? ptlrpcd_check+0x590/0x590 [ptlrpc] [255312.963452] [] kthread+0xd1/0xe0 [255312.969006] [] ? insert_kthread_work+0x40/0x40 [255312.975913] [] ret_from_fork_nospec_begin+0x21/0x21 [255312.983308] [] ? insert_kthread_work+0x40/0x40 [255312.990213] kmmpd-dm-5 S ffff9c7dabfe0000 0 5230 2 0x00000080 [255312.998206] Call Trace: [255313.001037] [] schedule+0x29/0x70 [255313.006694] [] schedule_timeout+0x168/0x2d0 [255313.013308] [] ? __internal_add_timer+0x130/0x130 [255313.020540] [] ? write_mmp_block+0x12a/0x160 [ldiskfs] [255313.028244] [] schedule_timeout_interruptible+0x1e/0x20 [255313.036031] [] kmmpd+0x216/0x430 [ldiskfs] [255313.042554] [] ? __dump_mmp_msg+0x70/0x70 [ldiskfs] [255313.049956] [] kthread+0xd1/0xe0 [255313.055504] [] ? insert_kthread_work+0x40/0x40 [255313.062415] [] ret_from_fork_nospec_begin+0x21/0x21 [255313.069813] [] ? insert_kthread_work+0x40/0x40 [255313.076736] jbd2/dm-5-8 S ffff9c7dabfe1070 0 5231 2 0x00000080 [255313.084738] Call Trace: [255313.087571] [] ? task_rq_unlock+0x20/0x20 [255313.093990] [] schedule+0x29/0x70 [255313.099655] [] kjournald2+0x203/0x260 [jbd2] [255313.106357] [] ? wake_up_atomic_t+0x30/0x30 [255313.112975] [] ? commit_timeout+0x10/0x10 [jbd2] [255313.120072] [] kthread+0xd1/0xe0 [255313.125618] [] ? insert_kthread_work+0x40/0x40 [255313.132535] [] ret_from_fork_nospec_begin+0x21/0x21 [255313.139922] [] ? insert_kthread_work+0x40/0x40 [255313.146825] ldiskfs-rsv-con S ffff9c7dabfe20e0 0 5232 2 0x00000080 [255313.154848] Call Trace: [255313.157688] [] schedule+0x29/0x70 [255313.163332] [] rescuer_thread+0x31e/0x3c0 [255313.169770] [] ? process_one_work+0x440/0x440 [255313.176588] [] kthread+0xd1/0xe0 [255313.182135] [] ? insert_kthread_work+0x40/0x40 [255313.189038] [] ret_from_fork_nospec_begin+0x21/0x21 [255313.196427] [] ? insert_kthread_work+0x40/0x40 [255313.203332] ldlm_cb00_000 S ffff9c7dabfe3150 0 5235 2 0x00000080 [255313.211340] Call Trace: [255313.214174] [] ? __set_current_blocked+0x42/0x70 [255313.221272] [] schedule+0x29/0x70 [255313.226967] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255313.234566] [] ? wake_up_atomic_t+0x30/0x30 [255313.241249] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255313.248404] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255313.256768] [] kthread+0xd1/0xe0 [255313.262334] [] ? insert_kthread_work+0x40/0x40 [255313.269237] [] ret_from_fork_nospec_begin+0x21/0x21 [255313.276640] [] ? insert_kthread_work+0x40/0x40 [255313.283543] ldlm_cb00_001 S ffff9c7dabfe41c0 0 5236 2 0x00000080 [255313.291577] Call Trace: [255313.294409] [] ? __set_current_blocked+0x42/0x70 [255313.301509] [] schedule+0x29/0x70 [255313.307206] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255313.314799] [] ? __wake_up+0x13/0x20 [255313.320743] [] ? wake_up_atomic_t+0x30/0x30 [255313.327411] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255313.334566] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255313.342928] [] kthread+0xd1/0xe0 [255313.348474] [] ? insert_kthread_work+0x40/0x40 [255313.355384] [] ret_from_fork_nospec_begin+0x21/0x21 [255313.362790] [] ? insert_kthread_work+0x40/0x40 [255313.369694] ldlm_cb01_000 S ffff9c7dabfe5230 0 5237 2 0x00000080 [255313.377711] Call Trace: [255313.380544] [] ? __set_current_blocked+0x42/0x70 [255313.387641] [] schedule+0x29/0x70 [255313.393322] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255313.400916] [] ? __wake_up+0x13/0x20 [255313.406856] [] ? wake_up_atomic_t+0x30/0x30 [255313.413521] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255313.420688] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255313.429064] [] kthread+0xd1/0xe0 [255313.434624] [] ? insert_kthread_work+0x40/0x40 [255313.441527] [] ret_from_fork_nospec_begin+0x21/0x21 [255313.448921] [] ? insert_kthread_work+0x40/0x40 [255313.455825] ldlm_cb01_001 S ffff9c7dabfe62a0 0 5238 2 0x00000080 [255313.463829] Call Trace: [255313.466670] [] ? __set_current_blocked+0x42/0x70 [255313.473776] [] schedule+0x29/0x70 [255313.479474] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255313.487073] [] ? __wake_up+0x13/0x20 [255313.493006] [] ? wake_up_atomic_t+0x30/0x30 [255313.499674] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255313.506822] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255313.515194] [] kthread+0xd1/0xe0 [255313.520749] [] ? insert_kthread_work+0x40/0x40 [255313.527654] [] ret_from_fork_nospec_begin+0x21/0x21 [255313.535057] [] ? insert_kthread_work+0x40/0x40 [255313.541959] ldlm_cn00_000 S ffff9c7dae8a0000 0 5239 2 0x00000080 [255313.549968] Call Trace: [255313.552805] [] ? __set_current_blocked+0x42/0x70 [255313.559910] [] schedule+0x29/0x70 [255313.565606] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255313.573197] [] ? __wake_up+0x13/0x20 [255313.579141] [] ? wake_up_atomic_t+0x30/0x30 [255313.585826] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255313.592964] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255313.601318] [] kthread+0xd1/0xe0 [255313.606864] [] ? insert_kthread_work+0x40/0x40 [255313.613776] [] ret_from_fork_nospec_begin+0x21/0x21 [255313.621165] [] ? insert_kthread_work+0x40/0x40 [255313.628067] ldlm_cn00_001 S ffff9c7dae8a1070 0 5240 2 0x00000080 [255313.636077] Call Trace: [255313.638910] [] ? __set_current_blocked+0x42/0x70 [255313.646007] [] schedule+0x29/0x70 [255313.651707] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255313.659325] [] ? wake_up_atomic_t+0x30/0x30 [255313.666008] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255313.673145] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255313.681516] [] kthread+0xd1/0xe0 [255313.687062] [] ? insert_kthread_work+0x40/0x40 [255313.693970] [] ret_from_fork_nospec_begin+0x21/0x21 [255313.701359] [] ? insert_kthread_work+0x40/0x40 [255313.708262] ldlm_cn00_002 S ffff9c7dae8a20e0 0 5241 2 0x00000080 [255313.716260] Call Trace: [255313.719093] [] ? __set_current_blocked+0x42/0x70 [255313.726192] [] schedule+0x29/0x70 [255313.731878] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255313.739494] [] ? __wake_up+0x13/0x20 [255313.745440] [] ? wake_up_atomic_t+0x30/0x30 [255313.752112] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255313.759256] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255313.767617] [] kthread+0xd1/0xe0 [255313.773176] [] ? insert_kthread_work+0x40/0x40 [255313.780079] [] ret_from_fork_nospec_begin+0x21/0x21 [255313.787481] [] ? insert_kthread_work+0x40/0x40 [255313.794375] ldlm_cn01_000 S ffff9c7dae8a3150 0 5242 2 0x00000080 [255313.802378] Call Trace: [255313.805224] [] ? _raw_spin_lock_irqsave+0x37/0x40 [255313.812417] [] schedule+0x29/0x70 [255313.818121] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255313.825714] [] ? _raw_spin_lock+0x20/0x30 [255313.832144] [] ? wake_up_atomic_t+0x30/0x30 [255313.838804] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255313.845968] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255313.854344] [] kthread+0xd1/0xe0 [255313.859907] [] ? insert_kthread_work+0x40/0x40 [255313.866819] [] ret_from_fork_nospec_begin+0x21/0x21 [255313.874207] [] ? insert_kthread_work+0x40/0x40 [255313.881109] ldlm_cn01_001 S ffff9c7dae8a41c0 0 5243 2 0x00000080 [255313.889099] Call Trace: [255313.891940] [] ? _raw_spin_lock_irqsave+0x37/0x40 [255313.899134] [] schedule+0x29/0x70 [255313.904833] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255313.912419] [] ? __wake_up+0x13/0x20 [255313.918382] [] ? wake_up_atomic_t+0x30/0x30 [255313.925048] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255313.932201] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255313.940564] [] kthread+0xd1/0xe0 [255313.946124] [] ? insert_kthread_work+0x40/0x40 [255313.953026] [] ret_from_fork_nospec_begin+0x21/0x21 [255313.960424] [] ? insert_kthread_work+0x40/0x40 [255313.967328] ldlm_cn01_002 S ffff9c7dae8a5230 0 5244 2 0x00000080 [255313.975326] Call Trace: [255313.978171] [] ? __set_current_blocked+0x42/0x70 [255313.985269] [] schedule+0x29/0x70 [255313.990966] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255313.998570] [] ? __wake_up+0x13/0x20 [255314.004505] [] ? wake_up_atomic_t+0x30/0x30 [255314.011172] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255314.018341] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255314.026703] [] kthread+0xd1/0xe0 [255314.032287] [] ? insert_kthread_work+0x40/0x40 [255314.039192] [] ret_from_fork_nospec_begin+0x21/0x21 [255314.046582] [] ? insert_kthread_work+0x40/0x40 [255314.053486] ldlm_bl_01 S ffff9c7dae8a62a0 0 5245 2 0x00000080 [255314.061499] Call Trace: [255314.064406] [] ? obd_stale_export_get+0x31/0x190 [obdclass] [255314.072570] [] schedule+0x29/0x70 [255314.078261] [] ldlm_bl_thread_main+0x709/0xa00 [ptlrpc] [255314.086052] [] ? wake_up_atomic_t+0x30/0x30 [255314.092706] [] ? ldlm_handle_bl_callback+0x3e0/0x3e0 [ptlrpc] [255314.101074] [] kthread+0xd1/0xe0 [255314.106634] [] ? insert_kthread_work+0x40/0x40 [255314.113550] [] ret_from_fork_nospec_begin+0x21/0x21 [255314.120952] [] ? insert_kthread_work+0x40/0x40 [255314.127855] ldlm_bl_02 S ffff9c7dae8c0000 0 5246 2 0x00000080 [255314.135866] Call Trace: [255314.138739] [] ? obd_stale_export_get+0x31/0x190 [obdclass] [255314.146905] [] schedule+0x29/0x70 [255314.152603] [] ldlm_bl_thread_main+0x709/0xa00 [ptlrpc] [255314.160394] [] ? wake_up_atomic_t+0x30/0x30 [255314.167046] [] ? ldlm_handle_bl_callback+0x3e0/0x3e0 [ptlrpc] [255314.175407] [] kthread+0xd1/0xe0 [255314.180970] [] ? insert_kthread_work+0x40/0x40 [255314.187873] [] ret_from_fork_nospec_begin+0x21/0x21 [255314.195263] [] ? insert_kthread_work+0x40/0x40 [255314.202179] ldlm_elt S ffff9c7dae8c1070 0 5247 2 0x00000080 [255314.210180] Call Trace: [255314.213024] [] schedule+0x29/0x70 [255314.218729] [] expired_lock_main+0x1c2/0xb20 [ptlrpc] [255314.226331] [] ? wake_up_atomic_t+0x30/0x30 [255314.232996] [] ? ldlm_add_waiting_lock+0x300/0x300 [ptlrpc] [255314.241176] [] kthread+0xd1/0xe0 [255314.246734] [] ? insert_kthread_work+0x40/0x40 [255314.253637] [] ret_from_fork_nospec_begin+0x21/0x21 [255314.261033] [] ? insert_kthread_work+0x40/0x40 [255314.267949] ll_cfg_requeue S ffff9c7dae8c20e0 0 5248 2 0x00000080 [255314.275944] Call Trace: [255314.278794] [] schedule+0x29/0x70 [255314.284441] [] mgc_requeue_thread+0x5de/0x860 [mgc] [255314.291844] [] ? wake_up_atomic_t+0x30/0x30 [255314.298471] [] ? mgc_process_config+0x1870/0x1870 [mgc] [255314.306251] [] kthread+0xd1/0xe0 [255314.311798] [] ? insert_kthread_work+0x40/0x40 [255314.318701] [] ret_from_fork_nospec_begin+0x21/0x21 [255314.326108] [] ? insert_kthread_work+0x40/0x40 [255314.333012] mdt00_000 S ffff9c7dae8c3150 0 5252 2 0x00000080 [255314.341026] Call Trace: [255314.343858] [] schedule+0x29/0x70 [255314.349548] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255314.357124] [] ? _raw_spin_lock+0x20/0x30 [255314.363543] [] ? wake_up_atomic_t+0x30/0x30 [255314.370208] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255314.377365] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255314.385728] [] kthread+0xd1/0xe0 [255314.391274] [] ? insert_kthread_work+0x40/0x40 [255314.398199] [] ret_from_fork_nospec_begin+0x21/0x21 [255314.405600] [] ? insert_kthread_work+0x40/0x40 [255314.412508] mdt00_001 S ffff9c7dae8c41c0 0 5253 2 0x00000080 [255314.420503] Call Trace: [255314.423337] [] ? __set_current_blocked+0x42/0x70 [255314.430450] [] schedule+0x29/0x70 [255314.436150] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255314.443736] [] ? _raw_spin_lock+0x20/0x30 [255314.450154] [] ? wake_up_atomic_t+0x30/0x30 [255314.456829] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255314.463968] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255314.472341] [] kthread+0xd1/0xe0 [255314.477897] [] ? insert_kthread_work+0x40/0x40 [255314.484803] [] ret_from_fork_nospec_begin+0x21/0x21 [255314.492201] [] ? insert_kthread_work+0x40/0x40 [255314.499106] mdt00_002 S ffff9c7dae8c5230 0 5254 2 0x00000080 [255314.507113] Call Trace: [255314.509947] [] ? _raw_spin_lock_irqsave+0x37/0x40 [255314.517135] [] schedule+0x29/0x70 [255314.522840] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255314.530425] [] ? __wake_up+0x13/0x20 [255314.536360] [] ? wake_up_atomic_t+0x30/0x30 [255314.543014] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255314.550169] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255314.558531] [] kthread+0xd1/0xe0 [255314.564078] [] ? insert_kthread_work+0x40/0x40 [255314.570982] [] ret_from_fork_nospec_begin+0x21/0x21 [255314.578372] [] ? insert_kthread_work+0x40/0x40 [255314.585288] mdt01_000 S ffff9c7dae8c62a0 0 5255 2 0x00000080 [255314.593319] Call Trace: [255314.596153] [] ? __set_current_blocked+0x42/0x70 [255314.603251] [] schedule+0x29/0x70 [255314.608934] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255314.616524] [] ? __wake_up+0x13/0x20 [255314.622460] [] ? wake_up_atomic_t+0x30/0x30 [255314.629111] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255314.636262] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255314.644628] [] kthread+0xd1/0xe0 [255314.650176] [] ? insert_kthread_work+0x40/0x40 [255314.657079] [] ret_from_fork_nospec_begin+0x21/0x21 [255314.664470] [] ? insert_kthread_work+0x40/0x40 [255314.671372] mdt01_001 S ffff9c7a68ed0000 0 5256 2 0x00000080 [255314.679368] Call Trace: [255314.682201] [] ? __set_current_blocked+0x42/0x70 [255314.689300] [] schedule+0x29/0x70 [255314.694982] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255314.702567] [] ? __wake_up+0x13/0x20 [255314.708500] [] ? wake_up_atomic_t+0x30/0x30 [255314.715153] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255314.722304] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255314.730678] [] kthread+0xd1/0xe0 [255314.736237] [] ? insert_kthread_work+0x40/0x40 [255314.743134] [] ret_from_fork_nospec_begin+0x21/0x21 [255314.750537] [] ? insert_kthread_work+0x40/0x40 [255314.757438] mdt01_002 S ffff9c7a68ed1070 0 5257 2 0x00000080 [255314.765449] Call Trace: [255314.768280] [] ? _raw_spin_lock_irqsave+0x37/0x40 [255314.775472] [] schedule+0x29/0x70 [255314.781168] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255314.788755] [] ? _raw_spin_lock+0x20/0x30 [255314.795176] [] ? wake_up_atomic_t+0x30/0x30 [255314.801846] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255314.809011] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255314.817373] [] kthread+0xd1/0xe0 [255314.822922] [] ? insert_kthread_work+0x40/0x40 [255314.829825] [] ret_from_fork_nospec_begin+0x21/0x21 [255314.837226] [] ? insert_kthread_work+0x40/0x40 [255314.844128] mdt_rdpg00_000 S ffff9c7a68ed20e0 0 5258 2 0x00000080 [255314.852129] Call Trace: [255314.854953] [] ? __set_current_blocked+0x42/0x70 [255314.862051] [] schedule+0x29/0x70 [255314.867741] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255314.875340] [] ? __wake_up+0x13/0x20 [255314.881276] [] ? wake_up_atomic_t+0x30/0x30 [255314.887942] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255314.895098] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255314.903459] [] kthread+0xd1/0xe0 [255314.909006] [] ? insert_kthread_work+0x40/0x40 [255314.915911] [] ret_from_fork_nospec_begin+0x21/0x21 [255314.923330] [] ? insert_kthread_work+0x40/0x40 [255314.930227] mdt_rdpg00_001 S ffff9c7a68ed3150 0 5259 2 0x00000080 [255314.938232] Call Trace: [255314.941064] [] ? __set_current_blocked+0x42/0x70 [255314.948162] [] schedule+0x29/0x70 [255314.953844] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255314.961443] [] ? __wake_up+0x13/0x20 [255314.967379] [] ? wake_up_atomic_t+0x30/0x30 [255314.974044] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255314.981186] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255314.989572] [] kthread+0xd1/0xe0 [255314.995122] [] ? insert_kthread_work+0x40/0x40 [255315.002026] [] ret_from_fork_nospec_begin+0x21/0x21 [255315.009416] [] ? insert_kthread_work+0x40/0x40 [255315.016319] mdt_rdpg01_000 S ffff9c7a68ed41c0 0 5260 2 0x00000080 [255315.024323] Call Trace: [255315.027167] [] ? __set_current_blocked+0x42/0x70 [255315.034265] [] schedule+0x29/0x70 [255315.039948] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255315.047534] [] ? wake_up_atomic_t+0x30/0x30 [255315.054204] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255315.061367] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255315.069737] [] kthread+0xd1/0xe0 [255315.075284] [] ? insert_kthread_work+0x40/0x40 [255315.082189] [] ret_from_fork_nospec_begin+0x21/0x21 [255315.089599] [] ? insert_kthread_work+0x40/0x40 [255315.096504] mdt_rdpg01_001 S ffff9c7a68ed5230 0 5261 2 0x00000080 [255315.104510] Call Trace: [255315.107340] [] schedule+0x29/0x70 [255315.113039] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255315.120621] [] ? _raw_spin_lock+0x20/0x30 [255315.127040] [] ? wake_up_atomic_t+0x30/0x30 [255315.133717] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255315.140856] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255315.149227] [] kthread+0xd1/0xe0 [255315.154781] [] ? insert_kthread_work+0x40/0x40 [255315.161686] [] ret_from_fork_nospec_begin+0x21/0x21 [255315.169076] [] ? insert_kthread_work+0x40/0x40 [255315.175979] mdt_attr00_000 S ffff9c7a68ed62a0 0 5262 2 0x00000080 [255315.183977] Call Trace: [255315.186811] [] ? __set_current_blocked+0x42/0x70 [255315.193908] [] schedule+0x29/0x70 [255315.199606] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255315.207215] [] ? wake_up_atomic_t+0x30/0x30 [255315.213883] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255315.221021] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255315.229383] [] kthread+0xd1/0xe0 [255315.234930] [] ? insert_kthread_work+0x40/0x40 [255315.241836] [] ret_from_fork_nospec_begin+0x21/0x21 [255315.249224] [] ? insert_kthread_work+0x40/0x40 [255315.256139] mdt_attr00_001 S ffff9c7db90b8000 0 5263 2 0x00000080 [255315.264148] Call Trace: [255315.266980] [] ? __set_current_blocked+0x42/0x70 [255315.274091] [] schedule+0x29/0x70 [255315.279791] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255315.287377] [] ? wake_up_atomic_t+0x30/0x30 [255315.294034] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255315.301182] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255315.309553] [] kthread+0xd1/0xe0 [255315.315105] [] ? insert_kthread_work+0x40/0x40 [255315.322001] [] ret_from_fork_nospec_begin+0x21/0x21 [255315.329399] [] ? insert_kthread_work+0x40/0x40 [255315.336338] mdt_attr01_000 S ffff9c7db90b9070 0 5264 2 0x00000080 [255315.344356] Call Trace: [255315.347192] [] ? __set_current_blocked+0x42/0x70 [255315.354289] [] schedule+0x29/0x70 [255315.359984] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255315.367571] [] ? wake_up_atomic_t+0x30/0x30 [255315.374237] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255315.381381] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255315.389754] [] kthread+0xd1/0xe0 [255315.395303] [] ? insert_kthread_work+0x40/0x40 [255315.402208] [] ret_from_fork_nospec_begin+0x21/0x21 [255315.409610] [] ? insert_kthread_work+0x40/0x40 [255315.416504] mdt_attr01_001 S ffff9c7db90ba0e0 0 5265 2 0x00000080 [255315.424497] Call Trace: [255315.427344] [] ? __set_current_blocked+0x42/0x70 [255315.434442] [] schedule+0x29/0x70 [255315.440122] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255315.447716] [] ? wake_up_atomic_t+0x30/0x30 [255315.454392] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255315.461557] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255315.469918] [] kthread+0xd1/0xe0 [255315.475501] [] ? insert_kthread_work+0x40/0x40 [255315.482414] [] ret_from_fork_nospec_begin+0x21/0x21 [255315.489805] [] ? insert_kthread_work+0x40/0x40 [255315.496709] mdt_out00_000 S ffff9c7db90bb150 0 5266 2 0x00000080 [255315.504711] Call Trace: [255315.507557] [] ? __set_current_blocked+0x42/0x70 [255315.514654] [] schedule+0x29/0x70 [255315.520355] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255315.527942] [] ? __wake_up+0x13/0x20 [255315.533889] [] ? wake_up_atomic_t+0x30/0x30 [255315.540562] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255315.547709] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255315.556083] [] kthread+0xd1/0xe0 [255315.561640] [] ? insert_kthread_work+0x40/0x40 [255315.568542] [] ret_from_fork_nospec_begin+0x21/0x21 [255315.575930] [] ? insert_kthread_work+0x40/0x40 [255315.582834] mdt_out00_001 S ffff9c7db90bc1c0 0 5267 2 0x00000080 [255315.590834] Call Trace: [255315.593672] [] ? __set_current_blocked+0x42/0x70 [255315.600795] [] schedule+0x29/0x70 [255315.606506] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255315.614092] [] ? __wake_up+0x13/0x20 [255315.620032] [] ? wake_up_atomic_t+0x30/0x30 [255315.626685] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255315.633843] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255315.642203] [] kthread+0xd1/0xe0 [255315.647751] [] ? insert_kthread_work+0x40/0x40 [255315.654654] [] ret_from_fork_nospec_begin+0x21/0x21 [255315.662059] [] ? insert_kthread_work+0x40/0x40 [255315.668963] mdt_out01_000 S ffff9c7db90bd230 0 5268 2 0x00000080 [255315.676969] Call Trace: [255315.679802] [] ? _raw_spin_lock_irqsave+0x37/0x40 [255315.687002] [] schedule+0x29/0x70 [255315.692684] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255315.700264] [] ? __wake_up+0x13/0x20 [255315.706197] [] ? wake_up_atomic_t+0x30/0x30 [255315.712848] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255315.719988] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255315.728351] [] kthread+0xd1/0xe0 [255315.733921] [] ? insert_kthread_work+0x40/0x40 [255315.740833] [] ret_from_fork_nospec_begin+0x21/0x21 [255315.748225] [] ? insert_kthread_work+0x40/0x40 [255315.755129] mdt_out01_001 S ffff9c7db90be2a0 0 5269 2 0x00000080 [255315.763131] Call Trace: [255315.765964] [] ? __set_current_blocked+0x42/0x70 [255315.773061] [] schedule+0x29/0x70 [255315.778755] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255315.786373] [] ? __wake_up+0x13/0x20 [255315.792313] [] ? wake_up_atomic_t+0x30/0x30 [255315.798971] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255315.806122] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255315.814494] [] kthread+0xd1/0xe0 [255315.820048] [] ? insert_kthread_work+0x40/0x40 [255315.826951] [] ret_from_fork_nospec_begin+0x21/0x21 [255315.834340] [] ? insert_kthread_work+0x40/0x40 [255315.841243] mdt_seqs_0000 S ffff9c7a688b8000 0 5270 2 0x00000080 [255315.849241] Call Trace: [255315.852102] [] ? __set_current_blocked+0x42/0x70 [255315.859212] [] schedule+0x29/0x70 [255315.864911] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255315.872490] [] ? wake_up_atomic_t+0x30/0x30 [255315.879149] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255315.886295] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255315.894647] [] kthread+0xd1/0xe0 [255315.900192] [] ? insert_kthread_work+0x40/0x40 [255315.907102] [] ret_from_fork_nospec_begin+0x21/0x21 [255315.914492] [] ? insert_kthread_work+0x40/0x40 [255315.921396] mdt_seqs_0001 S ffff9c7a688b9070 0 5271 2 0x00000080 [255315.929397] Call Trace: [255315.932240] [] ? __set_current_blocked+0x42/0x70 [255315.939350] [] schedule+0x29/0x70 [255315.945048] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255315.952635] [] ? wake_up_atomic_t+0x30/0x30 [255315.959304] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255315.966462] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255315.974821] [] kthread+0xd1/0xe0 [255315.980368] [] ? insert_kthread_work+0x40/0x40 [255315.987285] [] ret_from_fork_nospec_begin+0x21/0x21 [255315.994688] [] ? insert_kthread_work+0x40/0x40 [255316.001602] mdt_seqm_0000 S ffff9c7a688ba0e0 0 5272 2 0x00000080 [255316.009618] Call Trace: [255316.012450] [] ? __set_current_blocked+0x42/0x70 [255316.019553] [] schedule+0x29/0x70 [255316.025247] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255316.032833] [] ? __wake_up+0x13/0x20 [255316.038781] [] ? wake_up_atomic_t+0x30/0x30 [255316.045433] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255316.052575] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255316.060940] [] kthread+0xd1/0xe0 [255316.066511] [] ? insert_kthread_work+0x40/0x40 [255316.073426] [] ret_from_fork_nospec_begin+0x21/0x21 [255316.080814] [] ? insert_kthread_work+0x40/0x40 [255316.087717] mdt_seqm_0001 S ffff9c7a688bb150 0 5273 2 0x00000080 [255316.095728] Call Trace: [255316.098563] [] ? __set_current_blocked+0x42/0x70 [255316.105667] [] schedule+0x29/0x70 [255316.111354] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255316.118945] [] ? __wake_up+0x13/0x20 [255316.124879] [] ? wake_up_atomic_t+0x30/0x30 [255316.131546] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255316.138707] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255316.147068] [] kthread+0xd1/0xe0 [255316.152640] [] ? insert_kthread_work+0x40/0x40 [255316.159546] [] ret_from_fork_nospec_begin+0x21/0x21 [255316.166936] [] ? insert_kthread_work+0x40/0x40 [255316.173838] mdt_fld_0000 S ffff9c7a688bc1c0 0 5274 2 0x00000080 [255316.181848] Call Trace: [255316.184682] [] ? __set_current_blocked+0x42/0x70 [255316.191780] [] schedule+0x29/0x70 [255316.197492] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255316.205092] [] ? wake_up_atomic_t+0x30/0x30 [255316.211745] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255316.218915] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255316.227276] [] kthread+0xd1/0xe0 [255316.232824] [] ? insert_kthread_work+0x40/0x40 [255316.239727] [] ret_from_fork_nospec_begin+0x21/0x21 [255316.247115] [] ? insert_kthread_work+0x40/0x40 [255316.254019] mdt_fld_0001 S ffff9c7a688bd230 0 5275 2 0x00000080 [255316.262016] Call Trace: [255316.264847] [] ? __set_current_blocked+0x42/0x70 [255316.271945] [] schedule+0x29/0x70 [255316.277652] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255316.285238] [] ? wake_up_atomic_t+0x30/0x30 [255316.291906] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255316.299071] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255316.307434] [] kthread+0xd1/0xe0 [255316.312996] [] ? insert_kthread_work+0x40/0x40 [255316.319913] [] ret_from_fork_nospec_begin+0x21/0x21 [255316.327299] [] ? insert_kthread_work+0x40/0x40 [255316.334201] mdt_io00_000 S ffff9c7a688be2a0 0 5276 2 0x00000080 [255316.342207] Call Trace: [255316.345051] [] ? __set_current_blocked+0x42/0x70 [255316.352150] [] schedule+0x29/0x70 [255316.357862] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255316.365454] [] ? __wake_up+0x13/0x20 [255316.371388] [] ? wake_up_atomic_t+0x30/0x30 [255316.378055] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255316.385211] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255316.393582] [] kthread+0xd1/0xe0 [255316.399130] [] ? insert_kthread_work+0x40/0x40 [255316.406037] [] ret_from_fork_nospec_begin+0x21/0x21 [255316.413426] [] ? insert_kthread_work+0x40/0x40 [255316.420330] mdt_io00_001 S ffff9c7a68370000 0 5277 2 0x00000080 [255316.428328] Call Trace: [255316.431162] [] ? __set_current_blocked+0x42/0x70 [255316.438281] [] schedule+0x29/0x70 [255316.443978] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255316.451572] [] ? __wake_up+0x13/0x20 [255316.457507] [] ? wake_up_atomic_t+0x30/0x30 [255316.464163] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255316.471314] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255316.479684] [] kthread+0xd1/0xe0 [255316.485242] [] ? insert_kthread_work+0x40/0x40 [255316.492148] [] ret_from_fork_nospec_begin+0x21/0x21 [255316.499553] [] ? insert_kthread_work+0x40/0x40 [255316.506454] mdt_io00_002 S ffff9c7a68371070 0 5278 2 0x00000080 [255316.514463] Call Trace: [255316.517287] [] ? __set_current_blocked+0x42/0x70 [255316.524385] [] schedule+0x29/0x70 [255316.530066] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255316.537654] [] ? __wake_up+0x13/0x20 [255316.543590] [] ? wake_up_atomic_t+0x30/0x30 [255316.550246] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255316.557399] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255316.565774] [] kthread+0xd1/0xe0 [255316.571326] [] ? insert_kthread_work+0x40/0x40 [255316.578232] [] ret_from_fork_nospec_begin+0x21/0x21 [255316.585627] [] ? insert_kthread_work+0x40/0x40 [255316.592536] mdt_io01_000 S ffff9c7a683720e0 0 5279 2 0x00000080 [255316.600556] Call Trace: [255316.603394] [] ? __set_current_blocked+0x42/0x70 [255316.610494] [] schedule+0x29/0x70 [255316.616201] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255316.623786] [] ? __wake_up+0x13/0x20 [255316.629721] [] ? wake_up_atomic_t+0x30/0x30 [255316.636391] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255316.643533] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255316.651903] [] kthread+0xd1/0xe0 [255316.657483] [] ? insert_kthread_work+0x40/0x40 [255316.664411] [] ret_from_fork_nospec_begin+0x21/0x21 [255316.671802] [] ? insert_kthread_work+0x40/0x40 [255316.678720] mdt_io01_001 S ffff9c7a68373150 0 5280 2 0x00000080 [255316.686717] Call Trace: [255316.689558] [] ? __set_current_blocked+0x42/0x70 [255316.696664] [] schedule+0x29/0x70 [255316.702359] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255316.709959] [] ? __wake_up+0x13/0x20 [255316.715894] [] ? wake_up_atomic_t+0x30/0x30 [255316.722566] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255316.729707] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255316.738067] [] kthread+0xd1/0xe0 [255316.743613] [] ? insert_kthread_work+0x40/0x40 [255316.750545] [] ret_from_fork_nospec_begin+0x21/0x21 [255316.757933] [] ? insert_kthread_work+0x40/0x40 [255316.764848] mdt_io01_002 S ffff9c7a683741c0 0 5281 2 0x00000080 [255316.772847] Call Trace: [255316.775692] [] ? __set_current_blocked+0x42/0x70 [255316.782782] [] schedule+0x29/0x70 [255316.788471] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255316.796070] [] ? __wake_up+0x13/0x20 [255316.802004] [] ? wake_up_atomic_t+0x30/0x30 [255316.808671] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255316.815824] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255316.824185] [] kthread+0xd1/0xe0 [255316.829731] [] ? insert_kthread_work+0x40/0x40 [255316.836634] [] ret_from_fork_nospec_begin+0x21/0x21 [255316.844024] [] ? insert_kthread_work+0x40/0x40 [255316.850928] ll_evictor S ffff9c7dea4f1070 0 5287 2 0x00000080 [255316.858940] Call Trace: [255316.861784] [] schedule+0x29/0x70 [255316.867508] [] ping_evictor_main+0x54e/0x700 [ptlrpc] [255316.875111] [] ? wake_up_atomic_t+0x30/0x30 [255316.881763] [] ? ptlrpc_del_timeout_client+0x190/0x190 [ptlrpc] [255316.890321] [] kthread+0xd1/0xe0 [255316.895870] [] ? insert_kthread_work+0x40/0x40 [255316.902776] [] ret_from_fork_nospec_begin+0x21/0x21 [255316.910164] [] ? insert_kthread_work+0x40/0x40 [255316.917069] osp_up0-3 S ffff9c7dea4f20e0 0 5290 2 0x00000080 [255316.925066] Call Trace: [255316.927916] [] ? osp_get_next_request+0x2d/0x1a0 [osp] [255316.935606] [] schedule+0x29/0x70 [255316.941257] [] osp_send_update_thread+0x1b5/0x450 [osp] [255316.949058] [] ? wake_up_atomic_t+0x30/0x30 [255316.955677] [] ? osp_invalidate_request+0x390/0x390 [osp] [255316.963659] [] kthread+0xd1/0xe0 [255316.969206] [] ? insert_kthread_work+0x40/0x40 [255316.976112] [] ret_from_fork_nospec_begin+0x21/0x21 [255316.983503] [] ? insert_kthread_work+0x40/0x40 [255316.990406] osp-pre-0-3 S ffff9c7dea4f41c0 0 5291 2 0x00000080 [255316.998406] Call Trace: [255317.001243] [] schedule+0x29/0x70 [255317.006896] [] osp_precreate_thread+0x76b/0x12a0 [osp] [255317.014580] [] ? wake_up_atomic_t+0x30/0x30 [255317.021200] [] ? osp_init_pre_fid+0x630/0x630 [osp] [255317.028588] [] kthread+0xd1/0xe0 [255317.034147] [] ? insert_kthread_work+0x40/0x40 [255317.041051] [] ret_from_fork_nospec_begin+0x21/0x21 [255317.048442] [] ? insert_kthread_work+0x40/0x40 [255317.055345] osp_up1-3 S ffff9c7dea4f5230 0 5292 2 0x00000080 [255317.063345] Call Trace: [255317.066195] [] ? osp_get_next_request+0x2d/0x1a0 [osp] [255317.073890] [] schedule+0x29/0x70 [255317.079542] [] osp_send_update_thread+0x1b5/0x450 [osp] [255317.087320] [] ? wake_up_atomic_t+0x30/0x30 [255317.093939] [] ? osp_invalidate_request+0x390/0x390 [osp] [255317.101910] [] kthread+0xd1/0xe0 [255317.107458] [] ? insert_kthread_work+0x40/0x40 [255317.114362] [] ret_from_fork_nospec_begin+0x21/0x21 [255317.121760] [] ? insert_kthread_work+0x40/0x40 [255317.128663] osp-pre-1-3 S ffff9c7de8afc1c0 0 5293 2 0x00000080 [255317.136669] Call Trace: [255317.139522] [] schedule+0x29/0x70 [255317.145163] [] osp_precreate_thread+0x76b/0x12a0 [osp] [255317.152857] [] ? wake_up_atomic_t+0x30/0x30 [255317.159479] [] ? osp_init_pre_fid+0x630/0x630 [osp] [255317.166888] [] kthread+0xd1/0xe0 [255317.172436] [] ? insert_kthread_work+0x40/0x40 [255317.179347] [] ret_from_fork_nospec_begin+0x21/0x21 [255317.186748] [] ? insert_kthread_work+0x40/0x40 [255317.193657] osp_up2-3 S ffff9c7de8afa0e0 0 5294 2 0x00000080 [255317.201658] Call Trace: [255317.204496] [] ? osp_get_next_request+0x2d/0x1a0 [osp] [255317.212185] [] schedule+0x29/0x70 [255317.217836] [] osp_send_update_thread+0x1b5/0x450 [osp] [255317.225613] [] ? wake_up_atomic_t+0x30/0x30 [255317.232242] [] ? osp_invalidate_request+0x390/0x390 [osp] [255317.240213] [] kthread+0xd1/0xe0 [255317.245760] [] ? insert_kthread_work+0x40/0x40 [255317.252675] [] ret_from_fork_nospec_begin+0x21/0x21 [255317.260063] [] ? insert_kthread_work+0x40/0x40 [255317.266987] osp-pre-2-3 S ffff9c81e9719070 0 5295 2 0x00000080 [255317.274987] Call Trace: [255317.277818] [] schedule+0x29/0x70 [255317.283469] [] osp_precreate_thread+0x377/0x12a0 [osp] [255317.291150] [] ? wake_up_atomic_t+0x30/0x30 [255317.297782] [] ? osp_init_pre_fid+0x630/0x630 [osp] [255317.305185] [] kthread+0xd1/0xe0 [255317.310733] [] ? insert_kthread_work+0x40/0x40 [255317.317639] [] ret_from_fork_nospec_begin+0x21/0x21 [255317.325030] [] ? insert_kthread_work+0x40/0x40 [255317.331950] osp-syn-0-3 S ffff9c7da86e8000 0 5296 2 0x00000080 [255317.339971] Call Trace: [255317.342816] [] schedule+0x29/0x70 [255317.348470] [] osp_sync_process_queues+0x1681/0x1c20 [osp] [255317.356551] [] ? wake_up_atomic_t+0x30/0x30 [255317.363202] [] llog_process_thread+0x85f/0x1a10 [obdclass] [255317.371285] [] ? llog_cat_id2handle+0x3a8/0x620 [obdclass] [255317.379360] [] ? osp_sync_force+0x300/0x300 [osp] [255317.386598] [] llog_process_or_fork+0xcf/0x520 [obdclass] [255317.394595] [] ? llog_cat_process_common+0x119/0x420 [obdclass] [255317.403185] [] llog_cat_process_cb+0x239/0x250 [obdclass] [255317.411175] [] llog_process_thread+0x85f/0x1a10 [obdclass] [255317.419247] [] ? tracing_is_on+0x15/0x30 [255317.425571] [] ? tracing_record_cmdline+0x1d/0x120 [255317.432869] [] ? try_to_wake_up+0x190/0x390 [255317.439517] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [255317.448088] [] llog_process_or_fork+0xcf/0x520 [obdclass] [255317.456083] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [255317.464656] [] llog_cat_process_or_fork+0x1f1/0x370 [obdclass] [255317.473118] [] ? __wake_up_common_lock+0x91/0xc0 [255317.480221] [] ? osp_sync_force+0x300/0x300 [osp] [255317.487437] [] llog_cat_process+0x2e/0x30 [obdclass] [255317.494957] [] osp_sync_thread+0x550/0xb70 [osp] [255317.502059] [] ? __schedule+0x402/0x840 [255317.508291] [] ? osp_sync_process_committed+0xd40/0xd40 [osp] [255317.516651] [] kthread+0xd1/0xe0 [255317.522210] [] ? insert_kthread_work+0x40/0x40 [255317.529104] [] ret_from_fork_nospec_begin+0x21/0x21 [255317.536495] [] ? insert_kthread_work+0x40/0x40 [255317.543403] osp-pre-0-3 S ffff9c7de9ed9070 0 5297 2 0x00000080 [255317.551382] Call Trace: [255317.554213] [] schedule+0x29/0x70 [255317.559860] [] osp_precreate_thread+0x76b/0x12a0 [osp] [255317.567542] [] ? wake_up_atomic_t+0x30/0x30 [255317.574163] [] ? osp_init_pre_fid+0x630/0x630 [osp] [255317.581571] [] kthread+0xd1/0xe0 [255317.587117] [] ? insert_kthread_work+0x40/0x40 [255317.594045] [] ret_from_fork_nospec_begin+0x21/0x21 [255317.601440] [] ? insert_kthread_work+0x40/0x40 [255317.608342] osp-syn-1-3 S ffff9c7de9edd230 0 5304 2 0x00000080 [255317.616365] Call Trace: [255317.619199] [] schedule+0x29/0x70 [255317.624847] [] osp_sync_process_queues+0x1681/0x1c20 [osp] [255317.632932] [] ? wake_up_atomic_t+0x30/0x30 [255317.639570] [] llog_process_thread+0x85f/0x1a10 [obdclass] [255317.647664] [] ? llog_cat_id2handle+0x3a8/0x620 [obdclass] [255317.655739] [] ? osp_sync_force+0x300/0x300 [osp] [255317.662957] [] llog_process_or_fork+0xcf/0x520 [obdclass] [255317.670964] [] ? llog_cat_process_common+0x119/0x420 [obdclass] [255317.679551] [] llog_cat_process_cb+0x239/0x250 [obdclass] [255317.687541] [] llog_process_thread+0x85f/0x1a10 [obdclass] [255317.695619] [] ? tracing_is_on+0x15/0x30 [255317.701952] [] ? tracing_record_cmdline+0x1d/0x120 [255317.709244] [] ? try_to_wake_up+0x190/0x390 [255317.715876] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [255317.724473] [] llog_process_or_fork+0xcf/0x520 [obdclass] [255317.732493] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [255317.741064] [] llog_cat_process_or_fork+0x1f1/0x370 [obdclass] [255317.749542] [] ? __wake_up_common_lock+0x91/0xc0 [255317.756650] [] ? osp_sync_force+0x300/0x300 [osp] [255317.763882] [] llog_cat_process+0x2e/0x30 [obdclass] [255317.771378] [] osp_sync_thread+0x550/0xb70 [osp] [255317.778486] [] ? __schedule+0x402/0x840 [255317.784717] [] ? osp_sync_process_committed+0xd40/0xd40 [osp] [255317.793099] [] kthread+0xd1/0xe0 [255317.798647] [] ? insert_kthread_work+0x40/0x40 [255317.805564] [] ret_from_fork_nospec_begin+0x21/0x21 [255317.812955] [] ? insert_kthread_work+0x40/0x40 [255317.819864] osp-pre-1-3 S ffff9c7dea5ab150 0 5305 2 0x00000080 [255317.827854] Call Trace: [255317.830687] [] schedule+0x29/0x70 [255317.836337] [] osp_precreate_thread+0x76b/0x12a0 [osp] [255317.844032] [] ? wake_up_atomic_t+0x30/0x30 [255317.850648] [] ? osp_init_pre_fid+0x630/0x630 [osp] [255317.858050] [] kthread+0xd1/0xe0 [255317.863593] [] ? insert_kthread_work+0x40/0x40 [255317.870504] [] ret_from_fork_nospec_begin+0x21/0x21 [255317.877905] [] ? insert_kthread_work+0x40/0x40 [255317.884808] osp-syn-2-3 S ffff9c7dea5aa0e0 0 5308 2 0x00000080 [255317.892810] Call Trace: [255317.895654] [] schedule+0x29/0x70 [255317.901304] [] osp_sync_process_queues+0x1681/0x1c20 [osp] [255317.909379] [] ? wake_up_atomic_t+0x30/0x30 [255317.916023] [] llog_process_thread+0x85f/0x1a10 [obdclass] [255317.924118] [] ? llog_cat_id2handle+0x3a8/0x620 [obdclass] [255317.932197] [] ? osp_sync_force+0x300/0x300 [osp] [255317.939415] [] llog_process_or_fork+0xcf/0x520 [obdclass] [255317.947409] [] ? llog_cat_process_common+0x119/0x420 [obdclass] [255317.956004] [] llog_cat_process_cb+0x239/0x250 [obdclass] [255317.963997] [] llog_process_thread+0x85f/0x1a10 [obdclass] [255317.972067] [] ? tracing_is_on+0x15/0x30 [255317.978391] [] ? tracing_record_cmdline+0x1d/0x120 [255317.985684] [] ? try_to_wake_up+0x190/0x390 [255317.992319] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [255318.000920] [] llog_process_or_fork+0xcf/0x520 [obdclass] [255318.008911] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [255318.017496] [] llog_cat_process_or_fork+0x1f1/0x370 [obdclass] [255318.025956] [] ? __wake_up_common_lock+0x91/0xc0 [255318.033062] [] ? osp_sync_force+0x300/0x300 [osp] [255318.040292] [] llog_cat_process+0x2e/0x30 [obdclass] [255318.047799] [] osp_sync_thread+0x550/0xb70 [osp] [255318.054909] [] ? __schedule+0x402/0x840 [255318.061134] [] ? osp_sync_process_committed+0xd40/0xd40 [osp] [255318.069494] [] kthread+0xd1/0xe0 [255318.075053] [] ? insert_kthread_work+0x40/0x40 [255318.081959] [] ret_from_fork_nospec_begin+0x21/0x21 [255318.089350] [] ? insert_kthread_work+0x40/0x40 [255318.096255] osp-pre-2-3 S ffff9c7dea5a9070 0 5309 2 0x00000080 [255318.104245] Call Trace: [255318.107076] [] schedule+0x29/0x70 [255318.112726] [] osp_precreate_thread+0x76b/0x12a0 [osp] [255318.120411] [] ? wake_up_atomic_t+0x30/0x30 [255318.127030] [] ? osp_init_pre_fid+0x630/0x630 [osp] [255318.134421] [] kthread+0xd1/0xe0 [255318.139971] [] ? insert_kthread_work+0x40/0x40 [255318.146875] [] ret_from_fork_nospec_begin+0x21/0x21 [255318.154265] [] ? insert_kthread_work+0x40/0x40 [255318.161169] osp-syn-3-3 S ffff9c7dea5ae2a0 0 5311 2 0x00000080 [255318.169174] Call Trace: [255318.172007] [] schedule+0x29/0x70 [255318.177657] [] osp_sync_process_queues+0x1681/0x1c20 [osp] [255318.185739] [] ? wake_up_atomic_t+0x30/0x30 [255318.192370] [] llog_process_thread+0x85f/0x1a10 [obdclass] [255318.200478] [] ? llog_cat_id2handle+0x3a8/0x620 [obdclass] [255318.208572] [] ? osp_sync_force+0x300/0x300 [osp] [255318.215791] [] llog_process_or_fork+0xcf/0x520 [obdclass] [255318.223796] [] ? llog_cat_process_common+0x119/0x420 [obdclass] [255318.232379] [] llog_cat_process_cb+0x239/0x250 [obdclass] [255318.240383] [] llog_process_thread+0x85f/0x1a10 [obdclass] [255318.248464] [] ? tracing_is_on+0x15/0x30 [255318.254784] [] ? tracing_record_cmdline+0x1d/0x120 [255318.262076] [] ? try_to_wake_up+0x190/0x390 [255318.268708] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [255318.277282] [] llog_process_or_fork+0xcf/0x520 [obdclass] [255318.285289] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [255318.293871] [] llog_cat_process_or_fork+0x1f1/0x370 [obdclass] [255318.302329] [] ? __wake_up_common_lock+0x91/0xc0 [255318.309441] [] ? osp_sync_force+0x300/0x300 [osp] [255318.316653] [] llog_cat_process+0x2e/0x30 [obdclass] [255318.324144] [] osp_sync_thread+0x550/0xb70 [osp] [255318.331242] [] ? __schedule+0x402/0x840 [255318.337472] [] ? osp_sync_process_committed+0xd40/0xd40 [osp] [255318.345845] [] kthread+0xd1/0xe0 [255318.351396] [] ? insert_kthread_work+0x40/0x40 [255318.358312] [] ret_from_fork_nospec_begin+0x21/0x21 [255318.365693] [] ? insert_kthread_work+0x40/0x40 [255318.372608] osp-pre-3-3 S ffff9c7dea5a8000 0 5312 2 0x00000080 [255318.380632] Call Trace: [255318.383455] [] schedule+0x29/0x70 [255318.389104] [] osp_precreate_thread+0x76b/0x12a0 [osp] [255318.396792] [] ? wake_up_atomic_t+0x30/0x30 [255318.403434] [] ? osp_init_pre_fid+0x630/0x630 [osp] [255318.410823] [] kthread+0xd1/0xe0 [255318.416389] [] ? insert_kthread_work+0x40/0x40 [255318.423293] [] ret_from_fork_nospec_begin+0x21/0x21 [255318.430683] [] ? insert_kthread_work+0x40/0x40 [255318.437587] osp-syn-4-3 S ffff9c7de8aaa0e0 0 5313 2 0x00000080 [255318.445591] Call Trace: [255318.448436] [] schedule+0x29/0x70 [255318.454077] [] osp_sync_process_queues+0x1681/0x1c20 [osp] [255318.462158] [] ? wake_up_atomic_t+0x30/0x30 [255318.468797] [] llog_process_thread+0x85f/0x1a10 [obdclass] [255318.476901] [] ? llog_cat_id2handle+0x3a8/0x620 [obdclass] [255318.484979] [] ? osp_sync_force+0x300/0x300 [osp] [255318.492203] [] llog_process_or_fork+0xcf/0x520 [obdclass] [255318.500193] [] ? llog_cat_process_common+0x119/0x420 [obdclass] [255318.508777] [] llog_cat_process_cb+0x239/0x250 [obdclass] [255318.516766] [] llog_process_thread+0x85f/0x1a10 [obdclass] [255318.524849] [] ? tracing_is_on+0x15/0x30 [255318.531178] [] ? tracing_record_cmdline+0x1d/0x120 [255318.538472] [] ? try_to_wake_up+0x190/0x390 [255318.545136] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [255318.553719] [] llog_process_or_fork+0xcf/0x520 [obdclass] [255318.561705] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [255318.570283] [] llog_cat_process_or_fork+0x1f1/0x370 [obdclass] [255318.578742] [] ? __wake_up_common_lock+0x91/0xc0 [255318.585846] [] ? osp_sync_force+0x300/0x300 [osp] [255318.593064] [] llog_cat_process+0x2e/0x30 [obdclass] [255318.600556] [] osp_sync_thread+0x550/0xb70 [osp] [255318.607657] [] ? __schedule+0x402/0x840 [255318.613899] [] ? osp_sync_process_committed+0xd40/0xd40 [osp] [255318.622257] [] kthread+0xd1/0xe0 [255318.627806] [] ? insert_kthread_work+0x40/0x40 [255318.634710] [] ret_from_fork_nospec_begin+0x21/0x21 [255318.642101] [] ? insert_kthread_work+0x40/0x40 [255318.649004] osp-pre-4-3 S ffff9c7de8aa8000 0 5314 2 0x00000080 [255318.657037] Call Trace: [255318.659870] [] schedule+0x29/0x70 [255318.665521] [] osp_precreate_thread+0x76b/0x12a0 [osp] [255318.673214] [] ? wake_up_atomic_t+0x30/0x30 [255318.679833] [] ? osp_init_pre_fid+0x630/0x630 [osp] [255318.687221] [] kthread+0xd1/0xe0 [255318.692768] [] ? insert_kthread_work+0x40/0x40 [255318.699697] [] ret_from_fork_nospec_begin+0x21/0x21 [255318.707076] [] ? insert_kthread_work+0x40/0x40 [255318.713979] osp-syn-5-3 S ffff9c7de8aac1c0 0 5315 2 0x00000080 [255318.722012] Call Trace: [255318.724843] [] schedule+0x29/0x70 [255318.730507] [] osp_sync_process_queues+0x1681/0x1c20 [osp] [255318.738576] [] ? wake_up_atomic_t+0x30/0x30 [255318.745222] [] llog_process_thread+0x85f/0x1a10 [obdclass] [255318.753322] [] ? llog_cat_id2handle+0x3a8/0x620 [obdclass] [255318.761397] [] ? osp_sync_force+0x300/0x300 [osp] [255318.768626] [] llog_process_or_fork+0xcf/0x520 [obdclass] [255318.776630] [] ? llog_cat_process_common+0x119/0x420 [obdclass] [255318.785201] [] llog_cat_process_cb+0x239/0x250 [obdclass] [255318.793205] [] llog_process_thread+0x85f/0x1a10 [obdclass] [255318.801277] [] ? tracing_is_on+0x15/0x30 [255318.807600] [] ? tracing_record_cmdline+0x1d/0x120 [255318.814894] [] ? try_to_wake_up+0x190/0x390 [255318.821541] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [255318.830127] [] llog_process_or_fork+0xcf/0x520 [obdclass] [255318.838132] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [255318.846719] [] llog_cat_process_or_fork+0x1f1/0x370 [obdclass] [255318.855177] [] ? __wake_up_common_lock+0x91/0xc0 [255318.862282] [] ? osp_sync_force+0x300/0x300 [osp] [255318.869503] [] llog_cat_process+0x2e/0x30 [obdclass] [255318.876995] [] osp_sync_thread+0x550/0xb70 [osp] [255318.884093] [] ? __schedule+0x402/0x840 [255318.890323] [] ? osp_sync_process_committed+0xd40/0xd40 [osp] [255318.898683] [] kthread+0xd1/0xe0 [255318.904244] [] ? insert_kthread_work+0x40/0x40 [255318.911148] [] ret_from_fork_nospec_begin+0x21/0x21 [255318.918548] [] ? insert_kthread_work+0x40/0x40 [255318.925464] osp-pre-5-3 S ffff9c7da8050000 0 5316 2 0x00000080 [255318.933485] Call Trace: [255318.936321] [] schedule+0x29/0x70 [255318.941964] [] osp_precreate_thread+0x76b/0x12a0 [osp] [255318.949646] [] ? wake_up_atomic_t+0x30/0x30 [255318.956276] [] ? osp_init_pre_fid+0x630/0x630 [osp] [255318.963678] [] kthread+0xd1/0xe0 [255318.969240] [] ? insert_kthread_work+0x40/0x40 [255318.976145] [] ret_from_fork_nospec_begin+0x21/0x21 [255318.983535] [] ? insert_kthread_work+0x40/0x40 [255318.990440] osp-syn-6-3 S ffff9c7da8051070 0 5318 2 0x00000080 [255318.998473] Call Trace: [255319.001304] [] schedule+0x29/0x70 [255319.006952] [] osp_sync_process_queues+0x1681/0x1c20 [osp] [255319.015035] [] ? wake_up_atomic_t+0x30/0x30 [255319.021682] [] llog_process_thread+0x85f/0x1a10 [obdclass] [255319.029787] [] ? llog_cat_id2handle+0x3a8/0x620 [obdclass] [255319.037874] [] ? osp_sync_force+0x300/0x300 [osp] [255319.045100] [] llog_process_or_fork+0xcf/0x520 [obdclass] [255319.053090] [] ? llog_cat_process_common+0x119/0x420 [obdclass] [255319.061666] [] llog_cat_process_cb+0x239/0x250 [obdclass] [255319.069682] [] llog_process_thread+0x85f/0x1a10 [obdclass] [255319.077752] [] ? tracing_is_on+0x15/0x30 [255319.084092] [] ? tracing_record_cmdline+0x1d/0x120 [255319.091390] [] ? try_to_wake_up+0x190/0x390 [255319.098035] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [255319.106612] [] llog_process_or_fork+0xcf/0x520 [obdclass] [255319.114619] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [255319.123212] [] llog_cat_process_or_fork+0x1f1/0x370 [obdclass] [255319.131681] [] ? __wake_up_common_lock+0x91/0xc0 [255319.138784] [] ? osp_sync_force+0x300/0x300 [osp] [255319.146013] [] llog_cat_process+0x2e/0x30 [obdclass] [255319.153507] [] osp_sync_thread+0x550/0xb70 [osp] [255319.160605] [] ? __schedule+0x402/0x840 [255319.166836] [] ? osp_sync_process_committed+0xd40/0xd40 [osp] [255319.175195] [] kthread+0xd1/0xe0 [255319.180743] [] ? insert_kthread_work+0x40/0x40 [255319.187659] [] ret_from_fork_nospec_begin+0x21/0x21 [255319.195050] [] ? insert_kthread_work+0x40/0x40 [255319.201952] osp-pre-6-3 S ffff9c7da80520e0 0 5319 2 0x00000080 [255319.209952] Call Trace: [255319.212784] [] schedule+0x29/0x70 [255319.218443] [] osp_precreate_thread+0x76b/0x12a0 [osp] [255319.226125] [] ? wake_up_atomic_t+0x30/0x30 [255319.232756] [] ? osp_init_pre_fid+0x630/0x630 [osp] [255319.240154] [] kthread+0xd1/0xe0 [255319.245707] [] ? insert_kthread_work+0x40/0x40 [255319.252610] [] ret_from_fork_nospec_begin+0x21/0x21 [255319.260012] [] ? insert_kthread_work+0x40/0x40 [255319.266917] osp-syn-7-3 S ffff9c7da8053150 0 5320 2 0x00000080 [255319.274925] Call Trace: [255319.277766] [] schedule+0x29/0x70 [255319.283416] [] osp_sync_process_queues+0x1681/0x1c20 [osp] [255319.291504] [] ? wake_up_atomic_t+0x30/0x30 [255319.298135] [] llog_process_thread+0x85f/0x1a10 [obdclass] [255319.306252] [] ? llog_cat_id2handle+0x3a8/0x620 [obdclass] [255319.314344] [] ? osp_sync_force+0x300/0x300 [osp] [255319.321557] [] llog_process_or_fork+0xcf/0x520 [obdclass] [255319.329565] [] ? llog_cat_process_common+0x119/0x420 [obdclass] [255319.338139] [] llog_cat_process_cb+0x239/0x250 [obdclass] [255319.346137] [] llog_process_thread+0x85f/0x1a10 [obdclass] [255319.354206] [] ? tracing_is_on+0x15/0x30 [255319.360529] [] ? tracing_record_cmdline+0x1d/0x120 [255319.367823] [] ? try_to_wake_up+0x190/0x390 [255319.374472] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [255319.383046] [] llog_process_or_fork+0xcf/0x520 [obdclass] [255319.391050] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [255319.399625] [] llog_cat_process_or_fork+0x1f1/0x370 [obdclass] [255319.408097] [] ? __wake_up_common_lock+0x91/0xc0 [255319.415215] [] ? osp_sync_force+0x300/0x300 [osp] [255319.422447] [] llog_cat_process+0x2e/0x30 [obdclass] [255319.429941] [] osp_sync_thread+0x550/0xb70 [osp] [255319.437040] [] ? __schedule+0x402/0x840 [255319.443293] [] ? osp_sync_process_committed+0xd40/0xd40 [osp] [255319.451650] [] kthread+0xd1/0xe0 [255319.457196] [] ? insert_kthread_work+0x40/0x40 [255319.464111] [] ret_from_fork_nospec_begin+0x21/0x21 [255319.471500] [] ? insert_kthread_work+0x40/0x40 [255319.478425] osp-pre-7-3 S ffff9c7da80541c0 0 5321 2 0x00000080 [255319.486429] Call Trace: [255319.489251] [] schedule+0x29/0x70 [255319.494914] [] osp_precreate_thread+0x76b/0x12a0 [osp] [255319.502606] [] ? wake_up_atomic_t+0x30/0x30 [255319.509247] [] ? osp_init_pre_fid+0x630/0x630 [osp] [255319.516636] [] kthread+0xd1/0xe0 [255319.522183] [] ? insert_kthread_work+0x40/0x40 [255319.529088] [] ret_from_fork_nospec_begin+0x21/0x21 [255319.536488] [] ? insert_kthread_work+0x40/0x40 [255319.543400] osp-syn-8-3 S ffff9c7da8055230 0 5324 2 0x00000080 [255319.551416] Call Trace: [255319.554246] [] schedule+0x29/0x70 [255319.559915] [] osp_sync_process_queues+0x1681/0x1c20 [osp] [255319.567982] [] ? wake_up_atomic_t+0x30/0x30 [255319.574615] [] llog_process_thread+0x85f/0x1a10 [obdclass] [255319.582716] [] ? llog_cat_id2handle+0x3a8/0x620 [obdclass] [255319.590790] [] ? osp_sync_force+0x300/0x300 [osp] [255319.598009] [] llog_process_or_fork+0xcf/0x520 [obdclass] [255319.606000] [] ? llog_cat_process_common+0x119/0x420 [obdclass] [255319.614576] [] llog_cat_process_cb+0x239/0x250 [obdclass] [255319.622569] [] llog_process_thread+0x85f/0x1a10 [obdclass] [255319.630640] [] ? tracing_is_on+0x15/0x30 [255319.636976] [] ? tracing_record_cmdline+0x1d/0x120 [255319.644269] [] ? try_to_wake_up+0x190/0x390 [255319.650906] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [255319.659491] [] llog_process_or_fork+0xcf/0x520 [obdclass] [255319.667497] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [255319.676070] [] llog_cat_process_or_fork+0x1f1/0x370 [obdclass] [255319.684528] [] ? __wake_up_common_lock+0x91/0xc0 [255319.691631] [] ? osp_sync_force+0x300/0x300 [osp] [255319.698859] [] llog_cat_process+0x2e/0x30 [obdclass] [255319.706371] [] osp_sync_thread+0x550/0xb70 [osp] [255319.713472] [] ? __schedule+0x402/0x840 [255319.719702] [] ? osp_sync_process_committed+0xd40/0xd40 [osp] [255319.728081] [] kthread+0xd1/0xe0 [255319.733628] [] ? insert_kthread_work+0x40/0x40 [255319.740532] [] ret_from_fork_nospec_begin+0x21/0x21 [255319.747923] [] ? insert_kthread_work+0x40/0x40 [255319.754828] osp-pre-8-3 S ffff9c7da80562a0 0 5325 2 0x00000080 [255319.762829] Call Trace: [255319.765660] [] schedule+0x29/0x70 [255319.771314] [] osp_precreate_thread+0x76b/0x12a0 [osp] [255319.778995] [] ? wake_up_atomic_t+0x30/0x30 [255319.785616] [] ? osp_init_pre_fid+0x630/0x630 [osp] [255319.793019] [] kthread+0xd1/0xe0 [255319.798581] [] ? insert_kthread_work+0x40/0x40 [255319.805486] [] ret_from_fork_nospec_begin+0x21/0x21 [255319.812879] [] ? insert_kthread_work+0x40/0x40 [255319.819782] osp-syn-9-3 S ffff9c7da81a9070 0 5327 2 0x00000080 [255319.827798] Call Trace: [255319.830635] [] schedule+0x29/0x70 [255319.836287] [] osp_sync_process_queues+0x1681/0x1c20 [osp] [255319.844357] [] ? wake_up_atomic_t+0x30/0x30 [255319.850991] [] llog_process_thread+0x85f/0x1a10 [obdclass] [255319.859094] [] ? llog_cat_id2handle+0x3a8/0x620 [obdclass] [255319.867167] [] ? osp_sync_force+0x300/0x300 [osp] [255319.874401] [] llog_process_or_fork+0xcf/0x520 [obdclass] [255319.882392] [] ? llog_cat_process_common+0x119/0x420 [obdclass] [255319.890977] [] llog_cat_process_cb+0x239/0x250 [obdclass] [255319.898970] [] llog_process_thread+0x85f/0x1a10 [obdclass] [255319.907053] [] ? tracing_is_on+0x15/0x30 [255319.913376] [] ? tracing_record_cmdline+0x1d/0x120 [255319.920673] [] ? try_to_wake_up+0x190/0x390 [255319.927308] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [255319.935883] [] llog_process_or_fork+0xcf/0x520 [obdclass] [255319.943874] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [255319.952457] [] llog_cat_process_or_fork+0x1f1/0x370 [obdclass] [255319.960906] [] ? __wake_up_common_lock+0x91/0xc0 [255319.968021] [] ? osp_sync_force+0x300/0x300 [osp] [255319.975236] [] llog_cat_process+0x2e/0x30 [obdclass] [255319.982729] [] osp_sync_thread+0x550/0xb70 [osp] [255319.989830] [] ? __schedule+0x402/0x840 [255319.996061] [] ? osp_sync_process_committed+0xd40/0xd40 [osp] [255320.004421] [] kthread+0xd1/0xe0 [255320.009972] [] ? insert_kthread_work+0x40/0x40 [255320.016878] [] ret_from_fork_nospec_begin+0x21/0x21 [255320.024273] [] ? insert_kthread_work+0x40/0x40 [255320.031188] osp-pre-9-3 S ffff9c7da81aa0e0 0 5328 2 0x00000080 [255320.039194] Call Trace: [255320.042025] [] schedule+0x29/0x70 [255320.047676] [] osp_precreate_thread+0x76b/0x12a0 [osp] [255320.055356] [] ? wake_up_atomic_t+0x30/0x30 [255320.061977] [] ? osp_init_pre_fid+0x630/0x630 [osp] [255320.069383] [] kthread+0xd1/0xe0 [255320.074936] [] ? insert_kthread_work+0x40/0x40 [255320.081842] [] ret_from_fork_nospec_begin+0x21/0x21 [255320.089233] [] ? insert_kthread_work+0x40/0x40 [255320.096137] osp-syn-10-3 S ffff9c7da81ab150 0 5330 2 0x00000080 [255320.104124] Call Trace: [255320.106956] [] schedule+0x29/0x70 [255320.112608] [] osp_sync_process_queues+0x1681/0x1c20 [osp] [255320.120679] [] ? wake_up_atomic_t+0x30/0x30 [255320.127312] [] llog_process_thread+0x85f/0x1a10 [obdclass] [255320.135404] [] ? llog_cat_id2handle+0x3a8/0x620 [obdclass] [255320.143492] [] ? osp_sync_force+0x300/0x300 [osp] [255320.150713] [] llog_process_or_fork+0xcf/0x520 [obdclass] [255320.158717] [] ? llog_cat_process_common+0x119/0x420 [obdclass] [255320.167304] [] llog_cat_process_cb+0x239/0x250 [obdclass] [255320.175297] [] llog_process_thread+0x85f/0x1a10 [obdclass] [255320.183374] [] ? tracing_is_on+0x15/0x30 [255320.189698] [] ? tracing_record_cmdline+0x1d/0x120 [255320.197003] [] ? try_to_wake_up+0x190/0x390 [255320.203636] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [255320.212222] [] llog_process_or_fork+0xcf/0x520 [obdclass] [255320.220216] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [255320.228806] [] llog_cat_process_or_fork+0x1f1/0x370 [obdclass] [255320.237294] [] ? __wake_up_common_lock+0x91/0xc0 [255320.244399] [] ? osp_sync_force+0x300/0x300 [osp] [255320.251626] [] llog_cat_process+0x2e/0x30 [obdclass] [255320.259124] [] osp_sync_thread+0x550/0xb70 [osp] [255320.266237] [] ? __schedule+0x402/0x840 [255320.272464] [] ? osp_sync_process_committed+0xd40/0xd40 [osp] [255320.280823] [] kthread+0xd1/0xe0 [255320.286383] [] ? insert_kthread_work+0x40/0x40 [255320.293300] [] ret_from_fork_nospec_begin+0x21/0x21 [255320.300689] [] ? insert_kthread_work+0x40/0x40 [255320.307594] osp-pre-10-3 S ffff9c7da81ac1c0 0 5331 2 0x00000080 [255320.315592] Call Trace: [255320.318425] [] schedule+0x29/0x70 [255320.324074] [] osp_precreate_thread+0x76b/0x12a0 [osp] [255320.331754] [] ? wake_up_atomic_t+0x30/0x30 [255320.338374] [] ? osp_init_pre_fid+0x630/0x630 [osp] [255320.345774] [] kthread+0xd1/0xe0 [255320.351343] [] ? insert_kthread_work+0x40/0x40 [255320.358245] [] ret_from_fork_nospec_begin+0x21/0x21 [255320.365633] [] ? insert_kthread_work+0x40/0x40 [255320.372550] osp-syn-11-3 S ffff9c7da81ad230 0 5332 2 0x00000080 [255320.380549] Call Trace: [255320.383385] [] schedule+0x29/0x70 [255320.389035] [] osp_sync_process_queues+0x1681/0x1c20 [osp] [255320.397115] [] ? wake_up_atomic_t+0x30/0x30 [255320.403747] [] llog_process_thread+0x85f/0x1a10 [obdclass] [255320.411888] [] ? llog_cat_id2handle+0x3a8/0x620 [obdclass] [255320.419964] [] ? osp_sync_force+0x300/0x300 [osp] [255320.427201] [] llog_process_or_fork+0xcf/0x520 [obdclass] [255320.435207] [] ? llog_cat_process_common+0x119/0x420 [obdclass] [255320.443800] [] llog_cat_process_cb+0x239/0x250 [obdclass] [255320.451794] [] llog_process_thread+0x85f/0x1a10 [obdclass] [255320.459898] [] ? tracing_is_on+0x15/0x30 [255320.466219] [] ? tracing_record_cmdline+0x1d/0x120 [255320.473511] [] ? try_to_wake_up+0x190/0x390 [255320.480144] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [255320.488728] [] llog_process_or_fork+0xcf/0x520 [obdclass] [255320.496733] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [255320.505318] [] llog_cat_process_or_fork+0x1f1/0x370 [obdclass] [255320.513778] [] ? __wake_up_common_lock+0x91/0xc0 [255320.520876] [] ? osp_sync_force+0x300/0x300 [osp] [255320.528113] [] llog_cat_process+0x2e/0x30 [obdclass] [255320.535604] [] osp_sync_thread+0x550/0xb70 [osp] [255320.542731] [] ? __schedule+0x402/0x840 [255320.548964] [] ? osp_sync_process_committed+0xd40/0xd40 [osp] [255320.557326] [] kthread+0xd1/0xe0 [255320.562894] [] ? insert_kthread_work+0x40/0x40 [255320.569824] [] ret_from_fork_nospec_begin+0x21/0x21 [255320.577213] [] ? insert_kthread_work+0x40/0x40 [255320.584118] osp-pre-11-3 S ffff9c7da81ae2a0 0 5333 2 0x00000080 [255320.592129] Call Trace: [255320.594981] [] schedule+0x29/0x70 [255320.600632] [] osp_precreate_thread+0x76b/0x12a0 [osp] [255320.608337] [] ? wake_up_atomic_t+0x30/0x30 [255320.614954] [] ? osp_init_pre_fid+0x630/0x630 [osp] [255320.622347] [] kthread+0xd1/0xe0 [255320.627928] [] ? insert_kthread_work+0x40/0x40 [255320.634834] [] ret_from_fork_nospec_begin+0x21/0x21 [255320.642228] [] ? insert_kthread_work+0x40/0x40 [255320.649136] osp-syn-12-3 S ffff9c7da81f0000 0 5334 2 0x00000080 [255320.657126] Call Trace: [255320.659971] [] schedule+0x29/0x70 [255320.665622] [] osp_sync_process_queues+0x1681/0x1c20 [osp] [255320.673693] [] ? wake_up_atomic_t+0x30/0x30 [255320.680337] [] llog_process_thread+0x85f/0x1a10 [obdclass] [255320.688416] [] ? llog_cat_id2handle+0x3a8/0x620 [obdclass] [255320.696504] [] ? osp_sync_force+0x300/0x300 [osp] [255320.703733] [] llog_process_or_fork+0xcf/0x520 [obdclass] [255320.711739] [] ? llog_cat_process_common+0x119/0x420 [obdclass] [255320.720305] [] llog_cat_process_cb+0x239/0x250 [obdclass] [255320.728300] [] llog_process_thread+0x85f/0x1a10 [obdclass] [255320.736373] [] ? tracing_is_on+0x15/0x30 [255320.742687] [] ? tracing_record_cmdline+0x1d/0x120 [255320.749980] [] ? try_to_wake_up+0x190/0x390 [255320.756624] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [255320.765200] [] llog_process_or_fork+0xcf/0x520 [obdclass] [255320.773195] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [255320.781766] [] llog_cat_process_or_fork+0x1f1/0x370 [obdclass] [255320.790246] [] ? __wake_up_common_lock+0x91/0xc0 [255320.797350] [] ? osp_sync_force+0x300/0x300 [osp] [255320.804562] [] llog_cat_process+0x2e/0x30 [obdclass] [255320.812052] [] osp_sync_thread+0x550/0xb70 [osp] [255320.819143] [] ? __schedule+0x402/0x840 [255320.825376] [] ? osp_sync_process_committed+0xd40/0xd40 [osp] [255320.833736] [] kthread+0xd1/0xe0 [255320.839297] [] ? insert_kthread_work+0x40/0x40 [255320.846208] [] ret_from_fork_nospec_begin+0x21/0x21 [255320.853611] [] ? insert_kthread_work+0x40/0x40 [255320.860512] osp-pre-12-3 S ffff9c7da81f1070 0 5335 2 0x00000080 [255320.868519] Call Trace: [255320.871359] [] schedule+0x29/0x70 [255320.877007] [] osp_precreate_thread+0x76b/0x12a0 [osp] [255320.884692] [] ? wake_up_atomic_t+0x30/0x30 [255320.891324] [] ? osp_init_pre_fid+0x630/0x630 [osp] [255320.898725] [] kthread+0xd1/0xe0 [255320.904269] [] ? insert_kthread_work+0x40/0x40 [255320.911198] [] ret_from_fork_nospec_begin+0x21/0x21 [255320.918588] [] ? insert_kthread_work+0x40/0x40 [255320.925501] osp-syn-13-3 S ffff9c7da81f20e0 0 5337 2 0x00000080 [255320.933499] Call Trace: [255320.936333] [] schedule+0x29/0x70 [255320.941982] [] osp_sync_process_queues+0x1681/0x1c20 [osp] [255320.950051] [] ? wake_up_atomic_t+0x30/0x30 [255320.956696] [] llog_process_thread+0x85f/0x1a10 [obdclass] [255320.964795] [] ? llog_cat_id2handle+0x3a8/0x620 [obdclass] [255320.972871] [] ? osp_sync_force+0x300/0x300 [osp] [255320.980084] [] llog_process_or_fork+0xcf/0x520 [obdclass] [255320.988077] [] ? llog_cat_process_common+0x119/0x420 [obdclass] [255320.996661] [] llog_cat_process_cb+0x239/0x250 [obdclass] [255321.004668] [] llog_process_thread+0x85f/0x1a10 [obdclass] [255321.012748] [] ? tracing_is_on+0x15/0x30 [255321.019083] [] ? tracing_record_cmdline+0x1d/0x120 [255321.026378] [] ? try_to_wake_up+0x190/0x390 [255321.033015] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [255321.041589] [] llog_process_or_fork+0xcf/0x520 [obdclass] [255321.049608] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [255321.058180] [] llog_cat_process_or_fork+0x1f1/0x370 [obdclass] [255321.066641] [] ? __wake_up_common_lock+0x91/0xc0 [255321.073759] [] ? osp_sync_force+0x300/0x300 [osp] [255321.080975] [] llog_cat_process+0x2e/0x30 [obdclass] [255321.088482] [] osp_sync_thread+0x550/0xb70 [osp] [255321.095580] [] ? __schedule+0x402/0x840 [255321.101813] [] ? osp_sync_process_committed+0xd40/0xd40 [osp] [255321.110191] [] kthread+0xd1/0xe0 [255321.115740] [] ? insert_kthread_work+0x40/0x40 [255321.122645] [] ret_from_fork_nospec_begin+0x21/0x21 [255321.130071] [] ? insert_kthread_work+0x40/0x40 [255321.136975] osp-pre-13-3 S ffff9c7da81f3150 0 5338 2 0x00000080 [255321.144966] Call Trace: [255321.147808] [] schedule+0x29/0x70 [255321.153472] [] osp_precreate_thread+0x76b/0x12a0 [osp] [255321.161155] [] ? wake_up_atomic_t+0x30/0x30 [255321.167785] [] ? osp_init_pre_fid+0x630/0x630 [osp] [255321.175175] [] kthread+0xd1/0xe0 [255321.180740] [] ? insert_kthread_work+0x40/0x40 [255321.187646] [] ret_from_fork_nospec_begin+0x21/0x21 [255321.195049] [] ? insert_kthread_work+0x40/0x40 [255321.201954] osp-syn-14-3 S ffff9c7da81f41c0 0 5339 2 0x00000080 [255321.209968] Call Trace: [255321.212814] [] schedule+0x29/0x70 [255321.218470] [] osp_sync_process_queues+0x1681/0x1c20 [osp] [255321.226540] [] ? wake_up_atomic_t+0x30/0x30 [255321.233187] [] llog_process_thread+0x85f/0x1a10 [obdclass] [255321.241281] [] ? llog_cat_id2handle+0x3a8/0x620 [obdclass] [255321.249383] [] ? osp_sync_force+0x300/0x300 [osp] [255321.256599] [] llog_process_or_fork+0xcf/0x520 [obdclass] [255321.264595] [] ? llog_cat_process_common+0x119/0x420 [obdclass] [255321.273183] [] llog_cat_process_cb+0x239/0x250 [obdclass] [255321.281183] [] llog_process_thread+0x85f/0x1a10 [obdclass] [255321.289294] [] ? tracing_is_on+0x15/0x30 [255321.295639] [] ? tracing_record_cmdline+0x1d/0x120 [255321.302932] [] ? try_to_wake_up+0x190/0x390 [255321.309579] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [255321.318155] [] llog_process_or_fork+0xcf/0x520 [obdclass] [255321.326160] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [255321.334736] [] llog_cat_process_or_fork+0x1f1/0x370 [obdclass] [255321.343205] [] ? __wake_up_common_lock+0x91/0xc0 [255321.350309] [] ? osp_sync_force+0x300/0x300 [osp] [255321.357540] [] llog_cat_process+0x2e/0x30 [obdclass] [255321.365062] [] osp_sync_thread+0x550/0xb70 [osp] [255321.372160] [] ? __schedule+0x402/0x840 [255321.378399] [] ? osp_sync_process_committed+0xd40/0xd40 [osp] [255321.386759] [] kthread+0xd1/0xe0 [255321.392308] [] ? insert_kthread_work+0x40/0x40 [255321.399233] [] ret_from_fork_nospec_begin+0x21/0x21 [255321.406631] [] ? insert_kthread_work+0x40/0x40 [255321.413535] osp-pre-14-3 S ffff9c7da81f5230 0 5340 2 0x00000080 [255321.421569] Call Trace: [255321.424404] [] schedule+0x29/0x70 [255321.430055] [] osp_precreate_thread+0x76b/0x12a0 [osp] [255321.437736] [] ? wake_up_atomic_t+0x30/0x30 [255321.444367] [] ? osp_init_pre_fid+0x630/0x630 [osp] [255321.451758] [] kthread+0xd1/0xe0 [255321.457308] [] ? insert_kthread_work+0x40/0x40 [255321.464212] [] ret_from_fork_nospec_begin+0x21/0x21 [255321.471614] [] ? insert_kthread_work+0x40/0x40 [255321.478523] osp-syn-15-3 S ffff9c7da81f62a0 0 5343 2 0x00000080 [255321.486538] Call Trace: [255321.489374] [] schedule+0x29/0x70 [255321.495025] [] osp_sync_process_queues+0x1681/0x1c20 [osp] [255321.503093] [] ? wake_up_atomic_t+0x30/0x30 [255321.509728] [] llog_process_thread+0x85f/0x1a10 [obdclass] [255321.517834] [] ? llog_cat_id2handle+0x3a8/0x620 [obdclass] [255321.525931] [] ? osp_sync_force+0x300/0x300 [osp] [255321.533145] [] llog_process_or_fork+0xcf/0x520 [obdclass] [255321.541137] [] ? llog_cat_process_common+0x119/0x420 [obdclass] [255321.549725] [] llog_cat_process_cb+0x239/0x250 [obdclass] [255321.557732] [] llog_process_thread+0x85f/0x1a10 [obdclass] [255321.565801] [] ? tracing_is_on+0x15/0x30 [255321.572136] [] ? tracing_record_cmdline+0x1d/0x120 [255321.579429] [] ? try_to_wake_up+0x190/0x390 [255321.586062] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [255321.594658] [] llog_process_or_fork+0xcf/0x520 [obdclass] [255321.602663] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [255321.611236] [] llog_cat_process_or_fork+0x1f1/0x370 [obdclass] [255321.619688] [] ? __wake_up_common_lock+0x91/0xc0 [255321.626815] [] ? osp_sync_force+0x300/0x300 [osp] [255321.634031] [] llog_cat_process+0x2e/0x30 [obdclass] [255321.641515] [] osp_sync_thread+0x550/0xb70 [osp] [255321.648615] [] ? __schedule+0x402/0x840 [255321.654848] [] ? osp_sync_process_committed+0xd40/0xd40 [osp] [255321.663208] [] kthread+0xd1/0xe0 [255321.668766] [] ? insert_kthread_work+0x40/0x40 [255321.675700] [] ret_from_fork_nospec_begin+0x21/0x21 [255321.683093] [] ? insert_kthread_work+0x40/0x40 [255321.689999] osp-pre-15-3 S ffff9c7da8138000 0 5344 2 0x00000080 [255321.698018] Call Trace: [255321.700850] [] schedule+0x29/0x70 [255321.706508] [] osp_precreate_thread+0x76b/0x12a0 [osp] [255321.714190] [] ? wake_up_atomic_t+0x30/0x30 [255321.720846] [] ? osp_init_pre_fid+0x630/0x630 [osp] [255321.728243] [] kthread+0xd1/0xe0 [255321.733789] [] ? insert_kthread_work+0x40/0x40 [255321.740695] [] ret_from_fork_nospec_begin+0x21/0x21 [255321.748083] [] ? insert_kthread_work+0x40/0x40 [255321.754987] lquota_wb_soake S ffff9c7deb1ec1c0 0 5349 2 0x00000080 [255321.762989] Call Trace: [255321.765835] [] schedule+0x29/0x70 [255321.771491] [] schedule_timeout+0x168/0x2d0 [255321.778107] [] ? __internal_add_timer+0x130/0x130 [255321.785329] [] qsd_upd_thread+0x977/0xc50 [lquota] [255321.792640] [] ? qsd_upd_add+0xe0/0xe0 [lquota] [255321.799643] [] kthread+0xd1/0xe0 [255321.805200] [] ? insert_kthread_work+0x40/0x40 [255321.812141] [] ret_from_fork_nospec_begin+0x21/0x21 [255321.819531] [] ? insert_kthread_work+0x40/0x40 [255321.826434] lquota_wb_soake S ffff9c7b39571070 0 5350 2 0x00000080 [255321.834456] Call Trace: [255321.837291] [] schedule+0x29/0x70 [255321.842949] [] schedule_timeout+0x168/0x2d0 [255321.849576] [] ? __internal_add_timer+0x130/0x130 [255321.856790] [] qsd_upd_thread+0x977/0xc50 [lquota] [255321.864102] [] ? qsd_upd_add+0xe0/0xe0 [lquota] [255321.871096] [] kthread+0xd1/0xe0 [255321.876643] [] ? insert_kthread_work+0x40/0x40 [255321.883560] [] ret_from_fork_nospec_begin+0x21/0x21 [255321.890948] [] ? insert_kthread_work+0x40/0x40 [255321.897851] dist_txn-3 S ffff9c7dea47a0e0 0 5351 2 0x00000080 [255321.905838] Call Trace: [255321.908672] [] schedule+0x29/0x70 [255321.914403] [] distribute_txn_commit_thread+0x9de/0xc90 [ptlrpc] [255321.923065] [] ? wake_up_atomic_t+0x30/0x30 [255321.929743] [] ? sub_trans_commit_cb+0x20/0x20 [ptlrpc] [255321.937524] [] kthread+0xd1/0xe0 [255321.943086] [] ? insert_kthread_work+0x40/0x40 [255321.950020] [] ret_from_fork_nospec_begin+0x21/0x21 [255321.957401] [] ? insert_kthread_work+0x40/0x40 [255321.964318] mdt_out01_002 S ffff9c79f6141070 0 5374 2 0x00000080 [255321.972315] Call Trace: [255321.975161] [] schedule+0x29/0x70 [255321.980857] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255321.988444] [] ? __wake_up+0x13/0x20 [255321.994380] [] ? wake_up_atomic_t+0x30/0x30 [255322.001051] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255322.008191] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255322.016551] [] kthread+0xd1/0xe0 [255322.022109] [] ? insert_kthread_work+0x40/0x40 [255322.029014] [] ret_from_fork_nospec_begin+0x21/0x21 [255322.036416] [] ? insert_kthread_work+0x40/0x40 [255322.043322] mdt00_003 S ffff9c7a730fa0e0 0 5403 2 0x00000080 [255322.051308] Call Trace: [255322.054144] [] ? __set_current_blocked+0x42/0x70 [255322.061259] [] schedule+0x29/0x70 [255322.066944] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255322.074532] [] ? _raw_spin_lock+0x20/0x30 [255322.080960] [] ? wake_up_atomic_t+0x30/0x30 [255322.087630] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255322.094771] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255322.103133] [] kthread+0xd1/0xe0 [255322.108682] [] ? insert_kthread_work+0x40/0x40 [255322.115616] [] ret_from_fork_nospec_begin+0x21/0x21 [255322.123006] [] ? insert_kthread_work+0x40/0x40 [255322.129923] mdt00_004 S ffff9c7a730fb150 0 5412 2 0x00000080 [255322.137937] Call Trace: [255322.140771] [] ? _raw_spin_lock_irqsave+0x37/0x40 [255322.147966] [] schedule+0x29/0x70 [255322.153681] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255322.161295] [] ? __wake_up+0x13/0x20 [255322.167223] [] ? wake_up_atomic_t+0x30/0x30 [255322.173881] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255322.181063] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255322.189424] [] kthread+0xd1/0xe0 [255322.194972] [] ? insert_kthread_work+0x40/0x40 [255322.201876] [] ret_from_fork_nospec_begin+0x21/0x21 [255322.209266] [] ? insert_kthread_work+0x40/0x40 [255322.216168] mdt00_005 S ffff9c7a68375230 0 5413 2 0x00000080 [255322.224177] Call Trace: [255322.227020] [] ? _raw_spin_lock_irqsave+0x37/0x40 [255322.234227] [] schedule+0x29/0x70 [255322.239909] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255322.247495] [] ? _raw_spin_lock+0x20/0x30 [255322.253915] [] ? wake_up_atomic_t+0x30/0x30 [255322.260569] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255322.267711] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255322.276073] [] kthread+0xd1/0xe0 [255322.281648] [] ? insert_kthread_work+0x40/0x40 [255322.288554] [] ret_from_fork_nospec_begin+0x21/0x21 [255322.295942] [] ? insert_kthread_work+0x40/0x40 [255322.302846] mdt00_006 S ffff9c7da86e9070 0 5415 2 0x00000080 [255322.310851] Call Trace: [255322.313688] [] ? _raw_spin_lock_irqsave+0x37/0x40 [255322.320874] [] schedule+0x29/0x70 [255322.326556] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255322.334133] [] ? __wake_up+0x13/0x20 [255322.340079] [] ? wake_up_atomic_t+0x30/0x30 [255322.346762] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255322.353916] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255322.362277] [] kthread+0xd1/0xe0 [255322.367824] [] ? insert_kthread_work+0x40/0x40 [255322.374728] [] ret_from_fork_nospec_begin+0x21/0x21 [255322.382117] [] ? insert_kthread_work+0x40/0x40 [255322.389019] mdt01_003 S ffff9c7da86ea0e0 0 5643 2 0x00000080 [255322.397042] Call Trace: [255322.399882] [] ? __set_current_blocked+0x42/0x70 [255322.406994] [] schedule+0x29/0x70 [255322.412690] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255322.420289] [] ? __wake_up+0x13/0x20 [255322.426227] [] ? wake_up_atomic_t+0x30/0x30 [255322.432882] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255322.440039] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255322.448391] [] kthread+0xd1/0xe0 [255322.453952] [] ? insert_kthread_work+0x40/0x40 [255322.460868] [] ret_from_fork_nospec_begin+0x21/0x21 [255322.468272] [] ? insert_kthread_work+0x40/0x40 [255322.475174] mdt_out00_002 S ffff9c7da86ee2a0 0 5887 2 0x00000080 [255322.483208] Call Trace: [255322.486056] [] ? __set_current_blocked+0x42/0x70 [255322.493154] [] schedule+0x29/0x70 [255322.498851] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255322.506449] [] ? __wake_up+0x13/0x20 [255322.512385] [] ? wake_up_atomic_t+0x30/0x30 [255322.519049] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255322.526218] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255322.534579] [] kthread+0xd1/0xe0 [255322.540128] [] ? insert_kthread_work+0x40/0x40 [255322.547032] [] ret_from_fork_nospec_begin+0x21/0x21 [255322.554432] [] ? insert_kthread_work+0x40/0x40 [255322.561335] kworker/19:1H S ffff9c7deb84a0e0 0 8647 2 0x00000080 [255322.569331] Call Trace: [255322.572165] [] ? process_one_work+0x21a/0x440 [255322.578974] [] schedule+0x29/0x70 [255322.584619] [] worker_thread+0x1d9/0x3c0 [255322.590942] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255322.598335] [] kthread+0xd1/0xe0 [255322.603879] [] ? insert_kthread_work+0x40/0x40 [255322.610785] [] ret_from_fork_nospec_begin+0x21/0x21 [255322.618193] [] ? insert_kthread_work+0x40/0x40 [255322.625102] kworker/14:1 S ffff9c81e931e2a0 0 12845 2 0x00000080 [255322.633115] Call Trace: [255322.635959] [] ? process_one_work+0x21a/0x440 [255322.642765] [] schedule+0x29/0x70 [255322.648411] [] worker_thread+0x1d9/0x3c0 [255322.654764] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255322.662153] [] kthread+0xd1/0xe0 [255322.667701] [] ? insert_kthread_work+0x40/0x40 [255322.674614] [] ret_from_fork_nospec_begin+0x21/0x21 [255322.682003] [] ? insert_kthread_work+0x40/0x40 [255322.688918] kworker/10:0 S ffff9c81e931a0e0 0 14930 2 0x00000080 [255322.696929] Call Trace: [255322.699759] [] schedule+0x29/0x70 [255322.705404] [] worker_thread+0x1d9/0x3c0 [255322.711728] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255322.719130] [] kthread+0xd1/0xe0 [255322.724668] [] ? insert_kthread_work+0x40/0x40 [255322.731577] [] ret_from_fork_nospec_begin+0x21/0x21 [255322.738968] [] ? insert_kthread_work+0x40/0x40 [255322.745872] kworker/9:2 S ffff9c81e6e9d230 0 15405 2 0x00000080 [255322.753899] Call Trace: [255322.756732] [] schedule+0x29/0x70 [255322.762389] [] worker_thread+0x1d9/0x3c0 [255322.768734] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255322.776143] [] kthread+0xd1/0xe0 [255322.781688] [] ? insert_kthread_work+0x40/0x40 [255322.788601] [] ret_from_fork_nospec_begin+0x21/0x21 [255322.795990] [] ? insert_kthread_work+0x40/0x40 [255322.802905] kworker/u305:1 S ffff9c7de7bdc1c0 0 15672 2 0x00000080 [255322.810914] Call Trace: [255322.813746] [] ? __call_usermodehelper+0x4e/0x90 [255322.820858] [] ? process_one_work+0x21a/0x440 [255322.827663] [] schedule+0x29/0x70 [255322.833308] [] worker_thread+0x1d9/0x3c0 [255322.839632] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255322.847055] [] kthread+0xd1/0xe0 [255322.852605] [] ? insert_kthread_work+0x40/0x40 [255322.859516] [] ret_from_fork_nospec_begin+0x21/0x21 [255322.866907] [] ? insert_kthread_work+0x40/0x40 [255322.873811] kworker/21:1H S ffff9c7de7bda0e0 0 17172 2 0x00000080 [255322.881823] Call Trace: [255322.884657] [] ? process_one_work+0x21a/0x440 [255322.891477] [] schedule+0x29/0x70 [255322.897122] [] worker_thread+0x1d9/0x3c0 [255322.903448] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255322.910836] [] kthread+0xd1/0xe0 [255322.916384] [] ? insert_kthread_work+0x40/0x40 [255322.923287] [] ret_from_fork_nospec_begin+0x21/0x21 [255322.930676] [] ? insert_kthread_work+0x40/0x40 [255322.937580] kworker/15:0 S ffff9c81ea165230 0 17960 2 0x00000080 [255322.945605] Call Trace: [255322.948438] [] schedule+0x29/0x70 [255322.954094] [] worker_thread+0x1d9/0x3c0 [255322.960425] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255322.967814] [] kthread+0xd1/0xe0 [255322.973374] [] ? insert_kthread_work+0x40/0x40 [255322.980277] [] ret_from_fork_nospec_begin+0x21/0x21 [255322.987668] [] ? insert_kthread_work+0x40/0x40 [255322.994572] mdt_out01_003 S ffff9c81ea1641c0 0 18328 2 0x00000080 [255323.002579] Call Trace: [255323.005412] [] ? _raw_spin_lock_irqsave+0x37/0x40 [255323.012606] [] schedule+0x29/0x70 [255323.018307] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255323.025894] [] ? _raw_spin_lock+0x20/0x30 [255323.032317] [] ? wake_up_atomic_t+0x30/0x30 [255323.038986] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255323.046165] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255323.054529] [] kthread+0xd1/0xe0 [255323.060068] [] ? insert_kthread_work+0x40/0x40 [255323.066973] [] ret_from_fork_nospec_begin+0x21/0x21 [255323.074361] [] ? insert_kthread_work+0x40/0x40 [255323.081264] mdt00_007 S ffff9c81ea163150 0 18329 2 0x00000080 [255323.089253] Call Trace: [255323.092090] [] ? __set_current_blocked+0x42/0x70 [255323.099198] [] schedule+0x29/0x70 [255323.104899] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255323.112492] [] ? _raw_spin_lock+0x20/0x30 [255323.118926] [] ? wake_up_atomic_t+0x30/0x30 [255323.125580] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255323.132743] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255323.141104] [] kthread+0xd1/0xe0 [255323.146650] [] ? insert_kthread_work+0x40/0x40 [255323.153555] [] ret_from_fork_nospec_begin+0x21/0x21 [255323.160945] [] ? insert_kthread_work+0x40/0x40 [255323.167859] mdt01_004 S ffff9c81ea1620e0 0 18330 2 0x00000080 [255323.175884] Call Trace: [255323.178716] [] ? _raw_spin_lock_irqsave+0x37/0x40 [255323.185919] [] schedule+0x29/0x70 [255323.191602] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255323.199190] [] ? __wake_up+0x13/0x20 [255323.205128] [] ? wake_up_atomic_t+0x30/0x30 [255323.211781] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255323.218941] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255323.227301] [] kthread+0xd1/0xe0 [255323.232852] [] ? insert_kthread_work+0x40/0x40 [255323.239747] [] ret_from_fork_nospec_begin+0x21/0x21 [255323.247159] [] ? insert_kthread_work+0x40/0x40 [255323.254064] mdt01_005 S ffff9c81ea161070 0 18331 2 0x00000080 [255323.262081] Call Trace: [255323.264928] [] ? __set_current_blocked+0x42/0x70 [255323.272026] [] schedule+0x29/0x70 [255323.277714] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255323.285307] [] ? __wake_up+0x13/0x20 [255323.291242] [] ? wake_up_atomic_t+0x30/0x30 [255323.297923] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255323.305079] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255323.313439] [] kthread+0xd1/0xe0 [255323.318985] [] ? insert_kthread_work+0x40/0x40 [255323.325896] [] ret_from_fork_nospec_begin+0x21/0x21 [255323.333298] [] ? insert_kthread_work+0x40/0x40 [255323.340200] mdt_rdpg01_002 S ffff9c81ea160000 0 18332 2 0x00000080 [255323.348210] Call Trace: [255323.351047] [] ? __set_current_blocked+0x42/0x70 [255323.358152] [] schedule+0x29/0x70 [255323.363847] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255323.371447] [] ? __wake_up+0x13/0x20 [255323.377394] [] ? wake_up_atomic_t+0x30/0x30 [255323.384071] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255323.391234] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255323.399621] [] kthread+0xd1/0xe0 [255323.405168] [] ? insert_kthread_work+0x40/0x40 [255323.412081] [] ret_from_fork_nospec_begin+0x21/0x21 [255323.419468] [] ? insert_kthread_work+0x40/0x40 [255323.426370] mdt_rdpg00_002 S ffff9c81ea1662a0 0 18333 2 0x00000080 [255323.434389] Call Trace: [255323.437214] [] ? _raw_spin_lock_irqsave+0x37/0x40 [255323.444410] [] schedule+0x29/0x70 [255323.450109] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255323.457721] [] ? __wake_up+0x13/0x20 [255323.463670] [] ? wake_up_atomic_t+0x30/0x30 [255323.470325] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255323.477478] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255323.485838] [] kthread+0xd1/0xe0 [255323.491397] [] ? insert_kthread_work+0x40/0x40 [255323.498301] [] ret_from_fork_nospec_begin+0x21/0x21 [255323.505692] [] ? insert_kthread_work+0x40/0x40 [255323.512601] ldlm_cn01_003 S ffff9c7ded3f1070 0 18334 2 0x00000080 [255323.520593] Call Trace: [255323.523416] [] ? __set_current_blocked+0x42/0x70 [255323.530514] [] schedule+0x29/0x70 [255323.536228] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255323.543849] [] ? wake_up_atomic_t+0x30/0x30 [255323.550508] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255323.557659] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255323.566037] [] kthread+0xd1/0xe0 [255323.571587] [] ? insert_kthread_work+0x40/0x40 [255323.578491] [] ret_from_fork_nospec_begin+0x21/0x21 [255323.585881] [] ? insert_kthread_work+0x40/0x40 [255323.592797] ldlm_cn00_003 S ffff9c7ded3f0000 0 18335 2 0x00000080 [255323.600801] Call Trace: [255323.603648] [] ? __set_current_blocked+0x42/0x70 [255323.610746] [] schedule+0x29/0x70 [255323.616446] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255323.624036] [] ? __wake_up+0x13/0x20 [255323.629971] [] ? wake_up_atomic_t+0x30/0x30 [255323.636642] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255323.643807] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255323.652172] [] kthread+0xd1/0xe0 [255323.657742] [] ? insert_kthread_work+0x40/0x40 [255323.664647] [] ret_from_fork_nospec_begin+0x21/0x21 [255323.672046] [] ? insert_kthread_work+0x40/0x40 [255323.678978] ldlm_cn00_004 S ffff9c7ded3f3150 0 18336 2 0x00000080 [255323.686993] Call Trace: [255323.689825] [] schedule+0x29/0x70 [255323.695535] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255323.703132] [] ? __wake_up+0x13/0x20 [255323.709069] [] ? wake_up_atomic_t+0x30/0x30 [255323.715736] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255323.722891] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255323.731254] [] kthread+0xd1/0xe0 [255323.736793] [] ? insert_kthread_work+0x40/0x40 [255323.743699] [] ret_from_fork_nospec_begin+0x21/0x21 [255323.751088] [] ? insert_kthread_work+0x40/0x40 [255323.757997] ldlm_cn01_004 S ffff9c7ded3f41c0 0 18337 2 0x00000080 [255323.766005] Call Trace: [255323.768838] [] ? _raw_spin_lock_irqsave+0x37/0x40 [255323.776033] [] schedule+0x29/0x70 [255323.781734] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255323.789334] [] ? __wake_up+0x13/0x20 [255323.795261] [] ? wake_up_atomic_t+0x30/0x30 [255323.801927] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255323.809069] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255323.817435] [] kthread+0xd1/0xe0 [255323.822983] [] ? insert_kthread_work+0x40/0x40 [255323.829898] [] ret_from_fork_nospec_begin+0x21/0x21 [255323.837302] [] ? insert_kthread_work+0x40/0x40 [255323.844206] ldlm_cn00_005 S ffff9c7dec598000 0 18338 2 0x00000080 [255323.852228] Call Trace: [255323.855062] [] ? __set_current_blocked+0x42/0x70 [255323.862159] [] schedule+0x29/0x70 [255323.867846] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255323.875467] [] ? __wake_up+0x13/0x20 [255323.881403] [] ? wake_up_atomic_t+0x30/0x30 [255323.888062] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255323.895214] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255323.903587] [] kthread+0xd1/0xe0 [255323.909144] [] ? insert_kthread_work+0x40/0x40 [255323.916051] [] ret_from_fork_nospec_begin+0x21/0x21 [255323.923439] [] ? insert_kthread_work+0x40/0x40 [255323.930359] mdt01_006 S ffff9c7dec59e2a0 0 18339 2 0x00000080 [255323.938358] Call Trace: [255323.941192] [] ? __set_current_blocked+0x42/0x70 [255323.948291] [] schedule+0x29/0x70 [255323.953982] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255323.961580] [] ? wake_up_atomic_t+0x30/0x30 [255323.968245] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255323.975401] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255323.983762] [] kthread+0xd1/0xe0 [255323.989316] [] ? insert_kthread_work+0x40/0x40 [255323.996232] [] ret_from_fork_nospec_begin+0x21/0x21 [255324.003620] [] ? insert_kthread_work+0x40/0x40 [255324.010524] mdt00_008 S ffff9c7dec59d230 0 18340 2 0x00000080 [255324.018545] Call Trace: [255324.021369] [] ? __set_current_blocked+0x42/0x70 [255324.028471] [] schedule+0x29/0x70 [255324.034155] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255324.041744] [] ? _raw_spin_lock+0x20/0x30 [255324.048167] [] ? wake_up_atomic_t+0x30/0x30 [255324.054837] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255324.061987] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255324.070377] [] kthread+0xd1/0xe0 [255324.075924] [] ? insert_kthread_work+0x40/0x40 [255324.082830] [] ret_from_fork_nospec_begin+0x21/0x21 [255324.090218] [] ? insert_kthread_work+0x40/0x40 [255324.097122] ldlm_cn01_005 S ffff9c7dec59c1c0 0 18341 2 0x00000080 [255324.105124] Call Trace: [255324.107957] [] ? _raw_spin_lock_irqsave+0x37/0x40 [255324.115154] [] schedule+0x29/0x70 [255324.120853] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255324.128457] [] ? _raw_spin_lock+0x20/0x30 [255324.134878] [] ? wake_up_atomic_t+0x30/0x30 [255324.141530] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255324.148676] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255324.157052] [] kthread+0xd1/0xe0 [255324.162610] [] ? insert_kthread_work+0x40/0x40 [255324.169516] [] ret_from_fork_nospec_begin+0x21/0x21 [255324.176905] [] ? insert_kthread_work+0x40/0x40 [255324.183808] ldlm_cn00_006 S ffff9c7dec59b150 0 18342 2 0x00000080 [255324.191840] Call Trace: [255324.194703] [] ? __set_current_blocked+0x42/0x70 [255324.201800] [] schedule+0x29/0x70 [255324.207483] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255324.215079] [] ? __wake_up+0x13/0x20 [255324.221046] [] ? wake_up_atomic_t+0x30/0x30 [255324.227715] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255324.234863] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255324.243227] [] kthread+0xd1/0xe0 [255324.248798] [] ? insert_kthread_work+0x40/0x40 [255324.255703] [] ret_from_fork_nospec_begin+0x21/0x21 [255324.263093] [] ? insert_kthread_work+0x40/0x40 [255324.270018] mdt01_007 S ffff9c7dec599070 0 18343 2 0x00000080 [255324.278039] Call Trace: [255324.280897] [] ? _raw_spin_lock_irqsave+0x37/0x40 [255324.288099] [] schedule+0x29/0x70 [255324.293801] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255324.301387] [] ? _raw_spin_lock+0x20/0x30 [255324.307828] [] ? wake_up_atomic_t+0x30/0x30 [255324.314474] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255324.321628] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255324.329997] [] kthread+0xd1/0xe0 [255324.335553] [] ? insert_kthread_work+0x40/0x40 [255324.342471] [] ret_from_fork_nospec_begin+0x21/0x21 [255324.349861] [] ? insert_kthread_work+0x40/0x40 [255324.356764] mdt01_008 S ffff9c81e7f4d230 0 18344 2 0x00000080 [255324.364798] Call Trace: [255324.367643] [] ? __set_current_blocked+0x42/0x70 [255324.374742] [] schedule+0x29/0x70 [255324.380442] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255324.388029] [] ? __wake_up+0x13/0x20 [255324.393975] [] ? wake_up_atomic_t+0x30/0x30 [255324.400626] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255324.407762] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255324.416124] [] kthread+0xd1/0xe0 [255324.421672] [] ? insert_kthread_work+0x40/0x40 [255324.428599] [] ret_from_fork_nospec_begin+0x21/0x21 [255324.436013] [] ? insert_kthread_work+0x40/0x40 [255324.442927] mdt00_009 S ffff9c81e7f4a0e0 0 18345 2 0x00000080 [255324.450953] Call Trace: [255324.453785] [] ? __set_current_blocked+0x42/0x70 [255324.460912] [] schedule+0x29/0x70 [255324.466598] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255324.474195] [] ? __wake_up+0x13/0x20 [255324.480142] [] ? wake_up_atomic_t+0x30/0x30 [255324.486806] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255324.493961] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255324.502326] [] kthread+0xd1/0xe0 [255324.507886] [] ? insert_kthread_work+0x40/0x40 [255324.514792] [] ret_from_fork_nospec_begin+0x21/0x21 [255324.522182] [] ? insert_kthread_work+0x40/0x40 [255324.529085] mdt01_009 S ffff9c81e7f4b150 0 18346 2 0x00000080 [255324.537100] Call Trace: [255324.539934] [] ? __set_current_blocked+0x42/0x70 [255324.547039] [] schedule+0x29/0x70 [255324.552723] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255324.560309] [] ? __wake_up+0x13/0x20 [255324.566244] [] ? wake_up_atomic_t+0x30/0x30 [255324.572898] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255324.580048] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255324.588428] [] kthread+0xd1/0xe0 [255324.593974] [] ? insert_kthread_work+0x40/0x40 [255324.600879] [] ret_from_fork_nospec_begin+0x21/0x21 [255324.608267] [] ? insert_kthread_work+0x40/0x40 [255324.615179] mdt00_010 S ffff9c81e7f49070 0 18347 2 0x00000080 [255324.623168] Call Trace: [255324.626001] [] ? __set_current_blocked+0x42/0x70 [255324.633100] [] schedule+0x29/0x70 [255324.638783] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255324.646399] [] ? __wake_up+0x13/0x20 [255324.652335] [] ? wake_up_atomic_t+0x30/0x30 [255324.658987] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255324.666144] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255324.674506] [] kthread+0xd1/0xe0 [255324.680076] [] ? insert_kthread_work+0x40/0x40 [255324.687002] [] ret_from_fork_nospec_begin+0x21/0x21 [255324.694391] [] ? insert_kthread_work+0x40/0x40 [255324.701305] mdt01_010 S ffff9c81e7f4c1c0 0 18348 2 0x00000080 [255324.709303] Call Trace: [255324.712137] [] schedule+0x29/0x70 [255324.717818] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255324.725412] [] ? __wake_up+0x13/0x20 [255324.731348] [] ? wake_up_atomic_t+0x30/0x30 [255324.738015] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255324.745175] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255324.753548] [] kthread+0xd1/0xe0 [255324.759112] [] ? insert_kthread_work+0x40/0x40 [255324.766016] [] ret_from_fork_nospec_begin+0x21/0x21 [255324.773426] [] ? insert_kthread_work+0x40/0x40 [255324.780339] mdt01_011 S ffff9c81e7f4e2a0 0 18349 2 0x00000080 [255324.788339] Call Trace: [255324.791174] [] ? __set_current_blocked+0x42/0x70 [255324.798284] [] schedule+0x29/0x70 [255324.803988] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255324.811576] [] ? __wake_up+0x13/0x20 [255324.817511] [] ? wake_up_atomic_t+0x30/0x30 [255324.824159] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255324.831303] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255324.839661] [] kthread+0xd1/0xe0 [255324.845211] [] ? insert_kthread_work+0x40/0x40 [255324.852128] [] ret_from_fork_nospec_begin+0x21/0x21 [255324.859508] [] ? insert_kthread_work+0x40/0x40 [255324.866412] mdt01_012 S ffff9c81e7f48000 0 18350 2 0x00000080 [255324.874413] Call Trace: [255324.877251] [] ? _raw_spin_lock_irqsave+0x37/0x40 [255324.884447] [] schedule+0x29/0x70 [255324.890127] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255324.897711] [] ? _raw_spin_lock+0x20/0x30 [255324.904140] [] ? wake_up_atomic_t+0x30/0x30 [255324.910808] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255324.917964] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255324.926328] [] kthread+0xd1/0xe0 [255324.931875] [] ? insert_kthread_work+0x40/0x40 [255324.938794] [] ret_from_fork_nospec_begin+0x21/0x21 [255324.946185] [] ? insert_kthread_work+0x40/0x40 [255324.953089] mdt00_011 S ffff9c7b39498000 0 18351 2 0x00000080 [255324.961098] Call Trace: [255324.963933] [] ? __set_current_blocked+0x42/0x70 [255324.971052] [] schedule+0x29/0x70 [255324.976733] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255324.984329] [] ? _raw_spin_lock+0x20/0x30 [255324.990748] [] ? wake_up_atomic_t+0x30/0x30 [255324.997402] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255325.004547] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255325.012941] [] kthread+0xd1/0xe0 [255325.018501] [] ? insert_kthread_work+0x40/0x40 [255325.025406] [] ret_from_fork_nospec_begin+0x21/0x21 [255325.032796] [] ? insert_kthread_work+0x40/0x40 [255325.039711] mdt01_013 S ffff9c81ec5020e0 0 18352 2 0x00000080 [255325.047731] Call Trace: [255325.050591] [] ? __set_current_blocked+0x42/0x70 [255325.057692] [] schedule+0x29/0x70 [255325.063389] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255325.070980] [] ? __wake_up+0x13/0x20 [255325.076920] [] ? wake_up_atomic_t+0x30/0x30 [255325.083609] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255325.090764] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255325.099125] [] kthread+0xd1/0xe0 [255325.104670] [] ? insert_kthread_work+0x40/0x40 [255325.111577] [] ret_from_fork_nospec_begin+0x21/0x21 [255325.118965] [] ? insert_kthread_work+0x40/0x40 [255325.125870] mdt_out01_004 S ffff9c81ec505230 0 18353 2 0x00000080 [255325.133877] Call Trace: [255325.136710] [] ? __set_current_blocked+0x42/0x70 [255325.143819] [] schedule+0x29/0x70 [255325.149518] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255325.157105] [] ? __wake_up+0x13/0x20 [255325.163032] [] ? wake_up_atomic_t+0x30/0x30 [255325.169705] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255325.176844] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255325.185207] [] kthread+0xd1/0xe0 [255325.190755] [] ? insert_kthread_work+0x40/0x40 [255325.197659] [] ret_from_fork_nospec_begin+0x21/0x21 [255325.205053] [] ? insert_kthread_work+0x40/0x40 [255325.211963] ldlm_cn01_006 S ffff9c81ec5041c0 0 18354 2 0x00000080 [255325.219972] Call Trace: [255325.222816] [] schedule+0x29/0x70 [255325.228512] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255325.236125] [] ? _raw_spin_lock+0x20/0x30 [255325.242557] [] ? wake_up_atomic_t+0x30/0x30 [255325.249202] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255325.256345] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255325.264706] [] kthread+0xd1/0xe0 [255325.270254] [] ? insert_kthread_work+0x40/0x40 [255325.277159] [] ret_from_fork_nospec_begin+0x21/0x21 [255325.284562] [] ? insert_kthread_work+0x40/0x40 [255325.291466] ldlm_cn00_007 S ffff9c7de9f29070 0 18355 2 0x00000080 [255325.299478] Call Trace: [255325.302311] [] schedule+0x29/0x70 [255325.308003] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255325.315617] [] ? wake_up_atomic_t+0x30/0x30 [255325.322287] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255325.329433] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255325.337795] [] kthread+0xd1/0xe0 [255325.343345] [] ? insert_kthread_work+0x40/0x40 [255325.350249] [] ret_from_fork_nospec_begin+0x21/0x21 [255325.357649] [] ? insert_kthread_work+0x40/0x40 [255325.364552] ldlm_cn01_007 S ffff9c7daaf69070 0 18356 2 0x00000080 [255325.372556] Call Trace: [255325.375389] [] ? _raw_spin_lock_irqsave+0x37/0x40 [255325.382584] [] schedule+0x29/0x70 [255325.388267] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255325.395853] [] ? __wake_up+0x13/0x20 [255325.401787] [] ? wake_up_atomic_t+0x30/0x30 [255325.408457] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255325.415602] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255325.423976] [] kthread+0xd1/0xe0 [255325.429524] [] ? insert_kthread_work+0x40/0x40 [255325.436429] [] ret_from_fork_nospec_begin+0x21/0x21 [255325.443823] [] ? insert_kthread_work+0x40/0x40 [255325.450732] ldlm_cn00_008 S ffff9c7daaf6d230 0 18357 2 0x00000080 [255325.458725] Call Trace: [255325.461561] [] ? _raw_spin_lock_irqsave+0x37/0x40 [255325.468768] [] schedule+0x29/0x70 [255325.474474] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255325.482059] [] ? __wake_up+0x13/0x20 [255325.488002] [] ? wake_up_atomic_t+0x30/0x30 [255325.494675] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255325.501817] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255325.510178] [] kthread+0xd1/0xe0 [255325.515737] [] ? insert_kthread_work+0x40/0x40 [255325.522640] [] ret_from_fork_nospec_begin+0x21/0x21 [255325.530031] [] ? insert_kthread_work+0x40/0x40 [255325.536938] ldlm_cn00_009 S ffff9c79f61441c0 0 18358 2 0x00000080 [255325.544951] Call Trace: [255325.547795] [] ? __set_current_blocked+0x42/0x70 [255325.554892] [] schedule+0x29/0x70 [255325.560581] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255325.568191] [] ? __wake_up+0x13/0x20 [255325.574126] [] ? wake_up_atomic_t+0x30/0x30 [255325.580794] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255325.587934] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255325.596297] [] kthread+0xd1/0xe0 [255325.601845] [] ? insert_kthread_work+0x40/0x40 [255325.608749] [] ret_from_fork_nospec_begin+0x21/0x21 [255325.616138] [] ? insert_kthread_work+0x40/0x40 [255325.623039] ldlm_cn01_008 S ffff9c7de9edc1c0 0 18359 2 0x00000080 [255325.631050] Call Trace: [255325.633886] [] ? _raw_spin_lock_irqsave+0x37/0x40 [255325.641091] [] schedule+0x29/0x70 [255325.646773] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255325.654352] [] ? _raw_spin_lock+0x20/0x30 [255325.660784] [] ? wake_up_atomic_t+0x30/0x30 [255325.667455] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255325.674610] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255325.682971] [] kthread+0xd1/0xe0 [255325.688536] [] ? insert_kthread_work+0x40/0x40 [255325.695441] [] ret_from_fork_nospec_begin+0x21/0x21 [255325.702844] [] ? insert_kthread_work+0x40/0x40 [255325.709747] ldlm_cn01_009 S ffff9c7de9eda0e0 0 18361 2 0x00000080 [255325.717772] Call Trace: [255325.720617] [] ? _raw_spin_lock_irqsave+0x37/0x40 [255325.727813] [] schedule+0x29/0x70 [255325.733501] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255325.741089] [] ? __wake_up+0x13/0x20 [255325.747024] [] ? wake_up_atomic_t+0x30/0x30 [255325.753689] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255325.760829] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255325.769203] [] kthread+0xd1/0xe0 [255325.774750] [] ? insert_kthread_work+0x40/0x40 [255325.781676] [] ret_from_fork_nospec_begin+0x21/0x21 [255325.789064] [] ? insert_kthread_work+0x40/0x40 [255325.796004] ldlm_cn01_010 S ffff9c7dec543150 0 18362 2 0x00000080 [255325.804012] Call Trace: [255325.806844] [] ? __set_current_blocked+0x42/0x70 [255325.813946] [] schedule+0x29/0x70 [255325.819642] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255325.827227] [] ? _raw_spin_lock+0x20/0x30 [255325.833646] [] ? wake_up_atomic_t+0x30/0x30 [255325.840310] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255325.847452] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255325.855819] [] kthread+0xd1/0xe0 [255325.861386] [] ? insert_kthread_work+0x40/0x40 [255325.868297] [] ret_from_fork_nospec_begin+0x21/0x21 [255325.875699] [] ? insert_kthread_work+0x40/0x40 [255325.882601] ldlm_cn01_011 S ffff9c7dec541070 0 18363 2 0x00000080 [255325.890605] Call Trace: [255325.893442] [] ? _raw_spin_lock_irqsave+0x37/0x40 [255325.900642] [] schedule+0x29/0x70 [255325.906324] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255325.913911] [] ? _raw_spin_lock+0x20/0x30 [255325.920331] [] ? wake_up_atomic_t+0x30/0x30 [255325.926985] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255325.934138] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255325.942513] [] kthread+0xd1/0xe0 [255325.948059] [] ? insert_kthread_work+0x40/0x40 [255325.954973] [] ret_from_fork_nospec_begin+0x21/0x21 [255325.962363] [] ? insert_kthread_work+0x40/0x40 [255325.969267] mdt01_014 S ffff9c7dd369d230 0 18364 2 0x00000080 [255325.977283] Call Trace: [255325.980117] [] ? __set_current_blocked+0x42/0x70 [255325.987215] [] schedule+0x29/0x70 [255325.992905] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255326.000499] [] ? __wake_up+0x13/0x20 [255326.006436] [] ? wake_up_atomic_t+0x30/0x30 [255326.013101] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255326.020242] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255326.028604] [] kthread+0xd1/0xe0 [255326.034151] [] ? insert_kthread_work+0x40/0x40 [255326.041054] [] ret_from_fork_nospec_begin+0x21/0x21 [255326.048453] [] ? insert_kthread_work+0x40/0x40 [255326.055359] mdt00_012 S ffff9c7dd369c1c0 0 18365 2 0x00000080 [255326.063356] Call Trace: [255326.066194] [] ? _raw_spin_lock_irqsave+0x37/0x40 [255326.073410] [] schedule+0x29/0x70 [255326.079107] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255326.086705] [] ? __wake_up+0x13/0x20 [255326.092640] [] ? wake_up_atomic_t+0x30/0x30 [255326.099308] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255326.106474] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255326.114843] [] kthread+0xd1/0xe0 [255326.120390] [] ? insert_kthread_work+0x40/0x40 [255326.127295] [] ret_from_fork_nospec_begin+0x21/0x21 [255326.134687] [] ? insert_kthread_work+0x40/0x40 [255326.141590] ldlm_cn01_012 S ffff9c7de9f2a0e0 0 18366 2 0x00000080 [255326.149599] Call Trace: [255326.152434] [] ? _raw_spin_lock_irqsave+0x37/0x40 [255326.159637] [] schedule+0x29/0x70 [255326.165337] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255326.172914] [] ? _raw_spin_lock+0x20/0x30 [255326.179334] [] ? wake_up_atomic_t+0x30/0x30 [255326.185993] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255326.193137] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255326.201500] [] kthread+0xd1/0xe0 [255326.207057] [] ? insert_kthread_work+0x40/0x40 [255326.213960] [] ret_from_fork_nospec_begin+0x21/0x21 [255326.221352] [] ? insert_kthread_work+0x40/0x40 [255326.228247] ldlm_cn01_013 S ffff9c7de9f2c1c0 0 18367 2 0x00000080 [255326.236252] Call Trace: [255326.239084] [] ? _raw_spin_lock_irqsave+0x37/0x40 [255326.246280] [] schedule+0x29/0x70 [255326.251988] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255326.259578] [] ? _raw_spin_lock+0x20/0x30 [255326.266000] [] ? wake_up_atomic_t+0x30/0x30 [255326.272652] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255326.279800] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255326.288160] [] kthread+0xd1/0xe0 [255326.293710] [] ? insert_kthread_work+0x40/0x40 [255326.300614] [] ret_from_fork_nospec_begin+0x21/0x21 [255326.308012] [] ? insert_kthread_work+0x40/0x40 [255326.314916] ldlm_cn01_014 S ffff9c7de9f2b150 0 18368 2 0x00000080 [255326.322926] Call Trace: [255326.325758] [] ? _raw_spin_lock_irqsave+0x37/0x40 [255326.332952] [] schedule+0x29/0x70 [255326.338646] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255326.346237] [] ? _raw_spin_lock+0x20/0x30 [255326.352675] [] ? wake_up_atomic_t+0x30/0x30 [255326.359336] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255326.366483] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255326.374859] [] kthread+0xd1/0xe0 [255326.380425] [] ? insert_kthread_work+0x40/0x40 [255326.387338] [] ret_from_fork_nospec_begin+0x21/0x21 [255326.394727] [] ? insert_kthread_work+0x40/0x40 [255326.401645] ldlm_cn01_015 S ffff9c7de9f2e2a0 0 18369 2 0x00000080 [255326.409653] Call Trace: [255326.412477] [] ? _raw_spin_lock_irqsave+0x37/0x40 [255326.419672] [] schedule+0x29/0x70 [255326.425378] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255326.432964] [] ? _raw_spin_lock+0x20/0x30 [255326.439392] [] ? wake_up_atomic_t+0x30/0x30 [255326.446051] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255326.453206] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255326.461559] [] kthread+0xd1/0xe0 [255326.467114] [] ? insert_kthread_work+0x40/0x40 [255326.474025] [] ret_from_fork_nospec_begin+0x21/0x21 [255326.481416] [] ? insert_kthread_work+0x40/0x40 [255326.488319] ldlm_cn01_016 S ffff9c7de9f2d230 0 18370 2 0x00000080 [255326.496321] Call Trace: [255326.499154] [] ? _raw_spin_lock_irqsave+0x37/0x40 [255326.506363] [] schedule+0x29/0x70 [255326.512061] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255326.519641] [] ? wake_up_atomic_t+0x30/0x30 [255326.526288] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255326.533437] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255326.541819] [] kthread+0xd1/0xe0 [255326.547379] [] ? insert_kthread_work+0x40/0x40 [255326.554286] [] ret_from_fork_nospec_begin+0x21/0x21 [255326.561689] [] ? insert_kthread_work+0x40/0x40 [255326.568615] ldlm_cn01_017 S ffff9c7de9f28000 0 18371 2 0x00000080 [255326.576640] Call Trace: [255326.579481] [] ? _raw_spin_lock_irqsave+0x37/0x40 [255326.586675] [] schedule+0x29/0x70 [255326.592374] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255326.599960] [] ? _raw_spin_lock+0x20/0x30 [255326.606380] [] ? wake_up_atomic_t+0x30/0x30 [255326.613045] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255326.620198] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255326.628571] [] kthread+0xd1/0xe0 [255326.634121] [] ? insert_kthread_work+0x40/0x40 [255326.641024] [] ret_from_fork_nospec_begin+0x21/0x21 [255326.648430] [] ? insert_kthread_work+0x40/0x40 [255326.655334] ldlm_cn01_018 S ffff9c7de8250000 0 18372 2 0x00000080 [255326.663330] Call Trace: [255326.666163] [] ? _raw_spin_lock_irqsave+0x37/0x40 [255326.673374] [] schedule+0x29/0x70 [255326.679046] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255326.686631] [] ? _raw_spin_lock+0x20/0x30 [255326.693050] [] ? wake_up_atomic_t+0x30/0x30 [255326.699717] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255326.706869] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255326.715244] [] kthread+0xd1/0xe0 [255326.720797] [] ? insert_kthread_work+0x40/0x40 [255326.727701] [] ret_from_fork_nospec_begin+0x21/0x21 [255326.735089] [] ? insert_kthread_work+0x40/0x40 [255326.741994] ldlm_cn01_019 S ffff9c7de8253150 0 18373 2 0x00000080 [255326.749982] Call Trace: [255326.752830] [] ? _raw_spin_lock_irqsave+0x37/0x40 [255326.760025] [] schedule+0x29/0x70 [255326.765709] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255326.773296] [] ? _raw_spin_lock+0x20/0x30 [255326.779715] [] ? wake_up_atomic_t+0x30/0x30 [255326.786385] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255326.793550] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255326.801922] [] kthread+0xd1/0xe0 [255326.807470] [] ? insert_kthread_work+0x40/0x40 [255326.814376] [] ret_from_fork_nospec_begin+0x21/0x21 [255326.821763] [] ? insert_kthread_work+0x40/0x40 [255326.828666] ldlm_cn01_020 S ffff9c7de8251070 0 18374 2 0x00000080 [255326.836668] Call Trace: [255326.839500] [] ? __set_current_blocked+0x42/0x70 [255326.846610] [] schedule+0x29/0x70 [255326.852322] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255326.859908] [] ? __wake_up+0x13/0x20 [255326.865844] [] ? wake_up_atomic_t+0x30/0x30 [255326.872494] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255326.879633] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255326.888005] [] kthread+0xd1/0xe0 [255326.893553] [] ? insert_kthread_work+0x40/0x40 [255326.900457] [] ret_from_fork_nospec_begin+0x21/0x21 [255326.907846] [] ? insert_kthread_work+0x40/0x40 [255326.914752] ldlm_cn01_021 S ffff9c79f694b150 0 18375 2 0x00000080 [255326.922780] Call Trace: [255326.925618] [] ? _raw_spin_lock_irqsave+0x37/0x40 [255326.932814] [] schedule+0x29/0x70 [255326.938496] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255326.946074] [] ? _raw_spin_lock+0x20/0x30 [255326.952506] [] ? wake_up_atomic_t+0x30/0x30 [255326.959159] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255326.966327] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255326.974686] [] kthread+0xd1/0xe0 [255326.980231] [] ? insert_kthread_work+0x40/0x40 [255326.987147] [] ret_from_fork_nospec_begin+0x21/0x21 [255326.994535] [] ? insert_kthread_work+0x40/0x40 [255327.001437] ldlm_cn01_022 S ffff9c79f694e2a0 0 18376 2 0x00000080 [255327.009431] Call Trace: [255327.012270] [] ? _raw_spin_lock_irqsave+0x37/0x40 [255327.019464] [] schedule+0x29/0x70 [255327.025147] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255327.032732] [] ? _raw_spin_lock+0x20/0x30 [255327.039163] [] ? wake_up_atomic_t+0x30/0x30 [255327.045844] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255327.052999] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255327.061363] [] kthread+0xd1/0xe0 [255327.066910] [] ? insert_kthread_work+0x40/0x40 [255327.073824] [] ret_from_fork_nospec_begin+0x21/0x21 [255327.081212] [] ? insert_kthread_work+0x40/0x40 [255327.088116] mdt01_015 S ffff9c81ec5062a0 0 18377 2 0x00000080 [255327.096112] Call Trace: [255327.098949] [] ? __set_current_blocked+0x42/0x70 [255327.106047] [] schedule+0x29/0x70 [255327.111748] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255327.119344] [] ? __wake_up+0x13/0x20 [255327.125292] [] ? wake_up_atomic_t+0x30/0x30 [255327.131974] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255327.139124] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255327.147484] [] kthread+0xd1/0xe0 [255327.153033] [] ? insert_kthread_work+0x40/0x40 [255327.159940] [] ret_from_fork_nospec_begin+0x21/0x21 [255327.167321] [] ? insert_kthread_work+0x40/0x40 [255327.174236] mdt00_013 S ffff9c81ec503150 0 18378 2 0x00000080 [255327.182263] Call Trace: [255327.185108] [] ? _raw_spin_lock_irqsave+0x37/0x40 [255327.192324] [] schedule+0x29/0x70 [255327.198022] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255327.205621] [] ? __wake_up+0x13/0x20 [255327.211556] [] ? wake_up_atomic_t+0x30/0x30 [255327.218208] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255327.225357] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255327.233719] [] kthread+0xd1/0xe0 [255327.239279] [] ? insert_kthread_work+0x40/0x40 [255327.246186] [] ret_from_fork_nospec_begin+0x21/0x21 [255327.253573] [] ? insert_kthread_work+0x40/0x40 [255327.260505] kworker/30:1H S ffff9c81ec4c3150 0 18380 2 0x00000080 [255327.268516] Call Trace: [255327.271348] [] ? process_one_work+0x21a/0x440 [255327.278155] [] schedule+0x29/0x70 [255327.283814] [] worker_thread+0x1d9/0x3c0 [255327.290139] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255327.297528] [] kthread+0xd1/0xe0 [255327.303076] [] ? insert_kthread_work+0x40/0x40 [255327.310009] [] ret_from_fork_nospec_begin+0x21/0x21 [255327.317409] [] ? insert_kthread_work+0x40/0x40 [255327.324325] kworker/u305:0 S ffff9c7dec501070 0 18432 2 0x00000080 [255327.332325] Call Trace: [255327.335171] [] ? process_one_work+0x21a/0x440 [255327.341993] [] schedule+0x29/0x70 [255327.347640] [] worker_thread+0x1d9/0x3c0 [255327.353962] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255327.361363] [] kthread+0xd1/0xe0 [255327.366908] [] ? insert_kthread_work+0x40/0x40 [255327.373819] [] ret_from_fork_nospec_begin+0x21/0x21 [255327.381207] [] ? insert_kthread_work+0x40/0x40 [255327.388111] mdt_rdpg00_003 S ffff9c7daaf68000 0 18473 2 0x00000080 [255327.396117] Call Trace: [255327.398949] [] ? __set_current_blocked+0x42/0x70 [255327.406050] [] schedule+0x29/0x70 [255327.411731] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255327.419319] [] ? __wake_up+0x13/0x20 [255327.425295] [] ? wake_up_atomic_t+0x30/0x30 [255327.431952] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255327.439120] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255327.447490] [] kthread+0xd1/0xe0 [255327.453049] [] ? insert_kthread_work+0x40/0x40 [255327.459954] [] ret_from_fork_nospec_begin+0x21/0x21 [255327.467347] [] ? insert_kthread_work+0x40/0x40 [255327.474255] mdt_rdpg01_003 S ffff9c7daaf6b150 0 18474 2 0x00000080 [255327.482271] Call Trace: [255327.485111] [] ? __set_current_blocked+0x42/0x70 [255327.492236] [] schedule+0x29/0x70 [255327.497918] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255327.505504] [] ? __wake_up+0x13/0x20 [255327.511438] [] ? wake_up_atomic_t+0x30/0x30 [255327.518102] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255327.525251] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255327.533613] [] kthread+0xd1/0xe0 [255327.539160] [] ? insert_kthread_work+0x40/0x40 [255327.546064] [] ret_from_fork_nospec_begin+0x21/0x21 [255327.553454] [] ? insert_kthread_work+0x40/0x40 [255327.560365] mdt_rdpg00_004 S ffff9c7da8139070 0 18475 2 0x00000080 [255327.568346] Call Trace: [255327.571190] [] ? _raw_spin_lock_irqsave+0x37/0x40 [255327.578394] [] schedule+0x29/0x70 [255327.584080] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255327.591715] [] ? __wake_up+0x13/0x20 [255327.597649] [] ? wake_up_atomic_t+0x30/0x30 [255327.604301] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255327.611440] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255327.619802] [] kthread+0xd1/0xe0 [255327.625348] [] ? insert_kthread_work+0x40/0x40 [255327.632251] [] ret_from_fork_nospec_begin+0x21/0x21 [255327.639639] [] ? insert_kthread_work+0x40/0x40 [255327.646542] mdt_rdpg00_005 S ffff9c7da813a0e0 0 18476 2 0x00000080 [255327.654543] Call Trace: [255327.657388] [] ? __set_current_blocked+0x42/0x70 [255327.664476] [] schedule+0x29/0x70 [255327.670164] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255327.677777] [] ? __wake_up+0x13/0x20 [255327.683713] [] ? wake_up_atomic_t+0x30/0x30 [255327.690380] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255327.697525] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255327.705898] [] kthread+0xd1/0xe0 [255327.711459] [] ? insert_kthread_work+0x40/0x40 [255327.718363] [] ret_from_fork_nospec_begin+0x21/0x21 [255327.725783] [] ? insert_kthread_work+0x40/0x40 [255327.732684] mdt_rdpg01_004 S ffff9c7da813c1c0 0 18477 2 0x00000080 [255327.740685] Call Trace: [255327.743524] [] ? _raw_spin_lock_irqsave+0x37/0x40 [255327.750720] [] schedule+0x29/0x70 [255327.756404] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255327.764002] [] ? __wake_up+0x13/0x20 [255327.769936] [] ? wake_up_atomic_t+0x30/0x30 [255327.776619] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255327.783775] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255327.792137] [] kthread+0xd1/0xe0 [255327.797694] [] ? insert_kthread_work+0x40/0x40 [255327.804619] [] ret_from_fork_nospec_begin+0x21/0x21 [255327.812021] [] ? insert_kthread_work+0x40/0x40 [255327.818937] mdt_rdpg01_005 S ffff9c7da813d230 0 18478 2 0x00000080 [255327.826937] Call Trace: [255327.829775] [] ? __set_current_blocked+0x42/0x70 [255327.836873] [] schedule+0x29/0x70 [255327.842569] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255327.850157] [] ? wake_up_atomic_t+0x30/0x30 [255327.856827] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255327.863981] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255327.872344] [] kthread+0xd1/0xe0 [255327.877892] [] ? insert_kthread_work+0x40/0x40 [255327.884796] [] ret_from_fork_nospec_begin+0x21/0x21 [255327.892185] [] ? insert_kthread_work+0x40/0x40 [255327.899101] mdt_rdpg01_006 S ffff9c7da813b150 0 18479 2 0x00000080 [255327.907090] Call Trace: [255327.909935] [] ? __set_current_blocked+0x42/0x70 [255327.917024] [] schedule+0x29/0x70 [255327.922715] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255327.930317] [] ? __wake_up+0x13/0x20 [255327.936257] [] ? wake_up_atomic_t+0x30/0x30 [255327.942928] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255327.950091] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255327.958452] [] kthread+0xd1/0xe0 [255327.964000] [] ? insert_kthread_work+0x40/0x40 [255327.970907] [] ret_from_fork_nospec_begin+0x21/0x21 [255327.978295] [] ? insert_kthread_work+0x40/0x40 [255327.985211] mdt_rdpg00_006 S ffff9c81e78b0000 0 18480 2 0x00000080 [255327.993217] Call Trace: [255327.996062] [] ? _raw_spin_lock_irqsave+0x37/0x40 [255328.003261] [] schedule+0x29/0x70 [255328.008955] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255328.016554] [] ? __wake_up+0x13/0x20 [255328.022490] [] ? wake_up_atomic_t+0x30/0x30 [255328.029146] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255328.036313] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255328.044673] [] kthread+0xd1/0xe0 [255328.050262] [] ? insert_kthread_work+0x40/0x40 [255328.057157] [] ret_from_fork_nospec_begin+0x21/0x21 [255328.064544] [] ? insert_kthread_work+0x40/0x40 [255328.071446] mdt_rdpg01_007 S ffff9c81e78b5230 0 18481 2 0x00000080 [255328.079465] Call Trace: [255328.082308] [] ? __set_current_blocked+0x42/0x70 [255328.089407] [] schedule+0x29/0x70 [255328.095088] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255328.102673] [] ? __wake_up+0x13/0x20 [255328.108607] [] ? wake_up_atomic_t+0x30/0x30 [255328.115276] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255328.122415] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255328.130776] [] kthread+0xd1/0xe0 [255328.136335] [] ? insert_kthread_work+0x40/0x40 [255328.143240] [] ret_from_fork_nospec_begin+0x21/0x21 [255328.150631] [] ? insert_kthread_work+0x40/0x40 [255328.157535] mdt_rdpg00_007 S ffff9c81e78b62a0 0 18482 2 0x00000080 [255328.165541] Call Trace: [255328.168363] [] ? __set_current_blocked+0x42/0x70 [255328.175459] [] schedule+0x29/0x70 [255328.181154] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255328.188760] [] ? wake_up_atomic_t+0x30/0x30 [255328.195427] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255328.202608] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255328.210971] [] kthread+0xd1/0xe0 [255328.216517] [] ? insert_kthread_work+0x40/0x40 [255328.223420] [] ret_from_fork_nospec_begin+0x21/0x21 [255328.230812] [] ? insert_kthread_work+0x40/0x40 [255328.237739] mdt_rdpg00_008 S ffff9c81e78b3150 0 18483 2 0x00000080 [255328.245774] Call Trace: [255328.248625] [] ? __set_current_blocked+0x42/0x70 [255328.255735] [] schedule+0x29/0x70 [255328.261429] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255328.269021] [] ? __wake_up+0x13/0x20 [255328.274956] [] ? wake_up_atomic_t+0x30/0x30 [255328.281606] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255328.288763] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255328.297131] [] kthread+0xd1/0xe0 [255328.302691] [] ? insert_kthread_work+0x40/0x40 [255328.309593] [] ret_from_fork_nospec_begin+0x21/0x21 [255328.316981] [] ? insert_kthread_work+0x40/0x40 [255328.323882] mdt_rdpg01_008 S ffff9c7dec6a8000 0 18484 2 0x00000080 [255328.331893] Call Trace: [255328.334735] [] ? __set_current_blocked+0x42/0x70 [255328.341828] [] schedule+0x29/0x70 [255328.347529] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255328.355121] [] ? wake_up_atomic_t+0x30/0x30 [255328.361773] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255328.368906] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255328.377268] [] kthread+0xd1/0xe0 [255328.382839] [] ? insert_kthread_work+0x40/0x40 [255328.389743] [] ret_from_fork_nospec_begin+0x21/0x21 [255328.397130] [] ? insert_kthread_work+0x40/0x40 [255328.404034] mdt_rdpg00_009 S ffff9c7dec5462a0 0 18485 2 0x00000080 [255328.412030] Call Trace: [255328.414860] [] ? __set_current_blocked+0x42/0x70 [255328.421971] [] schedule+0x29/0x70 [255328.427654] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255328.435261] [] ? __wake_up+0x13/0x20 [255328.441197] [] ? wake_up_atomic_t+0x30/0x30 [255328.447865] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255328.455005] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255328.463368] [] kthread+0xd1/0xe0 [255328.468917] [] ? insert_kthread_work+0x40/0x40 [255328.475823] [] ret_from_fork_nospec_begin+0x21/0x21 [255328.483233] [] ? insert_kthread_work+0x40/0x40 [255328.490127] mdt_rdpg01_009 S ffff9c7a7123d230 0 18486 2 0x00000080 [255328.498124] Call Trace: [255328.500947] [] ? __set_current_blocked+0x42/0x70 [255328.508057] [] schedule+0x29/0x70 [255328.513740] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255328.521325] [] ? _raw_spin_lock+0x20/0x30 [255328.527743] [] ? wake_up_atomic_t+0x30/0x30 [255328.534414] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255328.541559] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255328.549939] [] kthread+0xd1/0xe0 [255328.555485] [] ? insert_kthread_work+0x40/0x40 [255328.562391] [] ret_from_fork_nospec_begin+0x21/0x21 [255328.569780] [] ? insert_kthread_work+0x40/0x40 [255328.576702] mdt_rdpg00_010 S ffff9c79f694c1c0 0 18487 2 0x00000080 [255328.584720] Call Trace: [255328.587551] [] ? __set_current_blocked+0x42/0x70 [255328.594666] [] schedule+0x29/0x70 [255328.600348] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255328.607934] [] ? _raw_spin_lock+0x20/0x30 [255328.614368] [] ? wake_up_atomic_t+0x30/0x30 [255328.621031] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255328.628176] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255328.636562] [] kthread+0xd1/0xe0 [255328.642110] [] ? insert_kthread_work+0x40/0x40 [255328.649015] [] ret_from_fork_nospec_begin+0x21/0x21 [255328.656404] [] ? insert_kthread_work+0x40/0x40 [255328.663320] mdt_rdpg01_010 S ffff9c7dec5020e0 0 18489 2 0x00000080 [255328.671331] Call Trace: [255328.674164] [] ? __set_current_blocked+0x42/0x70 [255328.681262] [] schedule+0x29/0x70 [255328.686963] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255328.694560] [] ? __wake_up+0x13/0x20 [255328.700507] [] ? wake_up_atomic_t+0x30/0x30 [255328.707166] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255328.714320] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255328.722702] [] kthread+0xd1/0xe0 [255328.728257] [] ? insert_kthread_work+0x40/0x40 [255328.735191] [] ret_from_fork_nospec_begin+0x21/0x21 [255328.742581] [] ? insert_kthread_work+0x40/0x40 [255328.749496] mdt_rdpg01_011 S ffff9c7dec503150 0 18490 2 0x00000080 [255328.757505] Call Trace: [255328.760330] [] ? __set_current_blocked+0x42/0x70 [255328.767429] [] schedule+0x29/0x70 [255328.773128] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255328.780705] [] ? wake_up_atomic_t+0x30/0x30 [255328.787374] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255328.794524] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255328.802897] [] kthread+0xd1/0xe0 [255328.808445] [] ? insert_kthread_work+0x40/0x40 [255328.815362] [] ret_from_fork_nospec_begin+0x21/0x21 [255328.822758] [] ? insert_kthread_work+0x40/0x40 [255328.829680] ldlm_cn00_010 S ffff9c7de79ec1c0 0 18491 2 0x00000080 [255328.837691] Call Trace: [255328.840534] [] ? __set_current_blocked+0x42/0x70 [255328.847639] [] schedule+0x29/0x70 [255328.853339] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255328.860939] [] ? __wake_up+0x13/0x20 [255328.866875] [] ? wake_up_atomic_t+0x30/0x30 [255328.873538] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255328.880682] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255328.889051] [] kthread+0xd1/0xe0 [255328.894599] [] ? insert_kthread_work+0x40/0x40 [255328.901508] [] ret_from_fork_nospec_begin+0x21/0x21 [255328.908909] [] ? insert_kthread_work+0x40/0x40 [255328.915819] ldlm_cn00_011 S ffff9c7de79ed230 0 18529 2 0x00000080 [255328.923821] Call Trace: [255328.926656] [] ? __set_current_blocked+0x42/0x70 [255328.933763] [] schedule+0x29/0x70 [255328.939451] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255328.947045] [] ? wake_up_atomic_t+0x30/0x30 [255328.953694] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255328.960849] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255328.969211] [] kthread+0xd1/0xe0 [255328.974770] [] ? insert_kthread_work+0x40/0x40 [255328.981696] [] ret_from_fork_nospec_begin+0x21/0x21 [255328.989086] [] ? insert_kthread_work+0x40/0x40 [255328.995996] mdt_out01_005 S ffff9c7de79ee2a0 0 18571 2 0x00000080 [255329.004007] Call Trace: [255329.006851] [] ? __set_current_blocked+0x42/0x70 [255329.013949] [] schedule+0x29/0x70 [255329.019639] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255329.027224] [] ? _raw_spin_lock+0x20/0x30 [255329.033663] [] ? wake_up_atomic_t+0x30/0x30 [255329.040333] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255329.047517] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255329.055878] [] kthread+0xd1/0xe0 [255329.061425] [] ? insert_kthread_work+0x40/0x40 [255329.068329] [] ret_from_fork_nospec_begin+0x21/0x21 [255329.075717] [] ? insert_kthread_work+0x40/0x40 [255329.082633] mdt_out01_006 S ffff9c7de79e8000 0 18572 2 0x00000080 [255329.090661] Call Trace: [255329.093505] [] ? __set_current_blocked+0x42/0x70 [255329.100602] [] schedule+0x29/0x70 [255329.106291] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255329.113888] [] ? __wake_up+0x13/0x20 [255329.119822] [] ? wake_up_atomic_t+0x30/0x30 [255329.126488] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255329.133637] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255329.142011] [] kthread+0xd1/0xe0 [255329.147571] [] ? insert_kthread_work+0x40/0x40 [255329.154477] [] ret_from_fork_nospec_begin+0x21/0x21 [255329.161866] [] ? insert_kthread_work+0x40/0x40 [255329.168769] ldlm_cb01_002 S ffff9c7de79e9070 0 18573 2 0x00000080 [255329.176766] Call Trace: [255329.179610] [] ? __set_current_blocked+0x42/0x70 [255329.186712] [] schedule+0x29/0x70 [255329.192415] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255329.200000] [] ? __wake_up+0x13/0x20 [255329.205936] [] ? wake_up_atomic_t+0x30/0x30 [255329.212603] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255329.219777] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255329.228166] [] kthread+0xd1/0xe0 [255329.233713] [] ? insert_kthread_work+0x40/0x40 [255329.240632] [] ret_from_fork_nospec_begin+0x21/0x21 [255329.248036] [] ? insert_kthread_work+0x40/0x40 [255329.254937] kworker/31:1H S ffff9c7e7953d230 0 18574 2 0x00000080 [255329.262956] Call Trace: [255329.265788] [] ? process_one_work+0x21a/0x440 [255329.272609] [] schedule+0x29/0x70 [255329.278254] [] worker_thread+0x1d9/0x3c0 [255329.284576] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255329.291966] [] kthread+0xd1/0xe0 [255329.297533] [] ? insert_kthread_work+0x40/0x40 [255329.304450] [] ret_from_fork_nospec_begin+0x21/0x21 [255329.311843] [] ? insert_kthread_work+0x40/0x40 [255329.318746] mdt_out01_007 S ffff9c7e7953e2a0 0 18577 2 0x00000080 [255329.326754] Call Trace: [255329.329599] [] ? _raw_spin_lock_irqsave+0x37/0x40 [255329.336809] [] schedule+0x29/0x70 [255329.342497] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255329.350114] [] ? __wake_up+0x13/0x20 [255329.356049] [] ? wake_up_atomic_t+0x30/0x30 [255329.362723] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255329.369880] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255329.378245] [] kthread+0xd1/0xe0 [255329.383793] [] ? insert_kthread_work+0x40/0x40 [255329.390697] [] ret_from_fork_nospec_begin+0x21/0x21 [255329.398095] [] ? insert_kthread_work+0x40/0x40 [255329.404999] mdt_out01_008 S ffff9c7de79eb150 0 18585 2 0x00000080 [255329.412999] Call Trace: [255329.415840] [] ? __set_current_blocked+0x42/0x70 [255329.422939] [] schedule+0x29/0x70 [255329.428629] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255329.436256] [] ? __wake_up+0x13/0x20 [255329.442193] [] ? wake_up_atomic_t+0x30/0x30 [255329.448851] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255329.456003] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255329.464378] [] kthread+0xd1/0xe0 [255329.469939] [] ? insert_kthread_work+0x40/0x40 [255329.476846] [] ret_from_fork_nospec_begin+0x21/0x21 [255329.484259] [] ? insert_kthread_work+0x40/0x40 [255329.491161] mdt_out01_009 S ffff9c7deca28000 0 18738 2 0x00000080 [255329.499170] Call Trace: [255329.502003] [] ? __set_current_blocked+0x42/0x70 [255329.509103] [] schedule+0x29/0x70 [255329.514798] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255329.522397] [] ? __wake_up+0x13/0x20 [255329.528331] [] ? wake_up_atomic_t+0x30/0x30 [255329.534982] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255329.542127] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255329.550480] [] kthread+0xd1/0xe0 [255329.556033] [] ? insert_kthread_work+0x40/0x40 [255329.562938] [] ret_from_fork_nospec_begin+0x21/0x21 [255329.570352] [] ? insert_kthread_work+0x40/0x40 [255329.577254] mdt_out01_010 S ffff9c7deca29070 0 18739 2 0x00000080 [255329.585266] Call Trace: [255329.588107] [] ? __set_current_blocked+0x42/0x70 [255329.595203] [] schedule+0x29/0x70 [255329.600899] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255329.608485] [] ? __wake_up+0x13/0x20 [255329.614420] [] ? wake_up_atomic_t+0x30/0x30 [255329.621074] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255329.628231] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255329.636597] [] kthread+0xd1/0xe0 [255329.642179] [] ? insert_kthread_work+0x40/0x40 [255329.649083] [] ret_from_fork_nospec_begin+0x21/0x21 [255329.656486] [] ? insert_kthread_work+0x40/0x40 [255329.663412] mdt01_016 S ffff9c79f694a0e0 0 18741 2 0x00000080 [255329.671419] Call Trace: [255329.674243] [] schedule+0x29/0x70 [255329.679936] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255329.687534] [] ? __wake_up+0x13/0x20 [255329.693490] [] ? wake_up_atomic_t+0x30/0x30 [255329.700148] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255329.707317] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255329.715697] [] kthread+0xd1/0xe0 [255329.721256] [] ? insert_kthread_work+0x40/0x40 [255329.728171] [] ret_from_fork_nospec_begin+0x21/0x21 [255329.735560] [] ? insert_kthread_work+0x40/0x40 [255329.742463] mdt00_014 S ffff9c79f6948000 0 18742 2 0x00000080 [255329.750461] Call Trace: [255329.753283] [] ? __set_current_blocked+0x42/0x70 [255329.760380] [] schedule+0x29/0x70 [255329.766061] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255329.773645] [] ? __wake_up+0x13/0x20 [255329.779583] [] ? wake_up_atomic_t+0x30/0x30 [255329.786241] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255329.793414] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255329.801777] [] kthread+0xd1/0xe0 [255329.807323] [] ? insert_kthread_work+0x40/0x40 [255329.814228] [] ret_from_fork_nospec_begin+0x21/0x21 [255329.821635] [] ? insert_kthread_work+0x40/0x40 [255329.828561] mdt01_017 S ffff9c79f6949070 0 18743 2 0x00000080 [255329.836575] Call Trace: [255329.839413] [] ? __set_current_blocked+0x42/0x70 [255329.846511] [] schedule+0x29/0x70 [255329.852196] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255329.859782] [] ? __wake_up+0x13/0x20 [255329.865717] [] ? wake_up_atomic_t+0x30/0x30 [255329.872382] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255329.879527] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255329.887900] [] kthread+0xd1/0xe0 [255329.893447] [] ? insert_kthread_work+0x40/0x40 [255329.900355] [] ret_from_fork_nospec_begin+0x21/0x21 [255329.907746] [] ? insert_kthread_work+0x40/0x40 [255329.914662] mdt_out01_011 S ffff9c79f694d230 0 18744 2 0x00000080 [255329.922677] Call Trace: [255329.925515] [] ? _raw_spin_lock_irqsave+0x37/0x40 [255329.932711] [] schedule+0x29/0x70 [255329.938391] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255329.945977] [] ? __wake_up+0x13/0x20 [255329.951918] [] ? wake_up_atomic_t+0x30/0x30 [255329.958571] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255329.965749] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255329.974110] [] kthread+0xd1/0xe0 [255329.979669] [] ? insert_kthread_work+0x40/0x40 [255329.986586] [] ret_from_fork_nospec_begin+0x21/0x21 [255329.993987] [] ? insert_kthread_work+0x40/0x40 [255330.000890] mdt_out01_012 S ffff9c7a730fe2a0 0 18745 2 0x00000080 [255330.008907] Call Trace: [255330.011763] [] ? __set_current_blocked+0x42/0x70 [255330.018860] [] schedule+0x29/0x70 [255330.024546] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255330.032137] [] ? __wake_up+0x13/0x20 [255330.038070] [] ? wake_up_atomic_t+0x30/0x30 [255330.044750] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255330.051904] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255330.060260] [] kthread+0xd1/0xe0 [255330.065807] [] ? insert_kthread_work+0x40/0x40 [255330.072717] [] ret_from_fork_nospec_begin+0x21/0x21 [255330.080118] [] ? insert_kthread_work+0x40/0x40 [255330.087020] mdt_out01_013 S ffff9c7a730fc1c0 0 18746 2 0x00000080 [255330.095031] Call Trace: [255330.097869] [] schedule+0x29/0x70 [255330.103571] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255330.111159] [] ? __wake_up+0x13/0x20 [255330.117096] [] ? wake_up_atomic_t+0x30/0x30 [255330.123748] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255330.130892] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255330.139264] [] kthread+0xd1/0xe0 [255330.144821] [] ? insert_kthread_work+0x40/0x40 [255330.151724] [] ret_from_fork_nospec_begin+0x21/0x21 [255330.159122] [] ? insert_kthread_work+0x40/0x40 [255330.166026] mdt_seqm_0002 S ffff9c7da6e78000 0 18747 2 0x00000080 [255330.174023] Call Trace: [255330.176857] [] ? __set_current_blocked+0x42/0x70 [255330.183965] [] schedule+0x29/0x70 [255330.189662] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255330.197261] [] ? __wake_up+0x13/0x20 [255330.203208] [] ? wake_up_atomic_t+0x30/0x30 [255330.209863] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255330.217015] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255330.225389] [] kthread+0xd1/0xe0 [255330.230936] [] ? insert_kthread_work+0x40/0x40 [255330.237840] [] ret_from_fork_nospec_begin+0x21/0x21 [255330.245229] [] ? insert_kthread_work+0x40/0x40 [255330.252146] ldlm_bl_03 S ffff9c7da6e79070 0 18904 2 0x00000080 [255330.260161] Call Trace: [255330.263029] [] ? obd_stale_export_get+0x31/0x190 [obdclass] [255330.271207] [] schedule+0x29/0x70 [255330.276896] [] ldlm_bl_thread_main+0x709/0xa00 [ptlrpc] [255330.284682] [] ? wake_up_atomic_t+0x30/0x30 [255330.291336] [] ? ldlm_handle_bl_callback+0x3e0/0x3e0 [ptlrpc] [255330.299712] [] kthread+0xd1/0xe0 [255330.305262] [] ? insert_kthread_work+0x40/0x40 [255330.312165] [] ret_from_fork_nospec_begin+0x21/0x21 [255330.319587] [] ? insert_kthread_work+0x40/0x40 [255330.326490] ldlm_bl_04 S ffff9c7da6e7a0e0 0 18905 2 0x00000080 [255330.334511] Call Trace: [255330.337365] [] ? obd_stale_export_get+0x31/0x190 [obdclass] [255330.345536] [] schedule+0x29/0x70 [255330.351228] [] ldlm_bl_thread_main+0x709/0xa00 [ptlrpc] [255330.359014] [] ? wake_up_atomic_t+0x30/0x30 [255330.365663] [] ? ldlm_handle_bl_callback+0x3e0/0x3e0 [ptlrpc] [255330.374036] [] kthread+0xd1/0xe0 [255330.379591] [] ? insert_kthread_work+0x40/0x40 [255330.386494] [] ret_from_fork_nospec_begin+0x21/0x21 [255330.393891] [] ? insert_kthread_work+0x40/0x40 [255330.400795] mdt_out01_014 S ffff9c7da86ed230 0 19059 2 0x00000080 [255330.408791] Call Trace: [255330.411631] [] ? __set_current_blocked+0x42/0x70 [255330.418740] [] schedule+0x29/0x70 [255330.424441] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255330.432029] [] ? __wake_up+0x13/0x20 [255330.437991] [] ? wake_up_atomic_t+0x30/0x30 [255330.444662] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255330.451801] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255330.460175] [] kthread+0xd1/0xe0 [255330.465736] [] ? insert_kthread_work+0x40/0x40 [255330.472648] [] ret_from_fork_nospec_begin+0x21/0x21 [255330.480036] [] ? insert_kthread_work+0x40/0x40 [255330.486947] mdt_out01_015 S ffff9c7da86ec1c0 0 19060 2 0x00000080 [255330.494966] Call Trace: [255330.497794] [] ? __set_current_blocked+0x42/0x70 [255330.504892] [] schedule+0x29/0x70 [255330.510592] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255330.518177] [] ? __wake_up+0x13/0x20 [255330.524137] [] ? wake_up_atomic_t+0x30/0x30 [255330.530780] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255330.537920] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255330.546279] [] kthread+0xd1/0xe0 [255330.551825] [] ? insert_kthread_work+0x40/0x40 [255330.558730] [] ret_from_fork_nospec_begin+0x21/0x21 [255330.566120] [] ? insert_kthread_work+0x40/0x40 [255330.573022] ldlm_cn01_023 S ffff9c7da6e7e2a0 0 19411 2 0x00000080 [255330.581008] Call Trace: [255330.583866] [] ? _raw_spin_lock_irqsave+0x37/0x40 [255330.591061] [] schedule+0x29/0x70 [255330.596742] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255330.604353] [] ? _raw_spin_lock+0x20/0x30 [255330.610773] [] ? wake_up_atomic_t+0x30/0x30 [255330.617426] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255330.624581] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255330.632942] [] kthread+0xd1/0xe0 [255330.638490] [] ? insert_kthread_work+0x40/0x40 [255330.645395] [] ret_from_fork_nospec_begin+0x21/0x21 [255330.652785] [] ? insert_kthread_work+0x40/0x40 [255330.659688] ldlm_bl_05 S ffff9c7da6e7d230 0 19448 2 0x00000080 [255330.667685] Call Trace: [255330.670547] [] ? obd_stale_export_get+0x31/0x190 [obdclass] [255330.678722] [] schedule+0x29/0x70 [255330.684422] [] ldlm_bl_thread_main+0x709/0xa00 [ptlrpc] [255330.692202] [] ? wake_up_atomic_t+0x30/0x30 [255330.698855] [] ? ldlm_handle_bl_callback+0x3e0/0x3e0 [ptlrpc] [255330.707229] [] kthread+0xd1/0xe0 [255330.712775] [] ? insert_kthread_work+0x40/0x40 [255330.719687] [] ret_from_fork_nospec_begin+0x21/0x21 [255330.727079] [] ? insert_kthread_work+0x40/0x40 [255330.733980] mdt_out01_016 S ffff9c81e9319070 0 19846 2 0x00000080 [255330.742013] Call Trace: [255330.744847] [] ? __set_current_blocked+0x42/0x70 [255330.751943] [] schedule+0x29/0x70 [255330.757633] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255330.765210] [] ? __wake_up+0x13/0x20 [255330.771145] [] ? wake_up_atomic_t+0x30/0x30 [255330.777816] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255330.784973] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255330.793342] [] kthread+0xd1/0xe0 [255330.798896] [] ? insert_kthread_work+0x40/0x40 [255330.805799] [] ret_from_fork_nospec_begin+0x21/0x21 [255330.813201] [] ? insert_kthread_work+0x40/0x40 [255330.820104] ldlm_bl_06 S ffff9c7da6e7c1c0 0 19847 2 0x00000080 [255330.828103] Call Trace: [255330.830957] [] ? obd_stale_export_get+0x31/0x190 [obdclass] [255330.839129] [] schedule+0x29/0x70 [255330.844811] [] ldlm_bl_thread_main+0x709/0xa00 [ptlrpc] [255330.852584] [] ? wake_up_atomic_t+0x30/0x30 [255330.859252] [] ? ldlm_handle_bl_callback+0x3e0/0x3e0 [ptlrpc] [255330.867620] [] kthread+0xd1/0xe0 [255330.873168] [] ? insert_kthread_work+0x40/0x40 [255330.880083] [] ret_from_fork_nospec_begin+0x21/0x21 [255330.887472] [] ? insert_kthread_work+0x40/0x40 [255330.894405] kworker/31:2 S ffff9c7e79bb9070 0 24019 2 0x00000080 [255330.902419] Call Trace: [255330.905251] [] schedule+0x29/0x70 [255330.910896] [] worker_thread+0x1d9/0x3c0 [255330.917217] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255330.924617] [] kthread+0xd1/0xe0 [255330.930184] [] ? insert_kthread_work+0x40/0x40 [255330.937090] [] ret_from_fork_nospec_begin+0x21/0x21 [255330.944478] [] ? insert_kthread_work+0x40/0x40 [255330.951380] kmmpd-dm-1 S ffff9c7a7123e2a0 0 49632 2 0x00000080 [255330.959407] Call Trace: [255330.962244] [] schedule+0x29/0x70 [255330.967892] [] schedule_timeout+0x168/0x2d0 [255330.974509] [] ? __internal_add_timer+0x130/0x130 [255330.981725] [] ? write_mmp_block+0x12a/0x160 [ldiskfs] [255330.989406] [] schedule_timeout_interruptible+0x1e/0x20 [255330.997210] [] kmmpd+0x216/0x430 [ldiskfs] [255331.003749] [] ? __dump_mmp_msg+0x70/0x70 [ldiskfs] [255331.011136] [] kthread+0xd1/0xe0 [255331.016696] [] ? insert_kthread_work+0x40/0x40 [255331.023603] [] ret_from_fork_nospec_begin+0x21/0x21 [255331.030992] [] ? insert_kthread_work+0x40/0x40 [255331.037895] jbd2/dm-1-8 S ffff9c7dec500000 0 49633 2 0x00000080 [255331.045886] Call Trace: [255331.048727] [] ? task_rq_unlock+0x20/0x20 [255331.055146] [] schedule+0x29/0x70 [255331.060824] [] kjournald2+0x203/0x260 [jbd2] [255331.067553] [] ? wake_up_atomic_t+0x30/0x30 [255331.074172] [] ? commit_timeout+0x10/0x10 [jbd2] [255331.081295] [] kthread+0xd1/0xe0 [255331.086843] [] ? insert_kthread_work+0x40/0x40 [255331.093759] [] ret_from_fork_nospec_begin+0x21/0x21 [255331.101139] [] ? insert_kthread_work+0x40/0x40 [255331.108041] ldiskfs-rsv-con S ffff9c7dec5062a0 0 49634 2 0x00000080 [255331.116064] Call Trace: [255331.118900] [] schedule+0x29/0x70 [255331.124545] [] rescuer_thread+0x31e/0x3c0 [255331.130997] [] ? process_one_work+0x440/0x440 [255331.137816] [] kthread+0xd1/0xe0 [255331.143363] [] ? insert_kthread_work+0x40/0x40 [255331.150270] [] ret_from_fork_nospec_begin+0x21/0x21 [255331.157670] [] ? insert_kthread_work+0x40/0x40 [255331.164591] osp_up0-2 S ffff9c7dec5041c0 0 49637 2 0x00000080 [255331.172608] Call Trace: [255331.175460] [] ? osp_get_next_request+0x2d/0x1a0 [osp] [255331.183139] [] schedule+0x29/0x70 [255331.188801] [] osp_send_update_thread+0x1b5/0x450 [osp] [255331.196577] [] ? wake_up_atomic_t+0x30/0x30 [255331.203208] [] ? osp_invalidate_request+0x390/0x390 [osp] [255331.211200] [] kthread+0xd1/0xe0 [255331.216753] [] ? insert_kthread_work+0x40/0x40 [255331.223657] [] ret_from_fork_nospec_begin+0x21/0x21 [255331.231044] [] ? insert_kthread_work+0x40/0x40 [255331.237946] osp-pre-0-2 S ffff9c81ec513150 0 49638 2 0x00000080 [255331.245941] Call Trace: [255331.248775] [] schedule+0x29/0x70 [255331.254435] [] osp_precreate_thread+0x76b/0x12a0 [osp] [255331.262127] [] ? wake_up_atomic_t+0x30/0x30 [255331.268756] [] ? osp_init_pre_fid+0x630/0x630 [osp] [255331.276166] [] kthread+0xd1/0xe0 [255331.281716] [] ? insert_kthread_work+0x40/0x40 [255331.288619] [] ret_from_fork_nospec_begin+0x21/0x21 [255331.296008] [] ? insert_kthread_work+0x40/0x40 [255331.302912] osp_up1-2 S ffff9c81e9318000 0 49639 2 0x00000080 [255331.310919] Call Trace: [255331.313758] [] ? osp_get_next_request+0x2d/0x1a0 [osp] [255331.321439] [] schedule+0x29/0x70 [255331.327101] [] osp_send_update_thread+0x1b5/0x450 [osp] [255331.334901] [] ? wake_up_atomic_t+0x30/0x30 [255331.341521] [] ? osp_invalidate_request+0x390/0x390 [osp] [255331.349510] [] kthread+0xd1/0xe0 [255331.355061] [] ? insert_kthread_work+0x40/0x40 [255331.361976] [] ret_from_fork_nospec_begin+0x21/0x21 [255331.369365] [] ? insert_kthread_work+0x40/0x40 [255331.376275] osp-pre-1-2 S ffff9c81e931d230 0 49640 2 0x00000080 [255331.384272] Call Trace: [255331.387102] [] schedule+0x29/0x70 [255331.392760] [] osp_precreate_thread+0x76b/0x12a0 [osp] [255331.400439] [] ? wake_up_atomic_t+0x30/0x30 [255331.407057] [] ? osp_init_pre_fid+0x630/0x630 [osp] [255331.414445] [] kthread+0xd1/0xe0 [255331.420001] [] ? insert_kthread_work+0x40/0x40 [255331.426906] [] ret_from_fork_nospec_begin+0x21/0x21 [255331.434298] [] ? insert_kthread_work+0x40/0x40 [255331.441208] osp_up3-2 S ffff9c81e931b150 0 49641 2 0x00000080 [255331.449233] Call Trace: [255331.452085] [] ? osp_get_next_request+0x2d/0x1a0 [osp] [255331.459766] [] schedule+0x29/0x70 [255331.465414] [] osp_send_update_thread+0x1b5/0x450 [osp] [255331.473182] [] ? wake_up_atomic_t+0x30/0x30 [255331.479813] [] ? osp_invalidate_request+0x390/0x390 [osp] [255331.487798] [] kthread+0xd1/0xe0 [255331.493367] [] ? insert_kthread_work+0x40/0x40 [255331.500272] [] ret_from_fork_nospec_begin+0x21/0x21 [255331.507660] [] ? insert_kthread_work+0x40/0x40 [255331.514564] osp-pre-3-2 S ffff9c81e931c1c0 0 49642 2 0x00000080 [255331.522581] Call Trace: [255331.525413] [] schedule+0x29/0x70 [255331.531061] [] osp_precreate_thread+0x76b/0x12a0 [osp] [255331.538743] [] ? wake_up_atomic_t+0x30/0x30 [255331.545362] [] ? osp_init_pre_fid+0x630/0x630 [osp] [255331.552762] [] kthread+0xd1/0xe0 [255331.558312] [] ? insert_kthread_work+0x40/0x40 [255331.565216] [] ret_from_fork_nospec_begin+0x21/0x21 [255331.572605] [] ? insert_kthread_work+0x40/0x40 [255331.579509] osp-syn-0-2 S ffff9c81e95f1070 0 49643 2 0x00000080 [255331.587510] Call Trace: [255331.590359] [] schedule+0x29/0x70 [255331.596021] [] osp_sync_process_queues+0x1681/0x1c20 [osp] [255331.604091] [] ? wake_up_atomic_t+0x30/0x30 [255331.610745] [] llog_process_thread+0x85f/0x1a10 [obdclass] [255331.618847] [] ? llog_cat_id2handle+0x3a8/0x620 [obdclass] [255331.626935] [] ? osp_sync_force+0x300/0x300 [osp] [255331.634148] [] llog_process_or_fork+0xcf/0x520 [obdclass] [255331.642142] [] ? llog_cat_process_common+0x119/0x420 [obdclass] [255331.650740] [] llog_cat_process_cb+0x239/0x250 [obdclass] [255331.658733] [] llog_process_thread+0x85f/0x1a10 [obdclass] [255331.666826] [] ? select_task_rq_fair+0x5a6/0x760 [255331.673918] [] ? try_to_wake_up+0x190/0x390 [255331.680566] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [255331.689137] [] llog_process_or_fork+0xcf/0x520 [obdclass] [255331.697143] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [255331.705718] [] llog_cat_process_or_fork+0x1f1/0x370 [obdclass] [255331.714175] [] ? __wake_up_common_lock+0x91/0xc0 [255331.721279] [] ? osp_sync_force+0x300/0x300 [osp] [255331.728495] [] llog_cat_process+0x2e/0x30 [obdclass] [255331.735989] [] osp_sync_thread+0x550/0xb70 [osp] [255331.743089] [] ? __schedule+0x402/0x840 [255331.749318] [] ? osp_sync_process_committed+0xd40/0xd40 [osp] [255331.757675] [] kthread+0xd1/0xe0 [255331.763220] [] ? insert_kthread_work+0x40/0x40 [255331.770123] [] ret_from_fork_nospec_begin+0x21/0x21 [255331.777512] [] ? insert_kthread_work+0x40/0x40 [255331.784413] osp-pre-0-2 S ffff9c81e95f5230 0 49644 2 0x00000080 [255331.792409] Call Trace: [255331.795247] [] schedule+0x29/0x70 [255331.800900] [] osp_precreate_cleanup_orphans+0x4a7/0x1170 [osp] [255331.809508] [] ? ptlrpc_assign_next_xid_nolock+0x24/0x30 [ptlrpc] [255331.818315] [] ? lustre_msg_set_timeout+0x27/0xe0 [ptlrpc] [255331.826398] [] ? wake_up_atomic_t+0x30/0x30 [255331.833031] [] osp_precreate_thread+0x150/0x12a0 [osp] [255331.840712] [] ? wake_up_atomic_t+0x30/0x30 [255331.847341] [] ? osp_init_pre_fid+0x630/0x630 [osp] [255331.854730] [] kthread+0xd1/0xe0 [255331.860288] [] ? insert_kthread_work+0x40/0x40 [255331.867191] [] ret_from_fork_nospec_begin+0x21/0x21 [255331.874583] [] ? insert_kthread_work+0x40/0x40 [255331.881487] osp-syn-1-2 S ffff9c81e95f3150 0 49645 2 0x00000080 [255331.889485] Call Trace: [255331.892320] [] schedule+0x29/0x70 [255331.897970] [] osp_sync_process_queues+0x1681/0x1c20 [osp] [255331.906039] [] ? wake_up_atomic_t+0x30/0x30 [255331.912679] [] llog_process_thread+0x85f/0x1a10 [obdclass] [255331.920773] [] ? llog_cat_id2handle+0x3a8/0x620 [obdclass] [255331.928859] [] ? osp_sync_force+0x300/0x300 [osp] [255331.936073] [] llog_process_or_fork+0xcf/0x520 [obdclass] [255331.944091] [] ? llog_cat_process_common+0x119/0x420 [obdclass] [255331.952668] [] llog_cat_process_cb+0x239/0x250 [obdclass] [255331.960658] [] llog_process_thread+0x85f/0x1a10 [obdclass] [255331.968740] [] ? select_task_rq_fair+0x5a6/0x760 [255331.975839] [] ? try_to_wake_up+0x190/0x390 [255331.982488] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [255331.991077] [] llog_process_or_fork+0xcf/0x520 [obdclass] [255331.999071] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [255332.007659] [] llog_cat_process_or_fork+0x1f1/0x370 [obdclass] [255332.016124] [] ? __wake_up_common_lock+0x91/0xc0 [255332.023227] [] ? osp_sync_force+0x300/0x300 [osp] [255332.030442] [] llog_cat_process+0x2e/0x30 [obdclass] [255332.037956] [] osp_sync_thread+0x550/0xb70 [osp] [255332.045068] [] ? __schedule+0x402/0x840 [255332.051298] [] ? osp_sync_process_committed+0xd40/0xd40 [osp] [255332.059663] [] kthread+0xd1/0xe0 [255332.065209] [] ? insert_kthread_work+0x40/0x40 [255332.072113] [] ret_from_fork_nospec_begin+0x21/0x21 [255332.079510] [] ? insert_kthread_work+0x40/0x40 [255332.086416] osp-pre-1-2 S ffff9c81e95f62a0 0 49646 2 0x00000080 [255332.094438] Call Trace: [255332.097269] [] schedule+0x29/0x70 [255332.102919] [] osp_precreate_cleanup_orphans+0x4a7/0x1170 [osp] [255332.111511] [] ? ptlrpc_assign_next_xid_nolock+0x24/0x30 [ptlrpc] [255332.120301] [] ? lustre_msg_set_timeout+0x27/0xe0 [ptlrpc] [255332.128385] [] ? wake_up_atomic_t+0x30/0x30 [255332.135009] [] osp_precreate_thread+0x150/0x12a0 [osp] [255332.142691] [] ? wake_up_atomic_t+0x30/0x30 [255332.149309] [] ? osp_init_pre_fid+0x630/0x630 [osp] [255332.156699] [] kthread+0xd1/0xe0 [255332.162244] [] ? insert_kthread_work+0x40/0x40 [255332.169162] [] ret_from_fork_nospec_begin+0x21/0x21 [255332.176550] [] ? insert_kthread_work+0x40/0x40 [255332.183453] osp-syn-2-2 S ffff9c81e95f41c0 0 49647 2 0x00000080 [255332.191462] Call Trace: [255332.194294] [] schedule+0x29/0x70 [255332.199942] [] osp_sync_process_queues+0x1681/0x1c20 [osp] [255332.208010] [] ? wake_up_atomic_t+0x30/0x30 [255332.214656] [] llog_process_thread+0x85f/0x1a10 [obdclass] [255332.222760] [] ? llog_cat_id2handle+0x3a8/0x620 [obdclass] [255332.230835] [] ? osp_sync_force+0x300/0x300 [osp] [255332.238053] [] llog_process_or_fork+0xcf/0x520 [obdclass] [255332.246056] [] ? llog_cat_process_common+0x119/0x420 [obdclass] [255332.254628] [] llog_cat_process_cb+0x239/0x250 [obdclass] [255332.262631] [] llog_process_thread+0x85f/0x1a10 [obdclass] [255332.270700] [] ? select_task_rq_fair+0x5a6/0x760 [255332.277799] [] ? try_to_wake_up+0x190/0x390 [255332.284448] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [255332.293023] [] llog_process_or_fork+0xcf/0x520 [obdclass] [255332.301028] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [255332.309600] [] llog_cat_process_or_fork+0x1f1/0x370 [obdclass] [255332.318056] [] ? __wake_up_common_lock+0x91/0xc0 [255332.325160] [] ? osp_sync_force+0x300/0x300 [osp] [255332.332388] [] llog_cat_process+0x2e/0x30 [obdclass] [255332.339887] [] osp_sync_thread+0x550/0xb70 [osp] [255332.346995] [] ? __schedule+0x402/0x840 [255332.353226] [] ? osp_sync_process_committed+0xd40/0xd40 [osp] [255332.361586] [] kthread+0xd1/0xe0 [255332.367134] [] ? insert_kthread_work+0x40/0x40 [255332.374039] [] ret_from_fork_nospec_begin+0x21/0x21 [255332.381441] [] ? insert_kthread_work+0x40/0x40 [255332.388344] osp-pre-2-2 S ffff9c81e95f0000 0 49648 2 0x00000080 [255332.396346] Call Trace: [255332.399178] [] schedule+0x29/0x70 [255332.404842] [] osp_precreate_cleanup_orphans+0x4a7/0x1170 [osp] [255332.413452] [] ? ptlrpc_assign_next_xid_nolock+0x24/0x30 [ptlrpc] [255332.422258] [] ? lustre_msg_set_timeout+0x27/0xe0 [ptlrpc] [255332.430328] [] ? wake_up_atomic_t+0x30/0x30 [255332.436947] [] osp_precreate_thread+0x150/0x12a0 [osp] [255332.444633] [] ? wake_up_atomic_t+0x30/0x30 [255332.451267] [] ? osp_init_pre_fid+0x630/0x630 [osp] [255332.458645] [] kthread+0xd1/0xe0 [255332.464194] [] ? insert_kthread_work+0x40/0x40 [255332.471108] [] ret_from_fork_nospec_begin+0x21/0x21 [255332.478505] [] ? insert_kthread_work+0x40/0x40 [255332.485408] osp-syn-3-2 S ffff9c81e85362a0 0 49649 2 0x00000080 [255332.493409] Call Trace: [255332.496245] [] schedule+0x29/0x70 [255332.501894] [] osp_sync_process_queues+0x1681/0x1c20 [osp] [255332.509965] [] ? wake_up_atomic_t+0x30/0x30 [255332.516597] [] llog_process_thread+0x85f/0x1a10 [obdclass] [255332.524685] [] ? llog_cat_id2handle+0x3a8/0x620 [obdclass] [255332.532773] [] ? osp_sync_force+0x300/0x300 [osp] [255332.539987] [] llog_process_or_fork+0xcf/0x520 [obdclass] [255332.547993] [] ? llog_cat_process_common+0x119/0x420 [obdclass] [255332.556569] [] llog_cat_process_cb+0x239/0x250 [obdclass] [255332.564570] [] llog_process_thread+0x85f/0x1a10 [obdclass] [255332.572640] [] ? select_task_rq_fair+0x5a6/0x760 [255332.579737] [] ? try_to_wake_up+0x190/0x390 [255332.586384] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [255332.594974] [] llog_process_or_fork+0xcf/0x520 [obdclass] [255332.602979] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [255332.611554] [] llog_cat_process_or_fork+0x1f1/0x370 [obdclass] [255332.620013] [] ? __wake_up_common_lock+0x91/0xc0 [255332.627117] [] ? osp_sync_force+0x300/0x300 [osp] [255332.634330] [] llog_cat_process+0x2e/0x30 [obdclass] [255332.641823] [] osp_sync_thread+0x550/0xb70 [osp] [255332.648928] [] ? __schedule+0x402/0x840 [255332.655157] [] ? osp_sync_process_committed+0xd40/0xd40 [osp] [255332.663516] [] kthread+0xd1/0xe0 [255332.669064] [] ? insert_kthread_work+0x40/0x40 [255332.675968] [] ret_from_fork_nospec_begin+0x21/0x21 [255332.683358] [] ? insert_kthread_work+0x40/0x40 [255332.690275] osp-pre-3-2 S ffff9c81e8535230 0 49650 2 0x00000080 [255332.698285] Call Trace: [255332.701117] [] schedule+0x29/0x70 [255332.706767] [] osp_precreate_cleanup_orphans+0x4a7/0x1170 [osp] [255332.715380] [] ? ptlrpc_assign_next_xid_nolock+0x24/0x30 [ptlrpc] [255332.724161] [] ? lustre_msg_set_timeout+0x27/0xe0 [ptlrpc] [255332.732223] [] ? wake_up_atomic_t+0x30/0x30 [255332.738841] [] osp_precreate_thread+0x150/0x12a0 [osp] [255332.746535] [] ? wake_up_atomic_t+0x30/0x30 [255332.753155] [] ? osp_init_pre_fid+0x630/0x630 [osp] [255332.760551] [] kthread+0xd1/0xe0 [255332.766099] [] ? insert_kthread_work+0x40/0x40 [255332.773002] [] ret_from_fork_nospec_begin+0x21/0x21 [255332.780403] [] ? insert_kthread_work+0x40/0x40 [255332.787317] osp-syn-4-2 S ffff9c81e85320e0 0 49651 2 0x00000080 [255332.795318] Call Trace: [255332.798160] [] schedule+0x29/0x70 [255332.803812] [] osp_sync_process_queues+0x1681/0x1c20 [osp] [255332.811892] [] ? wake_up_atomic_t+0x30/0x30 [255332.818523] [] llog_process_thread+0x85f/0x1a10 [obdclass] [255332.826611] [] ? llog_cat_id2handle+0x3a8/0x620 [obdclass] [255332.834686] [] ? osp_sync_force+0x300/0x300 [osp] [255332.841900] [] llog_process_or_fork+0xcf/0x520 [obdclass] [255332.849894] [] ? llog_cat_process_common+0x119/0x420 [obdclass] [255332.858465] [] llog_cat_process_cb+0x239/0x250 [obdclass] [255332.866493] [] llog_process_thread+0x85f/0x1a10 [obdclass] [255332.874564] [] ? select_task_rq_fair+0x5a6/0x760 [255332.881672] [] ? try_to_wake_up+0x190/0x390 [255332.888318] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [255332.896889] [] llog_process_or_fork+0xcf/0x520 [obdclass] [255332.904886] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [255332.913463] [] llog_cat_process_or_fork+0x1f1/0x370 [obdclass] [255332.921944] [] ? __wake_up_common_lock+0x91/0xc0 [255332.929059] [] ? osp_sync_force+0x300/0x300 [osp] [255332.936274] [] llog_cat_process+0x2e/0x30 [obdclass] [255332.943766] [] osp_sync_thread+0x550/0xb70 [osp] [255332.950864] [] ? __schedule+0x402/0x840 [255332.957093] [] ? osp_sync_process_committed+0xd40/0xd40 [osp] [255332.965452] [] kthread+0xd1/0xe0 [255332.971011] [] ? insert_kthread_work+0x40/0x40 [255332.977915] [] ret_from_fork_nospec_begin+0x21/0x21 [255332.985328] [] ? insert_kthread_work+0x40/0x40 [255332.992223] osp-pre-4-2 S ffff9c81e8533150 0 49652 2 0x00000080 [255333.000251] Call Trace: [255333.003111] [] schedule+0x29/0x70 [255333.008775] [] osp_precreate_cleanup_orphans+0x4a7/0x1170 [osp] [255333.017395] [] ? ptlrpc_assign_next_xid_nolock+0x24/0x30 [ptlrpc] [255333.026203] [] ? lustre_msg_set_timeout+0x27/0xe0 [ptlrpc] [255333.034273] [] ? wake_up_atomic_t+0x30/0x30 [255333.040905] [] osp_precreate_thread+0x150/0x12a0 [osp] [255333.048587] [] ? wake_up_atomic_t+0x30/0x30 [255333.055207] [] ? osp_init_pre_fid+0x630/0x630 [osp] [255333.062597] [] kthread+0xd1/0xe0 [255333.068166] [] ? insert_kthread_work+0x40/0x40 [255333.075060] [] ret_from_fork_nospec_begin+0x21/0x21 [255333.082462] [] ? insert_kthread_work+0x40/0x40 [255333.089363] osp-syn-5-2 S ffff9c81e85341c0 0 49653 2 0x00000080 [255333.097369] Call Trace: [255333.100210] [] schedule+0x29/0x70 [255333.105861] [] osp_sync_process_queues+0x1681/0x1c20 [osp] [255333.113929] [] ? wake_up_atomic_t+0x30/0x30 [255333.120576] [] llog_process_thread+0x85f/0x1a10 [obdclass] [255333.128669] [] ? llog_cat_id2handle+0x3a8/0x620 [obdclass] [255333.136744] [] ? osp_sync_force+0x300/0x300 [osp] [255333.143957] [] llog_process_or_fork+0xcf/0x520 [obdclass] [255333.151949] [] ? llog_cat_process_common+0x119/0x420 [obdclass] [255333.160549] [] llog_cat_process_cb+0x239/0x250 [obdclass] [255333.168537] [] llog_process_thread+0x85f/0x1a10 [obdclass] [255333.176616] [] ? tracing_is_on+0x15/0x30 [255333.182939] [] ? tracing_record_cmdline+0x1d/0x120 [255333.190231] [] ? try_to_wake_up+0x190/0x390 [255333.196867] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [255333.205452] [] llog_process_or_fork+0xcf/0x520 [obdclass] [255333.213459] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [255333.222043] [] llog_cat_process_or_fork+0x1f1/0x370 [obdclass] [255333.230502] [] ? __wake_up_common_lock+0x91/0xc0 [255333.237604] [] ? osp_sync_force+0x300/0x300 [osp] [255333.244809] [] llog_cat_process+0x2e/0x30 [obdclass] [255333.252304] [] osp_sync_thread+0x550/0xb70 [osp] [255333.259403] [] ? __schedule+0x402/0x840 [255333.265645] [] ? osp_sync_process_committed+0xd40/0xd40 [osp] [255333.274004] [] kthread+0xd1/0xe0 [255333.279591] [] ? insert_kthread_work+0x40/0x40 [255333.286498] [] ret_from_fork_nospec_begin+0x21/0x21 [255333.293887] [] ? insert_kthread_work+0x40/0x40 [255333.300792] osp-pre-5-2 S ffff9c81e8531070 0 49654 2 0x00000080 [255333.308792] Call Trace: [255333.311624] [] schedule+0x29/0x70 [255333.317271] [] osp_precreate_cleanup_orphans+0x4a7/0x1170 [osp] [255333.325877] [] ? ptlrpc_assign_next_xid_nolock+0x24/0x30 [ptlrpc] [255333.334684] [] ? lustre_msg_set_timeout+0x27/0xe0 [ptlrpc] [255333.342767] [] ? wake_up_atomic_t+0x30/0x30 [255333.349392] [] osp_precreate_thread+0x150/0x12a0 [osp] [255333.357073] [] ? wake_up_atomic_t+0x30/0x30 [255333.363693] [] ? osp_init_pre_fid+0x630/0x630 [osp] [255333.371088] [] kthread+0xd1/0xe0 [255333.376634] [] ? insert_kthread_work+0x40/0x40 [255333.383544] [] ret_from_fork_nospec_begin+0x21/0x21 [255333.390946] [] ? insert_kthread_work+0x40/0x40 [255333.397855] osp-syn-6-2 S ffff9c81e8530000 0 49655 2 0x00000080 [255333.405842] Call Trace: [255333.408679] [] schedule+0x29/0x70 [255333.414352] [] osp_sync_process_queues+0x1681/0x1c20 [osp] [255333.422419] [] ? wake_up_atomic_t+0x30/0x30 [255333.429061] [] llog_process_thread+0x85f/0x1a10 [obdclass] [255333.437164] [] ? llog_cat_id2handle+0x3a8/0x620 [obdclass] [255333.445253] [] ? osp_sync_force+0x300/0x300 [osp] [255333.452480] [] llog_process_or_fork+0xcf/0x520 [obdclass] [255333.460473] [] ? llog_cat_process_common+0x119/0x420 [obdclass] [255333.469037] [] llog_cat_process_cb+0x239/0x250 [obdclass] [255333.477026] [] llog_process_thread+0x85f/0x1a10 [obdclass] [255333.485093] [] ? select_task_rq_fair+0x5a6/0x760 [255333.492224] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [255333.500798] [] llog_process_or_fork+0xcf/0x520 [obdclass] [255333.508800] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [255333.517385] [] llog_cat_process_or_fork+0x1f1/0x370 [obdclass] [255333.525855] [] ? __wake_up_common_lock+0x91/0xc0 [255333.532958] [] ? osp_sync_force+0x300/0x300 [osp] [255333.540176] [] llog_cat_process+0x2e/0x30 [obdclass] [255333.547667] [] osp_sync_thread+0x550/0xb70 [osp] [255333.554765] [] ? __schedule+0x402/0x840 [255333.560996] [] ? osp_sync_process_committed+0xd40/0xd40 [osp] [255333.569355] [] kthread+0xd1/0xe0 [255333.574914] [] ? insert_kthread_work+0x40/0x40 [255333.581818] [] ret_from_fork_nospec_begin+0x21/0x21 [255333.589218] [] ? insert_kthread_work+0x40/0x40 [255333.596141] osp-pre-6-2 S ffff9c7d9da90000 0 49656 2 0x00000080 [255333.604152] Call Trace: [255333.606986] [] schedule+0x29/0x70 [255333.612636] [] osp_precreate_cleanup_orphans+0x4a7/0x1170 [osp] [255333.621233] [] ? ptlrpc_assign_next_xid_nolock+0x24/0x30 [ptlrpc] [255333.630022] [] ? lustre_msg_set_timeout+0x27/0xe0 [ptlrpc] [255333.638091] [] ? wake_up_atomic_t+0x30/0x30 [255333.644733] [] osp_precreate_thread+0x150/0x12a0 [osp] [255333.652425] [] ? wake_up_atomic_t+0x30/0x30 [255333.659056] [] ? osp_init_pre_fid+0x630/0x630 [osp] [255333.666458] [] kthread+0xd1/0xe0 [255333.671996] [] ? insert_kthread_work+0x40/0x40 [255333.678901] [] ret_from_fork_nospec_begin+0x21/0x21 [255333.686290] [] ? insert_kthread_work+0x40/0x40 [255333.693199] osp-syn-7-2 S ffff9c7d9da91070 0 49657 2 0x00000080 [255333.701214] Call Trace: [255333.704061] [] schedule+0x29/0x70 [255333.709711] [] osp_sync_process_queues+0x1681/0x1c20 [osp] [255333.717779] [] ? wake_up_atomic_t+0x30/0x30 [255333.724415] [] llog_process_thread+0x85f/0x1a10 [obdclass] [255333.732518] [] ? llog_cat_id2handle+0x3a8/0x620 [obdclass] [255333.740593] [] ? osp_sync_force+0x300/0x300 [osp] [255333.747811] [] llog_process_or_fork+0xcf/0x520 [obdclass] [255333.755802] [] ? llog_cat_process_common+0x119/0x420 [obdclass] [255333.764404] [] llog_cat_process_cb+0x239/0x250 [obdclass] [255333.772411] [] llog_process_thread+0x85f/0x1a10 [obdclass] [255333.780481] [] ? select_task_rq_fair+0x5a6/0x760 [255333.787580] [] ? try_to_wake_up+0x190/0x390 [255333.794227] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [255333.802813] [] llog_process_or_fork+0xcf/0x520 [obdclass] [255333.810803] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [255333.819374] [] llog_cat_process_or_fork+0x1f1/0x370 [obdclass] [255333.827830] [] ? __wake_up_common_lock+0x91/0xc0 [255333.834932] [] ? osp_sync_force+0x300/0x300 [osp] [255333.842147] [] llog_cat_process+0x2e/0x30 [obdclass] [255333.849653] [] osp_sync_thread+0x550/0xb70 [osp] [255333.856750] [] ? __schedule+0x402/0x840 [255333.863001] [] ? osp_sync_process_committed+0xd40/0xd40 [osp] [255333.871360] [] kthread+0xd1/0xe0 [255333.876908] [] ? insert_kthread_work+0x40/0x40 [255333.883811] [] ret_from_fork_nospec_begin+0x21/0x21 [255333.891202] [] ? insert_kthread_work+0x40/0x40 [255333.898105] osp-pre-7-2 S ffff9c7d9da920e0 0 49658 2 0x00000080 [255333.906113] Call Trace: [255333.908945] [] schedule+0x29/0x70 [255333.914591] [] osp_precreate_cleanup_orphans+0x4a7/0x1170 [osp] [255333.923197] [] ? ptlrpc_assign_next_xid_nolock+0x24/0x30 [ptlrpc] [255333.932001] [] ? lustre_msg_set_timeout+0x27/0xe0 [ptlrpc] [255333.940084] [] ? wake_up_atomic_t+0x30/0x30 [255333.946722] [] osp_precreate_thread+0x150/0x12a0 [osp] [255333.954406] [] ? wake_up_atomic_t+0x30/0x30 [255333.961025] [] ? osp_init_pre_fid+0x630/0x630 [osp] [255333.968416] [] kthread+0xd1/0xe0 [255333.973975] [] ? insert_kthread_work+0x40/0x40 [255333.980907] [] ret_from_fork_nospec_begin+0x21/0x21 [255333.988310] [] ? insert_kthread_work+0x40/0x40 [255333.995251] osp-syn-8-2 S ffff9c7d9da93150 0 49659 2 0x00000080 [255334.003259] Call Trace: [255334.006082] [] schedule+0x29/0x70 [255334.011732] [] osp_sync_process_queues+0x1681/0x1c20 [osp] [255334.019800] [] ? wake_up_atomic_t+0x30/0x30 [255334.026447] [] llog_process_thread+0x85f/0x1a10 [obdclass] [255334.034547] [] ? llog_cat_id2handle+0x3a8/0x620 [obdclass] [255334.042624] [] ? osp_sync_force+0x300/0x300 [osp] [255334.049841] [] llog_process_or_fork+0xcf/0x520 [obdclass] [255334.057844] [] ? llog_cat_process_common+0x119/0x420 [obdclass] [255334.066416] [] llog_cat_process_cb+0x239/0x250 [obdclass] [255334.074418] [] llog_process_thread+0x85f/0x1a10 [obdclass] [255334.082509] [] ? tracing_is_on+0x15/0x30 [255334.088832] [] ? tracing_record_cmdline+0x1d/0x120 [255334.096136] [] ? try_to_wake_up+0x190/0x390 [255334.102769] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [255334.111348] [] llog_process_or_fork+0xcf/0x520 [obdclass] [255334.119355] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [255334.127927] [] llog_cat_process_or_fork+0x1f1/0x370 [obdclass] [255334.136390] [] ? __wake_up_common_lock+0x91/0xc0 [255334.143496] [] ? osp_sync_force+0x300/0x300 [osp] [255334.150709] [] llog_cat_process+0x2e/0x30 [obdclass] [255334.158204] [] osp_sync_thread+0x550/0xb70 [osp] [255334.165305] [] ? __schedule+0x402/0x840 [255334.171539] [] ? osp_sync_process_committed+0xd40/0xd40 [osp] [255334.179900] [] kthread+0xd1/0xe0 [255334.185448] [] ? insert_kthread_work+0x40/0x40 [255334.192352] [] ret_from_fork_nospec_begin+0x21/0x21 [255334.199743] [] ? insert_kthread_work+0x40/0x40 [255334.206646] osp-pre-8-2 S ffff9c7d9da941c0 0 49660 2 0x00000080 [255334.214636] Call Trace: [255334.217469] [] schedule+0x29/0x70 [255334.223146] [] osp_precreate_cleanup_orphans+0x4a7/0x1170 [osp] [255334.231760] [] ? ptlrpc_assign_next_xid_nolock+0x24/0x30 [ptlrpc] [255334.240556] [] ? lustre_msg_set_timeout+0x27/0xe0 [ptlrpc] [255334.248631] [] ? wake_up_atomic_t+0x30/0x30 [255334.255280] [] osp_precreate_thread+0x150/0x12a0 [osp] [255334.262975] [] ? wake_up_atomic_t+0x30/0x30 [255334.269594] [] ? osp_init_pre_fid+0x630/0x630 [osp] [255334.276997] [] kthread+0xd1/0xe0 [255334.282546] [] ? insert_kthread_work+0x40/0x40 [255334.289462] [] ret_from_fork_nospec_begin+0x21/0x21 [255334.296849] [] ? insert_kthread_work+0x40/0x40 [255334.303752] osp-syn-9-2 S ffff9c7d9da95230 0 49661 2 0x00000080 [255334.311762] Call Trace: [255334.314606] [] schedule+0x29/0x70 [255334.320272] [] osp_sync_process_queues+0x1681/0x1c20 [osp] [255334.328351] [] ? wake_up_atomic_t+0x30/0x30 [255334.334987] [] llog_process_thread+0x85f/0x1a10 [obdclass] [255334.343087] [] ? llog_cat_id2handle+0x3a8/0x620 [obdclass] [255334.351175] [] ? osp_sync_force+0x300/0x300 [osp] [255334.358401] [] llog_process_or_fork+0xcf/0x520 [obdclass] [255334.366395] [] ? llog_cat_process_common+0x119/0x420 [obdclass] [255334.374969] [] llog_cat_process_cb+0x239/0x250 [obdclass] [255334.382961] [] llog_process_thread+0x85f/0x1a10 [obdclass] [255334.391039] [] ? select_task_rq_fair+0x5a6/0x760 [255334.398152] [] ? try_to_wake_up+0x190/0x390 [255334.404794] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [255334.413365] [] llog_process_or_fork+0xcf/0x520 [obdclass] [255334.421367] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [255334.429943] [] llog_cat_process_or_fork+0x1f1/0x370 [obdclass] [255334.438414] [] ? __wake_up_common_lock+0x91/0xc0 [255334.445527] [] ? osp_sync_force+0x300/0x300 [osp] [255334.452748] [] llog_cat_process+0x2e/0x30 [obdclass] [255334.460255] [] osp_sync_thread+0x550/0xb70 [osp] [255334.467355] [] ? __schedule+0x402/0x840 [255334.473585] [] ? osp_sync_process_committed+0xd40/0xd40 [osp] [255334.481944] [] kthread+0xd1/0xe0 [255334.487491] [] ? insert_kthread_work+0x40/0x40 [255334.494398] [] ret_from_fork_nospec_begin+0x21/0x21 [255334.501786] [] ? insert_kthread_work+0x40/0x40 [255334.508717] osp-pre-9-2 S ffff9c7d9da962a0 0 49662 2 0x00000080 [255334.516713] Call Trace: [255334.519560] [] schedule+0x29/0x70 [255334.525220] [] osp_precreate_cleanup_orphans+0x4a7/0x1170 [osp] [255334.533813] [] ? ptlrpc_assign_next_xid_nolock+0x24/0x30 [ptlrpc] [255334.542613] [] ? lustre_msg_set_timeout+0x27/0xe0 [ptlrpc] [255334.550683] [] ? wake_up_atomic_t+0x30/0x30 [255334.557309] [] osp_precreate_thread+0x150/0x12a0 [osp] [255334.564988] [] ? wake_up_atomic_t+0x30/0x30 [255334.571608] [] ? osp_init_pre_fid+0x630/0x630 [osp] [255334.578999] [] kthread+0xd1/0xe0 [255334.584559] [] ? insert_kthread_work+0x40/0x40 [255334.591468] [] ret_from_fork_nospec_begin+0x21/0x21 [255334.598871] [] ? insert_kthread_work+0x40/0x40 [255334.605776] osp-syn-10-2 S ffff9c7d9dae0000 0 49663 2 0x00000080 [255334.613791] Call Trace: [255334.616635] [] schedule+0x29/0x70 [255334.622314] [] osp_sync_process_queues+0x1681/0x1c20 [osp] [255334.630395] [] ? wake_up_atomic_t+0x30/0x30 [255334.637055] [] llog_process_thread+0x85f/0x1a10 [obdclass] [255334.645155] [] ? llog_cat_id2handle+0x3a8/0x620 [obdclass] [255334.653265] [] ? osp_sync_force+0x300/0x300 [osp] [255334.660479] [] llog_process_or_fork+0xcf/0x520 [obdclass] [255334.668484] [] ? llog_cat_process_common+0x119/0x420 [obdclass] [255334.677060] [] llog_cat_process_cb+0x239/0x250 [obdclass] [255334.685067] [] llog_process_thread+0x85f/0x1a10 [obdclass] [255334.693137] [] ? tracing_is_on+0x15/0x30 [255334.699467] [] ? tracing_record_cmdline+0x1d/0x120 [255334.706760] [] ? try_to_wake_up+0x190/0x390 [255334.713411] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [255334.721985] [] llog_process_or_fork+0xcf/0x520 [obdclass] [255334.729975] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [255334.738562] [] llog_cat_process_or_fork+0x1f1/0x370 [obdclass] [255334.747022] [] ? __wake_up_common_lock+0x91/0xc0 [255334.754128] [] ? osp_sync_force+0x300/0x300 [osp] [255334.761342] [] llog_cat_process+0x2e/0x30 [obdclass] [255334.768836] [] osp_sync_thread+0x550/0xb70 [osp] [255334.775935] [] ? __schedule+0x402/0x840 [255334.782167] [] ? osp_sync_process_committed+0xd40/0xd40 [osp] [255334.790525] [] kthread+0xd1/0xe0 [255334.796072] [] ? insert_kthread_work+0x40/0x40 [255334.802977] [] ret_from_fork_nospec_begin+0x21/0x21 [255334.810367] [] ? insert_kthread_work+0x40/0x40 [255334.817275] osp-pre-10-2 S ffff9c7d9dae1070 0 49664 2 0x00000080 [255334.825294] Call Trace: [255334.828140] [] schedule+0x29/0x70 [255334.833789] [] osp_precreate_cleanup_orphans+0x4a7/0x1170 [osp] [255334.842396] [] ? ptlrpc_assign_next_xid_nolock+0x24/0x30 [ptlrpc] [255334.851203] [] ? lustre_msg_set_timeout+0x27/0xe0 [ptlrpc] [255334.859278] [] ? wake_up_atomic_t+0x30/0x30 [255334.865899] [] osp_precreate_thread+0x150/0x12a0 [osp] [255334.873592] [] ? wake_up_atomic_t+0x30/0x30 [255334.880213] [] ? osp_init_pre_fid+0x630/0x630 [osp] [255334.887619] [] kthread+0xd1/0xe0 [255334.893169] [] ? insert_kthread_work+0x40/0x40 [255334.900066] [] ret_from_fork_nospec_begin+0x21/0x21 [255334.907456] [] ? insert_kthread_work+0x40/0x40 [255334.914361] osp-syn-11-2 S ffff9c7d9dae20e0 0 49665 2 0x00000080 [255334.922365] Call Trace: [255334.925198] [] schedule+0x29/0x70 [255334.930859] [] osp_sync_process_queues+0x1681/0x1c20 [osp] [255334.938930] [] ? wake_up_atomic_t+0x30/0x30 [255334.945561] [] llog_process_thread+0x85f/0x1a10 [obdclass] [255334.953652] [] ? llog_cat_id2handle+0x3a8/0x620 [obdclass] [255334.961729] [] ? osp_sync_force+0x300/0x300 [osp] [255334.968966] [] llog_process_or_fork+0xcf/0x520 [obdclass] [255334.976966] [] ? llog_cat_process_common+0x119/0x420 [obdclass] [255334.985542] [] llog_cat_process_cb+0x239/0x250 [obdclass] [255334.993546] [] llog_process_thread+0x85f/0x1a10 [obdclass] [255335.001636] [] ? select_task_rq_fair+0x5a6/0x760 [255335.008733] [] ? try_to_wake_up+0x190/0x390 [255335.015384] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [255335.023969] [] llog_process_or_fork+0xcf/0x520 [obdclass] [255335.031976] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [255335.040560] [] llog_cat_process_or_fork+0x1f1/0x370 [obdclass] [255335.049020] [] ? __wake_up_common_lock+0x91/0xc0 [255335.056116] [] ? osp_sync_force+0x300/0x300 [osp] [255335.063341] [] llog_cat_process+0x2e/0x30 [obdclass] [255335.070835] [] osp_sync_thread+0x550/0xb70 [osp] [255335.077934] [] ? __schedule+0x402/0x840 [255335.084164] [] ? osp_sync_process_committed+0xd40/0xd40 [osp] [255335.092523] [] kthread+0xd1/0xe0 [255335.098073] [] ? insert_kthread_work+0x40/0x40 [255335.104981] [] ret_from_fork_nospec_begin+0x21/0x21 [255335.112370] [] ? insert_kthread_work+0x40/0x40 [255335.119275] osp-pre-11-2 S ffff9c7d9dae3150 0 49666 2 0x00000080 [255335.127274] Call Trace: [255335.130108] [] schedule+0x29/0x70 [255335.135785] [] osp_precreate_cleanup_orphans+0x4a7/0x1170 [osp] [255335.144391] [] ? ptlrpc_assign_next_xid_nolock+0x24/0x30 [ptlrpc] [255335.153197] [] ? lustre_msg_set_timeout+0x27/0xe0 [ptlrpc] [255335.161261] [] ? wake_up_atomic_t+0x30/0x30 [255335.167901] [] osp_precreate_thread+0x150/0x12a0 [osp] [255335.175595] [] ? wake_up_atomic_t+0x30/0x30 [255335.182215] [] ? osp_init_pre_fid+0x630/0x630 [osp] [255335.189603] [] kthread+0xd1/0xe0 [255335.195152] [] ? insert_kthread_work+0x40/0x40 [255335.202056] [] ret_from_fork_nospec_begin+0x21/0x21 [255335.209457] [] ? insert_kthread_work+0x40/0x40 [255335.216360] osp-syn-12-2 S ffff9c7d9dae41c0 0 49667 2 0x00000080 [255335.224368] Call Trace: [255335.227202] [] schedule+0x29/0x70 [255335.232864] [] osp_sync_process_queues+0x1681/0x1c20 [osp] [255335.240924] [] ? wake_up_atomic_t+0x30/0x30 [255335.247560] [] llog_process_thread+0x85f/0x1a10 [obdclass] [255335.255675] [] ? llog_cat_id2handle+0x3a8/0x620 [obdclass] [255335.263772] [] ? osp_sync_force+0x300/0x300 [osp] [255335.270994] [] llog_process_or_fork+0xcf/0x520 [obdclass] [255335.279001] [] ? llog_cat_process_common+0x119/0x420 [obdclass] [255335.287578] [] llog_cat_process_cb+0x239/0x250 [obdclass] [255335.295598] [] llog_process_thread+0x85f/0x1a10 [obdclass] [255335.303666] [] ? select_task_rq_fair+0x5a6/0x760 [255335.310775] [] ? try_to_wake_up+0x190/0x390 [255335.317420] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [255335.325993] [] llog_process_or_fork+0xcf/0x520 [obdclass] [255335.333999] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [255335.342571] [] llog_cat_process_or_fork+0x1f1/0x370 [obdclass] [255335.351028] [] ? __wake_up_common_lock+0x91/0xc0 [255335.358133] [] ? osp_sync_force+0x300/0x300 [osp] [255335.365350] [] llog_cat_process+0x2e/0x30 [obdclass] [255335.372833] [] osp_sync_thread+0x550/0xb70 [osp] [255335.379932] [] ? __schedule+0x402/0x840 [255335.386163] [] ? osp_sync_process_committed+0xd40/0xd40 [osp] [255335.394522] [] kthread+0xd1/0xe0 [255335.400082] [] ? insert_kthread_work+0x40/0x40 [255335.406978] [] ret_from_fork_nospec_begin+0x21/0x21 [255335.414379] [] ? insert_kthread_work+0x40/0x40 [255335.421283] osp-pre-12-2 S ffff9c7d9dae5230 0 49668 2 0x00000080 [255335.429272] Call Trace: [255335.432097] [] schedule+0x29/0x70 [255335.437749] [] osp_precreate_cleanup_orphans+0x4a7/0x1170 [osp] [255335.446371] [] ? ptlrpc_assign_next_xid_nolock+0x24/0x30 [ptlrpc] [255335.455166] [] ? lustre_msg_set_timeout+0x27/0xe0 [ptlrpc] [255335.463237] [] ? wake_up_atomic_t+0x30/0x30 [255335.469861] [] osp_precreate_thread+0x150/0x12a0 [osp] [255335.477544] [] ? wake_up_atomic_t+0x30/0x30 [255335.484162] [] ? osp_init_pre_fid+0x630/0x630 [osp] [255335.491557] [] kthread+0xd1/0xe0 [255335.497105] [] ? insert_kthread_work+0x40/0x40 [255335.504009] [] ret_from_fork_nospec_begin+0x21/0x21 [255335.511398] [] ? insert_kthread_work+0x40/0x40 [255335.518304] osp-syn-13-2 S ffff9c7d9dae62a0 0 49669 2 0x00000080 [255335.526304] Call Trace: [255335.529144] [] schedule+0x29/0x70 [255335.534797] [] osp_sync_process_queues+0x1681/0x1c20 [osp] [255335.542887] [] ? wake_up_atomic_t+0x30/0x30 [255335.549537] [] llog_process_thread+0x85f/0x1a10 [obdclass] [255335.557642] [] ? llog_cat_id2handle+0x3a8/0x620 [obdclass] [255335.565715] [] ? osp_sync_force+0x300/0x300 [osp] [255335.572931] [] llog_process_or_fork+0xcf/0x520 [obdclass] [255335.580922] [] ? llog_cat_process_common+0x119/0x420 [obdclass] [255335.589512] [] llog_cat_process_cb+0x239/0x250 [obdclass] [255335.597503] [] llog_process_thread+0x85f/0x1a10 [obdclass] [255335.605573] [] ? tracing_is_on+0x15/0x30 [255335.611931] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [255335.620516] [] llog_process_or_fork+0xcf/0x520 [obdclass] [255335.628507] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [255335.637081] [] llog_cat_process_or_fork+0x1f1/0x370 [obdclass] [255335.645552] [] ? __wake_up_common_lock+0x91/0xc0 [255335.652678] [] ? osp_sync_force+0x300/0x300 [osp] [255335.659894] [] llog_cat_process+0x2e/0x30 [obdclass] [255335.667413] [] osp_sync_thread+0x550/0xb70 [osp] [255335.674512] [] ? __schedule+0x402/0x840 [255335.680755] [] ? osp_sync_process_committed+0xd40/0xd40 [osp] [255335.689115] [] kthread+0xd1/0xe0 [255335.694661] [] ? insert_kthread_work+0x40/0x40 [255335.701567] [] ret_from_fork_nospec_begin+0x21/0x21 [255335.708955] [] ? insert_kthread_work+0x40/0x40 [255335.715887] osp-pre-13-2 S ffff9c7d9db08000 0 49670 2 0x00000080 [255335.723889] Call Trace: [255335.726720] [] schedule+0x29/0x70 [255335.732379] [] osp_precreate_cleanup_orphans+0x4a7/0x1170 [osp] [255335.740990] [] ? ptlrpc_assign_next_xid_nolock+0x24/0x30 [ptlrpc] [255335.749793] [] ? lustre_msg_set_timeout+0x27/0xe0 [ptlrpc] [255335.757855] [] ? wake_up_atomic_t+0x30/0x30 [255335.764477] [] osp_precreate_thread+0x150/0x12a0 [osp] [255335.772160] [] ? wake_up_atomic_t+0x30/0x30 [255335.778772] [] ? osp_init_pre_fid+0x630/0x630 [osp] [255335.786170] [] kthread+0xd1/0xe0 [255335.791717] [] ? insert_kthread_work+0x40/0x40 [255335.798624] [] ret_from_fork_nospec_begin+0x21/0x21 [255335.806013] [] ? insert_kthread_work+0x40/0x40 [255335.812921] osp-syn-14-2 S ffff9c7d9db09070 0 49671 2 0x00000080 [255335.820959] Call Trace: [255335.823791] [] schedule+0x29/0x70 [255335.829442] [] osp_sync_process_queues+0x1681/0x1c20 [osp] [255335.837510] [] ? wake_up_atomic_t+0x30/0x30 [255335.844148] [] llog_process_thread+0x85f/0x1a10 [obdclass] [255335.852237] [] ? llog_cat_id2handle+0x3a8/0x620 [obdclass] [255335.860314] [] ? osp_sync_force+0x300/0x300 [osp] [255335.867533] [] llog_process_or_fork+0xcf/0x520 [obdclass] [255335.875528] [] ? llog_cat_process_common+0x119/0x420 [obdclass] [255335.884100] [] llog_cat_process_cb+0x239/0x250 [obdclass] [255335.892093] [] llog_process_thread+0x85f/0x1a10 [obdclass] [255335.900182] [] ? tracing_is_on+0x15/0x30 [255335.906516] [] ? tracing_record_cmdline+0x1d/0x120 [255335.913822] [] ? try_to_wake_up+0x190/0x390 [255335.920455] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [255335.929027] [] llog_process_or_fork+0xcf/0x520 [obdclass] [255335.937024] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [255335.945600] [] llog_cat_process_or_fork+0x1f1/0x370 [obdclass] [255335.954065] [] ? __wake_up_common_lock+0x91/0xc0 [255335.961182] [] ? osp_sync_force+0x300/0x300 [osp] [255335.968409] [] llog_cat_process+0x2e/0x30 [obdclass] [255335.975901] [] osp_sync_thread+0x550/0xb70 [osp] [255335.983000] [] ? __schedule+0x402/0x840 [255335.989231] [] ? osp_sync_process_committed+0xd40/0xd40 [osp] [255335.997590] [] kthread+0xd1/0xe0 [255336.003141] [] ? insert_kthread_work+0x40/0x40 [255336.010040] [] ret_from_fork_nospec_begin+0x21/0x21 [255336.017431] [] ? insert_kthread_work+0x40/0x40 [255336.024333] osp-pre-14-2 S ffff9c7d9db0a0e0 0 49672 2 0x00000080 [255336.032331] Call Trace: [255336.035163] [] schedule+0x29/0x70 [255336.040822] [] osp_precreate_cleanup_orphans+0x4a7/0x1170 [osp] [255336.049444] [] ? ptlrpc_assign_next_xid_nolock+0x24/0x30 [ptlrpc] [255336.058234] [] ? lustre_msg_set_timeout+0x27/0xe0 [ptlrpc] [255336.066303] [] ? wake_up_atomic_t+0x30/0x30 [255336.072923] [] osp_precreate_thread+0x150/0x12a0 [osp] [255336.080603] [] ? wake_up_atomic_t+0x30/0x30 [255336.087223] [] ? osp_init_pre_fid+0x630/0x630 [osp] [255336.094625] [] kthread+0xd1/0xe0 [255336.100186] [] ? insert_kthread_work+0x40/0x40 [255336.107101] [] ret_from_fork_nospec_begin+0x21/0x21 [255336.114490] [] ? insert_kthread_work+0x40/0x40 [255336.121402] osp-syn-15-2 S ffff9c7d9db0b150 0 49673 2 0x00000080 [255336.129401] Call Trace: [255336.132232] [] schedule+0x29/0x70 [255336.137909] [] osp_sync_process_queues+0x1681/0x1c20 [osp] [255336.145988] [] ? wake_up_atomic_t+0x30/0x30 [255336.152646] [] llog_process_thread+0x85f/0x1a10 [obdclass] [255336.160749] [] ? llog_cat_id2handle+0x3a8/0x620 [obdclass] [255336.168825] [] ? osp_sync_force+0x300/0x300 [osp] [255336.176041] [] llog_process_or_fork+0xcf/0x520 [obdclass] [255336.184037] [] ? llog_cat_process_common+0x119/0x420 [obdclass] [255336.192624] [] llog_cat_process_cb+0x239/0x250 [obdclass] [255336.200616] [] llog_process_thread+0x85f/0x1a10 [obdclass] [255336.208685] [] ? select_task_rq_fair+0x5a6/0x760 [255336.215785] [] ? try_to_wake_up+0x190/0x390 [255336.222430] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [255336.231006] [] llog_process_or_fork+0xcf/0x520 [obdclass] [255336.239010] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [255336.247587] [] llog_cat_process_or_fork+0x1f1/0x370 [obdclass] [255336.256059] [] ? __wake_up_common_lock+0x91/0xc0 [255336.263183] [] ? osp_sync_force+0x300/0x300 [osp] [255336.270400] [] llog_cat_process+0x2e/0x30 [obdclass] [255336.277894] [] osp_sync_thread+0x550/0xb70 [osp] [255336.284994] [] ? __schedule+0x402/0x840 [255336.291233] [] ? osp_sync_process_committed+0xd40/0xd40 [osp] [255336.299605] [] kthread+0xd1/0xe0 [255336.305164] [] ? insert_kthread_work+0x40/0x40 [255336.312068] [] ret_from_fork_nospec_begin+0x21/0x21 [255336.319471] [] ? insert_kthread_work+0x40/0x40 [255336.326375] osp-pre-15-2 S ffff9c7d9db0c1c0 0 49674 2 0x00000080 [255336.334386] Call Trace: [255336.337252] [] schedule+0x29/0x70 [255336.342900] [] osp_precreate_cleanup_orphans+0x4a7/0x1170 [osp] [255336.351457] [] ? queued_spin_lock_slowpath+0xb/0xf [255336.358807] [] ? lustre_msg_set_timeout+0x27/0xe0 [ptlrpc] [255336.366880] [] ? wake_up_atomic_t+0x30/0x30 [255336.373500] [] osp_precreate_thread+0x150/0x12a0 [osp] [255336.381185] [] ? wake_up_atomic_t+0x30/0x30 [255336.387837] [] ? osp_init_pre_fid+0x630/0x630 [osp] [255336.395227] [] kthread+0xd1/0xe0 [255336.400773] [] ? insert_kthread_work+0x40/0x40 [255336.407678] [] ret_from_fork_nospec_begin+0x21/0x21 [255336.415080] [] ? insert_kthread_work+0x40/0x40 [255336.421975] lquota_wb_soake S ffff9c7d9db0e2a0 0 49678 2 0x00000080 [255336.430004] Call Trace: [255336.432827] [] schedule+0x29/0x70 [255336.438482] [] schedule_timeout+0x168/0x2d0 [255336.445103] [] ? __internal_add_timer+0x130/0x130 [255336.452335] [] qsd_upd_thread+0x977/0xc50 [lquota] [255336.459648] [] ? qsd_upd_add+0xe0/0xe0 [lquota] [255336.466652] [] kthread+0xd1/0xe0 [255336.472199] [] ? insert_kthread_work+0x40/0x40 [255336.479115] [] ret_from_fork_nospec_begin+0x21/0x21 [255336.486506] [] ? insert_kthread_work+0x40/0x40 [255336.493420] lquota_wb_soake S ffff9c7de9fcb150 0 49679 2 0x00000080 [255336.501416] Call Trace: [255336.504250] [] schedule+0x29/0x70 [255336.509903] [] schedule_timeout+0x168/0x2d0 [255336.516516] [] ? __internal_add_timer+0x130/0x130 [255336.523718] [] qsd_upd_thread+0x977/0xc50 [lquota] [255336.531029] [] ? qsd_upd_add+0xe0/0xe0 [lquota] [255336.538051] [] kthread+0xd1/0xe0 [255336.543599] [] ? insert_kthread_work+0x40/0x40 [255336.550503] [] ret_from_fork_nospec_begin+0x21/0x21 [255336.557893] [] ? insert_kthread_work+0x40/0x40 [255336.564797] dist_txn-2 S ffff9c7de9fcd230 0 49680 2 0x00000080 [255336.572804] Call Trace: [255336.575638] [] schedule+0x29/0x70 [255336.581348] [] distribute_txn_commit_thread+0x9de/0xc90 [ptlrpc] [255336.590004] [] ? wake_up_atomic_t+0x30/0x30 [255336.596674] [] ? sub_trans_commit_cb+0x20/0x20 [ptlrpc] [255336.604461] [] kthread+0xd1/0xe0 [255336.610008] [] ? insert_kthread_work+0x40/0x40 [255336.616914] [] ret_from_fork_nospec_begin+0x21/0x21 [255336.624303] [] ? insert_kthread_work+0x40/0x40 [255336.631211] lod0002_rec0001 S ffff9c7de9fc9070 0 49683 2 0x00000080 [255336.639223] Call Trace: [255336.642054] [] schedule+0x29/0x70 [255336.647712] [] schedule_timeout+0x168/0x2d0 [255336.654325] [] ? wake_up_atomic_t+0x30/0x30 [255336.660939] [] __internal_add_timer+0x130/0x130 [255336.667952] [] ? kiblnd_post_tx_locked+0x7bb/0xa50 [ko2iblnd] [255336.676352] [] ? ptlrpc_set_wait+0x75f/0x7c0 [ptlrpc] [255336.683937] [] ? wake_up_atomic_t+0x30/0x30 [255336.690604] [] ? ptlrpc_queue_wait+0x83/0x230 [ptlrpc] [255336.698308] [] ? osp_md_read+0x478/0x890 [osp] [255336.705264] [] ? lu_object_start.isra.31+0x8b/0x120 [obdclass] [255336.713759] [] ? dt_read+0x1a/0x50 [obdclass] [255336.720570] [] ? alloc_pages_current+0x98/0x110 [255336.727590] [] ? llog_osd_next_block+0x36a/0xbc0 [obdclass] [255336.735757] [] ? kmalloc_order+0x18/0x40 [255336.742104] [] ? llog_process_thread+0x340/0x1a10 [obdclass] [255336.750388] [] ? llog_open+0x25f/0x400 [obdclass] [255336.757619] [] ? llog_cat_id2handle+0x2d7/0x620 [obdclass] [255336.765703] [] ? lodname2mdt_index+0x2f0/0x2f0 [lod] [255336.773234] [] ? llog_cat_process_common+0x119/0x420 [obdclass] [255336.781808] [] ? llog_cat_process_cb+0x239/0x250 [obdclass] [255336.789993] [] ? llog_process_thread+0x85f/0x1a10 [obdclass] [255336.798280] [] ? dt_read+0x1a/0x50 [obdclass] [255336.805131] [] ? llog_osd_read_header+0x698/0x7a0 [obdclass] [255336.813411] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [255336.821988] [] ? llog_process_or_fork+0xcf/0x520 [obdclass] [255336.830171] [] ? llog_read_header+0x56/0x2a0 [obdclass] [255336.837971] [] ? llog_cat_cancel_records+0x1c0/0x1c0 [obdclass] [255336.846546] [] ? llog_cat_process_or_fork+0x1f1/0x370 [obdclass] [255336.855241] [] ? lod_sub_prep_llog+0x24a/0x783 [lod] [255336.862740] [] ? lodname2mdt_index+0x2f0/0x2f0 [lod] [255336.870240] [] ? llog_cat_process+0x2e/0x30 [obdclass] [255336.877931] [] ? lod_sub_recovery_thread+0x519/0xc10 [lod] [255336.886007] [] ? lod_obd_set_info_async+0x960/0x960 [lod] [255336.893990] [] ? kthread+0xd1/0xe0 [255336.899733] [] ? insert_kthread_work+0x40/0x40 [255336.906648] [] ? ret_from_fork_nospec_begin+0x21/0x21 [255336.914231] [] ? insert_kthread_work+0x40/0x40 [255336.921136] tgt_recover_2 D ffff9c7de9fcc1c0 0 49685 2 0x00000080 [255336.929135] Call Trace: [255336.931968] [] schedule+0x29/0x70 [255336.937612] [] schedule_timeout+0x168/0x2d0 [255336.944231] [] ? __internal_add_timer+0x130/0x130 [255336.951479] [] ? handle_recovery_req+0x290/0x290 [ptlrpc] [255336.959509] [] target_recovery_overseer+0x108/0x750 [ptlrpc] [255336.967811] [] ? ldlm_dump_ns_write+0x90/0x90 [ptlrpc] [255336.975491] [] ? wake_up_atomic_t+0x30/0x30 [255336.982157] [] target_recovery_thread+0x68c/0x11a0 [ptlrpc] [255336.990373] [] ? replay_request_or_update.isra.23+0x8c0/0x8c0 [ptlrpc] [255336.999608] [] kthread+0xd1/0xe0 [255337.005157] [] ? insert_kthread_work+0x40/0x40 [255337.012067] [] ret_from_fork_nospec_begin+0x21/0x21 [255337.019458] [] ? insert_kthread_work+0x40/0x40 [255337.026361] kworker/u306:2 S ffff9c81e96e0000 0 50074 2 0x00000080 [255337.034376] Call Trace: [255337.037210] [] ? process_one_work+0x21a/0x440 [255337.044041] [] schedule+0x29/0x70 [255337.049685] [] worker_thread+0x1d9/0x3c0 [255337.056010] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255337.063412] [] kthread+0xd1/0xe0 [255337.068964] [] ? insert_kthread_work+0x40/0x40 [255337.075889] [] ret_from_fork_nospec_begin+0x21/0x21 [255337.083279] [] ? insert_kthread_work+0x40/0x40 [255337.090192] mdt_io00_003 S ffff9c7a6480b150 0 98882 2 0x00000080 [255337.098196] Call Trace: [255337.101030] [] ? __set_current_blocked+0x42/0x70 [255337.108128] [] schedule+0x29/0x70 [255337.113846] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255337.121436] [] ? __wake_up+0x13/0x20 [255337.127383] [] ? wake_up_atomic_t+0x30/0x30 [255337.134047] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255337.141193] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255337.149553] [] kthread+0xd1/0xe0 [255337.155100] [] ? insert_kthread_work+0x40/0x40 [255337.162004] [] ret_from_fork_nospec_begin+0x21/0x21 [255337.169393] [] ? insert_kthread_work+0x40/0x40 [255337.176296] mdt_io00_004 S ffff9c7a6480a0e0 0 98883 2 0x00000080 [255337.184285] Call Trace: [255337.187117] [] ? __set_current_blocked+0x42/0x70 [255337.194228] [] schedule+0x29/0x70 [255337.199928] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255337.207542] [] ? __wake_up+0x13/0x20 [255337.213479] [] ? wake_up_atomic_t+0x30/0x30 [255337.220151] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255337.227310] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255337.235674] [] kthread+0xd1/0xe0 [255337.241222] [] ? insert_kthread_work+0x40/0x40 [255337.248127] [] ret_from_fork_nospec_begin+0x21/0x21 [255337.255547] [] ? insert_kthread_work+0x40/0x40 [255337.262454] mdt_io01_003 S ffff9c7dec5420e0 0 98997 2 0x00000080 [255337.270478] Call Trace: [255337.273323] [] ? __set_current_blocked+0x42/0x70 [255337.280412] [] schedule+0x29/0x70 [255337.286110] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255337.293705] [] ? __wake_up+0x13/0x20 [255337.299641] [] ? wake_up_atomic_t+0x30/0x30 [255337.306310] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255337.313446] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255337.321806] [] kthread+0xd1/0xe0 [255337.327354] [] ? insert_kthread_work+0x40/0x40 [255337.334282] [] ret_from_fork_nospec_begin+0x21/0x21 [255337.341671] [] ? insert_kthread_work+0x40/0x40 [255337.348575] mdt_io01_004 S ffff9c7dec545230 0 98998 2 0x00000080 [255337.356604] Call Trace: [255337.359439] [] ? __set_current_blocked+0x42/0x70 [255337.366539] [] schedule+0x29/0x70 [255337.372243] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255337.379829] [] ? __wake_up+0x13/0x20 [255337.385777] [] ? wake_up_atomic_t+0x30/0x30 [255337.392442] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255337.399579] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255337.407946] [] kthread+0xd1/0xe0 [255337.413494] [] ? insert_kthread_work+0x40/0x40 [255337.420397] [] ret_from_fork_nospec_begin+0x21/0x21 [255337.427798] [] ? insert_kthread_work+0x40/0x40 [255337.434693] mdt_io00_005 S ffff9c7dec5441c0 0 98999 2 0x00000080 [255337.442689] Call Trace: [255337.445534] [] ? __set_current_blocked+0x42/0x70 [255337.452644] [] schedule+0x29/0x70 [255337.458337] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255337.465925] [] ? __wake_up+0x13/0x20 [255337.471864] [] ? wake_up_atomic_t+0x30/0x30 [255337.478527] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255337.485684] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255337.494046] [] kthread+0xd1/0xe0 [255337.499613] [] ? insert_kthread_work+0x40/0x40 [255337.506516] [] ret_from_fork_nospec_begin+0x21/0x21 [255337.513906] [] ? insert_kthread_work+0x40/0x40 [255337.520811] mdt_io01_005 S ffff9c7defa6e2a0 0 99267 2 0x00000080 [255337.528826] Call Trace: [255337.531663] [] ? __set_current_blocked+0x42/0x70 [255337.538763] [] schedule+0x29/0x70 [255337.544457] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255337.552041] [] ? __wake_up+0x13/0x20 [255337.557990] [] ? wake_up_atomic_t+0x30/0x30 [255337.564654] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255337.571797] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255337.580157] [] kthread+0xd1/0xe0 [255337.585708] [] ? insert_kthread_work+0x40/0x40 [255337.592613] [] ret_from_fork_nospec_begin+0x21/0x21 [255337.600001] [] ? insert_kthread_work+0x40/0x40 [255337.606905] mdt_io00_006 S ffff9c7a64680000 0 99268 2 0x00000080 [255337.614923] Call Trace: [255337.617756] [] ? __set_current_blocked+0x42/0x70 [255337.624853] [] schedule+0x29/0x70 [255337.630549] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255337.638134] [] ? __wake_up+0x13/0x20 [255337.644073] [] ? wake_up_atomic_t+0x30/0x30 [255337.650729] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255337.657882] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255337.666242] [] kthread+0xd1/0xe0 [255337.671792] [] ? insert_kthread_work+0x40/0x40 [255337.678697] [] ret_from_fork_nospec_begin+0x21/0x21 [255337.686087] [] ? insert_kthread_work+0x40/0x40 [255337.693000] mdt_io00_007 S ffff9c7a64681070 0 99269 2 0x00000080 [255337.701000] Call Trace: [255337.703846] [] ? __set_current_blocked+0x42/0x70 [255337.710945] [] schedule+0x29/0x70 [255337.716655] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255337.724242] [] ? __wake_up+0x13/0x20 [255337.730168] [] ? wake_up_atomic_t+0x30/0x30 [255337.736837] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255337.743981] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255337.752352] [] kthread+0xd1/0xe0 [255337.757898] [] ? insert_kthread_work+0x40/0x40 [255337.764814] [] ret_from_fork_nospec_begin+0x21/0x21 [255337.772205] [] ? insert_kthread_work+0x40/0x40 [255337.779140] mdt_io01_006 S ffff9c7a71238000 0 99270 2 0x00000080 [255337.787144] Call Trace: [255337.789977] [] ? __set_current_blocked+0x42/0x70 [255337.797075] [] schedule+0x29/0x70 [255337.802771] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255337.810360] [] ? __wake_up+0x13/0x20 [255337.816293] [] ? wake_up_atomic_t+0x30/0x30 [255337.822973] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255337.830110] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255337.838470] [] kthread+0xd1/0xe0 [255337.844017] [] ? insert_kthread_work+0x40/0x40 [255337.850929] [] ret_from_fork_nospec_begin+0x21/0x21 [255337.858318] [] ? insert_kthread_work+0x40/0x40 [255337.865222] mdt_io00_008 S ffff9c7a7123a0e0 0 99271 2 0x00000080 [255337.873225] Call Trace: [255337.876059] [] ? __set_current_blocked+0x42/0x70 [255337.883151] [] schedule+0x29/0x70 [255337.888848] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255337.896440] [] ? __wake_up+0x13/0x20 [255337.902377] [] ? wake_up_atomic_t+0x30/0x30 [255337.909032] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255337.916177] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255337.924559] [] kthread+0xd1/0xe0 [255337.930119] [] ? insert_kthread_work+0x40/0x40 [255337.937028] [] ret_from_fork_nospec_begin+0x21/0x21 [255337.944417] [] ? insert_kthread_work+0x40/0x40 [255337.951321] mdt_io01_007 S ffff9c7a71239070 0 99272 2 0x00000080 [255337.959323] Call Trace: [255337.962156] [] ? __set_current_blocked+0x42/0x70 [255337.969256] [] schedule+0x29/0x70 [255337.974945] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255337.982530] [] ? __wake_up+0x13/0x20 [255337.988466] [] ? wake_up_atomic_t+0x30/0x30 [255337.995133] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255338.002293] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255338.010667] [] kthread+0xd1/0xe0 [255338.016212] [] ? insert_kthread_work+0x40/0x40 [255338.023118] [] ret_from_fork_nospec_begin+0x21/0x21 [255338.030510] [] ? insert_kthread_work+0x40/0x40 [255338.037426] mdt00_015 S ffff9c7a7123c1c0 0 99335 2 0x00000080 [255338.045451] Call Trace: [255338.048284] [] ? __set_current_blocked+0x42/0x70 [255338.055382] [] schedule+0x29/0x70 [255338.061077] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255338.068664] [] ? __wake_up+0x13/0x20 [255338.074591] [] ? wake_up_atomic_t+0x30/0x30 [255338.081254] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255338.088402] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255338.096777] [] kthread+0xd1/0xe0 [255338.102326] [] ? insert_kthread_work+0x40/0x40 [255338.109244] [] ret_from_fork_nospec_begin+0x21/0x21 [255338.116637] [] ? insert_kthread_work+0x40/0x40 [255338.123559] mdt00_016 S ffff9c81eb308000 0 99339 2 0x00000080 [255338.131558] Call Trace: [255338.134416] [] ? _raw_spin_lock_irqsave+0x37/0x40 [255338.141610] [] schedule+0x29/0x70 [255338.147308] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255338.154898] [] ? __wake_up+0x13/0x20 [255338.160847] [] ? wake_up_atomic_t+0x30/0x30 [255338.167528] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255338.174667] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255338.183028] [] kthread+0xd1/0xe0 [255338.188592] [] ? insert_kthread_work+0x40/0x40 [255338.195495] [] ret_from_fork_nospec_begin+0x21/0x21 [255338.202885] [] ? insert_kthread_work+0x40/0x40 [255338.209788] mdt00_017 S ffff9c81eb30e2a0 0 99340 2 0x00000080 [255338.217795] Call Trace: [255338.220644] [] ? _raw_spin_lock_irqsave+0x37/0x40 [255338.227841] [] schedule+0x29/0x70 [255338.233540] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255338.241128] [] ? __wake_up+0x13/0x20 [255338.247077] [] ? wake_up_atomic_t+0x30/0x30 [255338.253728] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255338.260881] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255338.269244] [] kthread+0xd1/0xe0 [255338.274790] [] ? insert_kthread_work+0x40/0x40 [255338.281696] [] ret_from_fork_nospec_begin+0x21/0x21 [255338.289088] [] ? insert_kthread_work+0x40/0x40 [255338.296003] mdt00_018 S ffff9c81eb30a0e0 0 99341 2 0x00000080 [255338.304026] Call Trace: [255338.306857] [] ? __set_current_blocked+0x42/0x70 [255338.313973] [] schedule+0x29/0x70 [255338.319662] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255338.327253] [] ? __wake_up+0x13/0x20 [255338.333201] [] ? wake_up_atomic_t+0x30/0x30 [255338.339869] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255338.347029] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255338.355403] [] kthread+0xd1/0xe0 [255338.360951] [] ? insert_kthread_work+0x40/0x40 [255338.367866] [] ret_from_fork_nospec_begin+0x21/0x21 [255338.375267] [] ? insert_kthread_work+0x40/0x40 [255338.382172] mdt00_019 S ffff9c81eb30c1c0 0 99379 2 0x00000080 [255338.390171] Call Trace: [255338.393021] [] ? _raw_spin_lock_irqsave+0x37/0x40 [255338.400226] [] schedule+0x29/0x70 [255338.405908] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255338.413495] [] ? __wake_up+0x13/0x20 [255338.419443] [] ? wake_up_atomic_t+0x30/0x30 [255338.426095] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255338.433225] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255338.441586] [] kthread+0xd1/0xe0 [255338.447144] [] ? insert_kthread_work+0x40/0x40 [255338.454048] [] ret_from_fork_nospec_begin+0x21/0x21 [255338.461450] [] ? insert_kthread_work+0x40/0x40 [255338.468366] mdt00_020 S ffff9c7dd2788000 0 99453 2 0x00000080 [255338.476380] Call Trace: [255338.479225] [] ? __set_current_blocked+0x42/0x70 [255338.486314] [] schedule+0x29/0x70 [255338.492004] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255338.499598] [] ? __wake_up+0x13/0x20 [255338.505545] [] ? wake_up_atomic_t+0x30/0x30 [255338.512203] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255338.519364] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255338.527724] [] kthread+0xd1/0xe0 [255338.533272] [] ? insert_kthread_work+0x40/0x40 [255338.540177] [] ret_from_fork_nospec_begin+0x21/0x21 [255338.547576] [] ? insert_kthread_work+0x40/0x40 [255338.554481] mdt00_021 S ffff9c7dd278a0e0 0 99454 2 0x00000080 [255338.562481] Call Trace: [255338.565313] [] schedule+0x29/0x70 [255338.571013] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255338.578591] [] ? __wake_up+0x13/0x20 [255338.584525] [] ? wake_up_atomic_t+0x30/0x30 [255338.591194] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255338.598350] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255338.606723] [] kthread+0xd1/0xe0 [255338.612271] [] ? insert_kthread_work+0x40/0x40 [255338.619173] [] ret_from_fork_nospec_begin+0x21/0x21 [255338.626570] [] ? insert_kthread_work+0x40/0x40 [255338.633472] mdt00_022 S ffff9c7dd2789070 0 99456 2 0x00000080 [255338.641458] Call Trace: [255338.644302] [] ? __set_current_blocked+0x42/0x70 [255338.651421] [] schedule+0x29/0x70 [255338.657098] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255338.664684] [] ? __wake_up+0x13/0x20 [255338.670620] [] ? wake_up_atomic_t+0x30/0x30 [255338.677291] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255338.684447] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255338.692821] [] kthread+0xd1/0xe0 [255338.698380] [] ? insert_kthread_work+0x40/0x40 [255338.705298] [] ret_from_fork_nospec_begin+0x21/0x21 [255338.712689] [] ? insert_kthread_work+0x40/0x40 [255338.719598] mdt01_018 S ffff9c7debabc1c0 0 99457 2 0x00000080 [255338.727611] Call Trace: [255338.730453] [] ? _raw_spin_lock_irqsave+0x37/0x40 [255338.737646] [] schedule+0x29/0x70 [255338.743343] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255338.750928] [] ? __wake_up+0x13/0x20 [255338.756864] [] ? wake_up_atomic_t+0x30/0x30 [255338.763531] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255338.770683] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255338.779053] [] kthread+0xd1/0xe0 [255338.784600] [] ? insert_kthread_work+0x40/0x40 [255338.791506] [] ret_from_fork_nospec_begin+0x21/0x21 [255338.798909] [] ? insert_kthread_work+0x40/0x40 [255338.805814] mdt00_023 S ffff9c81eb30d230 0 99458 2 0x00000080 [255338.813823] Call Trace: [255338.816668] [] ? __set_current_blocked+0x42/0x70 [255338.823776] [] schedule+0x29/0x70 [255338.829468] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255338.837082] [] ? wake_up_atomic_t+0x30/0x30 [255338.843746] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255338.850883] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255338.859235] [] kthread+0xd1/0xe0 [255338.864784] [] ? insert_kthread_work+0x40/0x40 [255338.871687] [] ret_from_fork_nospec_begin+0x21/0x21 [255338.879077] [] ? insert_kthread_work+0x40/0x40 [255338.885983] mdt00_024 S ffff9c7de855d230 0 99459 2 0x00000080 [255338.893973] Call Trace: [255338.896820] [] ? __set_current_blocked+0x42/0x70 [255338.903918] [] schedule+0x29/0x70 [255338.909631] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255338.917242] [] ? __wake_up+0x13/0x20 [255338.923180] [] ? wake_up_atomic_t+0x30/0x30 [255338.929836] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255338.936987] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255338.945347] [] kthread+0xd1/0xe0 [255338.950914] [] ? insert_kthread_work+0x40/0x40 [255338.957817] [] ret_from_fork_nospec_begin+0x21/0x21 [255338.965206] [] ? insert_kthread_work+0x40/0x40 [255338.972116] ldlm_cn01_024 S ffff9c7da3d241c0 0 101992 2 0x00000080 [255338.980220] Call Trace: [255338.983065] [] ? _raw_spin_lock_irqsave+0x37/0x40 [255338.990261] [] schedule+0x29/0x70 [255338.995963] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255339.003550] [] ? wake_up_atomic_t+0x30/0x30 [255339.010219] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255339.017348] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255339.025699] [] kthread+0xd1/0xe0 [255339.031245] [] ? insert_kthread_work+0x40/0x40 [255339.038147] [] ret_from_fork_nospec_begin+0x21/0x21 [255339.045548] [] ? insert_kthread_work+0x40/0x40 [255339.052451] ldlm_cn01_025 S ffff9c7da3d25230 0 101993 2 0x00000080 [255339.060561] Call Trace: [255339.063396] [] ? _raw_spin_lock_irqsave+0x37/0x40 [255339.070594] [] schedule+0x29/0x70 [255339.076290] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255339.083910] [] ? _raw_spin_lock+0x20/0x30 [255339.090336] [] ? wake_up_atomic_t+0x30/0x30 [255339.097009] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255339.104147] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255339.112509] [] kthread+0xd1/0xe0 [255339.118055] [] ? insert_kthread_work+0x40/0x40 [255339.124969] [] ret_from_fork_nospec_begin+0x21/0x21 [255339.132357] [] ? insert_kthread_work+0x40/0x40 [255339.139262] mdt_out01_017 S ffff9c7da3d21070 0 102178 2 0x00000080 [255339.147372] Call Trace: [255339.150207] [] ? __set_current_blocked+0x42/0x70 [255339.157308] [] schedule+0x29/0x70 [255339.163008] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255339.170608] [] ? __wake_up+0x13/0x20 [255339.176556] [] ? wake_up_atomic_t+0x30/0x30 [255339.183219] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255339.190385] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255339.198749] [] kthread+0xd1/0xe0 [255339.204287] [] ? insert_kthread_work+0x40/0x40 [255339.211203] [] ret_from_fork_nospec_begin+0x21/0x21 [255339.218593] [] ? insert_kthread_work+0x40/0x40 [255339.225495] mdt_out01_018 S ffff9c81e6e99070 0 102699 2 0x00000080 [255339.233581] Call Trace: [255339.236428] [] ? __set_current_blocked+0x42/0x70 [255339.243524] [] schedule+0x29/0x70 [255339.249205] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255339.256792] [] ? __wake_up+0x13/0x20 [255339.262726] [] ? wake_up_atomic_t+0x30/0x30 [255339.269378] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255339.276520] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255339.284908] [] kthread+0xd1/0xe0 [255339.290458] [] ? insert_kthread_work+0x40/0x40 [255339.297372] [] ret_from_fork_nospec_begin+0x21/0x21 [255339.304761] [] ? insert_kthread_work+0x40/0x40 [255339.311665] mdt_rdpg01_012 S ffff9c81e6e9a0e0 0 102997 2 0x00000080 [255339.319779] Call Trace: [255339.322624] [] ? __set_current_blocked+0x42/0x70 [255339.329722] [] schedule+0x29/0x70 [255339.335417] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255339.343017] [] ? __wake_up+0x13/0x20 [255339.348953] [] ? wake_up_atomic_t+0x30/0x30 [255339.355624] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255339.362769] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255339.371143] [] kthread+0xd1/0xe0 [255339.376702] [] ? insert_kthread_work+0x40/0x40 [255339.383626] [] ret_from_fork_nospec_begin+0x21/0x21 [255339.391020] [] ? insert_kthread_work+0x40/0x40 [255339.397935] mdt_out01_019 S ffff9c79f5f262a0 0 103491 2 0x00000080 [255339.406023] Call Trace: [255339.408855] [] schedule+0x29/0x70 [255339.414543] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255339.422130] [] ? _raw_spin_lock+0x20/0x30 [255339.428552] [] ? wake_up_atomic_t+0x30/0x30 [255339.435202] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255339.442355] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255339.450720] [] kthread+0xd1/0xe0 [255339.456265] [] ? insert_kthread_work+0x40/0x40 [255339.463169] [] ret_from_fork_nospec_begin+0x21/0x21 [255339.470558] [] ? insert_kthread_work+0x40/0x40 [255339.477460] mdt_out01_020 S ffff9c7daaf6e2a0 0 104183 2 0x00000080 [255339.485584] Call Trace: [255339.488422] [] ? __set_current_blocked+0x42/0x70 [255339.495519] [] schedule+0x29/0x70 [255339.501226] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255339.508812] [] ? __wake_up+0x13/0x20 [255339.514745] [] ? wake_up_atomic_t+0x30/0x30 [255339.521410] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255339.528564] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255339.536932] [] kthread+0xd1/0xe0 [255339.542477] [] ? insert_kthread_work+0x40/0x40 [255339.549381] [] ret_from_fork_nospec_begin+0x21/0x21 [255339.556776] [] ? insert_kthread_work+0x40/0x40 [255339.563701] kworker/28:0 S ffff9c81e96e3150 0 113609 2 0x00000080 [255339.571840] Call Trace: [255339.574666] [] ? process_one_work+0x336/0x440 [255339.581484] [] schedule+0x29/0x70 [255339.587130] [] worker_thread+0x1d9/0x3c0 [255339.593469] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255339.600848] [] kthread+0xd1/0xe0 [255339.606395] [] ? insert_kthread_work+0x40/0x40 [255339.613298] [] ret_from_fork_nospec_begin+0x21/0x21 [255339.620686] [] ? insert_kthread_work+0x40/0x40 [255339.627610] kworker/29:2 S ffff9c81cce79070 0 123990 2 0x00000080 [255339.635707] Call Trace: [255339.638539] [] ? process_one_work+0x336/0x440 [255339.645346] [] schedule+0x29/0x70 [255339.650995] [] worker_thread+0x1d9/0x3c0 [255339.657317] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255339.664707] [] kthread+0xd1/0xe0 [255339.670263] [] ? insert_kthread_work+0x40/0x40 [255339.677175] [] ret_from_fork_nospec_begin+0x21/0x21 [255339.684565] [] ? insert_kthread_work+0x40/0x40 [255339.691468] kworker/6:2 S ffff9c7da86eb150 0 129426 2 0x00000080 [255339.699580] Call Trace: [255339.702413] [] ? process_one_work+0x21a/0x440 [255339.709218] [] schedule+0x29/0x70 [255339.714863] [] worker_thread+0x1d9/0x3c0 [255339.721202] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255339.728590] [] kthread+0xd1/0xe0 [255339.734141] [] ? insert_kthread_work+0x40/0x40 [255339.741043] [] ret_from_fork_nospec_begin+0x21/0x21 [255339.748431] [] ? insert_kthread_work+0x40/0x40 [255339.755347] kworker/0:2 S ffff9c7de7bdd230 0 134022 2 0x00000080 [255339.763451] Call Trace: [255339.766291] [] ? process_one_work+0x21a/0x440 [255339.773097] [] schedule+0x29/0x70 [255339.778741] [] worker_thread+0x1d9/0x3c0 [255339.785073] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255339.792483] [] kthread+0xd1/0xe0 [255339.798045] [] ? insert_kthread_work+0x40/0x40 [255339.804961] [] ret_from_fork_nospec_begin+0x21/0x21 [255339.812350] [] ? insert_kthread_work+0x40/0x40 [255339.819265] kworker/22:0 S ffff9c7dd369e2a0 0 139529 2 0x00000080 [255339.827377] Call Trace: [255339.830209] [] ? process_one_work+0x336/0x440 [255339.837018] [] schedule+0x29/0x70 [255339.842684] [] worker_thread+0x1d9/0x3c0 [255339.849020] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255339.856422] [] kthread+0xd1/0xe0 [255339.861968] [] ? insert_kthread_work+0x40/0x40 [255339.868897] [] ret_from_fork_nospec_begin+0x21/0x21 [255339.876288] [] ? insert_kthread_work+0x40/0x40 [255339.883189] mdt_rdpg00_011 S ffff9c7dd369a0e0 0 1425 2 0x00000080 [255339.891173] Call Trace: [255339.894007] [] ? __set_current_blocked+0x42/0x70 [255339.901106] [] schedule+0x29/0x70 [255339.906799] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255339.914377] [] ? __wake_up+0x13/0x20 [255339.920314] [] ? wake_up_atomic_t+0x30/0x30 [255339.926970] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255339.934138] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255339.942529] [] kthread+0xd1/0xe0 [255339.948075] [] ? insert_kthread_work+0x40/0x40 [255339.954998] [] ret_from_fork_nospec_begin+0x21/0x21 [255339.962389] [] ? insert_kthread_work+0x40/0x40 [255339.969291] mdt_rdpg00_012 S ffff9c7dd369b150 0 1426 2 0x00000080 [255339.977320] Call Trace: [255339.980152] [] ? _raw_spin_lock_irqsave+0x37/0x40 [255339.987345] [] schedule+0x29/0x70 [255339.993033] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255340.000620] [] ? wake_up_atomic_t+0x30/0x30 [255340.007276] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255340.014438] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255340.022801] [] kthread+0xd1/0xe0 [255340.028361] [] ? insert_kthread_work+0x40/0x40 [255340.035266] [] ret_from_fork_nospec_begin+0x21/0x21 [255340.042668] [] ? insert_kthread_work+0x40/0x40 [255340.049570] mdt_rdpg00_013 S ffff9c7b3968a0e0 0 1427 2 0x00000080 [255340.057576] Call Trace: [255340.060431] [] ? __set_current_blocked+0x42/0x70 [255340.067530] [] schedule+0x29/0x70 [255340.073226] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255340.080812] [] ? __wake_up+0x13/0x20 [255340.086751] [] ? wake_up_atomic_t+0x30/0x30 [255340.093416] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255340.100580] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255340.108942] [] kthread+0xd1/0xe0 [255340.114488] [] ? insert_kthread_work+0x40/0x40 [255340.121391] [] ret_from_fork_nospec_begin+0x21/0x21 [255340.128781] [] ? insert_kthread_work+0x40/0x40 [255340.135691] mdt_rdpg00_014 S ffff9c7dec795230 0 1489 2 0x00000080 [255340.143698] Call Trace: [255340.146543] [] ? __set_current_blocked+0x42/0x70 [255340.153640] [] schedule+0x29/0x70 [255340.159334] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255340.166919] [] ? wake_up_atomic_t+0x30/0x30 [255340.173578] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255340.180722] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255340.189097] [] kthread+0xd1/0xe0 [255340.194643] [] ? insert_kthread_work+0x40/0x40 [255340.201547] [] ret_from_fork_nospec_begin+0x21/0x21 [255340.208935] [] ? insert_kthread_work+0x40/0x40 [255340.215854] ldlm_cn00_012 S ffff9c81e847c1c0 0 2181 2 0x00000080 [255340.223881] Call Trace: [255340.226724] [] ? __set_current_blocked+0x42/0x70 [255340.233822] [] schedule+0x29/0x70 [255340.239519] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255340.247118] [] ? __wake_up+0x13/0x20 [255340.253053] [] ? wake_up_atomic_t+0x30/0x30 [255340.259720] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255340.266861] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255340.275216] [] kthread+0xd1/0xe0 [255340.280773] [] ? insert_kthread_work+0x40/0x40 [255340.287676] [] ret_from_fork_nospec_begin+0x21/0x21 [255340.295066] [] ? insert_kthread_work+0x40/0x40 [255340.301979] ldlm_bl_07 S ffff9c7deb84c1c0 0 2507 2 0x00000080 [255340.309968] Call Trace: [255340.312815] [] ? obd_stale_export_get+0x31/0x190 [obdclass] [255340.320980] [] schedule+0x29/0x70 [255340.326672] [] ldlm_bl_thread_main+0x709/0xa00 [ptlrpc] [255340.334451] [] ? wake_up_atomic_t+0x30/0x30 [255340.341100] [] ? ldlm_handle_bl_callback+0x3e0/0x3e0 [ptlrpc] [255340.349462] [] kthread+0xd1/0xe0 [255340.355007] [] ? insert_kthread_work+0x40/0x40 [255340.361909] [] ret_from_fork_nospec_begin+0x21/0x21 [255340.369311] [] ? insert_kthread_work+0x40/0x40 [255340.376215] kworker/u306:0 S ffff9c81e847e2a0 0 3392 2 0x00000080 [255340.384215] Call Trace: [255340.387047] [] ? process_one_work+0x21a/0x440 [255340.393859] [] schedule+0x29/0x70 [255340.399504] [] worker_thread+0x1d9/0x3c0 [255340.405830] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255340.413219] [] kthread+0xd1/0xe0 [255340.418767] [] ? insert_kthread_work+0x40/0x40 [255340.425672] [] ret_from_fork_nospec_begin+0x21/0x21 [255340.433059] [] ? insert_kthread_work+0x40/0x40 [255340.439961] ldlm_cb01_003 S ffff9c7d99fa1070 0 4320 2 0x00000080 [255340.447990] Call Trace: [255340.450829] [] ? __set_current_blocked+0x42/0x70 [255340.457927] [] schedule+0x29/0x70 [255340.463607] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255340.471193] [] ? __wake_up+0x13/0x20 [255340.477140] [] ? wake_up_atomic_t+0x30/0x30 [255340.483793] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255340.490945] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255340.499332] [] kthread+0xd1/0xe0 [255340.504879] [] ? insert_kthread_work+0x40/0x40 [255340.511784] [] ret_from_fork_nospec_begin+0x21/0x21 [255340.519176] [] ? insert_kthread_work+0x40/0x40 [255340.526079] ldlm_cb00_002 S ffff9c7d99fa20e0 0 4336 2 0x00000080 [255340.534087] Call Trace: [255340.536911] [] ? __set_current_blocked+0x42/0x70 [255340.544010] [] schedule+0x29/0x70 [255340.549712] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255340.557310] [] ? __wake_up+0x13/0x20 [255340.563243] [] ? wake_up_atomic_t+0x30/0x30 [255340.569894] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255340.577023] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255340.585382] [] kthread+0xd1/0xe0 [255340.590930] [] ? insert_kthread_work+0x40/0x40 [255340.597836] [] ret_from_fork_nospec_begin+0x21/0x21 [255340.605222] [] ? insert_kthread_work+0x40/0x40 [255340.612132] ldlm_cb01_004 S ffff9c7d99fa3150 0 4337 2 0x00000080 [255340.620128] Call Trace: [255340.622961] [] ? __set_current_blocked+0x42/0x70 [255340.630069] [] schedule+0x29/0x70 [255340.635758] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255340.643357] [] ? __wake_up+0x13/0x20 [255340.649315] [] ? wake_up_atomic_t+0x30/0x30 [255340.655981] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255340.663119] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255340.671493] [] kthread+0xd1/0xe0 [255340.677038] [] ? insert_kthread_work+0x40/0x40 [255340.683943] [] ret_from_fork_nospec_begin+0x21/0x21 [255340.691339] [] ? insert_kthread_work+0x40/0x40 [255340.698243] ldlm_cb01_005 S ffff9c7d99fa41c0 0 4338 2 0x00000080 [255340.706265] Call Trace: [255340.709111] [] ? __set_current_blocked+0x42/0x70 [255340.716208] [] schedule+0x29/0x70 [255340.721898] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255340.729485] [] ? __wake_up+0x13/0x20 [255340.735418] [] ? wake_up_atomic_t+0x30/0x30 [255340.742066] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255340.749222] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255340.757597] [] kthread+0xd1/0xe0 [255340.763145] [] ? insert_kthread_work+0x40/0x40 [255340.770050] [] ret_from_fork_nospec_begin+0x21/0x21 [255340.777452] [] ? insert_kthread_work+0x40/0x40 [255340.784346] ldlm_cb01_006 S ffff9c7d99fa5230 0 4451 2 0x00000080 [255340.792358] Call Trace: [255340.795192] [] ? __set_current_blocked+0x42/0x70 [255340.802289] [] schedule+0x29/0x70 [255340.807986] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255340.815586] [] ? __wake_up+0x13/0x20 [255340.821532] [] ? wake_up_atomic_t+0x30/0x30 [255340.828197] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255340.835336] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255340.843707] [] kthread+0xd1/0xe0 [255340.849253] [] ? insert_kthread_work+0x40/0x40 [255340.856168] [] ret_from_fork_nospec_begin+0x21/0x21 [255340.863556] [] ? insert_kthread_work+0x40/0x40 [255340.870458] ldlm_cb00_003 S ffff9c7d99fa62a0 0 4488 2 0x00000080 [255340.878460] Call Trace: [255340.881284] [] ? __set_current_blocked+0x42/0x70 [255340.888381] [] schedule+0x29/0x70 [255340.894083] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255340.901710] [] ? __wake_up+0x13/0x20 [255340.907637] [] ? wake_up_atomic_t+0x30/0x30 [255340.914305] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255340.921442] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255340.929808] [] kthread+0xd1/0xe0 [255340.935372] [] ? insert_kthread_work+0x40/0x40 [255340.942277] [] ret_from_fork_nospec_begin+0x21/0x21 [255340.949679] [] ? insert_kthread_work+0x40/0x40 [255340.956580] ldlm_cb00_004 S ffff9c81e96e20e0 0 4525 2 0x00000080 [255340.964586] Call Trace: [255340.967433] [] ? __set_current_blocked+0x42/0x70 [255340.974529] [] schedule+0x29/0x70 [255340.980232] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255340.987830] [] ? __wake_up+0x13/0x20 [255340.993765] [] ? wake_up_atomic_t+0x30/0x30 [255341.000414] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255341.007559] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255341.015923] [] kthread+0xd1/0xe0 [255341.021471] [] ? insert_kthread_work+0x40/0x40 [255341.028379] [] ret_from_fork_nospec_begin+0x21/0x21 [255341.035781] [] ? insert_kthread_work+0x40/0x40 [255341.042695] ldlm_cb00_005 S ffff9c81e96e41c0 0 4570 2 0x00000080 [255341.050700] Call Trace: [255341.053530] [] ? __set_current_blocked+0x42/0x70 [255341.060627] [] schedule+0x29/0x70 [255341.066323] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255341.073912] [] ? __wake_up+0x13/0x20 [255341.079849] [] ? wake_up_atomic_t+0x30/0x30 [255341.086499] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255341.093655] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255341.102016] [] kthread+0xd1/0xe0 [255341.107563] [] ? insert_kthread_work+0x40/0x40 [255341.114480] [] ret_from_fork_nospec_begin+0x21/0x21 [255341.121870] [] ? insert_kthread_work+0x40/0x40 [255341.128776] ldlm_cb01_007 S ffff9c81e96e5230 0 4610 2 0x00000080 [255341.136788] Call Trace: [255341.139622] [] ? _raw_spin_lock_irqsave+0x37/0x40 [255341.146816] [] schedule+0x29/0x70 [255341.152495] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255341.160083] [] ? __wake_up+0x13/0x20 [255341.166030] [] ? wake_up_atomic_t+0x30/0x30 [255341.172712] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255341.179849] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255341.188201] [] kthread+0xd1/0xe0 [255341.193748] [] ? insert_kthread_work+0x40/0x40 [255341.200663] [] ret_from_fork_nospec_begin+0x21/0x21 [255341.208052] [] ? insert_kthread_work+0x40/0x40 [255341.214955] ldlm_cb01_008 S ffff9c7a62931070 0 5425 2 0x00000080 [255341.222951] Call Trace: [255341.225777] [] ? __set_current_blocked+0x42/0x70 [255341.232888] [] schedule+0x29/0x70 [255341.238568] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255341.246152] [] ? __wake_up+0x13/0x20 [255341.252098] [] ? wake_up_atomic_t+0x30/0x30 [255341.258760] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255341.265901] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255341.274284] [] kthread+0xd1/0xe0 [255341.279841] [] ? insert_kthread_work+0x40/0x40 [255341.286745] [] ret_from_fork_nospec_begin+0x21/0x21 [255341.294144] [] ? insert_kthread_work+0x40/0x40 [255341.301046] ldlm_cb00_006 S ffff9c81fff30000 0 5426 2 0x00000080 [255341.309049] Call Trace: [255341.311897] [] ? __set_current_blocked+0x42/0x70 [255341.318996] [] schedule+0x29/0x70 [255341.324705] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255341.332295] [] ? __wake_up+0x13/0x20 [255341.338268] [] ? wake_up_atomic_t+0x30/0x30 [255341.344924] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255341.352063] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255341.360422] [] kthread+0xd1/0xe0 [255341.365969] [] ? insert_kthread_work+0x40/0x40 [255341.372873] [] ret_from_fork_nospec_begin+0x21/0x21 [255341.380261] [] ? insert_kthread_work+0x40/0x40 [255341.387166] kworker/20:2 S ffff9c79f6140000 0 10047 2 0x00000080 [255341.395170] Call Trace: [255341.398003] [] ? process_one_work+0x21a/0x440 [255341.404817] [] schedule+0x29/0x70 [255341.410489] [] worker_thread+0x1d9/0x3c0 [255341.416819] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255341.424217] [] kthread+0xd1/0xe0 [255341.429768] [] ? insert_kthread_work+0x40/0x40 [255341.436688] [] ret_from_fork_nospec_begin+0x21/0x21 [255341.444081] [] ? insert_kthread_work+0x40/0x40 [255341.450988] kworker/23:2 S ffff9c7d9bdac1c0 0 33760 2 0x00000080 [255341.458998] Call Trace: [255341.461830] [] ? process_one_work+0x336/0x440 [255341.468636] [] schedule+0x29/0x70 [255341.474304] [] worker_thread+0x1d9/0x3c0 [255341.480640] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255341.488027] [] kthread+0xd1/0xe0 [255341.493573] [] ? insert_kthread_work+0x40/0x40 [255341.500490] [] ret_from_fork_nospec_begin+0x21/0x21 [255341.507900] [] ? insert_kthread_work+0x40/0x40 [255341.514793] kworker/2:0 S ffff9c7a64808000 0 38694 2 0x00000080 [255341.522803] Call Trace: [255341.525640] [] ? process_one_work+0x21a/0x440 [255341.532458] [] schedule+0x29/0x70 [255341.538101] [] worker_thread+0x1d9/0x3c0 [255341.544426] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255341.551818] [] kthread+0xd1/0xe0 [255341.557370] [] ? insert_kthread_work+0x40/0x40 [255341.564278] [] ret_from_fork_nospec_begin+0x21/0x21 [255341.571678] [] ? insert_kthread_work+0x40/0x40 [255341.578581] ldlm_cb00_007 S ffff9c7d9bdae2a0 0 59695 2 0x00000080 [255341.586595] Call Trace: [255341.589427] [] ? __set_current_blocked+0x42/0x70 [255341.596529] [] schedule+0x29/0x70 [255341.602216] [] ptlrpc_wait_event+0x4c2/0x5b0 [ptlrpc] [255341.609805] [] ? __wake_up+0x13/0x20 [255341.615746] [] ? wake_up_atomic_t+0x30/0x30 [255341.622402] [] ptlrpc_main+0xa8d/0x1550 [ptlrpc] [255341.629560] [] ? ptlrpc_register_service+0xf90/0xf90 [ptlrpc] [255341.637913] [] kthread+0xd1/0xe0 [255341.643461] [] ? insert_kthread_work+0x40/0x40 [255341.650380] [] ret_from_fork_nospec_begin+0x21/0x21 [255341.657793] [] ? insert_kthread_work+0x40/0x40 [255341.664715] kworker/1:0 S ffff9c7d917ee2a0 0 66301 2 0x00000080 [255341.672737] Call Trace: [255341.675589] [] ? start_worker+0x27/0x30 [255341.681817] [] ? manage_workers.isra.26+0x189/0x2a0 [255341.689205] [] schedule+0x29/0x70 [255341.694858] [] worker_thread+0x1d9/0x3c0 [255341.701182] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255341.708570] [] kthread+0xd1/0xe0 [255341.714117] [] ? insert_kthread_work+0x40/0x40 [255341.721022] [] ret_from_fork_nospec_begin+0x21/0x21 [255341.728411] [] ? insert_kthread_work+0x40/0x40 [255341.735334] kworker/2:1 S ffff9c7d87ae8000 0 77771 2 0x00000080 [255341.743343] Call Trace: [255341.746187] [] ? process_one_work+0x336/0x440 [255341.752993] [] schedule+0x29/0x70 [255341.758636] [] worker_thread+0x1d9/0x3c0 [255341.764971] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255341.772361] [] kthread+0xd1/0xe0 [255341.777908] [] ? insert_kthread_work+0x40/0x40 [255341.784812] [] ret_from_fork_nospec_begin+0x21/0x21 [255341.792200] [] ? insert_kthread_work+0x40/0x40 [255341.799102] kworker/20:0 S ffff9c7a62930000 0 78404 2 0x00000080 [255341.807098] Call Trace: [255341.809931] [] schedule+0x29/0x70 [255341.815582] [] worker_thread+0x1d9/0x3c0 [255341.821903] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255341.829290] [] kthread+0xd1/0xe0 [255341.834857] [] ? insert_kthread_work+0x40/0x40 [255341.841760] [] ret_from_fork_nospec_begin+0x21/0x21 [255341.849179] [] ? insert_kthread_work+0x40/0x40 [255341.856075] kworker/17:1 S ffff9c7de7bd8000 0 85515 2 0x00000080 [255341.864075] Call Trace: [255341.866908] [] ? process_one_work+0x336/0x440 [255341.873722] [] schedule+0x29/0x70 [255341.879373] [] worker_thread+0x1d9/0x3c0 [255341.885695] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255341.893083] [] kthread+0xd1/0xe0 [255341.898629] [] ? insert_kthread_work+0x40/0x40 [255341.905534] [] ret_from_fork_nospec_begin+0x21/0x21 [255341.912923] [] ? insert_kthread_work+0x40/0x40 [255341.919845] kworker/5:2 S ffff9c7da54bd230 0 87194 2 0x00000080 [255341.927844] Call Trace: [255341.930674] [] ? start_worker+0x27/0x30 [255341.936902] [] ? manage_workers.isra.26+0x189/0x2a0 [255341.944299] [] schedule+0x29/0x70 [255341.949942] [] worker_thread+0x1d9/0x3c0 [255341.956266] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255341.963654] [] kthread+0xd1/0xe0 [255341.969214] [] ? insert_kthread_work+0x40/0x40 [255341.976116] [] ret_from_fork_nospec_begin+0x21/0x21 [255341.983510] [] ? insert_kthread_work+0x40/0x40 [255341.990411] kworker/26:0 S ffff9c81eccc8000 0 90676 2 0x00000080 [255341.998424] Call Trace: [255342.001255] [] ? process_one_work+0x336/0x440 [255342.008060] [] schedule+0x29/0x70 [255342.013710] [] worker_thread+0x1d9/0x3c0 [255342.020045] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255342.027434] [] kthread+0xd1/0xe0 [255342.032981] [] ? insert_kthread_work+0x40/0x40 [255342.039898] [] ret_from_fork_nospec_begin+0x21/0x21 [255342.047286] [] ? insert_kthread_work+0x40/0x40 [255342.054188] kworker/7:2 S ffff9c7a64631070 0 91306 2 0x00000080 [255342.062193] Call Trace: [255342.065027] [] ? process_one_work+0x21a/0x440 [255342.071849] [] schedule+0x29/0x70 [255342.077496] [] worker_thread+0x1d9/0x3c0 [255342.083823] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255342.091224] [] kthread+0xd1/0xe0 [255342.096779] [] ? insert_kthread_work+0x40/0x40 [255342.103682] [] ret_from_fork_nospec_begin+0x21/0x21 [255342.111072] [] ? insert_kthread_work+0x40/0x40 [255342.117973] kworker/19:2 S ffff9c7da813e2a0 0 95814 2 0x00000080 [255342.125969] Call Trace: [255342.128802] [] ? process_one_work+0x336/0x440 [255342.135610] [] schedule+0x29/0x70 [255342.141253] [] worker_thread+0x1d9/0x3c0 [255342.147586] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255342.154982] [] kthread+0xd1/0xe0 [255342.160532] [] ? insert_kthread_work+0x40/0x40 [255342.167437] [] ret_from_fork_nospec_begin+0x21/0x21 [255342.174829] [] ? insert_kthread_work+0x40/0x40 [255342.181732] kworker/11:2 S ffff9c81ecccb150 0 101009 2 0x00000080 [255342.189844] Call Trace: [255342.192676] [] ? process_one_work+0x336/0x440 [255342.199496] [] schedule+0x29/0x70 [255342.205154] [] worker_thread+0x1d9/0x3c0 [255342.211477] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255342.218878] [] kthread+0xd1/0xe0 [255342.224424] [] ? insert_kthread_work+0x40/0x40 [255342.231327] [] ret_from_fork_nospec_begin+0x21/0x21 [255342.238725] [] ? insert_kthread_work+0x40/0x40 [255342.245629] pickup S ffff9c81ccee62a0 0 104533 3307 0x00000080 [255342.253734] Call Trace: [255342.256565] [] schedule+0x29/0x70 [255342.262221] [] schedule_hrtimeout_range_clock+0xb2/0x150 [255342.270111] [] ? hrtimer_get_res+0x50/0x50 [255342.276640] [] ? schedule_hrtimeout_range_clock+0xa6/0x150 [255342.284718] [] schedule_hrtimeout_range+0x13/0x20 [255342.291913] [] ep_poll+0x23e/0x360 [255342.297654] [] ? wake_up_state+0x20/0x20 [255342.303978] [] SyS_epoll_wait+0xed/0x120 [255342.310311] [] ? system_call_after_swapgs+0xa2/0x146 [255342.317800] [] system_call_fastpath+0x25/0x2a [255342.324616] [] ? system_call_after_swapgs+0xae/0x146 [255342.332102] kworker/u304:0 S ffff9c7da5c262a0 0 105349 2 0x00000080 [255342.340230] Call Trace: [255342.343061] [] ? process_one_work+0x21a/0x440 [255342.349868] [] schedule+0x29/0x70 [255342.355512] [] worker_thread+0x1d9/0x3c0 [255342.361834] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255342.369223] [] kthread+0xd1/0xe0 [255342.374771] [] ? insert_kthread_work+0x40/0x40 [255342.381674] [] ret_from_fork_nospec_begin+0x21/0x21 [255342.389067] [] ? insert_kthread_work+0x40/0x40 [255342.395970] kworker/21:0 S ffff9c7da54ba0e0 0 106208 2 0x00000080 [255342.404100] Call Trace: [255342.406934] [] ? process_one_work+0x336/0x440 [255342.413742] [] schedule+0x29/0x70 [255342.419385] [] worker_thread+0x1d9/0x3c0 [255342.425728] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255342.433119] [] kthread+0xd1/0xe0 [255342.438666] [] ? insert_kthread_work+0x40/0x40 [255342.445569] [] ret_from_fork_nospec_begin+0x21/0x21 [255342.452957] [] ? insert_kthread_work+0x40/0x40 [255342.459860] kworker/5:1 S ffff9c7da54bc1c0 0 107771 2 0x00000080 [255342.467991] Call Trace: [255342.470822] [] ? process_one_work+0x21a/0x440 [255342.477640] [] schedule+0x29/0x70 [255342.483285] [] worker_thread+0x1d9/0x3c0 [255342.489607] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255342.496995] [] kthread+0xd1/0xe0 [255342.502542] [] ? insert_kthread_work+0x40/0x40 [255342.509444] [] ret_from_fork_nospec_begin+0x21/0x21 [255342.516845] [] ? insert_kthread_work+0x40/0x40 [255342.523760] kworker/25:0 S ffff9c81ecccc1c0 0 108777 2 0x00000080 [255342.531849] Call Trace: [255342.534683] [] ? process_one_work+0x336/0x440 [255342.541489] [] schedule+0x29/0x70 [255342.547133] [] worker_thread+0x1d9/0x3c0 [255342.553466] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255342.560867] [] kthread+0xd1/0xe0 [255342.566415] [] ? insert_kthread_work+0x40/0x40 [255342.573317] [] ret_from_fork_nospec_begin+0x21/0x21 [255342.580708] [] ? insert_kthread_work+0x40/0x40 [255342.587612] kworker/4:1 S ffff9c7da3d262a0 0 109001 2 0x00000080 [255342.595724] Call Trace: [255342.598558] [] ? process_one_work+0x21a/0x440 [255342.605365] [] schedule+0x29/0x70 [255342.611009] [] worker_thread+0x1d9/0x3c0 [255342.617330] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255342.624733] [] kthread+0xd1/0xe0 [255342.630291] [] ? insert_kthread_work+0x40/0x40 [255342.637207] [] ret_from_fork_nospec_begin+0x21/0x21 [255342.644595] [] ? insert_kthread_work+0x40/0x40 [255342.651499] kworker/6:1 S ffff9c7da54b8000 0 111030 2 0x00000080 [255342.659628] Call Trace: [255342.662459] [] schedule+0x29/0x70 [255342.668107] [] worker_thread+0x1d9/0x3c0 [255342.674431] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255342.681818] [] kthread+0xd1/0xe0 [255342.687367] [] ? insert_kthread_work+0x40/0x40 [255342.694282] [] ret_from_fork_nospec_begin+0x21/0x21 [255342.701683] [] ? insert_kthread_work+0x40/0x40 [255342.708585] kworker/0:1 S ffff9c7dec540000 0 111142 2 0x00000080 [255342.716695] Call Trace: [255342.719551] [] schedule+0x29/0x70 [255342.725187] [] worker_thread+0x1d9/0x3c0 [255342.731520] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255342.738921] [] kthread+0xd1/0xe0 [255342.744473] [] ? insert_kthread_work+0x40/0x40 [255342.751376] [] ret_from_fork_nospec_begin+0x21/0x21 [255342.758784] [] ? insert_kthread_work+0x40/0x40 [255342.765699] kworker/u304:1 S ffff9c7d917eb150 0 111179 2 0x00000080 [255342.773792] Call Trace: [255342.776644] [] ? process_one_work+0x21a/0x440 [255342.783451] [] schedule+0x29/0x70 [255342.789093] [] worker_thread+0x1d9/0x3c0 [255342.795424] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255342.802820] [] kthread+0xd1/0xe0 [255342.808370] [] ? insert_kthread_work+0x40/0x40 [255342.815274] [] ret_from_fork_nospec_begin+0x21/0x21 [255342.822665] [] ? insert_kthread_work+0x40/0x40 [255342.829568] kworker/3:1 S ffff9c7d917ec1c0 0 111291 2 0x00000080 [255342.837680] Call Trace: [255342.840521] [] ? process_one_work+0x336/0x440 [255342.847329] [] schedule+0x29/0x70 [255342.852979] [] worker_thread+0x1d9/0x3c0 [255342.859314] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255342.866713] [] kthread+0xd1/0xe0 [255342.872260] [] ? insert_kthread_work+0x40/0x40 [255342.879164] [] ret_from_fork_nospec_begin+0x21/0x21 [255342.886558] [] ? insert_kthread_work+0x40/0x40 [255342.893461] kworker/16:2 S ffff9c7a65375230 0 111371 2 0x00000080 [255342.901570] Call Trace: [255342.904425] [] ? process_one_work+0x336/0x440 [255342.911233] [] schedule+0x29/0x70 [255342.916876] [] worker_thread+0x1d9/0x3c0 [255342.923199] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255342.930586] [] kthread+0xd1/0xe0 [255342.936132] [] ? insert_kthread_work+0x40/0x40 [255342.943036] [] ret_from_fork_nospec_begin+0x21/0x21 [255342.950424] [] ? insert_kthread_work+0x40/0x40 [255342.957327] kworker/7:0 S ffff9c7a65373150 0 111631 2 0x00000080 [255342.965426] Call Trace: [255342.968255] [] schedule+0x29/0x70 [255342.973907] [] worker_thread+0x1d9/0x3c0 [255342.980231] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255342.987645] [] kthread+0xd1/0xe0 [255342.993195] [] ? insert_kthread_work+0x40/0x40 [255343.000098] [] ret_from_fork_nospec_begin+0x21/0x21 [255343.007497] [] ? insert_kthread_work+0x40/0x40 [255343.014402] kworker/4:0 S ffff9c7a653741c0 0 112451 2 0x00000080 [255343.022540] Call Trace: [255343.025373] [] schedule+0x29/0x70 [255343.031030] [] worker_thread+0x1d9/0x3c0 [255343.037362] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255343.044751] [] kthread+0xd1/0xe0 [255343.050309] [] ? insert_kthread_work+0x40/0x40 [255343.057213] [] ret_from_fork_nospec_begin+0x21/0x21 [255343.064602] [] ? insert_kthread_work+0x40/0x40 [255343.071507] kworker/1:1 S ffff9c7d98b23150 0 112526 2 0x00000080 [255343.079603] Call Trace: [255343.082450] [] ? process_one_work+0x21a/0x440 [255343.089268] [] schedule+0x29/0x70 [255343.094913] [] worker_thread+0x1d9/0x3c0 [255343.101237] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255343.108635] [] kthread+0xd1/0xe0 [255343.114189] [] ? insert_kthread_work+0x40/0x40 [255343.121104] [] ret_from_fork_nospec_begin+0x21/0x21 [255343.128492] [] ? insert_kthread_work+0x40/0x40 [255343.135396] kworker/3:2 S ffff9c7d98b241c0 0 112599 2 0x00000080 [255343.143483] Call Trace: [255343.146327] [] ? process_one_work+0x21a/0x440 [255343.153132] [] schedule+0x29/0x70 [255343.158777] [] worker_thread+0x1d9/0x3c0 [255343.165100] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255343.172501] [] kthread+0xd1/0xe0 [255343.178060] [] ? insert_kthread_work+0x40/0x40 [255343.184954] [] ret_from_fork_nospec_begin+0x21/0x21 [255343.192342] [] ? insert_kthread_work+0x40/0x40 [255343.199245] kworker/u304:2 S ffff9c7d98b21070 0 113540 2 0x00000080 [255343.207359] Call Trace: [255343.210196] [] ? process_one_work+0x21a/0x440 [255343.217001] [] schedule+0x29/0x70 [255343.222657] [] worker_thread+0x1d9/0x3c0 [255343.228979] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255343.236381] [] kthread+0xd1/0xe0 [255343.241922] [] ? insert_kthread_work+0x40/0x40 [255343.248826] [] ret_from_fork_nospec_begin+0x21/0x21 [255343.256215] [] ? insert_kthread_work+0x40/0x40 [255343.263132] kworker/18:2 S ffff9c7d98b25230 0 113640 2 0x00000080 [255343.271243] Call Trace: [255343.274075] [] ? process_one_work+0x336/0x440 [255343.280886] [] schedule+0x29/0x70 [255343.286542] [] worker_thread+0x1d9/0x3c0 [255343.292865] [] ? manage_workers.isra.26+0x2a0/0x2a0 [255343.300257] [] kthread+0xd1/0xe0 [255343.305804] [] ? insert_kthread_work+0x40/0x40 [255343.312707] [] ret_from_fork_nospec_begin+0x21/0x21 [255343.320096] [] ? insert_kthread_work+0x40/0x40 [255343.327007] sshd D ffff9c7dea47c1c0 0 113685 3039 0x00000080 [255343.335121] Call Trace: [255343.337959] [] schedule+0x29/0x70 [255343.343609] [] schedule_timeout+0x221/0x2d0 [255343.350228] [] ? put_prev_entity+0x31/0x400 [255343.356842] [] ? __switch_to+0x151/0x580 [255343.363169] [] ? try_to_wake_up+0x190/0x390 [255343.369774] [] wait_for_completion+0xfd/0x140 [255343.376581] [] ? wake_up_state+0x20/0x20 [255343.382902] [] flush_work+0x10a/0x1b0 [255343.388946] [] ? move_linked_works+0x90/0x90 [255343.395669] [] tty_flush_to_ldisc+0x15/0x20 [255343.402273] [] n_tty_poll+0x6d/0x1d0 [255343.408208] [] tty_poll+0x75/0x90 [255343.413852] [] do_select+0x3a8/0x7c0 [255343.419792] [] ? get_target_pstate_use_performance+0x8f/0xc0 [255343.428068] [] ? __pollwait+0xf0/0xf0 [255343.434111] [] ? __pollwait+0xf0/0xf0 [255343.440142] [] ? __pollwait+0xf0/0xf0 [255343.446173] [] ? __pollwait+0xf0/0xf0 [255343.452205] [] ? tracing_is_on+0x15/0x30 [255343.458529] [] ? tracing_record_cmdline+0x1d/0x120 [255343.465824] [] ? probe_sched_wakeup+0x2b/0xa0 [255343.472643] [] ? ttwu_do_wakeup+0xb5/0xe0 [255343.479060] [] ? try_to_wake_up+0x190/0x390 [255343.485676] [] ? default_wake_function+0x12/0x20 [255343.492775] [] ? __wake_up_common+0x82/0x120 [255343.499488] [] ? __wake_up_common_lock+0x91/0xc0 [255343.506585] [] core_sys_select+0x1ff/0x340 [255343.513100] [] ? __enqueue_entity+0x78/0x80 [255343.519725] [] ? put_prev_entity+0x8b/0x400 [255343.526338] [] ? pick_next_entity+0xa9/0x190 [255343.533048] [] ? set_next_entity+0x3c/0xe0 [255343.539565] [] ? __switch_to+0x151/0x580 [255343.545886] [] SyS_select+0xca/0x120 [255343.551820] [] ? system_call_after_swapgs+0xa2/0x146 [255343.559306] [] ? system_call_after_swapgs+0xae/0x146 [255343.566796] [] ? system_call_after_swapgs+0xa2/0x146 [255343.574282] [] ? system_call_after_swapgs+0xae/0x146 [255343.581769] [] system_call_fastpath+0x25/0x2a [255343.588575] [] ? system_call_after_swapgs+0xae/0x146 [255343.596058] bash R running task 0 113689 113685 0x00000088 [255343.604154] Call Trace: [255343.606986] [] sched_show_task+0xa8/0x110 [255343.613404] [] show_state_filter+0x82/0xd0 [255343.619920] [] sysrq_handle_showstate+0x10/0x20 [255343.626929] [] __handle_sysrq+0x10d/0x170 [255343.633348] [] write_sysrq_trigger+0x28/0x40 [255343.640058] [] proc_reg_write+0x40/0x80 [255343.646287] [] vfs_write+0xc0/0x1f0 [255343.652136] [] ? system_call_after_swapgs+0xae/0x146 [255343.659623] [] SyS_write+0x7f/0xf0 [255343.665364] [] ? system_call_after_swapgs+0xae/0x146 [255343.672850] [] system_call_fastpath+0x25/0x2a [255343.679666] [] ? system_call_after_swapgs+0xae/0x146 [255343.687168] Sched Debug Version: v0.11, 3.10.0-1062.9.1.el7_lustre.x86_64 #1 [255343.695136] ktime : 255361241.584569 [255343.702531] sched_clk : 255343687.166541 [255343.709920] cpu_clk : 255343687.166576 [255343.717319] jiffies : 4550028568 [255343.724130] sched_clock_stable() : 1 [255343.731817] sysctl_sched [255343.734746] .sysctl_sched_latency : 24.000000 [255343.741745] .sysctl_sched_min_granularity : 3.000000 [255343.748645] .sysctl_sched_wakeup_granularity : 4.000000 [255343.755562] .sysctl_sched_child_runs_first : 0 [255343.761786] .sysctl_sched_features : 56955 [255343.768396] .sysctl_sched_tunable_scaling : 1 (logaritmic) [255343.777656] cpu#0, 2693.549 MHz [255343.781261] .nr_running : 0 [255343.786513] .load : 0 [255343.791767] .nr_switches : 5036263 [255343.797602] .nr_load_updates : 1618000 [255343.803437] .nr_uninterruptible : 1165 [255343.808984] .next_balance : 4550.028662 [255343.815207] .curr->pid : 0 [255343.820461] .clock : 255343818.638435 [255343.827173] .cpu_load[0] : 0 [255343.832426] .cpu_load[1] : 0 [255343.837677] .cpu_load[2] : 0 [255343.842934] .cpu_load[3] : 0 [255343.848198] .cpu_load[4] : 0 [255343.853454] .avg_idle : 1000000 [255343.859300] .max_idle_balance_cost : 500000 [255343.866798] cfs_rq[0]:/ [255343.869625] .exec_clock : 0.000000 [255343.875552] .MIN_vruntime : 0.000001 [255343.881481] .min_vruntime : 87880.846225 [255343.887795] .max_vruntime : 0.000001 [255343.893723] .spread : 0.000000 [255343.899652] .spread0 : 0.000000 [255343.905579] .nr_spread_over : 0 [255343.910827] .nr_running : 0 [255343.916084] .load : 0 [255343.921334] .runnable_load_avg : 0 [255343.926588] .blocked_load_avg : 0 [255343.931844] .tg_load_avg : 0 [255343.937092] .tg_load_contrib : 0 [255343.942353] .tg_runnable_contrib : 0 [255343.947614] .tg->runnable_avg : 0 [255343.952864] .tg->cfs_bandwidth.timer_active: 0 [255343.958114] .throttled : 0 [255343.963363] .throttle_count : 0 [255343.968612] .avg->runnable_avg_sum : 12 [255343.973956] .avg->runnable_avg_period : 46884 [255343.981388] rt_rq[0]:/ [255343.984117] .rt_nr_running : 0 [255343.989366] .rt_throttled : 0 [255343.994615] .rt_time : 0.000000 [255344.000542] .rt_runtime : 950.000000 [255344.008421] runnable tasks: [255344.011633] task PID tree-key switches prio wait-time sum-exec sum-sleep [255344.023764] ---------------------------------------------------------------------------------------------------------- [255344.035801] kworker/0:0H 4 2144.652485 7 100 0.000000 0.037247 0.000000 0 / [255344.048291] ksoftirqd/0 6 87868.863933 6531 120 0.000000 214.517077 0.000000 0 / [255344.060798] migration/0 7 0.000000 1135 0 0.000000 1512.336248 0.000000 0 / [255344.073288] rcu_bh 8 100.875906 2 120 0.000000 0.001470 0.000000 0 / [255344.085772] lru-add-drain 10 104.877956 2 100 0.000000 0.002620 0.000000 0 / [255344.098247] watchdog/0 11 0.000000 63845 0 0.000000 987.997137 0.000000 0 / [255344.110745] kswapd0 190 1778.028087 4 120 0.000000 0.092708 0.000000 0 / [255344.123248] kworker/0:1H 1048 87817.576411 12586 100 0.000000 305.074714 0.000000 0 / [255344.135749] multipathd 1261 0.000000 51069 0 0.000000 1551.705364 0.000000 0 / [255344.148270] multipathd 1265 0.000000 414 0 0.000000 48.908830 0.000000 0 / [255344.160796] dbus-daemon 2343 87856.855661 285011 120 0.000000 86334.987928 0.000000 0 / [255344.173288] tuned 3310 87878.303224 255452 120 0.000000 24767.599965 0.000000 0 / [255344.185772] munged 3078 3504.161380 12 120 0.000000 2.131008 0.000000 0 / [255344.198270] kworker/u308:1 3885 3643.160699 2 100 0.000000 0.087513 0.000000 0 / [255344.210781] ptlrpc_hr00_002 5163 85479.829296 34655 120 0.000000 696.407149 0.000000 0 / [255344.223291] ptlrpc_hr00_003 5164 85478.436229 34675 120 0.000000 698.181459 0.000000 0 / [255344.235796] ptlrpcd_00_03 5201 87869.781834 119498 120 0.000000 3559.501497 0.000000 0 / [255344.248302] ldlm_bl_02 5246 87869.134215 131534 120 0.000000 4095.877661 0.000000 0 / [255344.260795] mdt00_001 5253 78712.978945 167352 120 0.000000 14302.024414 0.000000 0 / [255344.273285] mdt_rdpg00_000 5258 85471.450259 27743 120 0.000000 1340.674180 0.000000 0 / [255344.285769] mdt_attr00_000 5262 4067.467785 3 120 0.000000 0.167345 0.000000 0 / [255344.298262] mdt_attr00_001 5263 4067.526603 3 120 0.000000 0.071630 0.000000 0 / [255344.310761] osp-syn-1-3 5304 84743.752693 60877 120 0.000000 1283.029866 0.000000 0 / [255344.323290] mdt00_005 5413 87874.124844 127723 120 0.000000 10980.248583 0.000000 0 / [255344.335794] ldlm_cn00_011 18529 84818.650858 44576 120 0.000000 2244.468746 0.000000 0 / [255344.348302] osp-syn-3-2 49649 20000.213654 5 120 0.000000 0.418295 0.000000 0 / [255344.360791] osp-syn-4-2 49651 20012.153297 5 120 0.000000 0.400516 0.000000 0 / [255344.373278] mdt_io00_003 98882 83757.331177 542 120 0.000000 41.170122 0.000000 0 / [255344.385787] mdt_io00_004 98883 83757.601548 506 120 0.000000 39.395255 0.000000 0 / [255344.398283] mdt00_019 99379 84785.080927 83924 120 0.000000 7327.976318 0.000000 0 / [255344.410775] kworker/0:2 134022 87868.911966 11182 120 0.000000 400.155735 0.000000 0 / [255344.423364] mdt_rdpg00_012 1426 83148.872307 3817 120 0.000000 150.925314 0.000000 0 / [255344.435850] ldlm_bl_07 2507 87869.008466 20365 120 0.000000 409.741541 0.000000 0 / [255344.448354] ldlm_cb00_005 4570 78295.106848 1218 120 0.000000 62.272640 0.000000 0 / [255344.460855] kworker/0:1 111142 87502.603789 2 120 0.000000 0.055794 0.000000 0 / [255344.473480] kworker/u304:2 113540 87875.757264 1362 120 0.000000 41.523357 0.000000 0 / [255344.487856] cpu#1, 2693.549 MHz [255344.491475] .nr_running : 0 [255344.496728] .load : 0 [255344.501981] .nr_switches : 6487558 [255344.507818] .nr_load_updates : 5760943 [255344.513652] .nr_uninterruptible : -745 [255344.519198] .next_balance : 4550.029373 [255344.525422] .curr->pid : 0 [255344.530687] .clock : 255344530.542375 [255344.537396] .cpu_load[0] : 0 [255344.542649] .cpu_load[1] : 0 [255344.547903] .cpu_load[2] : 0 [255344.553155] .cpu_load[3] : 0 [255344.558416] .cpu_load[4] : 0 [255344.563669] .avg_idle : 1000000 [255344.569517] .max_idle_balance_cost : 500000 [255344.577018] cfs_rq[1]:/ [255344.579845] .exec_clock : 0.000000 [255344.585774] .MIN_vruntime : 0.000001 [255344.591715] .min_vruntime : 92015.230587 [255344.598030] .max_vruntime : 0.000001 [255344.603960] .spread : 0.000000 [255344.609881] .spread0 : 4134.384362 [255344.616099] .nr_spread_over : 0 [255344.621347] .nr_running : 0 [255344.626595] .load : 0 [255344.631845] .runnable_load_avg : 0 [255344.637093] .blocked_load_avg : 0 [255344.642344] .tg_load_avg : 0 [255344.647592] .tg_load_contrib : 0 [255344.652840] .tg_runnable_contrib : 0 [255344.658088] .tg->runnable_avg : 0 [255344.663346] .tg->cfs_bandwidth.timer_active: 0 [255344.668596] .throttled : 0 [255344.673844] .throttle_count : 0 [255344.679093] .avg->runnable_avg_sum : 22 [255344.684448] .avg->runnable_avg_period : 46418 [255344.691856] rt_rq[1]:/ [255344.694583] .rt_nr_running : 0 [255344.699832] .rt_throttled : 0 [255344.705093] .rt_time : 0.000000 [255344.711023] .rt_runtime : 950.000000 [255344.718893] runnable tasks: [255344.722106] task PID tree-key switches prio wait-time sum-exec sum-sleep [255344.734239] ---------------------------------------------------------------------------------------------------------- [255344.746286] systemd 1 92008.685564 207880 120 0.000000 98533.785173 0.000000 0 / [255344.758770] watchdog/1 12 -2.946501 63845 0 0.000000 1052.099516 0.000000 0 / [255344.771257] migration/1 13 0.000000 681 0 0.000000 1464.932721 0.000000 0 / [255344.783741] ksoftirqd/1 14 92002.122050 59971 120 0.000000 1154.970759 0.000000 0 / [255344.796246] kworker/1:0H 16 3452.299264 8 100 0.000000 0.031319 0.000000 0 / [255344.808751] kworker/1:1H 1050 91714.129204 69106 100 0.000000 1626.091918 0.000000 0 / [255344.821241] kdmwork-253:4 1477 3887.293428 70 120 0.000000 0.492091 0.000000 0 / [255344.833725] kdmflush 1494 3830.479645 2 100 0.000000 0.008524 0.000000 0 / [255344.846214] bioset 1497 3830.482067 2 100 0.000000 0.006873 0.000000 0 / [255344.858717] gssproxy 2488 29470.115569 106 120 0.000000 28.914052 0.000000 0 / [255344.871227] tuned 3040 90781.123719 212 120 0.000000 165.203831 0.000000 0 / [255344.883720] automount 3394 5034.450303 174 120 0.000000 142.545052 0.000000 0 / [255344.896208] automount 3437 92001.792482 13638 120 0.000000 852.845125 0.000000 0 / [255344.908716] ptlrpc_hr00_006 5167 90004.987321 34666 120 0.000000 672.533642 0.000000 0 / [255344.921221] kiblnd_sd_00_00 5187 92005.121490 2853452 120 0.000000 78223.304836 0.000000 0 / [255344.933709] lnet_discovery 5195 92003.247214 252664 120 0.000000 4964.444961 0.000000 0 / [255344.946216] ldlm_cn00_006 18342 89335.399707 46021 120 0.000000 2549.394676 0.000000 0 / [255344.958707] osp-syn-9-2 49661 29404.578010 4 120 0.000000 0.321619 0.000000 0 / [255344.971186] mdt_io00_008 99271 87842.072368 562 120 0.000000 42.083963 0.000000 0 / [255344.983672] mdt00_018 99341 92003.365105 79451 120 0.000000 6828.538991 0.000000 0 / [255344.996177] ldlm_cb00_007 59695 82727.383650 540 120 0.000000 28.579715 0.000000 0 / [255345.008673] kworker/1:0 66301 91684.198388 12415 120 0.000000 748.168863 0.000000 0 / [255345.021181] kworker/1:1 112526 92015.257207 1770 120 0.000000 110.998249 0.000000 0 / [255345.033771] kworker/u304:2 113540 92010.190810 1363 120 0.000000 41.545921 0.000000 0 / [255345.048138] cpu#2, 2693.549 MHz [255345.051742] .nr_running : 0 [255345.057008] .load : 0 [255345.062262] .nr_switches : 5655151 [255345.068108] .nr_load_updates : 5070154 [255345.073942] .nr_uninterruptible : 820 [255345.079388] .next_balance : 4550.029933 [255345.085611] .curr->pid : 0 [255345.090864] .clock : 255345090.502745 [255345.097572] .cpu_load[0] : 0 [255345.102825] .cpu_load[1] : 0 [255345.108079] .cpu_load[2] : 0 [255345.113343] .cpu_load[3] : 0 [255345.118614] .cpu_load[4] : 0 [255345.123869] .avg_idle : 1000000 [255345.129704] .max_idle_balance_cost : 500000 [255345.137212] cfs_rq[2]:/ [255345.140039] .exec_clock : 0.000000 [255345.145974] .MIN_vruntime : 0.000001 [255345.151914] .min_vruntime : 108306.591326 [255345.158328] .max_vruntime : 0.000001 [255345.164261] .spread : 0.000000 [255345.170190] .spread0 : 20425.745101 [255345.176506] .nr_spread_over : 0 [255345.181767] .nr_running : 0 [255345.187016] .load : 0 [255345.192266] .runnable_load_avg : 0 [255345.197533] .blocked_load_avg : 0 [255345.202783] .tg_load_avg : 0 [255345.208032] .tg_load_contrib : 0 [255345.213280] .tg_runnable_contrib : 0 [255345.218535] .tg->runnable_avg : 0 [255345.223780] .tg->cfs_bandwidth.timer_active: 0 [255345.229028] .throttled : 0 [255345.234278] .throttle_count : 0 [255345.239527] .avg->runnable_avg_sum : 0 [255345.244797] .avg->runnable_avg_period : 47077 [255345.252193] rt_rq[2]:/ [255345.254934] .rt_nr_running : 0 [255345.260184] .rt_throttled : 0 [255345.265434] .rt_time : 0.000000 [255345.271363] .rt_runtime : 950.000000 [255345.279250] runnable tasks: [255345.282461] task PID tree-key switches prio wait-time sum-exec sum-sleep [255345.294594] ---------------------------------------------------------------------------------------------------------- [255345.306639] kthreadd 2 107926.314607 1474 120 0.000000 82.034107 0.000000 0 / [255345.319148] watchdog/2 18 -5.938460 63843 0 0.000000 951.022424 0.000000 0 / [255345.331637] migration/2 19 0.000000 2366 0 0.000000 1001.867257 0.000000 0 / [255345.344165] ksoftirqd/2 20 107949.674452 4893 120 0.000000 154.991816 0.000000 0 / [255345.356663] kworker/2:0H 22 529.524025 9 100 0.000000 0.055420 0.000000 0 / [255345.369179] kauditd 318 108224.519931 176994 120 0.000000 6569.422513 0.000000 0 / [255345.381664] scsi_eh_5 1021 954.219997 23 120 0.000000 0.455804 0.000000 0 / [255345.394187] kworker/2:1H 1202 107902.667051 8431 100 0.000000 139.356843 0.000000 0 / [255345.406684] kdmflush 1463 625.872282 2 100 0.000000 0.007269 0.000000 0 / [255345.419204] bioset 1464 625.874375 2 100 0.000000 0.006192 0.000000 0 / [255345.431703] kdmwork-253:2 1465 706.483514 69 120 0.000000 0.626300 0.000000 0 / [255345.444227] kdmwork-253:6 1498 705.843717 35 120 0.000000 0.690460 0.000000 0 / [255345.456723] gdbus 2411 108225.143379 102361 120 0.000000 16096.642952 0.000000 0 / [255345.469199] qmgr 3312 107970.328953 1547 120 0.000000 190.591998 0.000000 0 / [255345.481694] automount 3438 108294.229000 40905 120 0.000000 1995.769923 0.000000 0 / [255345.494190] osp-syn-5-3 5315 104391.029206 60827 120 0.000000 1042.129026 0.000000 0 / [255345.506677] mdt_out00_002 5887 24173.540800 56397 120 0.000000 3793.568381 0.000000 0 / [255345.519181] kworker/u305:0 18432 108294.918758 32783 120 0.000000 2088.539542 0.000000 0 / [255345.531666] mdt_rdpg00_009 18485 102643.762422 34527 120 0.000000 1717.067980 0.000000 0 / [255345.544163] mdt00_014 18742 108306.591326 116741 120 0.000000 10007.523087 0.000000 0 / [255345.556662] osp-pre-0-2 49644 24224.919765 4 120 0.000000 0.112792 0.000000 0 / [255345.569149] osp-syn-7-2 49657 24214.922399 5 120 0.000000 0.394969 0.000000 0 / [255345.581646] mdt_io00_006 99268 103157.615342 539 120 0.000000 36.127452 0.000000 0 / [255345.594145] ldlm_cb00_006 5426 97396.621142 1022 120 0.000000 49.470042 0.000000 0 / [255345.606668] kworker/2:0 38694 108293.722656 6701 120 0.000000 233.113729 0.000000 0 / [255345.619153] kworker/2:1 77771 100015.943880 4 120 0.000000 0.130457 0.000000 0 / [255345.633454] cpu#3, 2693.549 MHz [255345.637075] .nr_running : 0 [255345.642319] .load : 0 [255345.647573] .nr_switches : 4274290 [255345.653413] .nr_load_updates : 5315435 [255345.659247] .nr_uninterruptible : -1723 [255345.664889] .next_balance : 4550.030517 [255345.671113] .curr->pid : 0 [255345.676366] .clock : 255345675.469289 [255345.683075] .cpu_load[0] : 0 [255345.688334] .cpu_load[1] : 0 [255345.693587] .cpu_load[2] : 0 [255345.698842] .cpu_load[3] : 0 [255345.704094] .cpu_load[4] : 0 [255345.709347] .avg_idle : 1000000 [255345.715194] .max_idle_balance_cost : 500000 [255345.722701] cfs_rq[3]:/ [255345.725518] .exec_clock : 0.000000 [255345.731448] .MIN_vruntime : 0.000001 [255345.737377] .min_vruntime : 119174.033971 [255345.743789] .max_vruntime : 0.000001 [255345.749718] .spread : 0.000000 [255345.755645] .spread0 : 31293.187746 [255345.761962] .nr_spread_over : 0 [255345.767212] .nr_running : 0 [255345.772460] .load : 0 [255345.777708] .runnable_load_avg : 0 [255345.782956] .blocked_load_avg : 0 [255345.788206] .tg_load_avg : 0 [255345.793455] .tg_load_contrib : 0 [255345.798704] .tg_runnable_contrib : 0 [255345.803953] .tg->runnable_avg : 0 [255345.809201] .tg->cfs_bandwidth.timer_active: 0 [255345.814466] .throttled : 0 [255345.819722] .throttle_count : 0 [255345.824972] .avg->runnable_avg_sum : 0 [255345.830221] .avg->runnable_avg_period : 47084 [255345.837616] rt_rq[3]:/ [255345.840346] .rt_nr_running : 0 [255345.845596] .rt_throttled : 0 [255345.850843] .rt_time : 0.000000 [255345.856772] .rt_runtime : 950.000000 [255345.864663] runnable tasks: [255345.867867] task PID tree-key switches prio wait-time sum-exec sum-sleep [255345.879998] ---------------------------------------------------------------------------------------------------------- [255345.892035] watchdog/3 23 -5.927604 63844 0 0.000000 966.894243 0.000000 0 / [255345.904531] migration/3 24 0.000000 2274 0 0.000000 1000.585550 0.000000 0 / [255345.917020] ksoftirqd/3 25 118295.207719 6958 120 0.000000 204.570000 0.000000 0 / [255345.929513] kworker/3:0H 27 416.879752 8 100 0.000000 0.078007 0.000000 0 / [255345.942028] kdevtmpfs 171 1267.972886 277 120 0.000000 5.129401 0.000000 0 / [255345.954532] kworker/3:1H 1200 118818.445956 19675 100 0.000000 470.547099 0.000000 0 / [255345.967043] gdbus 2494 118566.383614 29554 120 0.000000 7479.808875 0.000000 0 / [255345.979542] sssd 2418 119162.090225 8713 120 0.000000 468.594602 0.000000 0 / [255345.992049] nfsv4.0-svc 3330 23108.824190 14 120 0.000000 1.048122 0.000000 0 / [255346.004536] ptlrpc_hr00_005 5166 107774.672132 34681 120 0.000000 707.815820 0.000000 0 / [255346.017051] ptlrpc_hr00_007 5168 107774.670517 34672 120 0.000000 702.039223 0.000000 0 / [255346.029538] ptlrpcd_00_02 5200 119162.996219 112480 120 0.000000 3653.099990 0.000000 0 / [255346.042038] ptlrpcd_00_12 5210 119162.825412 112000 120 0.000000 3647.937463 0.000000 0 / [255346.054542] ldlm_cn00_001 5240 106824.589806 52191 120 0.000000 2809.943824 0.000000 0 / [255346.067037] mdt00_002 5254 106749.567646 200379 120 0.000000 17316.206139 0.000000 0 / [255346.079537] mdt_out00_001 5267 22537.618742 58752 120 0.000000 3958.428914 0.000000 0 / [255346.092041] osp-syn-0-3 5296 106701.594776 60820 120 0.000000 1076.026190 0.000000 0 / [255346.104542] osp-pre-1-3 5305 119162.208715 50299 120 0.000000 1965.842242 0.000000 0 / [255346.117030] osp-pre-8-3 5325 119162.071491 50418 120 0.000000 2260.176607 0.000000 0 / [255346.129542] osp-syn-11-3 5332 106699.772883 60873 120 0.000000 1058.387461 0.000000 0 / [255346.142041] mdt00_006 5415 119165.313196 162120 120 0.000000 13487.339280 0.000000 0 / [255346.154540] ldlm_cn00_010 18491 112588.779061 34529 120 0.000000 1924.627665 0.000000 0 / [255346.167050] osp-syn-1-2 49645 22806.845547 5 120 0.000000 0.386835 0.000000 0 / [255346.179546] osp-pre-9-2 49662 22808.951037 4 120 0.000000 0.047773 0.000000 0 / [255346.192036] osp-pre-12-2 49668 22808.949968 4 120 0.000000 0.080693 0.000000 0 / [255346.204523] mdt_io00_005 98999 102884.641954 488 120 0.000000 32.784129 0.000000 0 / [255346.217019] kworker/3:1 111291 118184.032451 5 120 0.000000 0.157841 0.000000 0 / [255346.229603] kworker/3:2 112599 119162.160302 270 120 0.000000 9.352838 0.000000 0 / [255346.243962] cpu#4, 2693.549 MHz [255346.247580] .nr_running : 0 [255346.252832] .load : 0 [255346.258098] .nr_switches : 6102844 [255346.263934] .nr_load_updates : 5441574 [255346.269770] .nr_uninterruptible : -3319 [255346.275415] .next_balance : 4550.031129 [255346.281639] .curr->pid : 0 [255346.286899] .clock : 255346286.424987 [255346.293608] .cpu_load[0] : 0 [255346.298872] .cpu_load[1] : 0 [255346.304125] .cpu_load[2] : 0 [255346.309379] .cpu_load[3] : 74 [255346.314731] .cpu_load[4] : 32 [255346.320081] .avg_idle : 1000000 [255346.325925] .max_idle_balance_cost : 500000 [255346.333440] cfs_rq[4]:/ [255346.336273] .exec_clock : 0.000000 [255346.342212] .MIN_vruntime : 0.000001 [255346.348142] .min_vruntime : 119337.364066 [255346.354554] .max_vruntime : 0.000001 [255346.360483] .spread : 0.000000 [255346.366426] .spread0 : 31456.517841 [255346.372769] .nr_spread_over : 0 [255346.378018] .nr_running : 0 [255346.383268] .load : 0 [255346.388517] .runnable_load_avg : 0 [255346.393767] .blocked_load_avg : 2 [255346.399014] .tg_load_avg : 0 [255346.404263] .tg_load_contrib : 0 [255346.409518] .tg_runnable_contrib : 0 [255346.414773] .tg->runnable_avg : 0 [255346.420020] .tg->cfs_bandwidth.timer_active: 0 [255346.425268] .throttled : 0 [255346.430517] .throttle_count : 0 [255346.435765] .avg->runnable_avg_sum : 160 [255346.441216] .avg->runnable_avg_period : 47600 [255346.448609] rt_rq[4]:/ [255346.451348] .rt_nr_running : 0 [255346.456596] .rt_throttled : 0 [255346.461860] .rt_time : 0.000000 [255346.467786] .rt_runtime : 950.000000 [255346.475667] runnable tasks: [255346.478881] task PID tree-key switches prio wait-time sum-exec sum-sleep [255346.491028] ---------------------------------------------------------------------------------------------------------- [255346.503065] watchdog/4 28 -8.926922 63844 0 0.000000 969.398784 0.000000 0 / [255346.515572] migration/4 29 0.000000 825 0 0.000000 997.444527 0.000000 0 / [255346.528072] ksoftirqd/4 30 119312.738486 18732 120 0.000000 662.385029 0.000000 0 / [255346.540566] kworker/4:0H 32 7285.204528 9 100 0.000000 0.119341 0.000000 0 / [255346.553090] jbd2/sda1-8 1116 119314.800187 46400 120 0.000000 3122.748488 0.000000 0 / [255346.565584] kworker/4:1H 2102 119314.126352 23119 100 0.000000 240.582553 0.000000 0 / [255346.578117] rs:main Q:Reg 3046 119337.364066 78605 120 0.000000 8929.312077 0.000000 0 / [255346.590608] crond 3401 119312.795091 4760 120 0.000000 573.100345 0.000000 0 / [255346.603095] ptlrpcd_00_13 5211 119312.847031 119316 120 0.000000 3580.482463 0.000000 0 / [255346.615591] ptlrpcd_00_15 5213 119312.795201 119382 120 0.000000 3609.080603 0.000000 0 / [255346.628125] mdt_out00_000 5266 8820.568911 1692 120 0.000000 102.696092 0.000000 0 / [255346.640631] ldlm_cn00_008 18357 112367.067954 44759 120 0.000000 2336.053970 0.000000 0 / [255346.653126] mdt_rdpg00_003 18473 81701.921773 18996 120 0.000000 801.793286 0.000000 0 / [255346.665615] mdt_rdpg00_007 18482 114825.729621 33808 120 0.000000 1580.190800 0.000000 0 / [255346.678111] mdt_rdpg00_008 18483 114806.485426 23000 120 0.000000 1007.181988 0.000000 0 / [255346.690601] osp-pre-6-2 49656 43571.199279 4 120 0.000000 0.084820 0.000000 0 / [255346.703085] osp-syn-11-2 49665 43581.121421 5 120 0.000000 0.409902 0.000000 0 / [255346.715570] mdt00_020 99453 119313.491489 97771 120 0.000000 8579.618735 0.000000 0 / [255346.728066] mdt_rdpg00_014 1489 111640.305027 677 120 0.000000 27.943377 0.000000 0 / [255346.740561] pickup 104533 119052.484177 57 120 0.000000 22.940235 0.000000 0 / [255346.753159] kworker/4:1 109001 119320.799380 1447 120 0.000000 287.628501 0.000000 0 / [255346.765752] kworker/4:0 112451 118658.135380 2 120 0.000000 0.045710 0.000000 0 / [255346.780151] cpu#5, 2693.549 MHz [255346.783755] .nr_running : 0 [255346.789008] .load : 0 [255346.794285] .nr_switches : 4321709 [255346.800132] .nr_load_updates : 5019851 [255346.805967] .nr_uninterruptible : 3776 [255346.811512] .next_balance : 4550.031665 [255346.817737] .curr->pid : 0 [255346.822991] .clock : 255346818.380651 [255346.829700] .cpu_load[0] : 0 [255346.834953] .cpu_load[1] : 0 [255346.840207] .cpu_load[2] : 0 [255346.845462] .cpu_load[3] : 0 [255346.850724] .cpu_load[4] : 0 [255346.856002] .avg_idle : 1000000 [255346.861838] .max_idle_balance_cost : 500000 [255346.869335] cfs_rq[5]:/ [255346.872161] .exec_clock : 0.000000 [255346.878089] .MIN_vruntime : 0.000001 [255346.884018] .min_vruntime : 106193.345582 [255346.890432] .max_vruntime : 0.000001 [255346.896354] .spread : 0.000000 [255346.902281] .spread0 : 18312.499357 [255346.908597] .nr_spread_over : 0 [255346.913856] .nr_running : 0 [255346.919107] .load : 0 [255346.924347] .runnable_load_avg : 0 [255346.929596] .blocked_load_avg : 0 [255346.934844] .tg_load_avg : 0 [255346.940095] .tg_load_contrib : 0 [255346.945345] .tg_runnable_contrib : 0 [255346.950593] .tg->runnable_avg : 0 [255346.955853] .tg->cfs_bandwidth.timer_active: 0 [255346.961094] .throttled : 0 [255346.966343] .throttle_count : 0 [255346.971596] .avg->runnable_avg_sum : 0 [255346.976845] .avg->runnable_avg_period : 46142 [255346.984247] rt_rq[5]:/ [255346.986975] .rt_nr_running : 0 [255346.992223] .rt_throttled : 0 [255346.997475] .rt_time : 0.012035 [255347.003392] .rt_runtime : 950.000000 [255347.011281] runnable tasks: [255347.014500] task PID tree-key switches prio wait-time sum-exec sum-sleep [255347.026637] ---------------------------------------------------------------------------------------------------------- [255347.038675] watchdog/5 33 -8.925672 63845 0 0.000000 897.731828 0.000000 0 / [255347.051171] migration/5 34 0.000000 2772 0 0.000000 1550.867691 0.000000 0 / [255347.063675] ksoftirqd/5 35 105837.109074 6065 120 0.000000 165.753437 0.000000 0 / [255347.076162] kworker/5:0H 37 470.957492 9 100 0.000000 0.152890 0.000000 0 / [255347.088657] kworker/u307:0 1054 462.844962 3 100 0.000000 0.015440 0.000000 0 / [255347.101158] kworker/5:1H 1240 105976.132582 7768 100 0.000000 86.685249 0.000000 0 / [255347.113656] multipathd 1259 28463.380371 105 120 0.000000 9.122420 0.000000 0 / [255347.126162] bioset 1442 552.584631 2 100 0.000000 0.007057 0.000000 0 / [255347.138663] auditd 2294 106082.621583 161913 116 0.000000 16212.544895 0.000000 0 / [255347.151176] auditd 2295 105973.890069 11090 116 0.000000 1037.042910 0.000000 0 / [255347.163682] rpc.gssd 2490 105976.224371 150 120 0.000000 15.620260 0.000000 0 / [255347.176195] systemd-logind 2597 106085.581305 248329 120 0.000000 41232.145271 0.000000 0 / [255347.188694] ptlrpcd_00_07 5205 106174.807398 119960 120 0.000000 3600.070146 0.000000 0 / [255347.201179] ptlrpcd_00_09 5207 106181.532655 119257 120 0.000000 3567.434445 0.000000 0 / [255347.213674] ldlm_cb00_000 5235 97519.113258 1149 120 0.000000 61.576743 0.000000 0 / [255347.226174] ldlm_cb00_001 5236 97519.129130 1218 120 0.000000 58.936594 0.000000 0 / [255347.238667] ldlm_cn00_002 5241 104262.183604 40745 120 0.000000 2132.694409 0.000000 0 / [255347.251172] ldlm_bl_01 5245 106157.744560 131526 120 0.000000 4681.393670 0.000000 0 / [255347.263666] mdt_io00_000 5276 102767.139409 504 120 0.000000 31.569868 0.000000 0 / [255347.276156] osp-syn-3-3 5311 103961.354399 61071 120 0.000000 1260.167451 0.000000 0 / [255347.288658] mdt00_008 18340 97833.999445 84964 120 0.000000 7539.344683 0.000000 0 / [255347.301159] mdt_rdpg00_005 18476 102265.449880 41339 120 0.000000 2025.156048 0.000000 0 / [255347.313676] ldlm_bl_04 18905 106167.229891 44417 120 0.000000 716.610386 0.000000 0 / [255347.326162] ldlm_bl_06 19847 106148.144899 42355 120 0.000000 833.077243 0.000000 0 / [255347.338667] osp-syn-6-2 49655 28469.233978 6 120 0.000000 0.362802 0.000000 0 / [255347.351165] osp-syn-15-2 49673 28480.986891 6 120 0.000000 0.413415 0.000000 0 / [255347.363675] mdt00_016 99339 106181.501286 134413 120 0.000000 11875.715027 0.000000 0 / [255347.376168] kworker/5:2 87194 105431.141553 5 120 0.000000 0.114584 0.000000 0 / [255347.388662] kworker/5:1 107771 106181.368208 359 120 0.000000 6.667177 0.000000 0 / [255347.403038] cpu#6, 2693.549 MHz [255347.406642] .nr_running : 0 [255347.411896] .load : 0 [255347.417151] .nr_switches : 4673048 [255347.423007] .nr_load_updates : 4782979 [255347.428842] .nr_uninterruptible : 666 [255347.434296] .next_balance : 4550.032288 [255347.440518] .curr->pid : 0 [255347.445772] .clock : 255347445.344974 [255347.452478] .cpu_load[0] : 0 [255347.457744] .cpu_load[1] : 0 [255347.462997] .cpu_load[2] : 0 [255347.468251] .cpu_load[3] : 0 [255347.473509] .cpu_load[4] : 0 [255347.478766] .avg_idle : 1000000 [255347.484602] .max_idle_balance_cost : 500000 [255347.492138] cfs_rq[6]:/ [255347.494963] .exec_clock : 0.000000 [255347.500890] .MIN_vruntime : 0.000001 [255347.506819] .min_vruntime : 81951.071267 [255347.513147] .max_vruntime : 0.000001 [255347.519074] .spread : 0.000000 [255347.525015] .spread0 : -5929.774958 [255347.531330] .nr_spread_over : 0 [255347.536579] .nr_running : 0 [255347.541827] .load : 0 [255347.547077] .runnable_load_avg : 0 [255347.552328] .blocked_load_avg : 0 [255347.557576] .tg_load_avg : 0 [255347.562826] .tg_load_contrib : 0 [255347.568074] .tg_runnable_contrib : 0 [255347.573322] .tg->runnable_avg : 0 [255347.578577] .tg->cfs_bandwidth.timer_active: 0 [255347.583827] .throttled : 0 [255347.589083] .throttle_count : 0 [255347.594332] .avg->runnable_avg_sum : 0 [255347.599595] .avg->runnable_avg_period : 46212 [255347.606990] rt_rq[6]:/ [255347.609730] .rt_nr_running : 0 [255347.614970] .rt_throttled : 0 [255347.620220] .rt_time : 0.000000 [255347.626148] .rt_runtime : 950.000000 [255347.634027] runnable tasks: [255347.637239] task PID tree-key switches prio wait-time sum-exec sum-sleep [255347.649379] ---------------------------------------------------------------------------------------------------------- [255347.661425] watchdog/6 38 -8.926447 63845 0 0.000000 959.564058 0.000000 0 / [255347.673932] migration/6 39 0.000000 693 0 0.000000 983.521207 0.000000 0 / [255347.686427] ksoftirqd/6 40 81897.857591 5618 120 0.000000 150.088646 0.000000 0 / [255347.698924] kworker/6:0H 42 465.886332 9 100 0.000000 0.171704 0.000000 0 / [255347.711439] kworker/6:1H 2103 81938.981048 10551 100 0.000000 192.212434 0.000000 0 / [255347.723941] gmain 2491 81940.334846 63845 120 0.000000 3201.047444 0.000000 0 / [255347.736437] sssd_nss 2577 81940.825874 112773 120 0.000000 10060.237696 0.000000 0 / [255347.748947] ptlrpc_hr00_000 5161 79449.841682 34668 120 0.000000 678.957398 0.000000 0 / [255347.761461] ptlrpcd_00_01 5199 81940.013747 119278 120 0.000000 3551.018401 0.000000 0 / [255347.773945] ptlrpcd_00_05 5203 81940.435020 119462 120 0.000000 3773.302889 0.000000 0 / [255347.786441] ptlrpcd_00_11 5209 81941.792174 119588 120 0.000000 3595.889326 0.000000 0 / [255347.798920] ptlrpcd_00_14 5212 81940.685565 112220 120 0.000000 3567.827652 0.000000 0 / [255347.811422] osp-pre-0-3 5297 81939.034923 50404 120 0.000000 1898.851398 0.000000 0 / [255347.823946] osp-pre-5-3 5316 81939.040219 50349 120 0.000000 2285.909865 0.000000 0 / [255347.836434] osp-pre-11-3 5333 81939.032937 50403 120 0.000000 2168.114563 0.000000 0 / [255347.848942] mdt00_003 5403 81939.937871 145537 120 0.000000 12450.130320 0.000000 0 / [255347.861455] kworker/u305:1 15672 68494.044956 12588 120 0.000000 813.372457 0.000000 0 / [255347.873956] ldlm_cn00_003 18335 80257.706078 48695 120 0.000000 2889.321902 0.000000 0 / [255347.886452] ldlm_cn00_005 18338 79448.348270 53195 120 0.000000 3029.945354 0.000000 0 / [255347.898982] mdt00_014 18742 81951.071267 116742 120 0.000000 10007.613531 0.000000 0 / [255347.911487] osp-pre-3-2 49642 81939.032946 11332 120 0.000000 394.957425 0.000000 0 / [255347.923993] osp-syn-2-2 49647 14545.170023 5 120 0.000000 0.344769 0.000000 0 / [255347.936488] mdt_io00_007 99269 77749.435460 552 120 0.000000 33.827001 0.000000 0 / [255347.948998] kworker/6:2 129426 81939.170830 8494 120 0.000000 327.421773 0.000000 0 / [255347.961602] kworker/6:1 111030 81388.079158 2 120 0.000000 0.030844 0.000000 0 / [255347.975980] cpu#7, 2693.549 MHz [255347.979586] .nr_running : 0 [255347.984838] .load : 0 [255347.990092] .nr_switches : 4967189 [255347.995926] .nr_load_updates : 5210857 [255348.001762] .nr_uninterruptible : 803 [255348.007210] .next_balance : 4550.032857 [255348.013446] .curr->pid : 5186 [255348.018998] .clock : 255348016.299971 [255348.025707] .cpu_load[0] : 0 [255348.030972] .cpu_load[1] : 0 [255348.036240] .cpu_load[2] : 0 [255348.041494] .cpu_load[3] : 0 [255348.046753] .cpu_load[4] : 0 [255348.052019] .avg_idle : 1000000 [255348.057853] .max_idle_balance_cost : 500000 [255348.065360] cfs_rq[7]:/ [255348.068193] .exec_clock : 0.000000 [255348.074126] .MIN_vruntime : 0.000001 [255348.080055] .min_vruntime : 85297.303074 [255348.086372] .max_vruntime : 0.000001 [255348.092315] .spread : 0.000000 [255348.098254] .spread0 : -2583.543151 [255348.104569] .nr_spread_over : 0 [255348.109819] .nr_running : 0 [255348.115069] .load : 0 [255348.120317] .runnable_load_avg : 0 [255348.125565] .blocked_load_avg : 0 [255348.130813] .tg_load_avg : 0 [255348.136062] .tg_load_contrib : 0 [255348.141311] .tg_runnable_contrib : 0 [255348.146560] .tg->runnable_avg : 0 [255348.151809] .tg->cfs_bandwidth.timer_active: 0 [255348.157059] .throttled : 0 [255348.162317] .throttle_count : 0 [255348.167565] .avg->runnable_avg_sum : 12 [255348.172924] .avg->runnable_avg_period : 47148 [255348.180328] rt_rq[7]:/ [255348.183067] .rt_nr_running : 0 [255348.188313] .rt_throttled : 0 [255348.193570] .rt_time : 0.000000 [255348.199510] .rt_runtime : 950.000000 [255348.207381] runnable tasks: [255348.210593] task PID tree-key switches prio wait-time sum-exec sum-sleep [255348.222726] ---------------------------------------------------------------------------------------------------------- [255348.234762] watchdog/7 43 -8.929149 63845 0 0.000000 951.537534 0.000000 0 / [255348.247262] migration/7 44 0.000000 756 0 0.000000 990.399103 0.000000 0 / [255348.259749] ksoftirqd/7 45 85177.949356 5859 120 0.000000 151.110663 0.000000 0 / [255348.272246] kworker/7:0H 47 457.481419 9 100 0.000000 0.164912 0.000000 0 / [255348.284758] kworker/7:1H 2104 85155.733881 8061 100 0.000000 111.840952 0.000000 0 / [255348.297254] polkitd 2341 85279.623505 101685 120 0.000000 14789.810777 0.000000 0 / [255348.309754] NetworkManager 2417 85285.746744 111179 120 0.000000 11287.582176 0.000000 0 / [255348.322242] sssd_be 2537 85285.730565 58905 120 0.000000 5366.808452 0.000000 0 / [255348.334739] sssd_pac 2580 85285.776182 51059 120 0.000000 1952.435398 0.000000 0 / [255348.347226] sshd 3039 85278.786474 19916 120 0.000000 7027.905701 0.000000 0 / [255348.359734] ptlrpc_hr00_001 5162 81435.265596 34676 120 0.000000 671.006615 0.000000 0 / [255348.372226] ptlrpc_hr00_004 5165 81436.999659 34664 120 0.000000 719.949898 0.000000 0 / [255348.384740] kiblnd_connd 5186 85288.198819 263758 120 0.000000 11285.321292 0.000000 0 / [255348.397225] ptlrpcd_00_00 5198 85286.259448 112407 120 0.000000 3574.518131 0.000000 0 / [255348.409717] ptlrpcd_00_04 5202 85287.061665 112035 120 0.000000 3602.536737 0.000000 0 / [255348.422221] ptlrpcd_00_06 5204 85285.979163 112210 120 0.000000 3605.896136 0.000000 0 / [255348.434729] ptlrpcd_00_08 5206 85286.717968 112812 120 0.000000 3554.465330 0.000000 0 / [255348.447247] ptlrpcd_00_10 5208 85286.437210 112380 120 0.000000 3621.463914 0.000000 0 / [255348.459731] mdt_io00_001 5277 78623.057872 577 120 0.000000 35.145382 0.000000 0 / [255348.472228] osp-syn-15-3 5343 80459.559468 61173 120 0.000000 1000.843903 0.000000 0 / [255348.484711] mdt00_009 18345 80491.814783 143192 120 0.000000 12194.876833 0.000000 0 / [255348.497196] ldlm_bl_03 18904 85286.003445 44449 120 0.000000 829.533223 0.000000 0 / [255348.509679] ldlm_bl_05 19448 85285.831107 43020 120 0.000000 854.381422 0.000000 0 / [255348.522180] osp-syn-0-2 49643 19169.363270 5 120 0.000000 0.478432 0.000000 0 / [255348.534670] mdt00_022 99456 85288.243413 111777 120 0.000000 9635.454258 0.000000 0 / [255348.547173] mdt00_024 99459 85282.454911 16894 120 0.000000 1602.250021 0.000000 0 / [255348.559661] mdt_rdpg00_011 1425 81440.771095 29605 120 0.000000 1462.867624 0.000000 0 / [255348.572166] mdt_rdpg00_013 1427 81432.616779 3497 120 0.000000 139.035314 0.000000 0 / [255348.584658] ldlm_cb00_002 4336 69882.406940 1890 120 0.000000 88.614691 0.000000 0 / [255348.597157] kworker/7:2 91306 85285.202440 1522 120 0.000000 59.299614 0.000000 0 / [255348.609644] kworker/u304:0 105349 85286.358311 4364 120 0.000000 130.072213 0.000000 0 / [255348.622226] kworker/u304:1 111179 85287.323224 2009 120 0.000000 57.994477 0.000000 0 / [255348.634811] kworker/7:0 111631 84812.726049 2 120 0.000000 0.035967 0.000000 0 / [255348.647399] sshd 113685 85297.225379 98 120 0.000000 44.855166 0.000000 0 / [255348.661760] cpu#8, 2693.549 MHz [255348.665364] .nr_running : 0 [255348.670616] .load : 0 [255348.675871] .nr_switches : 516053134 [255348.681920] .nr_load_updates : 33148546 [255348.687864] .nr_uninterruptible : 1219 [255348.693409] .next_balance : 4550.033547 [255348.699644] .curr->pid : 5191 [255348.705202] .clock : 255348705.178804 [255348.711908] .cpu_load[0] : 0 [255348.717162] .cpu_load[1] : 0 [255348.722417] .cpu_load[2] : 0 [255348.727670] .cpu_load[3] : 0 [255348.732924] .cpu_load[4] : 0 [255348.738191] .avg_idle : 63210 [255348.743832] .max_idle_balance_cost : 500000 [255348.751338] cfs_rq[8]:/ [255348.754162] .exec_clock : 0.000000 [255348.760089] .MIN_vruntime : 0.000001 [255348.766017] .min_vruntime : 4641810.759806 [255348.772533] .max_vruntime : 0.000001 [255348.778461] .spread : 0.000000 [255348.784391] .spread0 : 4553929.913581 [255348.790901] .nr_spread_over : 0 [255348.796150] .nr_running : 0 [255348.801398] .load : 0 [255348.806647] .runnable_load_avg : 0 [255348.811900] .blocked_load_avg : 66 [255348.817246] .tg_load_avg : 0 [255348.822507] .tg_load_contrib : 0 [255348.827755] .tg_runnable_contrib : 0 [255348.833003] .tg->runnable_avg : 0 [255348.838253] .tg->cfs_bandwidth.timer_active: 0 [255348.843501] .throttled : 0 [255348.848749] .throttle_count : 0 [255348.853997] .avg->runnable_avg_sum : 3242 [255348.859550] .avg->runnable_avg_period : 46228 [255348.866952] rt_rq[8]:/ [255348.869680] .rt_nr_running : 0 [255348.874929] .rt_throttled : 0 [255348.880177] .rt_time : 0.000000 [255348.886104] .rt_runtime : 950.000000 [255348.893983] runnable tasks: [255348.897197] task PID tree-key switches prio wait-time sum-exec sum-sleep [255348.909338] ---------------------------------------------------------------------------------------------------------- [255348.921375] watchdog/8 48 -11.957047 63844 0 0.000000 1218.520900 0.000000 1 / [255348.933861] migration/8 49 0.000000 331 0 0.000000 977.705428 0.000000 1 / [255348.946364] ksoftirqd/8 50 4641430.777496 13316 120 0.000000 327.675250 0.000000 1 / [255348.958855] kworker/8:0 51 -12.655394 19 120 0.000000 0.395031 0.000000 1 / [255348.971340] kworker/8:0H 52 269.634826 9 100 0.000000 0.068955 0.000000 1 / [255348.983866] kworker/8:1 203 4641791.862349 52760 120 0.000000 3271.727074 0.000000 1 / [255348.996381] kworker/u309:0 1056 269.479460 2 100 0.000000 0.013319 0.000000 1 / [255349.008872] kworker/8:1H 1184 4641430.746310 82844 100 0.000000 1447.922123 0.000000 1 / [255349.021383] l2arc_feed 2258 4641802.066272 255338 120 0.000000 4881.729186 0.000000 1 / [255349.033870] gssproxy 2481 4641017.235956 8717 120 0.000000 287.727289 0.000000 1 / [255349.046377] sssd_pam 2578 4641692.746898 51055 120 0.000000 1858.041698 0.000000 1 / [255349.058883] sssd_ssh 2579 4641693.349809 90979 120 0.000000 4674.642851 0.000000 1 / [255349.071382] agetty 3422 1067.679832 14 120 0.000000 8.654714 0.000000 1 / [255349.083877] kiblnd_sd_01_00 5191 4641834.801847 515439388 120 0.000000 4605901.881863 0.000000 1 / [255349.096375] monitor_thread 5196 4641803.427558 252754 120 0.000000 5520.310388 0.000000 1 / [255349.108878] mdt01_000 5255 4191960.804966 80665 120 0.000000 6177.854827 0.000000 1 / [255349.121365] mdt_rdpg01_000 5260 4071040.643198 20753 120 0.000000 679.095484 0.000000 1 / [255349.133867] osp-syn-2-3 5308 4190609.153061 59427 120 0.000000 1291.559071 0.000000 1 / [255349.146353] osp-syn-6-3 5318 4190679.881724 60298 120 0.000000 1114.271465 0.000000 1 / [255349.158853] osp-syn-7-3 5320 4190565.825931 59814 120 0.000000 1083.527801 0.000000 1 / [255349.171356] osp-syn-8-3 5324 4190579.600521 62131 120 0.000000 1020.206432 0.000000 1 / [255349.183856] mdt01_005 18331 4641660.681175 149665 120 0.000000 10759.689703 0.000000 1 / [255349.196347] mdt_rdpg01_009 18486 4071033.318807 18400 120 0.000000 904.617928 0.000000 1 / [255349.208844] mdt_rdpg01_011 18490 4203924.634579 30280 120 0.000000 1430.038256 0.000000 1 / [255349.221343] mdt_out01_015 19060 4203696.078422 171797 120 0.000000 9990.706087 0.000000 1 / [255349.233882] ldlm_cb01_004 4337 3483302.560428 32938 120 0.000000 819.328860 0.000000 1 / [255349.248152] cpu#9, 2693.549 MHz [255349.251757] .nr_running : 0 [255349.257011] .load : 0 [255349.262264] .nr_switches : 518671742 [255349.268300] .nr_load_updates : 33355458 [255349.274251] .nr_uninterruptible : 581 [255349.279700] .next_balance : 4550.034131 [255349.285923] .curr->pid : 0 [255349.291193] .clock : 255349291.188092 [255349.297900] .cpu_load[0] : 0 [255349.303170] .cpu_load[1] : 0 [255349.308425] .cpu_load[2] : 0 [255349.313689] .cpu_load[3] : 98 [255349.319038] .cpu_load[4] : 48 [255349.324388] .avg_idle : 65200 [255349.330029] .max_idle_balance_cost : 500000 [255349.337525] cfs_rq[9]:/ [255349.340350] .exec_clock : 0.000000 [255349.346279] .MIN_vruntime : 0.000001 [255349.352207] .min_vruntime : 4694791.525267 [255349.358730] .max_vruntime : 0.000001 [255349.364657] .spread : 0.000000 [255349.370584] .spread0 : 4606910.679042 [255349.377092] .nr_spread_over : 0 [255349.382347] .nr_running : 0 [255349.387603] .load : 0 [255349.392864] .runnable_load_avg : 0 [255349.398127] .blocked_load_avg : 68 [255349.403473] .tg_load_avg : 0 [255349.408723] .tg_load_contrib : 0 [255349.413986] .tg_runnable_contrib : 0 [255349.419238] .tg->runnable_avg : 0 [255349.424485] .tg->cfs_bandwidth.timer_active: 0 [255349.429734] .throttled : 0 [255349.434985] .throttle_count : 0 [255349.440239] .avg->runnable_avg_sum : 3141 [255349.445778] .avg->runnable_avg_period : 46112 [255349.453186] rt_rq[9]:/ [255349.455915] .rt_nr_running : 0 [255349.461176] .rt_throttled : 0 [255349.466428] .rt_time : 0.000000 [255349.472355] .rt_runtime : 950.000000 [255349.480233] runnable tasks: [255349.483444] task PID tree-key switches prio wait-time sum-exec sum-sleep [255349.495578] ---------------------------------------------------------------------------------------------------------- [255349.507616] watchdog/9 54 -11.928566 63844 0 0.000000 1226.057814 0.000000 1 / [255349.520100] migration/9 55 0.000000 482 0 0.000000 1142.897548 0.000000 1 / [255349.532593] ksoftirqd/9 56 4694703.880066 13213 120 0.000000 363.913403 0.000000 1 / [255349.545088] kworker/9:0H 58 716.247738 9 100 0.000000 0.044247 0.000000 1 / [255349.557577] kworker/9:1 234 4694687.442426 52442 120 0.000000 3393.780469 0.000000 1 / [255349.570064] scsi_eh_2 1015 823.634999 23 120 0.000000 0.610162 0.000000 1 / [255349.582556] kdmwork-253:0 1443 817.686987 69 120 0.000000 0.624233 0.000000 1 / [255349.595042] kdmwork-253:1 1454 4694533.984902 13325 120 0.000000 529.601693 0.000000 1 / [255349.607542] kdmwork-253:5 1481 4694702.791145 187794 120 0.000000 8057.047590 0.000000 1 / [255349.620030] kworker/9:1H 1482 4694703.849011 85541 100 0.000000 1426.395303 0.000000 1 / [255349.632536] ptlrpc_hr01_005 5174 4248859.071391 34981 120 0.000000 582.576822 0.000000 1 / [255349.645039] kiblnd_sd_01_02 5193 4694813.143607 515349904 120 0.000000 4664605.153838 0.000000 1 / [255349.657535] ptlrpcd_rcv 5197 4693376.084770 22789 120 0.000000 1095.177913 0.000000 1 / [255349.670044] ptlrpcd_01_01 5215 4694515.937072 264004 120 0.000000 10566.934141 0.000000 1 / [255349.682537] ptlrpcd_01_08 5222 4694733.768834 256631 120 0.000000 10994.481315 0.000000 1 / [255349.695043] ptlrpcd_01_12 5226 4694803.390445 256814 120 0.000000 10885.516783 0.000000 1 / [255349.707532] kmmpd-dm-5 5230 4694703.874800 101026 120 0.000000 2528.507396 0.000000 1 / [255349.720018] mdt_rdpg01_001 5261 4111297.334250 34025 120 0.000000 1339.599604 0.000000 1 / [255349.732519] mdt_out01_001 5269 2327280.401006 289885 120 0.000000 18867.219493 0.000000 1 / [255349.745049] mdt_seqm_0001 5273 1119748.619465 19 120 0.000000 0.796587 0.000000 1 / [255349.757536] mdt_io01_001 5280 4111751.525340 380 120 0.000000 23.862986 0.000000 1 / [255349.770049] osp_up0-3 5290 4115689.522659 175508 120 0.000000 6965.784939 0.000000 1 / [255349.782542] osp-pre-4-3 5314 4694687.467777 50393 120 0.000000 1873.893939 0.000000 1 / [255349.795038] dist_txn-3 5351 4115689.527199 56774 120 0.000000 2194.075569 0.000000 1 / [255349.807531] kworker/9:2 15405 41872.078959 2 120 0.000000 0.051944 0.000000 1 / [255349.820027] mdt_out01_003 18328 3510005.256350 206420 120 0.000000 11955.137092 0.000000 1 / [255349.832549] mdt_rdpg01_005 18478 4248860.947276 46659 120 0.000000 1946.243249 0.000000 1 / [255349.845033] mdt_seqm_0002 18747 1119271.847346 11 120 0.000000 0.592972 0.000000 1 / [255349.857521] kmmpd-dm-1 49632 4694535.599106 22702 120 0.000000 588.047687 0.000000 1 / [255349.870029] osp-pre-11-2 49666 77831.261299 4 120 0.000000 0.050760 0.000000 1 / [255349.882515] osp-pre-13-2 49670 77834.682161 4 120 0.000000 0.183931 0.000000 1 / [255349.895048] ldlm_cn01_024 101992 4249182.895199 45462 120 0.000000 1611.437790 0.000000 1 / [255349.907652] ldlm_cn01_025 101993 4249182.728410 33852 120 0.000000 1315.969037 0.000000 1 / [255349.922024] cpu#10, 2693.549 MHz [255349.925727] .nr_running : 0 [255349.930981] .load : 0 [255349.936235] .nr_switches : 485332126 [255349.942285] .nr_load_updates : 32114891 [255349.948219] .nr_uninterruptible : -119 [255349.953775] .next_balance : 4550.034805 [255349.959999] .curr->pid : 0 [255349.965263] .clock : 255349965.147646 [255349.971970] .cpu_load[0] : 0 [255349.977225] .cpu_load[1] : 3 [255349.982484] .cpu_load[2] : 117 [255349.987943] .cpu_load[3] : 192 [255349.993391] .cpu_load[4] : 96 [255349.998741] .avg_idle : 236071 [255350.004478] .max_idle_balance_cost : 500000 [255350.011989] cfs_rq[10]:/ [255350.014914] .exec_clock : 0.000000 [255350.020833] .MIN_vruntime : 0.000001 [255350.026760] .min_vruntime : 4605316.134826 [255350.033270] .max_vruntime : 0.000001 [255350.039198] .spread : 0.000000 [255350.045138] .spread0 : 4517435.288601 [255350.051647] .nr_spread_over : 0 [255350.056896] .nr_running : 0 [255350.062146] .load : 0 [255350.067401] .runnable_load_avg : 0 [255350.072650] .blocked_load_avg : 73 [255350.077997] .tg_load_avg : 0 [255350.083252] .tg_load_contrib : 0 [255350.088501] .tg_runnable_contrib : 0 [255350.093750] .tg->runnable_avg : 0 [255350.099000] .tg->cfs_bandwidth.timer_active: 0 [255350.104254] .throttled : 0 [255350.109504] .throttle_count : 0 [255350.114754] .avg->runnable_avg_sum : 3488 [255350.120301] .avg->runnable_avg_period : 46256 [255350.127697] rt_rq[10]:/ [255350.130522] .rt_nr_running : 0 [255350.135782] .rt_throttled : 0 [255350.141031] .rt_time : 0.000000 [255350.146958] .rt_runtime : 950.000000 [255350.154837] runnable tasks: [255350.158049] task PID tree-key switches prio wait-time sum-exec sum-sleep [255350.170186] ---------------------------------------------------------------------------------------------------------- [255350.182231] watchdog/10 59 -11.926698 63844 0 0.000000 1273.493033 0.000000 1 / [255350.194725] migration/10 60 0.000000 1179 0 0.000000 1036.958028 0.000000 1 / [255350.207225] ksoftirqd/10 61 4603428.195965 14351 120 0.000000 346.461857 0.000000 1 / [255350.219733] kworker/10:0H 63 829.233275 10 100 0.000000 0.082584 0.000000 1 / [255350.232229] khugepaged 193 4604412.796165 25538 139 0.000000 940.923588 0.000000 1 / [255350.244745] kworker/10:1 213 4605157.367261 69052 120 0.000000 4290.978754 0.000000 1 / [255350.257246] scsi_eh_4 1019 1026.968793 23 120 0.000000 0.563728 0.000000 1 / [255350.269735] zthr_procedure 2241 4605248.373998 255084 139 0.000000 4677.141525 0.000000 1 / [255350.282221] kworker/10:1H 2245 4603437.489268 82921 100 0.000000 1355.076363 0.000000 1 / [255350.294718] rsyslogd 3036 4600947.598838 431 120 0.000000 26.070359 0.000000 1 / [255350.307207] munged 3099 4603428.591652 4414 120 0.000000 2069.708457 0.000000 1 / [255350.319721] automount 3596 4577812.724668 47 120 0.000000 13.191611 0.000000 1 / [255350.332234] kiblnd_sd_01_03 5194 4605340.256403 515432364 120 0.000000 4609550.153528 0.000000 1 / [255350.344723] ptlrpcd_01_13 5227 4605307.135625 264609 120 0.000000 10565.736978 0.000000 1 / [255350.357242] lquota_wb_soake 5350 4603433.119496 4207 120 0.000000 66.127961 0.000000 1 / [255350.369731] kworker/10:0 14930 55602.701508 2 120 0.000000 0.052794 0.000000 1 / [255350.382235] mdt_out01_004 18353 4163269.471255 187194 120 0.000000 10964.922090 0.000000 1 / [255350.394719] ldlm_cn01_010 18362 4163297.933413 55868 120 0.000000 2180.381876 0.000000 1 / [255350.407238] ldlm_cn01_021 18375 4163290.426823 55708 120 0.000000 2174.545788 0.000000 1 / [255350.419738] osp-syn-10-2 49663 92669.270931 5 120 0.000000 0.301942 0.000000 1 / [255350.432240] tgt_recover_2 49685 4601871.659496 952 120 0.000000 2624.268342 0.000000 1 / [255350.444741] mdt01_018 99457 3438704.440067 115686 120 0.000000 8180.494981 0.000000 1 / [255350.459024] cpu#11, 2693.549 MHz [255350.462718] .nr_running : 1 [255350.467971] .load : 1024 [255350.473516] .nr_switches : 473110671 [255350.479545] .nr_load_updates : 31582251 [255350.485477] .nr_uninterruptible : 760 [255350.490924] .next_balance : 4550.035344 [255350.497155] .curr->pid : 0 [255350.502418] .clock : 255350502.414642 [255350.509127] .cpu_load[0] : 0 [255350.514384] .cpu_load[1] : 0 [255350.519637] .cpu_load[2] : 0 [255350.524889] .cpu_load[3] : 0 [255350.530142] .cpu_load[4] : 0 [255350.535396] .avg_idle : 1000000 [255350.541243] .max_idle_balance_cost : 500000 [255350.548741] cfs_rq[11]:/ [255350.551663] .exec_clock : 0.000000 [255350.557593] .MIN_vruntime : 0.000001 [255350.563521] .min_vruntime : 4489089.756667 [255350.570043] .max_vruntime : 0.000001 [255350.575972] .spread : 0.000000 [255350.581900] .spread0 : 4401208.910442 [255350.588410] .nr_spread_over : 0 [255350.593660] .nr_running : 0 [255350.598908] .load : 0 [255350.604159] .runnable_load_avg : 0 [255350.609408] .blocked_load_avg : 0 [255350.614657] .tg_load_avg : 0 [255350.619904] .tg_load_contrib : 0 [255350.625154] .tg_runnable_contrib : 0 [255350.630402] .tg->runnable_avg : 0 [255350.635662] .tg->cfs_bandwidth.timer_active: 0 [255350.640911] .throttled : 0 [255350.646172] .throttle_count : 0 [255350.651421] .avg->runnable_avg_sum : 147 [255350.656864] .avg->runnable_avg_period : 46789 [255350.664258] rt_rq[11]:/ [255350.667085] .rt_nr_running : 0 [255350.672333] .rt_throttled : 0 [255350.677582] .rt_time : 0.000000 [255350.683521] .rt_runtime : 950.000000 [255350.691403] runnable tasks: [255350.694615] task PID tree-key switches prio wait-time sum-exec sum-sleep [255350.706746] ---------------------------------------------------------------------------------------------------------- [255350.718784] watchdog/11 64 -11.929024 63845 0 0.000000 1266.032178 0.000000 1 / [255350.731270] migration/11 65 0.000000 877 0 0.000000 1184.742498 0.000000 1 / [255350.743768] ksoftirqd/11 66 4487695.007799 13932 120 0.000000 343.469550 0.000000 1 / [255350.756276] kworker/11:0H 68 1168.136858 9 100 0.000000 0.060331 0.000000 1 / [255350.768772] kworker/11:1 254 4489073.662325 55631 120 0.000000 3383.368074 0.000000 1 / [255350.781277] scsi_eh_7 1025 1513.759250 23 120 0.000000 0.655513 0.000000 1 / [255350.793782] systemd-journal 1203 4489089.756667 81556 120 0.000000 39758.967155 0.000000 1 / [255350.806272] kipmi0 1349 1085.380636 26 139 0.000000 35.420964 0.000000 1 / [255350.818786] kworker/11:1H 2101 4488143.740818 90275 100 0.000000 1497.626304 0.000000 1 / [255350.831306] dbuf_evict 2243 4489078.435715 255105 139 0.000000 4415.478970 0.000000 1 / [255350.843804] master 3307 4489066.365134 13683 120 0.000000 1040.348944 0.000000 1 / [255350.856295] automount 3592 1712.275983 6 120 0.000000 2.458950 0.000000 1 / [255350.868798] ptlrpcd_01_03 5217 4488921.758939 264659 120 0.000000 10544.830193 0.000000 1 / [255350.881295] ptlrpcd_01_10 5224 4489066.353217 256703 120 0.000000 10930.373659 0.000000 1 / [255350.893788] ldlm_cb01_000 5237 3352482.861122 35451 120 0.000000 954.576155 0.000000 1 / [255350.906291] osp-pre-12-3 5335 4489066.213836 50389 120 0.000000 1934.142424 0.000000 1 / [255350.918777] mdt01_009 18346 1164463.037910 29568 120 0.000000 2510.631049 0.000000 1 / [255350.931272] ldlm_cn01_007 18356 4059357.002306 58399 120 0.000000 2252.116120 0.000000 1 / [255350.943759] mdt01_014 18364 4044951.256758 98606 120 0.000000 6770.280421 0.000000 1 / [255350.956245] mdt01_015 18377 4488895.953214 146749 120 0.000000 10246.475483 0.000000 1 / [255350.968731] mdt_out01_010 18739 4059090.561021 187532 120 0.000000 10702.368396 0.000000 1 / [255350.981236] mdt01_016 18741 4045004.546939 142088 120 0.000000 10396.753524 0.000000 1 / [255350.993720] mdt_out01_012 18745 4489073.858159 255698 120 0.000000 15258.618853 0.000000 1 / [255351.006204] osp-pre-1-2 49640 4488934.975748 11326 120 0.000000 370.696709 0.000000 1 / [255351.018700] osp-syn-8-2 49659 62825.045039 4 120 0.000000 0.327251 0.000000 1 / [255351.031223] osp-syn-13-2 49669 62826.474589 5 120 0.000000 0.493911 0.000000 1 / [255351.043711] mdt_io01_005 99267 3927131.712445 427 120 0.000000 31.398302 0.000000 1 / [255351.056198] ldlm_cb01_007 4610 3352474.628078 31422 120 0.000000 788.463356 0.000000 1 / [255351.068704] kworker/11:2 101009 4181144.554320 4 120 0.000000 0.020588 0.000000 1 / [255351.083064] cpu#12, 2693.549 MHz [255351.086769] .nr_running : 5 [255351.092027] .load : 3072 [255351.097573] .nr_switches : 494298898 [255351.103613] .nr_load_updates : 32274979 [255351.109546] .nr_uninterruptible : 412 [255351.115020] .next_balance : 4550.036061 [255351.121243] .curr->pid : 113689 [255351.126985] .clock : 255279694.513109 [255351.133706] .cpu_load[0] : 3072 [255351.139251] .cpu_load[1] : 3072 [255351.144794] .cpu_load[2] : 3072 [255351.150341] .cpu_load[3] : 3072 [255351.155888] .cpu_load[4] : 3072 [255351.161433] .avg_idle : 1000000 [255351.167269] .max_idle_balance_cost : 500000 [255351.174767] cfs_rq[12]:/ [255351.177690] .exec_clock : 0.000000 [255351.183618] .MIN_vruntime : 4539343.159476 [255351.190128] .min_vruntime : 4539355.159476 [255351.196648] .max_vruntime : 4539343.159476 [255351.203158] .spread : 0.000000 [255351.209098] .spread0 : 4451474.313251 [255351.215609] .nr_spread_over : 0 [255351.220865] .nr_running : 3 [255351.226127] .load : 3072 [255351.231667] .runnable_load_avg : 199 [255351.237115] .blocked_load_avg : 0 [255351.242366] .tg_load_avg : 0 [255351.247626] .tg_load_contrib : 0 [255351.252876] .tg_runnable_contrib : 0 [255351.258124] .tg->runnable_avg : 0 [255351.263373] .tg->cfs_bandwidth.timer_active: 0 [255351.268624] .throttled : 0 [255351.273873] .throttle_count : 0 [255351.279121] .avg->runnable_avg_sum : 9328 [255351.284661] .avg->runnable_avg_period : 47441 [255351.292062] rt_rq[12]:/ [255351.294886] .rt_nr_running : 1 [255351.300134] .rt_throttled : 0 [255351.305383] .rt_time : 0.000000 [255351.311321] .rt_runtime : 950.000000 [255351.319190] runnable tasks: [255351.322401] task PID tree-key switches prio wait-time sum-exec sum-sleep [255351.334545] ---------------------------------------------------------------------------------------------------------- [255351.346583] watchdog/12 69 -11.930146 63827 0 0.000000 1213.529662 0.000000 1 / [255351.359093] migration/12 70 0.000000 352 0 0.000000 982.437381 0.000000 1 / [255351.371582] ksoftirqd/12 71 4539343.159476 14108 120 0.000000 367.563815 0.000000 1 / [255351.384088] kworker/12:0 72 -8.910352 21 120 0.000000 0.140274 0.000000 1 / [255351.396585] kworker/12:0H 73 595.157867 9 100 0.000000 0.053758 0.000000 1 / [255351.409078] kworker/12:1 235 4539343.159476 54247 120 0.000000 3310.157904 0.000000 1 / [255351.421579] scsi_eh_6 1023 622.908617 23 120 0.000000 0.352289 0.000000 1 / [255351.434073] lvmetad 1230 252.575440 4 120 0.000000 6.687542 0.000000 1 / [255351.446557] systemd-udevd 1267 4515121.186357 1372 120 0.000000 1447.712980 0.000000 1 / [255351.459066] kworker/12:1H 2107 4537705.990875 96336 100 0.000000 1605.340275 0.000000 1 / [255351.471572] JS Sour~ Thread 2414 609.234397 7 120 0.000000 0.278944 0.000000 1 / [255351.484067] zed 2415 622.188950 7 120 0.000000 15.159912 0.000000 1 / [255351.496571] zed 2469 85623.439469 26 120 0.000000 3.618751 0.000000 1 / [255351.509082] ldlm_cn01_001 5243 4121868.255159 51625 120 0.000000 2005.791411 0.000000 1 / [255351.521576] mdt_io01_002 5281 3987977.721408 389 120 0.000000 32.173144 0.000000 1 / [255351.534091] osp-syn-10-3 5330 4106456.117742 59665 120 0.000000 1108.036083 0.000000 1 / [255351.546579] osp-syn-14-3 5339 4106666.101901 60836 120 0.000000 1114.411580 0.000000 1 / [255351.559077] mdt01_008 18344 4108735.395378 136287 120 0.000000 10048.840056 0.000000 1 / [255351.571565] mdt01_010 18348 3987931.182494 155975 120 0.000000 10934.501093 0.000000 1 / [255351.584062] ldlm_cn01_018 18372 4121376.110477 74080 120 0.000000 2890.252592 0.000000 1 / [255351.596565] mdt_rdpg01_003 18474 3987452.866861 29730 120 0.000000 1046.104154 0.000000 1 / [255351.609077] mdt_rdpg01_007 18481 2343990.457690 17576 120 0.000000 628.887184 0.000000 1 / [255351.621573] mdt_out01_008 18585 4121275.052300 193505 120 0.000000 11394.220819 0.000000 1 / [255351.634066] mdt01_017 18743 4108737.284380 122303 120 0.000000 9445.212506 0.000000 1 / [255351.646570] mdt_out01_013 18746 3408968.402404 215219 120 0.000000 12708.202392 0.000000 1 / [255351.659055] mdt_out01_014 19059 4121469.589746 180779 120 0.000000 10511.848324 0.000000 1 / [255351.671568] jbd2/dm-1-8 49633 86316.036991 15 120 0.000000 1.979957 0.000000 1 / [255351.684052] osp-syn-5-2 49653 85701.845543 5 120 0.000000 0.427572 0.000000 1 / [255351.696567] R bash 113689 4539353.712447 61 120 0.000000 45.505781 0.000000 1 / [255351.710918] cpu#13, 2693.549 MHz [255351.714619] .nr_running : 0 [255351.719872] .load : 0 [255351.725133] .nr_switches : 506595810 [255351.731163] .nr_load_updates : 32739635 [255351.737093] .nr_uninterruptible : 292 [255351.742545] .next_balance : 4550.036594 [255351.748768] .curr->pid : 5194 [255351.754314] .clock : 255351754.141906 [255351.761023] .cpu_load[0] : 1024 [255351.766567] .cpu_load[1] : 16 [255351.771927] .cpu_load[2] : 274 [255351.777376] .cpu_load[3] : 85 [255351.782727] .cpu_load[4] : 138 [255351.788188] .avg_idle : 80521 [255351.793845] .max_idle_balance_cost : 500000 [255351.801341] cfs_rq[13]:/ [255351.804264] .exec_clock : 0.000000 [255351.810191] .MIN_vruntime : 0.000001 [255351.816120] .min_vruntime : 4601397.511676 [255351.822638] .max_vruntime : 0.000001 [255351.828577] .spread : 0.000000 [255351.834498] .spread0 : 4513516.665451 [255351.841005] .nr_spread_over : 0 [255351.846254] .nr_running : 0 [255351.851502] .load : 0 [255351.856750] .runnable_load_avg : 0 [255351.861999] .blocked_load_avg : 78 [255351.867346] .tg_load_avg : 0 [255351.872595] .tg_load_contrib : 0 [255351.877845] .tg_runnable_contrib : 0 [255351.883095] .tg->runnable_avg : 0 [255351.888356] .tg->cfs_bandwidth.timer_active: 0 [255351.893604] .throttled : 0 [255351.898853] .throttle_count : 0 [255351.904113] .avg->runnable_avg_sum : 3634 [255351.909662] .avg->runnable_avg_period : 46514 [255351.917066] rt_rq[13]:/ [255351.919891] .rt_nr_running : 0 [255351.925140] .rt_throttled : 0 [255351.930390] .rt_time : 0.000000 [255351.936320] .rt_runtime : 950.000000 [255351.944202] runnable tasks: [255351.947413] task PID tree-key switches prio wait-time sum-exec sum-sleep [255351.959547] ---------------------------------------------------------------------------------------------------------- [255351.971586] watchdog/13 74 -11.926308 63845 0 0.000000 1231.776565 0.000000 1 / [255351.984063] migration/13 75 0.000000 305 0 0.000000 1001.036575 0.000000 1 / [255351.996561] ksoftirqd/13 76 4595768.438431 12989 120 0.000000 335.839441 0.000000 1 / [255352.009052] kworker/13:0 77 -8.884881 21 120 0.000000 0.165925 0.000000 1 / [255352.021551] kworker/13:0H 78 1402.791721 9 100 0.000000 0.059356 0.000000 1 / [255352.034056] kworker/13:1 236 4601331.982669 52436 120 0.000000 3237.475141 0.000000 1 / [255352.046550] kworker/13:1H 2100 4597947.532757 79480 100 0.000000 1328.626382 0.000000 1 / [255352.059051] rpc.statd 3073 1485.439253 13 120 0.000000 20.062742 0.000000 1 / [255352.071551] kiblnd_sd_01_03 5194 4601418.734264 515449516 120 0.000000 4609687.191615 0.000000 1 / [255352.084040] ptlrpcd_01_14 5228 4601280.547814 255599 120 0.000000 10791.977222 0.000000 1 / [255352.096526] ldlm_cb01_001 5238 3453370.908885 30330 120 0.000000 806.148356 0.000000 1 / [255352.109016] mdt01_001 5256 4600489.199311 137591 120 0.000000 9693.332235 0.000000 1 / [255352.121556] lquota_wb_soake 5349 4598646.910620 4207 120 0.000000 84.281741 0.000000 1 / [255352.134062] mdt01_011 18349 4600489.228206 126835 120 0.000000 9142.672425 0.000000 1 / [255352.146551] ldlm_cn01_008 18359 4174548.223554 50202 120 0.000000 2036.548704 0.000000 1 / [255352.159059] ldlm_cn01_011 18363 4174548.227886 62148 120 0.000000 2430.318282 0.000000 1 / [255352.171570] mdt_out01_007 18577 3452103.562385 153882 120 0.000000 9126.509661 0.000000 1 / [255352.184063] mdt_out01_016 19846 3452100.746664 125053 120 0.000000 7078.747768 0.000000 1 / [255352.196561] osp-pre-4-2 49652 69091.502515 4 120 0.000000 0.201858 0.000000 1 / [255352.209057] osp-syn-14-2 49671 68849.597185 5 120 0.000000 0.337059 0.000000 1 / [255352.221548] lquota_wb_soake 49678 4597370.688734 947 120 0.000000 15.257292 0.000000 1 / [255352.234066] ldlm_cb01_006 4451 4042318.311535 36473 120 0.000000 1047.707487 0.000000 1 / [255352.248358] cpu#14, 2693.549 MHz [255352.252082] .nr_running : 0 [255352.257344] .load : 0 [255352.262594] .nr_switches : 511482406 [255352.268624] .nr_load_updates : 32921664 [255352.274557] .nr_uninterruptible : 306 [255352.280004] .next_balance : 4550.037132 [255352.286227] .curr->pid : 0 [255352.291480] .clock : 255352291.446966 [255352.298189] .cpu_load[0] : 0 [255352.303444] .cpu_load[1] : 0 [255352.308697] .cpu_load[2] : 0 [255352.313951] .cpu_load[3] : 8 [255352.319203] .cpu_load[4] : 24 [255352.324564] .avg_idle : 73758 [255352.330206] .max_idle_balance_cost : 500000 [255352.337709] cfs_rq[14]:/ [255352.340632] .exec_clock : 0.000000 [255352.346560] .MIN_vruntime : 0.000001 [255352.352487] .min_vruntime : 4582558.594274 [255352.359029] .max_vruntime : 0.000001 [255352.364957] .spread : 0.000000 [255352.370892] .spread0 : 4494677.748049 [255352.377403] .nr_spread_over : 0 [255352.382643] .nr_running : 0 [255352.387903] .load : 0 [255352.393149] .runnable_load_avg : 0 [255352.398397] .blocked_load_avg : 64 [255352.403741] .tg_load_avg : 0 [255352.409012] .tg_load_contrib : 0 [255352.414259] .tg_runnable_contrib : 0 [255352.419509] .tg->runnable_avg : 0 [255352.424766] .tg->cfs_bandwidth.timer_active: 0 [255352.430014] .throttled : 0 [255352.435271] .throttle_count : 0 [255352.440520] .avg->runnable_avg_sum : 3079 [255352.446072] .avg->runnable_avg_period : 46456 [255352.453468] rt_rq[14]:/ [255352.456292] .rt_nr_running : 0 [255352.461543] .rt_throttled : 0 [255352.466792] .rt_time : 0.000000 [255352.472719] .rt_runtime : 950.000000 [255352.480596] runnable tasks: [255352.483809] task PID tree-key switches prio wait-time sum-exec sum-sleep [255352.495943] ---------------------------------------------------------------------------------------------------------- [255352.507987] watchdog/14 79 -11.925194 63845 0 0.000000 1231.907444 0.000000 1 / [255352.520497] migration/14 80 0.000000 440 0 0.000000 979.463580 0.000000 1 / [255352.533011] ksoftirqd/14 81 4581683.770448 13670 120 0.000000 379.525401 0.000000 1 / [255352.545504] kworker/14:0 82 38226.863155 25 120 0.000000 0.206452 0.000000 1 / [255352.558013] kworker/14:0H 83 398.372073 9 100 0.000000 0.060908 0.000000 1 / [255352.570518] kworker/14:1H 2105 4582464.969992 81305 100 0.000000 1426.989351 0.000000 1 / [255352.583016] dhclient 2563 4440198.872168 197 120 0.000000 61.966990 0.000000 1 / [255352.595527] kiblnd_sd_01_02 5193 4582575.375840 515379351 120 0.000000 4664817.032186 0.000000 1 / [255352.608021] ptlrpcd_01_04 5218 4582119.073777 255964 120 0.000000 10929.477979 0.000000 1 / [255352.620502] ptlrpcd_01_06 5220 4582124.547260 255619 120 0.000000 10856.597391 0.000000 1 / [255352.633004] jbd2/dm-5-8 5231 4151085.041476 76792 120 0.000000 15666.809413 0.000000 1 / [255352.645496] osp-pre-0-3 5291 4582129.689188 49111 120 0.000000 1863.538505 0.000000 1 / [255352.657993] osp_up1-3 5292 4020875.068090 173689 120 0.000000 6444.356715 0.000000 1 / [255352.670509] osp-pre-2-3 5309 4582129.924259 50468 120 0.000000 1889.945487 0.000000 1 / [255352.682994] osp-pre-3-3 5312 4582124.445904 50390 120 0.000000 2164.076688 0.000000 1 / [255352.695492] osp-pre-4-3 5314 4582564.175623 50394 120 0.000000 1873.909284 0.000000 1 / [255352.707979] osp-pre-6-3 5319 4582249.109602 50447 120 0.000000 2151.945832 0.000000 1 / [255352.720482] osp-pre-13-3 5338 4582142.212607 50314 120 0.000000 1873.744896 0.000000 1 / [255352.732981] osp-pre-14-3 5340 4582135.899018 50496 120 0.000000 1915.991331 0.000000 1 / [255352.745481] kworker/14:1 12845 4582531.143357 50051 120 0.000000 3134.372078 0.000000 1 / [255352.757966] mdt_rdpg01_002 18332 2376538.364831 42644 120 0.000000 1927.649121 0.000000 1 / [255352.770467] mdt_out01_009 18738 4146183.659458 238122 120 0.000000 13961.849144 0.000000 1 / [255352.782983] osp-pre-0-2 49638 4582129.923139 11328 120 0.000000 365.170454 0.000000 1 / [255352.795477] osp-pre-1-2 49640 4582498.614663 11327 120 0.000000 370.710346 0.000000 1 / [255352.807978] kworker/u306:2 50074 4580628.058736 24581 120 0.000000 3962.997617 0.000000 1 / [255352.820480] mdt_io01_006 99270 4016096.369428 350 120 0.000000 28.810831 0.000000 1 / [255352.832965] mdt_out01_018 102699 4582209.911009 150545 120 0.000000 8536.964942 0.000000 1 / [255352.845549] mdt_out01_020 104183 2280304.014475 45995 120 0.000000 2525.651038 0.000000 1 / [255352.859942] cpu#15, 2693.549 MHz [255352.863647] .nr_running : 0 [255352.868900] .load : 0 [255352.874155] .nr_switches : 504490676 [255352.880185] .nr_load_updates : 32584887 [255352.886118] .nr_uninterruptible : 274 [255352.891578] .next_balance : 4550.037746 [255352.897814] .curr->pid : 49683 [255352.903456] .clock : 255352903.440122 [255352.910174] .cpu_load[0] : 0 [255352.915440] .cpu_load[1] : 256 [255352.920888] .cpu_load[2] : 385 [255352.926349] .cpu_load[3] : 133 [255352.931801] .cpu_load[4] : 364 [255352.937248] .avg_idle : 131116 [255352.942986] .max_idle_balance_cost : 500000 [255352.950484] cfs_rq[15]:/ [255352.953417] .exec_clock : 0.000000 [255352.959336] .MIN_vruntime : 0.000001 [255352.965264] .min_vruntime : 4534857.141736 [255352.971774] .max_vruntime : 0.000001 [255352.977702] .spread : 0.000000 [255352.983644] .spread0 : 4446976.295511 [255352.990153] .nr_spread_over : 0 [255352.995412] .nr_running : 1 [255353.000662] .load : 0 [255353.005912] .runnable_load_avg : 0 [255353.011161] .blocked_load_avg : 0 [255353.016411] .tg_load_avg : 0 [255353.021660] .tg_load_contrib : 0 [255353.026909] .tg_runnable_contrib : 0 [255353.032165] .tg->runnable_avg : 0 [255353.037414] .tg->cfs_bandwidth.timer_active: 0 [255353.042662] .throttled : 0 [255353.047918] .throttle_count : 0 [255353.053173] .avg->runnable_avg_sum : 16321 [255353.058822] .avg->runnable_avg_period : 46746 [255353.066216] rt_rq[15]:/ [255353.069046] .rt_nr_running : 0 [255353.074311] .rt_throttled : 0 [255353.079559] .rt_time : 0.000000 [255353.085488] .rt_runtime : 950.000000 [255353.093369] runnable tasks: [255353.096595] task PID tree-key switches prio wait-time sum-exec sum-sleep [255353.108730] ---------------------------------------------------------------------------------------------------------- [255353.120787] watchdog/15 84 -11.929875 63845 0 0.000000 1214.387789 0.000000 1 / [255353.133265] migration/15 85 0.000000 320 0 0.000000 1004.533435 0.000000 1 / [255353.145761] ksoftirqd/15 86 4533524.601505 14632 120 0.000000 351.990571 0.000000 1 / [255353.158256] kworker/15:0H 88 398.745139 9 100 0.000000 0.070976 0.000000 1 / [255353.170755] khungtaskd 173 4534185.132034 2130 120 0.000000 445.738625 0.000000 1 / [255353.183252] kworker/15:1 210 4534897.459035 50547 120 0.000000 3111.983923 0.000000 1 / [255353.195749] kdmwork-253:3 1472 89082.766299 245 120 0.000000 8.192914 0.000000 1 / [255353.208257] kworker/15:1H 2098 4534188.554117 86652 100 0.000000 1342.520630 0.000000 1 / [255353.220761] rpcbind 2346 4533308.321340 8518 120 0.000000 390.499608 0.000000 1 / [255353.233272] ptlrpc_hr01_000 5169 4097270.032906 34963 120 0.000000 595.648953 0.000000 1 / [255353.245756] ptlrpc_hr01_001 5170 4097270.052091 34982 120 0.000000 580.239073 0.000000 1 / [255353.258243] ptlrpc_hr01_002 5171 4097269.994356 34954 120 0.000000 587.904027 0.000000 1 / [255353.270732] ptlrpc_hr01_003 5172 4097270.097906 34981 120 0.000000 583.497118 0.000000 1 / [255353.283238] ptlrpc_hr01_004 5173 4097271.717653 34966 120 0.000000 592.898073 0.000000 1 / [255353.295748] ptlrpc_hr01_006 5175 4097269.901090 34961 120 0.000000 599.117406 0.000000 1 / [255353.308231] ptlrpc_hr01_007 5176 4097269.998940 34974 120 0.000000 602.794673 0.000000 1 / [255353.320721] ptlrpcd_01_02 5216 4534897.527414 257281 120 0.000000 10962.467123 0.000000 1 / [255353.333200] mdt_seqm_0000 5272 75629.481076 17 120 0.000000 0.723505 0.000000 1 / [255353.345692] osp-pre-9-3 5328 4534578.987292 50292 120 0.000000 2108.202842 0.000000 1 / [255353.358186] osp-syn-12-3 5334 4081172.887475 61556 120 0.000000 1643.072675 0.000000 1 / [255353.370684] osp-pre-15-3 5344 4534579.335871 50396 120 0.000000 1875.489247 0.000000 1 / [255353.383176] mdt01_003 5643 1197751.565469 133369 120 0.000000 10104.948703 0.000000 1 / [255353.395708] kworker/15:0 17960 70560.640146 2 120 0.000000 0.047075 0.000000 1 / [255353.408206] ldlm_cn01_015 18369 4097232.911369 55860 120 0.000000 2242.695531 0.000000 1 / [255353.420708] mdt_rdpg01_006 18479 2340135.531881 24027 120 0.000000 827.198149 0.000000 1 / [255353.433214] osp-pre-15-2 49674 89264.302845 4 120 0.000000 0.039285 0.000000 1 / [255353.445705] lquota_wb_soake 49679 4530878.245653 947 120 0.000000 17.063657 0.000000 1 / [255353.458200] lod0002_rec0001 49683 4535023.272487 258137708 120 0.000000 21313793.698986 0.000000 1 / [255353.470715] kworker/u306:0 3392 4530967.649479 52 120 0.000000 3.631288 0.000000 1 / [255353.483213] ldlm_cb01_003 4320 3385863.283315 28657 120 0.000000 757.797900 0.000000 1 / [255353.495705] ldlm_cb01_008 5425 3965254.766745 31775 120 0.000000 845.951090 0.000000 1 / [255353.509982] cpu#16, 2693.549 MHz [255353.513684] .nr_running : 0 [255353.518939] .load : 0 [255353.524204] .nr_switches : 912087 [255353.529955] .nr_load_updates : 3959387 [255353.535811] .nr_uninterruptible : 86 [255353.541160] .next_balance : 4550.038394 [255353.547383] .curr->pid : 0 [255353.552635] .clock : 255353551.907336 [255353.559334] .cpu_load[0] : 0 [255353.564587] .cpu_load[1] : 0 [255353.569853] .cpu_load[2] : 0 [255353.575105] .cpu_load[3] : 0 [255353.580381] .cpu_load[4] : 0 [255353.585634] .avg_idle : 1000000 [255353.591469] .max_idle_balance_cost : 500000 [255353.598965] cfs_rq[16]:/ [255353.601887] .exec_clock : 0.000000 [255353.607821] .MIN_vruntime : 0.000001 [255353.613748] .min_vruntime : 169900.812818 [255353.620168] .max_vruntime : 0.000001 [255353.626108] .spread : 0.000000 [255353.632038] .spread0 : 82019.933033 [255353.638354] .nr_spread_over : 0 [255353.643602] .nr_running : 0 [255353.648853] .load : 0 [255353.654102] .runnable_load_avg : 0 [255353.659350] .blocked_load_avg : 0 [255353.664598] .tg_load_avg : 0 [255353.669866] .tg_load_contrib : 0 [255353.675126] .tg_runnable_contrib : 0 [255353.680376] .tg->runnable_avg : 0 [255353.685624] .tg->cfs_bandwidth.timer_active: 0 [255353.690875] .throttled : 0 [255353.696132] .throttle_count : 0 [255353.701382] .avg->runnable_avg_sum : 0 [255353.706633] .avg->runnable_avg_period : 47800 [255353.714041] rt_rq[16]:/ [255353.716868] .rt_nr_running : 0 [255353.722118] .rt_throttled : 0 [255353.727366] .rt_time : 0.000000 [255353.733295] .rt_runtime : 950.000000 [255353.741175] runnable tasks: [255353.744389] task PID tree-key switches prio wait-time sum-exec sum-sleep [255353.756522] ---------------------------------------------------------------------------------------------------------- [255353.768560] watchdog/16 89 -11.949604 63845 0 0.000000 966.835419 0.000000 0 / [255353.781044] migration/16 90 0.000000 5604 0 0.000000 1212.843209 0.000000 0 / [255353.793542] ksoftirqd/16 91 169888.872501 2867 120 0.000000 104.643253 0.000000 0 / [255353.806047] kworker/16:0H 93 241.192136 7 100 0.000000 0.036339 0.000000 0 / [255353.818537] kworker/16:1 238 169889.216457 6225 120 0.000000 222.254528 0.000000 0 / [255353.831038] kworker/16:1H 1049 169888.812909 153 100 0.000000 1.606724 0.000000 0 / [255353.843524] multipathd 1445 0.000000 3 0 0.000000 0.525586 0.000000 0 / [255353.856029] multipathd 1458 0.000000 6 0 0.000000 2.017174 0.000000 0 / [255353.868540] multipathd 1467 0.000000 3 0 0.000000 0.440960 0.000000 0 / [255353.881023] multipathd 1473 0.000000 3 0 0.000000 0.967348 0.000000 0 / [255353.893544] multipathd 1478 0.000000 1 0 0.000000 0.432027 0.000000 0 / [255353.906044] multipathd 1483 0.000000 15 0 0.000000 3.048740 0.000000 0 / [255353.918544] multipathd 1499 0.000000 1 0 0.000000 0.430544 0.000000 0 / [255353.931046] ntpd 3994 169890.961528 9137 120 0.000000 1059.316879 0.000000 0 / [255353.943569] mdt00_005 5413 169894.591944 127728 120 0.000000 10980.749090 0.000000 0 / [255353.956080] mdt00_012 18365 169890.304046 27855 120 0.000000 2416.046947 0.000000 0 / [255353.968572] osp-pre-8-2 49660 10584.065104 4 120 0.000000 0.047028 0.000000 0 / [255353.981072] kworker/16:2 111371 167953.066885 3 120 0.000000 0.085896 0.000000 0 / [255353.995436] cpu#17, 2693.549 MHz [255353.999137] .nr_running : 0 [255354.004404] .load : 0 [255354.009659] .nr_switches : 2807982 [255354.015506] .nr_load_updates : 5851909 [255354.021341] .nr_uninterruptible : 158 [255354.026802] .next_balance : 4550.038880 [255354.033026] .curr->pid : 0 [255354.038291] .clock : 255354037.873495 [255354.045010] .cpu_load[0] : 0 [255354.050288] .cpu_load[1] : 0 [255354.055541] .cpu_load[2] : 0 [255354.060795] .cpu_load[3] : 0 [255354.066049] .cpu_load[4] : 0 [255354.071306] .avg_idle : 1000000 [255354.077141] .max_idle_balance_cost : 500000 [255354.084662] cfs_rq[17]:/ [255354.087584] .exec_clock : 0.000000 [255354.093525] .MIN_vruntime : 0.000001 [255354.099463] .min_vruntime : 1657995.525564 [255354.105976] .max_vruntime : 0.000001 [255354.111911] .spread : 0.000000 [255354.117839] .spread0 : 1570114.645779 [255354.124348] .nr_spread_over : 0 [255354.129595] .nr_running : 0 [255354.134846] .load : 0 [255354.140090] .runnable_load_avg : 0 [255354.145336] .blocked_load_avg : 0 [255354.150585] .tg_load_avg : 0 [255354.155836] .tg_load_contrib : 0 [255354.161099] .tg_runnable_contrib : 0 [255354.166348] .tg->runnable_avg : 0 [255354.171599] .tg->cfs_bandwidth.timer_active: 0 [255354.176850] .throttled : 0 [255354.182102] .throttle_count : 0 [255354.187351] .avg->runnable_avg_sum : 24 [255354.192699] .avg->runnable_avg_period : 46402 [255354.200096] rt_rq[17]:/ [255354.202921] .rt_nr_running : 0 [255354.208177] .rt_throttled : 0 [255354.213425] .rt_time : 0.032441 [255354.219366] .rt_runtime : 950.000000 [255354.227248] runnable tasks: [255354.230459] task PID tree-key switches prio wait-time sum-exec sum-sleep [255354.242592] ---------------------------------------------------------------------------------------------------------- [255354.254636] watchdog/17 94 -11.943281 63845 0 0.000000 952.837419 0.000000 0 / [255354.267149] migration/17 95 0.000000 44638 0 0.000000 1722.957174 0.000000 0 / [255354.279628] ksoftirqd/17 96 1657980.846306 28734 120 0.000000 740.987967 0.000000 0 / [255354.292109] kworker/17:0H 98 3542.490062 9 100 0.000000 0.055742 0.000000 0 / [255354.304608] scsi_eh_1 1010 1176.938157 7 120 0.000000 0.123855 0.000000 0 / [255354.317106] ib-comp-wq 1053 1200.937920 2 100 0.000000 0.057747 0.000000 0 / [255354.329592] ib-comp-unb-wq 1057 1248.970769 2 100 0.000000 0.013178 0.000000 0 / [255354.342091] ib_mcast 1058 1260.983406 2 100 0.000000 0.013486 0.000000 0 / [255354.354607] ib_nl_sa_wq 1059 1272.989799 2 100 0.000000 0.006712 0.000000 0 / [255354.367105] mlx4_ib 1060 1284.998507 2 100 0.000000 0.009217 0.000000 0 / [255354.379619] mlx4_ib_mcg 1061 1297.005687 2 100 0.000000 0.007562 0.000000 0 / [255354.392117] ib_mad1 1068 1309.026471 2 100 0.000000 0.022842 0.000000 0 / [255354.404606] to_fifo 1069 1321.105932 2 100 0.000000 0.080689 0.000000 0 / [255354.417102] poll_mpt3sas0_s 1077 1342.907069 2 100 0.000000 0.095203 0.000000 0 / [255354.429608] ext4-rsv-conver 1117 1382.004225 2 100 0.000000 0.057237 0.000000 0 / [255354.442139] rpciod 1217 2055.373820 2 100 0.000000 0.041337 0.000000 0 / [255354.454649] xprtiod 1218 2067.388913 2 100 0.000000 0.016271 0.000000 0 / [255354.467128] kmpathd 1248 2150.466962 2 100 0.000000 0.074270 0.000000 0 / [255354.479631] kmpath_handlerd 1249 2162.483409 2 100 0.000000 0.017749 0.000000 0 / [255354.492126] multipathd 1258 0.000000 44 0 0.000000 17.114277 0.000000 0 / [255354.504616] multipathd 1260 0.000000 64 0 0.000000 7.401362 0.000000 0 / [255354.517127] multipathd 1264 0.000000 573876 0 0.000000 58839.167508 0.000000 0 / [255354.529625] kworker/17:4 1263 1657995.707669 159704 120 0.000000 20048.735726 0.000000 0 / [255354.542120] kdmflush 1410 2451.187966 2 100 0.000000 0.007417 0.000000 0 / [255354.554611] kworker/17:1H 2124 1657983.507219 27611 100 0.000000 553.437713 0.000000 0 / [255354.567122] gssproxy 2484 4918.238492 2 120 0.000000 0.094632 0.000000 0 / [255354.579612] gssproxy 2487 4930.277817 1 120 0.000000 0.039331 0.000000 0 / [255354.592104] mdt_io00_002 5278 1513411.480876 500 120 0.000000 35.110249 0.000000 0 / [255354.604596] mdt00_004 5412 1657980.653119 157263 120 0.000000 12972.164178 0.000000 0 / [255354.617102] mdt00_015 99335 1357173.819391 92413 120 0.000000 7308.818566 0.000000 0 / [255354.629599] kworker/17:1 85515 1644612.845973 5 120 0.000000 0.074367 0.000000 0 / [255354.643888] cpu#18, 2693.549 MHz [255354.647616] .nr_running : 0 [255354.652875] .load : 0 [255354.658131] .nr_switches : 6770975 [255354.663968] .nr_load_updates : 10578017 [255354.669918] .nr_uninterruptible : -293 [255354.675473] .next_balance : 4550.039529 [255354.681697] .curr->pid : 0 [255354.686951] .clock : 255354686.820237 [255354.693661] .cpu_load[0] : 0 [255354.698914] .cpu_load[1] : 0 [255354.704184] .cpu_load[2] : 0 [255354.709438] .cpu_load[3] : 0 [255354.714691] .cpu_load[4] : 0 [255354.719949] .avg_idle : 1000000 [255354.725782] .max_idle_balance_cost : 500000 [255354.733271] cfs_rq[18]:/ [255354.736206] .exec_clock : 0.000000 [255354.742134] .MIN_vruntime : 0.000001 [255354.748061] .min_vruntime : 693134.996350 [255354.754486] .max_vruntime : 0.000001 [255354.760415] .spread : 0.000000 [255354.766359] .spread0 : 605254.116565 [255354.772770] .nr_spread_over : 0 [255354.778020] .nr_running : 0 [255354.783270] .load : 0 [255354.788531] .runnable_load_avg : 0 [255354.793781] .blocked_load_avg : 0 [255354.799031] .tg_load_avg : 0 [255354.804281] .tg_load_contrib : 0 [255354.809530] .tg_runnable_contrib : 0 [255354.814781] .tg->runnable_avg : 0 [255354.820022] .tg->cfs_bandwidth.timer_active: 0 [255354.825270] .throttled : 0 [255354.830527] .throttle_count : 0 [255354.835784] .avg->runnable_avg_sum : 0 [255354.841046] .avg->runnable_avg_period : 47074 [255354.848445] rt_rq[18]:/ [255354.851271] .rt_nr_running : 0 [255354.856519] .rt_throttled : 0 [255354.861776] .rt_time : 0.028361 [255354.867705] .rt_runtime : 950.000000 [255354.875606] runnable tasks: [255354.878818] task PID tree-key switches prio wait-time sum-exec sum-sleep [255354.890951] ---------------------------------------------------------------------------------------------------------- [255354.902992] watchdog/18 99 -11.941544 63846 0 0.000000 1000.610559 0.000000 0 / [255354.915477] migration/18 100 0.000000 16628 0 0.000000 1170.580220 0.000000 0 / [255354.927972] ksoftirqd/18 101 693015.491929 24574 120 0.000000 590.735335 0.000000 0 / [255354.940489] kworker/18:0H 103 3882.722478 9 100 0.000000 0.092003 0.000000 0 / [255354.952985] kworker/18:1 239 693123.098607 15729 120 0.000000 505.019086 0.000000 0 / [255354.965487] gssproxy 2485 1509.420468 1 120 0.000000 0.072638 0.000000 0 / [255354.977987] kworker/18:1H 4707 655528.796108 2776 100 0.000000 44.671043 0.000000 0 / [255354.990492] ldlm_cn00_000 5239 644942.728625 57093 120 0.000000 3231.445315 0.000000 0 / [255355.002983] mdt_rdpg00_001 5259 646825.610506 23703 120 0.000000 1001.146074 0.000000 0 / [255355.015478] mdt00_003 5403 693123.866617 145538 120 0.000000 12450.133983 0.000000 0 / [255355.027992] mdt00_011 18351 693126.484796 89562 120 0.000000 7559.574820 0.000000 0 / [255355.040480] kworker/18:2 113640 693015.315526 3 120 0.000000 0.077422 0.000000 0 / [255355.054852] cpu#19, 2693.549 MHz [255355.058554] .nr_running : 0 [255355.063816] .load : 0 [255355.069071] .nr_switches : 4495681 [255355.074914] .nr_load_updates : 4617267 [255355.080749] .nr_uninterruptible : -818 [255355.086294] .next_balance : 4550.039940 [255355.092530] .curr->pid : 0 [255355.097795] .clock : 255355096.800530 [255355.104503] .cpu_load[0] : 0 [255355.109770] .cpu_load[1] : 0 [255355.115035] .cpu_load[2] : 0 [255355.120293] .cpu_load[3] : 0 [255355.125548] .cpu_load[4] : 0 [255355.130804] .avg_idle : 1000000 [255355.136650] .max_idle_balance_cost : 500000 [255355.144176] cfs_rq[19]:/ [255355.147098] .exec_clock : 0.000000 [255355.153025] .MIN_vruntime : 0.000001 [255355.158954] .min_vruntime : 395808.006595 [255355.165368] .max_vruntime : 0.000001 [255355.171296] .spread : 0.000000 [255355.177223] .spread0 : 307927.084761 [255355.183634] .nr_spread_over : 0 [255355.188892] .nr_running : 0 [255355.194142] .load : 0 [255355.199392] .runnable_load_avg : 0 [255355.204642] .blocked_load_avg : 0 [255355.209894] .tg_load_avg : 0 [255355.215144] .tg_load_contrib : 0 [255355.220392] .tg_runnable_contrib : 0 [255355.225640] .tg->runnable_avg : 0 [255355.230908] .tg->cfs_bandwidth.timer_active: 0 [255355.236157] .throttled : 0 [255355.241407] .throttle_count : 0 [255355.246655] .avg->runnable_avg_sum : 0 [255355.251906] .avg->runnable_avg_period : 46535 [255355.259313] rt_rq[19]:/ [255355.262137] .rt_nr_running : 0 [255355.267385] .rt_throttled : 0 [255355.272635] .rt_time : 0.021461 [255355.278564] .rt_runtime : 950.000000 [255355.286446] runnable tasks: [255355.289665] task PID tree-key switches prio wait-time sum-exec sum-sleep [255355.301822] ---------------------------------------------------------------------------------------------------------- [255355.313861] watchdog/19 104 -11.941487 63846 0 0.000000 934.669686 0.000000 0 / [255355.326377] migration/19 105 0.000000 8276 0 0.000000 1073.825160 0.000000 0 / [255355.338883] ksoftirqd/19 106 395316.658732 8621 120 0.000000 315.851640 0.000000 0 / [255355.351396] kworker/19:0H 108 5134.639825 9 100 0.000000 0.088899 0.000000 0 / [255355.363907] kworker/19:1 241 395795.962897 11377 120 0.000000 388.063274 0.000000 0 / [255355.376410] kworker/u308:0 1055 27161.445977 17949 100 0.000000 451.759149 0.000000 0 / [255355.388906] ll_cfg_requeue 5248 25393.950241 206 120 0.000000 17.040234 0.000000 0 / [255355.401412] kworker/19:1H 8647 309166.314670 2429 100 0.000000 72.423954 0.000000 0 / [255355.413906] kworker/19:2 95814 368911.921285 3 120 0.000000 0.098882 0.000000 0 / [255355.428217] cpu#20, 2693.549 MHz [255355.431917] .nr_running : 0 [255355.437168] .load : 0 [255355.442429] .nr_switches : 1125956 [255355.448278] .nr_load_updates : 4140827 [255355.454124] .nr_uninterruptible : 89 [255355.459480] .next_balance : 4550.040313 [255355.465713] .curr->pid : 0 [255355.470987] .clock : 255355468.783340 [255355.477695] .cpu_load[0] : 0 [255355.482948] .cpu_load[1] : 0 [255355.488202] .cpu_load[2] : 0 [255355.493456] .cpu_load[3] : 0 [255355.498721] .cpu_load[4] : 0 [255355.503975] .avg_idle : 1000000 [255355.509818] .max_idle_balance_cost : 500000 [255355.517316] cfs_rq[20]:/ [255355.520240] .exec_clock : 0.000000 [255355.526168] .MIN_vruntime : 0.000001 [255355.532094] .min_vruntime : 336361.755792 [255355.538516] .max_vruntime : 0.000001 [255355.544443] .spread : 0.000000 [255355.550371] .spread0 : 248480.798854 [255355.556784] .nr_spread_over : 0 [255355.562040] .nr_running : 0 [255355.567290] .load : 0 [255355.572541] .runnable_load_avg : 0 [255355.577790] .blocked_load_avg : 0 [255355.583047] .tg_load_avg : 0 [255355.588296] .tg_load_contrib : 0 [255355.593556] .tg_runnable_contrib : 0 [255355.598804] .tg->runnable_avg : 0 [255355.604052] .tg->cfs_bandwidth.timer_active: 0 [255355.609300] .throttled : 0 [255355.614550] .throttle_count : 0 [255355.619800] .avg->runnable_avg_sum : 0 [255355.625048] .avg->runnable_avg_period : 46214 [255355.632445] rt_rq[20]:/ [255355.635270] .rt_nr_running : 0 [255355.640520] .rt_throttled : 0 [255355.645789] .rt_time : 0.000000 [255355.651723] .rt_runtime : 950.000000 [255355.659623] runnable tasks: [255355.662837] task PID tree-key switches prio wait-time sum-exec sum-sleep [255355.674970] ---------------------------------------------------------------------------------------------------------- [255355.687015] watchdog/20 109 -11.943207 63846 0 0.000000 955.931069 0.000000 0 / [255355.699510] migration/20 110 0.000000 8256 0 0.000000 1088.482495 0.000000 0 / [255355.712016] ksoftirqd/20 111 336034.116840 4444 120 0.000000 147.565106 0.000000 0 / [255355.724536] kworker/20:0H 113 1822.575200 9 100 0.000000 0.126984 0.000000 0 / [255355.737059] zvol 2236 921.837809 2 100 0.000000 0.040066 0.000000 0 / [255355.749548] polkitd 2420 977.424432 4 120 0.000000 0.287996 0.000000 0 / [255355.762047] gmain 3309 1753.847458 1 120 0.000000 0.055329 0.000000 0 / [255355.774547] kworker/20:1H 3620 326439.308678 505 100 0.000000 18.538851 0.000000 0 / [255355.787039] ll_evictor 5287 19909.723128 29 120 0.000000 178.231934 0.000000 0 / [255355.799525] osp_up2-3 5294 2518.279450 2 120 0.000000 0.060995 0.000000 0 / [255355.812013] osp-pre-2-3 5295 2530.343055 2 120 0.000000 0.063611 0.000000 0 / [255355.824515] mdt_rdpg00_002 18333 291548.677457 34200 120 0.000000 1635.335094 0.000000 0 / [255355.837004] mdt00_010 18347 74504.265121 21318 120 0.000000 1708.222096 0.000000 0 / [255355.849522] mdt_rdpg00_004 18475 291546.678469 27593 120 0.000000 1094.489145 0.000000 0 / [255355.862036] osp-pre-1-2 49646 20369.465655 4 120 0.000000 0.122072 0.000000 0 / [255355.874530] osp-pre-3-2 49650 20369.492176 4 120 0.000000 0.133674 0.000000 0 / [255355.887045] osp-pre-7-2 49658 20369.489058 4 120 0.000000 0.075611 0.000000 0 / [255355.899553] osp-syn-12-2 49667 20323.740043 5 120 0.000000 0.805421 0.000000 0 / [255355.912049] mdt00_020 99453 336350.630596 97774 120 0.000000 8580.493539 0.000000 0 / [255355.924535] ldlm_cb00_003 4488 243027.316220 1427 120 0.000000 64.219402 0.000000 0 / [255355.937045] kworker/20:2 10047 336349.835285 3539 120 0.000000 142.485570 0.000000 0 / [255355.949551] kworker/20:0 78404 273281.982309 2 120 0.000000 0.066252 0.000000 0 / [255355.963826] cpu#21, 2693.549 MHz [255355.967530] .nr_running : 0 [255355.972784] .load : 0 [255355.978037] .nr_switches : 1460513 [255355.983872] .nr_load_updates : 4080587 [255355.989723] .nr_uninterruptible : -274 [255355.995282] .next_balance : 4550.040851 [255356.001506] .curr->pid : 0 [255356.006781] .clock : 255356005.737770 [255356.013496] .cpu_load[0] : 0 [255356.018749] .cpu_load[1] : 0 [255356.024025] .cpu_load[2] : 0 [255356.029278] .cpu_load[3] : 0 [255356.034530] .cpu_load[4] : 0 [255356.039787] .avg_idle : 1000000 [255356.045621] .max_idle_balance_cost : 500000 [255356.053120] cfs_rq[21]:/ [255356.056042] .exec_clock : 0.000000 [255356.061979] .MIN_vruntime : 0.000001 [255356.067908] .min_vruntime : 372094.443433 [255356.074322] .max_vruntime : 0.000001 [255356.080249] .spread : 0.000000 [255356.086176] .spread0 : 284213.452547 [255356.092590] .nr_spread_over : 0 [255356.097850] .nr_running : 0 [255356.103099] .load : 0 [255356.108357] .runnable_load_avg : 0 [255356.113605] .blocked_load_avg : 0 [255356.118854] .tg_load_avg : 0 [255356.124103] .tg_load_contrib : 0 [255356.129352] .tg_runnable_contrib : 0 [255356.134601] .tg->runnable_avg : 0 [255356.139849] .tg->cfs_bandwidth.timer_active: 0 [255356.145098] .throttled : 0 [255356.150354] .throttle_count : 0 [255356.155604] .avg->runnable_avg_sum : 0 [255356.160852] .avg->runnable_avg_period : 47708 [255356.168242] rt_rq[21]:/ [255356.171079] .rt_nr_running : 0 [255356.176328] .rt_throttled : 0 [255356.181578] .rt_time : 0.000000 [255356.187517] .rt_runtime : 950.000000 [255356.195397] runnable tasks: [255356.198610] task PID tree-key switches prio wait-time sum-exec sum-sleep [255356.210741] ---------------------------------------------------------------------------------------------------------- [255356.222779] watchdog/21 114 -11.942656 63846 0 0.000000 882.619027 0.000000 0 / [255356.235270] migration/21 115 0.000000 13483 0 0.000000 1131.735398 0.000000 0 / [255356.247760] ksoftirqd/21 116 371999.674944 3679 120 0.000000 96.916877 0.000000 0 / [255356.260247] kworker/21:0H 118 4142.953887 9 100 0.000000 0.080109 0.000000 0 / [255356.272743] kworker/21:1 242 372082.462197 8231 120 0.000000 194.871708 0.000000 0 / [255356.285252] kworker/21:1H 17172 348315.710335 2150 100 0.000000 30.401575 0.000000 0 / [255356.297741] ldlm_cn00_009 18358 337862.916577 32296 120 0.000000 1844.966417 0.000000 0 / [255356.310266] mdt_rdpg00_006 18480 325192.610241 32398 120 0.000000 1324.479678 0.000000 0 / [255356.322760] osp-pre-5-2 49654 14705.589854 4 120 0.000000 0.119828 0.000000 0 / [255356.335253] mdt00_016 99339 372082.687105 134414 120 0.000000 11875.802995 0.000000 0 / [255356.347735] ldlm_cn00_012 2181 337970.662007 13257 120 0.000000 907.258427 0.000000 0 / [255356.360245] kworker/21:0 106208 358644.530272 4 120 0.000000 0.054844 0.000000 0 / [255356.374631] cpu#22, 2693.549 MHz [255356.378346] .nr_running : 0 [255356.383600] .load : 0 [255356.388865] .nr_switches : 1352749 [255356.394715] .nr_load_updates : 4273852 [255356.400541] .nr_uninterruptible : -1027 [255356.406193] .next_balance : 4550.041258 [255356.412445] .curr->pid : 0 [255356.417719] .clock : 255356416.710971 [255356.424425] .cpu_load[0] : 0 [255356.429676] .cpu_load[1] : 0 [255356.434922] .cpu_load[2] : 0 [255356.440178] .cpu_load[3] : 0 [255356.445431] .cpu_load[4] : 0 [255356.450689] .avg_idle : 1000000 [255356.456525] .max_idle_balance_cost : 500000 [255356.464021] cfs_rq[22]:/ [255356.466945] .exec_clock : 0.000000 [255356.472872] .MIN_vruntime : 0.000001 [255356.478799] .min_vruntime : 336756.539963 [255356.485213] .max_vruntime : 0.000001 [255356.491140] .spread : 0.000000 [255356.497068] .spread0 : 248875.549077 [255356.503482] .nr_spread_over : 0 [255356.508743] .nr_running : 0 [255356.513993] .load : 0 [255356.519240] .runnable_load_avg : 0 [255356.524490] .blocked_load_avg : 0 [255356.529745] .tg_load_avg : 0 [255356.534994] .tg_load_contrib : 0 [255356.540243] .tg_runnable_contrib : 0 [255356.545492] .tg->runnable_avg : 0 [255356.550741] .tg->cfs_bandwidth.timer_active: 0 [255356.556001] .throttled : 0 [255356.561257] .throttle_count : 0 [255356.566511] .avg->runnable_avg_sum : 0 [255356.571761] .avg->runnable_avg_period : 46990 [255356.579168] rt_rq[22]:/ [255356.581993] .rt_nr_running : 0 [255356.587252] .rt_throttled : 0 [255356.592493] .rt_time : 0.000000 [255356.598420] .rt_runtime : 950.000000 [255356.606298] runnable tasks: [255356.609509] task PID tree-key switches prio wait-time sum-exec sum-sleep [255356.621651] ---------------------------------------------------------------------------------------------------------- [255356.633690] watchdog/22 119 -11.942590 63846 0 0.000000 952.582308 0.000000 0 / [255356.646217] migration/22 120 0.000000 10520 0 0.000000 1100.385806 0.000000 0 / [255356.658709] ksoftirqd/22 121 336719.296212 14360 120 0.000000 770.118095 0.000000 0 / [255356.671220] kworker/22:0H 123 1350.097315 9 100 0.000000 0.141926 0.000000 0 / [255356.683731] kworker/22:1 244 336744.036603 14178 120 0.000000 477.233563 0.000000 0 / [255356.696227] kdmflush 1451 479.843285 2 100 0.000000 0.006023 0.000000 0 / [255356.708740] bioset 1453 491.847470 2 100 0.000000 0.004588 0.000000 0 / [255356.721230] kdmflush 1470 507.066628 2 100 0.000000 0.005734 0.000000 0 / [255356.733743] nfsiod 3128 1193.263579 2 100 0.000000 0.040004 0.000000 0 / [255356.746269] kworker/22:1H 4812 198581.515426 1838 100 0.000000 50.412890 0.000000 0 / [255356.758788] ldlm_cn00_004 18336 301206.658511 49589 120 0.000000 2696.972685 0.000000 0 / [255356.771281] ldlm_cn00_007 18355 301206.898554 41746 120 0.000000 2410.712835 0.000000 0 / [255356.783788] mdt_rdpg00_010 18487 300228.775535 26091 120 0.000000 1067.742759 0.000000 0 / [255356.796278] mdt00_014 18742 336756.539963 116746 120 0.000000 10007.835953 0.000000 0 / [255356.808780] kworker/22:0 139529 151691.932763 5 120 0.000000 0.077797 0.000000 0 / [255356.821406] ldlm_cb00_004 4525 260233.972019 1619 120 0.000000 83.431025 0.000000 0 / [255356.835691] cpu#23, 2693.549 MHz [255356.839393] .nr_running : 0 [255356.844647] .load : 0 [255356.849900] .nr_switches : 2286234 [255356.855736] .nr_load_updates : 4180132 [255356.861572] .nr_uninterruptible : -4269 [255356.867211] .next_balance : 4550.041721 [255356.873425] .curr->pid : 0 [255356.878688] .clock : 255356877.683812 [255356.885407] .cpu_load[0] : 0 [255356.890662] .cpu_load[1] : 0 [255356.895916] .cpu_load[2] : 0 [255356.901170] .cpu_load[3] : 0 [255356.906430] .cpu_load[4] : 0 [255356.911687] .avg_idle : 904419 [255356.917426] .max_idle_balance_cost : 500000 [255356.924925] cfs_rq[23]:/ [255356.927863] .exec_clock : 0.000000 [255356.933796] .MIN_vruntime : 0.000001 [255356.939731] .min_vruntime : 327101.349885 [255356.946145] .max_vruntime : 0.000001 [255356.952072] .spread : 0.000000 [255356.957999] .spread0 : 239220.358999 [255356.964411] .nr_spread_over : 0 [255356.969662] .nr_running : 0 [255356.974910] .load : 0 [255356.980160] .runnable_load_avg : 0 [255356.985411] .blocked_load_avg : 0 [255356.990659] .tg_load_avg : 0 [255356.995908] .tg_load_contrib : 0 [255357.001157] .tg_runnable_contrib : 0 [255357.006408] .tg->runnable_avg : 0 [255357.011656] .tg->cfs_bandwidth.timer_active: 0 [255357.016903] .throttled : 0 [255357.022153] .throttle_count : 0 [255357.027401] .avg->runnable_avg_sum : 230 [255357.032845] .avg->runnable_avg_period : 48052 [255357.040242] rt_rq[23]:/ [255357.043079] .rt_nr_running : 0 [255357.048329] .rt_throttled : 0 [255357.053578] .rt_time : 0.000000 [255357.059504] .rt_runtime : 950.000000 [255357.067382] runnable tasks: [255357.070595] task PID tree-key switches prio wait-time sum-exec sum-sleep [255357.082729] ---------------------------------------------------------------------------------------------------------- [255357.094767] watchdog/23 124 -11.943806 63846 0 0.000000 948.360053 0.000000 0 / [255357.107255] migration/23 125 0.000000 6633 0 0.000000 1051.450705 0.000000 0 / [255357.119744] ksoftirqd/23 126 326965.857504 6040 120 0.000000 200.208811 0.000000 0 / [255357.132248] kworker/23:0H 128 953.822623 9 100 0.000000 0.105326 0.000000 0 / [255357.144755] kworker/23:1 243 327087.848223 12881 120 0.000000 497.794889 0.000000 0 / [255357.157266] bioset 1471 441.095113 2 100 0.000000 0.005917 0.000000 0 / [255357.169765] kdmflush 1475 465.105924 2 100 0.000000 0.004890 0.000000 0 / [255357.182285] bioset 1476 477.109687 2 100 0.000000 0.004149 0.000000 0 / [255357.194782] bioset 1480 501.119829 2 100 0.000000 0.004436 0.000000 0 / [255357.207284] kworker/23:1H 2106 176573.634638 15206 100 0.000000 445.472809 0.000000 0 / [255357.219786] xinetd 3044 1305.065191 17 120 0.000000 18.449004 0.000000 0 / [255357.232282] mdt00_013 18378 303889.510877 74011 120 0.000000 6193.535151 0.000000 0 / [255357.244792] mdt00_023 99458 107728.517498 5 120 0.000000 0.499836 0.000000 0 / [255357.257293] kworker/23:2 33760 225107.677200 3 120 0.000000 0.046048 0.000000 0 / [255357.271572] cpu#24, 2693.549 MHz [255357.275266] .nr_running : 0 [255357.280520] .load : 0 [255357.285773] .nr_switches : 101431413 [255357.291802] .nr_load_updates : 8373282 [255357.297653] .nr_uninterruptible : 89 [255357.303004] .next_balance : 4550.042156 [255357.309250] .curr->pid : 0 [255357.314503] .clock : 255357310.685607 [255357.321211] .cpu_load[0] : 0 [255357.326484] .cpu_load[1] : 0 [255357.331738] .cpu_load[2] : 0 [255357.336993] .cpu_load[3] : 0 [255357.342246] .cpu_load[4] : 0 [255357.347508] .avg_idle : 918918 [255357.353245] .max_idle_balance_cost : 500000 [255357.360754] cfs_rq[24]:/ [255357.363676] .exec_clock : 0.000000 [255357.369603] .MIN_vruntime : 0.000001 [255357.375533] .min_vruntime : 503820.585689 [255357.381959] .max_vruntime : 0.000001 [255357.387896] .spread : 0.000000 [255357.393824] .spread0 : 415939.594803 [255357.400237] .nr_spread_over : 0 [255357.405488] .nr_running : 0 [255357.410738] .load : 0 [255357.415986] .runnable_load_avg : 0 [255357.421236] .blocked_load_avg : 0 [255357.426484] .tg_load_avg : 0 [255357.431733] .tg_load_contrib : 0 [255357.436987] .tg_runnable_contrib : 0 [255357.442237] .tg->runnable_avg : 0 [255357.447494] .tg->cfs_bandwidth.timer_active: 0 [255357.452744] .throttled : 0 [255357.457993] .throttle_count : 0 [255357.463241] .avg->runnable_avg_sum : 0 [255357.468504] .avg->runnable_avg_period : 47085 [255357.475900] rt_rq[24]:/ [255357.478724] .rt_nr_running : 0 [255357.483974] .rt_throttled : 0 [255357.489223] .rt_time : 0.000000 [255357.495159] .rt_runtime : 950.000000 [255357.503029] runnable tasks: [255357.506246] task PID tree-key switches prio wait-time sum-exec sum-sleep [255357.518380] ---------------------------------------------------------------------------------------------------------- [255357.530419] watchdog/24 129 -11.931095 63846 0 0.000000 865.154745 0.000000 1 / [255357.542912] migration/24 130 0.000000 427 0 0.000000 972.412937 0.000000 1 / [255357.555425] ksoftirqd/24 131 471156.577764 441 120 0.000000 20.945522 0.000000 1 / [255357.567959] kworker/24:0 132 -8.901249 21 120 0.000000 0.149619 0.000000 1 / [255357.580449] kworker/24:0H 133 1325.613054 9 100 0.000000 0.168509 0.000000 1 / [255357.592937] kworker/24:1 245 487307.571523 2956 120 0.000000 50.032930 0.000000 1 / [255357.605447] kworker/24:1H 2244 300912.688258 6899 100 0.000000 44.630371 0.000000 1 / [255357.617954] ptlrpcd_01_09 5223 503809.074828 264936 120 0.000000 10580.734297 0.000000 1 / [255357.630439] osp-syn-13-3 5337 422759.340984 60088 120 0.000000 1017.834872 0.000000 1 / [255357.642927] mdt01_007 18343 292826.120426 92093 120 0.000000 7026.330151 0.000000 1 / [255357.655440] mdt01_013 18352 404075.056196 136905 120 0.000000 9754.379554 0.000000 1 / [255357.667943] ldlm_cn01_009 18361 437844.084637 51861 120 0.000000 2127.132759 0.000000 1 / [255357.680444] mdt_io01_004 98998 404064.656279 381 120 0.000000 28.470753 0.000000 1 / [255357.694743] cpu#25, 2693.549 MHz [255357.698444] .nr_running : 0 [255357.703698] .load : 0 [255357.708961] .nr_switches : 18349546 [255357.714894] .nr_load_updates : 5791638 [255357.720730] .nr_uninterruptible : 615 [255357.726190] .next_balance : 4550.042577 [255357.732420] .curr->pid : 0 [255357.737674] .clock : 255357735.649548 [255357.744393] .cpu_load[0] : 0 [255357.749655] .cpu_load[1] : 0 [255357.754912] .cpu_load[2] : 0 [255357.760166] .cpu_load[3] : 0 [255357.765421] .cpu_load[4] : 0 [255357.770672] .avg_idle : 1000000 [255357.776500] .max_idle_balance_cost : 500000 [255357.783995] cfs_rq[25]:/ [255357.786919] .exec_clock : 0.000000 [255357.792846] .MIN_vruntime : 0.000001 [255357.798774] .min_vruntime : 1744059.161167 [255357.805282] .max_vruntime : 0.000001 [255357.811222] .spread : 0.000000 [255357.817150] .spread0 : 1656178.170281 [255357.823666] .nr_spread_over : 0 [255357.828927] .nr_running : 0 [255357.834175] .load : 0 [255357.839424] .runnable_load_avg : 0 [255357.844684] .blocked_load_avg : 0 [255357.849941] .tg_load_avg : 0 [255357.855194] .tg_load_contrib : 0 [255357.860457] .tg_runnable_contrib : 0 [255357.865709] .tg->runnable_avg : 0 [255357.870958] .tg->cfs_bandwidth.timer_active: 0 [255357.876210] .throttled : 0 [255357.881461] .throttle_count : 0 [255357.886719] .avg->runnable_avg_sum : 0 [255357.891980] .avg->runnable_avg_period : 47738 [255357.899374] rt_rq[25]:/ [255357.902198] .rt_nr_running : 0 [255357.907448] .rt_throttled : 0 [255357.912698] .rt_time : 0.000000 [255357.918631] .rt_runtime : 950.000000 [255357.926509] runnable tasks: [255357.929722] task PID tree-key switches prio wait-time sum-exec sum-sleep [255357.941871] ---------------------------------------------------------------------------------------------------------- [255357.953922] watchdog/25 134 -11.937918 63846 0 0.000000 925.476891 0.000000 1 / [255357.966421] migration/25 135 0.000000 40287 0 0.000000 1362.838797 0.000000 1 / [255357.978908] ksoftirqd/25 136 1743407.805153 19345 120 0.000000 537.578251 0.000000 1 / [255357.991407] kworker/25:0H 138 6384.286685 9 100 0.000000 0.060928 0.000000 1 / [255358.003943] netns 172 223.973544 2 100 0.000000 0.013164 0.000000 1 / [255358.016437] writeback 174 247.998287 2 100 0.000000 0.013158 0.000000 1 / [255358.028929] kintegrityd 175 260.008851 2 100 0.000000 0.011744 0.000000 1 / [255358.041429] bioset 176 272.020189 2 100 0.000000 0.012480 0.000000 1 / [255358.053925] bioset 177 284.031452 2 100 0.000000 0.012363 0.000000 1 / [255358.066440] bioset 178 296.050589 2 100 0.000000 0.020331 0.000000 1 / [255358.078919] kblockd 179 308.061267 2 100 0.000000 0.011792 0.000000 1 / [255358.091403] md 181 332.082129 2 100 0.000000 0.012196 0.000000 1 / [255358.103894] edac-poller 182 344.093891 2 100 0.000000 0.012968 0.000000 1 / [255358.116382] watchdogd 183 356.104196 2 100 0.000000 0.011405 0.000000 1 / [255358.128882] kswapd1 191 573.095655 3 120 0.000000 0.056391 0.000000 1 / [255358.141376] ksmd 192 464.430205 2 125 0.000000 0.015985 0.000000 1 / [255358.153861] crypto 194 488.635809 2 100 0.000000 0.019951 0.000000 1 / [255358.166365] kthrotld 202 585.053812 2 100 0.000000 0.012975 0.000000 1 / [255358.178853] kmpath_rdacd 207 622.192722 2 100 0.000000 0.011692 0.000000 1 / [255358.191359] kaluad 208 634.202815 2 100 0.000000 0.010536 0.000000 1 / [255358.203862] kpsmoused 211 658.222936 2 100 0.000000 0.012244 0.000000 1 / [255358.216362] ipv6_addrconf 212 670.235712 2 100 0.000000 0.014101 0.000000 1 / [255358.228863] deferwq 226 790.680164 2 100 0.000000 0.026666 0.000000 1 / [255358.241352] kworker/25:1 252 1744047.946534 27326 120 0.000000 1248.117961 0.000000 1 / [255358.253845] kdmflush 1479 3220.451310 2 100 0.000000 0.005896 0.000000 1 / [255358.266333] spl_system_task 2183 4860.356391 2 100 0.000000 0.010097 0.000000 1 / [255358.278830] spl_delay_taskq 2184 4872.362318 2 100 0.000000 0.009156 0.000000 1 / [255358.291323] spl_dynamic_tas 2185 4884.365943 2 100 0.000000 0.006744 0.000000 1 / [255358.303817] spl_kmem_cache 2186 5223.208471 3 100 0.000000 0.124416 0.000000 1 / [255358.316322] arc_prune 2239 5189.401713 2 120 0.000000 0.066164 0.000000 1 / [255358.328818] zthr_procedure 2240 5201.879067 2 139 0.000000 0.016585 0.000000 1 / [255358.341306] dbu_evict 2242 5222.632548 2 120 0.000000 0.095311 0.000000 1 / [255358.353812] z_vdev_file 2257 5364.203678 2 139 0.000000 0.074243 0.000000 1 / [255358.366310] gmain 2404 6144.121301 2 120 0.000000 0.249209 0.000000 1 / [255358.378818] polkitd 2412 6195.730667 1 120 0.000000 0.171686 0.000000 1 / [255358.391304] JS GC Helper 2413 6207.966736 4 120 0.000000 0.236075 0.000000 1 / [255358.403802] kworker/25:1H 2482 1738445.521786 399 100 0.000000 4.524890 0.000000 1 / [255358.416319] mlx4_en 2532 6666.724030 2 100 0.000000 0.049445 0.000000 1 / [255358.428832] mlx5_ib_sigerr_ 2561 6854.528312 2 100 0.000000 0.066120 0.000000 1 / [255358.441320] ipoib_wq 2630 7130.257810 2 100 0.000000 0.065017 0.000000 1 / [255358.453830] ipoib_wq 2631 7142.326695 2 100 0.000000 0.071019 0.000000 1 / [255358.466344] rdma_cm 2655 7259.610090 2 100 0.000000 0.028556 0.000000 1 / [255358.478866] tuned 3314 452013.635806 26 120 0.000000 13.251262 0.000000 1 / [255358.491352] automount 3595 12565.492629 4 120 0.000000 0.748728 0.000000 1 / [255358.503882] automount 3600 12614.053705 1 120 0.000000 0.976930 0.000000 1 / [255358.516385] agetty 3424 12090.985115 8 120 0.000000 32.995924 0.000000 1 / [255358.528892] ldiskfs-rsv-con 5232 22780.864599 2 100 0.000000 0.062028 0.000000 1 / [255358.541386] ldlm_elt 5247 22937.570496 2 120 0.000000 0.013338 0.000000 1 / [255358.553883] mdt_attr01_000 5264 23094.665938 2 120 0.000000 0.114397 0.000000 1 / [255358.566380] mdt_attr01_001 5265 23106.728050 2 120 0.000000 0.062118 0.000000 1 / [255358.578866] mdt_seqs_0000 5270 23167.121113 2 120 0.000000 0.083129 0.000000 1 / [255358.591372] mdt_seqs_0001 5271 23179.150524 2 120 0.000000 0.029417 0.000000 1 / [255358.603894] mdt_fld_0000 5274 23215.377688 2 120 0.000000 0.079818 0.000000 1 / [255358.616391] mdt_fld_0001 5275 23227.406758 2 120 0.000000 0.029076 0.000000 1 / [255358.628873] osp-syn-4-3 5313 1631091.012528 62681 120 0.000000 1614.644675 0.000000 1 / [255358.641365] mdt01_006 18339 752915.950504 5200 120 0.000000 457.306493 0.000000 1 / [255358.653851] ldlm_cn01_017 18371 1637821.930529 70339 120 0.000000 2704.891882 0.000000 1 / [255358.666348] ldlm_cn01_022 18376 1638408.838452 50061 120 0.000000 2065.344934 0.000000 1 / [255358.678835] mdt_rdpg01_004 18477 1596433.783010 26376 120 0.000000 887.118084 0.000000 1 / [255358.691355] mdt_out01_005 18571 1436120.900558 182518 120 0.000000 10356.562189 0.000000 1 / [255358.703834] ldlm_cn01_023 19411 1637815.303370 62545 120 0.000000 2351.320673 0.000000 1 / [255358.716322] ldiskfs-rsv-con 49634 452062.052370 2 100 0.000000 0.060348 0.000000 1 / [255358.728823] osp_up0-2 49637 452162.320917 2 120 0.000000 0.134665 0.000000 1 / [255358.741304] osp_up1-2 49639 452186.527780 2 120 0.000000 0.111844 0.000000 1 / [255358.753812] osp_up3-2 49641 452210.735117 2 120 0.000000 0.058627 0.000000 1 / [255358.766303] osp-pre-2-2 49648 452664.394141 4 120 0.000000 0.180856 0.000000 1 / [255358.778788] osp-pre-10-2 49664 452664.329647 4 120 0.000000 0.046151 0.000000 1 / [255358.791281] osp-pre-14-2 49672 452664.330280 4 120 0.000000 0.055682 0.000000 1 / [255358.803768] dist_txn-2 49680 452432.562659 2 120 0.000000 0.096226 0.000000 1 / [255358.816268] kworker/25:0 108777 1738444.533357 5 120 0.000000 0.052256 0.000000 1 / [255358.830646] cpu#26, 2693.549 MHz [255358.834348] .nr_running : 0 [255358.839601] .load : 0 [255358.844853] .nr_switches : 42241259 [255358.850787] .nr_load_updates : 6017382 [255358.856645] .nr_uninterruptible : 74 [255358.861996] .next_balance : 4550.043718 [255358.868232] .curr->pid : 0 [255358.873499] .clock : 255358869.564014 [255358.880206] .cpu_load[0] : 0 [255358.885474] .cpu_load[1] : 0 [255358.890728] .cpu_load[2] : 0 [255358.895980] .cpu_load[3] : 0 [255358.901234] .cpu_load[4] : 0 [255358.906499] .avg_idle : 1000000 [255358.912341] .max_idle_balance_cost : 500000 [255358.919855] cfs_rq[26]:/ [255358.922779] .exec_clock : 0.000000 [255358.928708] .MIN_vruntime : 0.000001 [255358.934636] .min_vruntime : 372722.459450 [255358.941048] .max_vruntime : 0.000001 [255358.946976] .spread : 0.000000 [255358.952903] .spread0 : 284841.425648 [255358.959315] .nr_spread_over : 0 [255358.964583] .nr_running : 0 [255358.969832] .load : 0 [255358.975080] .runnable_load_avg : 0 [255358.980341] .blocked_load_avg : 0 [255358.985589] .tg_load_avg : 0 [255358.990837] .tg_load_contrib : 0 [255358.996085] .tg_runnable_contrib : 0 [255359.001334] .tg->runnable_avg : 0 [255359.006583] .tg->cfs_bandwidth.timer_active: 0 [255359.011832] .throttled : 0 [255359.017094] .throttle_count : 0 [255359.022344] .avg->runnable_avg_sum : 0 [255359.027604] .avg->runnable_avg_period : 47561 [255359.035003] rt_rq[26]:/ [255359.037828] .rt_nr_running : 0 [255359.043076] .rt_throttled : 0 [255359.048327] .rt_time : 0.014055 [255359.054254] .rt_runtime : 950.000000 [255359.062157] runnable tasks: [255359.065369] task PID tree-key switches prio wait-time sum-exec sum-sleep [255359.077501] ---------------------------------------------------------------------------------------------------------- [255359.089558] watchdog/26 139 -11.937320 63847 0 0.000000 890.495143 0.000000 1 / [255359.102034] migration/26 140 0.000000 3819 0 0.000000 1012.829027 0.000000 1 / [255359.114532] ksoftirqd/26 141 372698.056275 5947 120 0.000000 177.833869 0.000000 1 / [255359.127039] kworker/26:0H 143 1477.301253 9 100 0.000000 0.047685 0.000000 1 / [255359.139524] kworker/26:1 247 372710.478248 11381 120 0.000000 209.042401 0.000000 1 / [255359.152018] kworker/26:1H 2125 324037.422091 1081 100 0.000000 13.202523 0.000000 1 / [255359.164504] mcelog 2437 2114.307929 1 120 0.000000 1.495390 0.000000 1 / [255359.177034] tuned 3390 3117.611720 4 120 0.000000 1.625370 0.000000 1 / [255359.189545] munged 3100 2917.626300 1 120 0.000000 0.029876 0.000000 1 / [255359.202030] munged 3101 2929.634855 1 120 0.000000 0.008561 0.000000 1 / [255359.214540] ptlrpcd_01_13 5227 372710.538436 264615 120 0.000000 10565.984087 0.000000 1 / [255359.227031] ldlm_cn01_000 5242 343405.817465 67153 120 0.000000 2738.824261 0.000000 1 / [255359.239519] ldlm_cn01_002 5244 343529.046356 59874 120 0.000000 2369.581730 0.000000 1 / [255359.252054] ldlm_cn01_003 18334 354477.647960 56284 120 0.000000 2244.182290 0.000000 1 / [255359.264543] mdt_io01_003 98997 332307.942907 400 120 0.000000 31.357271 0.000000 1 / [255359.277057] kworker/26:0 90676 336002.456906 5 120 0.000000 0.030036 0.000000 1 / [255359.291336] cpu#27, 2693.549 MHz [255359.295030] .nr_running : 0 [255359.300283] .load : 0 [255359.305547] .nr_switches : 107877023 [255359.311575] .nr_load_updates : 8976279 [255359.317423] .nr_uninterruptible : 86 [255359.322785] .next_balance : 4550.044179 [255359.329019] .curr->pid : 0 [255359.334292] .clock : 255359331.516665 [255359.341000] .cpu_load[0] : 0 [255359.346253] .cpu_load[1] : 0 [255359.351531] .cpu_load[2] : 0 [255359.356785] .cpu_load[3] : 0 [255359.362040] .cpu_load[4] : 0 [255359.367298] .avg_idle : 1000000 [255359.373134] .max_idle_balance_cost : 500000 [255359.380641] cfs_rq[27]:/ [255359.383555] .exec_clock : 0.000000 [255359.389485] .MIN_vruntime : 0.000001 [255359.395413] .min_vruntime : 672650.456954 [255359.401826] .max_vruntime : 0.000001 [255359.407755] .spread : 0.000000 [255359.413683] .spread0 : 584769.423152 [255359.420100] .nr_spread_over : 0 [255359.425350] .nr_running : 0 [255359.430600] .load : 0 [255359.435854] .runnable_load_avg : 0 [255359.441105] .blocked_load_avg : 0 [255359.446347] .tg_load_avg : 0 [255359.451597] .tg_load_contrib : 0 [255359.456846] .tg_runnable_contrib : 0 [255359.462096] .tg->runnable_avg : 0 [255359.467346] .tg->cfs_bandwidth.timer_active: 0 [255359.472594] .throttled : 0 [255359.477842] .throttle_count : 0 [255359.483090] .avg->runnable_avg_sum : 0 [255359.488340] .avg->runnable_avg_period : 47245 [255359.495737] rt_rq[27]:/ [255359.498568] .rt_nr_running : 0 [255359.503816] .rt_throttled : 0 [255359.509064] .rt_time : 0.000000 [255359.514991] .rt_runtime : 950.000000 [255359.522870] runnable tasks: [255359.526083] task PID tree-key switches prio wait-time sum-exec sum-sleep [255359.538216] ---------------------------------------------------------------------------------------------------------- [255359.550255] watchdog/27 144 -11.937173 63847 0 0.000000 898.806456 0.000000 1 / [255359.562741] migration/27 145 0.000000 893 0 0.000000 980.816779 0.000000 1 / [255359.575244] ksoftirqd/27 146 667023.253470 881 120 0.000000 22.463524 0.000000 1 / [255359.587751] kworker/27:0 147 235455.886311 25 120 0.000000 0.150361 0.000000 1 / [255359.600243] kworker/27:0H 148 871.406152 9 100 0.000000 0.052794 0.000000 1 / [255359.612740] kworker/27:1 249 667027.351395 19853 120 0.000000 379.338159 0.000000 1 / [255359.625222] kworker/27:1H 2126 638765.601601 562 100 0.000000 6.190675 0.000000 1 / [255359.637720] gssproxy 2486 1026.266584 1 120 0.000000 0.048666 0.000000 1 / [255359.650216] ptlrpcd_01_07 5221 672638.840558 265724 120 0.000000 10654.938928 0.000000 1 / [255359.662728] osp-syn-9-3 5327 638029.484783 59732 120 0.000000 1070.605336 0.000000 1 / [255359.675255] mdt_out01_002 5374 553555.853597 161926 120 0.000000 10385.361917 0.000000 1 / [255359.687771] ldlm_cn01_016 18370 640881.260298 75854 120 0.000000 2925.772138 0.000000 1 / [255359.700271] ldlm_cb01_002 18573 554053.087206 36201 120 0.000000 953.474037 0.000000 1 / [255359.712794] mdt_out01_017 102178 416714.927043 111850 120 0.000000 6462.498946 0.000000 1 / [255359.727168] cpu#28, 2693.549 MHz [255359.730881] .nr_running : 0 [255359.736135] .load : 0 [255359.741399] .nr_switches : 97626042 [255359.747332] .nr_load_updates : 8262755 [255359.753168] .nr_uninterruptible : 35 [255359.758520] .next_balance : 4550.044611 [255359.764744] .curr->pid : 0 [255359.769997] .clock : 255359769.448564 [255359.776717] .cpu_load[0] : 0 [255359.781969] .cpu_load[1] : 0 [255359.787222] .cpu_load[2] : 0 [255359.792475] .cpu_load[3] : 0 [255359.797735] .cpu_load[4] : 0 [255359.802988] .avg_idle : 1000000 [255359.808824] .max_idle_balance_cost : 500000 [255359.816332] cfs_rq[28]:/ [255359.819254] .exec_clock : 0.000000 [255359.825181] .MIN_vruntime : 0.000001 [255359.831127] .min_vruntime : 477267.262781 [255359.837561] .max_vruntime : 0.000001 [255359.843488] .spread : 0.000000 [255359.849424] .spread0 : 389386.228979 [255359.855835] .nr_spread_over : 0 [255359.861096] .nr_running : 0 [255359.866345] .load : 0 [255359.871594] .runnable_load_avg : 0 [255359.876843] .blocked_load_avg : 0 [255359.882104] .tg_load_avg : 0 [255359.887354] .tg_load_contrib : 0 [255359.892602] .tg_runnable_contrib : 0 [255359.897851] .tg->runnable_avg : 0 [255359.903101] .tg->cfs_bandwidth.timer_active: 0 [255359.908349] .throttled : 0 [255359.913611] .throttle_count : 0 [255359.918858] .avg->runnable_avg_sum : 0 [255359.924107] .avg->runnable_avg_period : 46787 [255359.931505] rt_rq[28]:/ [255359.934334] .rt_nr_running : 0 [255359.939584] .rt_throttled : 0 [255359.944832] .rt_time : 0.000000 [255359.950761] .rt_runtime : 950.000000 [255359.958638] runnable tasks: [255359.961852] task PID tree-key switches prio wait-time sum-exec sum-sleep [255359.973987] ---------------------------------------------------------------------------------------------------------- [255359.986026] watchdog/28 149 -11.935569 63847 0 0.000000 916.182624 0.000000 1 / [255359.998515] migration/28 150 0.000000 1341 0 0.000000 983.269771 0.000000 1 / [255360.010997] ksoftirqd/28 151 387228.963345 479 120 0.000000 13.806840 0.000000 1 / [255360.023509] kworker/28:0H 153 2220.278766 9 100 0.000000 0.080343 0.000000 1 / [255360.035997] kworker/28:1 246 477255.294424 3444 120 0.000000 60.801109 0.000000 1 / [255360.048505] irqbalance 2416 477267.262781 26530 120 0.000000 230920.494795 0.000000 1 / [255360.061013] atd 3402 432391.989293 73 120 0.000000 10.536894 0.000000 1 / [255360.073502] kworker/28:1H 5065 283596.983989 122 100 0.000000 1.047166 0.000000 1 / [255360.085997] ldlm_cn01_005 18341 407351.630131 72632 120 0.000000 2893.657076 0.000000 1 / [255360.098509] ldlm_cn01_006 18354 407389.544241 57798 120 0.000000 2261.597925 0.000000 1 / [255360.110999] ldlm_cn01_012 18366 407388.809955 64306 120 0.000000 2478.318328 0.000000 1 / [255360.123495] ldlm_cn01_013 18367 407351.062089 48382 120 0.000000 1911.670628 0.000000 1 / [255360.136003] mdt_rdpg01_010 18489 398276.090965 30051 120 0.000000 1237.521903 0.000000 1 / [255360.148488] mdt_out01_011 18744 351851.660630 150047 120 0.000000 8716.139142 0.000000 1 / [255360.160987] mdt_out01_019 103491 351846.145251 43403 120 0.000000 2411.704723 0.000000 1 / [255360.173590] kworker/28:0 113609 130661.069993 3 120 0.000000 0.016768 0.000000 1 / [255360.187933] cpu#29, 2693.549 MHz [255360.191628] .nr_running : 0 [255360.196881] .load : 0 [255360.202135] .nr_switches : 106901002 [255360.208176] .nr_load_updates : 8596438 [255360.214011] .nr_uninterruptible : 51 [255360.219362] .next_balance : 4550.045074 [255360.225598] .curr->pid : 0 [255360.230852] .clock : 255360227.477329 [255360.237560] .cpu_load[0] : 0 [255360.242811] .cpu_load[1] : 0 [255360.248064] .cpu_load[2] : 0 [255360.253322] .cpu_load[3] : 0 [255360.258589] .cpu_load[4] : 0 [255360.263844] .avg_idle : 1000000 [255360.269681] .max_idle_balance_cost : 500000 [255360.277182] cfs_rq[29]:/ [255360.280117] .exec_clock : 0.000000 [255360.286048] .MIN_vruntime : 0.000001 [255360.291976] .min_vruntime : 501608.675574 [255360.298401] .max_vruntime : 0.000001 [255360.304328] .spread : 0.000000 [255360.310264] .spread0 : 413727.596269 [255360.316690] .nr_spread_over : 0 [255360.321939] .nr_running : 0 [255360.327187] .load : 0 [255360.332435] .runnable_load_avg : 0 [255360.337684] .blocked_load_avg : 0 [255360.342932] .tg_load_avg : 0 [255360.348190] .tg_load_contrib : 0 [255360.353440] .tg_runnable_contrib : 0 [255360.358697] .tg->runnable_avg : 0 [255360.363949] .tg->cfs_bandwidth.timer_active: 0 [255360.369199] .throttled : 0 [255360.374449] .throttle_count : 0 [255360.379699] .avg->runnable_avg_sum : 0 [255360.384949] .avg->runnable_avg_period : 46816 [255360.392357] rt_rq[29]:/ [255360.395189] .rt_nr_running : 0 [255360.400438] .rt_throttled : 0 [255360.405686] .rt_time : 0.000000 [255360.411612] .rt_runtime : 950.000000 [255360.419493] runnable tasks: [255360.422704] task PID tree-key switches prio wait-time sum-exec sum-sleep [255360.434836] ---------------------------------------------------------------------------------------------------------- [255360.446875] watchdog/29 154 -11.934768 63847 0 0.000000 887.200105 0.000000 1 / [255360.459375] migration/29 155 0.000000 698 0 0.000000 973.595876 0.000000 1 / [255360.471870] ksoftirqd/29 156 470111.463519 678 120 0.000000 21.821612 0.000000 1 / [255360.484373] kworker/29:0H 158 2211.435639 9 100 0.000000 0.067383 0.000000 1 / [255360.496871] kworker/29:1 248 501596.688796 2951 120 0.000000 56.915594 0.000000 1 / [255360.509371] ata_sff 903 146.011178 2 100 0.000000 0.006618 0.000000 1 / [255360.521871] zed 2468 1451.734103 1 120 0.000000 0.030346 0.000000 1 / [255360.534388] kworker/29:1H 5083 396616.430655 352 100 0.000000 3.871518 0.000000 1 / [255360.546876] ptlrpcd_01_08 5222 501596.885850 256639 120 0.000000 10994.782804 0.000000 1 / [255360.559361] mdt01_002 5257 431112.509264 237384 120 0.000000 18284.245780 0.000000 1 / [255360.571871] mdt_out01_000 5268 377277.825068 252573 120 0.000000 15769.090753 0.000000 1 / [255360.584375] mdt_io01_000 5279 425068.834020 462 120 0.000000 35.202303 0.000000 1 / [255360.596881] ldlm_cn01_014 18368 435795.245256 54746 120 0.000000 2194.375093 0.000000 1 / [255360.609381] ldlm_cn01_019 18373 435795.360477 48092 120 0.000000 1930.398814 0.000000 1 / [255360.621883] mdt_out01_006 18572 219859.634150 151969 120 0.000000 8981.621328 0.000000 1 / [255360.634379] mdt_rdpg01_012 102997 424960.515649 16928 120 0.000000 655.646142 0.000000 1 / [255360.646985] kworker/29:2 123990 122917.423394 3 120 0.000000 0.057084 0.000000 1 / [255360.661362] cpu#30, 2693.549 MHz [255360.665063] .nr_running : 0 [255360.670315] .load : 0 [255360.675576] .nr_switches : 86079302 [255360.681511] .nr_load_updates : 7641363 [255360.687355] .nr_uninterruptible : 83 [255360.692709] .next_balance : 4550.045546 [255360.698955] .curr->pid : 0 [255360.704202] .clock : 255360704.196337 [255360.710917] .cpu_load[0] : 1024 [255360.716459] .cpu_load[1] : 136 [255360.721907] .cpu_load[2] : 43 [255360.727258] .cpu_load[3] : 41 [255360.732619] .cpu_load[4] : 139 [255360.738066] .avg_idle : 70628 [255360.743708] .max_idle_balance_cost : 500000 [255360.751206] cfs_rq[30]:/ [255360.754128] .exec_clock : 0.000000 [255360.760057] .MIN_vruntime : 0.000001 [255360.766006] .min_vruntime : 408397.604881 [255360.772417] .max_vruntime : 0.000001 [255360.778344] .spread : 0.000000 [255360.784271] .spread0 : 320516.413777 [255360.790683] .nr_spread_over : 0 [255360.795932] .nr_running : 0 [255360.801185] .load : 0 [255360.806437] .runnable_load_avg : 0 [255360.811685] .blocked_load_avg : 57 [255360.817031] .tg_load_avg : 0 [255360.822280] .tg_load_contrib : 0 [255360.827542] .tg_runnable_contrib : 0 [255360.832790] .tg->runnable_avg : 0 [255360.838040] .tg->cfs_bandwidth.timer_active: 0 [255360.843290] .throttled : 0 [255360.848544] .throttle_count : 0 [255360.853793] .avg->runnable_avg_sum : 2791 [255360.859353] .avg->runnable_avg_period : 46276 [255360.866743] rt_rq[30]:/ [255360.869567] .rt_nr_running : 0 [255360.874815] .rt_throttled : 0 [255360.880064] .rt_time : 0.000000 [255360.885993] .rt_runtime : 950.000000 [255360.893880] runnable tasks: [255360.897093] task PID tree-key switches prio wait-time sum-exec sum-sleep [255360.909226] ---------------------------------------------------------------------------------------------------------- [255360.921266] watchdog/30 159 -11.934143 63847 0 0.000000 877.387241 0.000000 1 / [255360.933768] migration/30 160 0.000000 586 0 0.000000 972.072368 0.000000 1 / [255360.946267] ksoftirqd/30 161 380962.352921 310 120 0.000000 20.319873 0.000000 1 / [255360.958750] kworker/30:0 162 -8.950819 21 120 0.000000 0.099867 0.000000 1 / [255360.971248] kworker/30:0H 163 2852.764177 9 100 0.000000 0.095873 0.000000 1 / [255360.983757] kworker/30:1 250 407367.101131 2911 120 0.000000 49.521395 0.000000 1 / [255360.996238] scsi_eh_3 1017 1619.674592 23 120 0.000000 0.514585 0.000000 1 / [255361.008740] kiblnd_sd_01_01 5192 408413.948011 515537380 120 0.000000 4574244.034396 0.000000 1 / [255361.021258] mdt01_004 18330 217749.152932 94831 120 0.000000 6618.795538 0.000000 1 / [255361.033762] ldlm_cn01_020 18374 380874.239612 66376 120 0.000000 2699.630854 0.000000 1 / [255361.046245] kworker/30:1H 18380 302753.236180 120 100 0.000000 1.279228 0.000000 1 / [255361.058732] mdt_rdpg01_008 18484 344940.742175 25908 120 0.000000 1499.125958 0.000000 1 / [255361.071233] ldlm_cb01_005 4338 302777.166126 33258 120 0.000000 882.691127 0.000000 1 / [255361.085508] cpu#31, 2693.549 MHz [255361.089210] .nr_running : 0 [255361.094476] .load : 0 [255361.099731] .nr_switches : 129522775 [255361.105760] .nr_load_updates : 9711457 [255361.111597] .nr_uninterruptible : 149 [255361.117044] .next_balance : 4550.045973 [255361.123278] .curr->pid : 0 [255361.128532] .clock : 255361128.413692 [255361.135245] .cpu_load[0] : 0 [255361.140499] .cpu_load[1] : 0 [255361.145752] .cpu_load[2] : 0 [255361.151017] .cpu_load[3] : 0 [255361.156270] .cpu_load[4] : 0 [255361.161535] .avg_idle : 1000000 [255361.167371] .max_idle_balance_cost : 500000 [255361.174902] cfs_rq[31]:/ [255361.177823] .exec_clock : 0.000000 [255361.183751] .MIN_vruntime : 0.000001 [255361.189679] .min_vruntime : 612322.398148 [255361.196098] .max_vruntime : 0.000001 [255361.202026] .spread : 0.000000 [255361.207955] .spread0 : 524441.159661 [255361.214368] .nr_spread_over : 0 [255361.219625] .nr_running : 0 [255361.224876] .load : 0 [255361.230125] .runnable_load_avg : 0 [255361.235386] .blocked_load_avg : 0 [255361.240636] .tg_load_avg : 0 [255361.245886] .tg_load_contrib : 0 [255361.251136] .tg_runnable_contrib : 0 [255361.256384] .tg->runnable_avg : 0 [255361.261631] .tg->cfs_bandwidth.timer_active: 0 [255361.266881] .throttled : 0 [255361.272131] .throttle_count : 0 [255361.277401] .avg->runnable_avg_sum : 0 [255361.282649] .avg->runnable_avg_period : 48015 [255361.290047] rt_rq[31]:/ [255361.292878] .rt_nr_running : 0 [255361.298127] .rt_throttled : 0 [255361.303376] .rt_time : 0.000000 [255361.309324] .rt_runtime : 950.000000 [255361.317225] runnable tasks: [255361.320437] task PID tree-key switches prio wait-time sum-exec sum-sleep [255361.332570] ---------------------------------------------------------------------------------------------------------- [255361.344611] watchdog/31 164 -11.938546 63847 0 0.000000 875.537797 0.000000 1 / [255361.357098] migration/31 165 0.000000 529 0 0.000000 666.480363 0.000000 1 / [255361.369605] ksoftirqd/31 166 535422.299379 520 120 0.000000 21.363754 0.000000 1 / [255361.382128] kworker/31:0H 168 4156.687743 10 100 0.000000 0.092306 0.000000 1 / [255361.394614] kworker/31:1 251 604424.128298 2034 120 0.000000 39.476067 0.000000 1 / [255361.407099] scsi_eh_0 1005 894.203141 2 120 0.000000 0.022055 0.000000 1 / [255361.419592] scsi_tmf_0 1006 906.207593 2 100 0.000000 0.005379 0.000000 1 / [255361.432092] scsi_tmf_1 1011 918.214496 2 100 0.000000 0.007827 0.000000 1 / [255361.444588] mlx4 1012 930.237055 2 100 0.000000 0.023748 0.000000 1 / [255361.457078] scsi_wq_1 1013 942.249080 2 100 0.000000 0.010040 0.000000 1 / [255361.469563] mlx4_health 1014 954.244149 2 100 0.000000 0.004373 0.000000 1 / [255361.482081] scsi_tmf_2 1016 978.278951 2 100 0.000000 0.005378 0.000000 1 / [255361.494588] scsi_tmf_3 1018 1002.287417 2 100 0.000000 0.004623 0.000000 1 / [255361.507081] scsi_tmf_4 1020 1026.295658 2 100 0.000000 0.004825 0.000000 1 / [255361.519565] scsi_tmf_5 1022 1050.304157 2 100 0.000000 0.004679 0.000000 1 / [255361.532070] scsi_tmf_6 1024 1074.312617 2 100 0.000000 0.005083 0.000000 1 / [255361.544559] scsi_tmf_7 1026 1098.320650 2 100 0.000000 0.005565 0.000000 1 / [255361.557059] ttm_swap 1033 1146.415559 2 100 0.000000 0.087104 0.000000 1 / [255361.569548] ib_mad2 1070 1260.432585 2 100 0.000000 0.048329 0.000000 1 / [255361.582053] to_fifo 1071 1272.520714 2 100 0.000000 0.090114 0.000000 1 / [255361.594573] osp-pre-3-3 5312 612310.423416 50392 120 0.000000 2164.124450 0.000000 1 / [255361.607058] osp-pre-12-3 5335 612310.422283 50391 120 0.000000 1934.180528 0.000000 1 / [255361.619550] ldlm_cn01_004 18337 551279.385969 71275 120 0.000000 2807.608361 0.000000 1 / [255361.632036] mdt01_012 18350 331595.746657 91154 120 0.000000 6349.852905 0.000000 1 / [255361.644536] kworker/31:1H 18574 535422.256004 313 100 0.000000 3.152186 0.000000 1 / [255361.657049] kworker/31:2 24019 8865.488472 2 120 0.000000 0.048258 0.000000 1 / [255361.669536] mdt_io01_007 99272 535288.656211 412 120 0.000000 31.364754 0.000000 1 / [255361.684314] INFO: rcu_sched detected stalls on CPUs/tasks: { 13} (detected by 13, t=6 jiffies, g=8760926, c=8760925, q=97456) [255361.697120] Task dump for CPU 13: [255361.700907] systemd-journal R running task 0 1203 1 0x00000000 [255361.708894] Call Trace: [255361.711721] [] sched_show_task+0xa8/0x110 [255361.718840] [] dump_cpu_task+0x39/0x70 [255361.724964] [] rcu_dump_cpu_stacks+0x90/0xd0 [255361.731669] [] rcu_check_callbacks+0x6f2/0x730 [255361.738569] [] ? tick_sched_do_timer+0x50/0x50 [255361.745459] [] update_process_times+0x46/0x80 [255361.752262] [] tick_sched_handle+0x30/0x70 [255361.758780] [] tick_sched_timer+0x39/0x80 [255361.765196] [] __hrtimer_run_queues+0x10e/0x270 [255361.772204] [] hrtimer_interrupt+0xaf/0x1d0 [255361.778824] [] local_apic_timer_interrupt+0x3b/0x60 [255361.786208] [] smp_apic_timer_interrupt+0x43/0x60 [255361.793389] [] apic_timer_interrupt+0x16a/0x170 [255361.800382] [] ? format_decode+0x295/0x3c0 [255361.807581] [] ? putname+0xa/0x60 [255361.813218] [] user_path_at_empty+0x72/0xc0 [255361.819826] [] ? devkmsg_read+0x2b2/0x480 [255361.826244] [] ? kmem_cache_alloc+0x35/0x1f0 [255361.832949] [] ? prepare_creds+0x26/0x1c0 [255361.839371] [] user_path_at+0x11/0x20 [255361.845397] [] SyS_faccessat+0xb2/0x230 [255361.851620] [] ? system_call_after_swapgs+0xa2/0x146 [255361.859112] [] ? system_call_after_swapgs+0xa2/0x146 [255361.866601] [] ? system_call_after_swapgs+0xae/0x146 [255361.874081] [] SyS_access+0x18/0x20 [255361.879911] [] system_call_fastpath+0x25/0x2a [255361.886734] [] ? system_call_after_swapgs+0xae/0x146 [255432.442366] LustreError: 49683:0:(llog.c:723:llog_process_thread()) soaked-MDT0001-osp-MDT0002 retry remote llog process [255432.454633] LustreError: 49683:0:(llog.c:723:llog_process_thread()) Skipped 33238 previous similar messages