[ 0.000000] microcode: microcode updated early to revision 0x710, date = 2013-06-17 [ 0.000000] Initializing cgroup subsys cpuset [ 0.000000] Initializing cgroup subsys cpu [ 0.000000] Initializing cgroup subsys cpuacct [ 0.000000] Linux version 3.10.0-514.10.2.el7.x86_64 (builder@kbuilder.dev.centos.org) (gcc version 4.8.5 20150623 (Red Hat 4.8.5-11) (GCC) ) #1 SMP Fri Mar 3 00:04:05 UTC 2017 [ 0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-0-rescue-0fdca7a4842946dda019dc44fc14bdee root=UUID=1882ec04-7425-4b77-a7e0-b0dd4b0890aa ro crashkernel=320M console=tty0 console=ttyS0,115200 net.ifnames=0 [ 0.000000] e820: BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008ffff] usable [ 0.000000] BIOS-e820: [mem 0x0000000000090000-0x000000000009ffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bb3c6fff] usable [ 0.000000] BIOS-e820: [mem 0x00000000bb3c7000-0x00000000bdd2efff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000bdd2f000-0x00000000bddccfff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x00000000bddcd000-0x00000000bdea0fff] ACPI data [ 0.000000] BIOS-e820: [mem 0x00000000bdea1000-0x00000000bdf2efff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x00000000bdf2f000-0x00000000bdfabfff] ACPI data [ 0.000000] BIOS-e820: [mem 0x00000000bdfac000-0x00000000bdffffff] usable [ 0.000000] BIOS-e820: [mem 0x00000000be000000-0x00000000cfffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fec00000-0x00000000fec00fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed19000-0x00000000fed19fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fee00000-0x00000000fee00fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ffa20000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000083fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 2.6 present. [ 0.000000] DMI: Intel Corporation S2600GZ ........../S2600GZ, BIOS SE5C600.86B.01.08.0003.022620131521 02/26/2013 [ 0.000000] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved [ 0.000000] e820: remove [mem 0x000a0000-0x000fffff] usable [ 0.000000] e820: last_pfn = 0x840000 max_arch_pfn = 0x400000000 [ 0.000000] MTRR default type: uncachable [ 0.000000] MTRR fixed ranges enabled: [ 0.000000] 00000-9FFFF write-back [ 0.000000] A0000-BFFFF uncachable [ 0.000000] C0000-D3FFF write-through [ 0.000000] D4000-D7FFF write-protect [ 0.000000] D8000-E7FFF uncachable [ 0.000000] E8000-FFFFF write-protect [ 0.000000] MTRR variable ranges enabled: [ 0.000000] 0 base 000000000000 mask 3FFF80000000 write-back [ 0.000000] 1 base 000080000000 mask 3FFFC0000000 write-back [ 0.000000] 2 base 000100000000 mask 3FFF00000000 write-back [ 0.000000] 3 base 000200000000 mask 3FFE00000000 write-back [ 0.000000] 4 base 000400000000 mask 3FFC00000000 write-back [ 0.000000] 5 base 000800000000 mask 3FFFC0000000 write-back [ 0.000000] 6 base 0000FF800000 mask 3FFFFF800000 write-protect [ 0.000000] 7 disabled [ 0.000000] 8 disabled [ 0.000000] 9 disabled [ 0.000000] x86 PAT enabled: cpu 0, old 0x7040600070406, new 0x7010600070106 [ 0.000000] e820: last_pfn = 0xbe000 max_arch_pfn = 0x400000000 [ 0.000000] found SMP MP-table at [mem 0x000fcdb0-0x000fcdbf] mapped at [ffff8800000fcdb0] [ 0.000000] Base memory trampoline at [ffff88000008a000] 8a000 size 24576 [ 0.000000] Using GB pages for direct mapping [ 0.000000] BRK [0x01f9e000, 0x01f9efff] PGTABLE [ 0.000000] BRK [0x01f9f000, 0x01f9ffff] PGTABLE [ 0.000000] BRK [0x01fa0000, 0x01fa0fff] PGTABLE [ 0.000000] BRK [0x01fa1000, 0x01fa1fff] PGTABLE [ 0.000000] RAMDISK: [mem 0x32317000-0x35183fff] [ 0.000000] ACPI: RSDP 00000000000f0410 00024 (v02 INTEL ) [ 0.000000] ACPI: XSDT 00000000bdfa9d98 000BC (v01 INTEL S2600GZ 06222004 INTL 20090903) [ 0.000000] ACPI: FACP 00000000bdfa9918 000F4 (v04 INTEL S2600GZ 06222004 INTL 20090903) [ 0.000000] ACPI BIOS Warning (bug): Invalid length for FADT/Pm1aControlBlock: 32, using default 16 (20130517/tbfadt-668) [ 0.000000] ACPI: DSDT 00000000bdf8f018 18762 (v02 INTEL S2600GZ 00000008 INTL 20100331) [ 0.000000] ACPI: FACS 00000000bdfa9f40 00040 [ 0.000000] ACPI: APIC 00000000bdfa8018 00BAA (v03 INTEL S2600GZ 06222004 INTL 20090903) [ 0.000000] ACPI: SPMI 00000000bdfabb18 00040 (v05 INTEL S2600GZ 06222004 INTL 20090903) [ 0.000000] ACPI: MCFG 00000000bdfaba98 0003C (v01 INTEL S2600GZ 06222004 INTL 20090903) [ 0.000000] ACPI: WDDT 00000000bdfabf18 00040 (v01 INTEL S2600GZ 06222004 INTL 20090903) [ 0.000000] ACPI: SRAT 00000000bdf8cc18 002A8 (v03 INTEL S2600GZ 06222004 INTL 20090903) [ 0.000000] ACPI: SLIT 00000000bdfabe98 00030 (v01 INTEL S2600GZ 06222004 INTL 20090903) [ 0.000000] ACPI: MSCT 00000000bdfaae18 00090 (v01 INTEL S2600GZ 06222004 INTL 20090903) [ 0.000000] ACPI: HPET 00000000bdfabe18 00038 (v01 INTEL S2600GZ 06222004 INTL 20090903) [ 0.000000] ACPI: SSDT 00000000bdfabd18 0002B (v02 INTEL S2600GZ 00001000 INTL 20100331) [ 0.000000] ACPI: SSDT 00000000bddcd018 D30C8 (v02 INTEL S2600GZ 00004000 INTL 20100331) [ 0.000000] ACPI: SPCR 00000000bdfabd98 00050 (v01 INTEL S2600GZ 06222004 INTL 20090903) [ 0.000000] ACPI: HEST 00000000bdf8ef18 000A8 (v01 INTEL S2600GZ 00000001 INTL 00000001) [ 0.000000] ACPI: BERT 00000000bdfabc18 00030 (v01 INTEL S2600GZ 00000001 INTL 00000001) [ 0.000000] ACPI: ERST 00000000bdf8ec98 00230 (v01 INTEL S2600GZ 00000001 INTL 00000001) [ 0.000000] ACPI: EINJ 00000000bdfa9798 00130 (v01 INTEL S2600GZ 00000001 INTL 00000001) [ 0.000000] ACPI: SSDT 00000000bdf8a018 01729 (v02 INTEL S2600GZ 00000002 INTL 20100331) [ 0.000000] ACPI: SSDT 00000000bdfabc98 00045 (v02 INTEL S2600GZ 00000001 INTL 20100331) [ 0.000000] ACPI: SSDT 00000000bdf8de18 00181 (v02 INTEL S2600GZ 00000003 INTL 20100331) [ 0.000000] ACPI: Local APIC address 0xfee00000 [ 0.000000] SRAT: PXM 0 -> APIC 0x00 -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x01 -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x02 -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x03 -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x04 -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x05 -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x06 -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x07 -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x08 -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x09 -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x0a -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x0b -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x0c -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x0d -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x0e -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x0f -> Node 0 [ 0.000000] SRAT: PXM 1 -> APIC 0x20 -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x21 -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x22 -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x23 -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x24 -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x25 -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x26 -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x27 -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x28 -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x29 -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x2a -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x2b -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x2c -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x2d -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x2e -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x2f -> Node 1 [ 0.000000] SRAT: Node 0 PXM 0 [mem 0x00000000-0xbfffffff] [ 0.000000] SRAT: Node 0 PXM 0 [mem 0x100000000-0x43fffffff] [ 0.000000] SRAT: Node 1 PXM 1 [mem 0x440000000-0x83fffffff] [ 0.000000] NUMA: Initialized distance table, cnt=2 [ 0.000000] NUMA: Node 0 [mem 0x00000000-0xbfffffff] + [mem 0x100000000-0x43fffffff] -> [mem 0x00000000-0x43fffffff] [ 0.000000] Initmem setup node 0 [mem 0x00000000-0x43fffffff] [ 0.000000] NODE_DATA [mem 0x43ffd9000-0x43fffffff] [ 0.000000] Initmem setup node 1 [mem 0x440000000-0x83fffffff] [ 0.000000] NODE_DATA [mem 0x83ffd6000-0x83fffcfff] [ 0.000000] Reserving 320MB of memory at 480MB for crashkernel (System RAM: 32691MB) [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x00001000-0x00ffffff] [ 0.000000] DMA32 [mem 0x01000000-0xffffffff] [ 0.000000] Normal [mem 0x100000000-0x83fffffff] [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x00001000-0x0008ffff] [ 0.000000] node 0: [mem 0x00100000-0xbb3c6fff] [ 0.000000] node 0: [mem 0xbdfac000-0xbdffffff] [ 0.000000] node 0: [mem 0x100000000-0x43fffffff] [ 0.000000] node 1: [mem 0x440000000-0x83fffffff] [ 0.000000] On node 0 totalpages: 4174762 [ 0.000000] DMA zone: 64 pages used for memmap [ 0.000000] DMA zone: 21 pages reserved [ 0.000000] DMA zone: 3983 pages, LIFO batch:0 [ 0.000000] DMA32 zone: 11921 pages used for memmap [ 0.000000] DMA32 zone: 762907 pages, LIFO batch:31 [ 0.000000] Normal zone: 53248 pages used for memmap [ 0.000000] Normal zone: 3407872 pages, LIFO batch:31 [ 0.000000] On node 1 totalpages: 4194304 [ 0.000000] Normal zone: 65536 pages used for memmap [ 0.000000] Normal zone: 4194304 pages, LIFO batch:31 [ 0.000000] ACPI: PM-Timer IO Port: 0x408 [ 0.000000] ACPI: Local APIC address 0xfee00000 [ 0.000000] ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x01] lapic_id[0x02] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x02] lapic_id[0x04] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x03] lapic_id[0x06] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x04] lapic_id[0x08] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x05] lapic_id[0x0a] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x06] lapic_id[0x0c] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x07] lapic_id[0x0e] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x08] lapic_id[0x20] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x09] lapic_id[0x22] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x24] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x26] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x0c] lapic_id[0x28] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x0d] lapic_id[0x2a] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x0e] lapic_id[0x2c] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x0f] lapic_id[0x2e] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x10] lapic_id[0x01] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x11] lapic_id[0x03] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x12] lapic_id[0x05] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x13] lapic_id[0x07] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x14] lapic_id[0x09] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x15] lapic_id[0x0b] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x16] lapic_id[0x0d] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x17] lapic_id[0x0f] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x18] lapic_id[0x21] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x19] lapic_id[0x23] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x1a] lapic_id[0x25] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x1b] lapic_id[0x27] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x1c] lapic_id[0x29] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x1d] lapic_id[0x2b] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x1e] lapic_id[0x2d] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x1f] lapic_id[0x2f] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x20] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x21] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x22] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x23] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x24] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x25] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x26] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x27] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x28] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x29] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x2a] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x2b] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x2c] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x2d] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x2e] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x2f] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x30] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x31] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x32] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x33] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x34] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x35] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x36] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x37] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x38] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x39] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x3a] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x3b] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x3c] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x3d] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x3e] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x3f] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x40] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x41] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x42] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x43] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x44] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x45] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x46] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x47] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x48] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x49] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x4a] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x4b] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x4c] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x4d] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x4e] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x4f] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x50] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x51] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x52] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x53] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x54] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x55] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x56] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x57] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x58] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x59] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x5a] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x5b] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x5c] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x5d] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x5e] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x5f] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x60] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x61] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x62] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x63] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x64] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x65] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x66] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x67] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x68] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x69] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x6a] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x6b] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x6c] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x6d] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x6e] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x6f] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x70] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x71] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x72] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x73] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x74] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x75] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x76] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x77] lapic_id[0xff] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x00] uid[0x00] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x01] uid[0x01] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x02] uid[0x02] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x03] uid[0x03] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x04] uid[0x04] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x05] uid[0x05] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x06] uid[0x06] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x07] uid[0x07] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x08] uid[0x08] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x09] uid[0x09] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x0a] uid[0x0a] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x0b] uid[0x0b] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x0c] uid[0x0c] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x0d] uid[0x0d] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x0e] uid[0x0e] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x0f] uid[0x0f] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x10] uid[0x10] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x11] uid[0x11] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x12] uid[0x12] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x13] uid[0x13] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x14] uid[0x14] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x15] uid[0x15] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x16] uid[0x16] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x17] uid[0x17] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x18] uid[0x18] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x19] uid[0x19] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x1a] uid[0x1a] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x1b] uid[0x1b] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x1c] uid[0x1c] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x1d] uid[0x1d] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x1e] uid[0x1e] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x1f] uid[0x1f] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x20] uid[0x20] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x21] uid[0x21] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x22] uid[0x22] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x23] uid[0x23] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x24] uid[0x24] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x25] uid[0x25] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x26] uid[0x26] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x27] uid[0x27] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x28] uid[0x28] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x29] uid[0x29] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x2a] uid[0x2a] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x2b] uid[0x2b] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x2c] uid[0x2c] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x2d] uid[0x2d] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x2e] uid[0x2e] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x2f] uid[0x2f] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x30] uid[0x30] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x31] uid[0x31] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x32] uid[0x32] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x33] uid[0x33] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x34] uid[0x34] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x35] uid[0x35] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x36] uid[0x36] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x37] uid[0x37] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x38] uid[0x38] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x39] uid[0x39] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x3a] uid[0x3a] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x3b] uid[0x3b] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x3c] uid[0x3c] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x3d] uid[0x3d] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x3e] uid[0x3e] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x3f] uid[0x3f] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x40] uid[0x40] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x41] uid[0x41] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x42] uid[0x42] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x43] uid[0x43] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x44] uid[0x44] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x45] uid[0x45] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x46] uid[0x46] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x47] uid[0x47] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x48] uid[0x48] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x49] uid[0x49] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x4a] uid[0x4a] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x4b] uid[0x4b] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x4c] uid[0x4c] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x4d] uid[0x4d] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x4e] uid[0x4e] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x4f] uid[0x4f] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x50] uid[0x50] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x51] uid[0x51] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x52] uid[0x52] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x53] uid[0x53] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x54] uid[0x54] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x55] uid[0x55] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x56] uid[0x56] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x57] uid[0x57] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x58] uid[0x58] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x59] uid[0x59] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x5a] uid[0x5a] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x5b] uid[0x5b] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x5c] uid[0x5c] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x5d] uid[0x5d] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x5e] uid[0x5e] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x5f] uid[0x5f] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x60] uid[0x60] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x61] uid[0x61] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x62] uid[0x62] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x63] uid[0x63] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x64] uid[0x64] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x65] uid[0x65] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x66] uid[0x66] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x67] uid[0x67] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x68] uid[0x68] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x69] uid[0x69] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x6a] uid[0x6a] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x6b] uid[0x6b] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x6c] uid[0x6c] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x6d] uid[0x6d] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x6e] uid[0x6e] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x6f] uid[0x6f] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x70] uid[0x70] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x71] uid[0x71] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x72] uid[0x72] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x73] uid[0x73] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x74] uid[0x74] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x75] uid[0x75] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x76] uid[0x76] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x77] uid[0x77] disabled) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) [ 0.000000] ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0]) [ 0.000000] IOAPIC[0]: apic_id 0, version 32, address 0xfec00000, GSI 0-23 [ 0.000000] ACPI: IOAPIC (id[0x01] address[0xfec3f000] gsi_base[24]) [ 0.000000] IOAPIC[1]: apic_id 1, version 32, address 0xfec3f000, GSI 24-47 [ 0.000000] ACPI: IOAPIC (id[0x02] address[0xfec7f000] gsi_base[48]) [ 0.000000] IOAPIC[2]: apic_id 2, version 32, address 0xfec7f000, GSI 48-71 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.000000] ACPI: IRQ0 used by override. [ 0.000000] ACPI: IRQ9 used by override. [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.000000] smpboot: Allowing 240 CPUs, 208 hotplug CPUs [ 0.000000] PM: Registered nosave memory: [mem 0x00090000-0x0009ffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000dffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.000000] PM: Registered nosave memory: [mem 0xbb3c7000-0xbdd2efff] [ 0.000000] PM: Registered nosave memory: [mem 0xbdd2f000-0xbddccfff] [ 0.000000] PM: Registered nosave memory: [mem 0xbddcd000-0xbdea0fff] [ 0.000000] PM: Registered nosave memory: [mem 0xbdea1000-0xbdf2efff] [ 0.000000] PM: Registered nosave memory: [mem 0xbdf2f000-0xbdfabfff] [ 0.000000] PM: Registered nosave memory: [mem 0xbe000000-0xcfffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xd0000000-0xfebfffff] [ 0.000000] PM: Registered nosave memory: [mem 0xfec00000-0xfec00fff] [ 0.000000] PM: Registered nosave memory: [mem 0xfec01000-0xfed18fff] [ 0.000000] PM: Registered nosave memory: [mem 0xfed19000-0xfed19fff] [ 0.000000] PM: Registered nosave memory: [mem 0xfed1a000-0xfed1bfff] [ 0.000000] PM: Registered nosave memory: [mem 0xfed1c000-0xfed1ffff] [ 0.000000] PM: Registered nosave memory: [mem 0xfed20000-0xfedfffff] [ 0.000000] PM: Registered nosave memory: [mem 0xfee00000-0xfee00fff] [ 0.000000] PM: Registered nosave memory: [mem 0xfee01000-0xffa1ffff] [ 0.000000] PM: Registered nosave memory: [mem 0xffa20000-0xffffffff] [ 0.000000] e820: [mem 0xd0000000-0xfebfffff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on bare hardware [ 0.000000] setup_percpu: NR_CPUS:5120 nr_cpumask_bits:240 nr_cpu_ids:240 nr_node_ids:2 [ 0.000000] PERCPU: Embedded 33 pages/cpu @ffff88042e000000 s96728 r8192 d30248 u262144 [ 0.000000] pcpu-alloc: s96728 r8192 d30248 u262144 alloc=1*2097152 [ 0.000000] pcpu-alloc: [0] 000 001 002 003 004 005 006 007 [ 0.000000] pcpu-alloc: [0] 016 017 018 019 020 021 022 023 [ 0.000000] pcpu-alloc: [0] 032 034 036 038 040 042 044 046 [ 0.000000] pcpu-alloc: [0] 048 050 052 054 056 058 060 062 [ 0.000000] pcpu-alloc: [0] 064 066 068 070 072 074 076 078 [ 0.000000] pcpu-alloc: [0] 080 082 084 086 088 090 092 094 [ 0.000000] pcpu-alloc: [0] 096 098 100 102 104 106 108 110 [ 0.000000] pcpu-alloc: [0] 112 114 116 118 120 122 124 126 [ 0.000000] pcpu-alloc: [0] 128 130 132 134 136 138 140 142 [ 0.000000] pcpu-alloc: [0] 144 146 148 150 152 154 156 158 [ 0.000000] pcpu-alloc: [0] 160 162 164 166 168 170 172 174 [ 0.000000] pcpu-alloc: [0] 176 178 180 182 184 186 188 190 [ 0.000000] pcpu-alloc: [0] 192 194 196 198 200 202 204 206 [ 0.000000] pcpu-alloc: [0] 208 210 212 214 216 218 220 222 [ 0.000000] pcpu-alloc: [0] 224 226 228 230 232 234 236 238 [ 0.000000] pcpu-alloc: [1] 008 009 010 011 012 013 014 015 [ 0.000000] pcpu-alloc: [1] 024 025 026 027 028 029 030 031 [ 0.000000] pcpu-alloc: [1] 033 035 037 039 041 043 045 047 [ 0.000000] pcpu-alloc: [1] 049 051 053 055 057 059 061 063 [ 0.000000] pcpu-alloc: [1] 065 067 069 071 073 075 077 079 [ 0.000000] pcpu-alloc: [1] 081 083 085 087 089 091 093 095 [ 0.000000] pcpu-alloc: [1] 097 099 101 103 105 107 109 111 [ 0.000000] pcpu-alloc: [1] 113 115 117 119 121 123 125 127 [ 0.000000] pcpu-alloc: [1] 129 131 133 135 137 139 141 143 [ 0.000000] pcpu-alloc: [1] 145 147 149 151 153 155 157 159 [ 0.000000] pcpu-alloc: [1] 161 163 165 167 169 171 173 175 [ 0.000000] pcpu-alloc: [1] 177 179 181 183 185 187 189 191 [ 0.000000] pcpu-alloc: [1] 193 195 197 199 201 203 205 207 [ 0.000000] pcpu-alloc: [1] 209 211 213 215 217 219 221 223 [ 0.000000] pcpu-alloc: [1] 225 227 229 231 233 235 237 239 [ 0.000000] Built 2 zonelists in Zone order, mobility grouping on. Total pages: 8238276 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-0-rescue-0fdca7a4842946dda019dc44fc14bdee root=UUID=1882ec04-7425-4b77-a7e0-b0dd4b0890aa ro crashkernel=320M console=tty0 console=ttyS0,115200 net.ifnames=0 [ 0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes) [ 0.000000] x86/fpu: xstate_offset[2]: 0240, xstate_sizes[2]: 0100 [ 0.000000] xsave: enabled xstate_bv 0x7, cntxt size 0x340 using standard form [ 0.000000] Memory: 6804976k/34603008k available (6765k kernel code, 1126744k absent, 1014032k reserved, 4432k data, 1680k init) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=240, Nodes=2 [ 0.000000] Hierarchical RCU implementation. [ 0.000000] RCU restricting CPUs from NR_CPUS=5120 to nr_cpu_ids=240. [ 0.000000] NR_IRQS:327936 nr_irqs:3160 0 [ 0.000000] Console: colour VGA+ 80x25 [ 0.000000] console [tty0] enabled [ 0.000000] console [ttyS0] enabled [ 0.000000] allocated 134217728 bytes of page_cgroup [ 0.000000] please try 'cgroup_disable=memory' option if you don't want memory cgroups [ 0.000000] Enabling automatic NUMA balancing. Configure with numa_balancing= or the kernel.numa_balancing sysctl [ 0.000000] hpet clockevent registered [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 2693.319 MHz processor [ 0.000102] Calibrating delay loop (skipped), value calculated using timer frequency.. 5386.63 BogoMIPS (lpj=2693319) [ 0.012539] pid_max: default: 245760 minimum: 1920 [ 0.018822] Security Framework initialized [ 0.023685] SELinux: Initializing. [ 0.027929] SELinux: Starting in permissive mode [ 0.030411] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes) [ 0.045649] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes) [ 0.056959] Mount-cache hash table entries: 4096 [ 0.064015] Initializing cgroup subsys memory [ 0.069219] Initializing cgroup subsys devices [ 0.074463] Initializing cgroup subsys freezer [ 0.079708] Initializing cgroup subsys net_cls [ 0.084954] Initializing cgroup subsys blkio [ 0.090005] Initializing cgroup subsys perf_event [ 0.095572] Initializing cgroup subsys hugetlb [ 0.100818] Initializing cgroup subsys pids [ 0.105776] Initializing cgroup subsys net_prio [ 0.111391] CPU: Physical Processor ID: 0 [ 0.116151] CPU: Processor Core ID: 0 [ 0.120526] mce: CPU supports 20 MCE banks [ 0.125412] CPU0: Thermal monitoring enabled (TM1) [ 0.131064] Last level iTLB entries: 4KB 512, 2MB 0, 4MB 0 [ 0.137468] Last level dTLB entries: 4KB 512, 2MB 32, 4MB 32 [ 0.144074] tlb_flushall_shift: 6 [ 0.148202] Freeing SMP alternatives: 28k freed [ 0.155014] ACPI: Core revision 20130517 [ 0.197990] ACPI: All ACPI Tables successfully acquired [ 0.221222] ftrace: allocating 25810 entries in 101 pages [ 0.239992] smpboot: APIC(0) Converting physical 0 to logical package 0 [ 0.247671] smpboot: APIC(20) Converting physical 1 to logical package 1 [ 0.255453] smpboot: Max logical packages: 30 [ 0.261246] IRQ remapping doesn't support X2APIC mode, disable x2apic. [ 0.268899] Switched APIC routing to physical flat. [ 0.275252] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.292244] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2680 0 @ 2.70GHz (fam: 06, model: 2d, stepping: 07) [ 0.303373] TSC deadline timer enabled [ 0.303405] Performance Events: PEBS fmt1+, 16-deep LBR, SandyBridge events, full-width counters, Intel PMU driver. [ 0.315967] ... version: 3 [ 0.320719] ... bit width: 48 [ 0.325569] ... generic registers: 4 [ 0.330324] ... value mask: 0000ffffffffffff [ 0.336533] ... max period: 0000ffffffffffff [ 0.342742] ... fixed-purpose events: 3 [ 0.347483] ... event mask: 000000070000000f [ 0.374315] NMI watchdog: enabled on all CPUs, permanently consumes one hw-PMU counter. [ 0.358431] smpboot: Booting Node 0, Processors #1 #2 #3 #4 #5 #6 #7 OK [ 0.411228] smpboot: Booting Node 1, Processors #8 #9 #10 #11 #12 #13 #14 #15 OK [ 0.542284] smpboot: Booting Node 0, Processors #16 #17 #18 #19 #20 #21 #22 #23 OK [ 0.576769] smpboot: Booting Node 1, Processors #24 #25 #26 #27 #28 #29 #30 #31 [ 0.617216] Brought up 32 CPUs [ 0.621375] smpboot: Total of 32 processors activated (172448.99 BogoMIPS) [ 0.745240] node 0 initialised, 2813971 pages in 60ms [ 0.852265] node 1 initialised, 3600339 pages in 161ms [ 0.859832] devtmpfs: initialized [ 0.872158] EVM: security.selinux [ 0.876142] EVM: security.ima [ 0.879739] EVM: security.capability [ 0.884276] PM: Registering ACPI NVS region [mem 0xbdd2f000-0xbddccfff] (647168 bytes) [ 0.893640] PM: Registering ACPI NVS region [mem 0xbdea1000-0xbdf2efff] (581632 bytes) [ 0.905515] atomic64 test passed for x86-64 platform with CX8 and with SSE [ 0.913497] pinctrl core: initialized pinctrl subsystem [ 0.920554] NET: Registered protocol family 16 [ 0.926273] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 0.935230] ACPI: bus type PCI registered [ 0.940001] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.948018] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0xc0000000-0xcfffffff] (base 0xc0000000) [ 0.958929] PCI: MMCONFIG at [mem 0xc0000000-0xcfffffff] reserved in E820 [ 0.966839] PCI: Using configuration type 1 for base access [ 0.973405] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on [ 0.991809] ACPI: Added _OSI(Module Device) [ 0.996778] ACPI: Added _OSI(Processor Device) [ 1.002033] ACPI: Added _OSI(3.0 _SCP Extensions) [ 1.007580] ACPI: Added _OSI(Processor Aggregator Device) [ 1.032277] ACPI: EC: Look up EC in DSDT [ 1.051000] ACPI: Executed 1 blocks of module-level executable AML code [ 1.321814] [Firmware Bug]: ACPI: BIOS _OSI(Linux) query ignored [ 1.354529] ACPI: Interpreter enabled [ 1.358944] ACPI: (supports S0 S1 S5) [ 1.363323] ACPI: Using IOAPIC for interrupt routing [ 1.369259] HEST: Table parsing has been initialized. [ 1.375198] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 1.437773] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-7e]) [ 1.444983] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI] [ 1.455118] acpi PNP0A08:00: _OSC: platform does not support [AER] [ 1.462707] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.471764] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.481680] acpi PNP0A08:00: ignoring host bridge window [mem 0x000d0000-0x000d3fff window] (conflicts with Adapter ROM [mem 0x000c8000-0x000d1bff]) [ 1.497416] PCI host bridge to bus 0000:00 [ 1.502285] pci_bus 0000:00: root bus resource [bus 00-7e] [ 1.508709] pci_bus 0000:00: root bus resource [io 0x0000-0xbfff window] [ 1.516589] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 1.525449] pci_bus 0000:00: root bus resource [mem 0x000c0000-0x000c3fff window] [ 1.534307] pci_bus 0000:00: root bus resource [mem 0x000c4000-0x000c7fff window] [ 1.543168] pci_bus 0000:00: root bus resource [mem 0x000c8000-0x000cbfff window] [ 1.552027] pci_bus 0000:00: root bus resource [mem 0x000cc000-0x000cffff window] [ 1.560886] pci_bus 0000:00: root bus resource [mem 0x000d4000-0x000d7fff window] [ 1.569748] pci_bus 0000:00: root bus resource [mem 0x000d8000-0x000dbfff window] [ 1.578607] pci_bus 0000:00: root bus resource [mem 0x000dc000-0x000dffff window] [ 1.587477] pci_bus 0000:00: root bus resource [mem 0x000e0000-0x000e3fff window] [ 1.596336] pci_bus 0000:00: root bus resource [mem 0x000e4000-0x000e7fff window] [ 1.605194] pci_bus 0000:00: root bus resource [mem 0x000e8000-0x000ebfff window] [ 1.614057] pci_bus 0000:00: root bus resource [mem 0x000ec000-0x000effff window] [ 1.622915] pci_bus 0000:00: root bus resource [mem 0x000f0000-0x000fffff window] [ 1.631780] pci_bus 0000:00: root bus resource [mem 0xd0000000-0xebffffff window] [ 1.640637] pci_bus 0000:00: root bus resource [mem 0x380000000000-0x38007fffffff window] [ 1.650293] pci 0000:00:00.0: [8086:3c00] type 00 class 0x060000 [ 1.650385] pci 0000:00:00.0: PME# supported from D0 D3hot D3cold [ 1.650532] pci 0000:00:01.0: [8086:3c02] type 01 class 0x060400 [ 1.650625] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 1.650726] pci 0000:00:01.0: System wakeup disabled by ACPI [ 1.657398] pci 0000:00:01.1: [8086:3c03] type 01 class 0x060400 [ 1.657491] pci 0000:00:01.1: PME# supported from D0 D3hot D3cold [ 1.657589] pci 0000:00:01.1: System wakeup disabled by ACPI [ 1.664268] pci 0000:00:02.0: [8086:3c04] type 01 class 0x060400 [ 1.664361] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 1.664460] pci 0000:00:02.0: System wakeup disabled by ACPI [ 1.671127] pci 0000:00:02.2: [8086:3c06] type 01 class 0x060400 [ 1.671221] pci 0000:00:02.2: PME# supported from D0 D3hot D3cold [ 1.671319] pci 0000:00:02.2: System wakeup disabled by ACPI [ 1.677993] pci 0000:00:03.0: [8086:3c08] type 01 class 0x060400 [ 1.678089] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 1.678194] pci 0000:00:03.0: System wakeup disabled by ACPI [ 1.684860] pci 0000:00:03.2: [8086:3c0a] type 01 class 0x060400 [ 1.684953] pci 0000:00:03.2: PME# supported from D0 D3hot D3cold [ 1.685051] pci 0000:00:03.2: System wakeup disabled by ACPI [ 1.691724] pci 0000:00:04.0: [8086:3c20] type 00 class 0x088000 [ 1.691749] pci 0000:00:04.0: reg 0x10: [mem 0x38007e790000-0x38007e793fff 64bit] [ 1.691943] pci 0000:00:04.1: [8086:3c21] type 00 class 0x088000 [ 1.691966] pci 0000:00:04.1: reg 0x10: [mem 0x38007e780000-0x38007e783fff 64bit] [ 1.692156] pci 0000:00:04.2: [8086:3c22] type 00 class 0x088000 [ 1.692178] pci 0000:00:04.2: reg 0x10: [mem 0x38007e770000-0x38007e773fff 64bit] [ 1.692370] pci 0000:00:04.3: [8086:3c23] type 00 class 0x088000 [ 1.692392] pci 0000:00:04.3: reg 0x10: [mem 0x38007e760000-0x38007e763fff 64bit] [ 1.692589] pci 0000:00:04.4: [8086:3c24] type 00 class 0x088000 [ 1.692611] pci 0000:00:04.4: reg 0x10: [mem 0x38007e750000-0x38007e753fff 64bit] [ 1.692809] pci 0000:00:04.5: [8086:3c25] type 00 class 0x088000 [ 1.692831] pci 0000:00:04.5: reg 0x10: [mem 0x38007e740000-0x38007e743fff 64bit] [ 1.693021] pci 0000:00:04.6: [8086:3c26] type 00 class 0x088000 [ 1.693043] pci 0000:00:04.6: reg 0x10: [mem 0x38007e730000-0x38007e733fff 64bit] [ 1.693237] pci 0000:00:04.7: [8086:3c27] type 00 class 0x088000 [ 1.693259] pci 0000:00:04.7: reg 0x10: [mem 0x38007e720000-0x38007e723fff 64bit] [ 1.693443] pci 0000:00:05.0: [8086:3c28] type 00 class 0x088000 [ 1.693625] pci 0000:00:05.2: [8086:3c2a] type 00 class 0x088000 [ 1.693809] pci 0000:00:05.4: [8086:3c2c] type 00 class 0x080020 [ 1.693826] pci 0000:00:05.4: reg 0x10: [mem 0xd1460000-0xd1460fff] [ 1.694029] pci 0000:00:16.0: [8086:1d3a] type 00 class 0x078000 [ 1.694055] pci 0000:00:16.0: reg 0x10: [mem 0xd1450000-0xd145000f 64bit] [ 1.694139] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 1.694267] pci 0000:00:16.1: [8086:1d3b] type 00 class 0x078000 [ 1.694292] pci 0000:00:16.1: reg 0x10: [mem 0xd1440000-0xd144000f 64bit] [ 1.694375] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 1.694517] pci 0000:00:1a.0: [8086:1d2d] type 00 class 0x0c0320 [ 1.694541] pci 0000:00:1a.0: reg 0x10: [mem 0xd1420000-0xd14203ff] [ 1.694645] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 1.694759] pci 0000:00:1a.0: System wakeup disabled by ACPI [ 1.701433] pci 0000:00:1c.0: [8086:1d10] type 01 class 0x060400 [ 1.701557] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 1.701650] pci 0000:00:1c.0: System wakeup disabled by ACPI [ 1.708315] pci 0000:00:1c.7: [8086:1d1e] type 01 class 0x060400 [ 1.708410] pci 0000:00:1c.7: PME# supported from D0 D3hot D3cold [ 1.708502] pci 0000:00:1c.7: System wakeup disabled by ACPI [ 1.715173] pci 0000:00:1d.0: [8086:1d26] type 00 class 0x0c0320 [ 1.715197] pci 0000:00:1d.0: reg 0x10: [mem 0xd1410000-0xd14103ff] [ 1.715303] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 1.715408] pci 0000:00:1d.0: System wakeup disabled by ACPI [ 1.722076] pci 0000:00:1e.0: [8086:244e] type 01 class 0x060401 [ 1.722221] pci 0000:00:1e.0: System wakeup disabled by ACPI [ 1.728888] pci 0000:00:1f.0: [8086:1d41] type 00 class 0x060100 [ 1.729130] pci 0000:00:1f.2: [8086:1d02] type 00 class 0x010601 [ 1.729152] pci 0000:00:1f.2: reg 0x10: [io 0x4070-0x4077] [ 1.729164] pci 0000:00:1f.2: reg 0x14: [io 0x4060-0x4063] [ 1.729175] pci 0000:00:1f.2: reg 0x18: [io 0x4050-0x4057] [ 1.729187] pci 0000:00:1f.2: reg 0x1c: [io 0x4040-0x4043] [ 1.729201] pci 0000:00:1f.2: reg 0x20: [io 0x4020-0x403f] [ 1.729213] pci 0000:00:1f.2: reg 0x24: [mem 0xd1400000-0xd14007ff] [ 1.729266] pci 0000:00:1f.2: PME# supported from D3hot [ 1.729394] pci 0000:00:1f.3: [8086:1d22] type 00 class 0x0c0500 [ 1.729416] pci 0000:00:1f.3: reg 0x10: [mem 0x38007e710000-0x38007e7100ff 64bit] [ 1.729445] pci 0000:00:1f.3: reg 0x20: [io 0x4000-0x401f] [ 1.729663] pci 0000:01:00.0: [8086:1d74] type 01 class 0x060400 [ 1.729682] pci 0000:01:00.0: reg 0x10: [mem 0xd1200000-0xd1203fff] [ 1.729759] pci 0000:01:00.0: PME# supported from D0 D3hot D3cold [ 1.731861] pci 0000:00:01.0: PCI bridge to [bus 01-03] [ 1.737996] pci 0000:00:01.0: bridge window [io 0x3000-0x3fff] [ 1.738003] pci 0000:00:01.0: bridge window [mem 0xd1100000-0xd12fffff] [ 1.738011] pci 0000:00:01.0: bridge window [mem 0x38007e800000-0x38007f1fffff 64bit pref] [ 1.738108] pci 0000:02:08.0: [8086:1d3f] type 01 class 0x060400 [ 1.738220] pci 0000:02:08.0: PME# supported from D0 D3hot D3cold [ 1.738328] pci 0000:01:00.0: PCI bridge to [bus 02-03] [ 1.744461] pci 0000:01:00.0: bridge window [io 0x3000-0x3fff] [ 1.744467] pci 0000:01:00.0: bridge window [mem 0xd1100000-0xd11fffff] [ 1.744476] pci 0000:01:00.0: bridge window [mem 0x38007e800000-0x38007f1fffff 64bit pref] [ 1.744601] pci 0000:03:00.0: [8086:1d6a] type 00 class 0x010700 [ 1.744628] pci 0000:03:00.0: reg 0x10: [mem 0x38007f000000-0x38007f007fff 64bit pref] [ 1.744647] pci 0000:03:00.0: reg 0x18: [mem 0x38007e800000-0x38007effffff 64bit pref] [ 1.744660] pci 0000:03:00.0: reg 0x20: [io 0x3100-0x31ff] [ 1.744673] pci 0000:03:00.0: reg 0x24: [io 0x3000-0x30ff] [ 1.744785] pci 0000:03:00.0: reg 0x164: [mem 0x38007f010000-0x38007f017fff 64bit pref] [ 1.744790] pci 0000:03:00.0: VF(n) BAR0 space: [mem 0x38007f010000-0x38007f107fff 64bit pref] (contains BAR0 for 31 VFs) [ 1.757749] pci 0000:03:00.3: [8086:1d70] type 00 class 0x0c0500 [ 1.757771] pci 0000:03:00.3: reg 0x10: [mem 0xd1110000-0xd1110fff] [ 1.757817] pci 0000:03:00.3: reg 0x20: [io 0x3220-0x323f] [ 1.757902] pci 0000:03:00.3: PME# supported from D0 D3hot D3cold [ 1.757993] pci 0000:03:00.4: [8086:1d71] type 00 class 0x0c0500 [ 1.758015] pci 0000:03:00.4: reg 0x10: [mem 0xd1100000-0xd1100fff] [ 1.758061] pci 0000:03:00.4: reg 0x20: [io 0x3200-0x321f] [ 1.758144] pci 0000:03:00.4: PME# supported from D0 D3hot D3cold [ 1.758255] pci 0000:02:08.0: PCI bridge to [bus 03] [ 1.764097] pci 0000:02:08.0: bridge window [io 0x3000-0x3fff] [ 1.764104] pci 0000:02:08.0: bridge window [mem 0xd1100000-0xd11fffff] [ 1.764113] pci 0000:02:08.0: bridge window [mem 0x38007e800000-0x38007f1fffff 64bit pref] [ 1.764264] acpiphp: Slot [2] registered [ 1.768993] pci 0000:04:00.0: [8086:1521] type 00 class 0x020000 [ 1.769011] pci 0000:04:00.0: reg 0x10: [mem 0xd0f60000-0xd0f7ffff] [ 1.769030] pci 0000:04:00.0: reg 0x18: [io 0x2060-0x207f] [ 1.769041] pci 0000:04:00.0: reg 0x1c: [mem 0xd0fb0000-0xd0fb3fff] [ 1.769151] pci 0000:04:00.0: PME# supported from D0 D3hot D3cold [ 1.769183] pci 0000:04:00.0: reg 0x184: [mem 0xd10a0000-0xd10a3fff] [ 1.769187] pci 0000:04:00.0: VF(n) BAR0 space: [mem 0xd10a0000-0xd10bffff] (contains BAR0 for 8 VFs) [ 1.780014] pci 0000:04:00.0: reg 0x190: [mem 0xd1080000-0xd1083fff] [ 1.780018] pci 0000:04:00.0: VF(n) BAR3 space: [mem 0xd1080000-0xd109ffff] (contains BAR3 for 8 VFs) [ 1.790955] pci 0000:04:00.1: [8086:1521] type 00 class 0x020000 [ 1.790973] pci 0000:04:00.1: reg 0x10: [mem 0xd0f40000-0xd0f5ffff] [ 1.790992] pci 0000:04:00.1: reg 0x18: [io 0x2040-0x205f] [ 1.791004] pci 0000:04:00.1: reg 0x1c: [mem 0xd0fa0000-0xd0fa3fff] [ 1.791107] pci 0000:04:00.1: PME# supported from D0 D3hot D3cold [ 1.791134] pci 0000:04:00.1: reg 0x184: [mem 0xd1060000-0xd1063fff] [ 1.791138] pci 0000:04:00.1: VF(n) BAR0 space: [mem 0xd1060000-0xd107ffff] (contains BAR0 for 8 VFs) [ 1.801963] pci 0000:04:00.1: reg 0x190: [mem 0xd1040000-0xd1043fff] [ 1.801967] pci 0000:04:00.1: VF(n) BAR3 space: [mem 0xd1040000-0xd105ffff] (contains BAR3 for 8 VFs) [ 1.812902] pci 0000:04:00.2: [8086:1521] type 00 class 0x020000 [ 1.812920] pci 0000:04:00.2: reg 0x10: [mem 0xd0f20000-0xd0f3ffff] [ 1.812938] pci 0000:04:00.2: reg 0x18: [io 0x2020-0x203f] [ 1.812950] pci 0000:04:00.2: reg 0x1c: [mem 0xd0f90000-0xd0f93fff] [ 1.813051] pci 0000:04:00.2: PME# supported from D0 D3hot D3cold [ 1.813077] pci 0000:04:00.2: reg 0x184: [mem 0xd1020000-0xd1023fff] [ 1.813081] pci 0000:04:00.2: VF(n) BAR0 space: [mem 0xd1020000-0xd103ffff] (contains BAR0 for 8 VFs) [ 1.823907] pci 0000:04:00.2: reg 0x190: [mem 0xd1000000-0xd1003fff] [ 1.823911] pci 0000:04:00.2: VF(n) BAR3 space: [mem 0xd1000000-0xd101ffff] (contains BAR3 for 8 VFs) [ 1.834845] pci 0000:04:00.3: [8086:1521] type 00 class 0x020000 [ 1.834863] pci 0000:04:00.3: reg 0x10: [mem 0xd0f00000-0xd0f1ffff] [ 1.834882] pci 0000:04:00.3: reg 0x18: [io 0x2000-0x201f] [ 1.834893] pci 0000:04:00.3: reg 0x1c: [mem 0xd0f80000-0xd0f83fff] [ 1.834995] pci 0000:04:00.3: PME# supported from D0 D3hot D3cold [ 1.835021] pci 0000:04:00.3: reg 0x184: [mem 0xd0fe0000-0xd0fe3fff] [ 1.835025] pci 0000:04:00.3: VF(n) BAR0 space: [mem 0xd0fe0000-0xd0ffffff] (contains BAR0 for 8 VFs) [ 1.845850] pci 0000:04:00.3: reg 0x190: [mem 0xd0fc0000-0xd0fc3fff] [ 1.845854] pci 0000:04:00.3: VF(n) BAR3 space: [mem 0xd0fc0000-0xd0fdffff] (contains BAR3 for 8 VFs) [ 1.858683] pci 0000:00:01.1: PCI bridge to [bus 04-05] [ 1.864819] pci 0000:00:01.1: bridge window [io 0x2000-0x2fff] [ 1.864825] pci 0000:00:01.1: bridge window [mem 0xd0f00000-0xd10fffff] [ 1.864978] acpiphp: Slot [2-2] registered [ 1.870083] pci 0000:06:00.0: [15b3:1003] type 00 class 0x028000 [ 1.870362] pci 0000:06:00.0: reg 0x10: [mem 0xd1300000-0xd13fffff 64bit] [ 1.870565] pci 0000:06:00.0: reg 0x18: [mem 0x38007f800000-0x38007fffffff 64bit pref] [ 1.872222] pci 0000:00:02.0: PCI bridge to [bus 06] [ 1.878068] pci 0000:00:02.0: bridge window [mem 0xd1300000-0xd13fffff] [ 1.878077] pci 0000:00:02.0: bridge window [mem 0x38007f800000-0x38007fffffff 64bit pref] [ 1.878213] acpiphp: Slot [2-3] registered [ 1.883117] pci 0000:00:02.2: PCI bridge to [bus 07] [ 1.889099] acpiphp: Slot [2-4] registered [ 1.894013] pci 0000:08:00.0: [1000:0072] type 00 class 0x010700 [ 1.894028] pci 0000:08:00.0: reg 0x10: [io 0x1000-0x10ff] [ 1.894042] pci 0000:08:00.0: reg 0x14: [mem 0xd0dc0000-0xd0dc3fff 64bit] [ 1.894056] pci 0000:08:00.0: reg 0x1c: [mem 0xd0d80000-0xd0dbffff 64bit] [ 1.894073] pci 0000:08:00.0: reg 0x30: [mem 0xd0900000-0xd097ffff pref] [ 1.894140] pci 0000:08:00.0: supports D1 D2 [ 1.894165] pci 0000:08:00.0: reg 0x174: [mem 0xd0dd0000-0xd0dd3fff 64bit] [ 1.894169] pci 0000:08:00.0: VF(n) BAR0 space: [mem 0xd0dd0000-0xd0e0ffff 64bit] (contains BAR0 for 16 VFs) [ 1.905663] pci 0000:08:00.0: reg 0x17c: [mem 0xd0980000-0xd09bffff 64bit] [ 1.905667] pci 0000:08:00.0: VF(n) BAR2 space: [mem 0xd0980000-0xd0d7ffff 64bit] (contains BAR2 for 16 VFs) [ 1.919175] pci 0000:00:03.0: PCI bridge to [bus 08] [ 1.925017] pci 0000:00:03.0: bridge window [io 0x1000-0x1fff] [ 1.925023] pci 0000:00:03.0: bridge window [mem 0xd0900000-0xd0efffff] [ 1.925164] acpiphp: Slot [2-5] registered [ 1.930069] pci 0000:00:03.2: PCI bridge to [bus 09] [ 1.936006] pci 0000:00:1c.0: PCI bridge to [bus 0a] [ 1.941950] pci 0000:0b:00.0: [102b:0522] type 00 class 0x030000 [ 1.941985] pci 0000:0b:00.0: reg 0x10: [mem 0xea000000-0xeaffffff pref] [ 1.942006] pci 0000:0b:00.0: reg 0x14: [mem 0xd0810000-0xd0813fff] [ 1.942027] pci 0000:0b:00.0: reg 0x18: [mem 0xd0000000-0xd07fffff] [ 1.942101] pci 0000:0b:00.0: reg 0x30: [mem 0xd0800000-0xd080ffff pref] [ 1.942227] pci 0000:0b:00.0: System wakeup disabled by ACPI [ 1.950868] pci 0000:00:1c.7: PCI bridge to [bus 0b] [ 1.956713] pci 0000:00:1c.7: bridge window [mem 0xd0000000-0xd08fffff] [ 1.956722] pci 0000:00:1c.7: bridge window [mem 0xea000000-0xeaffffff 64bit pref] [ 1.956825] pci 0000:00:1e.0: PCI bridge to [bus 0c] (subtractive decode) [ 1.964718] pci 0000:00:1e.0: bridge window [io 0x0000-0xbfff window] (subtractive decode) [ 1.964722] pci 0000:00:1e.0: bridge window [mem 0x000a0000-0x000bffff window] (subtractive decode) [ 1.964726] pci 0000:00:1e.0: bridge window [mem 0x000c0000-0x000c3fff window] (subtractive decode) [ 1.964729] pci 0000:00:1e.0: bridge window [mem 0x000c4000-0x000c7fff window] (subtractive decode) [ 1.964732] pci 0000:00:1e.0: bridge window [mem 0x000c8000-0x000cbfff window] (subtractive decode) [ 1.964746] pci 0000:00:1e.0: bridge window [mem 0x000cc000-0x000cffff window] (subtractive decode) [ 1.964749] pci 0000:00:1e.0: bridge window [mem 0x000d4000-0x000d7fff window] (subtractive decode) [ 1.964752] pci 0000:00:1e.0: bridge window [mem 0x000d8000-0x000dbfff window] (subtractive decode) [ 1.964756] pci 0000:00:1e.0: bridge window [mem 0x000dc000-0x000dffff window] (subtractive decode) [ 1.964759] pci 0000:00:1e.0: bridge window [mem 0x000e0000-0x000e3fff window] (subtractive decode) [ 1.964763] pci 0000:00:1e.0: bridge window [mem 0x000e4000-0x000e7fff window] (subtractive decode) [ 1.964766] pci 0000:00:1e.0: bridge window [mem 0x000e8000-0x000ebfff window] (subtractive decode) [ 1.964769] pci 0000:00:1e.0: bridge window [mem 0x000ec000-0x000effff window] (subtractive decode) [ 1.964773] pci 0000:00:1e.0: bridge window [mem 0x000f0000-0x000fffff window] (subtractive decode) [ 1.964776] pci 0000:00:1e.0: bridge window [mem 0xd0000000-0xebffffff window] (subtractive decode) [ 1.964780] pci 0000:00:1e.0: bridge window [mem 0x380000000000-0x38007fffffff window] (subtractive decode) [ 1.964857] pci_bus 0000:00: on NUMA node 0 [ 1.966031] ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 10 *11 12 14 15) [ 1.975039] ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 *5 6 10 11 12 14 15) [ 1.984036] ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 5 6 *10 11 12 14 15) [ 1.993029] ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 10 *11 12 14 15) [ 2.002005] ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 *5 6 10 11 12 14 15) [ 2.010990] ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 10 *11 12 14 15) [ 2.019970] ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 *10 11 12 14 15) [ 2.028958] ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 *10 11 12 14 15) [ 2.038161] ACPI: PCI Root Bridge [PCI1] (domain 0000 [bus 80-fe]) [ 2.045366] acpi PNP0A08:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI] [ 2.055258] acpi PNP0A08:01: _OSC: platform does not support [AER] [ 2.062697] acpi PNP0A08:01: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 2.071755] acpi PNP0A08:01: FADT indicates ASPM is unsupported, using BIOS configuration [ 2.081798] PCI host bridge to bus 0000:80 [ 2.086665] pci_bus 0000:80: root bus resource [bus 80-fe] [ 2.093090] pci_bus 0000:80: root bus resource [io 0x03b0-0x03df window] [ 2.100969] pci_bus 0000:80: root bus resource [io 0xc000-0xffff window] [ 2.108847] pci_bus 0000:80: root bus resource [mem 0x000a0000-0x000bffff window] [ 2.117713] pci_bus 0000:80: root bus resource [mem 0xec000000-0xfbffffff window] [ 2.126576] pci_bus 0000:80: root bus resource [mem 0x380080000000-0x3800ffffffff window] [ 2.136231] pci 0000:80:01.0: [8086:3c02] type 01 class 0x060400 [ 2.136335] pci 0000:80:01.0: PME# supported from D0 D3hot D3cold [ 2.136401] pci 0000:80:01.0: System wakeup disabled by ACPI [ 2.143090] pci 0000:80:02.0: [8086:3c04] type 01 class 0x060400 [ 2.143190] pci 0000:80:02.0: PME# supported from D0 D3hot D3cold [ 2.143252] pci 0000:80:02.0: System wakeup disabled by ACPI [ 2.149941] pci 0000:80:02.2: [8086:3c06] type 01 class 0x060400 [ 2.150039] pci 0000:80:02.2: PME# supported from D0 D3hot D3cold [ 2.150101] pci 0000:80:02.2: System wakeup disabled by ACPI [ 2.156795] pci 0000:80:03.0: [8086:3c08] type 01 class 0x060400 [ 2.156893] pci 0000:80:03.0: PME# supported from D0 D3hot D3cold [ 2.156966] pci 0000:80:03.0: System wakeup disabled by ACPI [ 2.163643] pci 0000:80:03.2: [8086:3c0a] type 01 class 0x060400 [ 2.163740] pci 0000:80:03.2: PME# supported from D0 D3hot D3cold [ 2.163808] pci 0000:80:03.2: System wakeup disabled by ACPI [ 2.170484] pci 0000:80:04.0: [8086:3c20] type 00 class 0x088000 [ 2.170508] pci 0000:80:04.0: reg 0x10: [mem 0x3800fff70000-0x3800fff73fff 64bit] [ 2.170677] pci 0000:80:04.1: [8086:3c21] type 00 class 0x088000 [ 2.170701] pci 0000:80:04.1: reg 0x10: [mem 0x3800fff60000-0x3800fff63fff 64bit] [ 2.170862] pci 0000:80:04.2: [8086:3c22] type 00 class 0x088000 [ 2.170885] pci 0000:80:04.2: reg 0x10: [mem 0x3800fff50000-0x3800fff53fff 64bit] [ 2.171045] pci 0000:80:04.3: [8086:3c23] type 00 class 0x088000 [ 2.171068] pci 0000:80:04.3: reg 0x10: [mem 0x3800fff40000-0x3800fff43fff 64bit] [ 2.171228] pci 0000:80:04.4: [8086:3c24] type 00 class 0x088000 [ 2.171251] pci 0000:80:04.4: reg 0x10: [mem 0x3800fff30000-0x3800fff33fff 64bit] [ 2.171409] pci 0000:80:04.5: [8086:3c25] type 00 class 0x088000 [ 2.171437] pci 0000:80:04.5: reg 0x10: [mem 0x3800fff20000-0x3800fff23fff 64bit] [ 2.171600] pci 0000:80:04.6: [8086:3c26] type 00 class 0x088000 [ 2.171623] pci 0000:80:04.6: reg 0x10: [mem 0x3800fff10000-0x3800fff13fff 64bit] [ 2.171783] pci 0000:80:04.7: [8086:3c27] type 00 class 0x088000 [ 2.171806] pci 0000:80:04.7: reg 0x10: [mem 0x3800fff00000-0x3800fff03fff 64bit] [ 2.171965] pci 0000:80:05.0: [8086:3c28] type 00 class 0x088000 [ 2.172118] pci 0000:80:05.2: [8086:3c2a] type 00 class 0x088000 [ 2.172266] pci 0000:80:05.4: [8086:3c2c] type 00 class 0x080020 [ 2.172284] pci 0000:80:05.4: reg 0x10: [mem 0xed200000-0xed200fff] [ 2.172541] pci 0000:81:00.0: [1000:0072] type 00 class 0x010700 [ 2.172557] pci 0000:81:00.0: reg 0x10: [io 0xe000-0xe0ff] [ 2.172572] pci 0000:81:00.0: reg 0x14: [mem 0xed0c0000-0xed0c3fff 64bit] [ 2.172586] pci 0000:81:00.0: reg 0x1c: [mem 0xed080000-0xed0bffff 64bit] [ 2.172603] pci 0000:81:00.0: reg 0x30: [mem 0xecc00000-0xecc7ffff pref] [ 2.172657] pci 0000:81:00.0: supports D1 D2 [ 2.172684] pci 0000:81:00.0: reg 0x174: [mem 0xed0d0000-0xed0d3fff 64bit] [ 2.172688] pci 0000:81:00.0: VF(n) BAR0 space: [mem 0xed0d0000-0xed10ffff 64bit] (contains BAR0 for 16 VFs) [ 2.184185] pci 0000:81:00.0: reg 0x17c: [mem 0xecc80000-0xeccbffff 64bit] [ 2.184190] pci 0000:81:00.0: VF(n) BAR2 space: [mem 0xecc80000-0xed07ffff 64bit] (contains BAR2 for 16 VFs) [ 2.197693] pci 0000:80:01.0: PCI bridge to [bus 81] [ 2.203531] pci 0000:80:01.0: bridge window [io 0xe000-0xefff] [ 2.203537] pci 0000:80:01.0: bridge window [mem 0xecc00000-0xed1fffff] [ 2.203631] pci 0000:82:00.0: [1000:0072] type 00 class 0x010700 [ 2.203647] pci 0000:82:00.0: reg 0x10: [io 0xd000-0xd0ff] [ 2.203662] pci 0000:82:00.0: reg 0x14: [mem 0xecac0000-0xecac3fff 64bit] [ 2.203676] pci 0000:82:00.0: reg 0x1c: [mem 0xeca80000-0xecabffff 64bit] [ 2.203693] pci 0000:82:00.0: reg 0x30: [mem 0xec600000-0xec67ffff pref] [ 2.203747] pci 0000:82:00.0: supports D1 D2 [ 2.203773] pci 0000:82:00.0: reg 0x174: [mem 0xecad0000-0xecad3fff 64bit] [ 2.203777] pci 0000:82:00.0: VF(n) BAR0 space: [mem 0xecad0000-0xecb0ffff 64bit] (contains BAR0 for 16 VFs) [ 2.215270] pci 0000:82:00.0: reg 0x17c: [mem 0xec680000-0xec6bffff 64bit] [ 2.215274] pci 0000:82:00.0: VF(n) BAR2 space: [mem 0xec680000-0xeca7ffff 64bit] (contains BAR2 for 16 VFs) [ 2.228783] pci 0000:80:02.0: PCI bridge to [bus 82] [ 2.234624] pci 0000:80:02.0: bridge window [io 0xd000-0xdfff] [ 2.234630] pci 0000:80:02.0: bridge window [mem 0xec600000-0xecbfffff] [ 2.234718] pci 0000:80:02.2: PCI bridge to [bus 83] [ 2.240642] pci 0000:84:00.0: [1000:0072] type 00 class 0x010700 [ 2.240657] pci 0000:84:00.0: reg 0x10: [io 0xc000-0xc0ff] [ 2.240672] pci 0000:84:00.0: reg 0x14: [mem 0xec4c0000-0xec4c3fff 64bit] [ 2.240686] pci 0000:84:00.0: reg 0x1c: [mem 0xec480000-0xec4bffff 64bit] [ 2.240703] pci 0000:84:00.0: reg 0x30: [mem 0xec000000-0xec07ffff pref] [ 2.240758] pci 0000:84:00.0: supports D1 D2 [ 2.240785] pci 0000:84:00.0: reg 0x174: [mem 0xec4d0000-0xec4d3fff 64bit] [ 2.240789] pci 0000:84:00.0: VF(n) BAR0 space: [mem 0xec4d0000-0xec50ffff 64bit] (contains BAR0 for 16 VFs) [ 2.252291] pci 0000:84:00.0: reg 0x17c: [mem 0xec080000-0xec0bffff 64bit] [ 2.252295] pci 0000:84:00.0: VF(n) BAR2 space: [mem 0xec080000-0xec47ffff 64bit] (contains BAR2 for 16 VFs) [ 2.265805] pci 0000:80:03.0: PCI bridge to [bus 84] [ 2.276371] pci 0000:80:03.0: bridge window [io 0xc000-0xcfff] [ 2.276377] pci 0000:80:03.0: bridge window [mem 0xec000000-0xec5fffff] [ 2.276443] pci 0000:80:03.2: PCI bridge to [bus 85] [ 2.282337] pci_bus 0000:80: on NUMA node 1 [ 2.292265] ACPI: PCI Root Bridge [UCR0] (domain 0000 [bus 7f]) [ 2.299182] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI] [ 2.308875] acpi PNP0A03:00: _OSC: platform does not support [PCIeHotplug PME AER] [ 2.317883] acpi PNP0A03:00: _OSC: OS now controls [PCIeCapability] [ 2.325180] acpi PNP0A03:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 2.334918] PCI host bridge to bus 0000:7f [ 2.339785] pci_bus 0000:7f: root bus resource [bus 7f] [ 2.345927] pci 0000:7f:08.0: [8086:3c80] type 00 class 0x088000 [ 2.346051] pci 0000:7f:09.0: [8086:3c90] type 00 class 0x088000 [ 2.346140] pci 0000:7f:0a.0: [8086:3cc0] type 00 class 0x088000 [ 2.346219] pci 0000:7f:0a.1: [8086:3cc1] type 00 class 0x088000 [ 2.346297] pci 0000:7f:0a.2: [8086:3cc2] type 00 class 0x088000 [ 2.346372] pci 0000:7f:0a.3: [8086:3cd0] type 00 class 0x088000 [ 2.346446] pci 0000:7f:0b.0: [8086:3ce0] type 00 class 0x088000 [ 2.346520] pci 0000:7f:0b.3: [8086:3ce3] type 00 class 0x088000 [ 2.346600] pci 0000:7f:0c.0: [8086:3ce8] type 00 class 0x088000 [ 2.346678] pci 0000:7f:0c.1: [8086:3ce8] type 00 class 0x088000 [ 2.346755] pci 0000:7f:0c.2: [8086:3ce8] type 00 class 0x088000 [ 2.346833] pci 0000:7f:0c.3: [8086:3ce8] type 00 class 0x088000 [ 2.346923] pci 0000:7f:0c.6: [8086:3cf4] type 00 class 0x088000 [ 2.347000] pci 0000:7f:0c.7: [8086:3cf6] type 00 class 0x088000 [ 2.347081] pci 0000:7f:0d.0: [8086:3ce8] type 00 class 0x088000 [ 2.347161] pci 0000:7f:0d.1: [8086:3ce8] type 00 class 0x088000 [ 2.347240] pci 0000:7f:0d.2: [8086:3ce8] type 00 class 0x088000 [ 2.347316] pci 0000:7f:0d.3: [8086:3ce8] type 00 class 0x088000 [ 2.347389] pci 0000:7f:0d.6: [8086:3cf5] type 00 class 0x088000 [ 2.347464] pci 0000:7f:0e.0: [8086:3ca0] type 00 class 0x088000 [ 2.347547] pci 0000:7f:0e.1: [8086:3c46] type 00 class 0x110100 [ 2.347639] pci 0000:7f:0f.0: [8086:3ca8] type 00 class 0x088000 [ 2.347737] pci 0000:7f:0f.1: [8086:3c71] type 00 class 0x088000 [ 2.347840] pci 0000:7f:0f.2: [8086:3caa] type 00 class 0x088000 [ 2.347946] pci 0000:7f:0f.3: [8086:3cab] type 00 class 0x088000 [ 2.348041] pci 0000:7f:0f.4: [8086:3cac] type 00 class 0x088000 [ 2.348140] pci 0000:7f:0f.5: [8086:3cad] type 00 class 0x088000 [ 2.348232] pci 0000:7f:0f.6: [8086:3cae] type 00 class 0x088000 [ 2.348317] pci 0000:7f:10.0: [8086:3cb0] type 00 class 0x088000 [ 2.348413] pci 0000:7f:10.1: [8086:3cb1] type 00 class 0x088000 [ 2.348504] pci 0000:7f:10.2: [8086:3cb2] type 00 class 0x088000 [ 2.348603] pci 0000:7f:10.3: [8086:3cb3] type 00 class 0x088000 [ 2.348702] pci 0000:7f:10.4: [8086:3cb4] type 00 class 0x088000 [ 2.348799] pci 0000:7f:10.5: [8086:3cb5] type 00 class 0x088000 [ 2.348896] pci 0000:7f:10.6: [8086:3cb6] type 00 class 0x088000 [ 2.348999] pci 0000:7f:10.7: [8086:3cb7] type 00 class 0x088000 [ 2.349091] pci 0000:7f:11.0: [8086:3cb8] type 00 class 0x088000 [ 2.349184] pci 0000:7f:13.0: [8086:3ce4] type 00 class 0x088000 [ 2.349262] pci 0000:7f:13.1: [8086:3c43] type 00 class 0x110100 [ 2.349342] pci 0000:7f:13.4: [8086:3ce6] type 00 class 0x110100 [ 2.349424] pci 0000:7f:13.5: [8086:3c44] type 00 class 0x110100 [ 2.349502] pci 0000:7f:13.6: [8086:3c45] type 00 class 0x088000 [ 2.349674] ACPI: PCI Root Bridge [UCR1] (domain 0000 [bus ff]) [ 2.356587] acpi PNP0A03:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI] [ 2.366272] acpi PNP0A03:01: _OSC: platform does not support [PCIeHotplug PME AER] [ 2.375270] acpi PNP0A03:01: _OSC: OS now controls [PCIeCapability] [ 2.382556] acpi PNP0A03:01: FADT indicates ASPM is unsupported, using BIOS configuration [ 2.392292] PCI host bridge to bus 0000:ff [ 2.397164] pci_bus 0000:ff: root bus resource [bus ff] [ 2.403308] pci 0000:ff:08.0: [8086:3c80] type 00 class 0x088000 [ 2.403413] pci 0000:ff:09.0: [8086:3c90] type 00 class 0x088000 [ 2.403503] pci 0000:ff:0a.0: [8086:3cc0] type 00 class 0x088000 [ 2.403588] pci 0000:ff:0a.1: [8086:3cc1] type 00 class 0x088000 [ 2.403669] pci 0000:ff:0a.2: [8086:3cc2] type 00 class 0x088000 [ 2.403744] pci 0000:ff:0a.3: [8086:3cd0] type 00 class 0x088000 [ 2.403829] pci 0000:ff:0b.0: [8086:3ce0] type 00 class 0x088000 [ 2.403909] pci 0000:ff:0b.3: [8086:3ce3] type 00 class 0x088000 [ 2.403990] pci 0000:ff:0c.0: [8086:3ce8] type 00 class 0x088000 [ 2.404068] pci 0000:ff:0c.1: [8086:3ce8] type 00 class 0x088000 [ 2.404156] pci 0000:ff:0c.2: [8086:3ce8] type 00 class 0x088000 [ 2.404236] pci 0000:ff:0c.3: [8086:3ce8] type 00 class 0x088000 [ 2.404323] pci 0000:ff:0c.6: [8086:3cf4] type 00 class 0x088000 [ 2.404408] pci 0000:ff:0c.7: [8086:3cf6] type 00 class 0x088000 [ 2.404490] pci 0000:ff:0d.0: [8086:3ce8] type 00 class 0x088000 [ 2.404569] pci 0000:ff:0d.1: [8086:3ce8] type 00 class 0x088000 [ 2.404646] pci 0000:ff:0d.2: [8086:3ce8] type 00 class 0x088000 [ 2.404720] pci 0000:ff:0d.3: [8086:3ce8] type 00 class 0x088000 [ 2.404798] pci 0000:ff:0d.6: [8086:3cf5] type 00 class 0x088000 [ 2.404878] pci 0000:ff:0e.0: [8086:3ca0] type 00 class 0x088000 [ 2.404963] pci 0000:ff:0e.1: [8086:3c46] type 00 class 0x110100 [ 2.405057] pci 0000:ff:0f.0: [8086:3ca8] type 00 class 0x088000 [ 2.405167] pci 0000:ff:0f.1: [8086:3c71] type 00 class 0x088000 [ 2.405270] pci 0000:ff:0f.2: [8086:3caa] type 00 class 0x088000 [ 2.405377] pci 0000:ff:0f.3: [8086:3cab] type 00 class 0x088000 [ 2.405478] pci 0000:ff:0f.4: [8086:3cac] type 00 class 0x088000 [ 2.405578] pci 0000:ff:0f.5: [8086:3cad] type 00 class 0x088000 [ 2.405676] pci 0000:ff:0f.6: [8086:3cae] type 00 class 0x088000 [ 2.405764] pci 0000:ff:10.0: [8086:3cb0] type 00 class 0x088000 [ 2.405862] pci 0000:ff:10.1: [8086:3cb1] type 00 class 0x088000 [ 2.405968] pci 0000:ff:10.2: [8086:3cb2] type 00 class 0x088000 [ 2.406069] pci 0000:ff:10.3: [8086:3cb3] type 00 class 0x088000 [ 2.406169] pci 0000:ff:10.4: [8086:3cb4] type 00 class 0x088000 [ 2.406275] pci 0000:ff:10.5: [8086:3cb5] type 00 class 0x088000 [ 2.406382] pci 0000:ff:10.6: [8086:3cb6] type 00 class 0x088000 [ 2.406483] pci 0000:ff:10.7: [8086:3cb7] type 00 class 0x088000 [ 2.406581] pci 0000:ff:11.0: [8086:3cb8] type 00 class 0x088000 [ 2.406676] pci 0000:ff:13.0: [8086:3ce4] type 00 class 0x088000 [ 2.406759] pci 0000:ff:13.1: [8086:3c43] type 00 class 0x110100 [ 2.406843] pci 0000:ff:13.4: [8086:3ce6] type 00 class 0x110100 [ 2.406923] pci 0000:ff:13.5: [8086:3c44] type 00 class 0x110100 [ 2.406999] pci 0000:ff:13.6: [8086:3c45] type 00 class 0x088000 [ 2.407329] ACPI: Enabled 6 GPEs in block 00 to 3F [ 2.413311] vgaarb: device added: PCI:0000:0b:00.0,decodes=io+mem,owns=io+mem,locks=none [ 2.422879] vgaarb: loaded [ 2.426188] vgaarb: bridge control possible 0000:0b:00.0 [ 2.432654] SCSI subsystem initialized [ 2.437179] ACPI: bus type USB registered [ 2.441979] usbcore: registered new interface driver usbfs [ 2.448418] usbcore: registered new interface driver hub [ 2.454932] usbcore: registered new device driver usb [ 2.461395] PCI: Using ACPI for IRQ routing [ 2.472869] PCI: pci_cache_line_size set to 64 bytes [ 2.473244] e820: reserve RAM buffer [mem 0xbb3c7000-0xbbffffff] [ 2.473248] e820: reserve RAM buffer [mem 0xbe000000-0xbfffffff] [ 2.473652] NetLabel: Initializing [ 2.477740] NetLabel: domain hash size = 128 [ 2.482894] NetLabel: protocols = UNLABELED CIPSOv4 [ 2.488759] NetLabel: unlabeled traffic allowed by default [ 2.495339] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 2.503304] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 2.512337] Switched to clocksource hpet [ 2.531674] pnp: PnP ACPI init [ 2.535389] ACPI: bus type PNP registered [ 2.540449] system 00:00: [io 0x0680-0x069f] has been reserved [ 2.547365] system 00:00: [io 0xffff] has been reserved [ 2.553595] system 00:00: [io 0xffff] has been reserved [ 2.559825] system 00:00: [io 0xffff] has been reserved [ 2.566054] system 00:00: [io 0x0400-0x0453] could not be reserved [ 2.573353] system 00:00: [io 0x0458-0x047f] has been reserved [ 2.580275] system 00:00: [io 0x0500-0x057f] has been reserved [ 2.587175] system 00:00: [io 0x0600-0x061f] has been reserved [ 2.594085] system 00:00: [io 0x0ca2-0x0ca5] has been reserved [ 2.600996] system 00:00: [io 0x0cf9] could not be reserved [ 2.607618] system 00:00: Plug and Play ACPI device, IDs PNP0c02 (active) [ 2.607666] pnp 00:01: Plug and Play ACPI device, IDs PNP0b00 (active) [ 2.607799] system 00:02: [io 0x0454-0x0457] has been reserved [ 2.614710] system 00:02: Plug and Play ACPI device, IDs INT3f0d PNP0c02 (active) [ 2.615089] pnp 00:03: [dma 0 disabled] [ 2.615186] pnp 00:03: Plug and Play ACPI device, IDs PNP0501 (active) [ 2.615461] pnp 00:04: [dma 0 disabled] [ 2.615558] pnp 00:04: Plug and Play ACPI device, IDs PNP0501 (active) [ 2.616129] system 00:05: [mem 0xfed1c000-0xfed1ffff] has been reserved [ 2.623823] system 00:05: [mem 0xebfff000-0xebffffff] has been reserved [ 2.631508] system 00:05: [mem 0xc0000000-0xcfffffff] has been reserved [ 2.639202] system 00:05: [mem 0xfed20000-0xfed3ffff] has been reserved [ 2.646891] system 00:05: [mem 0xfed45000-0xfed8ffff] has been reserved [ 2.654578] system 00:05: [mem 0xff000000-0xffffffff] could not be reserved [ 2.662657] system 00:05: [mem 0xfee00000-0xfeefffff] could not be reserved [ 2.670734] system 00:05: [mem 0xfec00000-0xfecfffff] could not be reserved [ 2.678813] system 00:05: [mem 0xd1470000-0xd1470fff] has been reserved [ 2.686503] system 00:05: Plug and Play ACPI device, IDs PNP0c02 (active) [ 2.687005] system 00:06: [mem 0x00000000-0x0009cfff] could not be reserved [ 2.695089] system 00:06: Plug and Play ACPI device, IDs PNP0c01 (active) [ 2.695592] pnp: PnP ACPI: found 7 devices [ 2.700466] ACPI: bus type PNP unregistered [ 2.713995] pci 0000:02:08.0: PCI bridge to [bus 03] [ 2.719840] pci 0000:02:08.0: bridge window [io 0x3000-0x3fff] [ 2.726949] pci 0000:02:08.0: bridge window [mem 0xd1100000-0xd11fffff] [ 2.734833] pci 0000:02:08.0: bridge window [mem 0x38007e800000-0x38007f1fffff 64bit pref] [ 2.744772] pci 0000:01:00.0: PCI bridge to [bus 02-03] [ 2.750902] pci 0000:01:00.0: bridge window [io 0x3000-0x3fff] [ 2.758011] pci 0000:01:00.0: bridge window [mem 0xd1100000-0xd11fffff] [ 2.765898] pci 0000:01:00.0: bridge window [mem 0x38007e800000-0x38007f1fffff 64bit pref] [ 2.775834] pci 0000:00:01.0: PCI bridge to [bus 01-03] [ 2.781967] pci 0000:00:01.0: bridge window [io 0x3000-0x3fff] [ 2.789075] pci 0000:00:01.0: bridge window [mem 0xd1100000-0xd12fffff] [ 2.796965] pci 0000:00:01.0: bridge window [mem 0x38007e800000-0x38007f1fffff 64bit pref] [ 2.806901] pci 0000:00:01.1: PCI bridge to [bus 04-05] [ 2.813033] pci 0000:00:01.1: bridge window [io 0x2000-0x2fff] [ 2.820138] pci 0000:00:01.1: bridge window [mem 0xd0f00000-0xd10fffff] [ 2.828025] pci 0000:00:02.0: PCI bridge to [bus 06] [ 2.833867] pci 0000:00:02.0: bridge window [mem 0xd1300000-0xd13fffff] [ 2.841750] pci 0000:00:02.0: bridge window [mem 0x38007f800000-0x38007fffffff 64bit pref] [ 2.851686] pci 0000:00:02.2: PCI bridge to [bus 07] [ 2.857537] pci 0000:00:03.0: PCI bridge to [bus 08] [ 2.863378] pci 0000:00:03.0: bridge window [io 0x1000-0x1fff] [ 2.870484] pci 0000:00:03.0: bridge window [mem 0xd0900000-0xd0efffff] [ 2.878365] pci 0000:00:03.2: PCI bridge to [bus 09] [ 2.884213] pci 0000:00:1c.0: PCI bridge to [bus 0a] [ 2.890068] pci 0000:00:1c.7: PCI bridge to [bus 0b] [ 2.895904] pci 0000:00:1c.7: bridge window [mem 0xd0000000-0xd08fffff] [ 2.903787] pci 0000:00:1c.7: bridge window [mem 0xea000000-0xeaffffff 64bit pref] [ 2.912946] pci 0000:00:1e.0: PCI bridge to [bus 0c] [ 2.918795] pci_bus 0000:00: resource 4 [io 0x0000-0xbfff window] [ 2.918799] pci_bus 0000:00: resource 5 [mem 0x000a0000-0x000bffff window] [ 2.918803] pci_bus 0000:00: resource 6 [mem 0x000c0000-0x000c3fff window] [ 2.918806] pci_bus 0000:00: resource 7 [mem 0x000c4000-0x000c7fff window] [ 2.918810] pci_bus 0000:00: resource 8 [mem 0x000c8000-0x000cbfff window] [ 2.918813] pci_bus 0000:00: resource 9 [mem 0x000cc000-0x000cffff window] [ 2.918816] pci_bus 0000:00: resource 10 [mem 0x000d4000-0x000d7fff window] [ 2.918820] pci_bus 0000:00: resource 11 [mem 0x000d8000-0x000dbfff window] [ 2.918823] pci_bus 0000:00: resource 12 [mem 0x000dc000-0x000dffff window] [ 2.918827] pci_bus 0000:00: resource 13 [mem 0x000e0000-0x000e3fff window] [ 2.918830] pci_bus 0000:00: resource 14 [mem 0x000e4000-0x000e7fff window] [ 2.918834] pci_bus 0000:00: resource 15 [mem 0x000e8000-0x000ebfff window] [ 2.918837] pci_bus 0000:00: resource 16 [mem 0x000ec000-0x000effff window] [ 2.918840] pci_bus 0000:00: resource 17 [mem 0x000f0000-0x000fffff window] [ 2.918844] pci_bus 0000:00: resource 18 [mem 0xd0000000-0xebffffff window] [ 2.918848] pci_bus 0000:00: resource 19 [mem 0x380000000000-0x38007fffffff window] [ 2.918852] pci_bus 0000:01: resource 0 [io 0x3000-0x3fff] [ 2.918855] pci_bus 0000:01: resource 1 [mem 0xd1100000-0xd12fffff] [ 2.918859] pci_bus 0000:01: resource 2 [mem 0x38007e800000-0x38007f1fffff 64bit pref] [ 2.918862] pci_bus 0000:02: resource 0 [io 0x3000-0x3fff] [ 2.918866] pci_bus 0000:02: resource 1 [mem 0xd1100000-0xd11fffff] [ 2.918869] pci_bus 0000:02: resource 2 [mem 0x38007e800000-0x38007f1fffff 64bit pref] [ 2.918872] pci_bus 0000:03: resource 0 [io 0x3000-0x3fff] [ 2.918875] pci_bus 0000:03: resource 1 [mem 0xd1100000-0xd11fffff] [ 2.918879] pci_bus 0000:03: resource 2 [mem 0x38007e800000-0x38007f1fffff 64bit pref] [ 2.918882] pci_bus 0000:04: resource 0 [io 0x2000-0x2fff] [ 2.918886] pci_bus 0000:04: resource 1 [mem 0xd0f00000-0xd10fffff] [ 2.918889] pci_bus 0000:06: resource 1 [mem 0xd1300000-0xd13fffff] [ 2.918893] pci_bus 0000:06: resource 2 [mem 0x38007f800000-0x38007fffffff 64bit pref] [ 2.918896] pci_bus 0000:08: resource 0 [io 0x1000-0x1fff] [ 2.918900] pci_bus 0000:08: resource 1 [mem 0xd0900000-0xd0efffff] [ 2.918904] pci_bus 0000:0b: resource 1 [mem 0xd0000000-0xd08fffff] [ 2.918907] pci_bus 0000:0b: resource 2 [mem 0xea000000-0xeaffffff 64bit pref] [ 2.918911] pci_bus 0000:0c: resource 4 [io 0x0000-0xbfff window] [ 2.918914] pci_bus 0000:0c: resource 5 [mem 0x000a0000-0x000bffff window] [ 2.918918] pci_bus 0000:0c: resource 6 [mem 0x000c0000-0x000c3fff window] [ 2.918921] pci_bus 0000:0c: resource 7 [mem 0x000c4000-0x000c7fff window] [ 2.918924] pci_bus 0000:0c: resource 8 [mem 0x000c8000-0x000cbfff window] [ 2.918928] pci_bus 0000:0c: resource 9 [mem 0x000cc000-0x000cffff window] [ 2.918931] pci_bus 0000:0c: resource 10 [mem 0x000d4000-0x000d7fff window] [ 2.918934] pci_bus 0000:0c: resource 11 [mem 0x000d8000-0x000dbfff window] [ 2.918938] pci_bus 0000:0c: resource 12 [mem 0x000dc000-0x000dffff window] [ 2.918941] pci_bus 0000:0c: resource 13 [mem 0x000e0000-0x000e3fff window] [ 2.918945] pci_bus 0000:0c: resource 14 [mem 0x000e4000-0x000e7fff window] [ 2.918948] pci_bus 0000:0c: resource 15 [mem 0x000e8000-0x000ebfff window] [ 2.918951] pci_bus 0000:0c: resource 16 [mem 0x000ec000-0x000effff window] [ 2.918955] pci_bus 0000:0c: resource 17 [mem 0x000f0000-0x000fffff window] [ 2.918958] pci_bus 0000:0c: resource 18 [mem 0xd0000000-0xebffffff window] [ 2.918962] pci_bus 0000:0c: resource 19 [mem 0x380000000000-0x38007fffffff window] [ 2.919009] pci 0000:80:01.0: PCI bridge to [bus 81] [ 2.924854] pci 0000:80:01.0: bridge window [io 0xe000-0xefff] [ 2.931962] pci 0000:80:01.0: bridge window [mem 0xecc00000-0xed1fffff] [ 2.939850] pci 0000:80:02.0: PCI bridge to [bus 82] [ 2.945690] pci 0000:80:02.0: bridge window [io 0xd000-0xdfff] [ 2.952798] pci 0000:80:02.0: bridge window [mem 0xec600000-0xecbfffff] [ 2.960689] pci 0000:80:02.2: PCI bridge to [bus 83] [ 2.966529] pci 0000:80:03.0: PCI bridge to [bus 84] [ 2.972370] pci 0000:80:03.0: bridge window [io 0xc000-0xcfff] [ 2.979479] pci 0000:80:03.0: bridge window [mem 0xec000000-0xec5fffff] [ 2.987368] pci 0000:80:03.2: PCI bridge to [bus 85] [ 2.993220] pci_bus 0000:80: resource 4 [io 0x03b0-0x03df window] [ 2.993224] pci_bus 0000:80: resource 5 [io 0xc000-0xffff window] [ 2.993227] pci_bus 0000:80: resource 6 [mem 0x000a0000-0x000bffff window] [ 2.993231] pci_bus 0000:80: resource 7 [mem 0xec000000-0xfbffffff window] [ 2.993234] pci_bus 0000:80: resource 8 [mem 0x380080000000-0x3800ffffffff window] [ 2.993238] pci_bus 0000:81: resource 0 [io 0xe000-0xefff] [ 2.993241] pci_bus 0000:81: resource 1 [mem 0xecc00000-0xed1fffff] [ 2.993245] pci_bus 0000:82: resource 0 [io 0xd000-0xdfff] [ 2.993248] pci_bus 0000:82: resource 1 [mem 0xec600000-0xecbfffff] [ 2.993251] pci_bus 0000:84: resource 0 [io 0xc000-0xcfff] [ 2.993255] pci_bus 0000:84: resource 1 [mem 0xec000000-0xec5fffff] [ 2.993594] NET: Registered protocol family 2 [ 3.001059] TCP established hash table entries: 262144 (order: 9, 2097152 bytes) [ 3.010705] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes) [ 3.018731] TCP: Hash tables configured (established 262144 bind 65536) [ 3.026511] TCP: reno registered [ 3.030581] UDP hash table entries: 16384 (order: 7, 524288 bytes) [ 3.038045] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes) [ 3.047068] NET: Registered protocol family 1 [ 4.152441] pci 0000:00:1a.0: EHCI: BIOS handoff failed (BIOS bug?) 01010001 [ 5.260518] pci 0000:00:1d.0: EHCI: BIOS handoff failed (BIOS bug?) 01010001 [ 5.269001] PCI: CLS mismatch (64 != 32), using 64 bytes [ 5.269020] pci 0000:0b:00.0: Boot video device [ 5.269316] Unpacking initramfs... [ 6.793810] Freeing initrd memory: 47540k freed [ 6.817967] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 6.825478] software IO TLB [mem 0xb73c7000-0xbb3c7000] (64MB) mapped at [ffff8800b73c7000-ffff8800bb3c6fff] [ 6.837433] RAPL PMU: API unit is 2^-32 Joules, 3 fixed counters, 163840 ms ovfl timer [ 6.846805] RAPL PMU: hw unit of domain pp0-core 2^-16 Joules [ 6.853534] RAPL PMU: hw unit of domain package 2^-16 Joules [ 6.860172] RAPL PMU: hw unit of domain dram 2^-16 Joules [ 6.878264] sha1_ssse3: Using AVX optimized SHA-1 implementation [ 6.885395] sha256_ssse3: Using AVX optimized SHA-256 implementation [ 6.897221] futex hash table entries: 65536 (order: 10, 4194304 bytes) [ 6.905790] Initialise system trusted keyring [ 6.911116] audit: initializing netlink socket (disabled) [ 6.917483] type=2000 audit(1496935836.516:1): initialized [ 6.972671] HugeTLB registered 1 GB page size, pre-allocated 0 pages [ 6.980072] HugeTLB registered 2 MB page size, pre-allocated 0 pages [ 6.989566] zpool: loaded [ 6.992789] zbud: loaded [ 6.997087] VFS: Disk quotas dquot_6.5.2 [ 7.002277] Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 7.011382] msgmni has been set to 32768 [ 7.016483] Key type big_key registered [ 7.021071] SELinux: Registering netfilter hooks [ 7.023589] NET: Registered protocol family 38 [ 7.028878] Key type asymmetric registered [ 7.033771] Asymmetric key parser 'x509' registered [ 7.039690] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 251) [ 7.048761] io scheduler noop registered [ 7.053456] io scheduler deadline registered (default) [ 7.059668] io scheduler cfq registered [ 7.065190] pcieport 0000:00:01.0: irq 25 for MSI/MSI-X [ 7.065563] pcieport 0000:00:01.1: irq 26 for MSI/MSI-X [ 7.065930] pcieport 0000:00:02.0: irq 27 for MSI/MSI-X [ 7.066286] pcieport 0000:00:02.2: irq 28 for MSI/MSI-X [ 7.066737] pcieport 0000:00:03.0: irq 29 for MSI/MSI-X [ 7.067099] pcieport 0000:00:03.2: irq 30 for MSI/MSI-X [ 7.067460] pcieport 0000:00:1c.0: irq 31 for MSI/MSI-X [ 7.067926] pcieport 0000:00:1c.7: irq 32 for MSI/MSI-X [ 7.068795] pcieport 0000:80:01.0: irq 35 for MSI/MSI-X [ 7.069026] pcieport 0000:80:02.0: irq 36 for MSI/MSI-X [ 7.069221] pcieport 0000:80:02.2: irq 37 for MSI/MSI-X [ 7.069414] pcieport 0000:80:03.0: irq 38 for MSI/MSI-X [ 7.069666] pcieport 0000:80:03.2: irq 39 for MSI/MSI-X [ 7.069816] pcieport 0000:00:01.0: Signaling PME through PCIe PME interrupt [ 7.077911] pcieport 0000:01:00.0: Signaling PME through PCIe PME interrupt [ 7.085998] pcieport 0000:02:08.0: Signaling PME through PCIe PME interrupt [ 7.094086] pci 0000:03:00.0: Signaling PME through PCIe PME interrupt [ 7.101692] pci 0000:03:00.3: Signaling PME through PCIe PME interrupt [ 7.109297] pci 0000:03:00.4: Signaling PME through PCIe PME interrupt [ 7.116894] pcie_pme 0000:00:01.0:pcie01: service driver pcie_pme loaded [ 7.116928] pcieport 0000:00:01.1: Signaling PME through PCIe PME interrupt [ 7.125011] pci 0000:04:00.0: Signaling PME through PCIe PME interrupt [ 7.132604] pci 0000:04:00.1: Signaling PME through PCIe PME interrupt [ 7.140202] pci 0000:04:00.2: Signaling PME through PCIe PME interrupt [ 7.147817] pci 0000:04:00.3: Signaling PME through PCIe PME interrupt [ 7.155429] pcie_pme 0000:00:01.1:pcie01: service driver pcie_pme loaded [ 7.155467] pcieport 0000:00:02.0: Signaling PME through PCIe PME interrupt [ 7.163561] pci 0000:06:00.0: Signaling PME through PCIe PME interrupt [ 7.171178] pcie_pme 0000:00:02.0:pcie01: service driver pcie_pme loaded [ 7.171206] pcieport 0000:00:02.2: Signaling PME through PCIe PME interrupt [ 7.179299] pcie_pme 0000:00:02.2:pcie01: service driver pcie_pme loaded [ 7.179325] pcieport 0000:00:03.0: Signaling PME through PCIe PME interrupt [ 7.187425] pci 0000:08:00.0: Signaling PME through PCIe PME interrupt [ 7.195030] pcie_pme 0000:00:03.0:pcie01: service driver pcie_pme loaded [ 7.195063] pcieport 0000:00:03.2: Signaling PME through PCIe PME interrupt [ 7.203160] pcie_pme 0000:00:03.2:pcie01: service driver pcie_pme loaded [ 7.203196] pcieport 0000:00:1c.0: Signaling PME through PCIe PME interrupt [ 7.211296] pcie_pme 0000:00:1c.0:pcie01: service driver pcie_pme loaded [ 7.211328] pcieport 0000:00:1c.7: Signaling PME through PCIe PME interrupt [ 7.219425] pci 0000:0b:00.0: Signaling PME through PCIe PME interrupt [ 7.227035] pcie_pme 0000:00:1c.7:pcie01: service driver pcie_pme loaded [ 7.227077] pcieport 0000:80:01.0: Signaling PME through PCIe PME interrupt [ 7.235173] pci 0000:81:00.0: Signaling PME through PCIe PME interrupt [ 7.242783] pcie_pme 0000:80:01.0:pcie01: service driver pcie_pme loaded [ 7.242813] pcieport 0000:80:02.0: Signaling PME through PCIe PME interrupt [ 7.250923] pci 0000:82:00.0: Signaling PME through PCIe PME interrupt [ 7.258526] pcie_pme 0000:80:02.0:pcie01: service driver pcie_pme loaded [ 7.258555] pcieport 0000:80:02.2: Signaling PME through PCIe PME interrupt [ 7.266653] pcie_pme 0000:80:02.2:pcie01: service driver pcie_pme loaded [ 7.266683] pcieport 0000:80:03.0: Signaling PME through PCIe PME interrupt [ 7.274788] pci 0000:84:00.0: Signaling PME through PCIe PME interrupt [ 7.282400] pcie_pme 0000:80:03.0:pcie01: service driver pcie_pme loaded [ 7.282431] pcieport 0000:80:03.2: Signaling PME through PCIe PME interrupt [ 7.290525] pcie_pme 0000:80:03.2:pcie01: service driver pcie_pme loaded [ 7.290558] ioapic: probe of 0000:00:05.4 failed with error -22 [ 7.302276] ioapic: probe of 0000:80:05.4 failed with error -22 [ 7.309226] pci_hotplug: PCI Hot Plug PCI Core version: 0.5 [ 7.315781] pciehp: PCI Express Hot Plug Controller Driver version: 0.4 [ 7.323629] intel_idle: MWAIT substates: 0x21120 [ 7.323632] intel_idle: v0.4.1 model 0x2D [ 7.323634] intel_idle: lapic_timer_reliable_states 0xffffffff [ 7.323992] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 [ 7.332769] ACPI: Power Button [PWRF] [ 7.337177] ACPI: Requesting acpi_cpufreq [ 7.378697] ERST: Error Record Serialization Table (ERST) support is initialized. [ 7.387565] pstore: Registered erst as persistent store backend [ 7.394644] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 7.403523] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 7.431561] 00:03: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A [ 7.458816] 00:04: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A [ 7.465806] Non-volatile memory driver v1.3 [ 7.470786] Linux agpgart interface v0.103 [ 7.475856] crash memory driver: version 1.1 [ 7.481101] rdac: device handler registered [ 7.486114] hp_sw: device handler registered [ 7.491188] emc: device handler registered [ 7.496068] alua: device handler registered [ 7.501071] libphy: Fixed MDIO Bus: probed [ 7.506006] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver [ 7.513610] ehci-pci: EHCI PCI platform driver [ 7.519117] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 7.525294] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1 [ 7.534081] ehci-pci 0000:00:1a.0: debug port 2 [ 7.543368] ehci-pci 0000:00:1a.0: cache line size of 64 is not supported [ 7.543395] ehci-pci 0000:00:1a.0: irq 22, io mem 0xd1420000 [ 7.555685] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 7.562465] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002 [ 7.570335] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 7.578900] usb usb1: Product: EHCI Host Controller [ 7.584641] usb usb1: Manufacturer: Linux 3.10.0-514.10.2.el7.x86_64 ehci_hcd [ 7.592917] usb usb1: SerialNumber: 0000:00:1a.0 [ 7.598501] hub 1-0:1.0: USB hub found [ 7.602999] hub 1-0:1.0: 2 ports detected [ 7.608048] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 7.614234] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2 [ 7.623018] ehci-pci 0000:00:1d.0: debug port 2 [ 7.632261] ehci-pci 0000:00:1d.0: cache line size of 64 is not supported [ 7.632301] ehci-pci 0000:00:1d.0: irq 20, io mem 0xd1410000 [ 7.644689] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 7.651452] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002 [ 7.659336] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 7.667911] usb usb2: Product: EHCI Host Controller [ 7.673645] usb usb2: Manufacturer: Linux 3.10.0-514.10.2.el7.x86_64 ehci_hcd [ 7.681930] usb usb2: SerialNumber: 0000:00:1d.0 [ 7.687448] hub 2-0:1.0: USB hub found [ 7.691932] hub 2-0:1.0: 2 ports detected [ 7.696794] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver [ 7.703999] ohci-pci: OHCI PCI platform driver [ 7.709288] uhci_hcd: USB Universal Host Controller Interface driver [ 7.716761] usbcore: registered new interface driver usbserial [ 7.723589] usbcore: registered new interface driver usbserial_generic [ 7.731200] usbserial: USB Serial support registered for generic [ 7.738236] i8042: PNP: No PS/2 controller found. Probing ports directly. [ 7.875719] tsc: Refined TSC clocksource calibration: 2693.509 MHz [ 8.785130] i8042: No controller found [ 8.789631] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 8.789651] Switched to clocksource tsc [ 8.789685] mousedev: PS/2 mouse device common for all mice [ 8.789980] rtc_cmos 00:01: RTC can wake from S4 [ 8.790192] rtc_cmos 00:01: rtc core: registered rtc_cmos as rtc0 [ 8.790240] rtc_cmos 00:01: alarms up to one month, y3k, 242 bytes nvram, hpet irqs [ 8.790287] Intel P-state driver initializing. [ 8.799154] cpuidle: using governor menu [ 8.800120] hidraw: raw HID events driver (C) Jiri Kosina [ 8.800299] usbcore: registered new interface driver usbhid [ 8.800300] usbhid: USB HID core driver [ 8.800436] drop_monitor: Initializing network drop monitor service [ 8.801039] TCP: cubic registered [ 8.801045] Initializing XFRM netlink socket [ 8.801696] NET: Registered protocol family 10 [ 8.803351] NET: Registered protocol family 17 [ 8.808324] microcode: CPU0 sig=0x206d7, pf=0x1, revision=0x710 [ 8.808336] microcode: CPU1 sig=0x206d7, pf=0x1, revision=0x710 [ 8.808347] microcode: CPU2 sig=0x206d7, pf=0x1, revision=0x710 [ 8.808358] microcode: CPU3 sig=0x206d7, pf=0x1, revision=0x710 [ 8.808369] microcode: CPU4 sig=0x206d7, pf=0x1, revision=0x710 [ 8.808392] microcode: CPU5 sig=0x206d7, pf=0x1, revision=0x710 [ 8.808399] microcode: CPU6 sig=0x206d7, pf=0x1, revision=0x710 [ 8.808406] microcode: CPU7 sig=0x206d7, pf=0x1, revision=0x710 [ 8.808413] microcode: CPU8 sig=0x206d7, pf=0x1, revision=0x710 [ 8.808422] microcode: CPU9 sig=0x206d7, pf=0x1, revision=0x710 [ 8.808432] microcode: CPU10 sig=0x206d7, pf=0x1, revision=0x710 [ 8.808441] microcode: CPU11 sig=0x206d7, pf=0x1, revision=0x710 [ 8.808455] microcode: CPU12 sig=0x206d7, pf=0x1, revision=0x710 [ 8.808464] microcode: CPU13 sig=0x206d7, pf=0x1, revision=0x710 [ 8.808474] microcode: CPU14 sig=0x206d7, pf=0x1, revision=0x710 [ 8.808482] microcode: CPU15 sig=0x206d7, pf=0x1, revision=0x710 [ 8.808490] microcode: CPU16 sig=0x206d7, pf=0x1, revision=0x710 [ 8.808496] microcode: CPU17 sig=0x206d7, pf=0x1, revision=0x710 [ 8.808503] microcode: CPU18 sig=0x206d7, pf=0x1, revision=0x710 [ 8.808510] microcode: CPU19 sig=0x206d7, pf=0x1, revision=0x710 [ 8.808516] microcode: CPU20 sig=0x206d7, pf=0x1, revision=0x710 [ 8.808522] microcode: CPU21 sig=0x206d7, pf=0x1, revision=0x710 [ 8.808529] microcode: CPU22 sig=0x206d7, pf=0x1, revision=0x710 [ 8.808535] microcode: CPU23 sig=0x206d7, pf=0x1, revision=0x710 [ 8.808549] microcode: CPU24 sig=0x206d7, pf=0x1, revision=0x710 [ 8.808560] microcode: CPU25 sig=0x206d7, pf=0x1, revision=0x710 [ 8.808568] microcode: CPU26 sig=0x206d7, pf=0x1, revision=0x710 [ 8.808575] microcode: CPU27 sig=0x206d7, pf=0x1, revision=0x710 [ 8.808583] microcode: CPU28 sig=0x206d7, pf=0x1, revision=0x710 [ 8.808591] microcode: CPU29 sig=0x206d7, pf=0x1, revision=0x710 [ 8.808599] microcode: CPU30 sig=0x206d7, pf=0x1, revision=0x710 [ 8.808606] microcode: CPU31 sig=0x206d7, pf=0x1, revision=0x710 [ 8.808660] microcode: Microcode Update Driver: v2.01 , Peter Oruba [ 8.808842] Loading compiled-in X.509 certificates [ 8.808884] Loaded X.509 cert 'CentOS Linux kpatch signing key: ea0413152cde1d98ebdca3fe6f0230904c9ef717' [ 8.808906] Loaded X.509 cert 'CentOS Linux Driver update signing key: 7f421ee0ab69461574bb358861dbe77762a4201b' [ 8.809966] Loaded X.509 cert 'CentOS Linux kernel signing key: 27f20485ebeb3b2d54add61e57b308fae070f41f' [ 8.809999] registered taskstats version 1 [ 8.813707] Key type trusted registered [ 8.817330] Key type encrypted registered [ 8.821013] IMA: No TPM chip found, activating TPM-bypass! [ 8.829914] rtc_cmos 00:01: setting system clock to 2017-06-08 15:30:41 UTC (1496935841) [ 8.941814] usb 2-1: new high-speed USB device number 2 using ehci-pci [ 8.956156] usb 1-1: New USB device found, idVendor=8087, idProduct=0024 [ 8.956159] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 8.956448] hub 1-1:1.0: USB hub found [ 8.956528] hub 1-1:1.0: 6 ports detected [ 9.058179] usb 2-1: New USB device found, idVendor=8087, idProduct=0024 [ 9.058181] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 9.058469] hub 2-1:1.0: USB hub found [ 9.058558] hub 2-1:1.0: 8 ports detected [ 9.247223] Freeing unused kernel memory: 1680k freed [ 9.267208] systemd[1]: systemd 219 running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ -LZ4 -SECCOMP +BLKID +ELFUTILS +KMOD +IDN) [ 9.289075] systemd[1]: Detected architecture x86-64. [ 9.295024] systemd[1]: Running in initial RAM disk. [ 9.310932] systemd[1]: No hostname configured. [ 9.316310] systemd[1]: Set hostname to . [ 9.322234] systemd[1]: Initializing machine ID from random generator. [ 9.333842] usb 2-1.4: new full-speed USB device number 3 using ehci-pci [ 9.394958] systemd[1]: Reached target Swap. [ 9.400077] systemd[1]: Starting Swap. [ 9.409916] systemd[1]: Reached target Timers. [ 9.415227] systemd[1]: Starting Timers. [ 9.424924] systemd[1]: Created slice Root Slice. [ 9.430508] systemd[1]: Starting Root Slice. [ 9.440874] systemd[1]: Created slice System Slice. [ 9.446652] systemd[1]: Starting System Slice. [ 9.458844] usb 2-1.4: New USB device found, idVendor=046b, idProduct=ff10 [ 9.466643] systemd[1]: Listening on Journal Socket. [ 9.466663] systemd[1]: Starting Journal Socket. [ 9.467412] systemd[1]: Starting Setup Virtual Console... [ 9.484501] usb 2-1.4: New USB device strings: Mfr=1, Product=2, SerialNumber=3 [ 9.484503] usb 2-1.4: Product: Virtual Keyboard and Mouse [ 9.484505] usb 2-1.4: Manufacturer: American Megatrends Inc. [ 9.484506] usb 2-1.4: SerialNumber: serial [ 9.486109] input: American Megatrends Inc. Virtual Keyboard and Mouse as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.4/2-1.4:1.0/input/input1 [ 9.531922] systemd[1]: Starting dracut cmdline hook... [ 9.538321] hid-generic 0003:046B:FF10.0001: input,hidraw0: USB HID v1.10 Keyboard [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:1d.0-1.4/input0 [ 9.557008] input: American Megatrends Inc. Virtual Keyboard and Mouse as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.4/2-1.4:1.1/input/input2 [ 9.572587] hid-generic 0003:046B:FF10.0002: input,hidraw1: USB HID v1.10 Mouse [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:1d.0-1.4/input1 [ 9.594037] systemd[1]: Starting Apply Kernel Variables... [ 9.612924] systemd[1]: Listening on udev Kernel Socket. [ 9.619193] systemd[1]: Starting udev Kernel Socket. [ 9.625700] systemd[1]: Starting Journal Service... [ 9.637805] systemd[1]: Starting Create list of required static device nodes for the current kernel... [ 9.663935] systemd[1]: Reached target Slices. [ 9.674006] systemd[1]: Starting Slices. [ 9.684921] systemd[1]: Listening on udev Control Socket. [ 9.691277] systemd[1]: Starting udev Control Socket. [ 9.701959] systemd[1]: Reached target Sockets. [ 9.707342] systemd[1]: Starting Sockets. [ 9.718957] systemd[1]: Reached target Local File Systems. [ 9.725422] systemd[1]: Starting Local File Systems. [ 9.736945] systemd[1]: Started Journal Service. [ 9.812370] device-mapper: uevent: version 1.0.3 [ 9.818170] device-mapper: ioctl: 4.34.0-ioctl (2015-10-28) initialised: dm-devel@redhat.com [ 9.958533] FUJITSU Extended Socket Network Device Driver - version 1.1 - Copyright (c) 2015 FUJITSU LIMITED [ 9.980018] wmi: Mapper loaded [ 9.987066] libata version 3.00 loaded. [ 9.987094] pps_core: LinuxPPS API ver. 1 registered [ 9.993567] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 10.007747] PTP clock support registered [ 10.014071] dca service started, version 1.12.1 [ 10.020149] ahci 0000:00:1f.2: version 3.0 [ 10.020526] ahci 0000:00:1f.2: irq 40 for MSI/MSI-X [ 10.022754] [drm] Initialized drm 1.1.0 20060810 [ 10.028474] mlx4_core: Mellanox ConnectX core driver v2.2-1 (Feb, 2014) [ 10.028512] mpt2sas version 20.102.00.00 loaded [ 10.044196] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 10.044199] ahci 0000:00:1f.2: flags: 64bit ncq sntf pm led clo pio slum part ems apst [ 10.044458] mlx4_core: Initializing 0000:06:00.0 [ 10.045603] mpt2sas_cm0: 64 BIT PCI BUS DMA ADDRESSING SUPPORTED, total mem (32511480 kB) [ 10.084515] igb: Intel(R) Gigabit Ethernet Network Driver - version 5.3.0-k [ 10.087334] scsi host1: ahci [ 10.087427] scsi host2: ahci [ 10.087516] scsi host3: ahci [ 10.087583] scsi host4: ahci [ 10.087645] scsi host5: ahci [ 10.087707] scsi host6: ahci [ 10.087739] ata1: SATA max UDMA/133 abar m2048@0xd1400000 port 0xd1400100 irq 40 [ 10.087740] ata2: SATA max UDMA/133 abar m2048@0xd1400000 port 0xd1400180 irq 40 [ 10.087743] ata3: SATA max UDMA/133 abar m2048@0xd1400000 port 0xd1400200 irq 40 [ 10.087745] ata4: SATA max UDMA/133 abar m2048@0xd1400000 port 0xd1400280 irq 40 [ 10.087748] ata5: SATA max UDMA/133 abar m2048@0xd1400000 port 0xd1400300 irq 40 [ 10.087751] ata6: SATA max UDMA/133 abar m2048@0xd1400000 port 0xd1400380 irq 40 [ 10.099862] mpt2sas_cm0: MSI-X vectors supported: 1, no of cores: 32, max_msix_vectors: -1 [ 10.099945] mpt2sas 0000:08:00.0: irq 43 for MSI/MSI-X [ 10.099965] mpt2sas0-msix0: PCI-MSI-X enabled: IRQ 43 [ 10.099966] mpt2sas_cm0: iomem(0x00000000d0dc0000), mapped(0xffffc90003990000), size(16384) [ 10.099967] mpt2sas_cm0: ioport(0x0000000000001000), size(256) [ 10.171220] isci: Intel(R) C600 SAS Controller Driver - version 1.2.0 [ 10.171244] isci 0000:03:00.0: driver configured for rev: 6 silicon [ 10.171248] isci 0000:03:00.0: OEM parameter table found in OROM [ 10.171250] isci 0000:03:00.0: OEM SAS parameters (version: 1.1) loaded (platform) [ 10.171485] isci 0000:03:00.0: SCU controller 0: phy 3-0 cables: {short, short, short, short} [ 10.173908] scsi host7: isci [ 10.174503] isci 0000:03:00.0: SCU controller 1: phy 3-0 cables: {short, short, short, short} [ 10.176936] scsi host8: isci [ 10.177454] isci 0000:03:00.0: irq 44 for MSI/MSI-X [ 10.177521] isci 0000:03:00.0: irq 45 for MSI/MSI-X [ 10.177583] isci 0000:03:00.0: irq 46 for MSI/MSI-X [ 10.177648] isci 0000:03:00.0: irq 47 for MSI/MSI-X [ 10.192211] mpt2sas_cm0: Allocated physical memory: size(6902 kB) [ 10.192211] mpt2sas_cm0: Current Controller Queue Depth(3052),Max Controller Queue Depth(3160) [ 10.192212] mpt2sas_cm0: Scatter Gather Elements per IO(128) [ 10.236831] mpt2sas_cm0: LSISAS2008: FWVersion(12.00.00.00), ChipRevision(0x03), BiosVersion(00.00.00.00) [ 10.236832] mpt2sas_cm0: Intel(R) SSD 910 Series [ 10.236833] mpt2sas_cm0: Intel(R) Controller: Subsystem ID: 0x3700 [ 10.236833] mpt2sas_cm0: Intel(R) Controller: Subsystem ID: 0x3700 [ 10.236834] mpt2sas_cm0: Protocol=( [ 10.236834] Initiator [ 10.236835] ,Target [ 10.236835] ), [ 10.236835] Capabilities=( [ 10.236836] TLR [ 10.236836] ,EEDP [ 10.236836] ,Snapshot Buffer [ 10.236837] ,Diag Trace Buffer [ 10.236837] ,Task Set Full [ 10.236837] ,NCQ [ 10.236837] ) [ 10.236891] scsi host0: Fusion MPT SAS Host [ 10.237339] mpt2sas_cm0: sending port enable !! [ 10.237665] mpt2sas_cm1: 64 BIT PCI BUS DMA ADDRESSING SUPPORTED, total mem (32511480 kB) [ 10.291885] mpt2sas_cm1: MSI-X vectors supported: 1, no of cores: 32, max_msix_vectors: 8 [ 10.291965] mpt2sas 0000:81:00.0: irq 49 for MSI/MSI-X [ 10.291985] mpt2sas1-msix0: PCI-MSI-X enabled: IRQ 49 [ 10.291986] mpt2sas_cm1: iomem(0x00000000ed0c0000), mapped(0xffffc900039b0000), size(16384) [ 10.291987] mpt2sas_cm1: ioport(0x000000000000e000), size(256) [ 10.354248] [TTM] Zone kernel: Available graphics memory: 16255740 kiB [ 10.354249] [TTM] Zone dma32: Available graphics memory: 2097152 kiB [ 10.354250] [TTM] Initializing pool allocator [ 10.354253] [TTM] Initializing DMA pool allocator [ 10.388858] mpt2sas_cm1: Allocated physical memory: size(6902 kB) [ 10.388859] mpt2sas_cm1: Current Controller Queue Depth(3052),Max Controller Queue Depth(3160) [ 10.388860] mpt2sas_cm1: Scatter Gather Elements per IO(128) [ 10.391947] ata4: SATA link down (SStatus 0 SControl 300) [ 10.392961] ata3: SATA link down (SStatus 0 SControl 300) [ 10.392994] ata1: SATA link down (SStatus 0 SControl 300) [ 10.393029] ata6: SATA link down (SStatus 0 SControl 300) [ 10.393064] ata2: SATA link down (SStatus 0 SControl 300) [ 10.393099] ata5: SATA link down (SStatus 0 SControl 300) [ 10.397150] fbcon: mgadrmfb (fb0) is primary device [ 10.397199] igb: Copyright (c) 2007-2014 Intel Corporation. [ 10.397664] igb 0000:04:00.0: irq 51 for MSI/MSI-X [ 10.397756] igb 0000:04:00.0: irq 51 for MSI/MSI-X [ 10.397821] igb 0000:04:00.0: irq 52 for MSI/MSI-X [ 10.397893] igb 0000:04:00.0: irq 53 for MSI/MSI-X [ 10.397979] igb 0000:04:00.0: irq 54 for MSI/MSI-X [ 10.398063] igb 0000:04:00.0: irq 55 for MSI/MSI-X [ 10.398131] igb 0000:04:00.0: irq 56 for MSI/MSI-X [ 10.398201] igb 0000:04:00.0: irq 57 for MSI/MSI-X [ 10.398270] igb 0000:04:00.0: irq 58 for MSI/MSI-X [ 10.398340] igb 0000:04:00.0: irq 59 for MSI/MSI-X [ 10.398374] igb 0000:04:00.0: PHY reset is blocked due to SOL/IDER session. [ 10.434708] mpt2sas_cm1: LSISAS2008: FWVersion(12.00.00.00), ChipRevision(0x03), BiosVersion(00.00.00.00) [ 10.434710] mpt2sas_cm1: Intel(R) SSD 910 Series [ 10.434711] mpt2sas_cm1: Intel(R) Controller: Subsystem ID: 0x3700 [ 10.434712] mpt2sas_cm1: Intel(R) Controller: Subsystem ID: 0x3700 [ 10.434714] mpt2sas_cm1: Protocol=( [ 10.434715] Initiator [ 10.434715] ,Target [ 10.434716] ), [ 10.434717] Capabilities=( [ 10.434718] TLR [ 10.434718] ,EEDP [ 10.434719] ,Snapshot Buffer [ 10.434720] ,Diag Trace Buffer [ 10.434720] ,Task Set Full [ 10.434721] ,NCQ [ 10.434721] ) [ 10.434778] scsi host9: Fusion MPT SAS Host [ 10.435506] mpt2sas_cm1: sending port enable !! [ 10.435819] igb 0000:04:00.0: added PHC on eth0 [ 10.435820] igb 0000:04:00.0: Intel(R) Gigabit Ethernet Network Connection [ 10.435822] igb 0000:04:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:14:81 [ 10.435895] igb 0000:04:00.0: eth0: PBA No: 100000-000 [ 10.435896] igb 0000:04:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 10.436063] mpt2sas_cm2: 64 BIT PCI BUS DMA ADDRESSING SUPPORTED, total mem (32511480 kB) [ 10.436424] igb 0000:04:00.1: irq 62 for MSI/MSI-X [ 10.436512] igb 0000:04:00.1: irq 62 for MSI/MSI-X [ 10.436577] igb 0000:04:00.1: irq 63 for MSI/MSI-X [ 10.436655] igb 0000:04:00.1: irq 64 for MSI/MSI-X [ 10.436721] igb 0000:04:00.1: irq 65 for MSI/MSI-X [ 10.436786] igb 0000:04:00.1: irq 66 for MSI/MSI-X [ 10.436851] igb 0000:04:00.1: irq 67 for MSI/MSI-X [ 10.436923] igb 0000:04:00.1: irq 68 for MSI/MSI-X [ 10.436989] igb 0000:04:00.1: irq 69 for MSI/MSI-X [ 10.437056] igb 0000:04:00.1: irq 70 for MSI/MSI-X [ 10.437082] igb 0000:04:00.1: PHY reset is blocked due to SOL/IDER session. [ 10.474025] igb 0000:04:00.1: added PHC on eth1 [ 10.474026] igb 0000:04:00.1: Intel(R) Gigabit Ethernet Network Connection [ 10.474028] igb 0000:04:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:14:82 [ 10.474101] igb 0000:04:00.1: eth1: PBA No: 100000-000 [ 10.474102] igb 0000:04:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 10.474531] igb 0000:04:00.2: irq 72 for MSI/MSI-X [ 10.474620] igb 0000:04:00.2: irq 72 for MSI/MSI-X [ 10.474686] igb 0000:04:00.2: irq 73 for MSI/MSI-X [ 10.474750] igb 0000:04:00.2: irq 74 for MSI/MSI-X [ 10.474816] igb 0000:04:00.2: irq 75 for MSI/MSI-X [ 10.474889] igb 0000:04:00.2: irq 76 for MSI/MSI-X [ 10.474954] igb 0000:04:00.2: irq 77 for MSI/MSI-X [ 10.475030] igb 0000:04:00.2: irq 78 for MSI/MSI-X [ 10.475107] igb 0000:04:00.2: irq 79 for MSI/MSI-X [ 10.475185] igb 0000:04:00.2: irq 80 for MSI/MSI-X [ 10.491896] mpt2sas_cm2: MSI-X vectors supported: 1, no of cores: 32, max_msix_vectors: 8 [ 10.492041] mpt2sas 0000:82:00.0: irq 81 for MSI/MSI-X [ 10.492073] mpt2sas2-msix0: PCI-MSI-X enabled: IRQ 81 [ 10.492075] mpt2sas_cm2: iomem(0x00000000ecac0000), mapped(0xffffc900039e0000), size(16384) [ 10.492077] mpt2sas_cm2: ioport(0x000000000000d000), size(256) [ 10.531320] igb 0000:04:00.2: added PHC on eth2 [ 10.531322] igb 0000:04:00.2: Intel(R) Gigabit Ethernet Network Connection [ 10.531323] igb 0000:04:00.2: eth2: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:14:83 [ 10.531396] igb 0000:04:00.2: eth2: PBA No: 100000-000 [ 10.531397] igb 0000:04:00.2: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 10.531844] igb 0000:04:00.3: irq 83 for MSI/MSI-X [ 10.531948] igb 0000:04:00.3: irq 83 for MSI/MSI-X [ 10.532017] igb 0000:04:00.3: irq 84 for MSI/MSI-X [ 10.532085] igb 0000:04:00.3: irq 85 for MSI/MSI-X [ 10.532156] igb 0000:04:00.3: irq 86 for MSI/MSI-X [ 10.532223] igb 0000:04:00.3: irq 87 for MSI/MSI-X [ 10.532292] igb 0000:04:00.3: irq 88 for MSI/MSI-X [ 10.532359] igb 0000:04:00.3: irq 89 for MSI/MSI-X [ 10.532427] igb 0000:04:00.3: irq 90 for MSI/MSI-X [ 10.532499] igb 0000:04:00.3: irq 91 for MSI/MSI-X [ 10.587781] igb 0000:04:00.3: added PHC on eth3 [ 10.587784] igb 0000:04:00.3: Intel(R) Gigabit Ethernet Network Connection [ 10.587787] igb 0000:04:00.3: eth3: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:14:84 [ 10.587863] igb 0000:04:00.3: eth3: PBA No: 100000-000 [ 10.587864] igb 0000:04:00.3: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 10.593715] mpt2sas_cm2: Allocated physical memory: size(6902 kB) [ 10.593717] mpt2sas_cm2: Current Controller Queue Depth(3052),Max Controller Queue Depth(3160) [ 10.593717] mpt2sas_cm2: Scatter Gather Elements per IO(128) [ 10.628944] Console: switching to colour frame buffer device 128x48 [ 10.638987] mpt2sas_cm2: LSISAS2008: FWVersion(12.00.00.00), ChipRevision(0x03), BiosVersion(00.00.00.00) [ 10.638989] mpt2sas_cm2: Intel(R) SSD 910 Series [ 10.638990] mpt2sas_cm2: Intel(R) Controller: Subsystem ID: 0x3700 [ 10.638992] mpt2sas_cm2: Intel(R) Controller: Subsystem ID: 0x3700 [ 10.638993] mpt2sas_cm2: Protocol=( [ 10.638994] Initiator [ 10.638995] ,Target [ 10.638995] ), [ 10.638996] Capabilities=( [ 10.638997] TLR [ 10.638998] ,EEDP [ 10.638998] ,Snapshot Buffer [ 10.638999] ,Diag Trace Buffer [ 10.639000] ,Task Set Full [ 10.639001] ,NCQ [ 10.639001] ) [ 10.639057] scsi host10: Fusion MPT SAS Host [ 10.639767] mpt2sas_cm2: sending port enable !! [ 10.640096] mpt2sas_cm3: 64 BIT PCI BUS DMA ADDRESSING SUPPORTED, total mem (32511480 kB) [ 10.678855] mgag200 0000:0b:00.0: fb0: mgadrmfb frame buffer device [ 10.694776] mpt2sas_cm3: MSI-X vectors supported: 1, no of cores: 32, max_msix_vectors: 8 [ 10.694919] mpt2sas 0000:84:00.0: irq 93 for MSI/MSI-X [ 10.694968] mpt2sas3-msix0: PCI-MSI-X enabled: IRQ 93 [ 10.694970] mpt2sas_cm3: iomem(0x00000000ec4c0000), mapped(0xffffc900039b8000), size(16384) [ 10.694971] mpt2sas_cm3: ioport(0x000000000000c000), size(256) [ 10.794932] mpt2sas_cm3: Allocated physical memory: size(6902 kB) [ 10.794933] mpt2sas_cm3: Current Controller Queue Depth(3052),Max Controller Queue Depth(3160) [ 10.794934] mpt2sas_cm3: Scatter Gather Elements per IO(128) [ 10.841172] mpt2sas_cm3: LSISAS2008: FWVersion(12.00.00.00), ChipRevision(0x03), BiosVersion(00.00.00.00) [ 10.841174] mpt2sas_cm3: Intel(R) SSD 910 Series [ 10.841175] mpt2sas_cm3: Intel(R) Controller: Subsystem ID: 0x3700 [ 10.841176] mpt2sas_cm3: Intel(R) Controller: Subsystem ID: 0x3700 [ 10.841178] mpt2sas_cm3: Protocol=( [ 10.841179] Initiator [ 10.841179] ,Target [ 10.841180] ), [ 10.841180] Capabilities=( [ 10.841181] TLR [ 10.841182] ,EEDP [ 10.841182] ,Snapshot Buffer [ 10.841183] ,Diag Trace Buffer [ 10.841184] ,Task Set Full [ 10.841184] ,NCQ [ 10.841184] ) [ 10.841239] scsi host11: Fusion MPT SAS Host [ 10.841935] mpt2sas_cm3: sending port enable !! [ 11.315956] [drm] Initialized mgag200 1.0.0 20110418 for 0000:0b:00.0 on minor 0 [ 11.748115] mpt2sas_cm0: host_add: handle(0x0001), sas_addr(0x55cd2e400004fc08), phys(8) [ 11.754176] sas: phy-7:0 added to port-7:0, phy_mask:0x1 (5001e676b1481000) [ 11.754195] sas: phy-7:1 added to port-7:1, phy_mask:0x2 (5001e676b1481001) [ 11.754210] sas: DOING DISCOVERY on port 0, pid:6 [ 11.754233] sas: DONE DISCOVERY on port 0, pid:6, result:0 [ 11.754241] sas: DOING DISCOVERY on port 1, pid:6 [ 11.754264] sas: DONE DISCOVERY on port 1, pid:6, result:0 [ 11.754310] sas: Enter sas_scsi_recover_host busy: 0 failed: 0 [ 11.754405] sas: ata7: end_device-7:0: dev error handler [ 11.760695] scsi 0:0:0:0: Direct-Access INTEL(R) SSD 910 200GB a424 PQ: 0 ANSI: 6 [ 11.771036] scsi 0:0:0:0: SSP: handle(0x0009), sas_addr(0x5000cca013016239), phy(3), device_name(0x5000cca01301623b) [ 11.783940] scsi 0:0:0:0: SSP: enclosure_logical_id(0x55cd2e400004fc08), slot(3) [ 11.793402] scsi 0:0:0:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 11.998180] mpt2sas_cm1: host_add: handle(0x0001), sas_addr(0x55cd2e4000059375), phys(8) [ 12.010322] scsi 9:0:0:0: Direct-Access INTEL(R) SSD 910 200GB a424 PQ: 0 ANSI: 6 [ 12.020766] scsi 9:0:0:0: SSP: handle(0x0009), sas_addr(0x5000cca0130166d9), phy(3), device_name(0x5000cca0130166db) [ 12.033868] scsi 9:0:0:0: SSP: enclosure_logical_id(0x55cd2e4000059375), slot(3) [ 12.043526] scsi 9:0:0:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 12.045883] ata7.00: ATA-8: ST500NM0011, SN03, max UDMA/133 [ 12.045885] ata7.00: 976773168 sectors, multi 0: LBA48 NCQ (depth 31/32) [ 12.046732] ata7.00: configured for UDMA/133 [ 12.046785] sas: --- Exit sas_scsi_recover_host: busy: 0 failed: 0 tries: 1 [ 12.057441] scsi 7:0:0:0: Direct-Access ATA ST500NM0011 SN03 PQ: 0 ANSI: 5 [ 12.247532] mpt2sas_cm2: host_add: handle(0x0001), sas_addr(0x55cd2e4000058d95), phys(8) [ 12.259805] scsi 10:0:0:0: Direct-Access INTEL(R) SSD 910 200GB a424 PQ: 0 ANSI: 6 [ 12.270559] scsi 10:0:0:0: SSP: handle(0x0009), sas_addr(0x5000cca0130164a1), phy(3), device_name(0x5000cca0130164a3) [ 12.283971] scsi 10:0:0:0: SSP: enclosure_logical_id(0x55cd2e4000058d95), slot(3) [ 12.293922] scsi 10:0:0:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 12.372491] mpt2sas_cm3: host_add: handle(0x0001), sas_addr(0x55cd2e400004ffe6), phys(8) [ 12.385141] scsi 11:0:0:0: Direct-Access INTEL(R) SSD 910 200GB a424 PQ: 0 ANSI: 6 [ 12.396182] scsi 11:0:0:0: SSP: handle(0x0009), sas_addr(0x5000cca0130162f1), phy(3), device_name(0x5000cca0130162f3) [ 12.409772] scsi 11:0:0:0: SSP: enclosure_logical_id(0x55cd2e400004ffe6), slot(3) [ 12.419881] scsi 11:0:0:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 16.575214] mlx4_core 0000:06:00.0: Old device ETS support detected [ 16.583067] mlx4_core 0000:06:00.0: Consider upgrading device FW. [ 17.322537] mlx4_core 0000:06:00.0: PCIe link speed is 8.0GT/s, device supports 8.0GT/s [ 17.332239] mlx4_core 0000:06:00.0: PCIe link width is x8, device supports x8 [ 17.341129] mlx4_core 0000:06:00.0: irq 94 for MSI/MSI-X [ 17.341150] mlx4_core 0000:06:00.0: irq 95 for MSI/MSI-X [ 17.341169] mlx4_core 0000:06:00.0: irq 96 for MSI/MSI-X [ 17.341188] mlx4_core 0000:06:00.0: irq 97 for MSI/MSI-X [ 17.341227] mlx4_core 0000:06:00.0: irq 98 for MSI/MSI-X [ 17.341246] mlx4_core 0000:06:00.0: irq 99 for MSI/MSI-X [ 17.341265] mlx4_core 0000:06:00.0: irq 100 for MSI/MSI-X [ 17.341288] mlx4_core 0000:06:00.0: irq 101 for MSI/MSI-X [ 17.341308] mlx4_core 0000:06:00.0: irq 102 for MSI/MSI-X [ 17.341327] mlx4_core 0000:06:00.0: irq 103 for MSI/MSI-X [ 17.341346] mlx4_core 0000:06:00.0: irq 104 for MSI/MSI-X [ 17.341368] mlx4_core 0000:06:00.0: irq 105 for MSI/MSI-X [ 17.341389] mlx4_core 0000:06:00.0: irq 106 for MSI/MSI-X [ 17.341408] mlx4_core 0000:06:00.0: irq 107 for MSI/MSI-X [ 17.341427] mlx4_core 0000:06:00.0: irq 108 for MSI/MSI-X [ 17.341450] mlx4_core 0000:06:00.0: irq 109 for MSI/MSI-X [ 17.341469] mlx4_core 0000:06:00.0: irq 110 for MSI/MSI-X [ 17.341491] mlx4_core 0000:06:00.0: irq 111 for MSI/MSI-X [ 17.341511] mlx4_core 0000:06:00.0: irq 112 for MSI/MSI-X [ 17.341530] mlx4_core 0000:06:00.0: irq 113 for MSI/MSI-X [ 17.341570] mlx4_core 0000:06:00.0: irq 114 for MSI/MSI-X [ 17.341590] mlx4_core 0000:06:00.0: irq 115 for MSI/MSI-X [ 17.341609] mlx4_core 0000:06:00.0: irq 116 for MSI/MSI-X [ 17.341632] mlx4_core 0000:06:00.0: irq 117 for MSI/MSI-X [ 17.341652] mlx4_core 0000:06:00.0: irq 118 for MSI/MSI-X [ 17.341672] mlx4_core 0000:06:00.0: irq 119 for MSI/MSI-X [ 17.341691] mlx4_core 0000:06:00.0: irq 120 for MSI/MSI-X [ 17.341711] mlx4_core 0000:06:00.0: irq 121 for MSI/MSI-X [ 17.341730] mlx4_core 0000:06:00.0: irq 122 for MSI/MSI-X [ 17.341750] mlx4_core 0000:06:00.0: irq 123 for MSI/MSI-X [ 17.341769] mlx4_core 0000:06:00.0: irq 124 for MSI/MSI-X [ 17.341793] mlx4_core 0000:06:00.0: irq 125 for MSI/MSI-X [ 17.341813] mlx4_core 0000:06:00.0: irq 126 for MSI/MSI-X [ 17.341832] mlx4_core 0000:06:00.0: irq 127 for MSI/MSI-X [ 17.341852] mlx4_core 0000:06:00.0: irq 128 for MSI/MSI-X [ 17.341872] mlx4_core 0000:06:00.0: irq 129 for MSI/MSI-X [ 17.341912] mlx4_core 0000:06:00.0: irq 130 for MSI/MSI-X [ 17.341931] mlx4_core 0000:06:00.0: irq 131 for MSI/MSI-X [ 17.341950] mlx4_core 0000:06:00.0: irq 132 for MSI/MSI-X [ 17.341973] mlx4_core 0000:06:00.0: irq 133 for MSI/MSI-X [ 17.341992] mlx4_core 0000:06:00.0: irq 134 for MSI/MSI-X [ 17.342012] mlx4_core 0000:06:00.0: irq 135 for MSI/MSI-X [ 17.342031] mlx4_core 0000:06:00.0: irq 136 for MSI/MSI-X [ 17.342051] mlx4_core 0000:06:00.0: irq 137 for MSI/MSI-X [ 17.342070] mlx4_core 0000:06:00.0: irq 138 for MSI/MSI-X [ 17.342089] mlx4_core 0000:06:00.0: irq 139 for MSI/MSI-X [ 17.342109] mlx4_core 0000:06:00.0: irq 140 for MSI/MSI-X [ 17.342132] mlx4_core 0000:06:00.0: irq 141 for MSI/MSI-X [ 17.342151] mlx4_core 0000:06:00.0: irq 142 for MSI/MSI-X [ 17.342171] mlx4_core 0000:06:00.0: irq 143 for MSI/MSI-X [ 17.342190] mlx4_core 0000:06:00.0: irq 144 for MSI/MSI-X [ 17.342209] mlx4_core 0000:06:00.0: irq 145 for MSI/MSI-X [ 17.342249] mlx4_core 0000:06:00.0: irq 146 for MSI/MSI-X [ 17.342268] mlx4_core 0000:06:00.0: irq 147 for MSI/MSI-X [ 17.342288] mlx4_core 0000:06:00.0: irq 148 for MSI/MSI-X [ 17.342311] mlx4_core 0000:06:00.0: irq 149 for MSI/MSI-X [ 17.571427] sas: Enter sas_scsi_recover_host busy: 0 failed: 0 [ 17.571467] sas: ata7: end_device-7:0: dev error handler [ 17.571488] sas: ata8: end_device-7:1: dev error handler [ 17.572084] scsi 0:0:1:0: Direct-Access INTEL(R) SSD 910 200GB a424 PQ: 0 ANSI: 6 [ 17.572306] scsi 9:0:1:0: Direct-Access INTEL(R) SSD 910 200GB a424 PQ: 0 ANSI: 6 [ 17.572313] scsi 9:0:1:0: SSP: handle(0x000a), sas_addr(0x5000cca0130166de), phy(5), device_name(0x5000cca0130166df) [ 17.572316] scsi 9:0:1:0: SSP: enclosure_logical_id(0x55cd2e4000059375), slot(5) [ 17.572320] scsi 9:0:1:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 17.572574] scsi 11:0:1:0: Direct-Access INTEL(R) SSD 910 200GB a424 PQ: 0 ANSI: 6 [ 17.572580] scsi 11:0:1:0: SSP: handle(0x000a), sas_addr(0x5000cca0130162f6), phy(5), device_name(0x5000cca0130162f7) [ 17.572583] scsi 11:0:1:0: SSP: enclosure_logical_id(0x55cd2e400004ffe6), slot(5) [ 17.572587] scsi 11:0:1:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 17.666776] scsi 0:0:1:0: SSP: handle(0x000a), sas_addr(0x5000cca01301623e), phy(5), device_name(0x5000cca01301623f) [ 17.666780] scsi 0:0:1:0: SSP: enclosure_logical_id(0x55cd2e400004fc08), slot(5) [ 17.666785] scsi 0:0:1:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 17.666931] mlx4_en: Mellanox ConnectX HCA Ethernet driver v2.2-1 (Feb 2014) [ 17.667138] mlx4_ib_add: mlx4_ib: Mellanox ConnectX InfiniBand driver v2.2-1 (Feb 2014) [ 17.668648] mlx4_ib_add: counter index 0 for port 1 allocated 0 [ 17.668649] mlx4_ib_add: counter index 1 for port 2 allocated 0 [ 17.670978] scsi 10:0:1:0: Direct-Access INTEL(R) SSD 910 200GB a424 PQ: 0 ANSI: 6 [ 17.670982] scsi 10:0:1:0: SSP: handle(0x000a), sas_addr(0x5000cca0130164a6), phy(5), device_name(0x5000cca0130164a7) [ 17.670984] scsi 10:0:1:0: SSP: enclosure_logical_id(0x55cd2e4000058d95), slot(5) [ 17.670987] scsi 10:0:1:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 17.836443] mpt2sas_cm0: port enable: SUCCESS [ 17.838443] mpt2sas_cm3: port enable: SUCCESS [ 17.838445] mpt2sas_cm1: port enable: SUCCESS [ 17.844446] mpt2sas_cm2: port enable: SUCCESS [ 17.881220] ata8.00: ATA-8: ST500NM0011, SN03, max UDMA/133 [ 17.889942] ata8.00: 976773168 sectors, multi 0: LBA48 NCQ (depth 31/32) [ 17.900799] ata8.00: configured for UDMA/133 [ 17.907815] sas: --- Exit sas_scsi_recover_host: busy: 0 failed: 0 tries: 1 [ 17.919273] scsi 7:0:1:0: Direct-Access ATA ST500NM0011 SN03 PQ: 0 ANSI: 5 [ 17.947374] sd 7:0:0:0: [sda] 976773168 512-byte logical blocks: (500 GB/465 GiB) [ 17.947460] sd 7:0:1:0: [sdb] 976773168 512-byte logical blocks: (500 GB/465 GiB) [ 17.947523] sd 7:0:1:0: [sdb] Write Protect is off [ 17.947525] sd 7:0:1:0: [sdb] Mode Sense: 00 3a 00 00 [ 17.947548] sd 7:0:1:0: [sdb] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 17.947680] sd 0:0:0:0: [sdc] 390721968 512-byte logical blocks: (200 GB/186 GiB) [ 17.947681] sd 0:0:0:0: [sdc] 4096-byte physical blocks [ 17.947729] sd 0:0:1:0: [sdd] 390721968 512-byte logical blocks: (200 GB/186 GiB) [ 17.947730] sd 0:0:1:0: [sdd] 4096-byte physical blocks [ 17.947816] sd 9:0:0:0: [sde] 390721968 512-byte logical blocks: (200 GB/186 GiB) [ 17.947817] sd 9:0:0:0: [sde] 4096-byte physical blocks [ 17.947909] sd 9:0:1:0: [sdf] 390721968 512-byte logical blocks: (200 GB/186 GiB) [ 17.947911] sd 9:0:1:0: [sdf] 4096-byte physical blocks [ 17.947955] sd 10:0:0:0: [sdg] 390721968 512-byte logical blocks: (200 GB/186 GiB) [ 17.947956] sd 10:0:0:0: [sdg] 4096-byte physical blocks [ 17.948003] sd 10:0:1:0: [sdh] 390721968 512-byte logical blocks: (200 GB/186 GiB) [ 17.948004] sd 10:0:1:0: [sdh] 4096-byte physical blocks [ 17.948091] sd 11:0:0:0: [sdi] 390721968 512-byte logical blocks: (200 GB/186 GiB) [ 17.948092] sd 11:0:0:0: [sdi] 4096-byte physical blocks [ 17.948154] sd 11:0:1:0: [sdj] 390721968 512-byte logical blocks: (200 GB/186 GiB) [ 17.948155] sd 11:0:1:0: [sdj] 4096-byte physical blocks [ 17.948750] sd 0:0:0:0: [sdc] Write Protect is off [ 17.948752] sd 0:0:0:0: [sdc] Mode Sense: f7 00 10 08 [ 17.948802] sd 0:0:1:0: [sdd] Write Protect is off [ 17.948803] sd 0:0:1:0: [sdd] Mode Sense: f7 00 10 08 [ 17.948926] sd 9:0:0:0: [sde] Write Protect is off [ 17.948927] sd 9:0:0:0: [sde] Mode Sense: f7 00 10 08 [ 17.949031] sd 9:0:1:0: [sdf] Write Protect is off [ 17.949033] sd 9:0:1:0: [sdf] Mode Sense: f7 00 10 08 [ 17.949082] sd 10:0:0:0: [sdg] Write Protect is off [ 17.949085] sd 10:0:0:0: [sdg] Mode Sense: f7 00 10 08 [ 17.949120] sd 10:0:1:0: [sdh] Write Protect is off [ 17.949122] sd 10:0:1:0: [sdh] Mode Sense: f7 00 10 08 [ 17.949252] sd 11:0:1:0: [sdj] Write Protect is off [ 17.949253] sd 11:0:0:0: [sdi] Write Protect is off [ 17.949254] sd 11:0:1:0: [sdj] Mode Sense: f7 00 10 08 [ 17.949255] sd 11:0:0:0: [sdi] Mode Sense: f7 00 10 08 [ 17.949962] sd 0:0:0:0: [sdc] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 17.950026] sd 0:0:1:0: [sdd] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 17.950160] sd 9:0:0:0: [sde] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 17.950273] sd 9:0:1:0: [sdf] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 17.950335] sd 10:0:0:0: [sdg] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 17.950364] sd 10:0:1:0: [sdh] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 17.950491] sd 11:0:1:0: [sdj] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 17.950518] sd 11:0:0:0: [sdi] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 17.962189] sdh: sdh1 sdh9 [ 17.962256] sdj: sdj1 sdj9 [ 17.962439] sdg: sdg1 sdg9 [ 17.962481] sdi: sdi1 sdi9 [ 17.967382] sd 0:0:0:0: [sdc] Attached SCSI disk [ 17.967578] sdb: [ 17.967758] sd 7:0:1:0: [sdb] Attached SCSI disk [ 17.967816] sd 0:0:1:0: [sdd] Attached SCSI disk [ 17.968125] sd 9:0:0:0: [sde] Attached SCSI disk [ 17.968233] sd 9:0:1:0: [sdf] Attached SCSI disk [ 17.969332] sd 11:0:1:0: [sdj] Attached SCSI disk [ 17.969397] sd 10:0:1:0: [sdh] Attached SCSI disk [ 17.969887] sd 11:0:0:0: [sdi] Attached SCSI disk [ 17.970087] sd 10:0:0:0: [sdg] Attached SCSI disk [ 18.309825] sd 7:0:0:0: [sda] Write Protect is off [ 18.315651] sd 7:0:0:0: [sda] Mode Sense: 00 3a 00 00 [ 18.315671] sd 7:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 18.337610] sda: sda1 sda2 [ 18.341713] sd 7:0:0:0: [sda] Attached SCSI disk [ 18.906156] EXT4-fs (sda1): mounting ext3 file system using the ext4 subsystem [ 18.921142] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null) [ 19.365540] systemd-journald[341]: Received SIGTERM from PID 1 (systemd). [ 19.994478] SELinux: Disabled at runtime. [ 20.000552] SELinux: Unregistering netfilter hooks [ 20.056597] type=1404 audit(1496935852.731:2): selinux=0 auid=4294967295 ses=4294967295 [ 20.273733] ip_tables: (C) 2000-2006 Netfilter Core Team [ 20.281530] systemd[1]: Inserted module 'ip_tables' [ 22.221069] EXT4-fs (sda1): re-mounted. Opts: (null) [ 22.338062] RPC: Registered named UNIX socket transport module. [ 22.345775] RPC: Registered udp transport module. [ 22.352065] RPC: Registered tcp transport module. [ 22.358340] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 22.439534] systemd-journald[719]: Received request to flush runtime journal from PID 1 [ 22.509029] Installing knfsd (copyright (C) 1996 okir@monad.swb.de). [ 23.649068] ACPI Warning: SystemIO range 0x0000000000004000-0x000000000000401f conflicts with OpRegion 0x0000000000004000-0x000000000000400f (\_SB_.PCI0.SBUS.SMBI) (20130517/utaddress-254) [ 23.670501] ACPI: If an ACPI driver is available for this device, you should use it instead of the native driver [ 23.683332] i801_smbus 0000:03:00.3: SMBus using PCI interrupt [ 23.691618] i801_smbus 0000:03:00.4: SMBus using PCI interrupt [ 23.792105] ioatdma: Intel(R) QuickData Technology Driver 4.00 [ 23.800470] ioatdma 0000:00:04.0: irq 151 for MSI/MSI-X [ 23.800916] EDAC MC: Ver: 3.0.0 [ 23.801060] igb 0000:04:00.0: DCA enabled [ 23.801090] igb 0000:04:00.1: DCA enabled [ 23.801379] ioatdma 0000:00:04.1: irq 153 for MSI/MSI-X [ 23.801874] igb 0000:04:00.2: DCA enabled [ 23.801892] igb 0000:04:00.3: DCA enabled [ 23.814029] ioatdma 0000:00:04.2: irq 154 for MSI/MSI-X [ 23.814928] ioatdma 0000:00:04.3: irq 155 for MSI/MSI-X [ 23.816150] ioatdma 0000:00:04.4: irq 156 for MSI/MSI-X [ 23.816806] ioatdma 0000:00:04.5: irq 157 for MSI/MSI-X [ 23.817450] ioatdma 0000:00:04.6: irq 158 for MSI/MSI-X [ 23.818096] ioatdma 0000:00:04.7: irq 159 for MSI/MSI-X [ 23.829105] mei_me 0000:00:16.0: Device doesn't have valid ME Interface [ 23.829355] ioatdma 0000:80:04.0: irq 161 for MSI/MSI-X [ 23.829982] ioatdma 0000:80:04.1: irq 163 for MSI/MSI-X [ 23.830510] ioatdma 0000:80:04.2: irq 164 for MSI/MSI-X [ 23.831041] ioatdma 0000:80:04.3: irq 165 for MSI/MSI-X [ 23.831556] ioatdma 0000:80:04.4: irq 166 for MSI/MSI-X [ 23.832106] ioatdma 0000:80:04.5: irq 167 for MSI/MSI-X [ 23.832626] ioatdma 0000:80:04.6: irq 168 for MSI/MSI-X [ 23.833155] ioatdma 0000:80:04.7: irq 169 for MSI/MSI-X [ 23.837918] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 23.893555] EDAC sbridge: Seeking for: PCI ID 8086:3ca0 [ 23.893566] EDAC sbridge: Seeking for: PCI ID 8086:3ca0 [ 23.893572] EDAC sbridge: Seeking for: PCI ID 8086:3ca0 [ 23.893575] EDAC sbridge: Seeking for: PCI ID 8086:3ca8 [ 23.893582] EDAC sbridge: Seeking for: PCI ID 8086:3ca8 [ 23.893587] EDAC sbridge: Seeking for: PCI ID 8086:3ca8 [ 23.893589] EDAC sbridge: Seeking for: PCI ID 8086:3c71 [ 23.893596] EDAC sbridge: Seeking for: PCI ID 8086:3c71 [ 23.893600] EDAC sbridge: Seeking for: PCI ID 8086:3c71 [ 23.893603] EDAC sbridge: Seeking for: PCI ID 8086:3caa [ 23.893609] EDAC sbridge: Seeking for: PCI ID 8086:3caa [ 23.893614] EDAC sbridge: Seeking for: PCI ID 8086:3caa [ 23.893617] EDAC sbridge: Seeking for: PCI ID 8086:3cab [ 23.893623] EDAC sbridge: Seeking for: PCI ID 8086:3cab [ 23.893628] EDAC sbridge: Seeking for: PCI ID 8086:3cab [ 23.893630] EDAC sbridge: Seeking for: PCI ID 8086:3cac [ 23.893637] EDAC sbridge: Seeking for: PCI ID 8086:3cac [ 23.893643] EDAC sbridge: Seeking for: PCI ID 8086:3cac [ 23.893645] EDAC sbridge: Seeking for: PCI ID 8086:3cad [ 23.893652] EDAC sbridge: Seeking for: PCI ID 8086:3cad [ 23.893657] EDAC sbridge: Seeking for: PCI ID 8086:3cad [ 23.893659] EDAC sbridge: Seeking for: PCI ID 8086:3cb8 [ 23.893667] EDAC sbridge: Seeking for: PCI ID 8086:3cb8 [ 23.893672] EDAC sbridge: Seeking for: PCI ID 8086:3cb8 [ 23.893674] EDAC sbridge: Seeking for: PCI ID 8086:3cf4 [ 23.893680] EDAC sbridge: Seeking for: PCI ID 8086:3cf4 [ 23.893684] EDAC sbridge: Seeking for: PCI ID 8086:3cf4 [ 23.893687] EDAC sbridge: Seeking for: PCI ID 8086:3cf6 [ 23.893692] EDAC sbridge: Seeking for: PCI ID 8086:3cf6 [ 23.893697] EDAC sbridge: Seeking for: PCI ID 8086:3cf6 [ 23.893700] EDAC sbridge: Seeking for: PCI ID 8086:3cf5 [ 23.893707] EDAC sbridge: Seeking for: PCI ID 8086:3cf5 [ 23.893712] EDAC sbridge: Seeking for: PCI ID 8086:3cf5 [ 23.895115] EDAC MC0: Giving out device to 'sbridge_edac.c' 'Sandy Bridge Socket#0': DEV 0000:7f:0e.0 [ 23.906383] EDAC MC1: Giving out device to 'sbridge_edac.c' 'Sandy Bridge Socket#1': DEV 0000:ff:0e.0 [ 23.917511] EDAC sbridge: Ver: 1.1.1 [ 23.933421] ipmi message handler version 39.2 [ 23.950545] input: PC Speaker as /devices/platform/pcspkr/input/input3 [ 23.953256] sd 7:0:0:0: Attached scsi generic sg0 type 0 [ 23.953313] sd 7:0:1:0: Attached scsi generic sg1 type 0 [ 23.953366] sd 0:0:0:0: Attached scsi generic sg2 type 0 [ 23.953419] sd 0:0:1:0: Attached scsi generic sg3 type 0 [ 23.953469] sd 9:0:0:0: Attached scsi generic sg4 type 0 [ 23.953520] sd 9:0:1:0: Attached scsi generic sg5 type 0 [ 23.953570] sd 10:0:0:0: Attached scsi generic sg6 type 0 [ 23.953619] sd 10:0:1:0: Attached scsi generic sg7 type 0 [ 23.953672] sd 11:0:0:0: Attached scsi generic sg8 type 0 [ 23.953724] sd 11:0:1:0: Attached scsi generic sg9 type 0 [ 24.014185] iTCO_vendor_support: vendor-support=0 [ 24.175922] iTCO_wdt: Intel TCO WatchDog Timer Driver v1.11 [ 24.183032] iTCO_wdt: unable to reset NO_REBOOT flag, device disabled by hardware/BIOS [ 24.331164] IPMI System Interface driver. [ 24.336692] ipmi_si: probing via SMBIOS [ 24.341943] ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0 [ 24.349475] ipmi_si: Adding SMBIOS-specified kcs state machine [ 24.356872] ipmi_si: probing via SPMI [ 24.361804] ipmi_si: SPMI: io 0xca2 regsize 1 spacing 1 irq 0 [ 24.369082] ipmi_si: Adding SPMI-specified kcs state machine duplicate interface [ 24.378212] ipmi_si: Trying SMBIOS-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0 [ 24.489565] ipmi_si ipmi_si.0: Found new BMC (man_id: 0x000157, prod_id: 0x0049, dev_id: 0x21) [ 24.500303] ipmi_si ipmi_si.0: IPMI kcs interface initialized [ 24.584812] IPMI SSIF Interface driver [ 24.720848] AES CTR mode by8 optimization enabled [ 24.732318] alg: No test for __gcm-aes-aesni (__driver-gcm-aes-aesni) [ 24.848638] alg: No test for crc32 (crc32-pclmul) [ 24.868390] ipmi device interface [ 25.289222] Adding 16319484k swap on /dev/sda2. Priority:-1 extents:1 across:16319484k FS [ 25.683212] kvm: disabled by bios [ 25.695270] kvm: disabled by bios [ 25.706876] kvm: disabled by bios [ 25.719010] kvm: disabled by bios [ 25.733730] kvm: disabled by bios [ 25.744769] kvm: disabled by bios [ 25.755403] kvm: disabled by bios [ 25.795785] intel_rapl: Found RAPL domain package [ 25.801700] intel_rapl: Found RAPL domain core [ 25.807334] intel_rapl: Found RAPL domain dram [ 25.812997] intel_rapl: Found RAPL domain package [ 25.818901] intel_rapl: Found RAPL domain core [ 25.824541] intel_rapl: Found RAPL domain dram [ 26.157928] type=1305 audit(1496935858.831:3): audit_pid=968 old=0 auid=4294967295 ses=4294967295 res=1 [ 26.798913] Rounding down aligned max_sectors from 4294967295 to 4294967288 [ 26.829115] Loading iSCSI transport class v2.0-870. [ 26.838487] iscsi: registered transport (iser) [ 26.865268] RPC: Registered rdma transport module. [ 26.865269] RPC: Registered rdma backchannel transport module. [ 29.499871] IPv6: ADDRCONF(NETDEV_UP): eth0: link is not ready [ 29.588811] igb 0000:04:00.0 eth0: igb: eth0 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX [ 29.589956] IPv6: ADDRCONF(NETDEV_UP): eth0: link is not ready [ 29.596987] IPv6: ADDRCONF(NETDEV_UP): eth1: link is not ready [ 29.680112] IPv6: ADDRCONF(NETDEV_UP): eth1: link is not ready [ 29.680148] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready [ 29.687495] IPv6: ADDRCONF(NETDEV_UP): eth2: link is not ready [ 29.797746] IPv6: ADDRCONF(NETDEV_UP): eth2: link is not ready [ 29.808774] IPv6: ADDRCONF(NETDEV_UP): eth3: link is not ready [ 29.919770] IPv6: ADDRCONF(NETDEV_UP): eth3: link is not ready [ 29.929771] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready [ 29.937831] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready [ 29.947551] IPv6: ADDRCONF(NETDEV_UP): ib1: link is not ready [ 29.955372] IPv6: ADDRCONF(NETDEV_UP): ib1: link is not ready [ 37.790486] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready [ 37.803263] ib0: enabling connected mode will cause multicast packet drops [ 37.811380] ib0: mtu > 4092 will cause multicast packet drops. [ 37.818972] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready [ 37.828044] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready [ 60.049320] IPv6: ADDRCONF(NETDEV_CHANGE): ib0: link becomes ready [ 736.245657] libcfs: loading out-of-tree module taints kernel. [ 736.252542] libcfs: module verification failed: signature and/or required key missing - tainting kernel [ 736.267447] LNet: HW nodes: 2, HW CPU cores: 32, npartitions: 2 [ 736.277149] alg: No test for adler32 (adler32-zlib) [ 736.282946] alg: No test for crc32 (crc32-table) [ 737.118791] Lustre: Lustre: Build Version: 2.9.58_10_gf733ffe [ 737.232843] LNet: Added LNI 192.168.1.116@o2ib100 [8/256/0/180] [ 737.286995] LNetError: 208:0:(o2iblnd_cb.c:2785:kiblnd_rejected()) 192.168.1.114@o2ib100 rejected: o2iblnd fatal error [ 1548.186025] LustreError: 11-0: soaked-OST0009-osc-ffff880828cb2000: operation ost_connect to node 192.168.1.105@o2ib10 failed: rc = -16 [ 1548.196994] Lustre: Mounted soaked-client [ 1573.186341] LustreError: 11-0: soaked-OST0013-osc-ffff880828cb2000: operation ost_connect to node 192.168.1.103@o2ib10 failed: rc = -16 [ 1573.200075] LustreError: Skipped 14 previous similar messages [ 1598.186919] LustreError: 11-0: soaked-OST0015-osc-ffff880828cb2000: operation ost_connect to node 192.168.1.105@o2ib10 failed: rc = -16 [ 1598.200642] LustreError: Skipped 9 previous similar messages [ 1623.187591] LustreError: 11-0: soaked-OST0016-osc-ffff880828cb2000: operation ost_connect to node 192.168.1.106@o2ib10 failed: rc = -16 [ 1623.201334] LustreError: Skipped 6 previous similar messages [ 2045.858348] FS-Cache: Loaded [ 2045.895103] FS-Cache: Netfs 'nfs' registered for caching [ 2045.921573] Key type dns_resolver registered [ 2045.955830] NFS: Registering the id_resolver key type [ 2045.961525] Key type id_resolver registered [ 2045.966239] Key type id_legacy registered [ 5607.148904] Lustre: 2968:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496941431/real 1496941431] req@ffff8804f94d0c00 x1569651891110144/t0(0) o400->soaked-MDT0002-mdc-ffff880828cb2000@192.168.1.110@o2ib10:12/10 lens 224/224 e 0 to 1 dl 1496941438 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [ 5607.182378] Lustre: soaked-MDT0002-mdc-ffff880828cb2000: Connection to soaked-MDT0002 (at 192.168.1.110@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [ 5613.202923] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496941440/real 1496941440] req@ffff8804f94d1800 x1569651891306288/t0(0) o38->soaked-MDT0002-mdc-ffff880828cb2000@192.168.1.110@o2ib10:12/10 lens 520/544 e 0 to 1 dl 1496941446 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [ 5668.202841] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496941490/real 1496941490] req@ffff8804f94d0300 x1569651891988736/t0(0) o38->soaked-MDT0002-mdc-ffff880828cb2000@192.168.1.110@o2ib10:12/10 lens 520/544 e 0 to 1 dl 1496941501 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [ 5723.203729] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496941540/real 1496941540] req@ffff8804f9551b00 x1569651892959440/t0(0) o38->soaked-MDT0002-mdc-ffff880828cb2000@192.168.1.110@o2ib10:12/10 lens 520/544 e 0 to 1 dl 1496941556 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [ 5778.204629] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496941590/real 1496941590] req@ffff8804f9552700 x1569651893648512/t0(0) o38->soaked-MDT0002-mdc-ffff880828cb2000@192.168.1.110@o2ib10:12/10 lens 520/544 e 0 to 1 dl 1496941611 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [ 5833.205494] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496941640/real 1496941640] req@ffff8804f9556300 x1569651894440352/t0(0) o38->soaked-MDT0002-mdc-ffff880828cb2000@192.168.1.110@o2ib10:12/10 lens 520/544 e 0 to 1 dl 1496941666 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [ 5952.356772] Lustre: soaked-MDT0002-mdc-ffff880828cb2000: Connection restored to 192.168.1.111@o2ib10 (at 192.168.1.111@o2ib10) [ 5982.208386] LustreError: 11-0: soaked-MDT0002-mdc-ffff880828cb2000: operation obd_ping to node 192.168.1.111@o2ib10 failed: rc = -107 [ 5982.228648] LustreError: Skipped 1 previous similar message [ 5982.237951] Lustre: soaked-MDT0002-mdc-ffff880828cb2000: Connection to soaked-MDT0002 (at 192.168.1.111@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [ 5984.372925] Lustre: 3423:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496941785/real 1496941785] req@ffff88065475d700 x1569651896754880/t0(0) o101->soaked-MDT0002-mdc-ffff880828cb2000@192.168.1.111@o2ib10:12/10 lens 1728/5800 e 1 to 1 dl 1496941817 ref 2 fl Rpc:XP/0/ffffffff rc 0/-1 [ 6038.208806] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496941865/real 1496941865] req@ffff8804f9556c00 x1569651897736384/t0(0) o38->soaked-MDT0002-mdc-ffff880828cb2000@192.168.1.110@o2ib10:12/10 lens 520/544 e 0 to 1 dl 1496941871 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [ 6075.653028] LustreError: 2947:0:(import.c:1259:ptlrpc_connect_interpret()) soaked-MDT0002_UUID went back in time (transno 773095755347 was previously committed, server now claims 773095730992)! See https://bugzilla.lustre.org/show_bug.cgi?id=9646 [ 6116.840741] Lustre: soaked-MDT0002-mdc-ffff880828cb2000: Connection restored to 192.168.1.110@o2ib10 (at 192.168.1.110@o2ib10) [ 6670.694893] perf: interrupt took too long (2517 > 2500), lowering kernel.perf_event_max_sample_rate to 79000 [ 7922.717099] LustreError: 11-0: soaked-OST0012-osc-ffff880828cb2000: operation ldlm_enqueue to node 192.168.1.102@o2ib10 failed: rc = -14 [ 8600.420006] Lustre: 2970:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496944415/real 1496944415] req@ffff8801bef91e00 x1569651955339456/t0(0) o400->soaked-MDT0001-mdc-ffff880828cb2000@192.168.1.109@o2ib10:12/10 lens 224/224 e 0 to 1 dl 1496944433 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [ 8600.464519] Lustre: soaked-MDT0001-mdc-ffff880828cb2000: Connection to soaked-MDT0001 (at 192.168.1.109@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [ 8662.492999] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496944483/real 1496944483] req@ffff8801bef90900 x1569651955398496/t0(0) o38->soaked-MDT0001-mdc-ffff880828cb2000@192.168.1.109@o2ib10:12/10 lens 520/544 e 0 to 1 dl 1496944495 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [ 8662.538176] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 1 previous similar message [ 8717.493892] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496944533/real 1496944533] req@ffff8801bef90f00 x1569651955444272/t0(0) o38->soaked-MDT0001-mdc-ffff880828cb2000@192.168.1.109@o2ib10:12/10 lens 520/544 e 0 to 1 dl 1496944550 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [ 8772.494766] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496944583/real 1496944583] req@ffff8801bef95100 x1569651955506464/t0(0) o38->soaked-MDT0001-mdc-ffff880828cb2000@192.168.1.109@o2ib10:12/10 lens 520/544 e 0 to 1 dl 1496944605 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [ 8907.496930] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496944708/real 1496944708] req@ffff8806de0cd100 x1569651957089184/t0(0) o38->soaked-MDT0001-mdc-ffff880828cb2000@192.168.1.109@o2ib10:12/10 lens 520/544 e 0 to 1 dl 1496944740 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [ 8907.542316] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 1 previous similar message [ 9067.499553] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496944858/real 1496944858] req@ffff8806e0a26600 x1569651961196784/t0(0) o38->soaked-MDT0001-mdc-ffff880828cb2000@192.168.1.109@o2ib10:12/10 lens 520/544 e 0 to 1 dl 1496944900 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [ 9067.544877] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 1 previous similar message [ 9295.582258] Lustre: soaked-MDT0002-mdc-ffff880828cb2000: Connection to soaked-MDT0002 (at 192.168.1.110@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [ 9295.648014] Lustre: soaked-MDT0002-mdc-ffff880828cb2000: Connection restored to 192.168.1.110@o2ib10 (at 192.168.1.110@o2ib10) [ 9330.630805] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496945108/real 1496945108] req@ffff8807b8f1f200 x1569651967066512/t0(0) o38->soaked-MDT0001-mdc-ffff880828cb2000@192.168.1.109@o2ib10:12/10 lens 520/544 e 0 to 1 dl 1496945163 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [ 9330.674790] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 3 previous similar messages [ 9634.878184] Lustre: soaked-MDT0001-mdc-ffff880828cb2000: Connection restored to 192.168.1.109@o2ib10 (at 192.168.1.109@o2ib10) [12158.934302] Lustre: 41319:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496947933/real 1496947933] req@ffff880153374b00 x1569652030246240/t0(0) o36->soaked-MDT0002-mdc-ffff880828cb2000@192.168.1.110@o2ib10:12/10 lens 776/1696 e 0 to 1 dl 1496947991 ref 2 fl Rpc:X/0/ffffffff rc 0/-1 [12158.979438] Lustre: 41319:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 2 previous similar messages [12158.994269] Lustre: soaked-MDT0002-mdc-ffff880828cb2000: Connection to soaked-MDT0002 (at 192.168.1.110@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [12240.835769] INFO: task blogbench:41320 blocked for more than 120 seconds. [12240.847276] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [12240.859608] blogbench D ffff88004b9f05c0 0 41320 41304 0x00000080 [12240.870809] ffff880208bcbce0 0000000000000086 ffff880201faedd0 ffff880208bcbfd8 [12240.882185] ffff880208bcbfd8 ffff880208bcbfd8 ffff880201faedd0 ffff88004b9f05b8 [12240.893340] ffff88004b9f05bc ffff880201faedd0 00000000ffffffff ffff88004b9f05c0 [12240.904331] Call Trace: [12240.909476] [] schedule_preempt_disabled+0x29/0x70 [12240.919096] [] __mutex_lock_slowpath+0xc5/0x1c0 [12240.928230] [] mutex_lock+0x1f/0x2f [12240.936198] [] lock_rename+0xc0/0xe0 [12240.944073] [] SYSC_renameat2+0x22f/0x570 [12240.952435] [] ? call_rcu_sched+0x1d/0x20 [12240.960647] [] ? dentry_kill+0x14e/0x1b0 [12240.968728] [] ? mntput_no_expire+0x3e/0x120 [12240.977081] [] ? ____fput+0xe/0x10 [12240.984426] [] ? task_work_run+0xac/0xe0 [12240.992281] [] SyS_renameat2+0xe/0x10 [12240.999839] [] SyS_rename+0x1e/0x20 [12241.007072] [] system_call_fastpath+0x16/0x1b [12241.015257] INFO: task blogbench:41323 blocked for more than 120 seconds. [12241.024225] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [12241.034357] blogbench D ffff88062be8b740 0 41323 41304 0x00000080 [12241.043593] ffff8801862a3c70 0000000000000086 ffff8808257d3ec0 ffff8801862a3fd8 [12241.053190] ffff8801862a3fd8 ffff8801862a3fd8 ffff8808257d3ec0 ffff88062be8b738 [12241.062739] ffff88062be8b73c ffff8808257d3ec0 00000000ffffffff ffff88062be8b740 [12241.072269] Call Trace: [12241.076164] [] schedule_preempt_disabled+0x29/0x70 [12241.084541] [] __mutex_lock_slowpath+0xc5/0x1c0 [12241.092611] [] mutex_lock+0x1f/0x2f [12241.099486] [] do_last+0x28f/0x12a0 [12241.106339] [] ? __slab_free+0x81/0x2f0 [12241.113550] [] path_openat+0xc2/0x490 [12241.120547] [] ? kmem_cache_free+0x1bb/0x1f0 [12241.128220] [] ? ll_file_data_put+0x89/0x180 [lustre] [12241.136715] [] do_filp_open+0x4b/0xb0 [12241.143639] [] ? __alloc_fd+0xa7/0x130 [12241.150715] [] do_sys_open+0xf3/0x1f0 [12241.157583] [] SyS_open+0x1e/0x20 [12241.164040] [] system_call_fastpath+0x16/0x1b [12241.171648] INFO: task blogbench:41324 blocked for more than 120 seconds. [12241.180095] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [12241.189711] blogbench D ffff8806a615ed40 0 41324 41304 0x00000080 [12241.198482] ffff8801ebd9bc70 0000000000000086 ffff8808257d0000 ffff8801ebd9bfd8 [12241.207663] ffff8801ebd9bfd8 ffff8801ebd9bfd8 ffff8808257d0000 ffff8806a615ed38 [12241.216816] ffff8806a615ed3c ffff8808257d0000 00000000ffffffff ffff8806a615ed40 [12241.225965] Call Trace: [12241.229458] [] schedule_preempt_disabled+0x29/0x70 [12241.237420] [] __mutex_lock_slowpath+0xc5/0x1c0 [12241.245086] [] mutex_lock+0x1f/0x2f [12241.251569] [] do_last+0x28f/0x12a0 [12241.258059] [] ? mdc_lock_match+0xb2/0x180 [mdc] [12241.265804] [] path_openat+0xc2/0x490 [12241.272522] [] ? lprocfs_counter_sub+0xc1/0x130 [obdclass] [12241.281237] [] ? ll_file_data_put+0x89/0x180 [lustre] [12241.289465] [] do_filp_open+0x4b/0xb0 [12241.296137] [] ? __alloc_fd+0xa7/0x130 [12241.302903] [] do_sys_open+0xf3/0x1f0 [12241.309572] [] SyS_open+0x1e/0x20 [12241.315851] [] system_call_fastpath+0x16/0x1b [12241.323291] INFO: task blogbench:41325 blocked for more than 120 seconds. [12241.331633] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [12241.341152] blogbench D ffff8806a615ed40 0 41325 41304 0x00000080 [12241.349832] ffff8803ce50bc70 0000000000000086 ffff8804b9799f60 ffff8803ce50bfd8 [12241.358939] ffff8803ce50bfd8 ffff8803ce50bfd8 ffff8804b9799f60 ffff8806a615ed38 [12241.368066] ffff8806a615ed3c ffff8804b9799f60 00000000ffffffff ffff8806a615ed40 [12241.377209] Call Trace: [12241.380719] [] schedule_preempt_disabled+0x29/0x70 [12241.388711] [] __mutex_lock_slowpath+0xc5/0x1c0 [12241.396395] [] mutex_lock+0x1f/0x2f [12241.402907] [] do_last+0x28f/0x12a0 [12241.409415] [] ? __slab_free+0x81/0x2f0 [12241.416303] [] path_openat+0xc2/0x490 [12241.422994] [] ? kmem_cache_free+0x1bb/0x1f0 [12241.430366] [] ? ll_file_data_put+0x89/0x180 [lustre] [12241.438595] [] do_filp_open+0x4b/0xb0 [12241.445275] [] ? __alloc_fd+0xa7/0x130 [12241.452048] [] do_sys_open+0xf3/0x1f0 [12241.458716] [] SyS_open+0x1e/0x20 [12241.465059] [] system_call_fastpath+0x16/0x1b [12241.472515] INFO: task blogbench:41326 blocked for more than 120 seconds. [12241.480853] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [12241.490369] blogbench D ffff8806a615ed40 0 41326 41304 0x00000080 [12241.499062] ffff8802ad9a3c70 0000000000000086 ffff880411f63ec0 ffff8802ad9a3fd8 [12241.508187] ffff8802ad9a3fd8 ffff8802ad9a3fd8 ffff880411f63ec0 ffff8806a615ed38 [12241.517284] ffff8806a615ed3c ffff880411f63ec0 00000000ffffffff ffff8806a615ed40 [12241.526363] Call Trace: [12241.529828] [] schedule_preempt_disabled+0x29/0x70 [12241.537766] [] __mutex_lock_slowpath+0xc5/0x1c0 [12241.545369] [] mutex_lock+0x1f/0x2f [12241.551807] [] do_last+0x28f/0x12a0 [12241.558209] [] ? __slab_free+0x81/0x2f0 [12241.565001] [] path_openat+0xc2/0x490 [12241.571574] [] ? kmem_cache_free+0x1bb/0x1f0 [12241.578830] [] ? ll_file_data_put+0x89/0x180 [lustre] [12241.586933] [] do_filp_open+0x4b/0xb0 [12241.593468] [] ? __alloc_fd+0xa7/0x130 [12241.600089] [] do_sys_open+0xf3/0x1f0 [12241.606609] [] SyS_open+0x1e/0x20 [12241.612715] [] system_call_fastpath+0x16/0x1b [12241.619995] INFO: task blogbench:41327 blocked for more than 120 seconds. [12241.628150] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [12241.637470] blogbench D ffff8807dd647640 0 41327 41304 0x00000080 [12241.646027] ffff88023928bc70 0000000000000086 ffff880411f64e70 ffff88023928bfd8 [12241.654946] ffff88023928bfd8 ffff88023928bfd8 ffff880411f64e70 ffff8807dd647638 [12241.663862] ffff8807dd64763c ffff880411f64e70 00000000ffffffff ffff8807dd647640 [12241.672786] Call Trace: [12241.676116] [] schedule_preempt_disabled+0x29/0x70 [12241.683917] [] __mutex_lock_slowpath+0xc5/0x1c0 [12241.691416] [] mutex_lock+0x1f/0x2f [12241.697741] [] do_last+0x28f/0x12a0 [12241.704056] [] ? __slab_free+0x81/0x2f0 [12241.710753] [] path_openat+0xc2/0x490 [12241.717256] [] ? kmem_cache_free+0x1bb/0x1f0 [12241.724446] [] ? ll_file_data_put+0x89/0x180 [lustre] [12241.732484] [] do_filp_open+0x4b/0xb0 [12241.738982] [] ? __alloc_fd+0xa7/0x130 [12241.745560] [] do_sys_open+0xf3/0x1f0 [12241.752061] [] SyS_open+0x1e/0x20 [12241.758162] [] system_call_fastpath+0x16/0x1b [12241.765423] INFO: task blogbench:41328 blocked for more than 120 seconds. [12241.773576] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [12241.782896] blogbench D ffff8806a615ed40 0 41328 41304 0x00000080 [12241.791378] ffff880208bbfc70 0000000000000086 ffff880411f66dd0 ffff880208bbffd8 [12241.800285] ffff880208bbffd8 ffff880208bbffd8 ffff880411f66dd0 ffff8806a615ed38 [12241.809192] ffff8806a615ed3c ffff880411f66dd0 00000000ffffffff ffff8806a615ed40 [12241.818098] Call Trace: [12241.821415] [] schedule_preempt_disabled+0x29/0x70 [12241.829201] [] __mutex_lock_slowpath+0xc5/0x1c0 [12241.836691] [] mutex_lock+0x1f/0x2f [12241.843010] [] do_last+0x28f/0x12a0 [12241.849317] [] ? __slab_free+0x81/0x2f0 [12241.856011] [] path_openat+0xc2/0x490 [12241.862510] [] ? kmem_cache_free+0x1bb/0x1f0 [12241.869690] [] ? ll_file_data_put+0x89/0x180 [lustre] [12241.877735] [] do_filp_open+0x4b/0xb0 [12241.884226] [] ? __alloc_fd+0xa7/0x130 [12241.890811] [] do_sys_open+0xf3/0x1f0 [12241.897301] [] SyS_open+0x1e/0x20 [12241.903400] [] system_call_fastpath+0x16/0x1b [12241.910675] INFO: task blogbench:41329 blocked for more than 120 seconds. [12241.918820] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [12241.928135] blogbench D ffff8807dd647640 0 41329 41304 0x00000080 [12241.936626] ffff8801d70b7c70 0000000000000086 ffff880411f61f60 ffff8801d70b7fd8 [12241.945548] ffff8801d70b7fd8 ffff8801d70b7fd8 ffff880411f61f60 ffff8807dd647638 [12241.954491] ffff8807dd64763c ffff880411f61f60 00000000ffffffff ffff8807dd647640 [12241.963408] Call Trace: [12241.966720] [] schedule_preempt_disabled+0x29/0x70 [12241.974502] [] __mutex_lock_slowpath+0xc5/0x1c0 [12241.981994] [] mutex_lock+0x1f/0x2f [12241.988310] [] do_last+0x28f/0x12a0 [12241.994617] [] ? __slab_free+0x81/0x2f0 [12242.001320] [] path_openat+0xc2/0x490 [12242.007821] [] ? kmem_cache_free+0x1bb/0x1f0 [12242.015001] [] ? ll_file_data_put+0x89/0x180 [lustre] [12242.023102] [] do_filp_open+0x4b/0xb0 [12242.029593] [] ? __alloc_fd+0xa7/0x130 [12242.036178] [] do_sys_open+0xf3/0x1f0 [12242.042673] [] SyS_open+0x1e/0x20 [12242.048771] [] system_call_fastpath+0x16/0x1b [12242.056037] INFO: task blogbench:41330 blocked for more than 120 seconds. [12242.064183] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [12242.073501] blogbench D ffff8806a615ed40 0 41330 41304 0x00000080 [12242.081987] ffff8802304f7c70 0000000000000086 ffff880411f62f10 ffff8802304f7fd8 [12242.090924] ffff8802304f7fd8 ffff8802304f7fd8 ffff880411f62f10 ffff8806a615ed38 [12242.099846] ffff8806a615ed3c ffff880411f62f10 00000000ffffffff ffff8806a615ed40 [12242.108759] Call Trace: [12242.112071] [] schedule_preempt_disabled+0x29/0x70 [12242.119863] [] __mutex_lock_slowpath+0xc5/0x1c0 [12242.127355] [] mutex_lock+0x1f/0x2f [12242.133673] [] do_last+0x28f/0x12a0 [12242.139981] [] ? __slab_free+0x81/0x2f0 [12242.146678] [] path_openat+0xc2/0x490 [12242.153180] [] ? kmem_cache_free+0x1bb/0x1f0 [12242.160359] [] ? ll_file_data_put+0x89/0x180 [lustre] [12242.168405] [] do_filp_open+0x4b/0xb0 [12242.174898] [] ? __alloc_fd+0xa7/0x130 [12242.181482] [] do_sys_open+0xf3/0x1f0 [12242.187972] [] SyS_open+0x1e/0x20 [12242.194073] [] system_call_fastpath+0x16/0x1b [12242.201348] INFO: task blogbench:41331 blocked for more than 120 seconds. [12242.209495] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [12242.218816] blogbench D ffff88062be8b740 0 41331 41304 0x00000080 [12242.227312] ffff880130243c70 0000000000000086 ffff88034c703ec0 ffff880130243fd8 [12242.236233] ffff880130243fd8 ffff880130243fd8 ffff88034c703ec0 ffff88062be8b738 [12242.245159] ffff88062be8b73c ffff88034c703ec0 00000000ffffffff ffff88062be8b740 [12242.254080] Call Trace: [12242.257401] [] schedule_preempt_disabled+0x29/0x70 [12242.265193] [] __mutex_lock_slowpath+0xc5/0x1c0 [12242.272686] [] mutex_lock+0x1f/0x2f [12242.279006] [] do_last+0x28f/0x12a0 [12242.285315] [] ? __slab_free+0x81/0x2f0 [12242.292012] [] path_openat+0xc2/0x490 [12242.298514] [] ? kmem_cache_free+0x1bb/0x1f0 [12242.305693] [] ? ll_file_data_put+0x89/0x180 [lustre] [12242.313734] [] do_filp_open+0x4b/0xb0 [12242.320227] [] ? __alloc_fd+0xa7/0x130 [12242.326815] [] do_sys_open+0xf3/0x1f0 [12242.333308] [] SyS_open+0x1e/0x20 [12242.339410] [] system_call_fastpath+0x16/0x1b [12276.023240] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496948091/real 1496948091] req@ffff8806d081cb00 x1569652030280928/t0(0) o38->soaked-MDT0002-mdc-ffff880828cb2000@192.168.1.110@o2ib10:12/10 lens 520/544 e 0 to 1 dl 1496948108 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [12276.061625] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 7 previous similar messages [12497.070204] LustreError: 2947:0:(client.c:2982:ptlrpc_replay_interpret()) @@@ status 301, old was 0 req@ffff88068c758600 x1569652030234128/t781687614006(781687614006) o101->soaked-MDT0002-mdc-ffff880828cb2000@192.168.1.111@o2ib10:12/10 lens 1088/544 e 1 to 0 dl 1496948344 ref 2 fl Interpret:R/4/0 rc 301/301 [12500.437245] Lustre: soaked-MDT0002-mdc-ffff880828cb2000: Connection restored to 192.168.1.111@o2ib10 (at 192.168.1.111@o2ib10) [12516.643944] LustreError: 11-0: soaked-MDT0002-mdc-ffff880828cb2000: operation mds_statfs to node 192.168.1.111@o2ib10 failed: rc = -107 [12516.650578] Lustre: soaked-MDT0002-mdc-ffff880828cb2000: Connection to soaked-MDT0002 (at 192.168.1.111@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [12516.683770] LustreError: Skipped 1 previous similar message [12590.760191] Lustre: soaked-MDT0002-mdc-ffff880828cb2000: Connection restored to 192.168.1.110@o2ib10 (at 192.168.1.110@o2ib10) [13400.527035] perf: interrupt took too long (3150 > 3146), lowering kernel.perf_event_max_sample_rate to 63000 [14926.377310] Lustre: 61188:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496950752/real 1496950752] req@ffff8807f011dd00 x1569652716730656/t0(0) o41->soaked-MDT0002-mdc-ffff880828cb2000@192.168.1.110@o2ib10:12/10 lens 224/368 e 0 to 1 dl 1496950759 ref 2 fl Rpc:X/0/ffffffff rc 0/-1 [14926.413879] Lustre: 61188:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 2 previous similar messages [14926.425945] Lustre: soaked-MDT0002-mdc-ffff880828cb2000: Connection to soaked-MDT0002 (at 192.168.1.110@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [15047.622277] Lustre: soaked-MDT0002-mdc-ffff880828cb2000: Connection restored to 192.168.1.111@o2ib10 (at 192.168.1.111@o2ib10) [15057.827789] Lustre: soaked-MDT0002-mdc-ffff880828cb2000: Connection to soaked-MDT0002 (at 192.168.1.111@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [15104.072199] Lustre: 2977:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496950716/real 1496950716] req@ffff8805400e5700 x1569652696555392/t0(0) o400->soaked-MDT0002-mdc-ffff880828cb2000@192.168.1.110@o2ib10:12/10 lens 224/224 e 0 to 1 dl 1496950723 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [15104.110754] Lustre: 2977:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 2 previous similar messages [15122.619424] Lustre: soaked-MDT0002-mdc-ffff880828cb2000: Connection restored to 192.168.1.110@o2ib10 (at 192.168.1.110@o2ib10) [15144.106851] Lustre: 2970:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496950591/real 1496950591] req@ffff88048da9a700 x1569652626470880/t0(0) o400->soaked-MDT0002-mdc-ffff880828cb2000@192.168.1.110@o2ib10:12/10 lens 224/224 e 0 to 1 dl 1496950598 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [15144.143499] Lustre: 2970:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 4 previous similar messages [17495.892807] perf: interrupt took too long (3948 > 3937), lowering kernel.perf_event_max_sample_rate to 50000 [18606.782744] Lustre: 65288:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496954421/real 1496954421] req@ffff880635702700 x1569652982092864/t0(0) o101->soaked-MDT0001-mdc-ffff880828cb2000@192.168.1.109@o2ib10:12/10 lens 1728/5800 e 0 to 1 dl 1496954439 ref 2 fl Rpc:XP/0/ffffffff rc 0/-1 [18606.819968] Lustre: 65288:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 4 previous similar messages [18606.832114] Lustre: soaked-MDT0001-mdc-ffff880828cb2000: Connection to soaked-MDT0001 (at 192.168.1.109@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [18667.854741] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496954489/real 1496954489] req@ffff88074beb2400 x1569652982093888/t0(0) o38->soaked-MDT0001-mdc-ffff880828cb2000@192.168.1.109@o2ib10:12/10 lens 520/544 e 0 to 1 dl 1496954500 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [18667.891977] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 1 previous similar message [18722.856643] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496954539/real 1496954539] req@ffff880554c2da00 x1569652982094896/t0(0) o38->soaked-MDT0001-mdc-ffff880828cb2000@192.168.1.109@o2ib10:12/10 lens 520/544 e 0 to 1 dl 1496954555 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [18777.856503] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496954589/real 1496954589] req@ffff880635706900 x1569652982095904/t0(0) o38->soaked-MDT0001-mdc-ffff880828cb2000@192.168.1.109@o2ib10:12/10 lens 520/544 e 0 to 1 dl 1496954610 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [18912.858692] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496954714/real 1496954714] req@ffff8805e21cc800 x1569652982098544/t0(0) o38->soaked-MDT0001-mdc-ffff880828cb2000@192.168.1.109@o2ib10:12/10 lens 520/544 e 0 to 1 dl 1496954745 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [18912.895894] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 1 previous similar message [18948.541384] LustreError: 2947:0:(client.c:2982:ptlrpc_replay_interpret()) @@@ status 301, old was 0 req@ffff880637f86900 x1569652981832192/t768817579925(768817579925) o101->soaked-MDT0001-mdc-ffff880828cb2000@192.168.1.108@o2ib10:12/10 lens 1728/544 e 0 to 0 dl 1496954798 ref 2 fl Interpret:R/4/0 rc 301/301 [18949.080487] LustreError: 2947:0:(client.c:2982:ptlrpc_replay_interpret()) @@@ status 301, old was 0 req@ffff8804918d4b00 x1569652981863872/t768817582046(768817582046) o101->soaked-MDT0001-mdc-ffff880828cb2000@192.168.1.108@o2ib10:12/10 lens 1728/544 e 0 to 0 dl 1496954798 ref 2 fl Interpret:R/4/0 rc 301/301 [18949.115232] LustreError: 2947:0:(client.c:2982:ptlrpc_replay_interpret()) Skipped 244 previous similar messages [18950.081495] LustreError: 2947:0:(client.c:2982:ptlrpc_replay_interpret()) @@@ status 301, old was 0 req@ffff8806dd756f00 x1569652981927616/t768817586265(768817586265) o101->soaked-MDT0001-mdc-ffff880828cb2000@192.168.1.108@o2ib10:12/10 lens 1728/544 e 0 to 0 dl 1496954799 ref 2 fl Interpret:R/4/0 rc 301/301 [18950.116135] LustreError: 2947:0:(client.c:2982:ptlrpc_replay_interpret()) Skipped 497 previous similar messages [18952.133737] LustreError: 2947:0:(client.c:2982:ptlrpc_replay_interpret()) @@@ status 301, old was 0 req@ffff880765ff2700 x1569652982053952/t768817594684(768817594684) o101->soaked-MDT0001-mdc-ffff880828cb2000@192.168.1.108@o2ib10:12/10 lens 1728/544 e 0 to 0 dl 1496954801 ref 2 fl Interpret:R/4/0 rc 301/301 [18952.168387] LustreError: 2947:0:(client.c:2982:ptlrpc_replay_interpret()) Skipped 971 previous similar messages [18952.961905] Lustre: soaked-MDT0001-mdc-ffff880828cb2000: Connection restored to 192.168.1.108@o2ib10 (at 192.168.1.108@o2ib10) [18965.482430] LustreError: 11-0: soaked-MDT0001-mdc-ffff880828cb2000: operation mds_reint to node 192.168.1.108@o2ib10 failed: rc = -19 [18965.498857] Lustre: soaked-MDT0001-mdc-ffff880828cb2000: Connection to soaked-MDT0001 (at 192.168.1.108@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [18974.066109] perf: interrupt took too long (4976 > 4935), lowering kernel.perf_event_max_sample_rate to 40000 [19040.045436] Lustre: soaked-MDT0001-mdc-ffff880828cb2000: Connection restored to 192.168.1.109@o2ib10 (at 192.168.1.109@o2ib10) [21689.533712] Lustre: 65288:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496957515/real 1496957515] req@ffff8806fee5c500 x1569653126839984/t0(0) o101->soaked-OST0011-osc-ffff880828cb2000@192.168.1.107@o2ib10:28/4 lens 328/400 e 0 to 1 dl 1496957522 ref 2 fl Rpc:X/0/ffffffff rc 0/-1 [21689.571247] Lustre: soaked-OST0011-osc-ffff880828cb2000: Connection to soaked-OST0011 (at 192.168.1.107@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [21694.891810] Lustre: soaked-OST0017-osc-ffff880828cb2000: Connection to soaked-OST0017 (at 192.168.1.107@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [21696.890835] Lustre: soaked-OST000b-osc-ffff880828cb2000: Connection to soaked-OST000b (at 192.168.1.107@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [21757.917812] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496957579/real 1496957579] req@ffff88047fa7b600 x1569653126969600/t0(0) o8->soaked-OST0017-osc-ffff880828cb2000@192.168.1.107@o2ib10:28/4 lens 520/544 e 0 to 1 dl 1496957590 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [21757.955142] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 7 previous similar messages [21812.918698] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496957629/real 1496957629] req@ffff8804dcc7b900 x1569653128236496/t0(0) o8->soaked-OST0017-osc-ffff880828cb2000@192.168.1.107@o2ib10:28/4 lens 520/544 e 0 to 1 dl 1496957645 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [21812.955729] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 3 previous similar messages [21922.920473] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496957729/real 1496957729] req@ffff8804dcc7d100 x1569653129781296/t0(0) o8->soaked-OST0017-osc-ffff880828cb2000@192.168.1.107@o2ib10:28/4 lens 520/544 e 0 to 1 dl 1496957755 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [21922.957751] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 7 previous similar messages [21953.499773] Lustre: soaked-OST0017-osc-ffff880828cb2000: Connection restored to 192.168.1.106@o2ib10 (at 192.168.1.106@o2ib10) [22003.717824] Lustre: soaked-OST0005-osc-ffff880828cb2000: Connection restored to 192.168.1.106@o2ib10 (at 192.168.1.106@o2ib10) [22032.388956] LustreError: 11-0: soaked-OST0005-osc-ffff880828cb2000: operation ldlm_enqueue to node 192.168.1.106@o2ib10 failed: rc = -107 [22032.405741] Lustre: soaked-OST0005-osc-ffff880828cb2000: Connection to soaked-OST0005 (at 192.168.1.106@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [22032.428360] Lustre: Skipped 1 previous similar message [22039.605530] Lustre: soaked-OST0017-osc-ffff880828cb2000: Connection to soaked-OST0017 (at 192.168.1.106@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [22040.031880] Lustre: soaked-OST0017-osc-ffff880828cb2000: Connection restored to 192.168.1.107@o2ib10 (at 192.168.1.107@o2ib10) [22040.047618] Lustre: Skipped 2 previous similar messages [22046.923034] LustreError: 11-0: soaked-OST000b-osc-ffff880828cb2000: operation obd_ping to node 192.168.1.106@o2ib10 failed: rc = -107 [22048.414119] Lustre: soaked-OST0005-osc-ffff880828cb2000: Connection restored to 192.168.1.107@o2ib10 (at 192.168.1.107@o2ib10) [22053.617926] LustreError: 11-0: soaked-OST0011-osc-ffff880828cb2000: operation ldlm_enqueue to node 192.168.1.106@o2ib10 failed: rc = -107 [22053.634669] Lustre: soaked-OST0011-osc-ffff880828cb2000: Connection to soaked-OST0011 (at 192.168.1.106@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [22053.657244] Lustre: Skipped 1 previous similar message [22062.714549] Lustre: soaked-OST000b-osc-ffff880828cb2000: Connection restored to 192.168.1.107@o2ib10 (at 192.168.1.107@o2ib10) [22072.342585] Lustre: soaked-OST0011-osc-ffff880828cb2000: Connection restored to 192.168.1.107@o2ib10 (at 192.168.1.107@o2ib10) [22220.605281] Lustre: 65288:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496958046/real 1496958046] req@ffff8805e6ddf500 x1569653139697184/t0(0) o101->soaked-OST000d-osc-ffff880828cb2000@192.168.1.103@o2ib10:28/4 lens 328/400 e 0 to 1 dl 1496958053 ref 2 fl Rpc:X/0/ffffffff rc 0/-1 [22220.642750] Lustre: 65288:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 3 previous similar messages [22220.655088] Lustre: soaked-OST000d-osc-ffff880828cb2000: Connection to soaked-OST000d (at 192.168.1.103@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [22485.080910] Lustre: soaked-OST0013-osc-ffff880828cb2000: Connection restored to 192.168.1.102@o2ib10 (at 192.168.1.102@o2ib10) [22546.048149] Lustre: soaked-OST000d-osc-ffff880828cb2000: Connection restored to 192.168.1.102@o2ib10 (at 192.168.1.102@o2ib10) [22546.063771] Lustre: Skipped 1 previous similar message [22553.317950] LustreError: 11-0: soaked-OST0013-osc-ffff880828cb2000: operation ldlm_enqueue to node 192.168.1.102@o2ib10 failed: rc = -19 [22553.334603] Lustre: soaked-OST0013-osc-ffff880828cb2000: Connection to soaked-OST0013 (at 192.168.1.102@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [22553.357166] Lustre: Skipped 3 previous similar messages [22578.093614] LustreError: 11-0: soaked-OST0007-osc-ffff880828cb2000: operation ldlm_enqueue to node 192.168.1.102@o2ib10 failed: rc = -107 [22901.885222] Lustre: 70643:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496958727/real 1496958727] req@ffff8802af019200 x1569653158590368/t0(0) o41->soaked-MDT0003-mdc-ffff880828cb2000@192.168.1.111@o2ib10:12/10 lens 224/368 e 0 to 1 dl 1496958734 ref 2 fl Rpc:X/0/ffffffff rc 0/-1 [22901.922832] Lustre: 70643:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 23 previous similar messages [22901.935301] Lustre: soaked-MDT0003-mdc-ffff880828cb2000: Connection to soaked-MDT0003 (at 192.168.1.111@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [22901.957946] Lustre: Skipped 3 previous similar messages [23252.095830] Lustre: soaked-MDT0003-mdc-ffff880828cb2000: Connection restored to 192.168.1.110@o2ib10 (at 192.168.1.110@o2ib10) [23252.111488] Lustre: Skipped 5 previous similar messages [23273.864708] Lustre: soaked-MDT0003-mdc-ffff880828cb2000: Connection to soaked-MDT0003 (at 192.168.1.110@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [23273.887831] LustreError: 2947:0:(import.c:1259:ptlrpc_connect_interpret()) soaked-MDT0003_UUID went back in time (transno 695793434042 was previously committed, server now claims 695793115259)! See https://bugzilla.lustre.org/show_bug.cgi?id=9646 [23362.138529] Lustre: soaked-MDT0003-mdc-ffff880828cb2000: Connection restored to 192.168.1.111@o2ib10 (at 192.168.1.111@o2ib10) [25698.393367] Lustre: 76875:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496961512/real 1496961512] req@ffff880674415100 x1569653328011344/t0(0) o41->soaked-MDT0002-mdc-ffff880828cb2000@192.168.1.110@o2ib10:12/10 lens 224/368 e 0 to 1 dl 1496961531 ref 2 fl Rpc:X/0/ffffffff rc 0/-1 [25698.431051] Lustre: 76875:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 7 previous similar messages [25698.443412] Lustre: soaked-MDT0002-mdc-ffff880828cb2000: Connection to soaked-MDT0002 (at 192.168.1.110@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [25814.467239] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496961631/real 1496961631] req@ffff88044d00b600 x1569653333297280/t0(0) o38->soaked-MDT0002-mdc-ffff880828cb2000@192.168.1.110@o2ib10:12/10 lens 520/544 e 0 to 1 dl 1496961647 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [25814.504674] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 2 previous similar messages [26004.470326] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496961806/real 1496961806] req@ffff88073032dd00 x1569653341547376/t0(0) o38->soaked-MDT0002-mdc-ffff880828cb2000@192.168.1.110@o2ib10:12/10 lens 520/544 e 0 to 1 dl 1496961837 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [26004.507751] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 2 previous similar messages [26085.455826] Lustre: soaked-MDT0002-mdc-ffff880828cb2000: Connection restored to 192.168.1.110@o2ib10 (at 192.168.1.110@o2ib10) [27817.465857] Lustre: 2971:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496963606/real 1496963606] req@ffff8807e7a25700 x1569653497016992/t0(0) o400->soaked-MDT0001-mdc-ffff880828cb2000@192.168.1.109@o2ib10:12/10 lens 224/224 e 0 to 1 dl 1496963650 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [27817.503045] Lustre: soaked-MDT0001-mdc-ffff880828cb2000: Connection to soaked-MDT0001 (at 192.168.1.109@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [27878.525864] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496963700/real 1496963700] req@ffff8807431f9800 x1569653500519600/t0(0) o38->soaked-MDT0001-mdc-ffff880828cb2000@192.168.1.109@o2ib10:12/10 lens 520/544 e 0 to 1 dl 1496963711 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [27878.562929] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 2 previous similar messages [27988.527659] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496963800/real 1496963800] req@ffff8807431f9e00 x1569653500521472/t0(0) o38->soaked-MDT0001-mdc-ffff880828cb2000@192.168.1.109@o2ib10:12/10 lens 520/544 e 0 to 1 dl 1496963821 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [27988.564702] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 1 previous similar message [28123.529805] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496963925/real 1496963925] req@ffff8807431f9500 x1569653500523776/t0(0) o38->soaked-MDT0001-mdc-ffff880828cb2000@192.168.1.109@o2ib10:12/10 lens 520/544 e 0 to 1 dl 1496963956 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [28123.566926] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 1 previous similar message [28353.907548] Lustre: soaked-MDT0002-mdc-ffff880828cb2000: Connection to soaked-MDT0002 (at 192.168.1.110@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [28353.968765] Lustre: soaked-MDT0002-mdc-ffff880828cb2000: Connection restored to 192.168.1.110@o2ib10 (at 192.168.1.110@o2ib10) [28535.932516] Lustre: 2968:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496964361/real 1496964361] req@ffff88048d4a5a00 x1569653500531664/t0(0) o400->soaked-OST0009-osc-ffff880828cb2000@192.168.1.105@o2ib10:28/4 lens 224/224 e 0 to 1 dl 1496964368 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [28535.932526] Lustre: soaked-OST0003-osc-ffff880828cb2000: Connection to soaked-OST0003 (at 192.168.1.105@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [28535.991921] Lustre: 2968:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 5 previous similar messages [28817.748969] Lustre: soaked-OST0009-osc-ffff880828cb2000: Connection restored to 192.168.1.104@o2ib10 (at 192.168.1.104@o2ib10) [28833.872635] Lustre: soaked-OST000f-osc-ffff880828cb2000: Connection restored to 192.168.1.104@o2ib10 (at 192.168.1.104@o2ib10) [28833.888076] Lustre: Skipped 1 previous similar message [28842.951779] Lustre: soaked-OST0003-osc-ffff880828cb2000: Connection restored to 192.168.1.104@o2ib10 (at 192.168.1.104@o2ib10) [28861.009586] LustreError: 11-0: soaked-OST0009-osc-ffff880828cb2000: operation obd_ping to node 192.168.1.104@o2ib10 failed: rc = -107 [28861.009611] Lustre: soaked-OST0015-osc-ffff880828cb2000: Connection to soaked-OST0015 (at 192.168.1.104@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [28861.009613] Lustre: Skipped 3 previous similar messages [28861.055253] LustreError: Skipped 2 previous similar messages [28868.936239] Lustre: soaked-OST0009-osc-ffff880828cb2000: Connection restored to 192.168.1.105@o2ib10 (at 192.168.1.105@o2ib10) [28886.010126] LustreError: 11-0: soaked-OST000f-osc-ffff880828cb2000: operation obd_ping to node 192.168.1.104@o2ib10 failed: rc = -107 [28891.411638] Lustre: soaked-OST000f-osc-ffff880828cb2000: Connection restored to 192.168.1.105@o2ib10 (at 192.168.1.105@o2ib10) [28911.114613] Lustre: soaked-OST0015-osc-ffff880828cb2000: Connection restored to 192.168.1.105@o2ib10 (at 192.168.1.105@o2ib10) [28954.993307] Lustre: soaked-MDT0002-mdc-ffff880828cb2000: Connection to soaked-MDT0002 (at 192.168.1.110@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [28955.015705] Lustre: Skipped 3 previous similar messages [28955.023577] Lustre: soaked-MDT0002-mdc-ffff880828cb2000: Connection restored to 192.168.1.110@o2ib10 (at 192.168.1.110@o2ib10) [28955.038918] Lustre: Skipped 1 previous similar message [29114.241114] LustreError: 11-0: soaked-MDT0001-mdc-ffff880828cb2000: operation mds_close to node 192.168.1.109@o2ib10 failed: rc = -107 [29405.030179] LustreError: 167-0: soaked-MDT0001-mdc-ffff880828cb2000: This client was evicted by soaked-MDT0001; in progress operations using this service will fail. [29405.050249] LustreError: 118287:0:(lmv_obd.c:1381:lmv_statfs()) can't stat MDS #1 (soaked-MDT0001-mdc-ffff880828cb2000), error -5 [29405.050811] Lustre: soaked-MDT0001-mdc-ffff880828cb2000: Connection restored to 192.168.1.109@o2ib10 (at 192.168.1.109@o2ib10) [29405.081542] LustreError: 118287:0:(llite_lib.c:1691:ll_statfs_internal()) md_statfs fails: rc = -5 [30334.368621] Lustre: 119901:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496966159/real 1496966159] req@ffff8801f5c63600 x1569653529622208/t0(0) o36->soaked-MDT0000-mdc-ffff880828cb2000@192.168.1.108@o2ib10:12/10 lens 616/1696 e 0 to 1 dl 1496966166 ref 2 fl Rpc:X/0/ffffffff rc 0/-1 [30334.368632] Lustre: soaked-MDT0000-mdc-ffff880828cb2000: Connection to soaked-MDT0000 (at 192.168.1.108@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [30334.428131] Lustre: 119901:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 22 previous similar messages [30337.045749] LustreError: 166-1: MGC192.168.1.108@o2ib10: Connection to MGS (at 192.168.1.108@o2ib10) was lost; in progress operations using this service will fail [30423.065052] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496966244/real 1496966244] req@ffff8805ce343600 x1569653529623280/t0(0) o250->MGC192.168.1.108@o2ib10@192.168.1.109@o2ib10:26/25 lens 520/544 e 0 to 1 dl 1496966255 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [30423.100981] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 6 previous similar messages [30563.067304] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496966369/real 1496966369] req@ffff880722558600 x1569653529625600/t0(0) o250->MGC192.168.1.108@o2ib10@192.168.1.108@o2ib10:26/25 lens 520/544 e 0 to 1 dl 1496966395 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [30563.103200] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 6 previous similar messages [30823.072485] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496966619/real 1496966619] req@ffff8807cc505400 x1569653529630128/t0(0) o250->MGC192.168.1.108@o2ib10@192.168.1.109@o2ib10:26/25 lens 520/544 e 0 to 1 dl 1496966655 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [30823.108486] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 8 previous similar messages [30837.072469] Lustre: Evicted from MGS (at 192.168.1.108@o2ib10) after server handle changed from 0x5ec0ecf4e9f3c4c5 to 0x1e6b90f0df515930 [30837.088892] LustreError: 167-0: soaked-MDT0000-mdc-ffff880828cb2000: This client was evicted by soaked-MDT0000; in progress operations using this service will fail. [30837.088921] Lustre: MGC192.168.1.108@o2ib10: Connection restored to 192.168.1.108@o2ib10 (at 192.168.1.108@o2ib10) [30837.137616] LustreError: 120422:0:(lmv_obd.c:1381:lmv_statfs()) can't stat MDS #0 (soaked-MDT0000-mdc-ffff880828cb2000), error -5 [30837.137624] LustreError: 119455:0:(file.c:176:ll_close_inode_openhandle()) soaked-clilmv-ffff880828cb2000: inode [0x20005b956:0x1e32f:0x0] mdc close failed: rc = -5 [30837.139023] LustreError: 120710:0:(file.c:3491:ll_inode_revalidate_fini()) soaked: revalidate FID [0x200000404:0x2:0x0] error: rc = -108 [30837.189713] LustreError: 120422:0:(llite_lib.c:1691:ll_statfs_internal()) md_statfs fails: rc = -5 [31244.078357] LustreError: 166-1: MGC192.168.1.108@o2ib10: Connection to MGS (at 192.168.1.108@o2ib10) was lost; in progress operations using this service will fail [31244.078360] Lustre: soaked-MDT0001-mdc-ffff880828cb2000: Connection to soaked-MDT0001 (at 192.168.1.109@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [31273.033787] Lustre: soaked-OST000b-osc-ffff880828cb2000: Connection to soaked-OST000b (at 192.168.1.107@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [31299.043675] Lustre: MGC192.168.1.108@o2ib10: Connection restored to 192.168.1.108@o2ib10 (at 192.168.1.108@o2ib10) [31299.058930] Lustre: Skipped 2 previous similar messages [31336.027785] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496967156/real 1496967156] req@ffff8805ce770900 x1569653563031440/t0(0) o8->soaked-OST0011-osc-ffff880828cb2000@192.168.1.107@o2ib10:28/4 lens 520/544 e 0 to 1 dl 1496967168 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [31336.064669] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 44 previous similar messages [31341.304931] Lustre: soaked-OST0017-osc-ffff880828cb2000: Connection to soaked-OST0017 (at 192.168.1.107@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [31341.332351] Lustre: Skipped 2 previous similar messages [31510.405955] Lustre: soaked-OST0017-osc-ffff880828cb2000: Connection restored to 192.168.1.106@o2ib10 (at 192.168.1.106@o2ib10) [31562.395398] LustreError: 11-0: soaked-OST0017-osc-ffff880828cb2000: operation ldlm_enqueue to node 192.168.1.106@o2ib10 failed: rc = -19 [31562.395670] Lustre: soaked-OST0017-osc-ffff880828cb2000: Connection to soaked-OST0017 (at 192.168.1.106@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [31562.435659] LustreError: Skipped 20 previous similar messages [31611.340955] Lustre: soaked-OST0017-osc-ffff880828cb2000: Connection restored to 192.168.1.107@o2ib10 (at 192.168.1.107@o2ib10) [31611.361270] Lustre: Skipped 3 previous similar messages [31611.464192] LustreError: 11-0: soaked-OST0005-osc-ffff880828cb2000: operation ldlm_enqueue to node 192.168.1.106@o2ib10 failed: rc = -107 [31611.464311] Lustre: soaked-OST0005-osc-ffff880828cb2000: Connection to soaked-OST0005 (at 192.168.1.106@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [31611.513300] LustreError: Skipped 2 previous similar messages [31622.698737] LustreError: 11-0: soaked-OST000b-osc-ffff880828cb2000: operation ldlm_enqueue to node 192.168.1.106@o2ib10 failed: rc = -107 [31622.720523] LustreError: Skipped 10 previous similar messages [31646.119187] LustreError: 11-0: soaked-OST0011-osc-ffff880828cb2000: operation ost_write to node 192.168.1.106@o2ib10 failed: rc = -107 [31646.140190] Lustre: soaked-OST0011-osc-ffff880828cb2000: Connection to soaked-OST0011 (at 192.168.1.106@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [31646.166859] Lustre: Skipped 1 previous similar message [33284.327501] LustreError: 11-0: soaked-OST0003-osc-ffff880828cb2000: operation ldlm_enqueue to node 192.168.1.105@o2ib10 failed: rc = -14 [33391.652201] Lustre: 2963:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496969217/real 1496969217] req@ffff880118705d00 x1569653654762864/t0(0) o4->soaked-OST0005-osc-ffff880828cb2000@192.168.1.107@o2ib10:6/4 lens 608/448 e 0 to 1 dl 1496969224 ref 2 fl Rpc:X/0/ffffffff rc 0/-1 [33391.696167] Lustre: 2963:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 40 previous similar messages [33391.710823] Lustre: soaked-OST0005-osc-ffff880828cb2000: Connection to soaked-OST0005 (at 192.168.1.107@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [33395.737225] Lustre: soaked-OST0014-osc-ffff880828cb2000: Connection to soaked-OST0014 (at 192.168.1.104@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [33395.764390] Lustre: Skipped 5 previous similar messages [33402.652321] LustreError: 166-1: MGC192.168.1.108@o2ib10: Connection to MGS (at 192.168.1.108@o2ib10) was lost; in progress operations using this service will fail [33408.737428] Lustre: soaked-MDT0002-mdc-ffff880828cb2000: Connection to soaked-MDT0002 (at 192.168.1.110@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [33408.764557] Lustre: Skipped 1 previous similar message [33410.305321] Lustre: soaked-MDT0002-mdc-ffff880828cb2000: Connection restored to 192.168.1.110@o2ib10 (at 192.168.1.110@o2ib10) [33410.325452] Lustre: Skipped 3 previous similar messages [33427.659752] Lustre: soaked-OST0009-osc-ffff880828cb2000: Connection to soaked-OST0009 (at 192.168.1.105@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [33452.688125] Lustre: soaked-OST000b-osc-ffff880828cb2000: Connection restored to 192.168.1.107@o2ib10 (at 192.168.1.107@o2ib10) [33488.694659] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496969310/real 1496969310] req@ffff880608838f00 x1569653657206048/t0(0) o8->soaked-OST0009-osc-ffff880828cb2000@192.168.1.105@o2ib10:28/4 lens 520/544 e 0 to 1 dl 1496969321 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [33488.732509] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 58 previous similar messages [33653.690334] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496969460/real 1496969460] req@ffff880751570300 x1569653673447168/t0(0) o8->soaked-OST0009-osc-ffff880828cb2000@192.168.1.105@o2ib10:28/4 lens 520/544 e 0 to 1 dl 1496969486 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [33653.727955] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 11 previous similar messages [33683.751270] Lustre: soaked-OST0003-osc-ffff880828cb2000: Connection restored to 192.168.1.104@o2ib10 (at 192.168.1.104@o2ib10) [33683.767037] Lustre: Skipped 8 previous similar messages [33690.562013] Lustre: soaked-OST0017-osc-ffff880828cb2000: Connection to soaked-OST0017 (at 192.168.1.107@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [33690.589001] Lustre: Skipped 3 previous similar messages [33759.586316] Lustre: soaked-OST0003-osc-ffff880828cb2000: Connection to soaked-OST0003 (at 192.168.1.104@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [33759.612317] Lustre: Skipped 16 previous similar messages [33761.270432] Lustre: soaked-OST0015-osc-ffff880828cb2000: Connection restored to 192.168.1.104@o2ib10 (at 192.168.1.104@o2ib10) [33761.289027] Lustre: Skipped 17 previous similar messages [33797.017343] LustreError: 11-0: soaked-OST0015-osc-ffff880828cb2000: operation ldlm_enqueue to node 192.168.1.104@o2ib10 failed: rc = -19 [33797.035554] LustreError: Skipped 1 previous similar message [33810.397412] LustreError: 11-0: soaked-OST0003-osc-ffff880828cb2000: operation ldlm_enqueue to node 192.168.1.104@o2ib10 failed: rc = -19 [33846.701399] LustreError: 11-0: soaked-OST000f-osc-ffff880828cb2000: operation ldlm_enqueue to node 192.168.1.104@o2ib10 failed: rc = -19 [33846.718522] LustreError: Skipped 1 previous similar message [35333.081778] Lustre: 200076:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496971158/real 1496971158] req@ffff88060e9ae300 x1569653751581232/t0(0) o35->soaked-MDT0003-mdc-ffff880828cb2000@192.168.1.111@o2ib10:23/10 lens 512/1696 e 0 to 1 dl 1496971165 ref 2 fl Rpc:X/0/ffffffff rc 0/-1 [35333.118798] Lustre: 200076:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 1885 previous similar messages [35333.131313] Lustre: soaked-MDT0003-mdc-ffff880828cb2000: Connection to soaked-MDT0003 (at 192.168.1.111@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [35333.153464] Lustre: Skipped 3 previous similar messages [35394.160767] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496971215/real 1496971215] req@ffff8805c274ad00 x1569653751582416/t0(0) o38->soaked-MDT0003-mdc-ffff880828cb2000@192.168.1.111@o2ib10:12/10 lens 520/544 e 0 to 1 dl 1496971226 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [35394.197685] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 1 previous similar message [35504.162598] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496971315/real 1496971315] req@ffff8805c274ce00 x1569653751584288/t0(0) o38->soaked-MDT0003-mdc-ffff880828cb2000@192.168.1.111@o2ib10:12/10 lens 520/544 e 0 to 1 dl 1496971336 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [35504.206362] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 1 previous similar message [35719.167118] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496971515/real 1496971515] req@ffff880758f0e300 x1569653751587968/t0(0) o38->soaked-MDT0003-mdc-ffff880828cb2000@192.168.1.111@o2ib10:12/10 lens 520/544 e 0 to 1 dl 1496971551 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [35719.210887] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 2 previous similar messages [35959.562956] Lustre: soaked-MDT0001-mdc-ffff880828cb2000: Connection to soaked-MDT0001 (at 192.168.1.109@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [35959.623700] Lustre: soaked-MDT0001-mdc-ffff880828cb2000: Connection restored to 192.168.1.109@o2ib10 (at 192.168.1.109@o2ib10) [35959.643485] Lustre: Skipped 6 previous similar messages [36323.335793] LustreError: 2947:0:(client.c:2982:ptlrpc_replay_interpret()) @@@ status 301, old was 0 req@ffff8807865edd00 x1569653751579536/t704380628820(704380628820) o101->soaked-MDT0003-mdc-ffff880828cb2000@192.168.1.111@o2ib10:12/10 lens 960/544 e 0 to 0 dl 1496972167 ref 2 fl Interpret:R/4/0 rc 301/301 [36323.376827] LustreError: 2947:0:(client.c:2982:ptlrpc_replay_interpret()) Skipped 311 previous similar messages [36323.471769] Lustre: soaked-MDT0003-mdc-ffff880828cb2000: Connection restored to 192.168.1.111@o2ib10 (at 192.168.1.111@o2ib10) [39307.102065] Lustre: 2978:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496975067/real 1496975067] req@ffff8807eb1ac800 x1569653803378096/t0(0) o400->soaked-MDT0002-mdc-ffff880828cb2000@192.168.1.110@o2ib10:12/10 lens 224/224 e 0 to 1 dl 1496975111 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [39307.146599] Lustre: 2978:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 3 previous similar messages [39307.161210] Lustre: soaked-MDT0002-mdc-ffff880828cb2000: Connection to soaked-MDT0002 (at 192.168.1.110@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [39368.188050] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496975189/real 1496975189] req@ffff8804b76d8000 x1569653804728160/t0(0) o38->soaked-MDT0002-mdc-ffff880828cb2000@192.168.1.110@o2ib10:12/10 lens 520/544 e 0 to 1 dl 1496975200 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [39368.232548] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 3 previous similar messages [39478.189800] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496975289/real 1496975289] req@ffff8804e109bc00 x1569653805813328/t0(0) o38->soaked-MDT0002-mdc-ffff880828cb2000@192.168.1.110@o2ib10:12/10 lens 520/544 e 0 to 1 dl 1496975310 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [39478.233611] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 1 previous similar message [39618.075264] Lustre: soaked-MDT0002-mdc-ffff880828cb2000: Connection restored to 192.168.1.111@o2ib10 (at 192.168.1.111@o2ib10) [39635.575144] Lustre: soaked-MDT0002-mdc-ffff880828cb2000: Connection to soaked-MDT0002 (at 192.168.1.111@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [39696.337281] Lustre: soaked-MDT0002-mdc-ffff880828cb2000: Connection restored to 192.168.1.110@o2ib10 (at 192.168.1.110@o2ib10) [41015.215340] Lustre: 2972:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496976840/real 1496976840] req@ffff88040ff5d400 x1569653855414080/t0(0) o400->MGC192.168.1.108@o2ib10@192.168.1.108@o2ib10:26/25 lens 224/224 e 0 to 1 dl 1496976847 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [41015.258727] Lustre: 2972:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 1 previous similar message [41015.273238] LustreError: 166-1: MGC192.168.1.108@o2ib10: Connection to MGS (at 192.168.1.108@o2ib10) was lost; in progress operations using this service will fail [41022.296461] Lustre: soaked-MDT0000-mdc-ffff880828cb2000: Connection to soaked-MDT0000 (at 192.168.1.108@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [41053.323977] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496976879/real 1496976879] req@ffff88040ff5b000 x1569653855414560/t0(0) o250->MGC192.168.1.108@o2ib10@192.168.1.109@o2ib10:26/25 lens 520/544 e 0 to 1 dl 1496976885 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [41053.367497] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 3 previous similar messages [41108.325821] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496976929/real 1496976929] req@ffff88007af9a100 x1569653855415488/t0(0) o250->MGC192.168.1.108@o2ib10@192.168.1.109@o2ib10:26/25 lens 520/544 e 0 to 1 dl 1496976940 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [41108.369428] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 2 previous similar messages [41193.329208] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496977004/real 1496977004] req@ffff88007af9d100 x1569653855416896/t0(0) o250->MGC192.168.1.108@o2ib10@192.168.1.108@o2ib10:26/25 lens 520/544 e 0 to 1 dl 1496977025 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [41193.372662] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 3 previous similar messages [41322.330921] Lustre: Evicted from MGS (at 192.168.1.108@o2ib10) after server handle changed from 0x1e6b90f0df515930 to 0x4db373be2be3bf85 [41322.352473] Lustre: MGC192.168.1.108@o2ib10: Connection restored to 192.168.1.108@o2ib10 (at 192.168.1.108@o2ib10) [41330.263483] LustreError: 2947:0:(client.c:2982:ptlrpc_replay_interpret()) @@@ status 301, old was 0 req@ffff8805c2748900 x1569653739220400/t773097350597(773097350597) o101->soaked-MDT0000-mdc-ffff880828cb2000@192.168.1.108@o2ib10:12/10 lens 808/544 e 0 to 0 dl 1496977169 ref 2 fl Interpret:RP/4/0 rc 301/301 [41330.305451] LustreError: 2947:0:(client.c:2982:ptlrpc_replay_interpret()) Skipped 13 previous similar messages [41373.146318] Lustre: soaked-MDT0000-mdc-ffff880828cb2000: Connection restored to 192.168.1.108@o2ib10 (at 192.168.1.108@o2ib10) [44229.392238] Lustre: 2964:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496980054/real 1496980054] req@ffff8805c9c99b00 x1569654716717136/t0(0) o400->MGC192.168.1.108@o2ib10@192.168.1.108@o2ib10:26/25 lens 224/224 e 0 to 1 dl 1496980061 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [44229.435830] Lustre: 2964:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 6 previous similar messages [44229.450464] LustreError: 166-1: MGC192.168.1.108@o2ib10: Connection to MGS (at 192.168.1.108@o2ib10) was lost; in progress operations using this service will fail [44260.473729] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496980086/real 1496980086] req@ffff8805c9c99200 x1569654716717632/t0(0) o250->MGC192.168.1.108@o2ib10@192.168.1.109@o2ib10:26/25 lens 520/544 e 0 to 1 dl 1496980092 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [44260.517343] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 1 previous similar message [44266.473846] Lustre: soaked-MDT0000-mdc-ffff880828cb2000: Connection to soaked-MDT0000 (at 192.168.1.108@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [44298.501348] Lustre: 2977:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496980086/real 1496980086] req@ffff8805c9c9d100 x1569654716717648/t0(0) o400->soaked-MDT0000-mdc-ffff880828cb2000@192.168.1.109@o2ib10:12/10 lens 224/224 e 0 to 1 dl 1496980130 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [44298.546154] Lustre: 2977:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 3 previous similar messages [44382.502737] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496980198/real 1496980198] req@ffff8805b5d8c800 x1569654716719504/t0(0) o250->MGC192.168.1.108@o2ib10@192.168.1.109@o2ib10:26/25 lens 520/544 e 0 to 1 dl 1496980214 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [44382.546278] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 4 previous similar messages [44572.505893] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496980373/real 1496980373] req@ffff8805b5d89b00 x1569654716722736/t0(0) o38->soaked-MDT0000-mdc-ffff880828cb2000@192.168.1.108@o2ib10:12/10 lens 520/544 e 0 to 1 dl 1496980404 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [44572.550398] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 7 previous similar messages [44741.509515] Lustre: Evicted from MGS (at 192.168.1.108@o2ib10) after server handle changed from 0x4db373be2be3bf85 to 0x3a6ac8d66c8c8195 [44741.531115] Lustre: MGC192.168.1.108@o2ib10: Connection restored to 192.168.1.108@o2ib10 (at 192.168.1.108@o2ib10) [44791.120411] Lustre: soaked-MDT0000-mdc-ffff880828cb2000: Connection restored to 192.168.1.108@o2ib10 (at 192.168.1.108@o2ib10) [45148.515173] Lustre: 2975:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496980973/real 1496980973] req@ffff8804d6b19b00 x1569654719817056/t0(0) o400->soaked-OST0012-osc-ffff880828cb2000@192.168.1.102@o2ib10:28/4 lens 224/224 e 0 to 1 dl 1496980980 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [45148.515184] Lustre: soaked-OST0000-osc-ffff880828cb2000: Connection to soaked-OST0000 (at 192.168.1.102@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [45148.574507] Lustre: 2975:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 8 previous similar messages [45406.075948] Lustre: soaked-OST0000-osc-ffff880828cb2000: Connection restored to 192.168.1.103@o2ib10 (at 192.168.1.103@o2ib10) [45428.296828] Lustre: soaked-OST0006-osc-ffff880828cb2000: Connection restored to 192.168.1.103@o2ib10 (at 192.168.1.103@o2ib10) [45428.317286] Lustre: Skipped 1 previous similar message [45433.577554] Lustre: soaked-OST000c-osc-ffff880828cb2000: Connection restored to 192.168.1.103@o2ib10 (at 192.168.1.103@o2ib10) [45444.175636] LustreError: 11-0: soaked-OST0012-osc-ffff880828cb2000: operation ost_read to node 192.168.1.103@o2ib10 failed: rc = -19 [45444.194720] Lustre: soaked-OST0012-osc-ffff880828cb2000: Connection to soaked-OST0012 (at 192.168.1.103@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [45444.218425] Lustre: Skipped 3 previous similar messages [45486.053977] Lustre: soaked-OST0012-osc-ffff880828cb2000: Connection restored to 192.168.1.102@o2ib10 (at 192.168.1.102@o2ib10) [45486.339149] LustreError: 11-0: soaked-OST0000-osc-ffff880828cb2000: operation ost_read to node 192.168.1.103@o2ib10 failed: rc = -107 [45486.359081] Lustre: soaked-OST0000-osc-ffff880828cb2000: Connection to soaked-OST0000 (at 192.168.1.103@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [45497.200525] Lustre: soaked-OST0000-osc-ffff880828cb2000: Connection restored to 192.168.1.102@o2ib10 (at 192.168.1.102@o2ib10) [45499.592308] LustreError: 11-0: soaked-OST0006-osc-ffff880828cb2000: operation obd_ping to node 192.168.1.103@o2ib10 failed: rc = -107 [45499.613514] Lustre: soaked-OST0006-osc-ffff880828cb2000: Connection to soaked-OST0006 (at 192.168.1.103@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [45516.469678] Lustre: soaked-OST0006-osc-ffff880828cb2000: Connection restored to 192.168.1.102@o2ib10 (at 192.168.1.102@o2ib10) [45517.475657] LustreError: 11-0: soaked-OST000c-osc-ffff880828cb2000: operation ldlm_enqueue to node 192.168.1.103@o2ib10 failed: rc = -107 [45517.488813] Lustre: soaked-OST000c-osc-ffff880828cb2000: Connection to soaked-OST000c (at 192.168.1.103@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [45517.519832] LustreError: Skipped 1 previous similar message [45538.730336] Lustre: soaked-OST000c-osc-ffff880828cb2000: Connection restored to 192.168.1.102@o2ib10 (at 192.168.1.102@o2ib10) [45718.086457] Lustre: soaked-MDT0003-mdc-ffff880828cb2000: Connection to soaked-MDT0003 (at 192.168.1.111@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [45779.114474] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496981600/real 1496981600] req@ffff880324a7aa00 x1569654721810768/t0(0) o38->soaked-MDT0003-mdc-ffff880828cb2000@192.168.1.111@o2ib10:12/10 lens 520/544 e 0 to 1 dl 1496981611 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [45779.159358] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 23 previous similar messages [46791.130896] Lustre: 2964:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496982616/real 1496982616] req@ffff8805b8a76f00 x1569654721830176/t0(0) o400->soaked-MDT0001-mdc-ffff880828cb2000@192.168.1.109@o2ib10:12/10 lens 224/224 e 0 to 1 dl 1496982623 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [46791.175832] Lustre: 2964:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 6 previous similar messages [46791.190537] Lustre: soaked-MDT0001-mdc-ffff880828cb2000: Connection to soaked-MDT0001 (at 192.168.1.109@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [47507.834590] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496983033/real 1496983033] req@ffff880310399b00 x1569654721838192/t0(0) o400->soaked-MDT0001-mdc-ffff880828cb2000@192.168.1.109@o2ib10:12/10 lens 224/224 e 12 to 1 dl 1496983340 ref 1 fl Rpc:X/c0/ffffffff rc 0/-1 [47507.879928] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 8 previous similar messages [48119.021888] Lustre: soaked-MDT0003-mdc-ffff880828cb2000: Connection restored to 192.168.1.111@o2ib10 (at 192.168.1.111@o2ib10) [49246.560196] Lustre: soaked-MDT0001-mdc-ffff880828cb2000: Connection restored to 192.168.1.109@o2ib10 (at 192.168.1.109@o2ib10) [49388.176050] Lustre: 2968:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496985144/real 1496985144] req@ffff8801b84add00 x1569654722631008/t0(0) o400->soaked-MDT0001-mdc-ffff880828cb2000@192.168.1.109@o2ib10:12/10 lens 224/224 e 0 to 1 dl 1496985220 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [49388.221151] Lustre: 2968:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 9 previous similar messages [49388.235929] Lustre: soaked-MDT0001-mdc-ffff880828cb2000: Connection to soaked-MDT0001 (at 192.168.1.109@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [49463.264329] Lustre: 2976:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496985219/real 1496985219] req@ffff8801b84ac500 x1569654723329904/t0(0) o400->soaked-MDT0001-mdc-ffff880828cb2000@192.168.1.109@o2ib10:12/10 lens 224/224 e 0 to 1 dl 1496985295 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [49463.309503] Lustre: 2976:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 4 previous similar messages [49614.266811] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496985420/real 1496985420] req@ffff8801b84ae600 x1569654723333408/t0(0) o38->soaked-MDT0001-mdc-ffff880828cb2000@192.168.1.109@o2ib10:12/10 lens 520/544 e 0 to 1 dl 1496985446 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [49614.311652] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 2 previous similar messages [49614.328043] Lustre: 2947:0:(client.c:2939:ptlrpc_replay_interpret()) @@@ Version mismatch during replay req@ffff880534fa9200 x1569654722371376/t785979320822(785979320822) o36->soaked-MDT0001-mdc-ffff880828cb2000@192.168.1.108@o2ib10:12/10 lens 616/424 e 0 to 0 dl 1496985522 ref 2 fl Interpret:R/4/0 rc -75/-75 [49614.574858] LustreError: 2947:0:(client.c:2982:ptlrpc_replay_interpret()) @@@ status 301, old was 0 req@ffff880492fdc800 x1569654722390800/t785979330330(785979330330) o101->soaked-MDT0001-mdc-ffff880828cb2000@192.168.1.108@o2ib10:12/10 lens 1728/544 e 0 to 0 dl 1496985522 ref 2 fl Interpret:R/4/0 rc 301/301 [49614.952288] Lustre: 2947:0:(client.c:2939:ptlrpc_replay_interpret()) @@@ Version mismatch during replay req@ffff8805e80b8900 x1569654722457936/t785979372073(785979372073) o36->soaked-MDT0001-mdc-ffff880828cb2000@192.168.1.108@o2ib10:12/10 lens 616/424 e 0 to 0 dl 1496985704 ref 2 fl Interpret:R/4/0 rc -75/-75 [49614.994438] Lustre: 2947:0:(client.c:2939:ptlrpc_replay_interpret()) Skipped 431 previous similar messages [49691.239099] Lustre: 2947:0:(import.c:1355:completed_replay_interpret()) soaked-MDT0001-mdc-ffff880828cb2000: version recovery fails, reconnecting [49764.380685] LustreError: 167-0: soaked-MDT0001-mdc-ffff880828cb2000: This client was evicted by soaked-MDT0001; in progress operations using this service will fail. [49764.409681] LustreError: 239527:0:(lmv_obd.c:1381:lmv_statfs()) can't stat MDS #1 (soaked-MDT0001-mdc-ffff880828cb2000), error -5 [49764.409710] LustreError: 239590:0:(llite_lib.c:2257:ll_prep_inode()) new_inode -fatal: rc -5 [49764.410966] Lustre: soaked-MDT0001-mdc-ffff880828cb2000: Connection restored to 192.168.1.109@o2ib10 (at 192.168.1.109@o2ib10) [49764.466000] LustreError: 239527:0:(llite_lib.c:1691:ll_statfs_internal()) md_statfs fails: rc = -5 [50545.951338] kworker/u480:4: page allocation failure: order:4, mode:0x8010 [50545.960903] CPU: 12 PID: 240535 Comm: kworker/u480:4 Tainted: G OE ------------ 3.10.0-514.10.2.el7.x86_64 #1 [50545.975179] Hardware name: Intel Corporation S2600GZ ........../S2600GZ, BIOS SE5C600.86B.01.08.0003.022620131521 02/26/2013 [50545.989892] Workqueue: ipoib_wq ipoib_cm_tx_start [ib_ipoib] [50545.998390] 0000000000008010 0000000096a1e449 ffff8805a8c93810 ffffffff816864ef [50546.008865] ffff8805a8c938a0 ffffffff81186ba0 0000000000000000 ffff88043ffdb000 [50546.019302] 0000000000000004 0000000000008010 ffff8805a8c938a0 0000000096a1e449 [50546.029718] Call Trace: [50546.034989] [] dump_stack+0x19/0x1b [50546.042330] [] warn_alloc_failed+0x110/0x180 [50546.050518] [] __alloc_pages_slowpath+0x6b7/0x725 [50546.059182] [] __alloc_pages_nodemask+0x405/0x420 [50546.067819] [] dma_generic_alloc_coherent+0x8f/0x140 [50546.076754] [] x86_swiotlb_alloc_coherent+0x21/0x50 [50546.085560] [] mlx4_buf_direct_alloc.isra.6+0xd3/0x1a0 [mlx4_core] [50546.095775] [] mlx4_buf_alloc+0x1cb/0x240 [mlx4_core] [50546.104708] [] create_qp_common.isra.31+0x5e2/0x1000 [mlx4_ib] [50546.114498] [] mlx4_ib_create_qp+0x14e/0x470 [mlx4_ib] [50546.123491] [] ? ipoib_cm_tx_init+0x5c/0x3b0 [ib_ipoib] [50546.132572] [] ib_create_qp+0x3f/0x250 [ib_core] [50546.140929] [] ipoib_cm_tx_init+0xf7/0x3b0 [ib_ipoib] [50546.149784] [] ? ib_free_send_mad+0x26/0x50 [ib_core] [50546.158586] [] ipoib_cm_tx_start+0x260/0x3d0 [ib_ipoib] [50546.167563] [] process_one_work+0x17b/0x470 [50546.175385] [] worker_thread+0x126/0x410 [50546.182889] [] ? rescuer_thread+0x460/0x460 [50546.190643] [] kthread+0xcf/0xe0 [50546.197309] [] ? kthread_create_on_node+0x140/0x140 [50546.205816] [] ret_from_fork+0x58/0x90 [50546.213044] [] ? kthread_create_on_node+0x140/0x140 [50546.221507] Mem-Info: [50546.225212] active_anon:33371 inactive_anon:19720 isolated_anon:0 active_file:19749 inactive_file:2935536 isolated_file:20 unevictable:0 dirty:1192 writeback:0 unstable:21 slab_reclaimable:27211 slab_unreclaimable:4790793 mapped:11182 shmem:6385 pagetables:2109 bounce:0 free:95474 free_pcp:1767 free_cma:0 [50546.270124] Node 0 DMA free:15848kB min:40kB low:48kB high:60kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15932kB managed:15848kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes [50546.325464] lowmem_reserve[]: 0 2580 15620 15620 [50546.332992] Node 0 DMA32 free:68416kB min:7324kB low:9152kB high:10984kB active_anon:3228kB inactive_anon:3672kB active_file:5324kB inactive_file:923428kB unevictable:0kB isolated(anon):0kB isolated(file):80kB present:3051628kB managed:2644072kB mlocked:0kB dirty:456kB writeback:104kB mapped:440kB shmem:52kB slab_reclaimable:23604kB slab_unreclaimable:1536516kB kernel_stack:848kB pagetables:736kB unstable:12kB bounce:0kB free_pcp:1736kB local_pcp:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no [50546.395716] lowmem_reserve[]: 0 0 13040 13040 [50546.403050] Node 0 Normal free:83732kB min:37012kB low:46264kB high:55516kB active_anon:94460kB inactive_anon:37228kB active_file:27728kB inactive_file:5509184kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:13631488kB managed:13353036kB mlocked:0kB dirty:2040kB writeback:0kB mapped:2044kB shmem:472kB slab_reclaimable:37216kB slab_unreclaimable:7086876kB kernel_stack:7936kB pagetables:4132kB unstable:68kB bounce:0kB free_pcp:2852kB local_pcp:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no [50546.466099] lowmem_reserve[]: 0 0 0 0 [50546.472734] Node 1 Normal free:241096kB min:45728kB low:57160kB high:68592kB active_anon:36184kB inactive_anon:37980kB active_file:45944kB inactive_file:5276292kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:16777216kB managed:16498508kB mlocked:0kB dirty:2272kB writeback:88kB mapped:42244kB shmem:25016kB slab_reclaimable:48024kB slab_unreclaimable:10539844kB kernel_stack:5616kB pagetables:3568kB unstable:4kB bounce:0kB free_pcp:6272kB local_pcp:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no [50546.539100] lowmem_reserve[]: 0 0 0 0 [50546.546113] Node 0 DMA: 0*4kB 1*8kB (U) 0*16kB 1*32kB (U) 1*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15848kB [50546.566239] Node 0 DMA32: 2755*4kB (UEM) 3851*8kB (UEM) 1580*16kB (UEM) 201*32kB (UEM) 20*64kB (UEM) 10*128kB (M) 3*256kB (M) 0*512kB 0*1024kB 0*2048kB 0*4096kB = 76868kB [50546.587924] Node 0 Normal: 11840*4kB (UEM) 1654*8kB (UEM) 639*16kB (UM) 518*32kB (UEM) 81*64kB (UEM) 17*128kB (UEM) 12*256kB (M) 0*512kB 0*1024kB 0*2048kB 0*4096kB = 97824kB [50546.609498] Node 1 Normal: 9602*4kB (UEM) 9480*8kB (UEM) 4810*16kB (UEM) 1778*32kB (UM) 139*64kB (UM) 10*128kB (U) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 258280kB [50546.630211] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB [50546.641743] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB [50546.652835] Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB [50546.664135] Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB [50546.675093] 2858116 total pagecache pages [50546.681013] 4 pages in swap cache [50546.686223] Swap cache stats: add 8, delete 4, find 0/0 [50546.693456] Free swap = 16319452kB [50546.698736] Total swap = 16319484kB [50546.703970] 8369066 pages RAM [50546.708595] 0 pages HighMem/MovableOnly [50546.714184] 241200 pages reserved [51100.765186] Lustre: 56091:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496986925/real 1496986925] req@ffff8802062e8900 x1569654988708944/t0(0) o41->soaked-MDT0001-mdc-ffff880828cb2000@192.168.1.109@o2ib10:12/10 lens 224/368 e 0 to 1 dl 1496986932 ref 2 fl Rpc:X/0/ffffffff rc 0/-1 [51100.804628] Lustre: 56091:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 1 previous similar message [51100.818038] Lustre: soaked-MDT0001-mdc-ffff880828cb2000: Connection to soaked-MDT0001 (at 192.168.1.109@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [51161.842098] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496986983/real 1496986983] req@ffff8804dca6ad00 x1569654996292720/t0(0) o38->soaked-MDT0001-mdc-ffff880828cb2000@192.168.1.109@o2ib10:12/10 lens 520/544 e 0 to 1 dl 1496986994 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [51161.878905] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 1 previous similar message [51271.843808] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496987083/real 1496987083] req@ffff880333554200 x1569655005643168/t0(0) o38->soaked-MDT0001-mdc-ffff880828cb2000@192.168.1.109@o2ib10:12/10 lens 520/544 e 0 to 1 dl 1496987104 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [51271.880260] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 4 previous similar messages [51432.393545] Lustre: soaked-MDT0001-mdc-ffff880828cb2000: Connection restored to 192.168.1.109@o2ib10 (at 192.168.1.109@o2ib10) [51934.875366] Lustre: 67999:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496987760/real 1496987760] req@ffff8803e896ce00 x1569655029556080/t0(0) o101->soaked-OST0007-osc-ffff880828cb2000@192.168.1.103@o2ib10:28/4 lens 328/400 e 0 to 1 dl 1496987767 ref 2 fl Rpc:X/0/ffffffff rc 0/-1 [51934.912060] Lustre: 67999:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 1 previous similar message [51934.924000] Lustre: soaked-OST0007-osc-ffff880828cb2000: Connection to soaked-OST0007 (at 192.168.1.103@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [51974.497012] Lustre: soaked-OST000d-osc-ffff880828cb2000: Connection to soaked-OST000d (at 192.168.1.103@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [52037.966056] Lustre: soaked-OST0001-osc-ffff880828cb2000: Connection to soaked-OST0001 (at 192.168.1.103@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [52042.748148] Lustre: soaked-OST0013-osc-ffff880828cb2000: Connection to soaked-OST0013 (at 192.168.1.103@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [52216.194263] Lustre: soaked-OST0013-osc-ffff880828cb2000: Connection restored to 192.168.1.102@o2ib10 (at 192.168.1.102@o2ib10) [52216.882428] Lustre: soaked-OST0001-osc-ffff880828cb2000: Connection restored to 192.168.1.102@o2ib10 (at 192.168.1.102@o2ib10) [52222.398729] Lustre: soaked-OST000d-osc-ffff880828cb2000: Connection restored to 192.168.1.102@o2ib10 (at 192.168.1.102@o2ib10) [52242.104145] Lustre: soaked-OST0007-osc-ffff880828cb2000: Connection restored to 192.168.1.102@o2ib10 (at 192.168.1.102@o2ib10) [52257.456522] LustreError: 11-0: soaked-OST0013-osc-ffff880828cb2000: operation ost_read to node 192.168.1.102@o2ib10 failed: rc = -19 [52257.474143] Lustre: soaked-OST0013-osc-ffff880828cb2000: Connection to soaked-OST0013 (at 192.168.1.102@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [52299.225251] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496988125/real 1496988125] req@ffff8805dd139e00 x1569655035115936/t0(0) o8->soaked-OST0013-osc-ffff880828cb2000@192.168.1.103@o2ib10:28/4 lens 520/544 e 0 to 1 dl 1496988131 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [52299.262525] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 32 previous similar messages [52317.222026] Lustre: soaked-OST0013-osc-ffff880828cb2000: Connection restored to 192.168.1.103@o2ib10 (at 192.168.1.103@o2ib10) [52317.623992] LustreError: 11-0: soaked-OST0001-osc-ffff880828cb2000: operation ost_read to node 192.168.1.102@o2ib10 failed: rc = -107 [52317.624004] Lustre: soaked-OST0001-osc-ffff880828cb2000: Connection to soaked-OST0001 (at 192.168.1.102@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [52317.663259] LustreError: Skipped 3 previous similar messages [52322.228520] LustreError: 11-0: soaked-OST0007-osc-ffff880828cb2000: operation ldlm_enqueue to node 192.168.1.102@o2ib10 failed: rc = -107 [52331.447397] Lustre: soaked-OST0001-osc-ffff880828cb2000: Connection restored to 192.168.1.103@o2ib10 (at 192.168.1.103@o2ib10) [52332.125084] LustreError: 11-0: soaked-OST000d-osc-ffff880828cb2000: operation ost_read to node 192.168.1.102@o2ib10 failed: rc = -107 [52332.141545] LustreError: Skipped 3 previous similar messages [52366.078120] Lustre: soaked-OST000d-osc-ffff880828cb2000: Connection restored to 192.168.1.103@o2ib10 (at 192.168.1.103@o2ib10) [54886.439432] Lustre: 2971:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496990700/real 1496990700] req@ffff8806fa334800 x1569655139097792/t0(0) o400->soaked-MDT0001-mdc-ffff880828cb2000@192.168.1.109@o2ib10:12/10 lens 224/224 e 0 to 1 dl 1496990707 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [54886.484105] Lustre: soaked-MDT0001-mdc-ffff880828cb2000: Connection to soaked-MDT0001 (at 192.168.1.109@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [54886.511866] Lustre: Skipped 2 previous similar messages [55002.524201] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496990818/real 1496990818] req@ffff880740c83900 x1569655140375040/t0(0) o38->soaked-MDT0001-mdc-ffff880828cb2000@192.168.1.109@o2ib10:12/10 lens 520/544 e 0 to 1 dl 1496990834 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [55002.569179] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 2 previous similar messages [55192.529243] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496990993/real 1496990993] req@ffff88066e1a9800 x1569655143454944/t0(0) o38->soaked-MDT0001-mdc-ffff880828cb2000@192.168.1.109@o2ib10:12/10 lens 520/544 e 0 to 1 dl 1496991024 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [55192.566478] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 2 previous similar messages [55390.244232] Lustre: soaked-MDT0001-mdc-ffff880828cb2000: Connection restored to 192.168.1.109@o2ib10 (at 192.168.1.109@o2ib10) [55390.264995] Lustre: Skipped 1 previous similar message [58689.990923] Lustre: 78128:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496994515/real 1496994515] req@ffff8807c7582d00 x1569655626848832/t0(0) o101->soaked-MDT0000-mdc-ffff880828cb2000@192.168.1.108@o2ib10:12/10 lens 1728/5800 e 0 to 1 dl 1496994522 ref 2 fl Rpc:XP/0/ffffffff rc 0/-1 [58689.990931] Lustre: soaked-MDT0000-mdc-ffff880828cb2000: Connection to soaked-MDT0000 (at 192.168.1.108@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [58690.050847] Lustre: 78128:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 3 previous similar messages [58693.588986] LustreError: 166-1: MGC192.168.1.108@o2ib10: Connection to MGS (at 192.168.1.108@o2ib10) was lost; in progress operations using this service will fail [58754.607969] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496994575/real 1496994575] req@ffff8805fab24800 x1569655626849440/t0(0) o250->MGC192.168.1.108@o2ib10@192.168.1.108@o2ib10:26/25 lens 520/544 e 0 to 1 dl 1496994586 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [58754.644020] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 4 previous similar messages [58834.609269] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496994650/real 1496994650] req@ffff8805740ee000 x1569655626850832/t0(0) o250->MGC192.168.1.108@o2ib10@192.168.1.109@o2ib10:26/25 lens 520/544 e 0 to 1 dl 1496994666 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [58834.645271] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 4 previous similar messages [58999.611945] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496994800/real 1496994800] req@ffff8807a03bfb00 x1569655626853584/t0(0) o38->soaked-MDT0000-mdc-ffff880828cb2000@192.168.1.108@o2ib10:12/10 lens 520/544 e 0 to 1 dl 1496994831 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [58999.648967] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 6 previous similar messages [59018.612962] LustreError: 167-0: soaked-MDT0000-mdc-ffff880828cb2000: This client was evicted by soaked-MDT0000; in progress operations using this service will fail. [59018.632444] LustreError: 112211:0:(file.c:176:ll_close_inode_openhandle()) soaked-clilmv-ffff880828cb2000: inode [0x20005d09a:0x7c78:0x0] mdc close failed: rc = -5 [59018.632446] LustreError: 112409:0:(lmv_obd.c:1381:lmv_statfs()) can't stat MDS #0 (soaked-MDT0000-mdc-ffff880828cb2000), error -5 [59018.632450] LustreError: 112409:0:(llite_lib.c:1691:ll_statfs_internal()) md_statfs fails: rc = -5 [59018.682414] Lustre: soaked-MDT0000-mdc-ffff880828cb2000: Connection restored to 192.168.1.109@o2ib10 (at 192.168.1.109@o2ib10) [59019.883750] LustreError: 112599:0:(llite_lib.c:2257:ll_prep_inode()) new_inode -fatal: rc -2 [59068.613792] LustreError: 11-0: soaked-MDT0000-mdc-ffff880828cb2000: operation obd_ping to node 192.168.1.109@o2ib10 failed: rc = -107 [59068.629798] Lustre: soaked-MDT0000-mdc-ffff880828cb2000: Connection to soaked-MDT0000 (at 192.168.1.109@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [59093.614322] Lustre: Evicted from MGS (at 192.168.1.108@o2ib10) after server handle changed from 0x3a6ac8d66c8c8195 to 0xc3c175b3fa66ea38 [59093.630714] Lustre: MGC192.168.1.108@o2ib10: Connection restored to 192.168.1.108@o2ib10 (at 192.168.1.108@o2ib10) [59100.724562] LustreError: 167-0: soaked-MDT0000-mdc-ffff880828cb2000: This client was evicted by soaked-MDT0000; in progress operations using this service will fail. [59100.744353] LustreError: 112758:0:(fid_request.c:227:seq_client_alloc_seq()) cli-cli-soaked-MDT0000-mdc-ffff880828cb2000: Can't allocate new meta-sequence,rc -5 [59100.763188] LustreError: 112758:0:(fid_request.c:383:seq_client_alloc_fid()) cli-cli-soaked-MDT0000-mdc-ffff880828cb2000: Can't allocate new sequence: rc = -5 [59100.781725] LustreError: 112758:0:(lmv_obd.c:1244:lmv_fid_alloc()) Can't alloc new fid, rc -5 [59100.782206] Lustre: soaked-MDT0000-mdc-ffff880828cb2000: Connection restored to 192.168.1.108@o2ib10 (at 192.168.1.108@o2ib10) [61815.651521] Lustre: 2964:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496997625/real 1496997625] req@ffff88069a159e00 x1569655705390704/t0(0) o400->soaked-OST0017-osc-ffff880828cb2000@192.168.1.107@o2ib10:28/4 lens 224/224 e 0 to 1 dl 1496997634 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [61815.689065] Lustre: 2964:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 2 previous similar messages [61815.701301] Lustre: soaked-OST0017-osc-ffff880828cb2000: Connection to soaked-OST0017 (at 192.168.1.107@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [61824.678664] Lustre: soaked-OST0011-osc-ffff880828cb2000: Connection to soaked-OST0011 (at 192.168.1.107@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [61824.701368] Lustre: Skipped 1 previous similar message [61834.162837] Lustre: soaked-OST000b-osc-ffff880828cb2000: Connection to soaked-OST000b (at 192.168.1.107@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [61895.186804] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496997716/real 1496997716] req@ffff88069a15c800 x1569655707846240/t0(0) o8->soaked-OST0017-osc-ffff880828cb2000@192.168.1.107@o2ib10:28/4 lens 520/544 e 0 to 1 dl 1496997727 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [61895.224102] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 7 previous similar messages [62005.188589] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496997816/real 1496997816] req@ffff880758b39500 x1569655710339936/t0(0) o8->soaked-OST0017-osc-ffff880828cb2000@192.168.1.107@o2ib10:28/4 lens 520/544 e 0 to 1 dl 1496997837 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [62005.225795] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 9 previous similar messages [62060.681850] Lustre: soaked-OST0017-osc-ffff880828cb2000: Connection restored to 192.168.1.106@o2ib10 (at 192.168.1.106@o2ib10) [62065.242126] Lustre: soaked-OST0005-osc-ffff880828cb2000: Connection restored to 192.168.1.106@o2ib10 (at 192.168.1.106@o2ib10) [62090.853022] Lustre: soaked-OST000b-osc-ffff880828cb2000: Connection restored to 192.168.1.106@o2ib10 (at 192.168.1.106@o2ib10) [62103.810867] Lustre: soaked-OST0011-osc-ffff880828cb2000: Connection restored to 192.168.1.106@o2ib10 (at 192.168.1.106@o2ib10) [62110.989744] LustreError: 11-0: soaked-OST0017-osc-ffff880828cb2000: operation ost_write to node 192.168.1.106@o2ib10 failed: rc = -19 [62111.005917] Lustre: soaked-OST0017-osc-ffff880828cb2000: Connection to soaked-OST0017 (at 192.168.1.106@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [62111.522266] LustreError: 11-0: soaked-OST0017-osc-ffff880828cb2000: operation ost_write to node 192.168.1.106@o2ib10 failed: rc = -19 [62111.538794] LustreError: Skipped 7 previous similar messages [62150.428775] Lustre: soaked-OST0017-osc-ffff880828cb2000: Connection restored to 192.168.1.107@o2ib10 (at 192.168.1.107@o2ib10) [62150.650780] LustreError: 11-0: soaked-OST0005-osc-ffff880828cb2000: operation ldlm_enqueue to node 192.168.1.106@o2ib10 failed: rc = -107 [62150.658294] Lustre: soaked-OST0005-osc-ffff880828cb2000: Connection to soaked-OST0005 (at 192.168.1.106@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [62150.690237] LustreError: Skipped 1 previous similar message [62158.482739] Lustre: soaked-OST0005-osc-ffff880828cb2000: Connection restored to 192.168.1.107@o2ib10 (at 192.168.1.107@o2ib10) [62158.729007] LustreError: 11-0: soaked-OST000b-osc-ffff880828cb2000: operation ldlm_enqueue to node 192.168.1.106@o2ib10 failed: rc = -107 [62158.733182] Lustre: soaked-OST0011-osc-ffff880828cb2000: Connection to soaked-OST0011 (at 192.168.1.106@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [62158.768271] LustreError: Skipped 1 previous similar message [62203.731596] Lustre: soaked-OST0011-osc-ffff880828cb2000: Connection restored to 192.168.1.107@o2ib10 (at 192.168.1.107@o2ib10) [62203.747045] Lustre: Skipped 1 previous similar message [62255.257925] LustreError: 11-0: soaked-OST0016-osc-ffff880828cb2000: operation ldlm_enqueue to node 192.168.1.106@o2ib10 failed: rc = -14 [62543.640315] Lustre: 136443:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496998368/real 1496998368] req@ffff880091b66c00 x1569655729008784/t0(0) o36->soaked-MDT0000-mdc-ffff880828cb2000@192.168.1.108@o2ib10:12/10 lens 616/1696 e 0 to 1 dl 1496998375 ref 2 fl Rpc:X/0/ffffffff rc 0/-1 [62543.640323] Lustre: soaked-MDT0000-mdc-ffff880828cb2000: Connection to soaked-MDT0000 (at 192.168.1.108@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [62543.640325] Lustre: Skipped 1 previous similar message [62543.707594] Lustre: 136443:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 8 previous similar messages [62576.686857] LustreError: 166-1: MGC192.168.1.108@o2ib10: Connection to MGS (at 192.168.1.108@o2ib10) was lost; in progress operations using this service will fail [62852.709332] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1496998658/real 1496998658] req@ffff88066c737b00 x1569655729841728/t0(0) o250->MGC192.168.1.108@o2ib10@192.168.1.109@o2ib10:26/25 lens 520/544 e 0 to 1 dl 1496998684 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [62852.745648] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 15 previous similar messages [62876.710438] LustreError: 167-0: soaked-MDT0000-mdc-ffff880828cb2000: This client was evicted by soaked-MDT0000; in progress operations using this service will fail. [62876.729727] LustreError: 152661:0:(lmv_obd.c:1381:lmv_statfs()) can't stat MDS #0 (soaked-MDT0000-mdc-ffff880828cb2000), error -5 [62876.730584] Lustre: soaked-MDT0000-mdc-ffff880828cb2000: Connection restored to 192.168.1.109@o2ib10 (at 192.168.1.109@o2ib10) [62876.764811] LustreError: 152661:0:(llite_lib.c:1691:ll_statfs_internal()) md_statfs fails: rc = -5 [62901.710671] LustreError: 11-0: soaked-MDT0000-mdc-ffff880828cb2000: operation obd_ping to node 192.168.1.109@o2ib10 failed: rc = -107 [62901.726701] Lustre: soaked-MDT0000-mdc-ffff880828cb2000: Connection to soaked-MDT0000 (at 192.168.1.109@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [62951.712056] LustreError: 167-0: soaked-MDT0000-mdc-ffff880828cb2000: This client was evicted by soaked-MDT0000; in progress operations using this service will fail. [62951.736422] LustreError: 152850:0:(lmv_obd.c:1244:lmv_fid_alloc()) Can't alloc new fid, rc -19 [62951.737826] Lustre: soaked-MDT0000-mdc-ffff880828cb2000: Connection restored to 192.168.1.108@o2ib10 (at 192.168.1.108@o2ib10) [62976.880391] Lustre: Evicted from MGS (at 192.168.1.108@o2ib10) after server handle changed from 0xc3c175b3fa66ea38 to 0x88775877874d7c9f [62976.902006] Lustre: MGC192.168.1.108@o2ib10: Connection restored to 192.168.1.108@o2ib10 (at 192.168.1.108@o2ib10) [65414.965963] Lustre: 153993:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1497001239/real 1497001239] req@ffff880685386300 x1569655800162464/t0(0) o13->soaked-OST0001-osc-ffff880828cb2000@192.168.1.103@o2ib10:7/4 lens 224/368 e 0 to 1 dl 1497001246 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [65414.966974] Lustre: soaked-OST0001-osc-ffff880828cb2000: Connection to soaked-OST0001 (at 192.168.1.103@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [65415.033205] Lustre: 153993:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 7 previous similar messages [65530.968817] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1497001346/real 1497001346] req@ffff8807e4f36000 x1569655803528352/t0(0) o8->soaked-OST0013-osc-ffff880828cb2000@192.168.1.103@o2ib10:28/4 lens 520/544 e 0 to 1 dl 1497001362 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [65531.005839] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 12 previous similar messages [65675.124913] Lustre: soaked-OST0013-osc-ffff880828cb2000: Connection restored to 192.168.1.102@o2ib10 (at 192.168.1.102@o2ib10) [65702.958550] Lustre: soaked-OST0001-osc-ffff880828cb2000: Connection restored to 192.168.1.102@o2ib10 (at 192.168.1.102@o2ib10) [65716.031304] Lustre: soaked-OST0007-osc-ffff880828cb2000: Connection restored to 192.168.1.102@o2ib10 (at 192.168.1.102@o2ib10) [65720.412917] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1497001521/real 1497001521] req@ffff8807e4f30000 x1569655803969072/t0(0) o8->soaked-OST000d-osc-ffff880828cb2000@192.168.1.103@o2ib10:28/4 lens 520/544 e 0 to 1 dl 1497001552 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [65720.452857] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 11 previous similar messages [65740.258499] Lustre: soaked-OST000d-osc-ffff880828cb2000: Connection restored to 192.168.1.102@o2ib10 (at 192.168.1.102@o2ib10) [65754.528196] LustreError: 11-0: soaked-OST0013-osc-ffff880828cb2000: operation ldlm_enqueue to node 192.168.1.102@o2ib10 failed: rc = -107 [65754.545195] Lustre: soaked-OST0013-osc-ffff880828cb2000: Connection to soaked-OST0013 (at 192.168.1.102@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [65754.567965] Lustre: Skipped 3 previous similar messages [65779.907939] LustreError: 11-0: soaked-OST0001-osc-ffff880828cb2000: operation ost_write to node 192.168.1.102@o2ib10 failed: rc = -19 [65779.928683] Lustre: soaked-OST0001-osc-ffff880828cb2000: Connection to soaked-OST0001 (at 192.168.1.102@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [65789.168415] Lustre: soaked-OST0013-osc-ffff880828cb2000: Connection restored to 192.168.1.103@o2ib10 (at 192.168.1.103@o2ib10) [65797.470839] LustreError: 11-0: soaked-OST0007-osc-ffff880828cb2000: operation ost_setattr to node 192.168.1.102@o2ib10 failed: rc = -107 [65816.553374] LustreError: 11-0: soaked-OST000d-osc-ffff880828cb2000: operation ldlm_enqueue to node 192.168.1.102@o2ib10 failed: rc = -107 [65816.553385] Lustre: soaked-OST000d-osc-ffff880828cb2000: Connection to soaked-OST000d (at 192.168.1.102@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [65816.553387] Lustre: Skipped 1 previous similar message [65816.607300] LustreError: Skipped 1 previous similar message [65825.554247] Lustre: soaked-OST000d-osc-ffff880828cb2000: Connection restored to 192.168.1.103@o2ib10 (at 192.168.1.103@o2ib10) [65825.574715] Lustre: Skipped 2 previous similar messages [66400.102941] Lustre: 154702:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1497002225/real 1497002225] req@ffff88056c7f8000 x1569655854381056/t0(0) o41->soaked-MDT0001-mdc-ffff880828cb2000@192.168.1.109@o2ib10:12/10 lens 224/368 e 0 to 1 dl 1497002232 ref 2 fl Rpc:X/0/ffffffff rc 0/-1 [66400.140605] Lustre: soaked-MDT0001-mdc-ffff880828cb2000: Connection to soaked-MDT0001 (at 192.168.1.109@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [66689.171885] Lustre: soaked-MDT0001-mdc-ffff880828cb2000: Connection restored to 192.168.1.108@o2ib10 (at 192.168.1.108@o2ib10) [66725.169465] LustreError: 11-0: soaked-MDT0001-mdc-ffff880828cb2000: operation obd_ping to node 192.168.1.108@o2ib10 failed: rc = -107 [66725.185793] Lustre: soaked-MDT0001-mdc-ffff880828cb2000: Connection to soaked-MDT0001 (at 192.168.1.108@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [66839.071882] Lustre: soaked-MDT0001-mdc-ffff880828cb2000: Connection restored to 192.168.1.109@o2ib10 (at 192.168.1.109@o2ib10) [67398.845156] Lustre: 153994:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1497003223/real 1497003223] req@ffff8804ced3ec00 x1569655939409456/t0(0) o41->soaked-MDT0003-mdc-ffff880828cb2000@192.168.1.111@o2ib10:12/10 lens 224/368 e 0 to 1 dl 1497003230 ref 2 fl Rpc:X/0/ffffffff rc 0/-1 [67398.848194] Lustre: soaked-MDT0003-mdc-ffff880828cb2000: Connection to soaked-MDT0003 (at 192.168.1.111@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [67398.914040] Lustre: 153994:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 7 previous similar messages [67704.915111] LustreError: 2947:0:(mdc_request.c:564:mdc_replay_open()) @@@ Can't properly replay without open data. req@ffff880758afc200 x1569654723335296/t712964649006(712964649006) o101->soaked-MDT0003-mdc-ffff880828cb2000@192.168.1.110@o2ib10:12/10 lens 872/544 e 0 to 0 dl 1497003579 ref 2 fl Interpret:RP/4/0 rc 301/301 [67774.914951] Lustre: soaked-MDT0003-mdc-ffff880828cb2000: Connection restored to 192.168.1.110@o2ib10 (at 192.168.1.110@o2ib10) [67780.013908] LustreError: 11-0: soaked-MDT0003-mdc-ffff880828cb2000: operation mds_statfs to node 192.168.1.110@o2ib10 failed: rc = -107 [67895.948542] LustreError: 2947:0:(import.c:1259:ptlrpc_connect_interpret()) soaked-MDT0003_UUID went back in time (transno 712974377083 was previously committed, server now claims 712974263576)! See https://bugzilla.lustre.org/show_bug.cgi?id=9646 [67896.037771] LustreError: 2947:0:(mdc_request.c:564:mdc_replay_open()) @@@ Can't properly replay without open data. req@ffff880758afc200 x1569654723335296/t712964649006(712964649006) o101->soaked-MDT0003-mdc-ffff880828cb2000@192.168.1.111@o2ib10:12/10 lens 872/544 e 0 to 0 dl 1497003769 ref 2 fl Interpret:RP/4/0 rc 301/301 [67926.254384] Lustre: soaked-MDT0003-mdc-ffff880828cb2000: Connection restored to 192.168.1.111@o2ib10 (at 192.168.1.111@o2ib10) [69118.866050] Lustre: 169860:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1497004943/real 1497004943] req@ffff88032a22b600 x1569656119757712/t0(0) o36->soaked-MDT0000-mdc-ffff880828cb2000@192.168.1.108@o2ib10:12/10 lens 616/1696 e 0 to 1 dl 1497004950 ref 2 fl Rpc:X/0/ffffffff rc 0/-1 [69118.866060] Lustre: soaked-MDT0000-mdc-ffff880828cb2000: Connection to soaked-MDT0000 (at 192.168.1.108@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [69118.866061] Lustre: Skipped 1 previous similar message [69118.932970] Lustre: 169860:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 10 previous similar messages [69150.868567] LustreError: 166-1: MGC192.168.1.108@o2ib10: Connection to MGS (at 192.168.1.108@o2ib10) was lost; in progress operations using this service will fail [69211.887576] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1497005032/real 1497005032] req@ffff880742caad00 x1569656119759840/t0(0) o250->MGC192.168.1.108@o2ib10@192.168.1.108@o2ib10:26/25 lens 520/544 e 0 to 1 dl 1497005043 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [69211.923687] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 5 previous similar messages [69376.890336] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1497005182/real 1497005182] req@ffff880742c41200 x1569656119762656/t0(0) o250->MGC192.168.1.108@o2ib10@192.168.1.108@o2ib10:26/25 lens 520/544 e 0 to 1 dl 1497005208 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [69376.926512] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 8 previous similar messages [69625.964844] LustreError: 2947:0:(client.c:2982:ptlrpc_replay_interpret()) @@@ status 301, old was 0 req@ffff88066c730900 x1569655731919728/t798863917259(798863917259) o101->soaked-MDT0000-mdc-ffff880828cb2000@192.168.1.108@o2ib10:12/10 lens 808/544 e 0 to 0 dl 1497005464 ref 2 fl Interpret:RP/4/0 rc 301/301 [69625.999409] LustreError: 2947:0:(client.c:2982:ptlrpc_replay_interpret()) Skipped 464 previous similar messages [69650.895685] Lustre: Evicted from MGS (at 192.168.1.108@o2ib10) after server handle changed from 0x88775877874d7c9f to 0x67cc743f5672cb2e [69650.912134] Lustre: MGC192.168.1.108@o2ib10: Connection restored to 192.168.1.108@o2ib10 (at 192.168.1.108@o2ib10) [69674.726495] LustreError: 11-0: soaked-MDT0000-mdc-ffff880828cb2000: operation mds_close to node 192.168.1.108@o2ib10 failed: rc = -107 [69700.898729] LustreError: 167-0: soaked-MDT0000-mdc-ffff880828cb2000: This client was evicted by soaked-MDT0000; in progress operations using this service will fail. [69700.938560] LustreError: 172352:0:(lmv_obd.c:1381:lmv_statfs()) can't stat MDS #0 (soaked-MDT0000-mdc-ffff880828cb2000), error -5 [69700.939497] Lustre: soaked-MDT0000-mdc-ffff880828cb2000: Connection restored to 192.168.1.108@o2ib10 (at 192.168.1.108@o2ib10) [69700.971333] LustreError: 172352:0:(llite_lib.c:1691:ll_statfs_internal()) md_statfs fails: rc = -5 [71973.942939] Lustre: 179337:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1497007729/real 1497007729] req@ffff88018cfa4b00 x1569656153405200/t0(0) o101->soaked-OST0013-osc-ffff880828cb2000@192.168.1.103@o2ib10:28/4 lens 328/400 e 0 to 1 dl 1497007805 ref 2 fl Rpc:X/0/ffffffff rc 0/-1 [71973.980482] Lustre: 179337:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 8 previous similar messages [71973.992933] Lustre: soaked-OST0013-osc-ffff880828cb2000: Connection to soaked-OST0013 (at 192.168.1.103@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [72039.434971] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1497007860/real 1497007860] req@ffff88067e6a8300 x1569656155019008/t0(0) o8->soaked-OST0013-osc-ffff880828cb2000@192.168.1.103@o2ib10:28/4 lens 520/544 e 0 to 1 dl 1497007871 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [72039.472307] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 6 previous similar messages [72058.624263] Lustre: soaked-OST0001-osc-ffff880828cb2000: Connection to soaked-OST0001 (at 192.168.1.103@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [72058.646916] Lustre: Skipped 2 previous similar messages [72119.654219] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1497007940/real 1497007940] req@ffff8806d1c88600 x1569656156107808/t0(0) o8->soaked-OST0001-osc-ffff880828cb2000@192.168.1.103@o2ib10:28/4 lens 520/544 e 0 to 1 dl 1497007951 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [72119.691477] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 7 previous similar messages [72170.389514] Lustre: soaked-OST0013-osc-ffff880828cb2000: Connection restored to 192.168.1.102@o2ib10 (at 192.168.1.102@o2ib10) [72190.327019] Lustre: soaked-OST0001-osc-ffff880828cb2000: Connection restored to 192.168.1.102@o2ib10 (at 192.168.1.102@o2ib10) [72220.826468] Lustre: soaked-OST000d-osc-ffff880828cb2000: Connection restored to 192.168.1.102@o2ib10 (at 192.168.1.102@o2ib10) [72257.250983] Lustre: soaked-OST0013-osc-ffff880828cb2000: Connection to soaked-OST0013 (at 192.168.1.102@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [72258.608502] Lustre: soaked-OST0013-osc-ffff880828cb2000: Connection restored to 192.168.1.103@o2ib10 (at 192.168.1.103@o2ib10) [72258.624210] Lustre: Skipped 1 previous similar message [72271.664927] Lustre: soaked-OST0001-osc-ffff880828cb2000: Connection restored to 192.168.1.103@o2ib10 (at 192.168.1.103@o2ib10) [72275.302163] LustreError: 11-0: soaked-OST000d-osc-ffff880828cb2000: operation obd_ping to node 192.168.1.102@o2ib10 failed: rc = -107 [72275.318601] LustreError: Skipped 1 previous similar message [72282.804717] Lustre: soaked-OST0007-osc-ffff880828cb2000: Connection restored to 192.168.1.103@o2ib10 (at 192.168.1.103@o2ib10) [72316.308060] Lustre: soaked-OST000d-osc-ffff880828cb2000: Connection restored to 192.168.1.103@o2ib10 (at 192.168.1.103@o2ib10) [73798.910332] Lustre: 179338:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1497009623/real 0] req@ffff8807f9641b00 x1569656570972656/t0(0) o35->soaked-MDT0003-mdc-ffff880828cb2000@192.168.1.111@o2ib10:23/10 lens 512/1696 e 0 to 1 dl 1497009630 ref 3 fl Rpc:X/0/ffffffff rc 0/-1 [73798.946865] Lustre: 179338:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 14 previous similar messages [73798.959307] Lustre: soaked-MDT0003-mdc-ffff880828cb2000: Connection to soaked-MDT0003 (at 192.168.1.111@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [73798.981718] Lustre: Skipped 3 previous similar messages [73803.331414] Lustre: soaked-OST0012-osc-ffff880828cb2000: Connection to soaked-OST0012 (at 192.168.1.102@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [73803.331416] Lustre: soaked-OST000b-osc-ffff880828cb2000: Connection to soaked-OST000b (at 192.168.1.107@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [73803.331418] Lustre: Skipped 4 previous similar messages [73807.383489] LustreError: 166-1: MGC192.168.1.108@o2ib10: Connection to MGS (at 192.168.1.108@o2ib10) was lost; in progress operations using this service will fail [73838.401963] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1497009664/real 1497009664] req@ffff880461419e00 x1569656578023088/t0(0) o250->MGC192.168.1.108@o2ib10@192.168.1.109@o2ib10:26/25 lens 520/544 e 0 to 1 dl 1497009670 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [73838.439654] Lustre: 2947:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 69 previous similar messages [73857.402953] Lustre: soaked-OST0007-osc-ffff880828cb2000: Connection restored to 192.168.1.103@o2ib10 (at 192.168.1.103@o2ib10) [73941.300633] Lustre: 217007:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1497009765/real 1497009765] req@ffff8806f4689500 x1569656612324240/t0(0) o13->soaked-OST0003-osc-ffff880828cb2000@192.168.1.105@o2ib10:7/4 lens 224/368 e 0 to 1 dl 1497009773 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [73941.341153] Lustre: soaked-OST0003-osc-ffff880828cb2000: Connection to soaked-OST0003 (at 192.168.1.105@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [73941.365825] Lustre: Skipped 3 previous similar messages [74016.308834] Lustre: 2961:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1497009756/real 1497009756] req@ffff880600159800 x1569656611401344/t0(0) o101->soaked-OST0003-osc-ffff880828cb2000@192.168.1.105@o2ib10:28/4 lens 328/400 e 0 to 1 dl 1497009848 ref 1 fl Rpc:X/0/ffffffff rc 0/-1 [74016.345816] Lustre: 2961:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 158888 previous similar messages [74168.793255] Lustre: soaked-OST0009-osc-ffff880828cb2000: Connection restored to 192.168.1.104@o2ib10 (at 192.168.1.104@o2ib10) [74168.808640] Lustre: Skipped 10 previous similar messages [74187.266582] Lustre: 173277:0:(client.c:2114:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1497010006/real 0] req@ffff880549371800 x1569656616861552/t0(0) o101->soaked-MDT0002-mdc-ffff880828cb2000@192.168.1.110@o2ib10:12/10 lens 704/5672 e 0 to 1 dl 1497010019 ref 3 fl Rpc:X/0/ffffffff rc 0/-1 [74187.303965] Lustre: 173277:0:(client.c:2114:ptlrpc_expire_one_request()) Skipped 1627 previous similar messages [74187.316546] Lustre: soaked-MDT0002-mdc-ffff880828cb2000: Connection to soaked-MDT0002 (at 192.168.1.110@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [74187.339015] Lustre: Skipped 3 previous similar messages [74189.887637] LustreError: 166-1: MGC192.168.1.108@o2ib10: Connection to MGS (at 192.168.1.108@o2ib10) was lost; in progress operations using this service will fail [74194.674522] Lustre: MGC192.168.1.108@o2ib10: Connection restored to 192.168.1.108@o2ib10 (at 192.168.1.108@o2ib10) [74194.688177] Lustre: Skipped 1 previous similar message [74247.138750] Lustre: soaked-OST0015-osc-ffff880828cb2000: Connection restored to 192.168.1.104@o2ib10 (at 192.168.1.104@o2ib10) [74247.155243] Lustre: Skipped 1 previous similar message [74283.002146] Lustre: soaked-OST0001-osc-ffff880828cb2000: Connection to soaked-OST0001 (at 192.168.1.103@o2ib10) was lost; in progress operations using this service will wait for recovery to complete [74283.024496] Lustre: Skipped 2 previous similar messages [74294.093320] LustreError: 166-1: MGC192.168.1.108@o2ib10: Connection to MGS (at 192.168.1.108@o2ib10) was lost; in progress operations using this service will fail [74332.301269] Lustre: soaked-MDT0000-mdc-ffff880828cb2000: Connection restored to 192.168.1.108@o2ib10 (at 192.168.1.108@o2ib10) [74333.068216] LustreError: 11-0: soaked-OST0003-osc-ffff880828cb2000: operation ldlm_enqueue to node 192.168.1.104@o2ib10 failed: rc = -19 [74333.097686] LustreError: 2947:0:(import.c:671:ptlrpc_connect_import()) already connecting [74333.568918] LustreError: 11-0: soaked-OST0003-osc-ffff880828cb2000: operation ldlm_enqueue to node 192.168.1.104@o2ib10 failed: rc = -107 [74333.586347] LustreError: Skipped 12826 previous similar messages [74333.598918] LustreError: 2947:0:(import.c:671:ptlrpc_connect_import()) already connecting [74333.609846] LustreError: 2947:0:(import.c:671:ptlrpc_connect_import()) Skipped 13048 previous similar messages [74334.303596] LustreError: 167-0: soaked-OST0003-osc-ffff880828cb2000: This client was evicted by soaked-OST0003; in progress operations using this service will fail. [74334.334964] LustreError: 2960:0:(client.c:1189:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff8805e1cf3900 x1569656575292352/t0(0) o101->soaked-OST0003-osc-ffff880828cb2000@192.168.1.104@o2ib10:28/4 lens 328/400 e 0 to 1 dl 1497009748 ref 1 fl Rpc:X/0/ffffffff rc 0/-1 [74334.469039] LustreError: 2947:0:(client.c:1176:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff880624b19800 x1569656617848704/t0(0) o8->soaked-OST0003-osc-ffff880828cb2000@192.168.1.104@o2ib10:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:N/0/ffffffff rc 0/-1 [74364.225606] LustreError: 2960:0:(niobuf.c:773:ptl_send_rpc()) ASSERTION( (at_max == 0) || imp->imp_state != LUSTRE_IMP_FULL || (imp->imp_msghdr_flags & 0x1) || !(imp->imp_connect_data.ocd_connect_flags & 0x1000000ULL) ) failed: [74364.250964] LustreError: 2960:0:(niobuf.c:773:ptl_send_rpc()) LBUG [74364.259219] Pid: 2960, comm: ptlrpcd_00_12 [74364.265128] Call Trace: [74364.267656] LustreError: 217188:0:(niobuf.c:773:ptl_send_rpc()) ASSERTION( (at_max == 0) || imp->imp_state != LUSTRE_IMP_FULL || (imp->imp_msghdr_flags & 0x1) || !(imp->imp_connect_data.ocd_connect_flags & 0x1000000ULL) ) failed: [74364.267659] LustreError: 217188:0:(niobuf.c:773:ptl_send_rpc()) LBUG [74364.267661] Pid: 217188, comm: df [74364.267661] Call Trace: [74364.267685] [] libcfs_call_trace+0x4e/0x60 [libcfs] [74364.267695] [] lbug_with_loc+0x4c/0xb0 [libcfs] [74364.267747] [] ptl_send_rpc+0xb1f/0xe60 [ptlrpc] [74364.267815] [] ? sptlrpc_req_refresh_ctx+0x153/0x900 [ptlrpc] [74364.267856] [] ptlrpc_send_new_req+0x460/0xa60 [ptlrpc] [74364.267894] [] ptlrpc_set_wait+0x3d1/0x900 [ptlrpc] [74364.267906] [] ? osc_statfs_async+0xfd/0x1e0 [osc] [74364.267919] [] ? lov_statfs_async+0xe7/0x730 [lov] [74364.267928] [] ? kmem_cache_alloc_node_trace+0x125/0x220 [74364.267955] [] ll_statfs_internal+0x35d/0xf30 [lustre] [74364.267959] [] ? lookup_fast+0xcc/0x2e0 [74364.267963] [] ? path_lookupat+0x83/0x7a0 [74364.267966] [] ? path_lookupat+0x116/0x7a0 [74364.267979] [] ? _nfs4_proc_statfs+0xc8/0xf0 [nfsv4] [74364.268023] [] ? lprocfs_counter_add+0xf9/0x160 [obdclass] [74364.268044] [] ll_statfs+0x84/0x180 [lustre] [74364.268047] [] ? putname+0x3d/0x60 [74364.268052] [] statfs_by_dentry+0xa1/0x140 [74364.268054] [] vfs_statfs+0x1b/0xb0 [74364.268056] [] user_statfs+0x55/0xa0 [74364.268059] [] SYSC_statfs+0x27/0x60 [74364.268062] [] SyS_statfs+0xe/0x10 [74364.268068] [] system_call_fastpath+0x16/0x1b [74364.268069] [74364.268070] Kernel panic - not syncing: LBUG [74364.268074] CPU: 10 PID: 217188 Comm: df Tainted: G OE ------------ 3.10.0-514.10.2.el7.x86_64 #1 [74364.268076] Hardware name: Intel Corporation S2600GZ ........../S2600GZ, BIOS SE5C600.86B.01.08.0003.022620131521 02/26/2013 [74364.268081] ffffffffa0846dac 000000005fc826cb ffff8801f48df9f0 ffffffff816864ef [74364.268083] ffff8801f48dfa70 ffffffff8167f8f6 ffffffff00000008 ffff8801f48dfa80 [74364.268086] ffff8801f48dfa20 000000005fc826cb 000000005fc826cb 0000000000000282 [74364.268087] Call Trace: [74364.268103] [] dump_stack+0x19/0x1b [74364.268108] [] panic+0xe3/0x1f2 [74364.268119] [] lbug_with_loc+0x64/0xb0 [libcfs] [74364.268159] [] ptl_send_rpc+0xb1f/0xe60 [ptlrpc] [74364.268207] [] ? sptlrpc_req_refresh_ctx+0x153/0x900 [ptlrpc] [74364.268256] [] ptlrpc_send_new_req+0x460/0xa60 [ptlrpc] [74364.268287] [] ptlrpc_set_wait+0x3d1/0x900 [ptlrpc] [74364.268296] [] ? osc_statfs_async+0xfd/0x1e0 [osc] [74364.268306] [] ? lov_statfs_async+0xe7/0x730 [lov] [74364.268310] [] ? kmem_cache_alloc_node_trace+0x125/0x220 [74364.268328] [] ll_statfs_internal+0x35d/0xf30 [lustre] [74364.268330] [] ? lookup_fast+0xcc/0x2e0 [74364.268332] [] ? path_lookupat+0x83/0x7a0 [74364.268334] [] ? path_lookupat+0x116/0x7a0 [74364.268343] [] ? _nfs4_proc_statfs+0xc8/0xf0 [nfsv4] [74364.268370] [] ? lprocfs_counter_add+0xf9/0x160 [obdclass] [74364.268388] [] ll_statfs+0x84/0x180 [lustre] [74364.268390] [] ? putname+0x3d/0x60 [74364.268393] [] statfs_by_dentry+0xa1/0x140 [74364.268395] [] vfs_statfs+0x1b/0xb0 [74364.268396] [] user_statfs+0x55/0xa0 [74364.268398] [] SYSC_statfs+0x27/0x60 [74364.268401] [] SyS_statfs+0xe/0x10 [74364.268404] [] system_call_fastpath+0x16/0x1b