[ 0.000000] microcode: microcode updated early to revision 0x710, date = 2013-06-17 [ 0.000000] Initializing cgroup subsys cpuset [ 0.000000] Initializing cgroup subsys cpu [ 0.000000] Initializing cgroup subsys cpuacct [ 0.000000] Linux version 3.10.0-693.5.2.el7_lustre.x86_64 (jenkins@trevis-307-el7-x8664-1.trevis.hpdd.intel.com) (gcc version 4.8.5 20150623 (Red Hat 4.8.5-11) (GCC) ) #1 SMP Wed Nov 8 08:06:20 UTC 2017 [ 0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-3.10.0-693.5.2.el7_lustre.x86_64 root=UUID=4dfe900a-c2ad-4424-b141-9a27a9c3d15c ro crashkernel=320M console=tty0 LANG=en_US.UTF-8 console=ttyS0,115200 net.ifnames=0 [ 0.000000] e820: BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008efff] usable [ 0.000000] BIOS-e820: [mem 0x000000000008f000-0x000000000009ffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bb3c6fff] usable [ 0.000000] BIOS-e820: [mem 0x00000000bb3c7000-0x00000000bdd2efff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000bdd2f000-0x00000000bddccfff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x00000000bddcd000-0x00000000bdea0fff] ACPI data [ 0.000000] BIOS-e820: [mem 0x00000000bdea1000-0x00000000bdf2efff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x00000000bdf2f000-0x00000000bdfabfff] ACPI data [ 0.000000] BIOS-e820: [mem 0x00000000bdfac000-0x00000000bdffffff] usable [ 0.000000] BIOS-e820: [mem 0x00000000be000000-0x00000000cfffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fec00000-0x00000000fec00fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed19000-0x00000000fed19fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fee00000-0x00000000fee00fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ffa20000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000083fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 2.6 present. [ 0.000000] DMI: Intel Corporation SandyBridge Platform/To be filled by O.E.M., BIOS SE5C600.86B.01.08.0003.022620131521 02/26/2013 [ 0.000000] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved [ 0.000000] e820: remove [mem 0x000a0000-0x000fffff] usable [ 0.000000] e820: last_pfn = 0x840000 max_arch_pfn = 0x400000000 [ 0.000000] MTRR default type: uncachable [ 0.000000] MTRR fixed ranges enabled: [ 0.000000] 00000-9FFFF write-back [ 0.000000] A0000-BFFFF uncachable [ 0.000000] C0000-DBFFF write-through [ 0.000000] DC000-E7FFF uncachable [ 0.000000] E8000-FFFFF write-protect [ 0.000000] MTRR variable ranges enabled: [ 0.000000] 0 base 000000000000 mask 3FFF80000000 write-back [ 0.000000] 1 base 000080000000 mask 3FFFC0000000 write-back [ 0.000000] 2 base 000100000000 mask 3FFF00000000 write-back [ 0.000000] 3 base 000200000000 mask 3FFE00000000 write-back [ 0.000000] 4 base 000400000000 mask 3FFC00000000 write-back [ 0.000000] 5 base 000800000000 mask 3FFFC0000000 write-back [ 0.000000] 6 base 0000FF800000 mask 3FFFFF800000 write-protect [ 0.000000] 7 disabled [ 0.000000] 8 disabled [ 0.000000] 9 disabled [ 0.000000] x86 PAT enabled: cpu 0, old 0x7040600070406, new 0x7010600070106 [ 0.000000] e820: last_pfn = 0xbe000 max_arch_pfn = 0x400000000 [ 0.000000] found SMP MP-table at [mem 0x000fcd70-0x000fcd7f] mapped at [ffff8800000fcd70] [ 0.000000] Base memory trampoline at [ffff880000089000] 89000 size 24576 [ 0.000000] Using GB pages for direct mapping [ 0.000000] BRK [0x01fe9000, 0x01fe9fff] PGTABLE [ 0.000000] BRK [0x01fea000, 0x01feafff] PGTABLE [ 0.000000] BRK [0x01feb000, 0x01febfff] PGTABLE [ 0.000000] BRK [0x01fec000, 0x01fecfff] PGTABLE [ 0.000000] RAMDISK: [mem 0x34ac4000-0x36559fff] [ 0.000000] Early table checksum verification disabled [ 0.000000] ACPI: RSDP 00000000000f0410 00024 (v02 INTEL ) [ 0.000000] ACPI: XSDT 00000000bdfa9d98 000BC (v01 INTEL S2600GZ 06222004 INTL 20090903) [ 0.000000] ACPI: FACP 00000000bdfa9918 000F4 (v04 INTEL S2600GZ 06222004 INTL 20090903) [ 0.000000] ACPI BIOS Warning (bug): Invalid length for FADT/Pm1aControlBlock: 32, using default 16 (20130517/tbfadt-672) [ 0.000000] ACPI: DSDT 00000000bdf8f018 18762 (v02 INTEL S2600GZ 00000008 INTL 20100331) [ 0.000000] ACPI: FACS 00000000bdfa9f40 00040 [ 0.000000] ACPI: APIC 00000000bdfa8018 00BAA (v03 INTEL S2600GZ 06222004 INTL 20090903) [ 0.000000] ACPI: SPMI 00000000bdfabb18 00040 (v05 INTEL S2600GZ 06222004 INTL 20090903) [ 0.000000] ACPI: MCFG 00000000bdfaba98 0003C (v01 INTEL S2600GZ 06222004 INTL 20090903) [ 0.000000] ACPI: WDDT 00000000bdfabf18 00040 (v01 INTEL S2600GZ 06222004 INTL 20090903) [ 0.000000] ACPI: SRAT 00000000bdf8cc18 002A8 (v03 INTEL S2600GZ 06222004 INTL 20090903) [ 0.000000] ACPI: SLIT 00000000bdfabe98 00030 (v01 INTEL S2600GZ 06222004 INTL 20090903) [ 0.000000] ACPI: MSCT 00000000bdfaae18 00090 (v01 INTEL S2600GZ 06222004 INTL 20090903) [ 0.000000] ACPI: HPET 00000000bdfabe18 00038 (v01 INTEL S2600GZ 06222004 INTL 20090903) [ 0.000000] ACPI: SSDT 00000000bdfabd18 0002B (v02 INTEL S2600GZ 00001000 INTL 20100331) [ 0.000000] ACPI: SSDT 00000000bddcd018 D30C8 (v02 INTEL S2600GZ 00004000 INTL 20100331) [ 0.000000] ACPI: SPCR 00000000bdfabd98 00050 (v01 INTEL S2600GZ 06222004 INTL 20090903) [ 0.000000] ACPI: HEST 00000000bdf8ef18 000A8 (v01 INTEL S2600GZ 00000001 INTL 00000001) [ 0.000000] ACPI: BERT 00000000bdfabc18 00030 (v01 INTEL S2600GZ 00000001 INTL 00000001) [ 0.000000] ACPI: ERST 00000000bdf8ec98 00230 (v01 INTEL S2600GZ 00000001 INTL 00000001) [ 0.000000] ACPI: EINJ 00000000bdfa9798 00130 (v01 INTEL S2600GZ 00000001 INTL 00000001) [ 0.000000] ACPI: SSDT 00000000bdf8a018 01729 (v02 INTEL S2600GZ 00000002 INTL 20100331) [ 0.000000] ACPI: SSDT 00000000bdfabc98 00045 (v02 INTEL S2600GZ 00000001 INTL 20100331) [ 0.000000] ACPI: SSDT 00000000bdf8de18 00181 (v02 INTEL S2600GZ 00000003 INTL 20100331) [ 0.000000] ACPI: Local APIC address 0xfee00000 [ 0.000000] SRAT: PXM 0 -> APIC 0x00 -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x01 -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x02 -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x03 -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x04 -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x05 -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x06 -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x07 -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x08 -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x09 -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x0a -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x0b -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x0c -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x0d -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x0e -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x0f -> Node 0 [ 0.000000] SRAT: PXM 1 -> APIC 0x20 -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x21 -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x22 -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x23 -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x24 -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x25 -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x26 -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x27 -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x28 -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x29 -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x2a -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x2b -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x2c -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x2d -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x2e -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x2f -> Node 1 [ 0.000000] SRAT: Node 0 PXM 0 [mem 0x00000000-0xbfffffff] [ 0.000000] SRAT: Node 0 PXM 0 [mem 0x100000000-0x43fffffff] [ 0.000000] SRAT: Node 1 PXM 1 [mem 0x440000000-0x83fffffff] [ 0.000000] NUMA: Initialized distance table, cnt=2 [ 0.000000] NUMA: Node 0 [mem 0x00000000-0xbfffffff] + [mem 0x100000000-0x43fffffff] -> [mem 0x00000000-0x43fffffff] [ 0.000000] NODE_DATA(0) allocated [mem 0x43ffd9000-0x43fffffff] [ 0.000000] NODE_DATA(1) allocated [mem 0x83ffd6000-0x83fffcfff] [ 0.000000] Reserving 320MB of memory at 512MB for crashkernel (System RAM: 32691MB) [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x00001000-0x00ffffff] [ 0.000000] DMA32 [mem 0x01000000-0xffffffff] [ 0.000000] Normal [mem 0x100000000-0x83fffffff] [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x00001000-0x0008efff] [ 0.000000] node 0: [mem 0x00100000-0xbb3c6fff] [ 0.000000] node 0: [mem 0xbdfac000-0xbdffffff] [ 0.000000] node 0: [mem 0x100000000-0x43fffffff] [ 0.000000] node 1: [mem 0x440000000-0x83fffffff] [ 0.000000] Initmem setup node 0 [mem 0x00001000-0x43fffffff] [ 0.000000] On node 0 totalpages: 4174761 [ 0.000000] DMA zone: 64 pages used for memmap [ 0.000000] DMA zone: 21 pages reserved [ 0.000000] DMA zone: 3982 pages, LIFO batch:0 [ 0.000000] DMA32 zone: 11921 pages used for memmap [ 0.000000] DMA32 zone: 762907 pages, LIFO batch:31 [ 0.000000] Normal zone: 53248 pages used for memmap [ 0.000000] Normal zone: 3407872 pages, LIFO batch:31 [ 0.000000] Initmem setup node 1 [mem 0x440000000-0x83fffffff] [ 0.000000] On node 1 totalpages: 4194304 [ 0.000000] Normal zone: 65536 pages used for memmap [ 0.000000] Normal zone: 4194304 pages, LIFO batch:31 [ 0.000000] ACPI: PM-Timer IO Port: 0x408 [ 0.000000] ACPI: Local APIC address 0xfee00000 [ 0.000000] ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x01] lapic_id[0x02] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x02] lapic_id[0x04] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x03] lapic_id[0x06] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x04] lapic_id[0x08] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x05] lapic_id[0x0a] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x06] lapic_id[0x0c] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x07] lapic_id[0x0e] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x08] lapic_id[0x20] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x09] lapic_id[0x22] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x24] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x26] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x0c] lapic_id[0x28] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x0d] lapic_id[0x2a] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x0e] lapic_id[0x2c] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x0f] lapic_id[0x2e] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x10] lapic_id[0x01] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x11] lapic_id[0x03] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x12] lapic_id[0x05] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x13] lapic_id[0x07] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x14] lapic_id[0x09] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x15] lapic_id[0x0b] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x16] lapic_id[0x0d] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x17] lapic_id[0x0f] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x18] lapic_id[0x21] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x19] lapic_id[0x23] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x1a] lapic_id[0x25] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x1b] lapic_id[0x27] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x1c] lapic_id[0x29] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x1d] lapic_id[0x2b] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x1e] lapic_id[0x2d] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x1f] lapic_id[0x2f] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x20] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x21] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x22] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x23] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x24] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x25] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x26] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x27] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x28] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x29] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x2a] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x2b] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x2c] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x2d] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x2e] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x2f] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x30] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x31] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x32] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x33] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x34] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x35] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x36] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x37] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x38] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x39] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x3a] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x3b] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x3c] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x3d] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x3e] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x3f] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x40] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x41] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x42] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x43] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x44] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x45] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x46] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x47] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x48] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x49] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x4a] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x4b] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x4c] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x4d] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x4e] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x4f] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x50] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x51] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x52] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x53] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x54] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x55] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x56] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x57] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x58] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x59] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x5a] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x5b] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x5c] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x5d] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x5e] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x5f] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x60] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x61] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x62] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x63] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x64] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x65] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x66] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x67] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x68] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x69] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x6a] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x6b] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x6c] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x6d] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x6e] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x6f] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x70] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x71] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x72] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x73] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x74] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x75] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x76] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x77] lapic_id[0xff] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x00] uid[0x00] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x01] uid[0x01] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x02] uid[0x02] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x03] uid[0x03] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x04] uid[0x04] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x05] uid[0x05] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x06] uid[0x06] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x07] uid[0x07] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x08] uid[0x08] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x09] uid[0x09] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x0a] uid[0x0a] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x0b] uid[0x0b] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x0c] uid[0x0c] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x0d] uid[0x0d] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x0e] uid[0x0e] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x0f] uid[0x0f] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x10] uid[0x10] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x11] uid[0x11] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x12] uid[0x12] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x13] uid[0x13] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x14] uid[0x14] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x15] uid[0x15] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x16] uid[0x16] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x17] uid[0x17] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x18] uid[0x18] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x19] uid[0x19] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x1a] uid[0x1a] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x1b] uid[0x1b] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x1c] uid[0x1c] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x1d] uid[0x1d] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x1e] uid[0x1e] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x1f] uid[0x1f] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x20] uid[0x20] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x21] uid[0x21] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x22] uid[0x22] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x23] uid[0x23] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x24] uid[0x24] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x25] uid[0x25] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x26] uid[0x26] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x27] uid[0x27] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x28] uid[0x28] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x29] uid[0x29] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x2a] uid[0x2a] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x2b] uid[0x2b] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x2c] uid[0x2c] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x2d] uid[0x2d] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x2e] uid[0x2e] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x2f] uid[0x2f] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x30] uid[0x30] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x31] uid[0x31] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x32] uid[0x32] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x33] uid[0x33] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x34] uid[0x34] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x35] uid[0x35] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x36] uid[0x36] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x37] uid[0x37] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x38] uid[0x38] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x39] uid[0x39] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x3a] uid[0x3a] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x3b] uid[0x3b] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x3c] uid[0x3c] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x3d] uid[0x3d] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x3e] uid[0x3e] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x3f] uid[0x3f] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x40] uid[0x40] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x41] uid[0x41] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x42] uid[0x42] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x43] uid[0x43] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x44] uid[0x44] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x45] uid[0x45] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x46] uid[0x46] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x47] uid[0x47] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x48] uid[0x48] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x49] uid[0x49] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x4a] uid[0x4a] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x4b] uid[0x4b] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x4c] uid[0x4c] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x4d] uid[0x4d] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x4e] uid[0x4e] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x4f] uid[0x4f] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x50] uid[0x50] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x51] uid[0x51] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x52] uid[0x52] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x53] uid[0x53] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x54] uid[0x54] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x55] uid[0x55] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x56] uid[0x56] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x57] uid[0x57] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x58] uid[0x58] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x59] uid[0x59] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x5a] uid[0x5a] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x5b] uid[0x5b] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x5c] uid[0x5c] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x5d] uid[0x5d] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x5e] uid[0x5e] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x5f] uid[0x5f] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x60] uid[0x60] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x61] uid[0x61] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x62] uid[0x62] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x63] uid[0x63] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x64] uid[0x64] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x65] uid[0x65] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x66] uid[0x66] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x67] uid[0x67] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x68] uid[0x68] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x69] uid[0x69] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x6a] uid[0x6a] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x6b] uid[0x6b] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x6c] uid[0x6c] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x6d] uid[0x6d] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x6e] uid[0x6e] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x6f] uid[0x6f] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x70] uid[0x70] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x71] uid[0x71] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x72] uid[0x72] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x73] uid[0x73] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x74] uid[0x74] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x75] uid[0x75] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x76] uid[0x76] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x77] uid[0x77] disabled) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) [ 0.000000] ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0]) [ 0.000000] IOAPIC[0]: apic_id 0, version 32, address 0xfec00000, GSI 0-23 [ 0.000000] ACPI: IOAPIC (id[0x01] address[0xfec3f000] gsi_base[24]) [ 0.000000] IOAPIC[1]: apic_id 1, version 32, address 0xfec3f000, GSI 24-47 [ 0.000000] ACPI: IOAPIC (id[0x02] address[0xfec7f000] gsi_base[48]) [ 0.000000] IOAPIC[2]: apic_id 2, version 32, address 0xfec7f000, GSI 48-71 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.000000] ACPI: IRQ0 used by override. [ 0.000000] ACPI: IRQ9 used by override. [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.000000] smpboot: Allowing 240 CPUs, 208 hotplug CPUs [ 0.000000] PM: Registered nosave memory: [mem 0x0008f000-0x0009ffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000dffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.000000] PM: Registered nosave memory: [mem 0xbb3c7000-0xbdd2efff] [ 0.000000] PM: Registered nosave memory: [mem 0xbdd2f000-0xbddccfff] [ 0.000000] PM: Registered nosave memory: [mem 0xbddcd000-0xbdea0fff] [ 0.000000] PM: Registered nosave memory: [mem 0xbdea1000-0xbdf2efff] [ 0.000000] PM: Registered nosave memory: [mem 0xbdf2f000-0xbdfabfff] [ 0.000000] PM: Registered nosave memory: [mem 0xbe000000-0xcfffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xd0000000-0xfebfffff] [ 0.000000] PM: Registered nosave memory: [mem 0xfec00000-0xfec00fff] [ 0.000000] PM: Registered nosave memory: [mem 0xfec01000-0xfed18fff] [ 0.000000] PM: Registered nosave memory: [mem 0xfed19000-0xfed19fff] [ 0.000000] PM: Registered nosave memory: [mem 0xfed1a000-0xfed1bfff] [ 0.000000] PM: Registered nosave memory: [mem 0xfed1c000-0xfed1ffff] [ 0.000000] PM: Registered nosave memory: [mem 0xfed20000-0xfedfffff] [ 0.000000] PM: Registered nosave memory: [mem 0xfee00000-0xfee00fff] [ 0.000000] PM: Registered nosave memory: [mem 0xfee01000-0xffa1ffff] [ 0.000000] PM: Registered nosave memory: [mem 0xffa20000-0xffffffff] [ 0.000000] e820: [mem 0xd0000000-0xfebfffff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on bare hardware [ 0.000000] setup_percpu: NR_CPUS:5120 nr_cpumask_bits:240 nr_cpu_ids:240 nr_node_ids:2 [ 0.000000] PERCPU: Embedded 33 pages/cpu @ffff88042e000000 s97048 r8192 d29928 u262144 [ 0.000000] pcpu-alloc: s97048 r8192 d29928 u262144 alloc=1*2097152 [ 0.000000] pcpu-alloc: [0] 000 001 002 003 004 005 006 007 [ 0.000000] pcpu-alloc: [0] 016 017 018 019 020 021 022 023 [ 0.000000] pcpu-alloc: [0] 032 034 036 038 040 042 044 046 [ 0.000000] pcpu-alloc: [0] 048 050 052 054 056 058 060 062 [ 0.000000] pcpu-alloc: [0] 064 066 068 070 072 074 076 078 [ 0.000000] pcpu-alloc: [0] 080 082 084 086 088 090 092 094 [ 0.000000] pcpu-alloc: [0] 096 098 100 102 104 106 108 110 [ 0.000000] pcpu-alloc: [0] 112 114 116 118 120 122 124 126 [ 0.000000] pcpu-alloc: [0] 128 130 132 134 136 138 140 142 [ 0.000000] pcpu-alloc: [0] 144 146 148 150 152 154 156 158 [ 0.000000] pcpu-alloc: [0] 160 162 164 166 168 170 172 174 [ 0.000000] pcpu-alloc: [0] 176 178 180 182 184 186 188 190 [ 0.000000] pcpu-alloc: [0] 192 194 196 198 200 202 204 206 [ 0.000000] pcpu-alloc: [0] 208 210 212 214 216 218 220 222 [ 0.000000] pcpu-alloc: [0] 224 226 228 230 232 234 236 238 [ 0.000000] pcpu-alloc: [1] 008 009 010 011 012 013 014 015 [ 0.000000] pcpu-alloc: [1] 024 025 026 027 028 029 030 031 [ 0.000000] pcpu-alloc: [1] 033 035 037 039 041 043 045 047 [ 0.000000] pcpu-alloc: [1] 049 051 053 055 057 059 061 063 [ 0.000000] pcpu-alloc: [1] 065 067 069 071 073 075 077 079 [ 0.000000] pcpu-alloc: [1] 081 083 085 087 089 091 093 095 [ 0.000000] pcpu-alloc: [1] 097 099 101 103 105 107 109 111 [ 0.000000] pcpu-alloc: [1] 113 115 117 119 121 123 125 127 [ 0.000000] pcpu-alloc: [1] 129 131 133 135 137 139 141 143 [ 0.000000] pcpu-alloc: [1] 145 147 149 151 153 155 157 159 [ 0.000000] pcpu-alloc: [1] 161 163 165 167 169 171 173 175 [ 0.000000] pcpu-alloc: [1] 177 179 181 183 185 187 189 191 [ 0.000000] pcpu-alloc: [1] 193 195 197 199 201 203 205 207 [ 0.000000] pcpu-alloc: [1] 209 211 213 215 217 219 221 223 [ 0.000000] pcpu-alloc: [1] 225 227 229 231 233 235 237 239 [ 0.000000] Built 2 zonelists in Zone order, mobility grouping on. Total pages: 8238275 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-3.10.0-693.5.2.el7_lustre.x86_64 root=UUID=4dfe900a-c2ad-4424-b141-9a27a9c3d15c ro crashkernel=320M console=tty0 LANG=en_US.UTF-8 console=ttyS0,115200 net.ifnames=0 [ 0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes) [ 0.000000] x86/fpu: xstate_offset[2]: 0240, xstate_sizes[2]: 0100 [ 0.000000] xsave: enabled xstate_bv 0x7, cntxt size 0x340 using standard form [ 0.000000] Memory: 6824964k/34603008k available (6886k kernel code, 1126748k absent, 994040k reserved, 4545k data, 1764k init) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=240, Nodes=2 [ 0.000000] Hierarchical RCU implementation. [ 0.000000] RCU restricting CPUs from NR_CPUS=5120 to nr_cpu_ids=240. [ 0.000000] NR_IRQS:327936 nr_irqs:3160 0 [ 0.000000] Console: colour VGA+ 80x25 [ 0.000000] console [tty0] enabled [ 0.000000] console [ttyS0] enabled [ 0.000000] allocated 134217728 bytes of page_cgroup [ 0.000000] please try 'cgroup_disable=memory' option if you don't want memory cgroups [ 0.000000] Enabling automatic NUMA balancing. Configure with numa_balancing= or the kernel.numa_balancing sysctl [ 0.000000] hpet clockevent registered [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 2693.557 MHz processor [ 0.000101] Calibrating delay loop (skipped), value calculated using timer frequency.. 5387.11 BogoMIPS (lpj=2693557) [ 0.012524] pid_max: default: 245760 minimum: 1920 [ 0.018809] Security Framework initialized [ 0.023669] SELinux: Initializing. [ 0.027916] SELinux: Starting in permissive mode [ 0.027917] Yama: becoming mindful. [ 0.034577] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes) [ 0.049846] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes) [ 0.061311] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes) [ 0.069317] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes) [ 0.079775] Initializing cgroup subsys memory [ 0.084971] Initializing cgroup subsys devices [ 0.090216] Initializing cgroup subsys freezer [ 0.095461] Initializing cgroup subsys net_cls [ 0.100701] Initializing cgroup subsys blkio [ 0.105751] Initializing cgroup subsys perf_event [ 0.111325] Initializing cgroup subsys hugetlb [ 0.116571] Initializing cgroup subsys pids [ 0.121525] Initializing cgroup subsys net_prio [ 0.127023] CPU: Physical Processor ID: 0 [ 0.131780] CPU: Processor Core ID: 0 [ 0.136153] mce: CPU supports 20 MCE banks [ 0.141026] CPU0: Thermal monitoring enabled (TM1) [ 0.146694] Last level iTLB entries: 4KB 512, 2MB 0, 4MB 0 [ 0.153103] Last level dTLB entries: 4KB 512, 2MB 32, 4MB 32 [ 0.159707] tlb_flushall_shift: 6 [ 0.163837] Freeing SMP alternatives: 24k freed [ 0.171676] ACPI: Core revision 20130517 [ 0.213657] ACPI: All ACPI Tables successfully acquired [ 0.234316] ftrace: allocating 26589 entries in 104 pages [ 0.253388] smpboot: Max logical packages: 30 [ 0.259033] IRQ remapping doesn't support X2APIC mode, disable x2apic. [ 0.266684] Switched APIC routing to physical flat. [ 0.273024] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.290015] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2680 0 @ 2.70GHz (fam: 06, model: 2d, stepping: 07) [ 0.301139] TSC deadline timer enabled [ 0.301173] Performance Events: PEBS fmt1+, 16-deep LBR, SandyBridge events, full-width counters, Intel PMU driver. [ 0.313726] ... version: 3 [ 0.318479] ... bit width: 48 [ 0.323329] ... generic registers: 4 [ 0.328069] ... value mask: 0000ffffffffffff [ 0.334279] ... max period: 00007fffffffffff [ 0.340487] ... fixed-purpose events: 3 [ 0.345240] ... event mask: 000000070000000f [ 0.372244] NMI watchdog: enabled on all CPUs, permanently consumes one hw-PMU counter. [ 0.356352] smpboot: Booting Node 0, Processors #1 #2 #3 #4 #5 #6 #7 OK [ 0.414031] smpboot: Booting Node 1, Processors #8 #9 #10 #11 #12 #13 #14 #15 OK [ 0.541005] smpboot: Booting Node 0, Processors #16 #17 #18 #19 #20 #21 #22 #23 OK [ 0.575957] smpboot: Booting Node 1, Processors #24 #25 #26 #27 #28 #29 #30 #31 [ 0.616411] Brought up 32 CPUs [ 0.620568] smpboot: Total of 32 processors activated (172469.79 BogoMIPS) [ 0.743567] node 0 initialised, 2813971 pages in 62ms [ 0.760851] node 1 initialised, 3600339 pages in 74ms [ 0.768058] devtmpfs: initialized [ 0.781172] EVM: security.selinux [ 0.785155] EVM: security.ima [ 0.788756] EVM: security.capability [ 0.793317] PM: Registering ACPI NVS region [mem 0xbdd2f000-0xbddccfff] (647168 bytes) [ 0.802692] PM: Registering ACPI NVS region [mem 0xbdea1000-0xbdf2efff] (581632 bytes) [ 0.814529] atomic64 test passed for x86-64 platform with CX8 and with SSE [ 0.822513] pinctrl core: initialized pinctrl subsystem [ 0.828913] RTC time: 9:06:38, date: 11/15/17 [ 0.834677] NET: Registered protocol family 16 [ 0.840379] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 0.849337] ACPI: bus type PCI registered [ 0.854105] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.862214] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0xc0000000-0xcfffffff] (base 0xc0000000) [ 0.873118] PCI: MMCONFIG at [mem 0xc0000000-0xcfffffff] reserved in E820 [ 0.881034] PCI: Using configuration type 1 for base access [ 0.887605] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on [ 0.905903] ACPI: Added _OSI(Module Device) [ 0.910869] ACPI: Added _OSI(Processor Device) [ 0.916115] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.921660] ACPI: Added _OSI(Processor Aggregator Device) [ 0.945693] ACPI: EC: Look up EC in DSDT [ 0.963722] ACPI: Executed 1 blocks of module-level executable AML code [ 1.235470] [Firmware Bug]: ACPI: BIOS _OSI(Linux) query ignored [ 1.266180] ACPI: Interpreter enabled [ 1.270605] ACPI: (supports S0 S1 S5) [ 1.274984] ACPI: Using IOAPIC for interrupt routing [ 1.280923] HEST: Table parsing has been initialized. [ 1.286860] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 1.350423] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-7e]) [ 1.357634] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI] [ 1.367777] acpi PNP0A08:00: _OSC: platform does not support [AER] [ 1.375372] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.384435] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.394346] acpi PNP0A08:00: ignoring host bridge window [mem 0x000cc000-0x000cffff window] (conflicts with Adapter ROM [mem 0x000c8000-0x000cdbff]) [ 1.409722] acpi PNP0A08:00: ignoring host bridge window [mem 0x000d4000-0x000d7fff window] (conflicts with Adapter ROM [mem 0x000ce000-0x000d7bff]) [ 1.425471] PCI host bridge to bus 0000:00 [ 1.430338] pci_bus 0000:00: root bus resource [bus 00-7e] [ 1.436758] pci_bus 0000:00: root bus resource [io 0x0000-0xbfff window] [ 1.444639] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 1.453503] pci_bus 0000:00: root bus resource [mem 0x000c0000-0x000c3fff window] [ 1.462359] pci_bus 0000:00: root bus resource [mem 0x000c4000-0x000c7fff window] [ 1.471219] pci_bus 0000:00: root bus resource [mem 0x000c8000-0x000cbfff window] [ 1.480075] pci_bus 0000:00: root bus resource [mem 0x000d0000-0x000d3fff window] [ 1.488936] pci_bus 0000:00: root bus resource [mem 0x000d8000-0x000dbfff window] [ 1.497797] pci_bus 0000:00: root bus resource [mem 0x000dc000-0x000dffff window] [ 1.506656] pci_bus 0000:00: root bus resource [mem 0x000e0000-0x000e3fff window] [ 1.515520] pci_bus 0000:00: root bus resource [mem 0x000e4000-0x000e7fff window] [ 1.524379] pci_bus 0000:00: root bus resource [mem 0x000e8000-0x000ebfff window] [ 1.533238] pci_bus 0000:00: root bus resource [mem 0x000ec000-0x000effff window] [ 1.542096] pci_bus 0000:00: root bus resource [mem 0x000f0000-0x000fffff window] [ 1.550952] pci_bus 0000:00: root bus resource [mem 0xd0000000-0xebffffff window] [ 1.559810] pci_bus 0000:00: root bus resource [mem 0x380000000000-0x38007fffffff window] [ 1.569463] pci 0000:00:00.0: [8086:3c00] type 00 class 0x060000 [ 1.569560] pci 0000:00:00.0: PME# supported from D0 D3hot D3cold [ 1.569720] pci 0000:00:01.0: [8086:3c02] type 01 class 0x060400 [ 1.569822] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 1.569923] pci 0000:00:01.0: System wakeup disabled by ACPI [ 1.576613] pci 0000:00:01.1: [8086:3c03] type 01 class 0x060400 [ 1.576715] pci 0000:00:01.1: PME# supported from D0 D3hot D3cold [ 1.576813] pci 0000:00:01.1: System wakeup disabled by ACPI [ 1.583514] pci 0000:00:02.0: [8086:3c04] type 01 class 0x060400 [ 1.583615] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 1.583716] pci 0000:00:02.0: System wakeup disabled by ACPI [ 1.590400] pci 0000:00:02.2: [8086:3c06] type 01 class 0x060400 [ 1.590500] pci 0000:00:02.2: PME# supported from D0 D3hot D3cold [ 1.590598] pci 0000:00:02.2: System wakeup disabled by ACPI [ 1.597285] pci 0000:00:03.0: [8086:3c08] type 01 class 0x060400 [ 1.597386] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 1.597483] pci 0000:00:03.0: System wakeup disabled by ACPI [ 1.604156] pci 0000:00:04.0: [8086:3c20] type 00 class 0x088000 [ 1.604180] pci 0000:00:04.0: reg 0x10: [mem 0xebf90000-0xebf93fff 64bit] [ 1.604380] pci 0000:00:04.1: [8086:3c21] type 00 class 0x088000 [ 1.604402] pci 0000:00:04.1: reg 0x10: [mem 0xebf80000-0xebf83fff 64bit] [ 1.604599] pci 0000:00:04.2: [8086:3c22] type 00 class 0x088000 [ 1.604621] pci 0000:00:04.2: reg 0x10: [mem 0xebf70000-0xebf73fff 64bit] [ 1.604823] pci 0000:00:04.3: [8086:3c23] type 00 class 0x088000 [ 1.604845] pci 0000:00:04.3: reg 0x10: [mem 0xebf60000-0xebf63fff 64bit] [ 1.605054] pci 0000:00:04.4: [8086:3c24] type 00 class 0x088000 [ 1.605076] pci 0000:00:04.4: reg 0x10: [mem 0xebf50000-0xebf53fff 64bit] [ 1.605280] pci 0000:00:04.5: [8086:3c25] type 00 class 0x088000 [ 1.605302] pci 0000:00:04.5: reg 0x10: [mem 0xebf40000-0xebf43fff 64bit] [ 1.605493] pci 0000:00:04.6: [8086:3c26] type 00 class 0x088000 [ 1.605515] pci 0000:00:04.6: reg 0x10: [mem 0xebf30000-0xebf33fff 64bit] [ 1.605711] pci 0000:00:04.7: [8086:3c27] type 00 class 0x088000 [ 1.605733] pci 0000:00:04.7: reg 0x10: [mem 0xebf20000-0xebf23fff 64bit] [ 1.605931] pci 0000:00:05.0: [8086:3c28] type 00 class 0x088000 [ 1.606122] pci 0000:00:05.2: [8086:3c2a] type 00 class 0x088000 [ 1.606307] pci 0000:00:05.4: [8086:3c2c] type 00 class 0x080020 [ 1.606325] pci 0000:00:05.4: reg 0x10: [mem 0xd0f60000-0xd0f60fff] [ 1.606528] pci 0000:00:11.0: [8086:1d3e] type 01 class 0x060400 [ 1.606648] pci 0000:00:11.0: PME# supported from D0 D3hot D3cold [ 1.606799] pci 0000:00:16.0: [8086:1d3a] type 00 class 0x078000 [ 1.606825] pci 0000:00:16.0: reg 0x10: [mem 0xd0f50000-0xd0f5000f 64bit] [ 1.606912] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 1.607053] pci 0000:00:16.1: [8086:1d3b] type 00 class 0x078000 [ 1.607079] pci 0000:00:16.1: reg 0x10: [mem 0xd0f40000-0xd0f4000f 64bit] [ 1.607170] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 1.607311] pci 0000:00:1a.0: [8086:1d2d] type 00 class 0x0c0320 [ 1.607335] pci 0000:00:1a.0: reg 0x10: [mem 0xd0f20000-0xd0f203ff] [ 1.607446] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 1.607553] pci 0000:00:1a.0: System wakeup disabled by ACPI [ 1.614221] pci 0000:00:1c.0: [8086:1d10] type 01 class 0x060400 [ 1.614356] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 1.614449] pci 0000:00:1c.0: System wakeup disabled by ACPI [ 1.621123] pci 0000:00:1c.7: [8086:1d1e] type 01 class 0x060400 [ 1.621226] pci 0000:00:1c.7: PME# supported from D0 D3hot D3cold [ 1.621316] pci 0000:00:1c.7: System wakeup disabled by ACPI [ 1.627989] pci 0000:00:1d.0: [8086:1d26] type 00 class 0x0c0320 [ 1.628013] pci 0000:00:1d.0: reg 0x10: [mem 0xd0f10000-0xd0f103ff] [ 1.628125] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 1.628235] pci 0000:00:1d.0: System wakeup disabled by ACPI [ 1.634906] pci 0000:00:1e.0: [8086:244e] type 01 class 0x060401 [ 1.635049] pci 0000:00:1e.0: System wakeup disabled by ACPI [ 1.641713] pci 0000:00:1f.0: [8086:1d41] type 00 class 0x060100 [ 1.641966] pci 0000:00:1f.2: [8086:1d02] type 00 class 0x010601 [ 1.641989] pci 0000:00:1f.2: reg 0x10: [io 0x4070-0x4077] [ 1.642001] pci 0000:00:1f.2: reg 0x14: [io 0x4060-0x4063] [ 1.642012] pci 0000:00:1f.2: reg 0x18: [io 0x4050-0x4057] [ 1.642024] pci 0000:00:1f.2: reg 0x1c: [io 0x4040-0x4043] [ 1.642035] pci 0000:00:1f.2: reg 0x20: [io 0x4020-0x403f] [ 1.642047] pci 0000:00:1f.2: reg 0x24: [mem 0xd0f00000-0xd0f007ff] [ 1.642107] pci 0000:00:1f.2: PME# supported from D3hot [ 1.642234] pci 0000:00:1f.3: [8086:1d22] type 00 class 0x0c0500 [ 1.642256] pci 0000:00:1f.3: reg 0x10: [mem 0xebf10000-0xebf100ff 64bit] [ 1.642284] pci 0000:00:1f.3: reg 0x20: [io 0x4000-0x401f] [ 1.642502] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.648488] acpiphp: Slot [2] registered [ 1.653216] pci 0000:02:00.0: [8086:1521] type 00 class 0x020000 [ 1.653235] pci 0000:02:00.0: reg 0x10: [mem 0xd0b60000-0xd0b7ffff] [ 1.653254] pci 0000:02:00.0: reg 0x18: [io 0x3060-0x307f] [ 1.653265] pci 0000:02:00.0: reg 0x1c: [mem 0xd0bb0000-0xd0bb3fff] [ 1.653383] pci 0000:02:00.0: PME# supported from D0 D3hot D3cold [ 1.653417] pci 0000:02:00.0: reg 0x184: [mem 0xd0ca0000-0xd0ca3fff] [ 1.653421] pci 0000:02:00.0: VF(n) BAR0 space: [mem 0xd0ca0000-0xd0cbffff] (contains BAR0 for 8 VFs) [ 1.664245] pci 0000:02:00.0: reg 0x190: [mem 0xd0c80000-0xd0c83fff] [ 1.664249] pci 0000:02:00.0: VF(n) BAR3 space: [mem 0xd0c80000-0xd0c9ffff] (contains BAR3 for 8 VFs) [ 1.675203] pci 0000:02:00.1: [8086:1521] type 00 class 0x020000 [ 1.675221] pci 0000:02:00.1: reg 0x10: [mem 0xd0b40000-0xd0b5ffff] [ 1.675240] pci 0000:02:00.1: reg 0x18: [io 0x3040-0x305f] [ 1.675251] pci 0000:02:00.1: reg 0x1c: [mem 0xd0ba0000-0xd0ba3fff] [ 1.675362] pci 0000:02:00.1: PME# supported from D0 D3hot D3cold [ 1.675389] pci 0000:02:00.1: reg 0x184: [mem 0xd0c60000-0xd0c63fff] [ 1.675393] pci 0000:02:00.1: VF(n) BAR0 space: [mem 0xd0c60000-0xd0c7ffff] (contains BAR0 for 8 VFs) [ 1.686215] pci 0000:02:00.1: reg 0x190: [mem 0xd0c40000-0xd0c43fff] [ 1.686219] pci 0000:02:00.1: VF(n) BAR3 space: [mem 0xd0c40000-0xd0c5ffff] (contains BAR3 for 8 VFs) [ 1.697170] pci 0000:02:00.2: [8086:1521] type 00 class 0x020000 [ 1.697188] pci 0000:02:00.2: reg 0x10: [mem 0xd0b20000-0xd0b3ffff] [ 1.697207] pci 0000:02:00.2: reg 0x18: [io 0x3020-0x303f] [ 1.697218] pci 0000:02:00.2: reg 0x1c: [mem 0xd0b90000-0xd0b93fff] [ 1.697328] pci 0000:02:00.2: PME# supported from D0 D3hot D3cold [ 1.697355] pci 0000:02:00.2: reg 0x184: [mem 0xd0c20000-0xd0c23fff] [ 1.697358] pci 0000:02:00.2: VF(n) BAR0 space: [mem 0xd0c20000-0xd0c3ffff] (contains BAR0 for 8 VFs) [ 1.708187] pci 0000:02:00.2: reg 0x190: [mem 0xd0c00000-0xd0c03fff] [ 1.708191] pci 0000:02:00.2: VF(n) BAR3 space: [mem 0xd0c00000-0xd0c1ffff] (contains BAR3 for 8 VFs) [ 1.719142] pci 0000:02:00.3: [8086:1521] type 00 class 0x020000 [ 1.719162] pci 0000:02:00.3: reg 0x10: [mem 0xd0b00000-0xd0b1ffff] [ 1.719181] pci 0000:02:00.3: reg 0x18: [io 0x3000-0x301f] [ 1.719192] pci 0000:02:00.3: reg 0x1c: [mem 0xd0b80000-0xd0b83fff] [ 1.719301] pci 0000:02:00.3: PME# supported from D0 D3hot D3cold [ 1.719329] pci 0000:02:00.3: reg 0x184: [mem 0xd0be0000-0xd0be3fff] [ 1.719332] pci 0000:02:00.3: VF(n) BAR0 space: [mem 0xd0be0000-0xd0bfffff] (contains BAR0 for 8 VFs) [ 1.730158] pci 0000:02:00.3: reg 0x190: [mem 0xd0bc0000-0xd0bc3fff] [ 1.730162] pci 0000:02:00.3: VF(n) BAR3 space: [mem 0xd0bc0000-0xd0bdffff] (contains BAR3 for 8 VFs) [ 1.742990] pci 0000:00:01.1: PCI bridge to [bus 02-03] [ 1.749124] pci 0000:00:01.1: bridge window [io 0x3000-0x3fff] [ 1.749130] pci 0000:00:01.1: bridge window [mem 0xd0b00000-0xd0cfffff] [ 1.749290] acpiphp: Slot [2-2] registered [ 1.754388] pci 0000:04:00.0: [15b3:1003] type 00 class 0x028000 [ 1.754666] pci 0000:04:00.0: reg 0x10: [mem 0xd0e00000-0xd0efffff 64bit] [ 1.754868] pci 0000:04:00.0: reg 0x18: [mem 0xeb000000-0xeb7fffff 64bit pref] [ 1.756627] pci 0000:00:02.0: PCI bridge to [bus 04] [ 1.762461] pci 0000:00:02.0: bridge window [mem 0xd0e00000-0xd0efffff] [ 1.762469] pci 0000:00:02.0: bridge window [mem 0xeb000000-0xeb7fffff 64bit pref] [ 1.762614] acpiphp: Slot [2-3] registered [ 1.767519] pci 0000:00:02.2: PCI bridge to [bus 05] [ 1.773496] acpiphp: Slot [2-4] registered [ 1.778411] pci 0000:06:00.0: [1000:0087] type 00 class 0x010700 [ 1.778427] pci 0000:06:00.0: reg 0x10: [io 0x2000-0x20ff] [ 1.778441] pci 0000:06:00.0: reg 0x14: [mem 0xd0a40000-0xd0a4ffff 64bit] [ 1.778455] pci 0000:06:00.0: reg 0x1c: [mem 0xd0a00000-0xd0a3ffff 64bit] [ 1.778471] pci 0000:06:00.0: reg 0x30: [mem 0xd0900000-0xd09fffff pref] [ 1.778549] pci 0000:06:00.0: supports D1 D2 [ 1.780380] pci 0000:00:03.0: PCI bridge to [bus 06] [ 1.786226] pci 0000:00:03.0: bridge window [io 0x2000-0x2fff] [ 1.786232] pci 0000:00:03.0: bridge window [mem 0xd0900000-0xd0afffff] [ 1.786339] pci 0000:07:00.0: [8086:1d6b] type 00 class 0x010700 [ 1.786368] pci 0000:07:00.0: reg 0x10: [mem 0xebc00000-0xebc03fff 64bit pref] [ 1.786389] pci 0000:07:00.0: reg 0x18: [mem 0xeb800000-0xebbfffff 64bit pref] [ 1.786403] pci 0000:07:00.0: reg 0x20: [io 0x1000-0x10ff] [ 1.786540] pci 0000:07:00.0: reg 0x164: [mem 0xebc10000-0xebc13fff 64bit pref] [ 1.786544] pci 0000:07:00.0: VF(n) BAR0 space: [mem 0xebc10000-0xebc8bfff 64bit pref] (contains BAR0 for 31 VFs) [ 1.798728] pci 0000:07:00.3: [8086:1d70] type 00 class 0x0c0500 [ 1.798752] pci 0000:07:00.3: reg 0x10: [mem 0xd0d00000-0xd0d00fff] [ 1.798803] pci 0000:07:00.3: reg 0x20: [io 0x1100-0x111f] [ 1.798901] pci 0000:07:00.3: PME# supported from D0 D3hot D3cold [ 1.799003] pci 0000:00:11.0: PCI bridge to [bus 07] [ 1.804847] pci 0000:00:11.0: bridge window [io 0x1000-0x1fff] [ 1.804853] pci 0000:00:11.0: bridge window [mem 0xd0d00000-0xd0dfffff] [ 1.804863] pci 0000:00:11.0: bridge window [mem 0xeb800000-0xebcfffff 64bit pref] [ 1.804963] pci 0000:00:1c.0: PCI bridge to [bus 08] [ 1.810909] pci 0000:09:00.0: [102b:0522] type 00 class 0x030000 [ 1.810943] pci 0000:09:00.0: reg 0x10: [mem 0xea000000-0xeaffffff pref] [ 1.810964] pci 0000:09:00.0: reg 0x14: [mem 0xd0810000-0xd0813fff] [ 1.810985] pci 0000:09:00.0: reg 0x18: [mem 0xd0000000-0xd07fffff] [ 1.811058] pci 0000:09:00.0: reg 0x30: [mem 0xd0800000-0xd080ffff pref] [ 1.811202] pci 0000:09:00.0: System wakeup disabled by ACPI [ 1.819841] pci 0000:00:1c.7: PCI bridge to [bus 09] [ 1.825688] pci 0000:00:1c.7: bridge window [mem 0xd0000000-0xd08fffff] [ 1.825697] pci 0000:00:1c.7: bridge window [mem 0xea000000-0xeaffffff 64bit pref] [ 1.825801] pci 0000:00:1e.0: PCI bridge to [bus 0a] (subtractive decode) [ 1.833693] pci 0000:00:1e.0: bridge window [io 0x0000-0xbfff window] (subtractive decode) [ 1.833697] pci 0000:00:1e.0: bridge window [mem 0x000a0000-0x000bffff window] (subtractive decode) [ 1.833701] pci 0000:00:1e.0: bridge window [mem 0x000c0000-0x000c3fff window] (subtractive decode) [ 1.833704] pci 0000:00:1e.0: bridge window [mem 0x000c4000-0x000c7fff window] (subtractive decode) [ 1.833707] pci 0000:00:1e.0: bridge window [mem 0x000c8000-0x000cbfff window] (subtractive decode) [ 1.833711] pci 0000:00:1e.0: bridge window [mem 0x000d0000-0x000d3fff window] (subtractive decode) [ 1.833714] pci 0000:00:1e.0: bridge window [mem 0x000d8000-0x000dbfff window] (subtractive decode) [ 1.833717] pci 0000:00:1e.0: bridge window [mem 0x000dc000-0x000dffff window] (subtractive decode) [ 1.833720] pci 0000:00:1e.0: bridge window [mem 0x000e0000-0x000e3fff window] (subtractive decode) [ 1.833724] pci 0000:00:1e.0: bridge window [mem 0x000e4000-0x000e7fff window] (subtractive decode) [ 1.833727] pci 0000:00:1e.0: bridge window [mem 0x000e8000-0x000ebfff window] (subtractive decode) [ 1.833735] pci 0000:00:1e.0: bridge window [mem 0x000ec000-0x000effff window] (subtractive decode) [ 1.833738] pci 0000:00:1e.0: bridge window [mem 0x000f0000-0x000fffff window] (subtractive decode) [ 1.833742] pci 0000:00:1e.0: bridge window [mem 0xd0000000-0xebffffff window] (subtractive decode) [ 1.833745] pci 0000:00:1e.0: bridge window [mem 0x380000000000-0x38007fffffff window] (subtractive decode) [ 1.833825] pci_bus 0000:00: on NUMA node 0 [ 1.835011] ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 10 *11 12 14 15) [ 1.844020] ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 *10 11 12 14 15) [ 1.853006] ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 *5 6 10 11 12 14 15) [ 1.862009] ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 10 *11 12 14 15) [ 1.870999] ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 *5 6 10 11 12 14 15) [ 1.880001] ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 10 *11 12 14 15) [ 1.888987] ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 *10 11 12 14 15) [ 1.897968] ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 *10 11 12 14 15) [ 1.907134] ACPI: PCI Root Bridge [PCI1] (domain 0000 [bus 80-fe]) [ 1.914340] acpi PNP0A08:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI] [ 1.924240] acpi PNP0A08:01: _OSC: platform does not support [AER] [ 1.931668] acpi PNP0A08:01: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.940721] acpi PNP0A08:01: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.950749] PCI host bridge to bus 0000:80 [ 1.955621] pci_bus 0000:80: root bus resource [bus 80-fe] [ 1.962039] pci_bus 0000:80: root bus resource [io 0x03b0-0x03df window] [ 1.969918] pci_bus 0000:80: root bus resource [io 0xc000-0xffff window] [ 1.977799] pci_bus 0000:80: root bus resource [mem 0x000a0000-0x000bffff window] [ 1.986661] pci_bus 0000:80: root bus resource [mem 0xec000000-0xfbffffff window] [ 1.995525] pci_bus 0000:80: root bus resource [mem 0x380080000000-0x3800ffffffff window] [ 2.005181] pci 0000:80:01.0: [8086:3c02] type 01 class 0x060400 [ 2.005293] pci 0000:80:01.0: PME# supported from D0 D3hot D3cold [ 2.005367] pci 0000:80:01.0: System wakeup disabled by ACPI [ 2.012054] pci 0000:80:02.0: [8086:3c04] type 01 class 0x060400 [ 2.012163] pci 0000:80:02.0: PME# supported from D0 D3hot D3cold [ 2.012227] pci 0000:80:02.0: System wakeup disabled by ACPI [ 2.018897] pci 0000:80:03.0: [8086:3c08] type 01 class 0x060400 [ 2.019003] pci 0000:80:03.0: PME# supported from D0 D3hot D3cold [ 2.019078] pci 0000:80:03.0: System wakeup disabled by ACPI [ 2.025749] pci 0000:80:03.2: [8086:3c0a] type 01 class 0x060400 [ 2.025854] pci 0000:80:03.2: PME# supported from D0 D3hot D3cold [ 2.025916] pci 0000:80:03.2: System wakeup disabled by ACPI [ 2.032579] pci 0000:80:04.0: [8086:3c20] type 00 class 0x088000 [ 2.032603] pci 0000:80:04.0: reg 0x10: [mem 0xfbf70000-0xfbf73fff 64bit] [ 2.032774] pci 0000:80:04.1: [8086:3c21] type 00 class 0x088000 [ 2.032797] pci 0000:80:04.1: reg 0x10: [mem 0xfbf60000-0xfbf63fff 64bit] [ 2.032967] pci 0000:80:04.2: [8086:3c22] type 00 class 0x088000 [ 2.032990] pci 0000:80:04.2: reg 0x10: [mem 0xfbf50000-0xfbf53fff 64bit] [ 2.033156] pci 0000:80:04.3: [8086:3c23] type 00 class 0x088000 [ 2.033180] pci 0000:80:04.3: reg 0x10: [mem 0xfbf40000-0xfbf43fff 64bit] [ 2.033348] pci 0000:80:04.4: [8086:3c24] type 00 class 0x088000 [ 2.033371] pci 0000:80:04.4: reg 0x10: [mem 0xfbf30000-0xfbf33fff 64bit] [ 2.033542] pci 0000:80:04.5: [8086:3c25] type 00 class 0x088000 [ 2.033564] pci 0000:80:04.5: reg 0x10: [mem 0xfbf20000-0xfbf23fff 64bit] [ 2.033735] pci 0000:80:04.6: [8086:3c26] type 00 class 0x088000 [ 2.033758] pci 0000:80:04.6: reg 0x10: [mem 0xfbf10000-0xfbf13fff 64bit] [ 2.033921] pci 0000:80:04.7: [8086:3c27] type 00 class 0x088000 [ 2.033943] pci 0000:80:04.7: reg 0x10: [mem 0xfbf00000-0xfbf03fff 64bit] [ 2.034123] pci 0000:80:05.0: [8086:3c28] type 00 class 0x088000 [ 2.034282] pci 0000:80:05.2: [8086:3c2a] type 00 class 0x088000 [ 2.034438] pci 0000:80:05.4: [8086:3c2c] type 00 class 0x080020 [ 2.034456] pci 0000:80:05.4: reg 0x10: [mem 0xec000000-0xec000fff] [ 2.034705] pci 0000:80:01.0: PCI bridge to [bus 81] [ 2.040633] pci 0000:80:02.0: PCI bridge to [bus 82] [ 2.046548] pci 0000:80:03.0: PCI bridge to [bus 83] [ 2.052460] pci 0000:80:03.2: PCI bridge to [bus 84] [ 2.058344] pci_bus 0000:80: on NUMA node 1 [ 2.068292] ACPI: PCI Root Bridge [UCR0] (domain 0000 [bus 7f]) [ 2.075209] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI] [ 2.084908] acpi PNP0A03:00: _OSC: platform does not support [PCIeHotplug PME AER] [ 2.093918] acpi PNP0A03:00: _OSC: OS now controls [PCIeCapability] [ 2.101233] acpi PNP0A03:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 2.110977] PCI host bridge to bus 0000:7f [ 2.115846] pci_bus 0000:7f: root bus resource [bus 7f] [ 2.121988] pci 0000:7f:08.0: [8086:3c80] type 00 class 0x088000 [ 2.122103] pci 0000:7f:09.0: [8086:3c90] type 00 class 0x088000 [ 2.122194] pci 0000:7f:0a.0: [8086:3cc0] type 00 class 0x088000 [ 2.122274] pci 0000:7f:0a.1: [8086:3cc1] type 00 class 0x088000 [ 2.122355] pci 0000:7f:0a.2: [8086:3cc2] type 00 class 0x088000 [ 2.122432] pci 0000:7f:0a.3: [8086:3cd0] type 00 class 0x088000 [ 2.122519] pci 0000:7f:0b.0: [8086:3ce0] type 00 class 0x088000 [ 2.122603] pci 0000:7f:0b.3: [8086:3ce3] type 00 class 0x088000 [ 2.122685] pci 0000:7f:0c.0: [8086:3ce8] type 00 class 0x088000 [ 2.122764] pci 0000:7f:0c.1: [8086:3ce8] type 00 class 0x088000 [ 2.122851] pci 0000:7f:0c.2: [8086:3ce8] type 00 class 0x088000 [ 2.122931] pci 0000:7f:0c.3: [8086:3ce8] type 00 class 0x088000 [ 2.123018] pci 0000:7f:0c.6: [8086:3cf4] type 00 class 0x088000 [ 2.123097] pci 0000:7f:0c.7: [8086:3cf6] type 00 class 0x088000 [ 2.123174] pci 0000:7f:0d.0: [8086:3ce8] type 00 class 0x088000 [ 2.123253] pci 0000:7f:0d.1: [8086:3ce8] type 00 class 0x088000 [ 2.123332] pci 0000:7f:0d.2: [8086:3ce8] type 00 class 0x088000 [ 2.123411] pci 0000:7f:0d.3: [8086:3ce8] type 00 class 0x088000 [ 2.123495] pci 0000:7f:0d.6: [8086:3cf5] type 00 class 0x088000 [ 2.123576] pci 0000:7f:0e.0: [8086:3ca0] type 00 class 0x088000 [ 2.123660] pci 0000:7f:0e.1: [8086:3c46] type 00 class 0x110100 [ 2.123753] pci 0000:7f:0f.0: [8086:3ca8] type 00 class 0x088000 [ 2.123854] pci 0000:7f:0f.1: [8086:3c71] type 00 class 0x088000 [ 2.123962] pci 0000:7f:0f.2: [8086:3caa] type 00 class 0x088000 [ 2.124068] pci 0000:7f:0f.3: [8086:3cab] type 00 class 0x088000 [ 2.124170] pci 0000:7f:0f.4: [8086:3cac] type 00 class 0x088000 [ 2.124270] pci 0000:7f:0f.5: [8086:3cad] type 00 class 0x088000 [ 2.124365] pci 0000:7f:0f.6: [8086:3cae] type 00 class 0x088000 [ 2.124456] pci 0000:7f:10.0: [8086:3cb0] type 00 class 0x088000 [ 2.124559] pci 0000:7f:10.1: [8086:3cb1] type 00 class 0x088000 [ 2.124667] pci 0000:7f:10.2: [8086:3cb2] type 00 class 0x088000 [ 2.124771] pci 0000:7f:10.3: [8086:3cb3] type 00 class 0x088000 [ 2.124872] pci 0000:7f:10.4: [8086:3cb4] type 00 class 0x088000 [ 2.124983] pci 0000:7f:10.5: [8086:3cb5] type 00 class 0x088000 [ 2.125086] pci 0000:7f:10.6: [8086:3cb6] type 00 class 0x088000 [ 2.125182] pci 0000:7f:10.7: [8086:3cb7] type 00 class 0x088000 [ 2.125281] pci 0000:7f:11.0: [8086:3cb8] type 00 class 0x088000 [ 2.125376] pci 0000:7f:13.0: [8086:3ce4] type 00 class 0x088000 [ 2.125458] pci 0000:7f:13.1: [8086:3c43] type 00 class 0x110100 [ 2.125546] pci 0000:7f:13.4: [8086:3ce6] type 00 class 0x110100 [ 2.125628] pci 0000:7f:13.5: [8086:3c44] type 00 class 0x110100 [ 2.125708] pci 0000:7f:13.6: [8086:3c45] type 00 class 0x088000 [ 2.125892] ACPI: PCI Root Bridge [UCR1] (domain 0000 [bus ff]) [ 2.132803] acpi PNP0A03:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI] [ 2.142492] acpi PNP0A03:01: _OSC: platform does not support [PCIeHotplug PME AER] [ 2.151497] acpi PNP0A03:01: _OSC: OS now controls [PCIeCapability] [ 2.158794] acpi PNP0A03:01: FADT indicates ASPM is unsupported, using BIOS configuration [ 2.173262] PCI host bridge to bus 0000:ff [ 2.178127] pci_bus 0000:ff: root bus resource [bus ff] [ 2.184272] pci 0000:ff:08.0: [8086:3c80] type 00 class 0x088000 [ 2.184381] pci 0000:ff:09.0: [8086:3c90] type 00 class 0x088000 [ 2.184480] pci 0000:ff:0a.0: [8086:3cc0] type 00 class 0x088000 [ 2.184563] pci 0000:ff:0a.1: [8086:3cc1] type 00 class 0x088000 [ 2.184646] pci 0000:ff:0a.2: [8086:3cc2] type 00 class 0x088000 [ 2.184733] pci 0000:ff:0a.3: [8086:3cd0] type 00 class 0x088000 [ 2.184818] pci 0000:ff:0b.0: [8086:3ce0] type 00 class 0x088000 [ 2.184900] pci 0000:ff:0b.3: [8086:3ce3] type 00 class 0x088000 [ 2.184992] pci 0000:ff:0c.0: [8086:3ce8] type 00 class 0x088000 [ 2.185068] pci 0000:ff:0c.1: [8086:3ce8] type 00 class 0x088000 [ 2.185148] pci 0000:ff:0c.2: [8086:3ce8] type 00 class 0x088000 [ 2.185228] pci 0000:ff:0c.3: [8086:3ce8] type 00 class 0x088000 [ 2.185320] pci 0000:ff:0c.6: [8086:3cf4] type 00 class 0x088000 [ 2.185406] pci 0000:ff:0c.7: [8086:3cf6] type 00 class 0x088000 [ 2.185494] pci 0000:ff:0d.0: [8086:3ce8] type 00 class 0x088000 [ 2.185577] pci 0000:ff:0d.1: [8086:3ce8] type 00 class 0x088000 [ 2.185665] pci 0000:ff:0d.2: [8086:3ce8] type 00 class 0x088000 [ 2.185748] pci 0000:ff:0d.3: [8086:3ce8] type 00 class 0x088000 [ 2.185836] pci 0000:ff:0d.6: [8086:3cf5] type 00 class 0x088000 [ 2.185921] pci 0000:ff:0e.0: [8086:3ca0] type 00 class 0x088000 [ 2.186010] pci 0000:ff:0e.1: [8086:3c46] type 00 class 0x110100 [ 2.186111] pci 0000:ff:0f.0: [8086:3ca8] type 00 class 0x088000 [ 2.186218] pci 0000:ff:0f.1: [8086:3c71] type 00 class 0x088000 [ 2.186331] pci 0000:ff:0f.2: [8086:3caa] type 00 class 0x088000 [ 2.186438] pci 0000:ff:0f.3: [8086:3cab] type 00 class 0x088000 [ 2.186544] pci 0000:ff:0f.4: [8086:3cac] type 00 class 0x088000 [ 2.186655] pci 0000:ff:0f.5: [8086:3cad] type 00 class 0x088000 [ 2.186753] pci 0000:ff:0f.6: [8086:3cae] type 00 class 0x088000 [ 2.186847] pci 0000:ff:10.0: [8086:3cb0] type 00 class 0x088000 [ 2.186958] pci 0000:ff:10.1: [8086:3cb1] type 00 class 0x088000 [ 2.187065] pci 0000:ff:10.2: [8086:3cb2] type 00 class 0x088000 [ 2.187176] pci 0000:ff:10.3: [8086:3cb3] type 00 class 0x088000 [ 2.187287] pci 0000:ff:10.4: [8086:3cb4] type 00 class 0x088000 [ 2.187394] pci 0000:ff:10.5: [8086:3cb5] type 00 class 0x088000 [ 2.187500] pci 0000:ff:10.6: [8086:3cb6] type 00 class 0x088000 [ 2.187606] pci 0000:ff:10.7: [8086:3cb7] type 00 class 0x088000 [ 2.187712] pci 0000:ff:11.0: [8086:3cb8] type 00 class 0x088000 [ 2.187813] pci 0000:ff:13.0: [8086:3ce4] type 00 class 0x088000 [ 2.187895] pci 0000:ff:13.1: [8086:3c43] type 00 class 0x110100 [ 2.187981] pci 0000:ff:13.4: [8086:3ce6] type 00 class 0x110100 [ 2.188063] pci 0000:ff:13.5: [8086:3c44] type 00 class 0x110100 [ 2.188145] pci 0000:ff:13.6: [8086:3c45] type 00 class 0x088000 [ 2.188478] ACPI: Enabled 6 GPEs in block 00 to 3F [ 2.194456] vgaarb: device added: PCI:0000:09:00.0,decodes=io+mem,owns=io+mem,locks=none [ 2.204021] vgaarb: loaded [ 2.207330] vgaarb: bridge control possible 0000:09:00.0 [ 2.213778] SCSI subsystem initialized [ 2.218319] ACPI: bus type USB registered [ 2.223111] usbcore: registered new interface driver usbfs [ 2.229553] usbcore: registered new interface driver hub [ 2.236071] usbcore: registered new device driver usb [ 2.242544] PCI: Using ACPI for IRQ routing [ 2.254100] PCI: pci_cache_line_size set to 64 bytes [ 2.254459] e820: reserve RAM buffer [mem 0x0008f000-0x0008ffff] [ 2.254463] e820: reserve RAM buffer [mem 0xbb3c7000-0xbbffffff] [ 2.254465] e820: reserve RAM buffer [mem 0xbe000000-0xbfffffff] [ 2.254864] NetLabel: Initializing [ 2.258952] NetLabel: domain hash size = 128 [ 2.264107] NetLabel: protocols = UNLABELED CIPSOv4 [ 2.269965] NetLabel: unlabeled traffic allowed by default [ 2.276554] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 2.284538] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 2.293396] amd_nb: Cannot enumerate AMD northbridges [ 2.299516] Switched to clocksource hpet [ 2.318353] pnp: PnP ACPI init [ 2.322081] ACPI: bus type PNP registered [ 2.327095] system 00:00: [io 0x0680-0x069f] has been reserved [ 2.334010] system 00:00: [io 0xffff] has been reserved [ 2.340239] system 00:00: [io 0xffff] has been reserved [ 2.346468] system 00:00: [io 0xffff] has been reserved [ 2.352701] system 00:00: [io 0x0400-0x0453] could not be reserved [ 2.359997] system 00:00: [io 0x0458-0x047f] has been reserved [ 2.366927] system 00:00: [io 0x0500-0x057f] has been reserved [ 2.373826] system 00:00: [io 0x0600-0x061f] has been reserved [ 2.380734] system 00:00: [io 0x0ca2-0x0ca5] has been reserved [ 2.387642] system 00:00: [io 0x0cf9] could not be reserved [ 2.394266] system 00:00: Plug and Play ACPI device, IDs PNP0c02 (active) [ 2.394333] pnp 00:01: Plug and Play ACPI device, IDs PNP0b00 (active) [ 2.394463] system 00:02: [io 0x0454-0x0457] has been reserved [ 2.401379] system 00:02: Plug and Play ACPI device, IDs INT3f0d PNP0c02 (active) [ 2.401765] pnp 00:03: [dma 0 disabled] [ 2.401869] pnp 00:03: Plug and Play ACPI device, IDs PNP0501 (active) [ 2.402127] pnp 00:04: [dma 0 disabled] [ 2.402229] pnp 00:04: Plug and Play ACPI device, IDs PNP0501 (active) [ 2.402793] system 00:05: [mem 0xfed1c000-0xfed1ffff] has been reserved [ 2.410495] system 00:05: [mem 0xebfff000-0xebffffff] has been reserved [ 2.418183] system 00:05: [mem 0xc0000000-0xcfffffff] has been reserved [ 2.425862] system 00:05: [mem 0xfed20000-0xfed3ffff] has been reserved [ 2.433543] system 00:05: [mem 0xfed45000-0xfed8ffff] has been reserved [ 2.441230] system 00:05: [mem 0xff000000-0xffffffff] could not be reserved [ 2.449295] system 00:05: [mem 0xfee00000-0xfeefffff] could not be reserved [ 2.457372] system 00:05: [mem 0xfec00000-0xfecfffff] could not be reserved [ 2.465452] system 00:05: [mem 0xd0f70000-0xd0f70fff] has been reserved [ 2.473139] system 00:05: Plug and Play ACPI device, IDs PNP0c02 (active) [ 2.473627] system 00:06: [mem 0x00000000-0x0009cfff] could not be reserved [ 2.481713] system 00:06: Plug and Play ACPI device, IDs PNP0c01 (active) [ 2.482213] pnp: PnP ACPI: found 7 devices [ 2.487085] ACPI: bus type PNP unregistered [ 2.500531] pci 0000:00:01.0: PCI bridge to [bus 01] [ 2.506386] pci 0000:00:01.1: PCI bridge to [bus 02-03] [ 2.512512] pci 0000:00:01.1: bridge window [io 0x3000-0x3fff] [ 2.519618] pci 0000:00:01.1: bridge window [mem 0xd0b00000-0xd0cfffff] [ 2.527506] pci 0000:00:02.0: PCI bridge to [bus 04] [ 2.533351] pci 0000:00:02.0: bridge window [mem 0xd0e00000-0xd0efffff] [ 2.541224] pci 0000:00:02.0: bridge window [mem 0xeb000000-0xeb7fffff 64bit pref] [ 2.550379] pci 0000:00:02.2: PCI bridge to [bus 05] [ 2.556220] pci 0000:00:03.0: PCI bridge to [bus 06] [ 2.562058] pci 0000:00:03.0: bridge window [io 0x2000-0x2fff] [ 2.569162] pci 0000:00:03.0: bridge window [mem 0xd0900000-0xd0afffff] [ 2.577052] pci 0000:00:11.0: PCI bridge to [bus 07] [ 2.582891] pci 0000:00:11.0: bridge window [io 0x1000-0x1fff] [ 2.589997] pci 0000:00:11.0: bridge window [mem 0xd0d00000-0xd0dfffff] [ 2.597873] pci 0000:00:11.0: bridge window [mem 0xeb800000-0xebcfffff 64bit pref] [ 2.607031] pci 0000:00:1c.0: PCI bridge to [bus 08] [ 2.612888] pci 0000:00:1c.7: PCI bridge to [bus 09] [ 2.618731] pci 0000:00:1c.7: bridge window [mem 0xd0000000-0xd08fffff] [ 2.626613] pci 0000:00:1c.7: bridge window [mem 0xea000000-0xeaffffff 64bit pref] [ 2.635776] pci 0000:00:1e.0: PCI bridge to [bus 0a] [ 2.641627] pci_bus 0000:00: resource 4 [io 0x0000-0xbfff window] [ 2.641631] pci_bus 0000:00: resource 5 [mem 0x000a0000-0x000bffff window] [ 2.641634] pci_bus 0000:00: resource 6 [mem 0x000c0000-0x000c3fff window] [ 2.641637] pci_bus 0000:00: resource 7 [mem 0x000c4000-0x000c7fff window] [ 2.641640] pci_bus 0000:00: resource 8 [mem 0x000c8000-0x000cbfff window] [ 2.641644] pci_bus 0000:00: resource 9 [mem 0x000d0000-0x000d3fff window] [ 2.641647] pci_bus 0000:00: resource 10 [mem 0x000d8000-0x000dbfff window] [ 2.641650] pci_bus 0000:00: resource 11 [mem 0x000dc000-0x000dffff window] [ 2.641654] pci_bus 0000:00: resource 12 [mem 0x000e0000-0x000e3fff window] [ 2.641657] pci_bus 0000:00: resource 13 [mem 0x000e4000-0x000e7fff window] [ 2.641660] pci_bus 0000:00: resource 14 [mem 0x000e8000-0x000ebfff window] [ 2.641663] pci_bus 0000:00: resource 15 [mem 0x000ec000-0x000effff window] [ 2.641667] pci_bus 0000:00: resource 16 [mem 0x000f0000-0x000fffff window] [ 2.641670] pci_bus 0000:00: resource 17 [mem 0xd0000000-0xebffffff window] [ 2.641674] pci_bus 0000:00: resource 18 [mem 0x380000000000-0x38007fffffff window] [ 2.641677] pci_bus 0000:02: resource 0 [io 0x3000-0x3fff] [ 2.641681] pci_bus 0000:02: resource 1 [mem 0xd0b00000-0xd0cfffff] [ 2.641684] pci_bus 0000:04: resource 1 [mem 0xd0e00000-0xd0efffff] [ 2.641688] pci_bus 0000:04: resource 2 [mem 0xeb000000-0xeb7fffff 64bit pref] [ 2.641691] pci_bus 0000:06: resource 0 [io 0x2000-0x2fff] [ 2.641694] pci_bus 0000:06: resource 1 [mem 0xd0900000-0xd0afffff] [ 2.641698] pci_bus 0000:07: resource 0 [io 0x1000-0x1fff] [ 2.641701] pci_bus 0000:07: resource 1 [mem 0xd0d00000-0xd0dfffff] [ 2.641704] pci_bus 0000:07: resource 2 [mem 0xeb800000-0xebcfffff 64bit pref] [ 2.641708] pci_bus 0000:09: resource 1 [mem 0xd0000000-0xd08fffff] [ 2.641711] pci_bus 0000:09: resource 2 [mem 0xea000000-0xeaffffff 64bit pref] [ 2.641715] pci_bus 0000:0a: resource 4 [io 0x0000-0xbfff window] [ 2.641718] pci_bus 0000:0a: resource 5 [mem 0x000a0000-0x000bffff window] [ 2.641721] pci_bus 0000:0a: resource 6 [mem 0x000c0000-0x000c3fff window] [ 2.641725] pci_bus 0000:0a: resource 7 [mem 0x000c4000-0x000c7fff window] [ 2.641728] pci_bus 0000:0a: resource 8 [mem 0x000c8000-0x000cbfff window] [ 2.641731] pci_bus 0000:0a: resource 9 [mem 0x000d0000-0x000d3fff window] [ 2.641735] pci_bus 0000:0a: resource 10 [mem 0x000d8000-0x000dbfff window] [ 2.641738] pci_bus 0000:0a: resource 11 [mem 0x000dc000-0x000dffff window] [ 2.641741] pci_bus 0000:0a: resource 12 [mem 0x000e0000-0x000e3fff window] [ 2.641744] pci_bus 0000:0a: resource 13 [mem 0x000e4000-0x000e7fff window] [ 2.641748] pci_bus 0000:0a: resource 14 [mem 0x000e8000-0x000ebfff window] [ 2.641751] pci_bus 0000:0a: resource 15 [mem 0x000ec000-0x000effff window] [ 2.641754] pci_bus 0000:0a: resource 16 [mem 0x000f0000-0x000fffff window] [ 2.641758] pci_bus 0000:0a: resource 17 [mem 0xd0000000-0xebffffff window] [ 2.641761] pci_bus 0000:0a: resource 18 [mem 0x380000000000-0x38007fffffff window] [ 2.641800] pci 0000:80:01.0: PCI bridge to [bus 81] [ 2.647649] pci 0000:80:02.0: PCI bridge to [bus 82] [ 2.653501] pci 0000:80:03.0: PCI bridge to [bus 83] [ 2.659349] pci 0000:80:03.2: PCI bridge to [bus 84] [ 2.665202] pci_bus 0000:80: resource 4 [io 0x03b0-0x03df window] [ 2.665206] pci_bus 0000:80: resource 5 [io 0xc000-0xffff window] [ 2.665209] pci_bus 0000:80: resource 6 [mem 0x000a0000-0x000bffff window] [ 2.665212] pci_bus 0000:80: resource 7 [mem 0xec000000-0xfbffffff window] [ 2.665216] pci_bus 0000:80: resource 8 [mem 0x380080000000-0x3800ffffffff window] [ 2.665562] NET: Registered protocol family 2 [ 2.672970] TCP established hash table entries: 262144 (order: 9, 2097152 bytes) [ 2.682626] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes) [ 2.690662] TCP: Hash tables configured (established 262144 bind 65536) [ 2.698429] TCP: reno registered [ 2.702495] UDP hash table entries: 16384 (order: 7, 524288 bytes) [ 2.709954] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes) [ 2.718977] NET: Registered protocol family 1 [ 3.824476] pci 0000:00:1a.0: EHCI: BIOS handoff failed (BIOS bug?) 01010001 [ 4.932456] pci 0000:00:1d.0: EHCI: BIOS handoff failed (BIOS bug?) 01010001 [ 4.940920] PCI: CLS mismatch (64 != 32), using 64 bytes [ 4.940945] pci 0000:09:00.0: Boot video device [ 4.941243] Unpacking initramfs... [ 5.790459] Freeing initrd memory: 27224k freed [ 5.806437] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 5.813938] software IO TLB [mem 0xb73c7000-0xbb3c7000] (64MB) mapped at [ffff8800b73c7000-ffff8800bb3c6fff] [ 5.825887] RAPL PMU: API unit is 2^-32 Joules, 3 fixed counters, 163840 ms ovfl timer [ 5.835251] RAPL PMU: hw unit of domain pp0-core 2^-16 Joules [ 5.841969] RAPL PMU: hw unit of domain package 2^-16 Joules [ 5.848578] RAPL PMU: hw unit of domain dram 2^-16 Joules [ 5.866835] sha1_ssse3: Using AVX optimized SHA-1 implementation [ 5.873968] sha256_ssse3: Using AVX optimized SHA-256 implementation [ 5.886437] futex hash table entries: 65536 (order: 10, 4194304 bytes) [ 5.894981] Initialise system trusted keyring [ 5.900326] audit: initializing netlink socket (disabled) [ 5.906714] type=2000 audit(1510736799.513:1): initialized [ 5.963675] HugeTLB registered 1 GB page size, pre-allocated 0 pages [ 5.971081] HugeTLB registered 2 MB page size, pre-allocated 0 pages [ 5.980613] zpool: loaded [ 5.983844] zbud: loaded [ 5.987899] VFS: Disk quotas dquot_6.6.0 [ 5.993092] Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 6.002000] msgmni has been set to 32768 [ 6.007073] Key type big_key registered [ 6.011677] SELinux: Registering netfilter hooks [ 6.014184] NET: Registered protocol family 38 [ 6.019462] Key type asymmetric registered [ 6.024353] Asymmetric key parser 'x509' registered [ 6.030269] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 250) [ 6.039315] io scheduler noop registered [ 6.044013] io scheduler deadline registered (default) [ 6.050308] io scheduler cfq registered [ 6.055851] pcieport 0000:00:01.0: irq 25 for MSI/MSI-X [ 6.056223] pcieport 0000:00:01.1: irq 26 for MSI/MSI-X [ 6.056594] pcieport 0000:00:02.0: irq 27 for MSI/MSI-X [ 6.056956] pcieport 0000:00:02.2: irq 28 for MSI/MSI-X [ 6.057413] pcieport 0000:00:03.0: irq 29 for MSI/MSI-X [ 6.057778] pcieport 0000:00:11.0: irq 30 for MSI/MSI-X [ 6.058136] pcieport 0000:00:1c.0: irq 31 for MSI/MSI-X [ 6.058601] pcieport 0000:00:1c.7: irq 32 for MSI/MSI-X [ 6.059072] pcieport 0000:80:01.0: irq 34 for MSI/MSI-X [ 6.059304] pcieport 0000:80:02.0: irq 35 for MSI/MSI-X [ 6.059525] pcieport 0000:80:03.0: irq 36 for MSI/MSI-X [ 6.059774] pcieport 0000:80:03.2: irq 37 for MSI/MSI-X [ 6.059934] pcieport 0000:00:01.0: Signaling PME through PCIe PME interrupt [ 6.068031] pcie_pme 0000:00:01.0:pcie01: service driver pcie_pme loaded [ 6.068074] pcieport 0000:00:01.1: Signaling PME through PCIe PME interrupt [ 6.076174] pci 0000:02:00.0: Signaling PME through PCIe PME interrupt [ 6.083761] pci 0000:02:00.1: Signaling PME through PCIe PME interrupt [ 6.091371] pci 0000:02:00.2: Signaling PME through PCIe PME interrupt [ 6.098984] pci 0000:02:00.3: Signaling PME through PCIe PME interrupt [ 6.106593] pcie_pme 0000:00:01.1:pcie01: service driver pcie_pme loaded [ 6.106628] pcieport 0000:00:02.0: Signaling PME through PCIe PME interrupt [ 6.114724] pci 0000:04:00.0: Signaling PME through PCIe PME interrupt [ 6.122338] pcie_pme 0000:00:02.0:pcie01: service driver pcie_pme loaded [ 6.122391] pcieport 0000:00:02.2: Signaling PME through PCIe PME interrupt [ 6.130478] pcie_pme 0000:00:02.2:pcie01: service driver pcie_pme loaded [ 6.130504] pcieport 0000:00:03.0: Signaling PME through PCIe PME interrupt [ 6.138611] pci 0000:06:00.0: Signaling PME through PCIe PME interrupt [ 6.146218] pcie_pme 0000:00:03.0:pcie01: service driver pcie_pme loaded [ 6.146248] pcieport 0000:00:11.0: Signaling PME through PCIe PME interrupt [ 6.154345] pci 0000:07:00.0: Signaling PME through PCIe PME interrupt [ 6.161937] pci 0000:07:00.3: Signaling PME through PCIe PME interrupt [ 6.169545] pcie_pme 0000:00:11.0:pcie01: service driver pcie_pme loaded [ 6.169582] pcieport 0000:00:1c.0: Signaling PME through PCIe PME interrupt [ 6.177676] pcie_pme 0000:00:1c.0:pcie01: service driver pcie_pme loaded [ 6.177702] pcieport 0000:00:1c.7: Signaling PME through PCIe PME interrupt [ 6.185801] pci 0000:09:00.0: Signaling PME through PCIe PME interrupt [ 6.193401] pcie_pme 0000:00:1c.7:pcie01: service driver pcie_pme loaded [ 6.193442] pcieport 0000:80:01.0: Signaling PME through PCIe PME interrupt [ 6.201541] pcie_pme 0000:80:01.0:pcie01: service driver pcie_pme loaded [ 6.201582] pcieport 0000:80:02.0: Signaling PME through PCIe PME interrupt [ 6.209678] pcie_pme 0000:80:02.0:pcie01: service driver pcie_pme loaded [ 6.209708] pcieport 0000:80:03.0: Signaling PME through PCIe PME interrupt [ 6.217806] pcie_pme 0000:80:03.0:pcie01: service driver pcie_pme loaded [ 6.217835] pcieport 0000:80:03.2: Signaling PME through PCIe PME interrupt [ 6.225923] pcie_pme 0000:80:03.2:pcie01: service driver pcie_pme loaded [ 6.226020] pci_hotplug: PCI Hot Plug PCI Core version: 0.5 [ 6.232595] pciehp: PCI Express Hot Plug Controller Driver version: 0.4 [ 6.240459] intel_idle: MWAIT substates: 0x21120 [ 6.240461] intel_idle: v0.4.1 model 0x2D [ 6.240730] intel_idle: lapic_timer_reliable_states 0xffffffff [ 6.240859] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 [ 6.249648] ACPI: Power Button [PWRF] [ 6.254072] ACPI: Requesting acpi_cpufreq [ 6.295039] ERST: Error Record Serialization Table (ERST) support is initialized. [ 6.303925] pstore: Registered erst as persistent store backend [ 6.311013] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 6.319886] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 6.347931] 00:03: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A [ 6.375165] 00:04: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A [ 6.382138] Non-volatile memory driver v1.3 [ 6.387147] Linux agpgart interface v0.103 [ 6.392208] crash memory driver: version 1.1 [ 6.397465] rdac: device handler registered [ 6.402481] hp_sw: device handler registered [ 6.407552] emc: device handler registered [ 6.412428] alua: device handler registered [ 6.417422] libphy: Fixed MDIO Bus: probed [ 6.422323] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver [ 6.429931] ehci-pci: EHCI PCI platform driver [ 6.435433] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 6.441625] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1 [ 6.450409] ehci-pci 0000:00:1a.0: debug port 2 [ 6.459688] ehci-pci 0000:00:1a.0: cache line size of 64 is not supported [ 6.459715] ehci-pci 0000:00:1a.0: irq 22, io mem 0xd0f20000 [ 6.471430] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 6.478199] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002 [ 6.486068] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 6.494638] usb usb1: Product: EHCI Host Controller [ 6.500387] usb usb1: Manufacturer: Linux 3.10.0-693.5.2.el7_lustre.x86_64 ehci_hcd [ 6.509442] usb usb1: SerialNumber: 0000:00:1a.0 [ 6.514993] hub 1-0:1.0: USB hub found [ 6.519483] hub 1-0:1.0: 2 ports detected [ 6.524534] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 6.530724] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2 [ 6.544113] ehci-pci 0000:00:1d.0: debug port 2 [ 6.553364] ehci-pci 0000:00:1d.0: cache line size of 64 is not supported [ 6.553382] ehci-pci 0000:00:1d.0: irq 20, io mem 0xd0f10000 [ 6.565434] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 6.572198] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002 [ 6.580080] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 6.588649] usb usb2: Product: EHCI Host Controller [ 6.594390] usb usb2: Manufacturer: Linux 3.10.0-693.5.2.el7_lustre.x86_64 ehci_hcd [ 6.603443] usb usb2: SerialNumber: 0000:00:1d.0 [ 6.608969] hub 2-0:1.0: USB hub found [ 6.613447] hub 2-0:1.0: 2 ports detected [ 6.618309] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver [ 6.625521] ohci-pci: OHCI PCI platform driver [ 6.630796] uhci_hcd: USB Universal Host Controller Interface driver [ 6.638264] usbcore: registered new interface driver usbserial [ 6.645094] usbcore: registered new interface driver usbserial_generic [ 6.652698] usbserial: USB Serial support registered for generic [ 6.659745] i8042: PNP: No PS/2 controller found. Probing ports directly. [ 6.825424] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 6.864449] tsc: Refined TSC clocksource calibration: 2693.509 MHz [ 7.706703] i8042: No controller found [ 7.711196] usb 2-1: new high-speed USB device number 2 using ehci-pci [ 7.711228] Switched to clocksource tsc [ 7.711274] mousedev: PS/2 mouse device common for all mice [ 7.711553] rtc_cmos 00:01: RTC can wake from S4 [ 7.711764] rtc_cmos 00:01: rtc core: registered rtc_cmos as rtc0 [ 7.711812] rtc_cmos 00:01: alarms up to one month, y3k, 242 bytes nvram, hpet irqs [ 7.711862] Intel P-state driver initializing. [ 7.720693] cpuidle: using governor menu [ 7.721651] hidraw: raw HID events driver (C) Jiri Kosina [ 7.721816] usbcore: registered new interface driver usbhid [ 7.721817] usbhid: USB HID core driver [ 7.721948] drop_monitor: Initializing network drop monitor service [ 7.722619] TCP: cubic registered [ 7.722631] Initializing XFRM netlink socket [ 7.723278] NET: Registered protocol family 10 [ 7.724918] NET: Registered protocol family 17 [ 7.729879] microcode: CPU0 sig=0x206d7, pf=0x1, revision=0x710 [ 7.729892] microcode: CPU1 sig=0x206d7, pf=0x1, revision=0x710 [ 7.729902] microcode: CPU2 sig=0x206d7, pf=0x1, revision=0x710 [ 7.729913] microcode: CPU3 sig=0x206d7, pf=0x1, revision=0x710 [ 7.729924] microcode: CPU4 sig=0x206d7, pf=0x1, revision=0x710 [ 7.729944] microcode: CPU5 sig=0x206d7, pf=0x1, revision=0x710 [ 7.729951] microcode: CPU6 sig=0x206d7, pf=0x1, revision=0x710 [ 7.729958] microcode: CPU7 sig=0x206d7, pf=0x1, revision=0x710 [ 7.729970] microcode: CPU8 sig=0x206d7, pf=0x1, revision=0x710 [ 7.729979] microcode: CPU9 sig=0x206d7, pf=0x1, revision=0x710 [ 7.729989] microcode: CPU10 sig=0x206d7, pf=0x1, revision=0x710 [ 7.729998] microcode: CPU11 sig=0x206d7, pf=0x1, revision=0x710 [ 7.730008] microcode: CPU12 sig=0x206d7, pf=0x1, revision=0x710 [ 7.730017] microcode: CPU13 sig=0x206d7, pf=0x1, revision=0x710 [ 7.730026] microcode: CPU14 sig=0x206d7, pf=0x1, revision=0x710 [ 7.730035] microcode: CPU15 sig=0x206d7, pf=0x1, revision=0x710 [ 7.730042] microcode: CPU16 sig=0x206d7, pf=0x1, revision=0x710 [ 7.730049] microcode: CPU17 sig=0x206d7, pf=0x1, revision=0x710 [ 7.730055] microcode: CPU18 sig=0x206d7, pf=0x1, revision=0x710 [ 7.730061] microcode: CPU19 sig=0x206d7, pf=0x1, revision=0x710 [ 7.730072] microcode: CPU20 sig=0x206d7, pf=0x1, revision=0x710 [ 7.730079] microcode: CPU21 sig=0x206d7, pf=0x1, revision=0x710 [ 7.730085] microcode: CPU22 sig=0x206d7, pf=0x1, revision=0x710 [ 7.730092] microcode: CPU23 sig=0x206d7, pf=0x1, revision=0x710 [ 7.730102] microcode: CPU24 sig=0x206d7, pf=0x1, revision=0x710 [ 7.730110] microcode: CPU25 sig=0x206d7, pf=0x1, revision=0x710 [ 7.730118] microcode: CPU26 sig=0x206d7, pf=0x1, revision=0x710 [ 7.730126] microcode: CPU27 sig=0x206d7, pf=0x1, revision=0x710 [ 7.730133] microcode: CPU28 sig=0x206d7, pf=0x1, revision=0x710 [ 7.730141] microcode: CPU29 sig=0x206d7, pf=0x1, revision=0x710 [ 7.730148] microcode: CPU30 sig=0x206d7, pf=0x1, revision=0x710 [ 7.730155] microcode: CPU31 sig=0x206d7, pf=0x1, revision=0x710 [ 7.730205] microcode: Microcode Update Driver: v2.01 , Peter Oruba [ 7.730381] PM: Hibernation image not present or could not be loaded. [ 7.730385] Loading compiled-in X.509 certificates [ 7.730431] Loaded X.509 cert 'CentOS Linux kpatch signing key: ea0413152cde1d98ebdca3fe6f0230904c9ef717' [ 7.730451] Loaded X.509 cert 'CentOS Linux Driver update signing key: 7f421ee0ab69461574bb358861dbe77762a4201b' [ 7.731501] Loaded X.509 cert 'CentOS Linux kernel signing key: b47a4e68522da148dcade840321620b487b1ebac' [ 7.731532] registered taskstats version 1 [ 7.735635] Key type trusted registered [ 7.739297] Key type encrypted registered [ 7.743119] IMA: No TPM chip found, activating TPM-bypass! [ 7.744620] Magic number: 9:176:121 [ 7.744778] pci 0000:7f:0f.2: hash matches [ 7.751471] rtc_cmos 00:01: setting system clock to 2017-11-15 09:06:45 UTC (1510736805) [ 7.824879] usb 1-1: New USB device found, idVendor=8087, idProduct=0024 [ 7.824882] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 7.825165] hub 1-1:1.0: USB hub found [ 7.825238] hub 1-1:1.0: 6 ports detected [ 7.876907] usb 2-1: New USB device found, idVendor=8087, idProduct=0024 [ 7.876910] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 7.877159] hub 2-1:1.0: USB hub found [ 7.877228] hub 2-1:1.0: 8 ports detected [ 8.152452] usb 2-1.4: new full-speed USB device number 3 using ehci-pci [ 8.178085] Freeing unused kernel memory: 1764k freed [ 8.190394] random: systemd: uninitialized urandom read (16 bytes read) [ 8.201047] random: systemd: uninitialized urandom read (16 bytes read) [ 8.208795] random: systemd: uninitialized urandom read (16 bytes read) [ 8.219013] systemd[1]: systemd 219 running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ -LZ4 -SECCOMP +BLKID +ELFUTILS +KMOD +IDN) [ 8.240743] systemd[1]: Detected architecture x86-64. [ 8.246700] systemd[1]: Running in initial RAM disk. [ 8.254224] usb 2-1.4: New USB device found, idVendor=046b, idProduct=ff10 [ 8.262321] usb 2-1.4: New USB device strings: Mfr=1, Product=2, SerialNumber=3 [ 8.272520] usb 2-1.4: Product: Virtual Keyboard and Mouse [ 8.280481] usb 2-1.4: Manufacturer: American Megatrends Inc. [ 8.288749] usb 2-1.4: SerialNumber: serial [ 8.296503] systemd[1]: Set hostname to . [ 8.296699] input: American Megatrends Inc. Virtual Keyboard and Mouse as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.4/2-1.4:1.0/input/input1 [ 8.347735] hid-generic 0003:046B:FF10.0001: input,hidraw0: USB HID v1.10 Keyboard [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:1d.0-1.4/input0 [ 8.366421] input: American Megatrends Inc. Virtual Keyboard and Mouse as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.4/2-1.4:1.1/input/input2 [ 8.371734] random: systemd: uninitialized urandom read (16 bytes read) [ 8.371777] random: systemd: uninitialized urandom read (16 bytes read) [ 8.371845] random: systemd: uninitialized urandom read (16 bytes read) [ 8.371972] random: systemd: uninitialized urandom read (16 bytes read) [ 8.373211] random: systemd: uninitialized urandom read (16 bytes read) [ 8.373537] random: systemd: uninitialized urandom read (16 bytes read) [ 8.373916] random: systemd: uninitialized urandom read (16 bytes read) [ 8.404885] hid-generic 0003:046B:FF10.0002: input,hidraw1: USB HID v1.10 Mouse [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:1d.0-1.4/input1 [ 8.457570] systemd[1]: Reached target Swap. [ 8.462689] systemd[1]: Starting Swap. [ 8.474516] systemd[1]: Reached target Local File Systems. [ 8.481012] systemd[1]: Starting Local File Systems. [ 8.491499] systemd[1]: Reached target Timers. [ 8.496795] systemd[1]: Starting Timers. [ 8.506495] systemd[1]: Created slice Root Slice. [ 8.512069] systemd[1]: Starting Root Slice. [ 8.523518] systemd[1]: Listening on udev Kernel Socket. [ 8.529769] systemd[1]: Starting udev Kernel Socket. [ 8.542534] systemd[1]: Listening on Journal Socket. [ 8.548418] systemd[1]: Starting Journal Socket. [ 8.559460] systemd[1]: Created slice System Slice. [ 8.565237] systemd[1]: Starting System Slice. [ 8.571356] systemd[1]: Starting Create list of required static device nodes for the current kernel... [ 8.593210] systemd[1]: Starting Setup Virtual Console... [ 8.606347] systemd[1]: Starting Load Kernel Modules... [ 8.630510] systemd[1]: Reached target Slices. [ 8.635793] systemd[1]: Starting Slices. [ 8.641424] systemd[1]: Starting dracut cmdline hook... [ 8.653176] systemd[1]: Starting Journal Service... [ 8.670464] systemd[1]: Listening on udev Control Socket. [ 8.676813] systemd[1]: Starting udev Control Socket. [ 8.687455] systemd[1]: Reached target Sockets. [ 8.692824] systemd[1]: Starting Sockets. [ 8.707457] systemd[1]: Started Create list of required static device nodes for the current kernel. [ 8.726472] systemd[1]: Started Setup Virtual Console. [ 8.738469] systemd[1]: Started Load Kernel Modules. [ 8.750460] systemd[1]: Started Journal Service. [ 8.933298] mlx_compat: loading out-of-tree module taints kernel. [ 8.941973] mlx_compat: module verification failed: signature and/or required key missing - tainting kernel [ 8.955086] Compat-mlnx-ofed backport release: f36c870 [ 8.961134] Backport based on mlnx_ofed/mlnx-ofa_kernel-4.0.git f36c870 [ 8.968821] compat.git: mlnx_ofed/mlnx-ofa_kernel-4.0.git [ 8.977973] mlx4_core: Mellanox ConnectX core driver v4.2-1.0.0 [ 8.985437] mlx4_core: Initializing 0000:04:00.0 [ 8.994398] libata version 3.00 loaded. [ 8.995529] [drm] Initialized [ 8.995952] dca service started, version 1.12.1 [ 8.997958] pps_core: LinuxPPS API ver. 1 registered [ 8.997959] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 9.028222] PTP clock support registered [ 9.028270] ahci 0000:00:1f.2: version 3.0 [ 9.028572] ahci 0000:00:1f.2: irq 39 for MSI/MSI-X [ 9.035008] mpt2sas version 20.103.00.00 loaded [ 9.035084] mpt2sas 0000:06:00.0: can't disable ASPM; OS doesn't have ASPM control [ 9.035287] mpt2sas_cm0: 64 BIT PCI BUS DMA ADDRESSING SUPPORTED, total mem (32511232 kB) [ 9.039451] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 9.039453] ahci 0000:00:1f.2: flags: 64bit ncq sntf pm led clo pio slum part ems apst [ 9.049935] scsi host1: ahci [ 9.050066] scsi host2: ahci [ 9.050139] scsi host3: ahci [ 9.050217] scsi host4: ahci [ 9.050290] scsi host5: ahci [ 9.050361] scsi host6: ahci [ 9.050401] ata1: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00100 irq 39 [ 9.050403] ata2: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00180 irq 39 [ 9.050405] ata3: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00200 irq 39 [ 9.050408] ata4: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00280 irq 39 [ 9.050411] ata5: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00300 irq 39 [ 9.050414] ata6: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00380 irq 39 [ 9.090243] mpt2sas_cm0: MSI-X vectors supported: 16, no of cores: 32, max_msix_vectors: -1 [ 9.090329] mpt2sas 0000:06:00.0: irq 41 for MSI/MSI-X [ 9.090405] mpt2sas 0000:06:00.0: irq 42 for MSI/MSI-X [ 9.090466] mpt2sas 0000:06:00.0: irq 43 for MSI/MSI-X [ 9.090526] mpt2sas 0000:06:00.0: irq 44 for MSI/MSI-X [ 9.090586] mpt2sas 0000:06:00.0: irq 45 for MSI/MSI-X [ 9.090647] mpt2sas 0000:06:00.0: irq 46 for MSI/MSI-X [ 9.090706] mpt2sas 0000:06:00.0: irq 47 for MSI/MSI-X [ 9.090771] mpt2sas 0000:06:00.0: irq 48 for MSI/MSI-X [ 9.090831] mpt2sas 0000:06:00.0: irq 49 for MSI/MSI-X [ 9.090891] mpt2sas 0000:06:00.0: irq 50 for MSI/MSI-X [ 9.090951] mpt2sas 0000:06:00.0: irq 51 for MSI/MSI-X [ 9.091012] mpt2sas 0000:06:00.0: irq 52 for MSI/MSI-X [ 9.091072] mpt2sas 0000:06:00.0: irq 53 for MSI/MSI-X [ 9.091136] mpt2sas 0000:06:00.0: irq 54 for MSI/MSI-X [ 9.091197] mpt2sas 0000:06:00.0: irq 55 for MSI/MSI-X [ 9.091262] mpt2sas 0000:06:00.0: irq 56 for MSI/MSI-X [ 9.091380] mpt2sas0-msix0: PCI-MSI-X enabled: IRQ 41 [ 9.091381] mpt2sas0-msix1: PCI-MSI-X enabled: IRQ 42 [ 9.091381] mpt2sas0-msix2: PCI-MSI-X enabled: IRQ 43 [ 9.091382] mpt2sas0-msix3: PCI-MSI-X enabled: IRQ 44 [ 9.091382] mpt2sas0-msix4: PCI-MSI-X enabled: IRQ 45 [ 9.091383] mpt2sas0-msix5: PCI-MSI-X enabled: IRQ 46 [ 9.091383] mpt2sas0-msix6: PCI-MSI-X enabled: IRQ 47 [ 9.091384] mpt2sas0-msix7: PCI-MSI-X enabled: IRQ 48 [ 9.091384] mpt2sas0-msix8: PCI-MSI-X enabled: IRQ 49 [ 9.091384] mpt2sas0-msix9: PCI-MSI-X enabled: IRQ 50 [ 9.091385] mpt2sas0-msix10: PCI-MSI-X enabled: IRQ 51 [ 9.091386] mpt2sas0-msix11: PCI-MSI-X enabled: IRQ 52 [ 9.091386] mpt2sas0-msix12: PCI-MSI-X enabled: IRQ 53 [ 9.091386] mpt2sas0-msix13: PCI-MSI-X enabled: IRQ 54 [ 9.091387] mpt2sas0-msix14: PCI-MSI-X enabled: IRQ 55 [ 9.091387] mpt2sas0-msix15: PCI-MSI-X enabled: IRQ 56 [ 9.091389] mpt2sas_cm0: iomem(0x00000000d0a40000), mapped(0xffffc90003aa0000), size(65536) [ 9.091389] mpt2sas_cm0: ioport(0x0000000000002000), size(256) [ 9.145890] mpt2sas_cm0: sending message unit reset !! [ 9.147382] mpt2sas_cm0: message unit reset: SUCCESS [ 9.181290] isci: Intel(R) C600 SAS Controller Driver - version 1.2.0 [ 9.181308] igb: Intel(R) Gigabit Ethernet Network Driver - version 5.4.0-k [ 9.181309] igb: Copyright (c) 2007-2014 Intel Corporation. [ 9.181314] isci 0000:07:00.0: driver configured for rev: 6 silicon [ 9.181324] isci 0000:07:00.0: OEM parameter table found in OROM [ 9.181325] isci 0000:07:00.0: OEM SAS parameters (version: 1.1) loaded (platform) [ 9.181679] isci 0000:07:00.0: SCU controller 0: phy 3-0 cables: {short, short, short, short} [ 9.181784] igb 0000:02:00.0: irq 58 for MSI/MSI-X [ 9.181875] igb 0000:02:00.0: irq 58 for MSI/MSI-X [ 9.181940] igb 0000:02:00.0: irq 59 for MSI/MSI-X [ 9.182005] igb 0000:02:00.0: irq 60 for MSI/MSI-X [ 9.182070] igb 0000:02:00.0: irq 61 for MSI/MSI-X [ 9.182135] igb 0000:02:00.0: irq 62 for MSI/MSI-X [ 9.182205] igb 0000:02:00.0: irq 63 for MSI/MSI-X [ 9.182277] igb 0000:02:00.0: irq 64 for MSI/MSI-X [ 9.182345] igb 0000:02:00.0: irq 65 for MSI/MSI-X [ 9.182414] igb 0000:02:00.0: irq 66 for MSI/MSI-X [ 9.182448] igb 0000:02:00.0: PHY reset is blocked due to SOL/IDER session. [ 9.184179] scsi host7: isci [ 9.185003] isci 0000:07:00.0: irq 67 for MSI/MSI-X [ 9.185070] isci 0000:07:00.0: irq 68 for MSI/MSI-X [ 9.209522] mpt2sas_cm0: Allocated physical memory: size(18690 kB) [ 9.209523] mpt2sas_cm0: Current Controller Queue Depth(10104),Max Controller Queue Depth(10240) [ 9.209524] mpt2sas_cm0: Scatter Gather Elements per IO(128) [ 9.219048] igb 0000:02:00.0: added PHC on eth0 [ 9.219049] igb 0000:02:00.0: Intel(R) Gigabit Ethernet Network Connection [ 9.219050] igb 0000:02:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:11:0f [ 9.219123] igb 0000:02:00.0: eth0: PBA No: 100000-000 [ 9.219124] igb 0000:02:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 9.219588] igb 0000:02:00.1: irq 70 for MSI/MSI-X [ 9.219678] igb 0000:02:00.1: irq 70 for MSI/MSI-X [ 9.219743] igb 0000:02:00.1: irq 71 for MSI/MSI-X [ 9.219808] igb 0000:02:00.1: irq 72 for MSI/MSI-X [ 9.219874] igb 0000:02:00.1: irq 73 for MSI/MSI-X [ 9.219939] igb 0000:02:00.1: irq 74 for MSI/MSI-X [ 9.220003] igb 0000:02:00.1: irq 75 for MSI/MSI-X [ 9.220068] igb 0000:02:00.1: irq 76 for MSI/MSI-X [ 9.220142] igb 0000:02:00.1: irq 77 for MSI/MSI-X [ 9.220207] igb 0000:02:00.1: irq 78 for MSI/MSI-X [ 9.220233] igb 0000:02:00.1: PHY reset is blocked due to SOL/IDER session. [ 9.255260] mpt2sas_cm0: LSISAS2308: FWVersion(20.00.07.00), ChipRevision(0x05), BiosVersion(07.29.00.00) [ 9.255261] mpt2sas_cm0: Protocol=( [ 9.255262] Initiator [ 9.255263] ,Target [ 9.255263] ), [ 9.255264] Capabilities=( [ 9.255264] TLR [ 9.255265] ,EEDP [ 9.255265] ,Snapshot Buffer [ 9.255266] ,Diag Trace Buffer [ 9.255266] ,Task Set Full [ 9.255267] ,NCQ [ 9.255267] ) [ 9.255313] scsi host0: Fusion MPT SAS Host [ 9.255632] igb 0000:02:00.1: added PHC on eth1 [ 9.255633] igb 0000:02:00.1: Intel(R) Gigabit Ethernet Network Connection [ 9.255634] igb 0000:02:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:11:10 [ 9.255707] igb 0000:02:00.1: eth1: PBA No: 100000-000 [ 9.255708] igb 0000:02:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 9.255897] mpt2sas_cm0: sending port enable !! [ 9.256144] random: fast init done [ 9.258486] mpt2sas_cm0: host_add: handle(0x0001), sas_addr(0x500605b005d6e8b0), phys(8) [ 9.266367] mpt2sas_cm0: port enable: SUCCESS [ 9.267289] scsi 0:0:0:0: Direct-Access LSI INF-01-00 0820 PQ: 0 ANSI: 5 [ 9.267293] scsi 0:0:0:0: SSP: handle(0x000a), sas_addr(0x50080e52ffd82004), phy(4), device_name(0x50080e52ffd82004) [ 9.267295] scsi 0:0:0:0: SSP: enclosure_logical_id(0x500605b005d6e8b0), slot(7) [ 9.267298] scsi 0:0:0:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) [ 9.271584] igb 0000:02:00.2: irq 80 for MSI/MSI-X [ 9.271676] igb 0000:02:00.2: irq 80 for MSI/MSI-X [ 9.271739] igb 0000:02:00.2: irq 81 for MSI/MSI-X [ 9.271805] igb 0000:02:00.2: irq 82 for MSI/MSI-X [ 9.271868] igb 0000:02:00.2: irq 83 for MSI/MSI-X [ 9.271929] igb 0000:02:00.2: irq 84 for MSI/MSI-X [ 9.271993] igb 0000:02:00.2: irq 85 for MSI/MSI-X [ 9.272055] igb 0000:02:00.2: irq 86 for MSI/MSI-X [ 9.272128] igb 0000:02:00.2: irq 87 for MSI/MSI-X [ 9.272191] igb 0000:02:00.2: irq 88 for MSI/MSI-X [ 9.325887] igb 0000:02:00.2: added PHC on eth2 [ 9.325888] igb 0000:02:00.2: Intel(R) Gigabit Ethernet Network Connection [ 9.325889] igb 0000:02:00.2: eth2: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:11:11 [ 9.325961] igb 0000:02:00.2: eth2: PBA No: 100000-000 [ 9.325963] igb 0000:02:00.2: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 9.340572] igb 0000:02:00.3: irq 90 for MSI/MSI-X [ 9.340656] igb 0000:02:00.3: irq 90 for MSI/MSI-X [ 9.340718] igb 0000:02:00.3: irq 91 for MSI/MSI-X [ 9.340779] igb 0000:02:00.3: irq 92 for MSI/MSI-X [ 9.340842] igb 0000:02:00.3: irq 93 for MSI/MSI-X [ 9.340908] igb 0000:02:00.3: irq 94 for MSI/MSI-X [ 9.340971] igb 0000:02:00.3: irq 95 for MSI/MSI-X [ 9.341033] igb 0000:02:00.3: irq 96 for MSI/MSI-X [ 9.341094] igb 0000:02:00.3: irq 97 for MSI/MSI-X [ 9.341167] igb 0000:02:00.3: irq 98 for MSI/MSI-X [ 9.355452] ata6: SATA link down (SStatus 0 SControl 300) [ 9.355490] ata1: SATA link down (SStatus 0 SControl 300) [ 9.355525] ata2: SATA link down (SStatus 0 SControl 300) [ 9.355561] ata3: SATA link down (SStatus 0 SControl 300) [ 9.355596] ata4: SATA link down (SStatus 0 SControl 300) [ 9.355631] ata5: SATA link down (SStatus 0 SControl 300) [ 9.394845] igb 0000:02:00.3: added PHC on eth3 [ 9.394846] igb 0000:02:00.3: Intel(R) Gigabit Ethernet Network Connection [ 9.394847] igb 0000:02:00.3: eth3: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:11:12 [ 9.394920] igb 0000:02:00.3: eth3: PBA No: 100000-000 [ 9.394921] igb 0000:02:00.3: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 9.454822] [TTM] Zone kernel: Available graphics memory: 16255616 kiB [ 9.454823] [TTM] Zone dma32: Available graphics memory: 2097152 kiB [ 9.454823] [TTM] Initializing pool allocator [ 9.454826] [TTM] Initializing DMA pool allocator [ 9.508605] fbcon: mgadrmfb (fb0) is primary device [ 9.529256] scsi 0:0:0:1: Direct-Access LSI INF-01-00 0820 PQ: 0 ANSI: 5 [ 9.529263] scsi 0:0:0:1: SSP: handle(0x000a), sas_addr(0x50080e52ffd82004), phy(4), device_name(0x50080e52ffd82004) [ 9.529266] scsi 0:0:0:1: SSP: enclosure_logical_id(0x500605b005d6e8b0), slot(7) [ 9.529270] scsi 0:0:0:1: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) [ 9.540827] scsi 0:0:0:2: Direct-Access LSI INF-01-00 0820 PQ: 0 ANSI: 5 [ 9.540832] scsi 0:0:0:2: SSP: handle(0x000a), sas_addr(0x50080e52ffd82004), phy(4), device_name(0x50080e52ffd82004) [ 9.540834] scsi 0:0:0:2: SSP: enclosure_logical_id(0x500605b005d6e8b0), slot(7) [ 9.540838] scsi 0:0:0:2: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) [ 9.555792] scsi 0:0:0:3: Direct-Access LSI INF-01-00 0820 PQ: 0 ANSI: 5 [ 9.555797] scsi 0:0:0:3: SSP: handle(0x000a), sas_addr(0x50080e52ffd82004), phy(4), device_name(0x50080e52ffd82004) [ 9.555813] scsi 0:0:0:3: SSP: enclosure_logical_id(0x500605b005d6e8b0), slot(7) [ 9.555816] scsi 0:0:0:3: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) [ 9.570838] scsi 0:0:0:7: Direct-Access LSI Universal Xport 0820 PQ: 0 ANSI: 5 [ 9.570843] scsi 0:0:0:7: SSP: handle(0x000a), sas_addr(0x50080e52ffd82004), phy(4), device_name(0x50080e52ffd82004) [ 9.570845] scsi 0:0:0:7: SSP: enclosure_logical_id(0x500605b005d6e8b0), slot(7) [ 9.570848] scsi 0:0:0:7: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) [ 9.583424] scsi 0:0:1:0: Direct-Access LSI INF-01-00 0820 PQ: 0 ANSI: 5 [ 9.583429] scsi 0:0:1:0: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0000), phy(0), device_name(0x50080e52ff4f0000) [ 9.583432] scsi 0:0:1:0: SSP: enclosure_logical_id(0x500605b005d6e8b0), slot(3) [ 9.583435] scsi 0:0:1:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) [ 9.622389] scsi 0:0:1:1: Direct-Access LSI INF-01-00 0820 PQ: 0 ANSI: 5 [ 9.622394] scsi 0:0:1:1: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0000), phy(0), device_name(0x50080e52ff4f0000) [ 9.622396] scsi 0:0:1:1: SSP: enclosure_logical_id(0x500605b005d6e8b0), slot(3) [ 9.622399] scsi 0:0:1:1: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) [ 9.622814] scsi 0:0:1:1: Mode parameters changed [ 9.634814] scsi 0:0:1:2: Direct-Access LSI INF-01-00 0820 PQ: 0 ANSI: 5 [ 9.634819] scsi 0:0:1:2: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0000), phy(0), device_name(0x50080e52ff4f0000) [ 9.634822] scsi 0:0:1:2: SSP: enclosure_logical_id(0x500605b005d6e8b0), slot(3) [ 9.634825] scsi 0:0:1:2: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) [ 9.635218] scsi 0:0:1:2: Mode parameters changed [ 9.651850] scsi 0:0:1:3: Direct-Access LSI INF-01-00 0820 PQ: 0 ANSI: 5 [ 9.651855] scsi 0:0:1:3: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0000), phy(0), device_name(0x50080e52ff4f0000) [ 9.651857] scsi 0:0:1:3: SSP: enclosure_logical_id(0x500605b005d6e8b0), slot(3) [ 9.651861] scsi 0:0:1:3: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) [ 9.652226] scsi 0:0:1:3: Mode parameters changed [ 9.664673] scsi 0:0:1:7: Direct-Access LSI Universal Xport 0820 PQ: 0 ANSI: 5 [ 9.664675] scsi 0:0:1:7: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0000), phy(0), device_name(0x50080e52ff4f0000) [ 9.664676] scsi 0:0:1:7: SSP: enclosure_logical_id(0x500605b005d6e8b0), slot(3) [ 9.664677] scsi 0:0:1:7: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) [ 9.742177] Console: switching to colour frame buffer device 128x48 [ 9.792251] mgag200 0000:09:00.0: fb0: mgadrmfb frame buffer device [ 9.829412] [drm] Initialized mgag200 1.0.0 20110418 for 0000:09:00.0 on minor 0 [ 10.696430] sas: phy-7:0 added to port-7:0, phy_mask:0x1 (5001e676b110f000) [ 10.696451] sas: phy-7:1 added to port-7:1, phy_mask:0x2 (5001e676b110f001) [ 10.696461] sas: DOING DISCOVERY on port 0, pid:254 [ 10.696491] sas: DONE DISCOVERY on port 0, pid:254, result:0 [ 10.696498] sas: DOING DISCOVERY on port 1, pid:254 [ 10.696520] sas: DONE DISCOVERY on port 1, pid:254, result:0 [ 10.696600] sas: Enter sas_scsi_recover_host busy: 0 failed: 0 [ 10.696652] sas: ata7: end_device-7:0: dev error handler [ 10.858794] ata7.00: ATA-8: ST500DM002-1BD142, KC45, max UDMA/133 [ 10.868257] ata7.00: 976773168 sectors, multi 0: LBA48 NCQ (depth 31/32) [ 10.879675] ata7.00: configured for UDMA/133 [ 10.886660] sas: --- Exit sas_scsi_recover_host: busy: 0 failed: 0 tries: 1 [ 10.897861] scsi 7:0:0:0: Direct-Access ATA ST500DM002-1BD14 KC45 PQ: 0 ANSI: 5 [ 15.539935] mlx4_core 0000:04:00.0: Old device ETS support detected [ 15.547825] mlx4_core 0000:04:00.0: Consider upgrading device FW. [ 15.555513] mlx4_core 0000:04:00.0: DMFS high rate mode not supported [ 15.563583] mlx4_core: device is working in RoCE mode: Roce V1 [ 15.570964] mlx4_core: UD QP Gid type is: V1 [ 16.624323] mlx4_core 0000:04:00.0: PCIe link speed is 8.0GT/s, device supports 8.0GT/s [ 16.634123] mlx4_core 0000:04:00.0: PCIe link width is x8, device supports x8 [ 16.643100] mlx4_core 0000:04:00.0: irq 99 for MSI/MSI-X [ 16.643119] mlx4_core 0000:04:00.0: irq 100 for MSI/MSI-X [ 16.643137] mlx4_core 0000:04:00.0: irq 101 for MSI/MSI-X [ 16.643156] mlx4_core 0000:04:00.0: irq 102 for MSI/MSI-X [ 16.643174] mlx4_core 0000:04:00.0: irq 103 for MSI/MSI-X [ 16.643196] mlx4_core 0000:04:00.0: irq 104 for MSI/MSI-X [ 16.643251] mlx4_core 0000:04:00.0: irq 105 for MSI/MSI-X [ 16.643271] mlx4_core 0000:04:00.0: irq 106 for MSI/MSI-X [ 16.643291] mlx4_core 0000:04:00.0: irq 107 for MSI/MSI-X [ 16.643310] mlx4_core 0000:04:00.0: irq 108 for MSI/MSI-X [ 16.643330] mlx4_core 0000:04:00.0: irq 109 for MSI/MSI-X [ 16.643359] mlx4_core 0000:04:00.0: irq 110 for MSI/MSI-X [ 16.643378] mlx4_core 0000:04:00.0: irq 111 for MSI/MSI-X [ 16.643400] mlx4_core 0000:04:00.0: irq 112 for MSI/MSI-X [ 16.643418] mlx4_core 0000:04:00.0: irq 113 for MSI/MSI-X [ 16.643436] mlx4_core 0000:04:00.0: irq 114 for MSI/MSI-X [ 16.643455] mlx4_core 0000:04:00.0: irq 115 for MSI/MSI-X [ 16.643473] mlx4_core 0000:04:00.0: irq 116 for MSI/MSI-X [ 16.643491] mlx4_core 0000:04:00.0: irq 117 for MSI/MSI-X [ 16.643509] mlx4_core 0000:04:00.0: irq 118 for MSI/MSI-X [ 16.643527] mlx4_core 0000:04:00.0: irq 119 for MSI/MSI-X [ 16.643549] mlx4_core 0000:04:00.0: irq 120 for MSI/MSI-X [ 16.643589] mlx4_core 0000:04:00.0: irq 121 for MSI/MSI-X [ 16.643607] mlx4_core 0000:04:00.0: irq 122 for MSI/MSI-X [ 16.643625] mlx4_core 0000:04:00.0: irq 123 for MSI/MSI-X [ 16.643645] mlx4_core 0000:04:00.0: irq 124 for MSI/MSI-X [ 16.643664] mlx4_core 0000:04:00.0: irq 125 for MSI/MSI-X [ 16.643682] mlx4_core 0000:04:00.0: irq 126 for MSI/MSI-X [ 16.643700] mlx4_core 0000:04:00.0: irq 127 for MSI/MSI-X [ 16.643722] mlx4_core 0000:04:00.0: irq 128 for MSI/MSI-X [ 16.643741] mlx4_core 0000:04:00.0: irq 129 for MSI/MSI-X [ 16.643759] mlx4_core 0000:04:00.0: irq 130 for MSI/MSI-X [ 16.643778] mlx4_core 0000:04:00.0: irq 131 for MSI/MSI-X [ 16.643796] mlx4_core 0000:04:00.0: irq 132 for MSI/MSI-X [ 16.643814] mlx4_core 0000:04:00.0: irq 133 for MSI/MSI-X [ 16.643832] mlx4_core 0000:04:00.0: irq 134 for MSI/MSI-X [ 16.643850] mlx4_core 0000:04:00.0: irq 135 for MSI/MSI-X [ 16.643872] mlx4_core 0000:04:00.0: irq 136 for MSI/MSI-X [ 16.643912] mlx4_core 0000:04:00.0: irq 137 for MSI/MSI-X [ 16.643931] mlx4_core 0000:04:00.0: irq 138 for MSI/MSI-X [ 16.643949] mlx4_core 0000:04:00.0: irq 139 for MSI/MSI-X [ 16.643967] mlx4_core 0000:04:00.0: irq 140 for MSI/MSI-X [ 16.643986] mlx4_core 0000:04:00.0: irq 141 for MSI/MSI-X [ 16.644004] mlx4_core 0000:04:00.0: irq 142 for MSI/MSI-X [ 16.644022] mlx4_core 0000:04:00.0: irq 143 for MSI/MSI-X [ 16.644044] mlx4_core 0000:04:00.0: irq 144 for MSI/MSI-X [ 16.644062] mlx4_core 0000:04:00.0: irq 145 for MSI/MSI-X [ 16.644080] mlx4_core 0000:04:00.0: irq 146 for MSI/MSI-X [ 16.644098] mlx4_core 0000:04:00.0: irq 147 for MSI/MSI-X [ 16.644117] mlx4_core 0000:04:00.0: irq 148 for MSI/MSI-X [ 16.644135] mlx4_core 0000:04:00.0: irq 149 for MSI/MSI-X [ 16.644153] mlx4_core 0000:04:00.0: irq 150 for MSI/MSI-X [ 16.644171] mlx4_core 0000:04:00.0: irq 151 for MSI/MSI-X [ 16.644193] mlx4_core 0000:04:00.0: irq 152 for MSI/MSI-X [ 16.644235] mlx4_core 0000:04:00.0: irq 153 for MSI/MSI-X [ 16.644253] mlx4_core 0000:04:00.0: irq 154 for MSI/MSI-X [ 16.644272] mlx4_core 0000:04:00.0: irq 155 for MSI/MSI-X [ 16.644297] mlx4_core 0000:04:00.0: irq 156 for MSI/MSI-X [ 16.644315] mlx4_core 0000:04:00.0: irq 157 for MSI/MSI-X [ 16.644333] mlx4_core 0000:04:00.0: irq 158 for MSI/MSI-X [ 16.644355] mlx4_core 0000:04:00.0: irq 159 for MSI/MSI-X [ 16.644374] mlx4_core 0000:04:00.0: irq 160 for MSI/MSI-X [ 16.644392] mlx4_core 0000:04:00.0: irq 161 for MSI/MSI-X [ 16.644410] mlx4_core 0000:04:00.0: irq 162 for MSI/MSI-X [ 16.644427] mlx4_core 0000:04:00.0: irq 163 for MSI/MSI-X [ 16.879267] sas: Enter sas_scsi_recover_host busy: 0 failed: 0 [ 16.879332] sas: ata7: end_device-7:0: dev error handler [ 16.879371] sas: ata8: end_device-7:1: dev error handler [ 16.881396] mlx4_ib_add: mlx4_ib: Mellanox ConnectX InfiniBand driver v4.2-1.0.0 [ 16.893792] mlx4_ib_add: counter index 0 for port 1 allocated 0 [ 16.902296] mlx4_ib_add: counter index 1 for port 2 allocated 0 [ 17.040124] ata8.00: ATA-8: ST500NM0011, SN02, max UDMA/133 [ 17.048777] ata8.00: 976773168 sectors, multi 0: LBA48 NCQ (depth 31/32) [ 17.059504] ata8.00: configured for UDMA/133 [ 17.066477] sas: --- Exit sas_scsi_recover_host: busy: 0 failed: 0 tries: 1 [ 17.078134] scsi 7:0:1:0: Direct-Access ATA ST500NM0011 SN02 PQ: 0 ANSI: 5 [ 17.102748] sd 7:0:0:0: [sda] 976773168 512-byte logical blocks: (500 GB/465 GiB) [ 17.102816] sd 7:0:1:0: [sdb] 976773168 512-byte logical blocks: (500 GB/465 GiB) [ 17.102971] sd 7:0:1:0: [sdb] Write Protect is off [ 17.102972] sd 7:0:1:0: [sdb] Mode Sense: 00 3a 00 00 [ 17.102997] sd 7:0:1:0: [sdb] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 17.103570] scsi 0:0:0:0: rdac: LUN 0 (RDAC) (owned) [ 17.103910] sd 0:0:0:0: [sdc] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB) [ 17.104364] scsi 0:0:0:1: rdac: LUN 1 (RDAC) (unowned) [ 17.104707] sd 0:0:0:1: [sdd] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB) [ 17.104845] sd 0:0:0:0: [sdc] Write Protect is off [ 17.104846] sd 0:0:0:0: [sdc] Mode Sense: 83 00 10 08 [ 17.105293] sd 0:0:0:0: [sdc] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 17.105458] scsi 0:0:0:2: rdac: LUN 2 (RDAC) (owned) [ 17.106174] sd 0:0:0:1: [sdd] Write Protect is off [ 17.106175] sd 0:0:0:1: [sdd] Mode Sense: 83 00 10 08 [ 17.106204] sd 0:0:0:2: [sde] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB) [ 17.106303] sdb: [ 17.106621] sd 7:0:1:0: [sdb] Attached SCSI disk [ 17.106703] sd 0:0:0:1: [sdd] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 17.106789] scsi 0:0:0:3: rdac: LUN 3 (RDAC) (unowned) [ 17.107469] sd 0:0:0:3: [sdf] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB) [ 17.107492] sd 0:0:0:7: [sdg] 40960 512-byte logical blocks: (20.9 MB/20.0 MiB) [ 17.107680] scsi 0:0:1:0: rdac: LUN 0 (RDAC) (unowned) [ 17.107727] sd 0:0:0:2: [sde] Write Protect is off [ 17.107729] sd 0:0:0:2: [sde] Mode Sense: 83 00 10 08 [ 17.107958] sd 0:0:1:0: [sdh] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB) [ 17.108312] sd 0:0:0:2: [sde] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 17.108472] scsi 0:0:1:1: rdac: LUN 1 (RDAC) (owned) [ 17.108811] sd 0:0:1:0: [sdh] Write Protect is off [ 17.108811] sd 0:0:1:0: [sdh] Mode Sense: 83 00 10 08 [ 17.109035] sd 0:0:1:1: [sdi] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB) [ 17.109189] sd 0:0:0:3: [sdf] Write Protect is off [ 17.109190] sd 0:0:0:3: [sdf] Mode Sense: 83 00 10 08 [ 17.109203] sd 0:0:1:0: [sdh] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 17.109245] sd 0:0:0:7: [sdg] Write Protect is off [ 17.109246] sd 0:0:0:7: [sdg] Mode Sense: 83 00 10 08 [ 17.109725] scsi 0:0:1:2: rdac: LUN 2 (RDAC) (unowned) [ 17.109806] sd 0:0:0:3: [sdf] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 17.110030] sd 0:0:0:7: [sdg] Write cache: disabled, read cache: enabled, supports DPO and FUA [ 17.110250] sd 0:0:1:2: [sdj] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB) [ 17.110354] sd 0:0:1:1: [sdi] Write Protect is off [ 17.110355] sd 0:0:1:1: [sdi] Mode Sense: 83 00 10 08 [ 17.110833] scsi 0:0:1:3: rdac: LUN 3 (RDAC) (owned) [ 17.110899] sd 0:0:1:1: [sdi] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 17.110967] Dev sdd: unable to read RDB block 0 [ 17.110975] sdd: unable to read partition table [ 17.111675] sd 0:0:1:2: [sdj] Write Protect is off [ 17.111676] sd 0:0:1:2: [sdj] Mode Sense: 83 00 10 08 [ 17.111700] sd 0:0:1:3: [sdk] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB) [ 17.111732] sd 0:0:1:7: [sdl] 40960 512-byte logical blocks: (20.9 MB/20.0 MiB) [ 17.112231] sd 0:0:1:2: [sdj] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 17.112981] Dev sdh: unable to read RDB block 0 [ 17.112986] sdh: unable to read partition table [ 17.113256] sd 0:0:0:0: [sdc] Attached SCSI disk [ 17.113279] sd 0:0:1:7: [sdl] Write Protect is off [ 17.113280] sd 0:0:1:7: [sdl] Mode Sense: 83 00 10 08 [ 17.113473] sd 0:0:1:3: [sdk] Write Protect is off [ 17.113474] sd 0:0:1:3: [sdk] Mode Sense: 83 00 10 08 [ 17.113956] sd 0:0:1:7: [sdl] Write cache: disabled, read cache: enabled, supports DPO and FUA [ 17.113994] Dev sdf: unable to read RDB block 0 [ 17.113999] sdf: unable to read partition table [ 17.114049] sd 0:0:1:3: [sdk] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 17.114087] sd 0:0:0:1: [sdd] Attached SCSI disk [ 17.115388] sd 0:0:0:2: [sde] Attached SCSI disk [ 17.116053] sd 0:0:0:3: [sdf] Attached SCSI disk [ 17.116674] sd 0:0:1:0: [sdh] Attached SCSI disk [ 17.116917] Dev sdj: unable to read RDB block 0 [ 17.116923] sdj: unable to read partition table [ 17.118638] sd 0:0:1:1: [sdi] Attached SCSI disk [ 17.119216] sd 0:0:1:2: [sdj] Attached SCSI disk [ 17.136788] sd 0:0:1:3: [sdk] Attached SCSI disk [ 17.392987] sdg: [ 17.394193] sd 0:0:0:7: [sdg] Attached SCSI disk [ 17.557317] sd 7:0:0:0: [sda] 4096-byte physical blocks [ 17.563836] sd 7:0:0:0: [sda] Write Protect is off [ 17.569812] sd 7:0:0:0: [sda] Mode Sense: 00 3a 00 00 [ 17.569827] sd 7:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 17.591604] sda: sda1 sda2 [ 17.595990] sd 7:0:0:0: [sda] Attached SCSI disk [ 17.622613] sdl: [ 17.631179] sd 0:0:1:7: [sdl] Attached SCSI disk [ 17.653778] random: crng init done [ 20.860705] EXT4-fs (sda1): mounting ext3 file system using the ext4 subsystem [ 20.920469] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null) [ 21.714167] systemd-journald[294]: Received SIGTERM from PID 1 (systemd). [ 23.139032] SELinux: Disabled at runtime. [ 23.144971] SELinux: Unregistering netfilter hooks [ 23.200159] type=1404 audit(1510736820.954:2): selinux=0 auid=4294967295 ses=4294967295 [ 23.572969] ip_tables: (C) 2000-2006 Netfilter Core Team [ 23.580575] systemd[1]: Inserted module 'ip_tables' [ 25.512067] RPC: Registered named UNIX socket transport module. [ 25.520225] RPC: Registered udp transport module. [ 25.526910] RPC: Registered tcp transport module. [ 25.533570] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 25.740900] EXT4-fs (sda1): re-mounted. Opts: (null) [ 26.052315] systemd-journald[667]: Received request to flush runtime journal from PID 1 [ 26.388669] Installing knfsd (copyright (C) 1996 okir@monad.swb.de). [ 26.656005] device-mapper: uevent: version 1.0.3 [ 26.662844] device-mapper: ioctl: 4.35.0-ioctl (2016-06-23) initialised: dm-devel@redhat.com [ 27.216772] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 27.218691] wmi: Mapper loaded [ 27.421875] input: PC Speaker as /devices/platform/pcspkr/input/input3 [ 27.436226] ioatdma: Intel(R) QuickData Technology Driver 4.00 [ 27.444078] ioatdma 0000:00:04.0: irq 165 for MSI/MSI-X [ 27.444721] igb 0000:02:00.0: DCA enabled [ 27.450587] igb 0000:02:00.1: DCA enabled [ 27.456660] ioatdma 0000:00:04.1: irq 167 for MSI/MSI-X [ 27.457217] igb 0000:02:00.2: DCA enabled [ 27.462951] igb 0000:02:00.3: DCA enabled [ 27.468748] ioatdma 0000:00:04.2: irq 168 for MSI/MSI-X [ 27.469530] ioatdma 0000:00:04.3: irq 169 for MSI/MSI-X [ 27.470228] ioatdma 0000:00:04.4: irq 170 for MSI/MSI-X [ 27.470913] ioatdma 0000:00:04.5: irq 171 for MSI/MSI-X [ 27.471613] ioatdma 0000:00:04.6: irq 172 for MSI/MSI-X [ 27.472346] ioatdma 0000:00:04.7: irq 173 for MSI/MSI-X [ 27.473135] ioatdma 0000:80:04.0: irq 175 for MSI/MSI-X [ 27.473756] ioatdma 0000:80:04.1: irq 177 for MSI/MSI-X [ 27.474302] ioatdma 0000:80:04.2: irq 178 for MSI/MSI-X [ 27.474891] ioatdma 0000:80:04.3: irq 179 for MSI/MSI-X [ 27.475453] ioatdma 0000:80:04.4: irq 180 for MSI/MSI-X [ 27.476001] ioatdma 0000:80:04.5: irq 181 for MSI/MSI-X [ 27.476568] ioatdma 0000:80:04.6: irq 182 for MSI/MSI-X [ 27.477142] ioatdma 0000:80:04.7: irq 183 for MSI/MSI-X [ 27.638006] ipmi message handler version 39.2 [ 27.792960] ACPI Warning: SystemIO range 0x0000000000004000-0x000000000000401f conflicts with OpRegion 0x0000000000004000-0x000000000000400f (\_SB_.PCI0.SBUS.SMBI) (20130517/utaddress-254) [ 27.813624] ACPI: If an ACPI driver is available for this device, you should use it instead of the native driver [ 27.825917] ipmi device interface [ 27.825918] i801_smbus 0000:07:00.3: Enabling SMBus device [ 27.825954] i801_smbus 0000:07:00.3: SMBus using PCI interrupt [ 27.893168] sd 7:0:0:0: Attached scsi generic sg0 type 0 [ 27.900121] sd 7:0:1:0: Attached scsi generic sg1 type 0 [ 27.906937] sd 0:0:0:0: Attached scsi generic sg2 type 0 [ 27.913709] iTCO_vendor_support: vendor-support=0 [ 27.913756] sd 0:0:0:1: Attached scsi generic sg3 type 0 [ 27.913824] sd 0:0:0:2: Attached scsi generic sg4 type 0 [ 27.913898] sd 0:0:0:3: Attached scsi generic sg5 type 0 [ 27.913961] sd 0:0:0:7: Attached scsi generic sg6 type 0 [ 27.914024] sd 0:0:1:0: Attached scsi generic sg7 type 0 [ 27.914109] sd 0:0:1:1: Attached scsi generic sg8 type 0 [ 27.914174] sd 0:0:1:2: Attached scsi generic sg9 type 0 [ 27.914238] sd 0:0:1:3: Attached scsi generic sg10 type 0 [ 27.914323] sd 0:0:1:7: Attached scsi generic sg11 type 0 [ 27.953396] IPMI System Interface driver. [ 27.953429] ipmi_si: probing via SMBIOS [ 27.953430] ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0 [ 27.953432] ipmi_si: Adding SMBIOS-specified kcs state machine [ 27.953434] ipmi_si: probing via SPMI [ 27.953435] ipmi_si: SPMI: io 0xca2 regsize 1 spacing 1 irq 0 [ 27.953436] ipmi_si: Adding SPMI-specified kcs state machine duplicate interface [ 27.953438] ipmi_si: Trying SMBIOS-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0 [ 28.041397] mei_me 0000:00:16.0: Device doesn't have valid ME Interface [ 28.049417] ipmi_si ipmi_si.0: Found new BMC (man_id: 0x000157, prod_id: 0x0049, dev_id: 0x21) [ 28.049470] ipmi_si ipmi_si.0: IPMI kcs interface initialized [ 28.079951] AES CTR mode by8 optimization enabled [ 28.083081] alg: No test for __gcm-aes-aesni (__driver-gcm-aes-aesni) [ 28.089696] alg: No test for crc32 (crc32-pclmul) [ 28.111671] IPMI SSIF Interface driver [ 28.111990] iTCO_wdt: Intel TCO WatchDog Timer Driver v1.11 [ 28.112069] iTCO_wdt: unable to reset NO_REBOOT flag, device disabled by hardware/BIOS [ 28.722749] device-mapper: multipath round-robin: version 1.2.0 loaded [ 29.007022] sd 0:0:1:2: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command [ 29.121867] device-mapper: table: 253:5: multipath: error getting device [ 29.130360] device-mapper: ioctl: error adding target to table [ 29.383485] kvm: disabled by bios [ 29.401051] kvm: disabled by bios [ 29.412610] kvm: disabled by bios [ 29.449289] intel_rapl: Found RAPL domain package [ 29.455274] intel_rapl: Found RAPL domain core [ 29.460952] intel_rapl: Found RAPL domain dram [ 29.466660] intel_rapl: Found RAPL domain package [ 29.472637] intel_rapl: Found RAPL domain core [ 29.478294] intel_rapl: Found RAPL domain dram [ 29.492416] sd 0:0:1:2: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT completed [ 29.501963] sd 0:0:0:3: rdac: array soak-netapp2624-1, ctlr 0, queueing MODE_SELECT command [ 29.560845] EDAC MC: Ver: 3.0.0 [ 29.874517] EDAC sbridge: Seeking for: PCI ID 8086:3ca0 [ 29.874532] EDAC sbridge: Seeking for: PCI ID 8086:3ca0 [ 29.874539] EDAC sbridge: Seeking for: PCI ID 8086:3ca0 [ 29.874541] EDAC sbridge: Seeking for: PCI ID 8086:3ca8 [ 29.874546] EDAC sbridge: Seeking for: PCI ID 8086:3ca8 [ 29.874550] EDAC sbridge: Seeking for: PCI ID 8086:3ca8 [ 29.874552] EDAC sbridge: Seeking for: PCI ID 8086:3c71 [ 29.874557] EDAC sbridge: Seeking for: PCI ID 8086:3c71 [ 29.874561] EDAC sbridge: Seeking for: PCI ID 8086:3c71 [ 29.874562] EDAC sbridge: Seeking for: PCI ID 8086:3caa [ 29.874567] EDAC sbridge: Seeking for: PCI ID 8086:3caa [ 29.874572] EDAC sbridge: Seeking for: PCI ID 8086:3caa [ 29.874573] EDAC sbridge: Seeking for: PCI ID 8086:3cab [ 29.874578] EDAC sbridge: Seeking for: PCI ID 8086:3cab [ 29.874582] EDAC sbridge: Seeking for: PCI ID 8086:3cab [ 29.874584] EDAC sbridge: Seeking for: PCI ID 8086:3cac [ 29.874588] EDAC sbridge: Seeking for: PCI ID 8086:3cac [ 29.874593] EDAC sbridge: Seeking for: PCI ID 8086:3cac [ 29.874594] EDAC sbridge: Seeking for: PCI ID 8086:3cad [ 29.874599] EDAC sbridge: Seeking for: PCI ID 8086:3cad [ 29.874603] EDAC sbridge: Seeking for: PCI ID 8086:3cad [ 29.874605] EDAC sbridge: Seeking for: PCI ID 8086:3cb8 [ 29.874610] EDAC sbridge: Seeking for: PCI ID 8086:3cb8 [ 29.874614] EDAC sbridge: Seeking for: PCI ID 8086:3cb8 [ 29.874615] EDAC sbridge: Seeking for: PCI ID 8086:3cf4 [ 29.874619] EDAC sbridge: Seeking for: PCI ID 8086:3cf4 [ 29.874623] EDAC sbridge: Seeking for: PCI ID 8086:3cf4 [ 29.874625] EDAC sbridge: Seeking for: PCI ID 8086:3cf6 [ 29.874629] EDAC sbridge: Seeking for: PCI ID 8086:3cf6 [ 29.874633] EDAC sbridge: Seeking for: PCI ID 8086:3cf6 [ 29.874635] EDAC sbridge: Seeking for: PCI ID 8086:3cf5 [ 29.874639] EDAC sbridge: Seeking for: PCI ID 8086:3cf5 [ 29.874643] EDAC sbridge: Seeking for: PCI ID 8086:3cf5 [ 29.874780] EDAC MC0: Giving out device to 'sbridge_edac.c' 'Sandy Bridge Socket#0': DEV 0000:7f:0e.0 [ 29.886688] EDAC MC1: Giving out device to 'sbridge_edac.c' 'Sandy Bridge Socket#1': DEV 0000:ff:0e.0 [ 29.897808] EDAC sbridge: Ver: 1.1.1 [ 30.291831] Adding 16319484k swap on /dev/sda2. Priority:-1 extents:1 across:16319484k FS [ 33.419977] sd 0:0:0:3: rdac: array soak-netapp2624-1, ctlr 0, MODE_SELECT completed [ 33.430362] sd 0:0:0:2: rdac: array soak-netapp2624-1, ctlr 0, queueing MODE_SELECT command [ 34.163061] sd 0:0:0:2: rdac: array soak-netapp2624-1, ctlr 0, MODE_SELECT completed [ 34.173386] sd 0:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command [ 35.200342] sd 0:0:1:2: [sdj] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE [ 35.210815] sd 0:0:1:2: [sdj] Sense Key : Illegal Request [current] [ 35.219588] sd 0:0:1:2: [sdj] <>ASC=0x94 ASCQ=0x1 [ 35.227358] sd 0:0:1:2: [sdj] CDB: Read(16) 88 00 00 00 00 00 00 00 00 00 00 00 00 08 00 00 [ 35.238349] blk_update_request: I/O error, dev sdj, sector 0 [ 36.836738] sd 0:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT completed [ 37.573837] type=1305 audit(1510736835.327:3): audit_pid=1081 old=0 auid=4294967295 ses=4294967295 res=1 [ 38.655373] mlx4_en: Mellanox ConnectX HCA Ethernet driver v4.2-1.0.0 [ 38.825519] IPv6: ADDRCONF(NETDEV_UP): eth0: link is not ready [ 38.915656] igb 0000:02:00.0 eth0: igb: eth0 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX [ 38.916999] IPv6: ADDRCONF(NETDEV_UP): eth0: link is not ready [ 38.917010] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready [ 38.922734] IPv6: ADDRCONF(NETDEV_UP): eth1: link is not ready [ 38.937836] card: mlx4_0, QP: 0x220, inline size: 120 [ 39.005130] IPv6: ADDRCONF(NETDEV_UP): eth1: link is not ready [ 39.017276] IPv6: ADDRCONF(NETDEV_UP): eth2: link is not ready [ 39.025676] card: mlx4_0, QP: 0x300, inline size: 120 [ 39.129720] IPv6: ADDRCONF(NETDEV_UP): eth2: link is not ready [ 39.141658] IPv6: ADDRCONF(NETDEV_UP): eth3: link is not ready [ 39.259824] IPv6: ADDRCONF(NETDEV_UP): eth3: link is not ready [ 39.270623] ib0: enabling connected mode will cause multicast packet drops [ 39.279247] ib0: mtu > 4092 will cause multicast packet drops. [ 39.294002] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready [ 39.324082] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready [ 39.331398] IPv6: ADDRCONF(NETDEV_UP): ib1: link is not ready [ 39.350667] IPv6: ADDRCONF(NETDEV_UP): ib1: link is not ready [ 45.396986] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready [ 45.456322] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready [ 45.467334] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready [ 45.699942] FS-Cache: Loaded [ 45.717132] FS-Cache: Netfs 'nfs' registered for caching [ 45.720572] Key type dns_resolver registered [ 45.747054] NFS: Registering the id_resolver key type [ 45.747058] Key type id_resolver registered [ 45.747059] Key type id_legacy registered [ 59.936494] IPv6: ADDRCONF(NETDEV_CHANGE): ib0: link becomes ready [ 174.107199] SPL: Loaded module v0.7.3-1 [ 174.136895] znvpair: module license 'CDDL' taints kernel. [ 174.142991] Disabling lock debugging due to kernel taint [ 175.888838] ZFS: Loaded module v0.7.3-1, ZFS pool version 5000, ZFS filesystem version 5 [ 176.126880] LNet: HW NUMA nodes: 2, HW CPU cores: 32, npartitions: 2 [ 176.137287] alg: No test for adler32 (adler32-zlib) [ 176.143018] alg: No test for crc32 (crc32-table) [ 176.978166] Lustre: Lustre: Build Version: 2.10.55 [ 177.198863] LNet: Added LNI 192.168.1.109@o2ib [8/256/0/180] [ 177.806186] LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,user_xattr,no_mbcache,nodelalloc [ 178.510982] Lustre: soaked-MDT0001: Imperative Recovery enabled, recovery window shrunk from 300-900 down to 150-900 [ 183.185758] LNet: 2231:0:(o2iblnd_cb.c:3198:kiblnd_check_conns()) Timed out tx for 192.168.1.114@o2ib: 4294850 seconds [ 183.568785] Lustre: soaked-MDT0001: Will be in recovery for at least 2:30, or until 32 clients reconnect [ 183.579925] Lustre: soaked-MDT0001: Connection restored to c1e05730-7404-6b14-fde9-403484abb241 (at 192.168.1.123@o2ib) [ 184.185682] LNet: 2231:0:(o2iblnd_cb.c:3198:kiblnd_check_conns()) Timed out tx for 192.168.1.115@o2ib: 4294851 seconds [ 184.351525] Lustre: soaked-MDT0001: Connection restored to 329cf903-1799-038e-ebfa-c63dc81e0d9b (at 192.168.1.139@o2ib) [ 184.363683] Lustre: Skipped 2 previous similar messages [ 185.421694] Lustre: soaked-MDT0001: Connection restored to d720d2a6-6b6a-31de-f15c-361e1027d50c (at 192.168.1.124@o2ib) [ 185.433859] Lustre: Skipped 9 previous similar messages [ 187.356252] LustreError: 2305:0:(mdt_open.c:1164:mdt_cross_open()) soaked-MDT0001: [0x240007937:0xdf19:0x0] doesn't exist!: rc = -14 [ 187.481148] Lustre: soaked-MDT0001: Connection restored to f0b20fa8-c549-1c2c-d979-3d2b25b7df86 (at 192.168.1.120@o2ib) [ 187.493333] Lustre: Skipped 10 previous similar messages [ 205.048387] Lustre: soaked-MDT0001: Connection restored to 192.168.1.111@o2ib (at 192.168.1.111@o2ib) [ 205.058805] Lustre: Skipped 4 previous similar messages [ 216.997250] Lustre: soaked-MDT0001: Connection restored to 192.168.1.104@o2ib (at 192.168.1.104@o2ib) [ 217.007706] Lustre: Skipped 16 previous similar messages [ 219.351588] Lustre: soaked-MDT0001: Recovery over after 0:36, of 32 clients 32 recovered and 0 were evicted. [ 1390.958044] LustreError: 2475:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0001: expected 416 actual 344. [ 1390.989393] LustreError: 2475:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 1 previous similar message [ 1408.020872] LustreError: 2430:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0001: expected 968 actual 416. [ 1409.653860] LustreError: 2300:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0001: expected 968 actual 416. [ 2493.108946] Lustre: 2248:0:(client.c:2113:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1510739284/real 0] req@ffff8803f231e600 x1584122614318192/t0(0) o103->soaked-MDT0002-osp-MDT0001@192.168.1.110@o2ib:17/18 lens 328/224 e 0 to 1 dl 1510739291 ref 2 fl Rpc:X/0/ffffffff rc 0/-1 [ 2493.140364] Lustre: soaked-MDT0002-osp-MDT0001: Connection to soaked-MDT0002 (at 192.168.1.110@o2ib) was lost; in progress operations using this service will wait for recovery to complete [ 2493.644920] Lustre: 2250:0:(client.c:2113:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1510739284/real 0] req@ffff8803f231ec00 x1584122614318224/t0(0) o103->soaked-MDT0002-osp-MDT0001@192.168.1.110@o2ib:17/18 lens 328/224 e 0 to 1 dl 1510739291 ref 2 fl Rpc:X/0/ffffffff rc 0/-1 [ 2493.676318] Lustre: 2250:0:(client.c:2113:ptlrpc_expire_one_request()) Skipped 104 previous similar messages [ 2494.804828] Lustre: 2255:0:(client.c:2113:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1510739284/real 0] req@ffff8803f231fb00 x1584122614318304/t0(0) o103->soaked-MDT0002-osp-MDT0001@192.168.1.110@o2ib:17/18 lens 328/224 e 0 to 1 dl 1510739291 ref 2 fl Rpc:X/0/ffffffff rc 0/-1 [ 2494.844575] Lustre: 2255:0:(client.c:2113:ptlrpc_expire_one_request()) Skipped 387 previous similar messages [ 2497.035785] Lustre: 2274:0:(client.c:2113:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1510739287/real 0] req@ffff8807f5283300 x1584122614479728/t0(0) o103->soaked-MDT0002-osp-MDT0001@192.168.1.110@o2ib:17/18 lens 328/224 e 0 to 1 dl 1510739294 ref 2 fl Rpc:X/0/ffffffff rc 0/-1 [ 2497.076753] Lustre: 2274:0:(client.c:2113:ptlrpc_expire_one_request()) Skipped 1074 previous similar messages [ 2543.156523] Lustre: 2242:0:(client.c:2113:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1510739341/real 1510739341] req@ffff8800ac718300 x1584122615535744/t0(0) o38->soaked-MDT0002-osp-MDT0001@192.168.1.110@o2ib:24/4 lens 520/544 e 0 to 1 dl 1510739352 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1 [ 2543.197790] Lustre: 2242:0:(client.c:2113:ptlrpc_expire_one_request()) Skipped 161 previous similar messages [ 2593.153722] Lustre: 2242:0:(client.c:2113:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1510739391/real 1510739391] req@ffff8807f4f4a100 x1584122616271952/t0(0) o38->soaked-MDT0002-osp-MDT0001@192.168.1.110@o2ib:24/4 lens 520/544 e 0 to 1 dl 1510739407 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1 [ 2643.150881] Lustre: 2242:0:(client.c:2113:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1510739441/real 1510739441] req@ffff8803eba0f500 x1584122617182016/t0(0) o38->soaked-MDT0002-osp-MDT0001@192.168.1.110@o2ib:24/4 lens 520/544 e 0 to 1 dl 1510739462 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1 [ 2687.185931] LNet: Service thread pid 2564 was inactive for 200.70s. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes: [ 2687.211486] Pid: 2564, comm: mdt01_011 [ 2687.219099] Call Trace: [ 2687.230091] [] schedule+0x29/0x70 [ 2687.238757] [] top_trans_wait_result+0xa6/0x155 [ptlrpc] [ 2687.249547] [] ? default_wake_function+0x0/0x20 [ 2687.259245] [] top_trans_stop+0x420/0x920 [ptlrpc] [ 2687.268907] [] lod_trans_stop+0x259/0x340 [lod] [ 2687.278072] [] ? mdd_changelog_ns_store+0x2e/0x660 [mdd] [ 2687.288204] [] mdd_trans_stop+0x24/0x40 [mdd] [ 2687.297084] [] mdd_unlink+0x3f6/0xaa0 [mdd] [ 2687.305737] [] mdo_unlink+0x43/0x45 [mdt] [ 2687.314020] [] mdt_reint_unlink+0xc04/0x11a0 [mdt] [ 2687.323197] [] mdt_reint_rec+0x80/0x210 [mdt] [ 2687.331705] [] mdt_reint_internal+0x5fb/0x9c0 [mdt] [ 2687.340858] [] mdt_reint+0x67/0x140 [mdt] [ 2687.348897] [] tgt_request_handle+0x925/0x1370 [ptlrpc] [ 2687.358334] [] ptlrpc_server_handle_request+0x24e/0xab0 [ptlrpc] [ 2687.368551] [] ? ptlrpc_wait_event+0x98/0x340 [ptlrpc] [ 2687.377637] [] ? default_wake_function+0x12/0x20 [ 2687.386136] [] ? __wake_up_common+0x58/0x90 [ 2687.394071] [] ptlrpc_main+0xa92/0x1e40 [ptlrpc] [ 2687.402528] [] ? ptlrpc_main+0x0/0x1e40 [ptlrpc] [ 2687.410851] [] kthread+0xcf/0xe0 [ 2687.417606] [] ? kthread+0x0/0xe0 [ 2687.424320] [] ret_from_fork+0x58/0x90 [ 2687.431522] [] ? kthread+0x0/0xe0 [ 2687.438126] [ 2687.440838] LustreError: dumping log to /tmp/lustre-log.1510739485.2564 [ 2689.400611] LNet: Service thread pid 2696 was inactive for 202.91s. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes: [ 2689.424443] Pid: 2696, comm: mdt00_014 [ 2689.431021] Call Trace: [ 2689.439875] [] schedule+0x29/0x70 [ 2689.447449] [] schedule_timeout+0x174/0x2c0 [ 2689.455935] [] ? process_timeout+0x0/0x10 [ 2689.464077] [] ? ptlrpc_interrupted_set+0x0/0x110 [ptlrpc] [ 2689.473874] [] ptlrpc_set_wait+0x218/0x930 [ptlrpc] [ 2689.482718] [] ? default_wake_function+0x0/0x20 [ 2689.491280] [] ptlrpc_queue_wait+0x7d/0x220 [ptlrpc] [ 2689.500121] [] ldlm_cli_enqueue+0x686/0x810 [ptlrpc] [ 2689.508960] [] ? ldlm_prep_elc_req+0x125/0x490 [ptlrpc] [ 2689.517929] [] ? ldlm_completion_ast+0x0/0x920 [ptlrpc] [ 2689.526875] [] ? mdt_remote_blocking_ast+0x0/0x590 [mdt] [ 2689.535777] [] osp_md_object_lock+0x162/0x2d0 [osp] [ 2689.544181] [] lod_object_lock+0x424/0x950 [lod] [ 2689.552178] [] mdd_object_lock+0x3b/0xd0 [mdd] [ 2689.559983] [] mdt_lock_slaves+0x1c0/0x630 [mdt] [ 2689.567930] [] mdt_reint_unlink+0xa83/0x11a0 [mdt] [ 2689.576102] [] mdt_reint_rec+0x80/0x210 [mdt] [ 2689.583711] [] mdt_reint_internal+0x5fb/0x9c0 [mdt] [ 2689.591915] [] mdt_reint+0x67/0x140 [mdt] [ 2689.599118] [] tgt_request_handle+0x925/0x1370 [ptlrpc] [ 2689.607688] [] ptlrpc_server_handle_request+0x24e/0xab0 [ptlrpc] [ 2689.617104] [] ? ptlrpc_wait_event+0x98/0x340 [ptlrpc] [ 2689.625468] [] ? default_wake_function+0x12/0x20 [ 2689.633260] [] ? __wake_up_common+0x58/0x90 [ 2689.640556] [] ptlrpc_main+0xa92/0x1e40 [ptlrpc] [ 2689.648377] [] ? ptlrpc_main+0x0/0x1e40 [ptlrpc] [ 2689.656108] [] kthread+0xcf/0xe0 [ 2689.662297] [] ? kthread+0x0/0xe0 [ 2689.668534] [] ret_from_fork+0x58/0x90 [ 2689.675253] [] ? kthread+0x0/0xe0 [ 2689.681479] [ 2689.683822] Pid: 2697, comm: mdt01_016 [ 2689.688683] Call Trace: [ 2689.694357] [] schedule+0x29/0x70 [ 2689.700565] [] schedule_timeout+0x174/0x2c0 [ 2689.707745] [] ? process_timeout+0x0/0x10 [ 2689.714751] [] ? ptlrpc_interrupted_set+0x0/0x110 [ptlrpc] [ 2689.723416] [] ptlrpc_set_wait+0x218/0x930 [ptlrpc] [ 2689.731379] [] ? default_wake_function+0x0/0x20 [ 2689.738977] [] ptlrpc_queue_wait+0x7d/0x220 [ptlrpc] [ 2689.747070] [] ldlm_cli_enqueue+0x686/0x810 [ptlrpc] [ 2689.755160] [] ? ldlm_prep_elc_req+0x125/0x490 [ptlrpc] [ 2689.763518] [] ? ldlm_completion_ast+0x0/0x920 [ptlrpc] [ 2689.771833] [] ? mdt_remote_blocking_ast+0x0/0x590 [mdt] [ 2689.780238] [] osp_md_object_lock+0x162/0x2d0 [osp] [ 2689.788155] [] lod_object_lock+0x424/0x950 [lod] [ 2689.795804] [] mdd_object_lock+0x3b/0xd0 [mdd] [ 2689.803250] [] mdt_lock_slaves+0x1c0/0x630 [mdt] [ 2689.810892] [] mdt_reint_unlink+0xa83/0x11a0 [mdt] [ 2689.818743] [] mdt_reint_rec+0x80/0x210 [mdt] [ 2689.826095] [] mdt_reint_internal+0x5fb/0x9c0 [mdt] [ 2689.834024] [] mdt_reint+0x67/0x140 [mdt] [ 2689.840992] [] tgt_request_handle+0x925/0x1370 [ptlrpc] [ 2689.849324] [] ptlrpc_server_handle_request+0x24e/0xab0 [ptlrpc] [ 2689.858537] [] ? ptlrpc_wait_event+0x98/0x340 [ptlrpc] [ 2689.866751] [] ? default_wake_function+0x12/0x20 [ 2689.874387] [] ? __wake_up_common+0x58/0x90 [ 2689.881569] [] ptlrpc_main+0xa92/0x1e40 [ptlrpc] [ 2689.889207] [] ? __switch_to+0xd7/0x510 [ 2689.895980] [] ? __schedule+0x350/0x8b0 [ 2689.902766] [] ? ptlrpc_main+0x0/0x1e40 [ptlrpc] [ 2689.910421] [] kthread+0xcf/0xe0 [ 2689.916501] [] ? kthread+0x0/0xe0 [ 2689.922676] [] ret_from_fork+0x58/0x90 [ 2689.929328] [] ? kthread+0x0/0xe0 [ 2689.935498] [ 2689.937781] Pid: 2475, comm: mdt01_008 [ 2689.942580] Call Trace: [ 2689.948146] [] schedule+0x29/0x70 [ 2689.954298] [] schedule_timeout+0x174/0x2c0 [ 2689.961417] [] ? process_timeout+0x0/0x10 [ 2689.968364] [] ? ptlrpc_interrupted_set+0x0/0x110 [ptlrpc] [ 2689.976966] [] ptlrpc_set_wait+0x218/0x930 [ptlrpc] [ 2689.984870] [] ? default_wake_function+0x0/0x20 [ 2689.992419] [] ptlrpc_queue_wait+0x7d/0x220 [ptlrpc] [ 2690.000458] [] ldlm_cli_enqueue+0x686/0x810 [ptlrpc] [ 2690.008497] [] ? ldlm_prep_elc_req+0x125/0x490 [ptlrpc] [ 2690.016831] [] ? ldlm_completion_ast+0x0/0x920 [ptlrpc] [ 2690.025150] [] ? mdt_remote_blocking_ast+0x0/0x590 [mdt] [ 2690.033577] [] osp_md_object_lock+0x162/0x2d0 [osp] [ 2690.041513] [] lod_object_lock+0x424/0x950 [lod] [ 2690.049501] [] mdd_object_lock+0x3b/0xd0 [mdd] [ 2690.057299] [] mdt_lock_slaves+0x1c0/0x630 [mdt] [ 2690.065290] [] mdt_reint_unlink+0xa83/0x11a0 [mdt] [ 2690.073466] [] mdt_reint_rec+0x80/0x210 [mdt] [ 2690.081139] [] mdt_reint_internal+0x5fb/0x9c0 [mdt] [ 2690.089065] [] mdt_reint+0x67/0x140 [mdt] [ 2690.096050] [] tgt_request_handle+0x925/0x1370 [ptlrpc] [ 2690.104379] [] ptlrpc_server_handle_request+0x24e/0xab0 [ptlrpc] [ 2690.113599] [] ? ptlrpc_wait_event+0x98/0x340 [ptlrpc] [ 2690.121818] [] ? default_wake_function+0x12/0x20 [ 2690.129448] [] ? __wake_up_common+0x58/0x90 [ 2690.136627] [] ptlrpc_main+0xa92/0x1e40 [ptlrpc] [ 2690.144297] [] ? ptlrpc_main+0x0/0x1e40 [ptlrpc] [ 2690.151932] [] kthread+0xcf/0xe0 [ 2690.158010] [] ? kthread+0x0/0xe0 [ 2690.164188] [] ret_from_fork+0x58/0x90 [ 2690.170854] [] ? kthread+0x0/0xe0 [ 2690.177033] [ 2690.179314] Pid: 2415, comm: mdt01_004 [ 2690.184121] Call Trace: [ 2690.189688] [] schedule+0x29/0x70 [ 2690.195872] [] top_trans_wait_result+0xa6/0x155 [ptlrpc] [ 2690.204271] [] ? default_wake_function+0x0/0x20 [ 2690.211836] [] top_trans_stop+0x420/0x920 [ptlrpc] [ 2690.219657] [] lod_trans_stop+0x259/0x340 [lod] [ 2690.227174] [] ? mdd_changelog_ns_store+0x2e/0x660 [mdd] [ 2690.235568] [] mdd_trans_stop+0x24/0x40 [mdd] [ 2690.242882] [] mdd_create+0x10a3/0x1320 [mdd] [ 2690.250214] [] mdt_create+0x846/0xbb0 [mdt] [ 2690.257370] [] ? lprocfs_stats_lock+0x24/0xd0 [obdclass] [ 2690.265734] [] mdt_reint_create+0x16b/0x350 [mdt] [ 2690.273420] [] mdt_reint_rec+0x80/0x210 [mdt] [ 2690.280698] [] mdt_reint_internal+0x5fb/0x9c0 [mdt] [ 2690.288597] [] mdt_reint+0x67/0x140 [mdt] [ 2690.295503] [] tgt_request_handle+0x925/0x1370 [ptlrpc] [ 2690.303771] [] ptlrpc_server_handle_request+0x24e/0xab0 [ptlrpc] [ 2690.312921] [] ? ptlrpc_wait_event+0x98/0x340 [ptlrpc] [ 2690.321064] [] ? default_wake_function+0x12/0x20 [ 2690.328624] [] ? __wake_up_common+0x58/0x90 [ 2690.335718] [] ptlrpc_main+0xa92/0x1e40 [ptlrpc] [ 2690.343274] [] ? __switch_to+0xd7/0x510 [ 2690.349962] [] ? __schedule+0x350/0x8b0 [ 2690.356674] [] ? ptlrpc_main+0x0/0x1e40 [ptlrpc] [ 2690.364232] [] kthread+0xcf/0xe0 [ 2690.370239] [] ? kthread+0x0/0xe0 [ 2690.376330] [] ret_from_fork+0x58/0x90 [ 2690.382902] [] ? kthread+0x0/0xe0 [ 2690.388988] [ 2690.391188] LNet: Service thread pid 2662 was inactive for 203.91s. Watchdog stack traces are limited to 3 per 300 seconds, skipping this one. [ 2713.095007] Lustre: soaked-MDT0001: haven't heard from client soaked-MDT0002-mdtlov_UUID (at 192.168.1.110@o2ib) in 227 seconds. I think it's dead, and I am evicting it. exp ffff880824375000, cur 1510739511 expire 1510739361 last 1510739284 [ 2719.147195] Lustre: 2242:0:(client.c:2113:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1510739491/real 0] req@ffff8807deb10900 x1584122617727680/t0(0) o38->soaked-MDT0002-osp-MDT0001@192.168.1.110@o2ib:24/4 lens 520/544 e 0 to 1 dl 1510739517 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1 [ 2746.040655] LNet: 2231:0:(o2iblnd_cb.c:3198:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 2 seconds [ 2750.929460] Lustre: soaked-MDT0001: Connection restored to 192.168.1.111@o2ib (at 192.168.1.111@o2ib) [ 2750.941583] Lustre: Skipped 9 previous similar messages [ 2768.144076] LustreError: 167-0: soaked-MDT0002-osp-MDT0001: This client was evicted by soaked-MDT0002; in progress operations using this service will fail. [ 2768.163704] LNet: Service thread pid 2430 completed after 281.69s. This indicates the system was overloaded (too many service threads, or there were not enough hardware resources). [ 2768.178228] LustreError: 5323:0:(ldlm_resource.c:1094:ldlm_resource_complain()) soaked-MDT0002-osp-MDT0001: namespace resource [0x28000a846:0x17f5b:0x0].0x0 (ffff8803f3710d80) refcount nonzero (1) after lock cleanup; forcing cleanup. [ 2768.178233] LustreError: 5323:0:(ldlm_resource.c:1676:ldlm_resource_dump()) --- Resource: [0x28000a846:0x17f5b:0x0].0x0 (ffff8803f3710d80) refcount = 2 [ 2768.178235] LustreError: 5323:0:(ldlm_resource.c:1679:ldlm_resource_dump()) Granted locks (in reverse order): [ 2768.178244] LustreError: 5323:0:(ldlm_resource.c:1682:ldlm_resource_dump()) ### ### ns: soaked-MDT0002-osp-MDT0001 lock: ffff8807ce76b800/0x63957662e343d7d8 lrc: 2/0,1 mode: EX/EX res: [0x28000a846:0x17f5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1106401000000 nid: local remote: 0x978e8ccc11903b79 expref: -99 pid: 2563 timeout: 0 lvb_type: 0 [ 2768.178255] LustreError: 5323:0:(ldlm_resource.c:1676:ldlm_resource_dump()) --- Resource: [0x28000a846:0x17f7b:0x0].0x0 (ffff8803f3f6e9c0) refcount = 2 [ 2768.178257] LustreError: 5323:0:(ldlm_resource.c:1679:ldlm_resource_dump()) Granted locks (in reverse order): [ 2768.178278] LustreError: 5323:0:(ldlm_resource.c:1676:ldlm_resource_dump()) --- Resource: [0x28000a846:0x17bdc:0x0].0x0 (ffff8807f1262c00) refcount = 2 [ 2768.178279] LustreError: 5323:0:(ldlm_resource.c:1679:ldlm_resource_dump()) Granted locks (in reverse order): [ 2768.178301] LustreError: 5323:0:(ldlm_resource.c:1676:ldlm_resource_dump()) --- Resource: [0x240007934:0x15d4f:0x0].0x0 (ffff8803f06b98c0) refcount = 2 [ 2768.178303] LustreError: 5323:0:(ldlm_resource.c:1679:ldlm_resource_dump()) Granted locks (in reverse order): [ 2768.178362] LustreError: 5323:0:(ldlm_resource.c:1676:ldlm_resource_dump()) --- Resource: [0x28000a846:0x17be0:0x0].0x0 (ffff8800ab538f00) refcount = 2 [ 2768.178364] LustreError: 5323:0:(ldlm_resource.c:1679:ldlm_resource_dump()) Granted locks (in reverse order): [ 2768.178377] LustreError: 5323:0:(ldlm_resource.c:1676:ldlm_resource_dump()) --- Resource: [0x28000a843:0x3:0x0].0x0 (ffff8807f7c1a900) refcount = 2 [ 2768.178378] LustreError: 5323:0:(ldlm_resource.c:1679:ldlm_resource_dump()) Granted locks (in reverse order): [ 2768.178455] LustreError: 5323:0:(ldlm_resource.c:1676:ldlm_resource_dump()) --- Resource: [0x2400090a7:0xaee3:0x0].0x0 (ffff8807d577a9c0) refcount = 2 [ 2768.178457] LustreError: 5323:0:(ldlm_resource.c:1679:ldlm_resource_dump()) Granted locks (in reverse order): [ 2768.178481] LustreError: 5323:0:(ldlm_resource.c:1676:ldlm_resource_dump()) --- Resource: [0x28000a846:0x17be6:0x0].0x0 (ffff8803f13a3080) refcount = 2 [ 2768.178483] LustreError: 5323:0:(ldlm_resource.c:1679:ldlm_resource_dump()) Granted locks (in reverse order): [ 2768.178579] LustreError: 5323:0:(ldlm_resource.c:1676:ldlm_resource_dump()) --- Resource: [0x28000a846:0x17f6d:0x0].0x0 (ffff8803f1fa3440) refcount = 2 [ 2768.178581] LustreError: 5323:0:(ldlm_resource.c:1679:ldlm_resource_dump()) Granted locks (in reverse order): [ 2768.178652] LustreError: 5323:0:(ldlm_resource.c:1676:ldlm_resource_dump()) --- Resource: [0x24000793f:0x19959:0x0].0x0 (ffff8803f33b9980) refcount = 2 [ 2768.178653] LustreError: 5323:0:(ldlm_resource.c:1679:ldlm_resource_dump()) Granted locks (in reverse order): [ 2768.178687] LustreError: 5323:0:(ldlm_resource.c:1676:ldlm_resource_dump()) --- Resource: [0x24000b7b4:0xb6c6:0x0].0x0 (ffff8807e46ce6c0) refcount = 2 [ 2768.178688] LustreError: 5323:0:(ldlm_resource.c:1679:ldlm_resource_dump()) Granted locks (in reverse order): [ 2768.178715] LustreError: 5323:0:(ldlm_resource.c:1676:ldlm_resource_dump()) --- Resource: [0x28000a846:0x17f15:0x0].0x0 (ffff880818701200) refcount = 2 [ 2768.178716] LustreError: 5323:0:(ldlm_resource.c:1679:ldlm_resource_dump()) Granted locks (in reverse order): [ 2768.178753] LustreError: 5323:0:(ldlm_resource.c:1676:ldlm_resource_dump()) --- Resource: [0x28000a846:0x17ed8:0x0].0x0 (ffff8803f06b9a40) refcount = 2 [ 2768.178755] LustreError: 5323:0:(ldlm_resource.c:1679:ldlm_resource_dump()) Granted locks (in reverse order): [ 2768.178792] Lustre: soaked-MDT0002-osp-MDT0001: Connection restored to 192.168.1.111@o2ib (at 192.168.1.111@o2ib) [ 2768.660843] LNet: Skipped 15 previous similar messages [ 2773.467043] Lustre: soaked-MDT0001: Connection restored to 192.168.1.110@o2ib (at 192.168.1.110@o2ib) [ 2781.859729] LustreError: 11-0: soaked-MDT0002-osp-MDT0001: operation out_update to node 192.168.1.111@o2ib failed: rc = -107 [ 2781.875922] Lustre: soaked-MDT0002-osp-MDT0001: Connection to soaked-MDT0002 (at 192.168.1.111@o2ib) was lost; in progress operations using this service will wait for recovery to complete [ 2818.141228] LustreError: 167-0: soaked-MDT0002-osp-MDT0001: This client was evicted by soaked-MDT0002; in progress operations using this service will fail. [ 2818.165109] Lustre: soaked-MDT0002-osp-MDT0001: Connection restored to 192.168.1.110@o2ib (at 192.168.1.110@o2ib) [ 3012.025578] LNet: 2231:0:(o2iblnd_cb.c:3198:kiblnd_check_conns()) Timed out tx for 192.168.1.115@o2ib: 0 seconds [ 3412.436483] LustreError: 2566:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0001: expected 416 actual 344. [ 3412.450357] LustreError: 2566:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 2 previous similar messages [ 3426.858932] LustreError: 2304:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0001: expected 968 actual 416. [ 3426.873313] LustreError: 2304:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 2 previous similar messages [ 3430.607968] LustreError: 2566:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0001: expected 968 actual 416. [ 3608.593714] LustreError: 2404:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0001: expected 416 actual 344. [ 3608.710517] LustreError: 2404:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 14 previous similar messages [ 3623.570286] LustreError: 3325:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0001: expected 968 actual 416. [ 3623.687132] LustreError: 3325:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 2 previous similar messages [ 4432.595209] Lustre: 2254:0:(client.c:2113:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1510741222/real 0] req@ffff8803f66e8300 x1584122641215552/t0(0) o13->soaked-OST0017-osc-MDT0001@192.168.1.107@o2ib:7/4 lens 224/368 e 0 to 1 dl 1510741230 ref 2 fl Rpc:X/0/ffffffff rc 0/-1 [ 4432.635168] Lustre: soaked-OST0017-osc-MDT0001: Connection to soaked-OST0017 (at 192.168.1.107@o2ib) was lost; in progress operations using this service will wait for recovery to complete [ 4434.039134] Lustre: soaked-OST0011-osc-MDT0001: Connection to soaked-OST0011 (at 192.168.1.107@o2ib) was lost; in progress operations using this service will wait for recovery to complete [ 4434.064095] Lustre: Skipped 1 previous similar message [ 4449.847767] Lustre: 2261:0:(client.c:2113:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1510741223/real 1510741247] req@ffff8803d465a700 x1584122641218432/t0(0) o6->soaked-OST0017-osc-MDT0001@192.168.1.107@o2ib:28/4 lens 664/432 e 0 to 1 dl 1510741271 ref 1 fl Rpc:eX/0/ffffffff rc 0/-1 [ 4449.888736] Lustre: 2261:0:(client.c:2113:ptlrpc_expire_one_request()) Skipped 35 previous similar messages [ 4484.548775] Lustre: 2242:0:(client.c:2113:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1510741282/real 1510741282] req@ffff8807b524c500 x1584122641419376/t0(0) o8->soaked-OST0011-osc-MDT0001@192.168.1.107@o2ib:28/4 lens 520/544 e 0 to 1 dl 1510741293 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1 [ 4484.590046] Lustre: 2242:0:(client.c:2113:ptlrpc_expire_one_request()) Skipped 1 previous similar message [ 4534.545929] Lustre: 2242:0:(client.c:2113:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1510741332/real 1510741332] req@ffff8807f37a5400 x1584122641543760/t0(0) o8->soaked-OST0017-osc-MDT0001@192.168.1.107@o2ib:28/4 lens 520/544 e 0 to 1 dl 1510741349 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1 [ 4534.588044] Lustre: 2242:0:(client.c:2113:ptlrpc_expire_one_request()) Skipped 3 previous similar messages [ 4634.541226] Lustre: 2242:0:(client.c:2113:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1510741432/real 1510741432] req@ffff8807b6a02d00 x1584122642253344/t0(0) o8->soaked-OST0011-osc-MDT0001@192.168.1.107@o2ib:28/4 lens 520/544 e 0 to 1 dl 1510741458 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1 [ 4634.644804] Lustre: 2242:0:(client.c:2113:ptlrpc_expire_one_request()) Skipped 7 previous similar messages [ 4690.460676] Lustre: soaked-MDT0001: Received LWP connection from 192.168.1.106@o2ib, removing former export from 192.168.1.107@o2ib [ 4690.505937] Lustre: soaked-MDT0001: Connection restored to 192.168.1.106@o2ib (at 192.168.1.106@o2ib) [ 4714.542691] Lustre: soaked-MDT0001: Received LWP connection from 192.168.1.106@o2ib, removing former export from 192.168.1.107@o2ib [ 4714.588683] Lustre: soaked-MDT0001: Connection restored to 192.168.1.106@o2ib (at 192.168.1.106@o2ib) [ 4739.927759] LNet: 2231:0:(o2iblnd_cb.c:3198:kiblnd_check_conns()) Timed out tx for 192.168.1.107@o2ib: 5 seconds [ 4742.726924] Lustre: soaked-MDT0001: Received LWP connection from 192.168.1.106@o2ib, removing former export from 192.168.1.107@o2ib [ 4742.772233] Lustre: soaked-MDT0001: Connection restored to 192.168.1.106@o2ib (at 192.168.1.106@o2ib) [ 4754.589642] Lustre: soaked-OST0017-osc-MDT0001: Connection restored to 192.168.1.106@o2ib (at 192.168.1.106@o2ib) [ 4765.961874] Lustre: soaked-MDT0001: Received LWP connection from 192.168.1.106@o2ib, removing former export from 192.168.1.107@o2ib [ 4771.367064] Lustre: soaked-OST0005-osc-MDT0001: Connection restored to 192.168.1.106@o2ib (at 192.168.1.106@o2ib) [ 4771.404161] Lustre: Skipped 1 previous similar message [ 4800.753284] Lustre: 2242:0:(client.c:2113:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1510741562/real 0] req@ffff8807c8a69500 x1584122643329280/t0(0) o8->soaked-OST0011-osc-MDT0001@192.168.1.107@o2ib:28/4 lens 520/544 e 0 to 1 dl 1510741598 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1 [ 4800.852972] Lustre: 2242:0:(client.c:2113:ptlrpc_expire_one_request()) Skipped 7 previous similar messages [ 4804.601138] Lustre: soaked-OST000b-osc-MDT0001: Connection restored to 192.168.1.106@o2ib (at 192.168.1.106@o2ib) [ 4815.923576] LNet: 2231:0:(o2iblnd_cb.c:3198:kiblnd_check_conns()) Timed out tx for 192.168.1.107@o2ib: 0 seconds [ 4815.960639] LNet: 2231:0:(o2iblnd_cb.c:3198:kiblnd_check_conns()) Skipped 3 previous similar messages [ 4832.957939] LustreError: 11-0: soaked-OST0017-osc-MDT0001: operation ost_destroy to node 192.168.1.106@o2ib failed: rc = -107 [ 4832.957952] Lustre: soaked-OST0017-osc-MDT0001: Connection to soaked-OST0017 (at 192.168.1.106@o2ib) was lost; in progress operations using this service will wait for recovery to complete [ 4832.957955] Lustre: Skipped 1 previous similar message [ 4833.081106] LustreError: Skipped 3 previous similar messages [ 4851.559779] LustreError: 11-0: soaked-OST0005-osc-MDT0001: operation ost_statfs to node 192.168.1.106@o2ib failed: rc = -19 [ 4851.599647] Lustre: soaked-OST0005-osc-MDT0001: Connection to soaked-OST0005 (at 192.168.1.106@o2ib) was lost; in progress operations using this service will wait for recovery to complete [ 4859.719451] LustreError: 11-0: soaked-OST000b-osc-MDT0001: operation ost_statfs to node 192.168.1.106@o2ib failed: rc = -107 [ 4859.759978] Lustre: soaked-OST000b-osc-MDT0001: Connection to soaked-OST000b (at 192.168.1.106@o2ib) was lost; in progress operations using this service will wait for recovery to complete [ 4868.237000] LustreError: 11-0: soaked-OST0011-osc-MDT0001: operation ost_destroy to node 192.168.1.106@o2ib failed: rc = -107 [ 4868.237322] Lustre: soaked-OST0011-osc-MDT0001: Connection to soaked-OST0011 (at 192.168.1.106@o2ib) was lost; in progress operations using this service will wait for recovery to complete [ 4868.340333] LustreError: Skipped 6 previous similar messages [ 4871.158022] Lustre: soaked-OST0005-osc-MDT0001: Connection restored to 192.168.1.107@o2ib (at 192.168.1.107@o2ib) [ 4871.195203] Lustre: Skipped 5 previous similar messages [ 7246.122084] LustreError: 2564:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0001: expected 968 actual 344. [ 7246.135453] LustreError: 2564:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 15 previous similar messages [ 7249.421703] LustreError: 2560:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0001: expected 416 actual 344. [ 7265.247150] LustreError: 2525:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0001: expected 968 actual 416. [ 8382.627888] LustreError: 2694:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0001: expected 416 actual 344. [ 8396.410772] LustreError: 2304:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0001: expected 968 actual 416. [ 8399.581426] LustreError: 2430:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0001: expected 416 actual 344. [ 8399.594510] LustreError: 2430:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 4 previous similar messages [ 8417.120403] LustreError: 2304:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0001: expected 968 actual 416. [ 8417.133879] LustreError: 2304:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 3 previous similar messages [ 8703.283793] perf: interrupt took too long (2501 > 2500), lowering kernel.perf_event_max_sample_rate to 79000 [ 8847.845295] Lustre: 2271:0:(client.c:2113:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1510745639/real 0] req@ffff88075baff200 x1584122744152336/t0(0) o400->soaked-MDT0000-lwp-MDT0001@192.168.1.108@o2ib:12/10 lens 224/224 e 0 to 1 dl 1510745646 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1 [ 8847.885820] Lustre: soaked-MDT0000-lwp-MDT0001: Connection to soaked-MDT0000 (at 192.168.1.108@o2ib) was lost; in progress operations using this service will wait for recovery to complete [ 8848.910208] LustreError: 166-1: MGC192.168.1.108@o2ib: Connection to MGS (at 192.168.1.108@o2ib) was lost; in progress operations using this service will fail [ 8864.653761] Lustre: soaked-MDT0000-osp-MDT0001: Connection to soaked-MDT0000 (at 192.168.1.108@o2ib) was lost; in progress operations using this service will wait for recovery to complete [ 8868.661897] LustreError: 137-5: soaked-MDT0000_UUID: not available for connect from 192.168.1.117@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8869.253656] LustreError: 137-5: soaked-MDT0000_UUID: not available for connect from 192.168.1.143@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8869.279713] LustreError: Skipped 4 previous similar messages [ 8870.349726] LustreError: 137-5: soaked-MDT0000_UUID: not available for connect from 192.168.1.133@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8870.375308] LustreError: Skipped 15 previous similar messages [ 8872.654925] LustreError: 137-5: soaked-MDT0000_UUID: not available for connect from 192.168.1.102@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8872.681022] LustreError: Skipped 8 previous similar messages [ 8876.676156] LustreError: 137-5: soaked-MDT0000_UUID: not available for connect from 192.168.1.135@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8876.702154] LustreError: Skipped 9 previous similar messages [ 8886.271576] LustreError: 137-5: soaked-MDT0000_UUID: not available for connect from 192.168.1.105@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8886.297761] LustreError: Skipped 11 previous similar messages [ 8895.676571] Lustre: 2242:0:(client.c:2113:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1510745687/real 1510745687] req@ffff88075baf8c00 x1584122744158736/t0(0) o250->MGC192.168.1.108@o2ib@0@lo:26/25 lens 520/544 e 0 to 1 dl 1510745693 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [ 8895.716293] Lustre: 2242:0:(client.c:2113:ptlrpc_expire_one_request()) Skipped 5 previous similar messages [ 8918.822004] LustreError: 137-5: soaked-MDT0000_UUID: not available for connect from 192.168.1.117@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8918.848057] LustreError: Skipped 8 previous similar messages [ 8964.673248] Lustre: 2242:0:(client.c:2113:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1510745762/real 1510745762] req@ffff88075bafa700 x1584122744164736/t0(0) o250->MGC192.168.1.108@o2ib@192.168.1.108@o2ib:26/25 lens 520/544 e 0 to 1 dl 1510745778 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1 [ 8964.715072] Lustre: 2242:0:(client.c:2113:ptlrpc_expire_one_request()) Skipped 4 previous similar messages [ 8968.026348] LustreError: 137-5: soaked-MDT0000_UUID: not available for connect from 192.168.1.110@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server. [ 8968.052717] LustreError: Skipped 54 previous similar messages [ 9020.788898] sd 0:0:0:0: rdac: array soak-netapp2624-1, ctlr 0, queueing MODE_SELECT command [ 9021.303373] sd 0:0:0:0: rdac: array soak-netapp2624-1, ctlr 0, MODE_SELECT returned with sense 05/91/36 [ 9021.317303] sd 0:0:0:0: rdac: array soak-netapp2624-1, ctlr 0, queueing MODE_SELECT command [ 9021.832931] sd 0:0:0:0: rdac: array soak-netapp2624-1, ctlr 0, MODE_SELECT returned with sense 05/91/36 [ 9021.846872] sd 0:0:0:0: rdac: array soak-netapp2624-1, ctlr 0, queueing MODE_SELECT command [ 9022.362125] sd 0:0:0:0: rdac: array soak-netapp2624-1, ctlr 0, MODE_SELECT returned with sense 05/91/36 [ 9022.375829] sd 0:0:0:0: rdac: array soak-netapp2624-1, ctlr 0, queueing MODE_SELECT command [ 9022.895469] sd 0:0:0:0: rdac: array soak-netapp2624-1, ctlr 0, MODE_SELECT returned with sense 05/91/36 [ 9022.909313] sd 0:0:0:0: rdac: array soak-netapp2624-1, ctlr 0, queueing MODE_SELECT command [ 9023.426721] sd 0:0:0:0: rdac: array soak-netapp2624-1, ctlr 0, MODE_SELECT returned with sense 05/91/36 [ 9023.440486] sd 0:0:0:0: rdac: array soak-netapp2624-1, ctlr 0, queueing MODE_SELECT command [ 9023.962223] sd 0:0:0:0: rdac: array soak-netapp2624-1, ctlr 0, MODE_SELECT returned with sense 05/91/36 [ 9023.975640] sd 0:0:0:0: rdac: array soak-netapp2624-1, ctlr 0, queueing MODE_SELECT command [ 9024.492589] sd 0:0:0:0: rdac: array soak-netapp2624-1, ctlr 0, MODE_SELECT returned with sense 05/91/36 [ 9024.506141] sd 0:0:0:0: rdac: array soak-netapp2624-1, ctlr 0, queueing MODE_SELECT command [ 9025.028822] sd 0:0:0:0: rdac: array soak-netapp2624-1, ctlr 0, MODE_SELECT returned with sense 05/91/36 [ 9025.042062] sd 0:0:0:0: rdac: array soak-netapp2624-1, ctlr 0, queueing MODE_SELECT command [ 9025.557169] sd 0:0:0:0: rdac: array soak-netapp2624-1, ctlr 0, MODE_SELECT returned with sense 05/91/36 [ 9025.570515] sd 0:0:0:0: rdac: array soak-netapp2624-1, ctlr 0, queueing MODE_SELECT command [ 9026.095443] sd 0:0:0:0: rdac: array soak-netapp2624-1, ctlr 0, MODE_SELECT returned with sense 05/91/36 [ 9026.108677] sd 0:0:0:0: rdac: array soak-netapp2624-1, ctlr 0, queueing MODE_SELECT command [ 9026.123080] sd 0:0:0:0: rdac: array soak-netapp2624-1, ctlr 0, MODE_SELECT completed [ 9032.598507] LustreError: 137-5: soaked-MDT0000_UUID: not available for connect from 192.168.1.107@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9032.623608] LustreError: Skipped 103 previous similar messages [ 9043.817811] Lustre: soaked-MDT0001: haven't heard from client soaked-MDT0000-mdtlov_UUID (at 192.168.1.108@o2ib) in 227 seconds. I think it's dead, and I am evicting it. exp ffff880804a0fc00, cur 1510745842 expire 1510745692 last 1510745615 [ 9108.680512] LNet: 2231:0:(o2iblnd_cb.c:3198:kiblnd_check_conns()) Timed out tx for 192.168.1.108@o2ib: 10 seconds [ 9120.679804] LNet: 2231:0:(o2iblnd_cb.c:3198:kiblnd_check_conns()) Timed out tx for 192.168.1.108@o2ib: 6 seconds [ 9120.715921] LNet: 2231:0:(o2iblnd_cb.c:3198:kiblnd_check_conns()) Skipped 1 previous similar message [ 9165.661291] Lustre: 2242:0:(client.c:2113:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1510745937/real 1510745937] req@ffff88075bafa100 x1584122744178624/t0(0) o250->MGC192.168.1.108@o2ib@0@lo:26/25 lens 520/544 e 0 to 1 dl 1510745963 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [ 9165.758601] Lustre: 2242:0:(client.c:2113:ptlrpc_expire_one_request()) Skipped 10 previous similar messages [ 9168.014983] LustreError: 137-5: soaked-MDT0000_UUID: not available for connect from 192.168.1.110@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9168.078604] LustreError: Skipped 103 previous similar messages [ 9196.675497] LNet: 2231:0:(o2iblnd_cb.c:3198:kiblnd_check_conns()) Timed out tx for 192.168.1.108@o2ib: 10 seconds [ 9246.672687] LNet: 2231:0:(o2iblnd_cb.c:3198:kiblnd_check_conns()) Timed out tx for 192.168.1.108@o2ib: 7 seconds [ 9246.708735] LNet: 2231:0:(o2iblnd_cb.c:3198:kiblnd_check_conns()) Skipped 1 previous similar message [ 9300.343481] Lustre: soaked-MDT0001: Connection restored to 192.168.1.108@o2ib (at 192.168.1.108@o2ib) [ 9300.376342] Lustre: Skipped 3 previous similar messages [ 9314.653414] Lustre: Evicted from MGS (at 192.168.1.108@o2ib) after server handle changed from 0x3e009cb10be58820 to 0x405d9a5f614718cb [ 9314.698312] LustreError: 167-0: soaked-MDT0000-lwp-MDT0001: This client was evicted by soaked-MDT0000; in progress operations using this service will fail. [ 9900.797142] Lustre: soaked-MDT0000-osp-MDT0001: Connection restored to 192.168.1.108@o2ib (at 192.168.1.108@o2ib) [ 9900.834773] Lustre: Skipped 2 previous similar messages [10864.693035] Lustre: 2268:0:(client.c:2113:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1510747655/real 0] req@ffff88076e66dd00 x1584122778361040/t0(0) o13->soaked-OST0004-osc-MDT0001@192.168.1.106@o2ib:7/4 lens 224/368 e 0 to 1 dl 1510747663 ref 2 fl Rpc:X/0/ffffffff rc 0/-1 [10864.791587] Lustre: 2268:0:(client.c:2113:ptlrpc_expire_one_request()) Skipped 6 previous similar messages [10864.826143] Lustre: soaked-OST0004-osc-MDT0001: Connection to soaked-OST0004 (at 192.168.1.106@o2ib) was lost; in progress operations using this service will wait for recovery to complete [10865.565007] Lustre: soaked-OST000a-osc-MDT0001: Connection to soaked-OST000a (at 192.168.1.106@o2ib) was lost; in progress operations using this service will wait for recovery to complete [10877.891988] Lustre: soaked-OST0016-osc-MDT0001: Connection to soaked-OST0016 (at 192.168.1.106@o2ib) was lost; in progress operations using this service will wait for recovery to complete [10877.952048] Lustre: Skipped 1 previous similar message [10902.970325] Lustre: 2242:0:(client.c:2113:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1510747701/real 1510747701] req@ffff88074567d400 x1584122779326048/t0(0) o8->soaked-OST0016-osc-MDT0001@192.168.1.106@o2ib:28/4 lens 520/544 e 0 to 1 dl 1510747712 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1 [10903.073620] Lustre: 2242:0:(client.c:2113:ptlrpc_expire_one_request()) Skipped 30 previous similar messages [10977.966009] Lustre: 2242:0:(client.c:2113:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1510747776/real 1510747776] req@ffff880743e4fb00 x1584122782601376/t0(0) o8->soaked-OST0004-osc-MDT0001@192.168.1.106@o2ib:28/4 lens 520/544 e 0 to 1 dl 1510747793 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1 [10978.320213] Lustre: 2242:0:(client.c:2113:ptlrpc_expire_one_request()) Skipped 4 previous similar messages [11104.490957] Lustre: soaked-MDT0001: Received LWP connection from 192.168.1.107@o2ib, removing former export from 192.168.1.106@o2ib [11104.536251] Lustre: soaked-MDT0001: Connection restored to 192.168.1.107@o2ib (at 192.168.1.107@o2ib) [11122.741652] Lustre: soaked-MDT0001: Received LWP connection from 192.168.1.107@o2ib, removing former export from 192.168.1.106@o2ib [11122.786888] Lustre: soaked-MDT0001: Connection restored to 192.168.1.107@o2ib (at 192.168.1.107@o2ib) [11133.956816] Lustre: 2242:0:(client.c:2113:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1510747901/real 0] req@ffff8807a6b3ce00 x1584122784653760/t0(0) o8->soaked-OST0016-osc-MDT0001@192.168.1.106@o2ib:28/4 lens 520/544 e 0 to 1 dl 1510747932 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1 [11134.058848] Lustre: 2242:0:(client.c:2113:ptlrpc_expire_one_request()) Skipped 10 previous similar messages [11147.918030] Lustre: soaked-MDT0001: Received LWP connection from 192.168.1.107@o2ib, removing former export from 192.168.1.106@o2ib [11147.963767] Lustre: soaked-MDT0001: Connection restored to 192.168.1.107@o2ib (at 192.168.1.107@o2ib) [11153.564715] LNet: 2231:0:(o2iblnd_cb.c:3198:kiblnd_check_conns()) Timed out tx for 192.168.1.106@o2ib: 0 seconds [11169.004333] Lustre: soaked-MDT0001: Received LWP connection from 192.168.1.107@o2ib, removing former export from 192.168.1.106@o2ib [11169.050731] Lustre: soaked-MDT0001: Connection restored to 192.168.1.107@o2ib (at 192.168.1.107@o2ib) [11178.563295] LNet: 2231:0:(o2iblnd_cb.c:3198:kiblnd_check_conns()) Timed out tx for 192.168.1.106@o2ib: 0 seconds [11240.276613] Lustre: soaked-OST0010-osc-MDT0001: Connection restored to 192.168.1.107@o2ib (at 192.168.1.107@o2ib) [11240.403058] Lustre: Skipped 3 previous similar messages [11256.249409] LustreError: 11-0: soaked-OST0016-osc-MDT0001: operation ost_create to node 192.168.1.107@o2ib failed: rc = -107 [11256.387543] LustreError: Skipped 1 previous similar message [11256.458111] Lustre: soaked-OST0016-osc-MDT0001: Connection to soaked-OST0016 (at 192.168.1.107@o2ib) was lost; in progress operations using this service will wait for recovery to complete [11256.665719] LustreError: 2379:0:(osp_precreate.c:642:osp_precreate_send()) soaked-OST0016-osc-MDT0001: can't precreate: rc = -107 [11281.871202] LustreError: 11-0: soaked-OST0004-osc-MDT0001: operation ost_create to node 192.168.1.107@o2ib failed: rc = -107 [11282.007945] Lustre: soaked-OST0004-osc-MDT0001: Connection to soaked-OST0004 (at 192.168.1.107@o2ib) was lost; in progress operations using this service will wait for recovery to complete [11282.215110] LustreError: 2343:0:(osp_precreate.c:642:osp_precreate_send()) soaked-OST0004-osc-MDT0001: can't precreate: rc = -107 [11291.005760] LustreError: 11-0: soaked-OST000a-osc-MDT0001: operation ost_destroy to node 192.168.1.107@o2ib failed: rc = -107 [11291.005808] Lustre: soaked-OST000a-osc-MDT0001: Connection to soaked-OST000a (at 192.168.1.107@o2ib) was lost; in progress operations using this service will wait for recovery to complete [11291.352396] LustreError: Skipped 5 previous similar messages [11296.534211] LustreError: 11-0: soaked-OST0010-osc-MDT0001: operation ost_destroy to node 192.168.1.107@o2ib failed: rc = -107 [11296.673517] LustreError: Skipped 4 previous similar messages [11305.424522] Lustre: soaked-OST000a-osc-MDT0001: Connection restored to 192.168.1.106@o2ib (at 192.168.1.106@o2ib) [11305.551172] Lustre: Skipped 5 previous similar messages [11494.545419] LNet: 2231:0:(o2iblnd_cb.c:3198:kiblnd_check_conns()) Timed out tx for 192.168.1.114@o2ib: 1 seconds [11494.670937] LNet: 2231:0:(o2iblnd_cb.c:3198:kiblnd_check_conns()) Skipped 2 previous similar messages [12087.813212] LustreError: 2303:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0001: expected 416 actual 344. [12087.929406] LustreError: 2303:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 10 previous similar messages [12102.368945] LustreError: 2300:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0001: expected 968 actual 416. [12104.882968] LustreError: 2564:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0001: expected 968 actual 416. [12181.788014] LustreError: 2566:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0001: expected 416 actual 344. [12181.801151] LustreError: 2566:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 1 previous similar message [12198.260012] LustreError: 2304:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0001: expected 968 actual 416. [12198.274118] LustreError: 2304:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 2 previous similar messages [12314.128354] perf: interrupt took too long (3142 > 3126), lowering kernel.perf_event_max_sample_rate to 63000 [15494.213040] Lustre: 2243:0:(client.c:2113:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1510752285/real 0] req@ffff8803e43a6900 x1584122939688576/t0(0) o13->soaked-OST0014-osc-MDT0001@192.168.1.104@o2ib:7/4 lens 224/368 e 0 to 1 dl 1510752292 ref 2 fl Rpc:X/0/ffffffff rc 0/-1 [15494.313831] Lustre: 2243:0:(client.c:2113:ptlrpc_expire_one_request()) Skipped 3 previous similar messages [15494.348895] Lustre: soaked-OST0014-osc-MDT0001: Connection to soaked-OST0014 (at 192.168.1.104@o2ib) was lost; in progress operations using this service will wait for recovery to complete [15494.410304] Lustre: Skipped 1 previous similar message [15496.429871] Lustre: soaked-OST0002-osc-MDT0001: Connection to soaked-OST0002 (at 192.168.1.104@o2ib) was lost; in progress operations using this service will wait for recovery to complete [15496.491221] Lustre: Skipped 1 previous similar message [15547.610497] Lustre: 2242:0:(client.c:2113:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1510752346/real 1510752346] req@ffff880382349800 x1584122939693856/t0(0) o8->soaked-OST000e-osc-MDT0001@192.168.1.104@o2ib:28/4 lens 520/544 e 0 to 1 dl 1510752357 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1 [15547.715381] Lustre: 2242:0:(client.c:2113:ptlrpc_expire_one_request()) Skipped 37 previous similar messages [15647.604841] Lustre: 2242:0:(client.c:2113:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1510752446/real 1510752446] req@ffff88038234ec00 x1584122939700848/t0(0) o8->soaked-OST0014-osc-MDT0001@192.168.1.104@o2ib:28/4 lens 520/544 e 0 to 1 dl 1510752467 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1 [15647.960002] Lustre: 2242:0:(client.c:2113:ptlrpc_expire_one_request()) Skipped 7 previous similar messages [15673.308855] LNet: 2231:0:(o2iblnd_cb.c:3198:kiblnd_check_conns()) Timed out tx for 192.168.1.114@o2ib: 0 seconds [15748.304652] LNet: 2231:0:(o2iblnd_cb.c:3198:kiblnd_check_conns()) Timed out tx for 192.168.1.104@o2ib: 125 seconds [15748.319423] LNet: 2231:0:(o2iblnd_cb.c:3198:kiblnd_check_conns()) Skipped 1 previous similar message [15778.596897] Lustre: 2242:0:(client.c:2113:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1510752546/real 0] req@ffff88038234e600 x1584122939707792/t0(0) o8->soaked-OST0008-osc-MDT0001@192.168.1.104@o2ib:28/4 lens 520/544 e 0 to 1 dl 1510752577 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1 [15778.637149] Lustre: 2242:0:(client.c:2113:ptlrpc_expire_one_request()) Skipped 8 previous similar messages [15798.301951] LNet: 2231:0:(o2iblnd_cb.c:3198:kiblnd_check_conns()) Timed out tx for 192.168.1.104@o2ib: 0 seconds [15849.298935] LNet: 2231:0:(o2iblnd_cb.c:3198:kiblnd_check_conns()) Timed out tx for 192.168.1.104@o2ib: 1 seconds [15849.313361] LNet: 2231:0:(o2iblnd_cb.c:3198:kiblnd_check_conns()) Skipped 2 previous similar messages [15887.296760] LNet: 2231:0:(o2iblnd_cb.c:3198:kiblnd_check_conns()) Timed out tx for 192.168.1.104@o2ib: 1 seconds [15899.296092] LNet: 2231:0:(o2iblnd_cb.c:3198:kiblnd_check_conns()) Timed out tx for 192.168.1.104@o2ib: 2 seconds [15950.294194] LNet: 2231:0:(o2iblnd_cb.c:3198:kiblnd_check_conns()) Timed out tx for 192.168.1.104@o2ib: 3 seconds [15950.308374] LNet: 2231:0:(o2iblnd_cb.c:3198:kiblnd_check_conns()) Skipped 1 previous similar message [16000.290373] LNet: 2231:0:(o2iblnd_cb.c:3198:kiblnd_check_conns()) Timed out tx for 192.168.1.104@o2ib: 3 seconds [16000.304531] LNet: 2231:0:(o2iblnd_cb.c:3198:kiblnd_check_conns()) Skipped 1 previous similar message [16034.855726] LNet: 179:0:(o2iblnd_cb.c:2411:kiblnd_passive_connect()) Conn stale 192.168.1.104@o2ib version 12/12 incarnation 1510752832793665/1510752832793665 [16035.188748] Lustre: soaked-MDT0001: Received new LWP connection from 192.168.1.104@o2ib, removing former export from same NID [16035.204271] format at ldlm_lib.c:1201:target_handle_connect doesn't end in newline [16035.288358] LNet: 2231:0:(o2iblnd_cb.c:1356:kiblnd_reconnect_peer()) Abort reconnection of 192.168.1.104@o2ib: connected [16035.215642] Lustre: soaked-MDT0001: Rejecting reconnect from the known client soaked-MDT0001-lwp-OST0008_UUID (at 192.168.1.104@o2ib) because it is indicating it is a new client [16039.942201] Lustre: soaked-MDT0001: Received new LWP connection from 192.168.1.104@o2ib, removing former export from same NID [16039.960981] format at ldlm_lib.c:1201:target_handle_connect doesn't end in newline [16043.717905] Lustre: 2242:0:(client.c:2113:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1510752796/real 1510752833] req@ffff8807fc06da00 x1584122939724912/t0(0) o8->soaked-OST0014-osc-MDT0001@192.168.1.104@o2ib:28/4 lens 520/544 e 0 to 1 dl 1510752842 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [16043.759225] Lustre: 2242:0:(client.c:2113:ptlrpc_expire_one_request()) Skipped 10 previous similar messages [16044.220774] Lustre: soaked-MDT0001: Received new LWP connection from 192.168.1.104@o2ib, removing former export from same NID [16044.236627] format at ldlm_lib.c:1201:target_handle_connect doesn't end in newline [16039.972221] Lustre: soaked-MDT0001: Rejecting reconnect from the known client soaked-MDT0001-lwp-OST0014_UUID (at 192.168.1.104@o2ib) because it is indicating it is a new client [16044.247998] Lustre: soaked-MDT0001: Rejecting reconnect from the known client soaked-MDT0001-lwp-OST0002_UUID (at 192.168.1.104@o2ib) because it is indicating it is a new client [16052.277355] Lustre: soaked-MDT0001: Received new LWP connection from 192.168.1.104@o2ib, removing former export from same NID [16052.296442] format at ldlm_lib.c:1201:target_handle_connect doesn't end in newline [16062.269193] Lustre: soaked-OST0014-osc-MDT0001: Connection restored to 192.168.1.104@o2ib (at 192.168.1.104@o2ib) [16062.287039] Lustre: Skipped 2 previous similar messages [16077.278833] LustreError: 137-5: soaked-MDT0000_UUID: not available for connect from 192.168.1.104@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server. [16077.305047] LustreError: Skipped 144 previous similar messages [16081.612294] Lustre: soaked-OST000e-osc-MDT0001: Connection restored to 192.168.1.104@o2ib (at 192.168.1.104@o2ib) [16081.627001] Lustre: Skipped 2 previous similar messages [16096.988830] LustreError: 3326:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0001: expected 416 actual 344. [16097.000904] LustreError: 3326:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 2 previous similar messages [16102.277987] Lustre: soaked-MDT0001: Received new LWP connection from 192.168.1.104@o2ib, removing former export from same NID [16102.292852] Lustre: Skipped 3 previous similar messages [16112.626171] LustreError: 2447:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0001: expected 968 actual 416. [16112.639556] LustreError: 2447:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 18 previous similar messages [16114.695633] LustreError: 7017:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0001: expected 968 actual 416. [16114.709306] LustreError: 7017:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 9 previous similar messages [16127.276806] LustreError: 137-5: soaked-MDT0000_UUID: not available for connect from 192.168.1.104@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server. [16127.276809] LustreError: 137-5: soaked-MDT0000_UUID: not available for connect from 192.168.1.104@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server. [16127.276812] LustreError: Skipped 1 previous similar message [16127.338474] LustreError: Skipped 1 previous similar message [16152.275251] Lustre: soaked-MDT0001: Received new LWP connection from 192.168.1.104@o2ib, removing former export from same NID [16152.275253] Lustre: soaked-MDT0001: Received new LWP connection from 192.168.1.104@o2ib, removing former export from same NID [16152.307183] Lustre: Skipped 2 previous similar messages [16202.272224] Lustre: soaked-MDT0001: Received new LWP connection from 192.168.1.104@o2ib, removing former export from same NID [16202.287962] Lustre: Skipped 3 previous similar messages [16252.269295] Lustre: soaked-MDT0001: Received new LWP connection from 192.168.1.104@o2ib, removing former export from same NID [16252.284524] Lustre: Skipped 2 previous similar messages [16277.267918] LustreError: 137-5: soaked-MDT0000_UUID: not available for connect from 192.168.1.104@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server. [16277.293361] LustreError: Skipped 10 previous similar messages [16352.263610] Lustre: soaked-MDT0001: Received new LWP connection from 192.168.1.104@o2ib, removing former export from same NID [16352.304001] Lustre: Skipped 6 previous similar messages [16052.307807] Lustre: soaked-MDT0001: Rejecting reconnect from the known client soaked-MDT0001-lwp-OST000e_UUID (at 192.168.1.104@o2ib) because it is indicating it is a new client [16402.260771] Lustre: soaked-MDT0001: Connection restored to 192.168.1.104@o2ib (at 192.168.1.104@o2ib) [16402.260772] Lustre: soaked-MDT0001: Connection restored to 192.168.1.104@o2ib (at 192.168.1.104@o2ib) [16402.332456] Lustre: Skipped 2 previous similar messages [16753.956673] Lustre: 2250:0:(client.c:2113:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1510753535/real 0] req@ffff8800aa049200 x1584122953398368/t0(0) o13->soaked-OST0003-osc-MDT0001@192.168.1.105@o2ib:7/4 lens 224/368 e 0 to 1 dl 1510753542 ref 2 fl Rpc:X/0/ffffffff rc 0/-1 [16753.997046] Lustre: 2250:0:(client.c:2113:ptlrpc_expire_one_request()) Skipped 1 previous similar message [16754.010890] Lustre: soaked-OST0003-osc-MDT0001: Connection to soaked-OST0003 (at 192.168.1.105@o2ib) was lost; in progress operations using this service will wait for recovery to complete [16754.034822] Lustre: Skipped 1 previous similar message [16757.053535] Lustre: soaked-OST000f-osc-MDT0001: Connection to soaked-OST000f (at 192.168.1.105@o2ib) was lost; in progress operations using this service will wait for recovery to complete [16757.077511] Lustre: Skipped 2 previous similar messages [16787.870766] perf: interrupt took too long (3929 > 3927), lowering kernel.perf_event_max_sample_rate to 50000 [16808.244557] LNet: 2231:0:(o2iblnd_cb.c:3198:kiblnd_check_conns()) Timed out tx for 192.168.1.105@o2ib: 1 seconds [16808.258898] LNet: 2231:0:(o2iblnd_cb.c:3198:kiblnd_check_conns()) Skipped 2 previous similar messages [16935.237423] LNet: 2231:0:(o2iblnd_cb.c:3198:kiblnd_check_conns()) Timed out tx for 192.168.1.105@o2ib: 3 seconds [17012.233153] LNet: 2231:0:(o2iblnd_cb.c:3198:kiblnd_check_conns()) Timed out tx for 192.168.1.114@o2ib: 0 seconds [17061.230343] LNet: 2231:0:(o2iblnd_cb.c:3198:kiblnd_check_conns()) Timed out tx for 192.168.1.105@o2ib: 9 seconds [17061.244622] LNet: 2231:0:(o2iblnd_cb.c:3198:kiblnd_check_conns()) Skipped 2 previous similar messages [17071.355510] Lustre: soaked-MDT0001: Received new LWP connection from 192.168.1.105@o2ib, removing former export from same NID [17071.371080] Lustre: Skipped 3 previous similar messages [17071.379782] format at ldlm_lib.c:1201:target_handle_connect doesn't end in newline [17076.093746] format at ldlm_lib.c:1201:target_handle_connect doesn't end in newline [17071.391066] Lustre: soaked-MDT0001: Rejecting reconnect from the known client soaked-MDT0001-lwp-OST0009_UUID (at 192.168.1.105@o2ib) because it is indicating it is a new client [17076.108010] Lustre: soaked-MDT0001: Rejecting reconnect from the known client soaked-MDT0001-lwp-OST0015_UUID (at 192.168.1.105@o2ib) because it is indicating it is a new client [17083.907150] format at ldlm_lib.c:1201:target_handle_connect doesn't end in newline [17083.921534] Lustre: soaked-MDT0001: Rejecting reconnect from the known client soaked-MDT0001-lwp-OST0003_UUID (at 192.168.1.105@o2ib) because it is indicating it is a new client [17090.261704] format at ldlm_lib.c:1201:target_handle_connect doesn't end in newline [17103.440080] Lustre: soaked-OST0009-osc-MDT0001: Connection restored to 192.168.1.105@o2ib (at 192.168.1.105@o2ib) [17115.262467] LustreError: 137-5: soaked-MDT0000_UUID: not available for connect from 192.168.1.105@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server. [17115.288633] LustreError: Skipped 14 previous similar messages [17124.975706] Lustre: soaked-OST0003-osc-MDT0001: Connection restored to 192.168.1.105@o2ib (at 192.168.1.105@o2ib) [17156.217455] Lustre: soaked-OST0015-osc-MDT0001: Connection restored to 192.168.1.105@o2ib (at 192.168.1.105@o2ib) [17340.249348] Lustre: soaked-MDT0001: Received new LWP connection from 192.168.1.105@o2ib, removing former export from same NID [17340.249350] Lustre: soaked-MDT0001: Received new LWP connection from 192.168.1.105@o2ib, removing former export from same NID [17340.249353] Lustre: Skipped 18 previous similar messages [17340.289828] Lustre: Skipped 2 previous similar messages [17890.217866] Lustre: soaked-MDT0001: Received new LWP connection from 192.168.1.105@o2ib, removing former export from same NID [17890.355216] Lustre: Skipped 40 previous similar messages [18040.209371] Lustre: soaked-MDT0001: Connection restored to 192.168.1.105@o2ib (at 192.168.1.105@o2ib) [18040.209373] Lustre: soaked-MDT0001: Connection restored to 192.168.1.105@o2ib (at 192.168.1.105@o2ib) [18040.209375] Lustre: Skipped 1 previous similar message [18090.206503] Lustre: soaked-MDT0001: Connection restored to 192.168.1.105@o2ib (at 192.168.1.105@o2ib) [18090.206505] Lustre: soaked-MDT0001: Connection restored to 192.168.1.105@o2ib (at 192.168.1.105@o2ib) [18436.875062] LustreError: 7018:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0001: expected 968 actual 344. [18436.887095] LustreError: 7018:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 11 previous similar messages [20342.443494] LustreError: 16117:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0001: expected 416 actual 344. [20342.477685] LustreError: 16117:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 3 previous similar messages [20360.102568] LustreError: 2302:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0001: expected 968 actual 416. [20361.991987] LustreError: 2301:0:(mdt_lvb.c:163:mdt_lvbo_fill()) soaked-MDT0001: expected 968 actual 416. [20362.026109] LustreError: 2301:0:(mdt_lvb.c:163:mdt_lvbo_fill()) Skipped 2 previous similar messages [20693.321683] Lustre: 2252:0:(client.c:2113:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1510757484/real 0] req@ffff8800ac001200 x1584122994805504/t0(0) o13->soaked-OST0014-osc-MDT0001@192.168.1.104@o2ib:7/4 lens 224/368 e 0 to 1 dl 1510757492 ref 2 fl Rpc:X/0/ffffffff rc 0/-1 [20693.360927] Lustre: 2252:0:(client.c:2113:ptlrpc_expire_one_request()) Skipped 22 previous similar messages [20693.374668] Lustre: soaked-OST0014-osc-MDT0001: Connection to soaked-OST0014 (at 192.168.1.104@o2ib) was lost; in progress operations using this service will wait for recovery to complete [20694.398631] Lustre: soaked-OST0008-osc-MDT0001: Connection to soaked-OST0008 (at 192.168.1.104@o2ib) was lost; in progress operations using this service will wait for recovery to complete [20694.422287] Lustre: Skipped 2 previous similar messages [20794.425446] Lustre: 2242:0:(client.c:2113:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1510757593/real 1510757593] req@ffff880772209500 x1584122994964880/t0(0) o8->soaked-OST0014-osc-MDT0001@192.168.1.104@o2ib:28/4 lens 520/544 e 0 to 1 dl 1510757610 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1 [20794.529594] Lustre: 2242:0:(client.c:2113:ptlrpc_expire_one_request()) Skipped 43 previous similar messages [20976.414674] Lustre: 2242:0:(client.c:2113:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1510757743/real 0] req@ffff88077220ef00 x1584122994975312/t0(0) o8->soaked-OST0014-osc-MDT0001@192.168.1.104@o2ib:28/4 lens 520/544 e 0 to 1 dl 1510757775 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1 [20976.454637] Lustre: 2242:0:(client.c:2113:ptlrpc_expire_one_request()) Skipped 11 previous similar messages [21000.007345] LNet: 2231:0:(o2iblnd_cb.c:3198:kiblnd_check_conns()) Timed out tx for 192.168.1.104@o2ib: 6 seconds [21000.021746] LNet: 2231:0:(o2iblnd_cb.c:3198:kiblnd_check_conns()) Skipped 2 previous similar messages [21086.748672] LNet: 208:0:(o2iblnd_cb.c:2411:kiblnd_passive_connect()) Conn stale 192.168.1.104@o2ib version 12/12 incarnation 1510757885382518/1510757885382518 [21087.002468] LNet: 2231:0:(o2iblnd_cb.c:1356:kiblnd_reconnect_peer()) Abort reconnection of 192.168.1.104@o2ib: connected [21087.197833] Lustre: soaked-MDT0001: Received new LWP connection from 192.168.1.104@o2ib, removing former export from same NID [21087.238098] Lustre: Skipped 12 previous similar messages [21087.258513] format at ldlm_lib.c:1201:target_handle_connect doesn't end in newline [17090.276295] Lustre: soaked-MDT0001: Rejecting reconnect from the known client soaked-MDT0001-lwp-OST000f_UUID (at 192.168.1.105@o2ib) because it is indicating it is a new client [21087.286142] Lustre: soaked-MDT0001: Rejecting reconnect from the known client soaked-MDT0001-lwp-OST0008_UUID (at 192.168.1.104@o2ib) because it is indicating it is a new client [21092.585071] format at ldlm_lib.c:1201:target_handle_connect doesn't end in newline [21096.401842] format at ldlm_lib.c:1201:target_handle_connect doesn't end in newline [21092.615853] Lustre: soaked-MDT0001: Rejecting reconnect from the known client soaked-MDT0001-lwp-OST0014_UUID (at 192.168.1.104@o2ib) because it is indicating it is a new client [21096.432923] Lustre: soaked-MDT0001: Rejecting reconnect from the known client soaked-MDT0001-lwp-OST0002_UUID (at 192.168.1.104@o2ib) because it is indicating it is a new client [21101.870683] format at ldlm_lib.c:1201:target_handle_connect doesn't end in newline [21110.388077] Lustre: soaked-OST0008-osc-MDT0001: Connection restored to 192.168.1.104@o2ib (at 192.168.1.104@o2ib) [21126.871971] LustreError: 137-5: soaked-MDT0000_UUID: not available for connect from 192.168.1.104@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server. [21126.937193] LustreError: Skipped 29 previous similar messages [21147.144878] Lustre: soaked-OST000e-osc-MDT0001: Connection restored to 192.168.1.104@o2ib (at 192.168.1.104@o2ib) [21147.182287] Lustre: Skipped 2 previous similar messages [21201.867384] Lustre: soaked-MDT0001: Received new LWP connection from 192.168.1.104@o2ib, removing former export from same NID [21201.908034] Lustre: Skipped 9 previous similar messages [21226.866031] LustreError: 137-5: soaked-MDT0000_UUID: not available for connect from 192.168.1.104@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server. [21226.930834] LustreError: Skipped 7 previous similar messages [21376.857386] LustreError: 137-5: soaked-MDT0000_UUID: not available for connect from 192.168.1.104@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server. [21377.075902] LustreError: Skipped 11 previous similar messages [21401.855889] Lustre: soaked-MDT0001: Received new LWP connection from 192.168.1.104@o2ib, removing former export from same NID [21401.855891] Lustre: soaked-MDT0001: Received new LWP connection from 192.168.1.104@o2ib, removing former export from same NID [21401.855894] Lustre: Skipped 12 previous similar messages [21402.199921] Lustre: Skipped 2 previous similar messages [21501.850037] Lustre: soaked-MDT0001: Connection restored to 192.168.1.104@o2ib (at 192.168.1.104@o2ib) [21501.863704] Lustre: Skipped 3 previous similar messages [22076.352436] Lustre: 2261:0:(client.c:2113:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1510758868/real 0] req@ffff880738b8ce00 x1584123011294384/t0(0) o400->soaked-MDT0000-lwp-MDT0001@192.168.1.108@o2ib:12/10 lens 224/224 e 0 to 1 dl 1510758875 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1 [22076.393820] Lustre: 2261:0:(client.c:2113:ptlrpc_expire_one_request()) Skipped 7 previous similar messages [22076.408016] Lustre: soaked-MDT0000-lwp-MDT0001: Connection to soaked-MDT0000 (at 192.168.1.108@o2ib) was lost; in progress operations using this service will wait for recovery to complete [22076.432107] Lustre: Skipped 1 previous similar message [22076.832396] LustreError: 166-1: MGC192.168.1.108@o2ib: Connection to MGS (at 192.168.1.108@o2ib) was lost; in progress operations using this service will fail [22081.039317] LustreError: 137-5: soaked-MDT0000_UUID: not available for connect from 192.168.1.122@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server. [22081.065929] LustreError: Skipped 13 previous similar messages [22126.852009] Lustre: 2242:0:(client.c:2113:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1510758925/real 1510758925] req@ffff880738b8c500 x1584123011298976/t0(0) o38->soaked-MDT0000-lwp-MDT0001@192.168.1.108@o2ib:12/10 lens 520/544 e 0 to 1 dl 1510758936 ref 1 fl Rpc:eXN/0/ffffffff rc 0/-1 [22126.894720] Lustre: 2242:0:(client.c:2113:ptlrpc_expire_one_request()) Skipped 6 previous similar messages [22217.846372] Lustre: 2242:0:(client.c:2113:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1510759000/real 1510759000] req@ffff880738b88f00 x1584123011304912/t0(0) o250->MGC192.168.1.108@o2ib@0@lo:26/25 lens 520/544 e 0 to 1 dl 1510759016 ref 1 fl Rpc:XN/0/ffffffff rc 0/-1 [22217.945801] Lustre: 2242:0:(client.c:2113:ptlrpc_expire_one_request()) Skipped 6 previous similar messages [22260.329087] LDISKFS-fs warning (device dm-1): ldiskfs_multi_mount_protect:322: MMP interval 42 higher than expected, please wait. [22311.859433] LDISKFS-fs (dm-1): recovery complete [22311.924617] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,user_xattr,no_mbcache,nodelalloc [22312.933052] LNet: 2231:0:(o2iblnd_cb.c:3198:kiblnd_check_conns()) Timed out tx for 192.168.1.108@o2ib: 2 seconds [22312.969888] LNet: 2231:0:(o2iblnd_cb.c:3198:kiblnd_check_conns()) Skipped 3 previous similar messages [22315.977708] Lustre: MGS: Connection restored to 192.168.1.109@o2ib (at 0@lo) [22316.139349] Lustre: soaked-MDT0001: Received LWP connection from 0@lo, removing former export from 192.168.1.108@o2ib [22316.213348] Lustre: soaked-MDT0000: Imperative Recovery not enabled, recovery window 300-900 [22316.281682] LustreError: 27128:0:(lfsck_namespace.c:6671:lfsck_namespace_setup()) soaked-MDT0000-osd: unknown lfsck_namespace status 8 [22317.969733] Lustre: soaked-MDT0000: Will be in recovery for at least 5:00, or until 32 clients reconnect [22317.969894] Lustre: MGS: Connection restored to 8ec9768c-f2d5-e55a-d1c9-a8eb99e0ecf0 (at 192.168.1.116@o2ib) [22317.969897] Lustre: Skipped 1 previous similar message [22322.235828] Lustre: soaked-MDT0000: Connection restored to 192.168.1.105@o2ib (at 192.168.1.105@o2ib) [22322.269422] Lustre: Skipped 1 previous similar message [22326.349144] Lustre: MGS: Connection restored to a519a003-2908-8d77-9d37-3d34f4c0996e (at 192.168.1.134@o2ib) [22326.384745] Lustre: Skipped 1 previous similar message [22334.848765] Lustre: soaked-MDT0000: Connection restored to 192.168.1.111@o2ib (at 192.168.1.111@o2ib) [22334.882340] Lustre: Skipped 40 previous similar messages [22338.931574] LNet: 2231:0:(o2iblnd_cb.c:3198:kiblnd_check_conns()) Timed out tx for 192.168.1.108@o2ib: 12 seconds [22341.194921] Lustre: Evicted from MGS (at MGC192.168.1.108@o2ib_1) after server handle changed from 0x405d9a5f614718cb to 0x6395766309e0f8b4 [22341.241433] LustreError: 167-0: soaked-MDT0000-lwp-MDT0001: This client was evicted by soaked-MDT0000; in progress operations using this service will fail. [22351.546926] Lustre: MGS: Connection restored to 192.168.1.107@o2ib (at 192.168.1.107@o2ib) [22351.577524] Lustre: Skipped 17 previous similar messages [22372.287631] Lustre: 2242:0:(client.c:2113:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1510759140/real 0] req@ffff88070dba6900 x1584123013690720/t0(0) o38->soaked-MDT0000-osp-MDT0001@192.168.1.108@o2ib:24/4 lens 520/544 e 0 to 1 dl 1510759171 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1 [22372.389161] Lustre: 2242:0:(client.c:2113:ptlrpc_expire_one_request()) Skipped 8 previous similar messages [22375.929446] LNet: 2231:0:(o2iblnd_cb.c:3198:kiblnd_check_conns()) Timed out tx for 192.168.1.108@o2ib: 9 seconds [22375.966294] LNet: 2231:0:(o2iblnd_cb.c:3198:kiblnd_check_conns()) Skipped 1 previous similar message [22383.895708] Lustre: soaked-MDT0000: Connection restored to 192.168.1.104@o2ib (at 192.168.1.104@o2ib) [22383.929434] Lustre: Skipped 22 previous similar messages [22401.928011] LNet: 2231:0:(o2iblnd_cb.c:3198:kiblnd_check_conns()) Timed out tx for 192.168.1.108@o2ib: 11 seconds [22419.373182] Lustre: soaked-MDT0000: Recovery over after 1:42, of 32 clients 32 recovered and 0 were evicted. [22419.576941] LustreError: 27404:0:(lfsck_namespace.c:4571:lfsck_namespace_double_scan()) ASSERTION( list_empty(&lad->lad_req_list) ) failed: [22419.623383] LustreError: 27404:0:(lfsck_namespace.c:4571:lfsck_namespace_double_scan()) LBUG [22419.653852] Pid: 27404, comm: lfsck [22419.668046] Call Trace: [22419.684981] [] libcfs_call_trace+0x4e/0x60 [libcfs] [22419.708421] [] lbug_with_loc+0x4c/0xb0 [libcfs] [22419.730630] [] lfsck_namespace_double_scan+0x108/0x140 [lfsck] [22419.756929] [] lfsck_double_scan+0x59/0x200 [lfsck] [22419.780025] [] ? osd_otable_it_fini+0xca/0x240 [osd_ldiskfs] [22419.805598] [] ? kfree+0x103/0x140 [22419.823527] [] lfsck_master_engine+0x494/0x12b0 [lfsck] [22419.847485] [] ? default_wake_function+0x0/0x20 [22419.869126] [] ? lfsck_master_engine+0x0/0x12b0 [lfsck] [22419.893017] [] kthread+0xcf/0xe0 [22419.910327] [] ? kthread+0x0/0xe0 [22419.927895] [] ret_from_fork+0x58/0x90 [22419.946871] [] ? kthread+0x0/0xe0 [22419.964399] [22419.970461] Kernel panic - not syncing: LBUG [22419.985663] CPU: 2 PID: 27404 Comm: lfsck Tainted: P OE ------------ 3.10.0-693.5.2.el7_lustre.x86_64 #1 [22420.021760] Hardware name: Intel Corporation SandyBridge Platform/To be filled by O.E.M., BIOS SE5C600.86B.01.08.0003.022620131521 02/26/2013 [21101.901830] Lustre: soaked-MDT0001: Rejecting reconnect from the known client soaked-MDT0001-lwp-OST000e_UUID (at 192.168.1.104@o2ib) because it is indicating it is a new client [22420.065905] ffff8804292a4f00 [22420.076796] 0000000004b051b9 ffff8803ff5b7c78 ffffffff816a3e51 [22420.093166] ffff8803ff5b7cf8 ffffffff8169dd14 ffffffff00000008 ffff8803ff5b7d08 [22420.118683] ffff8803ff5b7ca8 0000000004b051b9 0000000004b051b9 ffff88042e08f8b8 [22420.144203] Call Trace: [22420.153340] [] dump_stack+0x19/0x1b [22420.171348] [] panic+0xe8/0x20d [22420.188221] [] lbug_with_loc+0x64/0xb0 [libcfs] [22420.209644] [] lfsck_namespace_double_scan+0x108/0x140 [lfsck] [22420.235341] [] lfsck_double_scan+0x59/0x200 [lfsck] [22420.257856] [] ? osd_otable_it_fini+0xca/0x240 [osd_ldiskfs] [22420.282923] [] ? kfree+0x103/0x140 [22420.300538] [] lfsck_master_engine+0x494/0x12b0 [lfsck] [22420.324144] [] ? wake_up_state+0x20/0x20 [22420.343454] [] ? lfsck_master_oit_engine+0x1170/0x1170 [lfsck] [22420.369029] [] kthread+0xcf/0xe0 [22420.386004] [] ? insert_kthread_work+0x40/0x40 [22420.406959] [] ret_from_fork+0x58/0x90 [22420.425609] [] ? insert_kthread_work+0x40/0x40