[ 0.000000] microcode: microcode updated early to revision 0x710, date = 2013-06-17 [ 0.000000] Initializing cgroup subsys cpuset [ 0.000000] Initializing cgroup subsys cpu [ 0.000000] Initializing cgroup subsys cpuacct [ 0.000000] Linux version 3.10.0-693.21.1.el7_lustre.x86_64 (jenkins@trevis-307-el7-x8664-1.trevis.hpdd.intel.com) (gcc version 4.8.5 20150623 (Red Hat 4.8.5-16) (GCC) ) #1 SMP Sat Apr 21 03:51:40 UTC 2018 [ 0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-3.10.0-693.21.1.el7_lustre.x86_64 root=UUID=4dfe900a-c2ad-4424-b141-9a27a9c3d15c ro crashkernel=320M console=tty0 LANG=en_US.UTF-8 console=ttyS0,115200 net.ifnames=0 [ 0.000000] e820: BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008efff] usable [ 0.000000] BIOS-e820: [mem 0x000000000008f000-0x000000000009ffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bb3c6fff] usable [ 0.000000] BIOS-e820: [mem 0x00000000bb3c7000-0x00000000bdd2efff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000bdd2f000-0x00000000bddccfff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x00000000bddcd000-0x00000000bdea0fff] ACPI data [ 0.000000] BIOS-e820: [mem 0x00000000bdea1000-0x00000000bdf2efff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x00000000bdf2f000-0x00000000bdfabfff] ACPI data [ 0.000000] BIOS-e820: [mem 0x00000000bdfac000-0x00000000bdffffff] usable [ 0.000000] BIOS-e820: [mem 0x00000000be000000-0x00000000cfffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fec00000-0x00000000fec00fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed19000-0x00000000fed19fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fee00000-0x00000000fee00fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ffa20000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000083fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 2.6 present. [ 0.000000] DMI: Intel Corporation S2600GZ ........../S2600GZ, BIOS SE5C600.86B.01.08.0003.022620131521 02/26/2013 [ 0.000000] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved [ 0.000000] e820: remove [mem 0x000a0000-0x000fffff] usable [ 0.000000] e820: last_pfn = 0x840000 max_arch_pfn = 0x400000000 [ 0.000000] MTRR default type: uncachable [ 0.000000] MTRR fixed ranges enabled: [ 0.000000] 00000-9FFFF write-back [ 0.000000] A0000-BFFFF uncachable [ 0.000000] C0000-DBFFF write-through [ 0.000000] DC000-E7FFF uncachable [ 0.000000] E8000-FFFFF write-protect [ 0.000000] MTRR variable ranges enabled: [ 0.000000] 0 base 000000000000 mask 3FFF80000000 write-back [ 0.000000] 1 base 000080000000 mask 3FFFC0000000 write-back [ 0.000000] 2 base 000100000000 mask 3FFF00000000 write-back [ 0.000000] 3 base 000200000000 mask 3FFE00000000 write-back [ 0.000000] 4 base 000400000000 mask 3FFC00000000 write-back [ 0.000000] 5 base 000800000000 mask 3FFFC0000000 write-back [ 0.000000] 6 base 0000FF800000 mask 3FFFFF800000 write-protect [ 0.000000] 7 disabled [ 0.000000] 8 disabled [ 0.000000] 9 disabled [ 0.000000] x86 PAT enabled: cpu 0, old 0x7040600070406, new 0x7010600070106 [ 0.000000] e820: last_pfn = 0xbe000 max_arch_pfn = 0x400000000 [ 0.000000] found SMP MP-table at [mem 0x000fcd70-0x000fcd7f] mapped at [ffff8800000fcd70] [ 0.000000] Base memory trampoline at [ffff880000089000] 89000 size 24576 [ 0.000000] Using GB pages for direct mapping [ 0.000000] BRK [0x02001000, 0x02001fff] PGTABLE [ 0.000000] BRK [0x02002000, 0x02002fff] PGTABLE [ 0.000000] BRK [0x02003000, 0x02003fff] PGTABLE [ 0.000000] BRK [0x02004000, 0x02004fff] PGTABLE [ 0.000000] RAMDISK: [mem 0x35b60000-0x36da7fff] [ 0.000000] Early table checksum verification disabled [ 0.000000] ACPI: RSDP 00000000000f0410 00024 (v02 INTEL ) [ 0.000000] ACPI: XSDT 00000000bdfa9d98 000BC (v01 INTEL S2600GZ 06222004 INTL 20090903) [ 0.000000] ACPI: FACP 00000000bdfa9918 000F4 (v04 INTEL S2600GZ 06222004 INTL 20090903) [ 0.000000] ACPI BIOS Warning (bug): Invalid length for FADT/Pm1aControlBlock: 32, using default 16 (20130517/tbfadt-672) [ 0.000000] ACPI: DSDT 00000000bdf8f018 18762 (v02 INTEL S2600GZ 00000008 INTL 20100331) [ 0.000000] ACPI: FACS 00000000bdfa9f40 00040 [ 0.000000] ACPI: APIC 00000000bdfa8018 00BAA (v03 INTEL S2600GZ 06222004 INTL 20090903) [ 0.000000] ACPI: SPMI 00000000bdfabb18 00040 (v05 INTEL S2600GZ 06222004 INTL 20090903) [ 0.000000] ACPI: MCFG 00000000bdfaba98 0003C (v01 INTEL S2600GZ 06222004 INTL 20090903) [ 0.000000] ACPI: WDDT 00000000bdfabf18 00040 (v01 INTEL S2600GZ 06222004 INTL 20090903) [ 0.000000] ACPI: SRAT 00000000bdf8cc18 002A8 (v03 INTEL S2600GZ 06222004 INTL 20090903) [ 0.000000] ACPI: SLIT 00000000bdfabe98 00030 (v01 INTEL S2600GZ 06222004 INTL 20090903) [ 0.000000] ACPI: MSCT 00000000bdfaae18 00090 (v01 INTEL S2600GZ 06222004 INTL 20090903) [ 0.000000] ACPI: HPET 00000000bdfabe18 00038 (v01 INTEL S2600GZ 06222004 INTL 20090903) [ 0.000000] ACPI: SSDT 00000000bdfabd18 0002B (v02 INTEL S2600GZ 00001000 INTL 20100331) [ 0.000000] ACPI: SSDT 00000000bddcd018 D30C8 (v02 INTEL S2600GZ 00004000 INTL 20100331) [ 0.000000] ACPI: SPCR 00000000bdfabd98 00050 (v01 INTEL S2600GZ 06222004 INTL 20090903) [ 0.000000] ACPI: HEST 00000000bdf8ef18 000A8 (v01 INTEL S2600GZ 00000001 INTL 00000001) [ 0.000000] ACPI: BERT 00000000bdfabc18 00030 (v01 INTEL S2600GZ 00000001 INTL 00000001) [ 0.000000] ACPI: ERST 00000000bdf8ec98 00230 (v01 INTEL S2600GZ 00000001 INTL 00000001) [ 0.000000] ACPI: EINJ 00000000bdfa9798 00130 (v01 INTEL S2600GZ 00000001 INTL 00000001) [ 0.000000] ACPI: SSDT 00000000bdf8a018 01729 (v02 INTEL S2600GZ 00000002 INTL 20100331) [ 0.000000] ACPI: SSDT 00000000bdfabc98 00045 (v02 INTEL S2600GZ 00000001 INTL 20100331) [ 0.000000] ACPI: SSDT 00000000bdf8de18 00181 (v02 INTEL S2600GZ 00000003 INTL 20100331) [ 0.000000] ACPI: Local APIC address 0xfee00000 [ 0.000000] SRAT: PXM 0 -> APIC 0x00 -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x01 -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x02 -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x03 -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x04 -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x05 -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x06 -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x07 -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x08 -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x09 -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x0a -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x0b -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x0c -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x0d -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x0e -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x0f -> Node 0 [ 0.000000] SRAT: PXM 1 -> APIC 0x20 -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x21 -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x22 -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x23 -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x24 -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x25 -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x26 -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x27 -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x28 -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x29 -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x2a -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x2b -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x2c -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x2d -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x2e -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x2f -> Node 1 [ 0.000000] SRAT: Node 0 PXM 0 [mem 0x00000000-0xbfffffff] [ 0.000000] SRAT: Node 0 PXM 0 [mem 0x100000000-0x43fffffff] [ 0.000000] SRAT: Node 1 PXM 1 [mem 0x440000000-0x83fffffff] [ 0.000000] NUMA: Initialized distance table, cnt=2 [ 0.000000] NUMA: Node 0 [mem 0x00000000-0xbfffffff] + [mem 0x100000000-0x43fffffff] -> [mem 0x00000000-0x43fffffff] [ 0.000000] NODE_DATA(0) allocated [mem 0x43ffd9000-0x43fffffff] [ 0.000000] NODE_DATA(1) allocated [mem 0x83ffd6000-0x83fffcfff] [ 0.000000] Reserving 320MB of memory at 528MB for crashkernel (System RAM: 32691MB) [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x00001000-0x00ffffff] [ 0.000000] DMA32 [mem 0x01000000-0xffffffff] [ 0.000000] Normal [mem 0x100000000-0x83fffffff] [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x00001000-0x0008efff] [ 0.000000] node 0: [mem 0x00100000-0xbb3c6fff] [ 0.000000] node 0: [mem 0xbdfac000-0xbdffffff] [ 0.000000] node 0: [mem 0x100000000-0x43fffffff] [ 0.000000] node 1: [mem 0x440000000-0x83fffffff] [ 0.000000] Initmem setup node 0 [mem 0x00001000-0x43fffffff] [ 0.000000] On node 0 totalpages: 4174761 [ 0.000000] DMA zone: 64 pages used for memmap [ 0.000000] DMA zone: 21 pages reserved [ 0.000000] DMA zone: 3982 pages, LIFO batch:0 [ 0.000000] DMA32 zone: 11921 pages used for memmap [ 0.000000] DMA32 zone: 762907 pages, LIFO batch:31 [ 0.000000] Normal zone: 53248 pages used for memmap [ 0.000000] Normal zone: 3407872 pages, LIFO batch:31 [ 0.000000] Initmem setup node 1 [mem 0x440000000-0x83fffffff] [ 0.000000] On node 1 totalpages: 4194304 [ 0.000000] Normal zone: 65536 pages used for memmap [ 0.000000] Normal zone: 4194304 pages, LIFO batch:31 [ 0.000000] ACPI: PM-Timer IO Port: 0x408 [ 0.000000] ACPI: Local APIC address 0xfee00000 [ 0.000000] ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x01] lapic_id[0x02] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x02] lapic_id[0x04] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x03] lapic_id[0x06] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x04] lapic_id[0x08] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x05] lapic_id[0x0a] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x06] lapic_id[0x0c] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x07] lapic_id[0x0e] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x08] lapic_id[0x20] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x09] lapic_id[0x22] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x24] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x26] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x0c] lapic_id[0x28] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x0d] lapic_id[0x2a] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x0e] lapic_id[0x2c] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x0f] lapic_id[0x2e] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x10] lapic_id[0x01] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x11] lapic_id[0x03] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x12] lapic_id[0x05] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x13] lapic_id[0x07] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x14] lapic_id[0x09] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x15] lapic_id[0x0b] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x16] lapic_id[0x0d] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x17] lapic_id[0x0f] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x18] lapic_id[0x21] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x19] lapic_id[0x23] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x1a] lapic_id[0x25] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x1b] lapic_id[0x27] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x1c] lapic_id[0x29] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x1d] lapic_id[0x2b] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x1e] lapic_id[0x2d] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x1f] lapic_id[0x2f] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x20] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x21] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x22] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x23] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x24] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x25] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x26] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x27] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x28] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x29] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x2a] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x2b] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x2c] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x2d] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x2e] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x2f] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x30] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x31] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x32] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x33] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x34] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x35] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x36] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x37] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x38] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x39] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x3a] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x3b] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x3c] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x3d] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x3e] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x3f] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x40] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x41] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x42] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x43] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x44] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x45] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x46] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x47] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x48] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x49] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x4a] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x4b] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x4c] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x4d] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x4e] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x4f] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x50] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x51] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x52] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x53] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x54] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x55] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x56] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x57] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x58] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x59] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x5a] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x5b] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x5c] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x5d] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x5e] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x5f] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x60] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x61] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x62] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x63] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x64] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x65] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x66] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x67] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x68] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x69] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x6a] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x6b] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x6c] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x6d] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x6e] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x6f] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x70] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x71] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x72] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x73] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x74] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x75] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x76] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x77] lapic_id[0xff] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x00] uid[0x00] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x01] uid[0x01] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x02] uid[0x02] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x03] uid[0x03] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x04] uid[0x04] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x05] uid[0x05] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x06] uid[0x06] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x07] uid[0x07] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x08] uid[0x08] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x09] uid[0x09] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x0a] uid[0x0a] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x0b] uid[0x0b] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x0c] uid[0x0c] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x0d] uid[0x0d] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x0e] uid[0x0e] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x0f] uid[0x0f] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x10] uid[0x10] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x11] uid[0x11] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x12] uid[0x12] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x13] uid[0x13] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x14] uid[0x14] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x15] uid[0x15] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x16] uid[0x16] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x17] uid[0x17] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x18] uid[0x18] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x19] uid[0x19] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x1a] uid[0x1a] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x1b] uid[0x1b] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x1c] uid[0x1c] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x1d] uid[0x1d] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x1e] uid[0x1e] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x1f] uid[0x1f] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x20] uid[0x20] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x21] uid[0x21] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x22] uid[0x22] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x23] uid[0x23] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x24] uid[0x24] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x25] uid[0x25] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x26] uid[0x26] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x27] uid[0x27] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x28] uid[0x28] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x29] uid[0x29] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x2a] uid[0x2a] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x2b] uid[0x2b] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x2c] uid[0x2c] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x2d] uid[0x2d] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x2e] uid[0x2e] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x2f] uid[0x2f] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x30] uid[0x30] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x31] uid[0x31] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x32] uid[0x32] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x33] uid[0x33] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x34] uid[0x34] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x35] uid[0x35] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x36] uid[0x36] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x37] uid[0x37] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x38] uid[0x38] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x39] uid[0x39] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x3a] uid[0x3a] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x3b] uid[0x3b] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x3c] uid[0x3c] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x3d] uid[0x3d] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x3e] uid[0x3e] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x3f] uid[0x3f] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x40] uid[0x40] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x41] uid[0x41] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x42] uid[0x42] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x43] uid[0x43] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x44] uid[0x44] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x45] uid[0x45] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x46] uid[0x46] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x47] uid[0x47] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x48] uid[0x48] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x49] uid[0x49] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x4a] uid[0x4a] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x4b] uid[0x4b] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x4c] uid[0x4c] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x4d] uid[0x4d] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x4e] uid[0x4e] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x4f] uid[0x4f] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x50] uid[0x50] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x51] uid[0x51] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x52] uid[0x52] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x53] uid[0x53] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x54] uid[0x54] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x55] uid[0x55] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x56] uid[0x56] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x57] uid[0x57] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x58] uid[0x58] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x59] uid[0x59] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x5a] uid[0x5a] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x5b] uid[0x5b] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x5c] uid[0x5c] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x5d] uid[0x5d] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x5e] uid[0x5e] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x5f] uid[0x5f] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x60] uid[0x60] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x61] uid[0x61] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x62] uid[0x62] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x63] uid[0x63] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x64] uid[0x64] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x65] uid[0x65] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x66] uid[0x66] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x67] uid[0x67] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x68] uid[0x68] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x69] uid[0x69] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x6a] uid[0x6a] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x6b] uid[0x6b] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x6c] uid[0x6c] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x6d] uid[0x6d] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x6e] uid[0x6e] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x6f] uid[0x6f] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x70] uid[0x70] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x71] uid[0x71] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x72] uid[0x72] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x73] uid[0x73] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x74] uid[0x74] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x75] uid[0x75] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x76] uid[0x76] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x77] uid[0x77] disabled) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) [ 0.000000] ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0]) [ 0.000000] IOAPIC[0]: apic_id 0, version 32, address 0xfec00000, GSI 0-23 [ 0.000000] ACPI: IOAPIC (id[0x01] address[0xfec3f000] gsi_base[24]) [ 0.000000] IOAPIC[1]: apic_id 1, version 32, address 0xfec3f000, GSI 24-47 [ 0.000000] ACPI: IOAPIC (id[0x02] address[0xfec7f000] gsi_base[48]) [ 0.000000] IOAPIC[2]: apic_id 2, version 32, address 0xfec7f000, GSI 48-71 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.000000] ACPI: IRQ0 used by override. [ 0.000000] ACPI: IRQ9 used by override. [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.000000] smpboot: Allowing 240 CPUs, 208 hotplug CPUs [ 0.000000] PM: Registered nosave memory: [mem 0x0008f000-0x0009ffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000dffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.000000] PM: Registered nosave memory: [mem 0xbb3c7000-0xbdd2efff] [ 0.000000] PM: Registered nosave memory: [mem 0xbdd2f000-0xbddccfff] [ 0.000000] PM: Registered nosave memory: [mem 0xbddcd000-0xbdea0fff] [ 0.000000] PM: Registered nosave memory: [mem 0xbdea1000-0xbdf2efff] [ 0.000000] PM: Registered nosave memory: [mem 0xbdf2f000-0xbdfabfff] [ 0.000000] PM: Registered nosave memory: [mem 0xbe000000-0xcfffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xd0000000-0xfebfffff] [ 0.000000] PM: Registered nosave memory: [mem 0xfec00000-0xfec00fff] [ 0.000000] PM: Registered nosave memory: [mem 0xfec01000-0xfed18fff] [ 0.000000] PM: Registered nosave memory: [mem 0xfed19000-0xfed19fff] [ 0.000000] PM: Registered nosave memory: [mem 0xfed1a000-0xfed1bfff] [ 0.000000] PM: Registered nosave memory: [mem 0xfed1c000-0xfed1ffff] [ 0.000000] PM: Registered nosave memory: [mem 0xfed20000-0xfedfffff] [ 0.000000] PM: Registered nosave memory: [mem 0xfee00000-0xfee00fff] [ 0.000000] PM: Registered nosave memory: [mem 0xfee01000-0xffa1ffff] [ 0.000000] PM: Registered nosave memory: [mem 0xffa20000-0xffffffff] [ 0.000000] e820: [mem 0xd0000000-0xfebfffff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on bare hardware [ 0.000000] setup_percpu: NR_CPUS:5120 nr_cpumask_bits:240 nr_cpu_ids:240 nr_node_ids:2 [ 0.000000] PERCPU: Embedded 35 pages/cpu @ffff88042e000000 s104600 r8192 d30568 u262144 [ 0.000000] pcpu-alloc: s104600 r8192 d30568 u262144 alloc=1*2097152 [ 0.000000] pcpu-alloc: [0] 000 001 002 003 004 005 006 007 [ 0.000000] pcpu-alloc: [0] 016 017 018 019 020 021 022 023 [ 0.000000] pcpu-alloc: [0] 032 034 036 038 040 042 044 046 [ 0.000000] pcpu-alloc: [0] 048 050 052 054 056 058 060 062 [ 0.000000] pcpu-alloc: [0] 064 066 068 070 072 074 076 078 [ 0.000000] pcpu-alloc: [0] 080 082 084 086 088 090 092 094 [ 0.000000] pcpu-alloc: [0] 096 098 100 102 104 106 108 110 [ 0.000000] pcpu-alloc: [0] 112 114 116 118 120 122 124 126 [ 0.000000] pcpu-alloc: [0] 128 130 132 134 136 138 140 142 [ 0.000000] pcpu-alloc: [0] 144 146 148 150 152 154 156 158 [ 0.000000] pcpu-alloc: [0] 160 162 164 166 168 170 172 174 [ 0.000000] pcpu-alloc: [0] 176 178 180 182 184 186 188 190 [ 0.000000] pcpu-alloc: [0] 192 194 196 198 200 202 204 206 [ 0.000000] pcpu-alloc: [0] 208 210 212 214 216 218 220 222 [ 0.000000] pcpu-alloc: [0] 224 226 228 230 232 234 236 238 [ 0.000000] pcpu-alloc: [1] 008 009 010 011 012 013 014 015 [ 0.000000] pcpu-alloc: [1] 024 025 026 027 028 029 030 031 [ 0.000000] pcpu-alloc: [1] 033 035 037 039 041 043 045 047 [ 0.000000] pcpu-alloc: [1] 049 051 053 055 057 059 061 063 [ 0.000000] pcpu-alloc: [1] 065 067 069 071 073 075 077 079 [ 0.000000] pcpu-alloc: [1] 081 083 085 087 089 091 093 095 [ 0.000000] pcpu-alloc: [1] 097 099 101 103 105 107 109 111 [ 0.000000] pcpu-alloc: [1] 113 115 117 119 121 123 125 127 [ 0.000000] pcpu-alloc: [1] 129 131 133 135 137 139 141 143 [ 0.000000] pcpu-alloc: [1] 145 147 149 151 153 155 157 159 [ 0.000000] pcpu-alloc: [1] 161 163 165 167 169 171 173 175 [ 0.000000] pcpu-alloc: [1] 177 179 181 183 185 187 189 191 [ 0.000000] pcpu-alloc: [1] 193 195 197 199 201 203 205 207 [ 0.000000] pcpu-alloc: [1] 209 211 213 215 217 219 221 223 [ 0.000000] pcpu-alloc: [1] 225 227 229 231 233 235 237 239 [ 0.000000] Built 2 zonelists in Zone order, mobility grouping on. Total pages: 8238275 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-3.10.0-693.21.1.el7_lustre.x86_64 root=UUID=4dfe900a-c2ad-4424-b141-9a27a9c3d15c ro crashkernel=320M console=tty0 LANG=en_US.UTF-8 console=ttyS0,115200 net.ifnames=0 [ 0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes) [ 0.000000] x86/fpu: xstate_offset[2]: 0240, xstate_sizes[2]: 0100 [ 0.000000] xsave: enabled xstate_bv 0x7, cntxt size 0x340 using standard form [ 0.000000] Memory: 6833372k/34603008k available (6940k kernel code, 1126748k absent, 987552k reserved, 4560k data, 1792k init) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=240, Nodes=2 [ 0.000000] x86/pti: Unmapping kernel while in userspace [ 0.000000] Hierarchical RCU implementation. [ 0.000000] RCU restricting CPUs from NR_CPUS=5120 to nr_cpu_ids=240. [ 0.000000] NR_IRQS:327936 nr_irqs:3160 0 [ 0.000000] Console: colour VGA+ 80x25 [ 0.000000] console [tty0] enabled [ 0.000000] console [ttyS0] enabled [ 0.000000] allocated 134217728 bytes of page_cgroup [ 0.000000] please try 'cgroup_disable=memory' option if you don't want memory cgroups [ 0.000000] Enabling automatic NUMA balancing. Configure with numa_balancing= or the kernel.numa_balancing sysctl [ 0.000000] hpet clockevent registered [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 2693.382 MHz processor [ 0.000108] Calibrating delay loop (skipped), value calculated using timer frequency.. 5386.76 BogoMIPS (lpj=2693382) [ 0.012543] pid_max: default: 245760 minimum: 1920 [ 0.018830] Security Framework initialized [ 0.023692] SELinux: Initializing. [ 0.028026] SELinux: Starting in permissive mode [ 0.028027] Yama: becoming mindful. [ 0.034669] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes) [ 0.049894] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes) [ 0.061275] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes) [ 0.069282] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes) [ 0.079709] Initializing cgroup subsys memory [ 0.084907] Initializing cgroup subsys devices [ 0.090153] Initializing cgroup subsys freezer [ 0.095404] Initializing cgroup subsys net_cls [ 0.100649] Initializing cgroup subsys blkio [ 0.105699] Initializing cgroup subsys perf_event [ 0.111275] Initializing cgroup subsys hugetlb [ 0.116520] Initializing cgroup subsys pids [ 0.121473] Initializing cgroup subsys net_prio [ 0.126969] CPU: Physical Processor ID: 0 [ 0.131729] CPU: Processor Core ID: 0 [ 0.136101] mce: CPU supports 20 MCE banks [ 0.140967] CPU0: Thermal monitoring enabled (TM1) [ 0.146632] Last level iTLB entries: 4KB 512, 2MB 0, 4MB 0 [ 0.153045] Last level dTLB entries: 4KB 512, 2MB 32, 4MB 32 [ 0.159701] tlb_flushall_shift: 6 [ 0.163681] FEATURE SPEC_CTRL Not Present [ 0.168438] FEATURE IBPB_SUPPORT Not Present [ 0.173571] Spectre V2 : Vulnerable: Retpoline without IBPB [ 0.180246] Freeing SMP alternatives: 24k freed [ 0.188232] ACPI: Core revision 20130517 [ 0.234389] ACPI: All ACPI Tables successfully acquired [ 0.261887] ftrace: allocating 26649 entries in 105 pages [ 0.291489] IRQ remapping doesn't support X2APIC mode, disable x2apic. [ 0.299147] Switched APIC routing to physical flat. [ 0.305487] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.322478] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2680 0 @ 2.70GHz (fam: 06, model: 2d, stepping: 07) [ 0.333614] TSC deadline timer enabled [ 0.333646] Performance Events: PEBS fmt1+, 16-deep LBR, SandyBridge events, full-width counters, Intel PMU driver. [ 0.346210] ... version: 3 [ 0.350962] ... bit width: 48 [ 0.355809] ... generic registers: 4 [ 0.360561] ... value mask: 0000ffffffffffff [ 0.366770] ... max period: 00007fffffffffff [ 0.377547] ... fixed-purpose events: 3 [ 0.382299] ... event mask: 000000070000000f [ 0.409074] NMI watchdog: enabled on all CPUs, permanently consumes one hw-PMU counter. [ 0.393363] smpboot: Booting Node 0, Processors #1 #2 #3 #4 #5 #6 #7 OK [ 0.446139] smpboot: Booting Node 1, Processors #8 #9 #10 #11 #12 #13 #14 #15 OK [ 0.573185] smpboot: Booting Node 0, Processors #16 #17 #18 #19 #20 #21 #22 #23 OK [ 0.607679] smpboot: Booting Node 1, Processors #24 #25 #26 #27 #28 #29 #30 #31 [ 0.648206] Brought up 32 CPUs [ 0.652362] smpboot: Max logical packages: 15 [ 0.657507] smpboot: Total of 32 processors activated (172455.68 BogoMIPS) [ 0.781430] node 0 initialised, 2813731 pages in 61ms [ 0.798407] node 1 initialised, 3600099 pages in 73ms [ 0.805647] devtmpfs: initialized [ 0.819930] EVM: security.selinux [ 0.823923] EVM: security.ima [ 0.827525] EVM: security.capability [ 0.832086] PM: Registering ACPI NVS region [mem 0xbdd2f000-0xbddccfff] (647168 bytes) [ 0.841473] PM: Registering ACPI NVS region [mem 0xbdea1000-0xbdf2efff] (581632 bytes) [ 0.854073] atomic64 test passed for x86-64 platform with CX8 and with SSE [ 0.862057] pinctrl core: initialized pinctrl subsystem [ 0.868476] RTC time: 23:37:06, date: 04/23/18 [ 0.874233] NET: Registered protocol family 16 [ 0.879948] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 0.888902] ACPI: bus type PCI registered [ 0.893674] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.901796] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0xc0000000-0xcfffffff] (base 0xc0000000) [ 0.912705] PCI: MMCONFIG at [mem 0xc0000000-0xcfffffff] reserved in E820 [ 0.920629] PCI: Using configuration type 1 for base access [ 0.927211] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on [ 0.945576] ACPI: Added _OSI(Module Device) [ 0.950547] ACPI: Added _OSI(Processor Device) [ 0.955803] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.961355] ACPI: Added _OSI(Processor Aggregator Device) [ 0.987248] ACPI: EC: Look up EC in DSDT [ 1.007283] ACPI: Executed 1 blocks of module-level executable AML code [ 1.319371] [Firmware Bug]: ACPI: BIOS _OSI(Linux) query ignored [ 1.352989] ACPI: Interpreter enabled [ 1.357418] ACPI: (supports S0 S1 S5) [ 1.361798] ACPI: Using IOAPIC for interrupt routing [ 1.367736] HEST: Table parsing has been initialized. [ 1.373675] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 1.440187] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-7e]) [ 1.447404] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI] [ 1.457574] acpi PNP0A08:00: _OSC: platform does not support [AER] [ 1.465186] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.474245] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.484193] acpi PNP0A08:00: ignoring host bridge window [mem 0x000cc000-0x000cffff window] (conflicts with Adapter ROM [mem 0x000c8000-0x000cdbff]) [ 1.499574] acpi PNP0A08:00: ignoring host bridge window [mem 0x000d4000-0x000d7fff window] (conflicts with Adapter ROM [mem 0x000ce000-0x000d7bff]) [ 1.515303] PCI host bridge to bus 0000:00 [ 1.520175] pci_bus 0000:00: root bus resource [bus 00-7e] [ 1.526598] pci_bus 0000:00: root bus resource [io 0x0000-0xbfff window] [ 1.534478] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 1.543341] pci_bus 0000:00: root bus resource [mem 0x000c0000-0x000c3fff window] [ 1.552205] pci_bus 0000:00: root bus resource [mem 0x000c4000-0x000c7fff window] [ 1.561068] pci_bus 0000:00: root bus resource [mem 0x000c8000-0x000cbfff window] [ 1.569935] pci_bus 0000:00: root bus resource [mem 0x000d0000-0x000d3fff window] [ 1.578797] pci_bus 0000:00: root bus resource [mem 0x000d8000-0x000dbfff window] [ 1.587656] pci_bus 0000:00: root bus resource [mem 0x000dc000-0x000dffff window] [ 1.596513] pci_bus 0000:00: root bus resource [mem 0x000e0000-0x000e3fff window] [ 1.605375] pci_bus 0000:00: root bus resource [mem 0x000e4000-0x000e7fff window] [ 1.614235] pci_bus 0000:00: root bus resource [mem 0x000e8000-0x000ebfff window] [ 1.623100] pci_bus 0000:00: root bus resource [mem 0x000ec000-0x000effff window] [ 1.631967] pci_bus 0000:00: root bus resource [mem 0x000f0000-0x000fffff window] [ 1.640828] pci_bus 0000:00: root bus resource [mem 0xd0000000-0xebffffff window] [ 1.649691] pci_bus 0000:00: root bus resource [mem 0x380000000000-0x38007fffffff window] [ 1.659350] pci 0000:00:00.0: [8086:3c00] type 00 class 0x060000 [ 1.659453] pci 0000:00:00.0: PME# supported from D0 D3hot D3cold [ 1.659608] pci 0000:00:01.0: [8086:3c02] type 01 class 0x060400 [ 1.659716] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 1.659821] pci 0000:00:01.0: System wakeup disabled by ACPI [ 1.666503] pci 0000:00:01.1: [8086:3c03] type 01 class 0x060400 [ 1.666609] pci 0000:00:01.1: PME# supported from D0 D3hot D3cold [ 1.666710] pci 0000:00:01.1: System wakeup disabled by ACPI [ 1.673395] pci 0000:00:02.0: [8086:3c04] type 01 class 0x060400 [ 1.673502] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 1.673609] pci 0000:00:02.0: System wakeup disabled by ACPI [ 1.680285] pci 0000:00:02.2: [8086:3c06] type 01 class 0x060400 [ 1.680392] pci 0000:00:02.2: PME# supported from D0 D3hot D3cold [ 1.680499] pci 0000:00:02.2: System wakeup disabled by ACPI [ 1.687186] pci 0000:00:03.0: [8086:3c08] type 01 class 0x060400 [ 1.687293] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 1.687400] pci 0000:00:03.0: System wakeup disabled by ACPI [ 1.694085] pci 0000:00:04.0: [8086:3c20] type 00 class 0x088000 [ 1.694111] pci 0000:00:04.0: reg 0x10: [mem 0xebf90000-0xebf93fff 64bit] [ 1.694323] pci 0000:00:04.1: [8086:3c21] type 00 class 0x088000 [ 1.694347] pci 0000:00:04.1: reg 0x10: [mem 0xebf80000-0xebf83fff 64bit] [ 1.694552] pci 0000:00:04.2: [8086:3c22] type 00 class 0x088000 [ 1.694576] pci 0000:00:04.2: reg 0x10: [mem 0xebf70000-0xebf73fff 64bit] [ 1.694781] pci 0000:00:04.3: [8086:3c23] type 00 class 0x088000 [ 1.694805] pci 0000:00:04.3: reg 0x10: [mem 0xebf60000-0xebf63fff 64bit] [ 1.695027] pci 0000:00:04.4: [8086:3c24] type 00 class 0x088000 [ 1.695052] pci 0000:00:04.4: reg 0x10: [mem 0xebf50000-0xebf53fff 64bit] [ 1.695262] pci 0000:00:04.5: [8086:3c25] type 00 class 0x088000 [ 1.695286] pci 0000:00:04.5: reg 0x10: [mem 0xebf40000-0xebf43fff 64bit] [ 1.695492] pci 0000:00:04.6: [8086:3c26] type 00 class 0x088000 [ 1.695516] pci 0000:00:04.6: reg 0x10: [mem 0xebf30000-0xebf33fff 64bit] [ 1.695722] pci 0000:00:04.7: [8086:3c27] type 00 class 0x088000 [ 1.695746] pci 0000:00:04.7: reg 0x10: [mem 0xebf20000-0xebf23fff 64bit] [ 1.695948] pci 0000:00:05.0: [8086:3c28] type 00 class 0x088000 [ 1.696150] pci 0000:00:05.2: [8086:3c2a] type 00 class 0x088000 [ 1.696342] pci 0000:00:05.4: [8086:3c2c] type 00 class 0x080020 [ 1.696362] pci 0000:00:05.4: reg 0x10: [mem 0xd0f60000-0xd0f60fff] [ 1.696574] pci 0000:00:11.0: [8086:1d3e] type 01 class 0x060400 [ 1.696698] pci 0000:00:11.0: PME# supported from D0 D3hot D3cold [ 1.696870] pci 0000:00:16.0: [8086:1d3a] type 00 class 0x078000 [ 1.696898] pci 0000:00:16.0: reg 0x10: [mem 0xd0f50000-0xd0f5000f 64bit] [ 1.696990] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 1.697134] pci 0000:00:16.1: [8086:1d3b] type 00 class 0x078000 [ 1.697161] pci 0000:00:16.1: reg 0x10: [mem 0xd0f40000-0xd0f4000f 64bit] [ 1.697253] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 1.697400] pci 0000:00:1a.0: [8086:1d2d] type 00 class 0x0c0320 [ 1.697426] pci 0000:00:1a.0: reg 0x10: [mem 0xd0f20000-0xd0f203ff] [ 1.697541] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 1.697651] pci 0000:00:1a.0: System wakeup disabled by ACPI [ 1.704333] pci 0000:00:1c.0: [8086:1d10] type 01 class 0x060400 [ 1.704470] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 1.704565] pci 0000:00:1c.0: System wakeup disabled by ACPI [ 1.711257] pci 0000:00:1c.7: [8086:1d1e] type 01 class 0x060400 [ 1.711366] pci 0000:00:1c.7: PME# supported from D0 D3hot D3cold [ 1.711462] pci 0000:00:1c.7: System wakeup disabled by ACPI [ 1.718138] pci 0000:00:1d.0: [8086:1d26] type 00 class 0x0c0320 [ 1.718165] pci 0000:00:1d.0: reg 0x10: [mem 0xd0f10000-0xd0f103ff] [ 1.718282] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 1.718396] pci 0000:00:1d.0: System wakeup disabled by ACPI [ 1.725070] pci 0000:00:1e.0: [8086:244e] type 01 class 0x060401 [ 1.725217] pci 0000:00:1e.0: System wakeup disabled by ACPI [ 1.731884] pci 0000:00:1f.0: [8086:1d41] type 00 class 0x060100 [ 1.732144] pci 0000:00:1f.2: [8086:1d02] type 00 class 0x010601 [ 1.732169] pci 0000:00:1f.2: reg 0x10: [io 0x4070-0x4077] [ 1.732182] pci 0000:00:1f.2: reg 0x14: [io 0x4060-0x4063] [ 1.732195] pci 0000:00:1f.2: reg 0x18: [io 0x4050-0x4057] [ 1.732208] pci 0000:00:1f.2: reg 0x1c: [io 0x4040-0x4043] [ 1.732222] pci 0000:00:1f.2: reg 0x20: [io 0x4020-0x403f] [ 1.732235] pci 0000:00:1f.2: reg 0x24: [mem 0xd0f00000-0xd0f007ff] [ 1.732299] pci 0000:00:1f.2: PME# supported from D3hot [ 1.732434] pci 0000:00:1f.3: [8086:1d22] type 00 class 0x0c0500 [ 1.732458] pci 0000:00:1f.3: reg 0x10: [mem 0xebf10000-0xebf100ff 64bit] [ 1.732488] pci 0000:00:1f.3: reg 0x20: [io 0x4000-0x401f] [ 1.732710] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.738702] acpiphp: Slot [2] registered [ 1.743435] pci 0000:02:00.0: [8086:1521] type 00 class 0x020000 [ 1.743456] pci 0000:02:00.0: reg 0x10: [mem 0xd0b60000-0xd0b7ffff] [ 1.743477] pci 0000:02:00.0: reg 0x18: [io 0x3060-0x307f] [ 1.743490] pci 0000:02:00.0: reg 0x1c: [mem 0xd0bb0000-0xd0bb3fff] [ 1.743614] pci 0000:02:00.0: PME# supported from D0 D3hot D3cold [ 1.743650] pci 0000:02:00.0: reg 0x184: [mem 0xd0ca0000-0xd0ca3fff] [ 1.743656] pci 0000:02:00.0: VF(n) BAR0 space: [mem 0xd0ca0000-0xd0cbffff] (contains BAR0 for 8 VFs) [ 1.754484] pci 0000:02:00.0: reg 0x190: [mem 0xd0c80000-0xd0c83fff] [ 1.754490] pci 0000:02:00.0: VF(n) BAR3 space: [mem 0xd0c80000-0xd0c9ffff] (contains BAR3 for 8 VFs) [ 1.765439] pci 0000:02:00.1: [8086:1521] type 00 class 0x020000 [ 1.765459] pci 0000:02:00.1: reg 0x10: [mem 0xd0b40000-0xd0b5ffff] [ 1.765480] pci 0000:02:00.1: reg 0x18: [io 0x3040-0x305f] [ 1.765493] pci 0000:02:00.1: reg 0x1c: [mem 0xd0ba0000-0xd0ba3fff] [ 1.765609] pci 0000:02:00.1: PME# supported from D0 D3hot D3cold [ 1.765639] pci 0000:02:00.1: reg 0x184: [mem 0xd0c60000-0xd0c63fff] [ 1.765644] pci 0000:02:00.1: VF(n) BAR0 space: [mem 0xd0c60000-0xd0c7ffff] (contains BAR0 for 8 VFs) [ 1.776474] pci 0000:02:00.1: reg 0x190: [mem 0xd0c40000-0xd0c43fff] [ 1.776479] pci 0000:02:00.1: VF(n) BAR3 space: [mem 0xd0c40000-0xd0c5ffff] (contains BAR3 for 8 VFs) [ 1.787426] pci 0000:02:00.2: [8086:1521] type 00 class 0x020000 [ 1.787446] pci 0000:02:00.2: reg 0x10: [mem 0xd0b20000-0xd0b3ffff] [ 1.787467] pci 0000:02:00.2: reg 0x18: [io 0x3020-0x303f] [ 1.787479] pci 0000:02:00.2: reg 0x1c: [mem 0xd0b90000-0xd0b93fff] [ 1.787595] pci 0000:02:00.2: PME# supported from D0 D3hot D3cold [ 1.787624] pci 0000:02:00.2: reg 0x184: [mem 0xd0c20000-0xd0c23fff] [ 1.787630] pci 0000:02:00.2: VF(n) BAR0 space: [mem 0xd0c20000-0xd0c3ffff] (contains BAR0 for 8 VFs) [ 1.798458] pci 0000:02:00.2: reg 0x190: [mem 0xd0c00000-0xd0c03fff] [ 1.798463] pci 0000:02:00.2: VF(n) BAR3 space: [mem 0xd0c00000-0xd0c1ffff] (contains BAR3 for 8 VFs) [ 1.809414] pci 0000:02:00.3: [8086:1521] type 00 class 0x020000 [ 1.809434] pci 0000:02:00.3: reg 0x10: [mem 0xd0b00000-0xd0b1ffff] [ 1.809454] pci 0000:02:00.3: reg 0x18: [io 0x3000-0x301f] [ 1.809467] pci 0000:02:00.3: reg 0x1c: [mem 0xd0b80000-0xd0b83fff] [ 1.809583] pci 0000:02:00.3: PME# supported from D0 D3hot D3cold [ 1.809612] pci 0000:02:00.3: reg 0x184: [mem 0xd0be0000-0xd0be3fff] [ 1.809617] pci 0000:02:00.3: VF(n) BAR0 space: [mem 0xd0be0000-0xd0bfffff] (contains BAR0 for 8 VFs) [ 1.820448] pci 0000:02:00.3: reg 0x190: [mem 0xd0bc0000-0xd0bc3fff] [ 1.820453] pci 0000:02:00.3: VF(n) BAR3 space: [mem 0xd0bc0000-0xd0bdffff] (contains BAR3 for 8 VFs) [ 1.833289] pci 0000:00:01.1: PCI bridge to [bus 02-03] [ 1.839428] pci 0000:00:01.1: bridge window [io 0x3000-0x3fff] [ 1.839435] pci 0000:00:01.1: bridge window [mem 0xd0b00000-0xd0cfffff] [ 1.839590] acpiphp: Slot [2-2] registered [ 1.844691] pci 0000:04:00.0: [15b3:1003] type 00 class 0x028000 [ 1.844971] pci 0000:04:00.0: reg 0x10: [mem 0xd0e00000-0xd0efffff 64bit] [ 1.845176] pci 0000:04:00.0: reg 0x18: [mem 0xeb000000-0xeb7fffff 64bit pref] [ 1.846899] pci 0000:00:02.0: PCI bridge to [bus 04] [ 1.852743] pci 0000:00:02.0: bridge window [mem 0xd0e00000-0xd0efffff] [ 1.852753] pci 0000:00:02.0: bridge window [mem 0xeb000000-0xeb7fffff 64bit pref] [ 1.852901] acpiphp: Slot [2-3] registered [ 1.857811] pci 0000:00:02.2: PCI bridge to [bus 05] [ 1.863808] acpiphp: Slot [2-4] registered [ 1.868729] pci 0000:06:00.0: [1000:0087] type 00 class 0x010700 [ 1.868747] pci 0000:06:00.0: reg 0x10: [io 0x2000-0x20ff] [ 1.868763] pci 0000:06:00.0: reg 0x14: [mem 0xd0a40000-0xd0a4ffff 64bit] [ 1.868778] pci 0000:06:00.0: reg 0x1c: [mem 0xd0a00000-0xd0a3ffff 64bit] [ 1.868797] pci 0000:06:00.0: reg 0x30: [mem 0xd0900000-0xd09fffff pref] [ 1.868879] pci 0000:06:00.0: supports D1 D2 [ 1.870696] pci 0000:00:03.0: PCI bridge to [bus 06] [ 1.876537] pci 0000:00:03.0: bridge window [io 0x2000-0x2fff] [ 1.876544] pci 0000:00:03.0: bridge window [mem 0xd0900000-0xd0afffff] [ 1.876659] pci 0000:07:00.0: [8086:1d6b] type 00 class 0x010700 [ 1.876690] pci 0000:07:00.0: reg 0x10: [mem 0xebc00000-0xebc03fff 64bit pref] [ 1.876711] pci 0000:07:00.0: reg 0x18: [mem 0xeb800000-0xebbfffff 64bit pref] [ 1.876727] pci 0000:07:00.0: reg 0x20: [io 0x1000-0x10ff] [ 1.876869] pci 0000:07:00.0: reg 0x164: [mem 0xebc10000-0xebc13fff 64bit pref] [ 1.876875] pci 0000:07:00.0: VF(n) BAR0 space: [mem 0xebc10000-0xebc8bfff 64bit pref] (contains BAR0 for 31 VFs) [ 1.889074] pci 0000:07:00.3: [8086:1d70] type 00 class 0x0c0500 [ 1.889101] pci 0000:07:00.3: reg 0x10: [mem 0xd0d00000-0xd0d00fff] [ 1.889154] pci 0000:07:00.3: reg 0x20: [io 0x1100-0x111f] [ 1.889256] pci 0000:07:00.3: PME# supported from D0 D3hot D3cold [ 1.889368] pci 0000:00:11.0: PCI bridge to [bus 07] [ 1.895214] pci 0000:00:11.0: bridge window [io 0x1000-0x1fff] [ 1.895222] pci 0000:00:11.0: bridge window [mem 0xd0d00000-0xd0dfffff] [ 1.895232] pci 0000:00:11.0: bridge window [mem 0xeb800000-0xebcfffff 64bit pref] [ 1.895337] pci 0000:00:1c.0: PCI bridge to [bus 08] [ 1.901298] pci 0000:09:00.0: [102b:0522] type 00 class 0x030000 [ 1.901335] pci 0000:09:00.0: reg 0x10: [mem 0xea000000-0xeaffffff pref] [ 1.901357] pci 0000:09:00.0: reg 0x14: [mem 0xd0810000-0xd0813fff] [ 1.901380] pci 0000:09:00.0: reg 0x18: [mem 0xd0000000-0xd07fffff] [ 1.901455] pci 0000:09:00.0: reg 0x30: [mem 0xd0800000-0xd080ffff pref] [ 1.901598] pci 0000:09:00.0: System wakeup disabled by ACPI [ 1.910246] pci 0000:00:1c.7: PCI bridge to [bus 09] [ 1.916096] pci 0000:00:1c.7: bridge window [mem 0xd0000000-0xd08fffff] [ 1.916106] pci 0000:00:1c.7: bridge window [mem 0xea000000-0xeaffffff 64bit pref] [ 1.916210] pci 0000:00:1e.0: PCI bridge to [bus 0a] (subtractive decode) [ 1.924105] pci 0000:00:1e.0: bridge window [io 0x0000-0xbfff window] (subtractive decode) [ 1.924110] pci 0000:00:1e.0: bridge window [mem 0x000a0000-0x000bffff window] (subtractive decode) [ 1.924114] pci 0000:00:1e.0: bridge window [mem 0x000c0000-0x000c3fff window] (subtractive decode) [ 1.924118] pci 0000:00:1e.0: bridge window [mem 0x000c4000-0x000c7fff window] (subtractive decode) [ 1.924123] pci 0000:00:1e.0: bridge window [mem 0x000c8000-0x000cbfff window] (subtractive decode) [ 1.924127] pci 0000:00:1e.0: bridge window [mem 0x000d0000-0x000d3fff window] (subtractive decode) [ 1.924131] pci 0000:00:1e.0: bridge window [mem 0x000d8000-0x000dbfff window] (subtractive decode) [ 1.924136] pci 0000:00:1e.0: bridge window [mem 0x000dc000-0x000dffff window] (subtractive decode) [ 1.924140] pci 0000:00:1e.0: bridge window [mem 0x000e0000-0x000e3fff window] (subtractive decode) [ 1.924144] pci 0000:00:1e.0: bridge window [mem 0x000e4000-0x000e7fff window] (subtractive decode) [ 1.924148] pci 0000:00:1e.0: bridge window [mem 0x000e8000-0x000ebfff window] (subtractive decode) [ 1.924158] pci 0000:00:1e.0: bridge window [mem 0x000ec000-0x000effff window] (subtractive decode) [ 1.924162] pci 0000:00:1e.0: bridge window [mem 0x000f0000-0x000fffff window] (subtractive decode) [ 1.924167] pci 0000:00:1e.0: bridge window [mem 0xd0000000-0xebffffff window] (subtractive decode) [ 1.924172] pci 0000:00:1e.0: bridge window [mem 0x380000000000-0x38007fffffff window] (subtractive decode) [ 1.924254] pci_bus 0000:00: on NUMA node 0 [ 1.925488] ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 10 *11 12 14 15) [ 1.934527] ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 *10 11 12 14 15) [ 1.943558] ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 *5 6 10 11 12 14 15) [ 1.952587] ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 10 *11 12 14 15) [ 1.961620] ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 *5 6 10 11 12 14 15) [ 1.970656] ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 10 *11 12 14 15) [ 1.979695] ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 *10 11 12 14 15) [ 1.988719] ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 *10 11 12 14 15) [ 1.997957] ACPI: PCI Root Bridge [PCI1] (domain 0000 [bus 80-fe]) [ 2.005164] acpi PNP0A08:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI] [ 2.015088] acpi PNP0A08:01: _OSC: platform does not support [AER] [ 2.022554] acpi PNP0A08:01: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 2.031616] acpi PNP0A08:01: FADT indicates ASPM is unsupported, using BIOS configuration [ 2.041673] PCI host bridge to bus 0000:80 [ 2.046546] pci_bus 0000:80: root bus resource [bus 80-fe] [ 2.052972] pci_bus 0000:80: root bus resource [io 0x03b0-0x03df window] [ 2.060853] pci_bus 0000:80: root bus resource [io 0xc000-0xffff window] [ 2.068733] pci_bus 0000:80: root bus resource [mem 0x000a0000-0x000bffff window] [ 2.077595] pci_bus 0000:80: root bus resource [mem 0xec000000-0xfbffffff window] [ 2.086460] pci_bus 0000:80: root bus resource [mem 0x380080000000-0x3800ffffffff window] [ 2.096123] pci 0000:80:01.0: [8086:3c02] type 01 class 0x060400 [ 2.096241] pci 0000:80:01.0: PME# supported from D0 D3hot D3cold [ 2.096318] pci 0000:80:01.0: System wakeup disabled by ACPI [ 2.103012] pci 0000:80:02.0: [8086:3c04] type 01 class 0x060400 [ 2.103127] pci 0000:80:02.0: PME# supported from D0 D3hot D3cold [ 2.103202] pci 0000:80:02.0: System wakeup disabled by ACPI [ 2.109883] pci 0000:80:03.0: [8086:3c08] type 01 class 0x060400 [ 2.109996] pci 0000:80:03.0: PME# supported from D0 D3hot D3cold [ 2.110075] pci 0000:80:03.0: System wakeup disabled by ACPI [ 2.116763] pci 0000:80:03.2: [8086:3c0a] type 01 class 0x060400 [ 2.116874] pci 0000:80:03.2: PME# supported from D0 D3hot D3cold [ 2.116939] pci 0000:80:03.2: System wakeup disabled by ACPI [ 2.123631] pci 0000:80:04.0: [8086:3c20] type 00 class 0x088000 [ 2.123658] pci 0000:80:04.0: reg 0x10: [mem 0xfbf70000-0xfbf73fff 64bit] [ 2.123841] pci 0000:80:04.1: [8086:3c21] type 00 class 0x088000 [ 2.123866] pci 0000:80:04.1: reg 0x10: [mem 0xfbf60000-0xfbf63fff 64bit] [ 2.124048] pci 0000:80:04.2: [8086:3c22] type 00 class 0x088000 [ 2.124074] pci 0000:80:04.2: reg 0x10: [mem 0xfbf50000-0xfbf53fff 64bit] [ 2.124258] pci 0000:80:04.3: [8086:3c23] type 00 class 0x088000 [ 2.124283] pci 0000:80:04.3: reg 0x10: [mem 0xfbf40000-0xfbf43fff 64bit] [ 2.124459] pci 0000:80:04.4: [8086:3c24] type 00 class 0x088000 [ 2.124484] pci 0000:80:04.4: reg 0x10: [mem 0xfbf30000-0xfbf33fff 64bit] [ 2.124667] pci 0000:80:04.5: [8086:3c25] type 00 class 0x088000 [ 2.124692] pci 0000:80:04.5: reg 0x10: [mem 0xfbf20000-0xfbf23fff 64bit] [ 2.124875] pci 0000:80:04.6: [8086:3c26] type 00 class 0x088000 [ 2.124900] pci 0000:80:04.6: reg 0x10: [mem 0xfbf10000-0xfbf13fff 64bit] [ 2.125077] pci 0000:80:04.7: [8086:3c27] type 00 class 0x088000 [ 2.125102] pci 0000:80:04.7: reg 0x10: [mem 0xfbf00000-0xfbf03fff 64bit] [ 2.125280] pci 0000:80:05.0: [8086:3c28] type 00 class 0x088000 [ 2.125446] pci 0000:80:05.2: [8086:3c2a] type 00 class 0x088000 [ 2.125617] pci 0000:80:05.4: [8086:3c2c] type 00 class 0x080020 [ 2.125637] pci 0000:80:05.4: reg 0x10: [mem 0xec000000-0xec000fff] [ 2.125893] pci 0000:80:01.0: PCI bridge to [bus 81] [ 2.131814] pci 0000:80:02.0: PCI bridge to [bus 82] [ 2.137741] pci 0000:80:03.0: PCI bridge to [bus 83] [ 2.143665] pci 0000:80:03.2: PCI bridge to [bus 84] [ 2.149546] pci_bus 0000:80: on NUMA node 1 [ 2.160549] ACPI: PCI Root Bridge [UCR0] (domain 0000 [bus 7f]) [ 2.167463] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI] [ 2.177169] acpi PNP0A03:00: _OSC: platform does not support [PCIeHotplug PME AER] [ 2.186182] acpi PNP0A03:00: _OSC: OS now controls [PCIeCapability] [ 2.193483] acpi PNP0A03:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 2.203224] PCI host bridge to bus 0000:7f [ 2.208093] pci_bus 0000:7f: root bus resource [bus 7f] [ 2.214241] pci 0000:7f:08.0: [8086:3c80] type 00 class 0x088000 [ 2.214344] pci 0000:7f:09.0: [8086:3c90] type 00 class 0x088000 [ 2.214444] pci 0000:7f:0a.0: [8086:3cc0] type 00 class 0x088000 [ 2.214535] pci 0000:7f:0a.1: [8086:3cc1] type 00 class 0x088000 [ 2.214623] pci 0000:7f:0a.2: [8086:3cc2] type 00 class 0x088000 [ 2.214710] pci 0000:7f:0a.3: [8086:3cd0] type 00 class 0x088000 [ 2.214800] pci 0000:7f:0b.0: [8086:3ce0] type 00 class 0x088000 [ 2.214887] pci 0000:7f:0b.3: [8086:3ce3] type 00 class 0x088000 [ 2.214976] pci 0000:7f:0c.0: [8086:3ce8] type 00 class 0x088000 [ 2.215061] pci 0000:7f:0c.1: [8086:3ce8] type 00 class 0x088000 [ 2.215154] pci 0000:7f:0c.2: [8086:3ce8] type 00 class 0x088000 [ 2.215246] pci 0000:7f:0c.3: [8086:3ce8] type 00 class 0x088000 [ 2.215335] pci 0000:7f:0c.6: [8086:3cf4] type 00 class 0x088000 [ 2.215420] pci 0000:7f:0c.7: [8086:3cf6] type 00 class 0x088000 [ 2.215506] pci 0000:7f:0d.0: [8086:3ce8] type 00 class 0x088000 [ 2.215600] pci 0000:7f:0d.1: [8086:3ce8] type 00 class 0x088000 [ 2.215687] pci 0000:7f:0d.2: [8086:3ce8] type 00 class 0x088000 [ 2.215776] pci 0000:7f:0d.3: [8086:3ce8] type 00 class 0x088000 [ 2.215863] pci 0000:7f:0d.6: [8086:3cf5] type 00 class 0x088000 [ 2.215946] pci 0000:7f:0e.0: [8086:3ca0] type 00 class 0x088000 [ 2.216040] pci 0000:7f:0e.1: [8086:3c46] type 00 class 0x110100 [ 2.216141] pci 0000:7f:0f.0: [8086:3ca8] type 00 class 0x088000 [ 2.216256] pci 0000:7f:0f.1: [8086:3c71] type 00 class 0x088000 [ 2.216374] pci 0000:7f:0f.2: [8086:3caa] type 00 class 0x088000 [ 2.216483] pci 0000:7f:0f.3: [8086:3cab] type 00 class 0x088000 [ 2.216596] pci 0000:7f:0f.4: [8086:3cac] type 00 class 0x088000 [ 2.216705] pci 0000:7f:0f.5: [8086:3cad] type 00 class 0x088000 [ 2.216811] pci 0000:7f:0f.6: [8086:3cae] type 00 class 0x088000 [ 2.216907] pci 0000:7f:10.0: [8086:3cb0] type 00 class 0x088000 [ 2.217015] pci 0000:7f:10.1: [8086:3cb1] type 00 class 0x088000 [ 2.217124] pci 0000:7f:10.2: [8086:3cb2] type 00 class 0x088000 [ 2.217241] pci 0000:7f:10.3: [8086:3cb3] type 00 class 0x088000 [ 2.217352] pci 0000:7f:10.4: [8086:3cb4] type 00 class 0x088000 [ 2.217466] pci 0000:7f:10.5: [8086:3cb5] type 00 class 0x088000 [ 2.217578] pci 0000:7f:10.6: [8086:3cb6] type 00 class 0x088000 [ 2.217688] pci 0000:7f:10.7: [8086:3cb7] type 00 class 0x088000 [ 2.217794] pci 0000:7f:11.0: [8086:3cb8] type 00 class 0x088000 [ 2.217891] pci 0000:7f:13.0: [8086:3ce4] type 00 class 0x088000 [ 2.217976] pci 0000:7f:13.1: [8086:3c43] type 00 class 0x110100 [ 2.218075] pci 0000:7f:13.4: [8086:3ce6] type 00 class 0x110100 [ 2.218163] pci 0000:7f:13.5: [8086:3c44] type 00 class 0x110100 [ 2.218258] pci 0000:7f:13.6: [8086:3c45] type 00 class 0x088000 [ 2.218452] ACPI: PCI Root Bridge [UCR1] (domain 0000 [bus ff]) [ 2.225366] acpi PNP0A03:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI] [ 2.239743] acpi PNP0A03:01: _OSC: platform does not support [PCIeHotplug PME AER] [ 2.248755] acpi PNP0A03:01: _OSC: OS now controls [PCIeCapability] [ 2.256053] acpi PNP0A03:01: FADT indicates ASPM is unsupported, using BIOS configuration [ 2.265811] PCI host bridge to bus 0000:ff [ 2.270685] pci_bus 0000:ff: root bus resource [bus ff] [ 2.276836] pci 0000:ff:08.0: [8086:3c80] type 00 class 0x088000 [ 2.276952] pci 0000:ff:09.0: [8086:3c90] type 00 class 0x088000 [ 2.277059] pci 0000:ff:0a.0: [8086:3cc0] type 00 class 0x088000 [ 2.277151] pci 0000:ff:0a.1: [8086:3cc1] type 00 class 0x088000 [ 2.277246] pci 0000:ff:0a.2: [8086:3cc2] type 00 class 0x088000 [ 2.277338] pci 0000:ff:0a.3: [8086:3cd0] type 00 class 0x088000 [ 2.277431] pci 0000:ff:0b.0: [8086:3ce0] type 00 class 0x088000 [ 2.277521] pci 0000:ff:0b.3: [8086:3ce3] type 00 class 0x088000 [ 2.277621] pci 0000:ff:0c.0: [8086:3ce8] type 00 class 0x088000 [ 2.277713] pci 0000:ff:0c.1: [8086:3ce8] type 00 class 0x088000 [ 2.277805] pci 0000:ff:0c.2: [8086:3ce8] type 00 class 0x088000 [ 2.277895] pci 0000:ff:0c.3: [8086:3ce8] type 00 class 0x088000 [ 2.277988] pci 0000:ff:0c.6: [8086:3cf4] type 00 class 0x088000 [ 2.278082] pci 0000:ff:0c.7: [8086:3cf6] type 00 class 0x088000 [ 2.278173] pci 0000:ff:0d.0: [8086:3ce8] type 00 class 0x088000 [ 2.278263] pci 0000:ff:0d.1: [8086:3ce8] type 00 class 0x088000 [ 2.278354] pci 0000:ff:0d.2: [8086:3ce8] type 00 class 0x088000 [ 2.278442] pci 0000:ff:0d.3: [8086:3ce8] type 00 class 0x088000 [ 2.278531] pci 0000:ff:0d.6: [8086:3cf5] type 00 class 0x088000 [ 2.278621] pci 0000:ff:0e.0: [8086:3ca0] type 00 class 0x088000 [ 2.278719] pci 0000:ff:0e.1: [8086:3c46] type 00 class 0x110100 [ 2.278838] pci 0000:ff:0f.0: [8086:3ca8] type 00 class 0x088000 [ 2.278956] pci 0000:ff:0f.1: [8086:3c71] type 00 class 0x088000 [ 2.279073] pci 0000:ff:0f.2: [8086:3caa] type 00 class 0x088000 [ 2.279189] pci 0000:ff:0f.3: [8086:3cab] type 00 class 0x088000 [ 2.279305] pci 0000:ff:0f.4: [8086:3cac] type 00 class 0x088000 [ 2.279419] pci 0000:ff:0f.5: [8086:3cad] type 00 class 0x088000 [ 2.279533] pci 0000:ff:0f.6: [8086:3cae] type 00 class 0x088000 [ 2.279632] pci 0000:ff:10.0: [8086:3cb0] type 00 class 0x088000 [ 2.279754] pci 0000:ff:10.1: [8086:3cb1] type 00 class 0x088000 [ 2.279881] pci 0000:ff:10.2: [8086:3cb2] type 00 class 0x088000 [ 2.279998] pci 0000:ff:10.3: [8086:3cb3] type 00 class 0x088000 [ 2.280113] pci 0000:ff:10.4: [8086:3cb4] type 00 class 0x088000 [ 2.280229] pci 0000:ff:10.5: [8086:3cb5] type 00 class 0x088000 [ 2.280342] pci 0000:ff:10.6: [8086:3cb6] type 00 class 0x088000 [ 2.280454] pci 0000:ff:10.7: [8086:3cb7] type 00 class 0x088000 [ 2.280564] pci 0000:ff:11.0: [8086:3cb8] type 00 class 0x088000 [ 2.280674] pci 0000:ff:13.0: [8086:3ce4] type 00 class 0x088000 [ 2.280771] pci 0000:ff:13.1: [8086:3c43] type 00 class 0x110100 [ 2.280871] pci 0000:ff:13.4: [8086:3ce6] type 00 class 0x110100 [ 2.280963] pci 0000:ff:13.5: [8086:3c44] type 00 class 0x110100 [ 2.281055] pci 0000:ff:13.6: [8086:3c45] type 00 class 0x088000 [ 2.281397] ACPI: Enabled 6 GPEs in block 00 to 3F [ 2.287395] vgaarb: device added: PCI:0000:09:00.0,decodes=io+mem,owns=io+mem,locks=none [ 2.296962] vgaarb: loaded [ 2.300271] vgaarb: bridge control possible 0000:09:00.0 [ 2.306723] SCSI subsystem initialized [ 2.311260] ACPI: bus type USB registered [ 2.316063] usbcore: registered new interface driver usbfs [ 2.322503] usbcore: registered new interface driver hub [ 2.329026] usbcore: registered new device driver usb [ 2.335510] PCI: Using ACPI for IRQ routing [ 2.347265] PCI: pci_cache_line_size set to 64 bytes [ 2.347630] e820: reserve RAM buffer [mem 0x0008f000-0x0008ffff] [ 2.347635] e820: reserve RAM buffer [mem 0xbb3c7000-0xbbffffff] [ 2.347638] e820: reserve RAM buffer [mem 0xbe000000-0xbfffffff] [ 2.348039] NetLabel: Initializing [ 2.352122] NetLabel: domain hash size = 128 [ 2.357277] NetLabel: protocols = UNLABELED CIPSOv4 [ 2.363141] NetLabel: unlabeled traffic allowed by default [ 2.369733] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 2.377720] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 2.386585] amd_nb: Cannot enumerate AMD northbridges [ 2.392708] Switched to clocksource hpet [ 2.412606] pnp: PnP ACPI init [ 2.416330] ACPI: bus type PNP registered [ 2.421366] system 00:00: [io 0x0680-0x069f] has been reserved [ 2.428287] system 00:00: [io 0xffff] has been reserved [ 2.434517] system 00:00: [io 0xffff] has been reserved [ 2.440746] system 00:00: [io 0xffff] has been reserved [ 2.446983] system 00:00: [io 0x0400-0x0453] could not be reserved [ 2.454281] system 00:00: [io 0x0458-0x047f] has been reserved [ 2.461211] system 00:00: [io 0x0500-0x057f] has been reserved [ 2.468122] system 00:00: [io 0x0600-0x061f] has been reserved [ 2.475034] system 00:00: [io 0x0ca2-0x0ca5] has been reserved [ 2.481947] system 00:00: [io 0x0cf9] could not be reserved [ 2.488558] system 00:00: Plug and Play ACPI device, IDs PNP0c02 (active) [ 2.488625] pnp 00:01: Plug and Play ACPI device, IDs PNP0b00 (active) [ 2.488771] system 00:02: [io 0x0454-0x0457] has been reserved [ 2.495696] system 00:02: Plug and Play ACPI device, IDs INT3f0d PNP0c02 (active) [ 2.496086] pnp 00:03: [dma 0 disabled] [ 2.496215] pnp 00:03: Plug and Play ACPI device, IDs PNP0501 (active) [ 2.496489] pnp 00:04: [dma 0 disabled] [ 2.496615] pnp 00:04: Plug and Play ACPI device, IDs PNP0501 (active) [ 2.497214] system 00:05: [mem 0xfed1c000-0xfed1ffff] has been reserved [ 2.504909] system 00:05: [mem 0xebfff000-0xebffffff] has been reserved [ 2.512597] system 00:05: [mem 0xc0000000-0xcfffffff] has been reserved [ 2.520280] system 00:05: [mem 0xfed20000-0xfed3ffff] has been reserved [ 2.527969] system 00:05: [mem 0xfed45000-0xfed8ffff] has been reserved [ 2.535656] system 00:05: [mem 0xff000000-0xffffffff] could not be reserved [ 2.543737] system 00:05: [mem 0xfee00000-0xfeefffff] could not be reserved [ 2.551815] system 00:05: [mem 0xfec00000-0xfecfffff] could not be reserved [ 2.559894] system 00:05: [mem 0xd0f70000-0xd0f70fff] has been reserved [ 2.567585] system 00:05: Plug and Play ACPI device, IDs PNP0c02 (active) [ 2.568099] system 00:06: [mem 0x00000000-0x0009cfff] could not be reserved [ 2.576189] system 00:06: Plug and Play ACPI device, IDs PNP0c01 (active) [ 2.576727] pnp: PnP ACPI: found 7 devices [ 2.581597] ACPI: bus type PNP unregistered [ 2.595350] pci 0000:00:01.0: PCI bridge to [bus 01] [ 2.601210] pci 0000:00:01.1: PCI bridge to [bus 02-03] [ 2.607344] pci 0000:00:01.1: bridge window [io 0x3000-0x3fff] [ 2.614453] pci 0000:00:01.1: bridge window [mem 0xd0b00000-0xd0cfffff] [ 2.622347] pci 0000:00:02.0: PCI bridge to [bus 04] [ 2.628191] pci 0000:00:02.0: bridge window [mem 0xd0e00000-0xd0efffff] [ 2.636075] pci 0000:00:02.0: bridge window [mem 0xeb000000-0xeb7fffff 64bit pref] [ 2.645235] pci 0000:00:02.2: PCI bridge to [bus 05] [ 2.651088] pci 0000:00:03.0: PCI bridge to [bus 06] [ 2.656931] pci 0000:00:03.0: bridge window [io 0x2000-0x2fff] [ 2.664040] pci 0000:00:03.0: bridge window [mem 0xd0900000-0xd0afffff] [ 2.671943] pci 0000:00:11.0: PCI bridge to [bus 07] [ 2.677785] pci 0000:00:11.0: bridge window [io 0x1000-0x1fff] [ 2.684894] pci 0000:00:11.0: bridge window [mem 0xd0d00000-0xd0dfffff] [ 2.692779] pci 0000:00:11.0: bridge window [mem 0xeb800000-0xebcfffff 64bit pref] [ 2.701942] pci 0000:00:1c.0: PCI bridge to [bus 08] [ 2.707800] pci 0000:00:1c.7: PCI bridge to [bus 09] [ 2.713643] pci 0000:00:1c.7: bridge window [mem 0xd0000000-0xd08fffff] [ 2.721532] pci 0000:00:1c.7: bridge window [mem 0xea000000-0xeaffffff 64bit pref] [ 2.730695] pci 0000:00:1e.0: PCI bridge to [bus 0a] [ 2.736554] pci_bus 0000:00: resource 4 [io 0x0000-0xbfff window] [ 2.736559] pci_bus 0000:00: resource 5 [mem 0x000a0000-0x000bffff window] [ 2.736564] pci_bus 0000:00: resource 6 [mem 0x000c0000-0x000c3fff window] [ 2.736568] pci_bus 0000:00: resource 7 [mem 0x000c4000-0x000c7fff window] [ 2.736573] pci_bus 0000:00: resource 8 [mem 0x000c8000-0x000cbfff window] [ 2.736577] pci_bus 0000:00: resource 9 [mem 0x000d0000-0x000d3fff window] [ 2.736582] pci_bus 0000:00: resource 10 [mem 0x000d8000-0x000dbfff window] [ 2.736586] pci_bus 0000:00: resource 11 [mem 0x000dc000-0x000dffff window] [ 2.736590] pci_bus 0000:00: resource 12 [mem 0x000e0000-0x000e3fff window] [ 2.736595] pci_bus 0000:00: resource 13 [mem 0x000e4000-0x000e7fff window] [ 2.736599] pci_bus 0000:00: resource 14 [mem 0x000e8000-0x000ebfff window] [ 2.736604] pci_bus 0000:00: resource 15 [mem 0x000ec000-0x000effff window] [ 2.736608] pci_bus 0000:00: resource 16 [mem 0x000f0000-0x000fffff window] [ 2.736613] pci_bus 0000:00: resource 17 [mem 0xd0000000-0xebffffff window] [ 2.736617] pci_bus 0000:00: resource 18 [mem 0x380000000000-0x38007fffffff window] [ 2.736622] pci_bus 0000:02: resource 0 [io 0x3000-0x3fff] [ 2.736627] pci_bus 0000:02: resource 1 [mem 0xd0b00000-0xd0cfffff] [ 2.736631] pci_bus 0000:04: resource 1 [mem 0xd0e00000-0xd0efffff] [ 2.736636] pci_bus 0000:04: resource 2 [mem 0xeb000000-0xeb7fffff 64bit pref] [ 2.736640] pci_bus 0000:06: resource 0 [io 0x2000-0x2fff] [ 2.736645] pci_bus 0000:06: resource 1 [mem 0xd0900000-0xd0afffff] [ 2.736650] pci_bus 0000:07: resource 0 [io 0x1000-0x1fff] [ 2.736654] pci_bus 0000:07: resource 1 [mem 0xd0d00000-0xd0dfffff] [ 2.736658] pci_bus 0000:07: resource 2 [mem 0xeb800000-0xebcfffff 64bit pref] [ 2.736663] pci_bus 0000:09: resource 1 [mem 0xd0000000-0xd08fffff] [ 2.736667] pci_bus 0000:09: resource 2 [mem 0xea000000-0xeaffffff 64bit pref] [ 2.736672] pci_bus 0000:0a: resource 4 [io 0x0000-0xbfff window] [ 2.736676] pci_bus 0000:0a: resource 5 [mem 0x000a0000-0x000bffff window] [ 2.736681] pci_bus 0000:0a: resource 6 [mem 0x000c0000-0x000c3fff window] [ 2.736685] pci_bus 0000:0a: resource 7 [mem 0x000c4000-0x000c7fff window] [ 2.736689] pci_bus 0000:0a: resource 8 [mem 0x000c8000-0x000cbfff window] [ 2.736694] pci_bus 0000:0a: resource 9 [mem 0x000d0000-0x000d3fff window] [ 2.736705] pci_bus 0000:0a: resource 10 [mem 0x000d8000-0x000dbfff window] [ 2.736709] pci_bus 0000:0a: resource 11 [mem 0x000dc000-0x000dffff window] [ 2.736713] pci_bus 0000:0a: resource 12 [mem 0x000e0000-0x000e3fff window] [ 2.736718] pci_bus 0000:0a: resource 13 [mem 0x000e4000-0x000e7fff window] [ 2.736722] pci_bus 0000:0a: resource 14 [mem 0x000e8000-0x000ebfff window] [ 2.736727] pci_bus 0000:0a: resource 15 [mem 0x000ec000-0x000effff window] [ 2.736731] pci_bus 0000:0a: resource 16 [mem 0x000f0000-0x000fffff window] [ 2.736736] pci_bus 0000:0a: resource 17 [mem 0xd0000000-0xebffffff window] [ 2.736740] pci_bus 0000:0a: resource 18 [mem 0x380000000000-0x38007fffffff window] [ 2.736781] pci 0000:80:01.0: PCI bridge to [bus 81] [ 2.742632] pci 0000:80:02.0: PCI bridge to [bus 82] [ 2.748483] pci 0000:80:03.0: PCI bridge to [bus 83] [ 2.754335] pci 0000:80:03.2: PCI bridge to [bus 84] [ 2.760191] pci_bus 0000:80: resource 4 [io 0x03b0-0x03df window] [ 2.760196] pci_bus 0000:80: resource 5 [io 0xc000-0xffff window] [ 2.760200] pci_bus 0000:80: resource 6 [mem 0x000a0000-0x000bffff window] [ 2.760204] pci_bus 0000:80: resource 7 [mem 0xec000000-0xfbffffff window] [ 2.760209] pci_bus 0000:80: resource 8 [mem 0x380080000000-0x3800ffffffff window] [ 2.760550] NET: Registered protocol family 2 [ 2.768061] TCP established hash table entries: 262144 (order: 9, 2097152 bytes) [ 2.777721] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes) [ 2.785762] TCP: Hash tables configured (established 262144 bind 65536) [ 2.793540] TCP: reno registered [ 2.797598] UDP hash table entries: 16384 (order: 7, 524288 bytes) [ 2.805063] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes) [ 2.814182] NET: Registered protocol family 1 [ 3.919768] pci 0000:00:1a.0: EHCI: BIOS handoff failed (BIOS bug?) 01010001 [ 5.027820] pci 0000:00:1d.0: EHCI: BIOS handoff failed (BIOS bug?) 01010001 [ 5.036297] PCI: CLS mismatch (64 != 32), using 64 bytes [ 5.036325] pci 0000:09:00.0: Boot video device [ 5.036628] Unpacking initramfs... [ 5.611811] Freeing initrd memory: 18720k freed [ 5.624375] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 5.631894] software IO TLB [mem 0xb73c7000-0xbb3c7000] (64MB) mapped at [ffff8800b73c7000-ffff8800bb3c6fff] [ 5.643842] RAPL PMU: API unit is 2^-32 Joules, 3 fixed counters, 163840 ms ovfl timer [ 5.653200] RAPL PMU: hw unit of domain pp0-core 2^-16 Joules [ 5.659930] RAPL PMU: hw unit of domain package 2^-16 Joules [ 5.666554] RAPL PMU: hw unit of domain dram 2^-16 Joules [ 5.685067] sha1_ssse3: Using AVX optimized SHA-1 implementation [ 5.692259] sha256_ssse3: Using AVX optimized SHA-256 implementation [ 5.705006] futex hash table entries: 65536 (order: 10, 4194304 bytes) [ 5.713562] Initialise system trusted keyring [ 5.718884] audit: initializing netlink socket (disabled) [ 5.725239] type=2000 audit(1524526627.302:1): initialized [ 5.782773] HugeTLB registered 1 GB page size, pre-allocated 0 pages [ 5.790177] HugeTLB registered 2 MB page size, pre-allocated 0 pages [ 5.799781] zpool: loaded [ 5.803024] zbud: loaded [ 5.807296] VFS: Disk quotas dquot_6.6.0 [ 5.812471] Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 5.821353] msgmni has been set to 32768 [ 5.826396] Key type big_key registered [ 5.831002] SELinux: Registering netfilter hooks [ 5.833639] NET: Registered protocol family 38 [ 5.838933] Key type asymmetric registered [ 5.843819] Asymmetric key parser 'x509' registered [ 5.849732] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 250) [ 5.858773] io scheduler noop registered [ 5.863470] io scheduler deadline registered (default) [ 5.869782] io scheduler cfq registered [ 5.875381] pcieport 0000:00:01.0: irq 25 for MSI/MSI-X [ 5.875772] pcieport 0000:00:01.1: irq 26 for MSI/MSI-X [ 5.876152] pcieport 0000:00:02.0: irq 27 for MSI/MSI-X [ 5.876525] pcieport 0000:00:02.2: irq 28 for MSI/MSI-X [ 5.876993] pcieport 0000:00:03.0: irq 29 for MSI/MSI-X [ 5.877389] pcieport 0000:00:11.0: irq 30 for MSI/MSI-X [ 5.877770] pcieport 0000:00:1c.0: irq 31 for MSI/MSI-X [ 5.878243] pcieport 0000:00:1c.7: irq 32 for MSI/MSI-X [ 5.878782] pcieport 0000:80:01.0: irq 34 for MSI/MSI-X [ 5.879049] pcieport 0000:80:02.0: irq 35 for MSI/MSI-X [ 5.879250] pcieport 0000:80:03.0: irq 36 for MSI/MSI-X [ 5.879452] pcieport 0000:80:03.2: irq 37 for MSI/MSI-X [ 5.879606] pcieport 0000:00:01.0: Signaling PME through PCIe PME interrupt [ 5.887716] pcie_pme 0000:00:01.0:pcie01: service driver pcie_pme loaded [ 5.887763] pcieport 0000:00:01.1: Signaling PME through PCIe PME interrupt [ 5.895868] pci 0000:02:00.0: Signaling PME through PCIe PME interrupt [ 5.903476] pci 0000:02:00.1: Signaling PME through PCIe PME interrupt [ 5.911081] pci 0000:02:00.2: Signaling PME through PCIe PME interrupt [ 5.918697] pci 0000:02:00.3: Signaling PME through PCIe PME interrupt [ 5.926311] pcie_pme 0000:00:01.1:pcie01: service driver pcie_pme loaded [ 5.926341] pcieport 0000:00:02.0: Signaling PME through PCIe PME interrupt [ 5.934428] pci 0000:04:00.0: Signaling PME through PCIe PME interrupt [ 5.942050] pcie_pme 0000:00:02.0:pcie01: service driver pcie_pme loaded [ 5.942096] pcieport 0000:00:02.2: Signaling PME through PCIe PME interrupt [ 5.950199] pcie_pme 0000:00:02.2:pcie01: service driver pcie_pme loaded [ 5.950243] pcieport 0000:00:03.0: Signaling PME through PCIe PME interrupt [ 5.958335] pci 0000:06:00.0: Signaling PME through PCIe PME interrupt [ 5.965961] pcie_pme 0000:00:03.0:pcie01: service driver pcie_pme loaded [ 5.965992] pcieport 0000:00:11.0: Signaling PME through PCIe PME interrupt [ 5.974082] pci 0000:07:00.0: Signaling PME through PCIe PME interrupt [ 5.981699] pci 0000:07:00.3: Signaling PME through PCIe PME interrupt [ 5.989308] pcie_pme 0000:00:11.0:pcie01: service driver pcie_pme loaded [ 5.989361] pcieport 0000:00:1c.0: Signaling PME through PCIe PME interrupt [ 5.997466] pcie_pme 0000:00:1c.0:pcie01: service driver pcie_pme loaded [ 5.997502] pcieport 0000:00:1c.7: Signaling PME through PCIe PME interrupt [ 6.005599] pci 0000:09:00.0: Signaling PME through PCIe PME interrupt [ 6.013221] pcie_pme 0000:00:1c.7:pcie01: service driver pcie_pme loaded [ 6.013257] pcieport 0000:80:01.0: Signaling PME through PCIe PME interrupt [ 6.021361] pcie_pme 0000:80:01.0:pcie01: service driver pcie_pme loaded [ 6.021412] pcieport 0000:80:02.0: Signaling PME through PCIe PME interrupt [ 6.029515] pcie_pme 0000:80:02.0:pcie01: service driver pcie_pme loaded [ 6.029550] pcieport 0000:80:03.0: Signaling PME through PCIe PME interrupt [ 6.037645] pcie_pme 0000:80:03.0:pcie01: service driver pcie_pme loaded [ 6.037677] pcieport 0000:80:03.2: Signaling PME through PCIe PME interrupt [ 6.045782] pcie_pme 0000:80:03.2:pcie01: service driver pcie_pme loaded [ 6.045917] pci_hotplug: PCI Hot Plug PCI Core version: 0.5 [ 6.052463] pciehp: PCI Express Hot Plug Controller Driver version: 0.4 [ 6.060334] intel_idle: MWAIT substates: 0x21120 [ 6.060338] intel_idle: v0.4.1 model 0x2D [ 6.060615] intel_idle: lapic_timer_reliable_states 0xffffffff [ 6.060763] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 [ 6.069535] ACPI: Power Button [PWRF] [ 6.073961] ACPI: Requesting acpi_cpufreq [ 6.116566] ERST: Error Record Serialization Table (ERST) support is initialized. [ 6.125455] pstore: Registered erst as persistent store backend [ 6.132554] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 6.141436] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 6.169479] 00:03: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A [ 6.196737] 00:04: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A [ 6.203749] Non-volatile memory driver v1.3 [ 6.208759] Linux agpgart interface v0.103 [ 6.213832] crash memory driver: version 1.1 [ 6.219088] rdac: device handler registered [ 6.224110] hp_sw: device handler registered [ 6.229194] emc: device handler registered [ 6.234070] alua: device handler registered [ 6.239083] libphy: Fixed MDIO Bus: probed [ 6.244007] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver [ 6.251620] ehci-pci: EHCI PCI platform driver [ 6.257122] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 6.263300] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1 [ 6.272081] ehci-pci 0000:00:1a.0: debug port 2 [ 6.281368] ehci-pci 0000:00:1a.0: cache line size of 64 is not supported [ 6.281388] ehci-pci 0000:00:1a.0: irq 22, io mem 0xd0f20000 [ 6.293880] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 6.300638] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002 [ 6.308511] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 6.317084] usb usb1: Product: EHCI Host Controller [ 6.322827] usb usb1: Manufacturer: Linux 3.10.0-693.21.1.el7_lustre.x86_64 ehci_hcd [ 6.331988] usb usb1: SerialNumber: 0000:00:1a.0 [ 6.342132] hub 1-0:1.0: USB hub found [ 6.346609] hub 1-0:1.0: 2 ports detected [ 6.351651] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 6.357824] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2 [ 6.366602] ehci-pci 0000:00:1d.0: debug port 2 [ 6.375838] ehci-pci 0000:00:1d.0: cache line size of 64 is not supported [ 6.375863] ehci-pci 0000:00:1d.0: irq 20, io mem 0xd0f10000 [ 6.387885] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 6.394624] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002 [ 6.402491] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 6.411065] usb usb2: Product: EHCI Host Controller [ 6.416808] usb usb2: Manufacturer: Linux 3.10.0-693.21.1.el7_lustre.x86_64 ehci_hcd [ 6.425962] usb usb2: SerialNumber: 0000:00:1d.0 [ 6.431496] hub 2-0:1.0: USB hub found [ 6.435974] hub 2-0:1.0: 2 ports detected [ 6.440843] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver [ 6.448045] ohci-pci: OHCI PCI platform driver [ 6.453336] uhci_hcd: USB Universal Host Controller Interface driver [ 6.460806] usbcore: registered new interface driver usbserial [ 6.467639] usbcore: registered new interface driver usbserial_generic [ 6.475249] usbserial: USB Serial support registered for generic [ 6.482277] i8042: PNP: No PS/2 controller found. Probing ports directly. [ 6.652898] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 6.680908] tsc: Refined TSC clocksource calibration: 2693.506 MHz [ 7.529950] i8042: No controller found [ 7.534474] Switched to clocksource tsc [ 7.534506] mousedev: PS/2 mouse device common for all mice [ 7.534652] rtc_cmos 00:01: RTC can wake from S4 [ 7.534890] rtc_cmos 00:01: rtc core: registered rtc_cmos as rtc0 [ 7.534953] rtc_cmos 00:01: alarms up to one month, y3k, 242 bytes nvram, hpet irqs [ 7.535014] Intel P-state driver initializing. [ 7.540989] cpuidle: using governor menu [ 7.542022] hidraw: raw HID events driver (C) Jiri Kosina [ 7.542234] usbcore: registered new interface driver usbhid [ 7.542235] usbhid: USB HID core driver [ 7.542390] drop_monitor: Initializing network drop monitor service [ 7.542998] TCP: cubic registered [ 7.543008] Initializing XFRM netlink socket [ 7.543658] NET: Registered protocol family 10 [ 7.545382] NET: Registered protocol family 17 [ 7.546715] microcode: CPU0 sig=0x206d7, pf=0x1, revision=0x710 [ 7.546727] microcode: CPU1 sig=0x206d7, pf=0x1, revision=0x710 [ 7.546739] microcode: CPU2 sig=0x206d7, pf=0x1, revision=0x710 [ 7.551025] microcode: CPU3 sig=0x206d7, pf=0x1, revision=0x710 [ 7.551037] microcode: CPU4 sig=0x206d7, pf=0x1, revision=0x710 [ 7.551053] microcode: CPU5 sig=0x206d7, pf=0x1, revision=0x710 [ 7.551065] microcode: CPU6 sig=0x206d7, pf=0x1, revision=0x710 [ 7.551076] microcode: CPU7 sig=0x206d7, pf=0x1, revision=0x710 [ 7.551084] microcode: CPU8 sig=0x206d7, pf=0x1, revision=0x710 [ 7.551094] microcode: CPU9 sig=0x206d7, pf=0x1, revision=0x710 [ 7.551105] microcode: CPU10 sig=0x206d7, pf=0x1, revision=0x710 [ 7.551115] microcode: CPU11 sig=0x206d7, pf=0x1, revision=0x710 [ 7.551125] microcode: CPU12 sig=0x206d7, pf=0x1, revision=0x710 [ 7.551136] microcode: CPU13 sig=0x206d7, pf=0x1, revision=0x710 [ 7.551146] microcode: CPU14 sig=0x206d7, pf=0x1, revision=0x710 [ 7.551155] microcode: CPU15 sig=0x206d7, pf=0x1, revision=0x710 [ 7.551165] microcode: CPU16 sig=0x206d7, pf=0x1, revision=0x710 [ 7.551179] microcode: CPU17 sig=0x206d7, pf=0x1, revision=0x710 [ 7.551189] microcode: CPU18 sig=0x206d7, pf=0x1, revision=0x710 [ 7.551200] microcode: CPU19 sig=0x206d7, pf=0x1, revision=0x710 [ 7.551211] microcode: CPU20 sig=0x206d7, pf=0x1, revision=0x710 [ 7.551221] microcode: CPU21 sig=0x206d7, pf=0x1, revision=0x710 [ 7.551231] microcode: CPU22 sig=0x206d7, pf=0x1, revision=0x710 [ 7.551242] microcode: CPU23 sig=0x206d7, pf=0x1, revision=0x710 [ 7.551253] microcode: CPU24 sig=0x206d7, pf=0x1, revision=0x710 [ 7.551264] microcode: CPU25 sig=0x206d7, pf=0x1, revision=0x710 [ 7.551273] microcode: CPU26 sig=0x206d7, pf=0x1, revision=0x710 [ 7.551281] microcode: CPU27 sig=0x206d7, pf=0x1, revision=0x710 [ 7.551290] microcode: CPU28 sig=0x206d7, pf=0x1, revision=0x710 [ 7.551302] microcode: CPU29 sig=0x206d7, pf=0x1, revision=0x710 [ 7.551310] microcode: CPU30 sig=0x206d7, pf=0x1, revision=0x710 [ 7.551318] microcode: CPU31 sig=0x206d7, pf=0x1, revision=0x710 [ 7.551377] microcode: Microcode Update Driver: v2.01 , Peter Oruba [ 7.551575] PM: Hibernation image not present or could not be loaded. [ 7.551579] Loading compiled-in X.509 certificates [ 7.551626] Loaded X.509 cert 'CentOS Linux kpatch signing key: ea0413152cde1d98ebdca3fe6f0230904c9ef717' [ 7.551655] Loaded X.509 cert 'CentOS Linux Driver update signing key: 7f421ee0ab69461574bb358861dbe77762a4201b' [ 7.552719] Loaded X.509 cert 'CentOS Linux kernel signing key: b4cf273140adc5b026849a35c1ae7355f84cd346' [ 7.552748] registered taskstats version 1 [ 7.557626] Key type trusted registered [ 7.562043] Key type encrypted registered [ 7.566396] IMA: No TPM chip found, activating TPM-bypass! [ 7.567951] Magic number: 14:737:656 [ 7.568144] acpi LNXCPU:09: hash matches [ 7.572505] rtc_cmos 00:01: setting system clock to 2018-04-23 23:37:13 UTC (1524526633) [ 7.584965] usb 2-1: new high-speed USB device number 2 using ehci-pci [ 7.599395] usb 1-1: New USB device found, idVendor=8087, idProduct=0024 [ 7.599399] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 7.599785] hub 1-1:1.0: USB hub found [ 7.599864] hub 1-1:1.0: 6 ports detected [ 7.699394] usb 2-1: New USB device found, idVendor=8087, idProduct=0024 [ 7.699397] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 7.699675] hub 2-1:1.0: USB hub found [ 7.699745] hub 2-1:1.0: 8 ports detected [ 7.974992] usb 2-1.4: new full-speed USB device number 3 using ehci-pci [ 8.002278] Freeing unused kernel memory: 1792k freed [ 8.015653] random: systemd: uninitialized urandom read (16 bytes read) [ 8.026427] random: systemd: uninitialized urandom read (16 bytes read) [ 8.034172] random: systemd: uninitialized urandom read (16 bytes read) [ 8.044466] systemd[1]: systemd 219 running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ -LZ4 -SECCOMP +BLKID +ELFUTILS +KMOD +IDN) [ 8.066482] systemd[1]: Detected architecture x86-64. [ 8.072420] systemd[1]: Running in initial RAM disk. [ 8.078069] usb 2-1.4: New USB device found, idVendor=046b, idProduct=ff10 [ 8.078072] usb 2-1.4: New USB device strings: Mfr=1, Product=2, SerialNumber=3 [ 8.078074] usb 2-1.4: Product: Virtual Keyboard and Mouse [ 8.078076] usb 2-1.4: Manufacturer: American Megatrends Inc. [ 8.078078] usb 2-1.4: SerialNumber: serial [ 8.079814] input: American Megatrends Inc. Virtual Keyboard and Mouse as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.4/2-1.4:1.0/input/input1 [ 8.130238] hid-generic 0003:046B:FF10.0001: input,hidraw0: USB HID v1.10 Keyboard [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:1d.0-1.4/input0 [ 8.150216] input: American Megatrends Inc. Virtual Keyboard and Mouse as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.4/2-1.4:1.1/input/input2 [ 8.165725] hid-generic 0003:046B:FF10.0002: input,hidraw1: USB HID v1.10 Mouse [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:1d.0-1.4/input1 [ 8.187130] systemd[1]: Set hostname to . [ 8.257503] random: systemd: uninitialized urandom read (16 bytes read) [ 8.265272] random: systemd: uninitialized urandom read (16 bytes read) [ 8.273033] random: systemd: uninitialized urandom read (16 bytes read) [ 8.280831] random: systemd: uninitialized urandom read (16 bytes read) [ 8.289274] random: systemd: uninitialized urandom read (16 bytes read) [ 8.297139] random: systemd: uninitialized urandom read (16 bytes read) [ 8.305097] random: systemd: uninitialized urandom read (16 bytes read) [ 8.322044] systemd[1]: Reached target Timers. [ 8.327350] systemd[1]: Starting Timers. [ 8.337039] systemd[1]: Created slice Root Slice. [ 8.342613] systemd[1]: Starting Root Slice. [ 8.354032] systemd[1]: Listening on udev Kernel Socket. [ 8.360278] systemd[1]: Starting udev Kernel Socket. [ 8.371033] systemd[1]: Reached target Swap. [ 8.376116] systemd[1]: Starting Swap. [ 8.386032] systemd[1]: Listening on Journal Socket. [ 8.391885] systemd[1]: Starting Journal Socket. [ 8.404069] systemd[1]: Reached target Local File Systems. [ 8.410521] systemd[1]: Starting Local File Systems. [ 8.423053] systemd[1]: Created slice System Slice. [ 8.428815] systemd[1]: Starting System Slice. [ 8.434680] systemd[1]: Starting Create list of required static device nodes for the current kernel... [ 8.455672] systemd[1]: Starting Load Kernel Modules... [ 8.472056] systemd[1]: Reached target Slices. [ 8.477332] systemd[1]: Starting Slices. [ 8.482502] systemd[1]: Starting Setup Virtual Console... [ 8.510063] systemd[1]: Listening on udev Control Socket. [ 8.516417] systemd[1]: Starting udev Control Socket. [ 8.527071] systemd[1]: Reached target Sockets. [ 8.532427] systemd[1]: Starting Sockets. [ 8.537696] systemd[1]: Starting Journal Service... [ 8.548695] systemd[1]: Starting dracut cmdline hook... [ 8.570047] systemd[1]: Started Create list of required static device nodes for the current kernel. [ 8.586063] systemd[1]: Started Load Kernel Modules. [ 8.599063] systemd[1]: Started Setup Virtual Console. [ 8.605867] systemd[1]: Starting Apply Kernel Variables... [ 8.617550] systemd[1]: Starting Create Static Device Nodes in /dev... [ 8.638070] systemd[1]: Started Journal Service. [ 8.793014] mlx_compat: loading out-of-tree module taints kernel. [ 8.802016] mlx_compat: module verification failed: signature and/or required key missing - tainting kernel [ 8.814494] Compat-mlnx-ofed backport release: 8509e41 [ 8.820855] Backport based on mlnx_ofed/mlnx-ofa_kernel-4.0.git 8509e41 [ 8.829116] compat.git: mlnx_ofed/mlnx-ofa_kernel-4.0.git [ 8.838755] libata version 3.00 loaded. [ 8.839871] dca service started, version 1.12.1 [ 8.848318] pps_core: LinuxPPS API ver. 1 registered [ 8.854455] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 8.866891] mlx4_core: Mellanox ConnectX core driver v4.3-1.0.1 [ 8.874382] mlx4_core: Initializing 0000:04:00.0 [ 8.875009] PTP clock support registered [ 8.875443] ahci 0000:00:1f.2: version 3.0 [ 8.875827] ahci 0000:00:1f.2: irq 39 for MSI/MSI-X [ 8.876075] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 8.876078] ahci 0000:00:1f.2: flags: 64bit ncq sntf pm led clo pio slum part ems apst [ 8.878859] mpt2sas version 20.103.00.00 loaded [ 8.878942] mpt2sas 0000:06:00.0: can't disable ASPM; OS doesn't have ASPM control [ 8.878994] [drm] Initialized [ 8.879223] mpt2sas_cm0: 64 BIT PCI BUS DMA ADDRESSING SUPPORTED, total mem (32509244 kB) [ 8.886562] scsi host1: ahci [ 8.886675] scsi host2: ahci [ 8.886749] scsi host3: ahci [ 8.886816] scsi host4: ahci [ 8.886880] scsi host5: ahci [ 8.886947] scsi host6: ahci [ 8.886980] ata1: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00100 irq 39 [ 8.886981] ata2: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00180 irq 39 [ 8.886989] ata3: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00200 irq 39 [ 8.886991] ata4: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00280 irq 39 [ 8.886994] ata5: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00300 irq 39 [ 8.886996] ata6: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00380 irq 39 [ 8.933519] mpt2sas_cm0: MSI-X vectors supported: 16, no of cores: 32, max_msix_vectors: -1 [ 8.933607] mpt2sas 0000:06:00.0: irq 41 for MSI/MSI-X [ 8.933676] mpt2sas 0000:06:00.0: irq 42 for MSI/MSI-X [ 8.933739] mpt2sas 0000:06:00.0: irq 43 for MSI/MSI-X [ 8.933803] mpt2sas 0000:06:00.0: irq 44 for MSI/MSI-X [ 8.933867] mpt2sas 0000:06:00.0: irq 45 for MSI/MSI-X [ 8.933930] mpt2sas 0000:06:00.0: irq 46 for MSI/MSI-X [ 8.933997] mpt2sas 0000:06:00.0: irq 47 for MSI/MSI-X [ 8.934062] mpt2sas 0000:06:00.0: irq 48 for MSI/MSI-X [ 8.934125] mpt2sas 0000:06:00.0: irq 49 for MSI/MSI-X [ 8.934188] mpt2sas 0000:06:00.0: irq 50 for MSI/MSI-X [ 8.934251] mpt2sas 0000:06:00.0: irq 51 for MSI/MSI-X [ 8.934315] mpt2sas 0000:06:00.0: irq 52 for MSI/MSI-X [ 8.934378] mpt2sas 0000:06:00.0: irq 53 for MSI/MSI-X [ 8.934441] mpt2sas 0000:06:00.0: irq 54 for MSI/MSI-X [ 8.934505] mpt2sas 0000:06:00.0: irq 55 for MSI/MSI-X [ 8.934568] mpt2sas 0000:06:00.0: irq 56 for MSI/MSI-X [ 8.934734] mpt2sas0-msix0: PCI-MSI-X enabled: IRQ 41 [ 8.934735] mpt2sas0-msix1: PCI-MSI-X enabled: IRQ 42 [ 8.934735] mpt2sas0-msix2: PCI-MSI-X enabled: IRQ 43 [ 8.934736] mpt2sas0-msix3: PCI-MSI-X enabled: IRQ 44 [ 8.934737] mpt2sas0-msix4: PCI-MSI-X enabled: IRQ 45 [ 8.934738] mpt2sas0-msix5: PCI-MSI-X enabled: IRQ 46 [ 8.934739] mpt2sas0-msix6: PCI-MSI-X enabled: IRQ 47 [ 8.934740] mpt2sas0-msix7: PCI-MSI-X enabled: IRQ 48 [ 8.934740] mpt2sas0-msix8: PCI-MSI-X enabled: IRQ 49 [ 8.934741] mpt2sas0-msix9: PCI-MSI-X enabled: IRQ 50 [ 8.934742] mpt2sas0-msix10: PCI-MSI-X enabled: IRQ 51 [ 8.934743] mpt2sas0-msix11: PCI-MSI-X enabled: IRQ 52 [ 8.934744] mpt2sas0-msix12: PCI-MSI-X enabled: IRQ 53 [ 8.934745] mpt2sas0-msix13: PCI-MSI-X enabled: IRQ 54 [ 8.934745] mpt2sas0-msix14: PCI-MSI-X enabled: IRQ 55 [ 8.934746] mpt2sas0-msix15: PCI-MSI-X enabled: IRQ 56 [ 8.934748] mpt2sas_cm0: iomem(0x00000000d0a40000), mapped(0xffffc90003ac0000), size(65536) [ 8.934749] mpt2sas_cm0: ioport(0x0000000000002000), size(256) [ 8.961677] isci: Intel(R) C600 SAS Controller Driver - version 1.2.0 [ 8.961688] igb: Intel(R) Gigabit Ethernet Network Driver - version 5.4.0-k [ 8.961688] igb: Copyright (c) 2007-2014 Intel Corporation. [ 8.961713] isci 0000:07:00.0: driver configured for rev: 6 silicon [ 8.961724] isci 0000:07:00.0: OEM parameter table found in OROM [ 8.961728] isci 0000:07:00.0: OEM SAS parameters (version: 1.1) loaded (platform) [ 8.961931] isci 0000:07:00.0: SCU controller 0: phy 3-0 cables: {short, short, short, short} [ 8.962104] igb 0000:02:00.0: irq 58 for MSI/MSI-X [ 8.962190] igb 0000:02:00.0: irq 58 for MSI/MSI-X [ 8.962251] igb 0000:02:00.0: irq 59 for MSI/MSI-X [ 8.962312] igb 0000:02:00.0: irq 60 for MSI/MSI-X [ 8.962373] igb 0000:02:00.0: irq 61 for MSI/MSI-X [ 8.962434] igb 0000:02:00.0: irq 62 for MSI/MSI-X [ 8.962498] igb 0000:02:00.0: irq 63 for MSI/MSI-X [ 8.962560] igb 0000:02:00.0: irq 64 for MSI/MSI-X [ 8.962623] igb 0000:02:00.0: irq 65 for MSI/MSI-X [ 8.962684] igb 0000:02:00.0: irq 66 for MSI/MSI-X [ 8.962713] igb 0000:02:00.0: PHY reset is blocked due to SOL/IDER session. [ 8.964391] scsi host7: isci [ 8.965058] isci 0000:07:00.0: irq 67 for MSI/MSI-X [ 8.965120] isci 0000:07:00.0: irq 68 for MSI/MSI-X [ 8.988611] mpt2sas_cm0: sending message unit reset !! [ 8.990118] mpt2sas_cm0: message unit reset: SUCCESS [ 8.999005] igb 0000:02:00.0: added PHC on eth0 [ 8.999006] igb 0000:02:00.0: Intel(R) Gigabit Ethernet Network Connection [ 8.999008] igb 0000:02:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:11:0f [ 8.999080] igb 0000:02:00.0: eth0: PBA No: 100000-000 [ 8.999082] igb 0000:02:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 8.999490] igb 0000:02:00.1: irq 70 for MSI/MSI-X [ 8.999578] igb 0000:02:00.1: irq 70 for MSI/MSI-X [ 8.999640] igb 0000:02:00.1: irq 71 for MSI/MSI-X [ 8.999701] igb 0000:02:00.1: irq 72 for MSI/MSI-X [ 8.999763] igb 0000:02:00.1: irq 73 for MSI/MSI-X [ 8.999823] igb 0000:02:00.1: irq 74 for MSI/MSI-X [ 8.999884] igb 0000:02:00.1: irq 75 for MSI/MSI-X [ 8.999946] igb 0000:02:00.1: irq 76 for MSI/MSI-X [ 9.000013] igb 0000:02:00.1: irq 77 for MSI/MSI-X [ 9.000077] igb 0000:02:00.1: irq 78 for MSI/MSI-X [ 9.000103] igb 0000:02:00.1: PHY reset is blocked due to SOL/IDER session. [ 9.036824] igb 0000:02:00.1: added PHC on eth1 [ 9.036825] igb 0000:02:00.1: Intel(R) Gigabit Ethernet Network Connection [ 9.036827] igb 0000:02:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:11:10 [ 9.036900] igb 0000:02:00.1: eth1: PBA No: 100000-000 [ 9.036902] igb 0000:02:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 9.051699] igb 0000:02:00.2: irq 80 for MSI/MSI-X [ 9.051793] igb 0000:02:00.2: irq 80 for MSI/MSI-X [ 9.051860] igb 0000:02:00.2: irq 81 for MSI/MSI-X [ 9.051925] igb 0000:02:00.2: irq 82 for MSI/MSI-X [ 9.052001] igb 0000:02:00.2: irq 83 for MSI/MSI-X [ 9.052076] igb 0000:02:00.2: irq 84 for MSI/MSI-X [ 9.052146] igb 0000:02:00.2: irq 85 for MSI/MSI-X [ 9.052211] igb 0000:02:00.2: irq 86 for MSI/MSI-X [ 9.052277] igb 0000:02:00.2: irq 87 for MSI/MSI-X [ 9.052345] igb 0000:02:00.2: irq 88 for MSI/MSI-X [ 9.054099] mpt2sas_cm0: Allocated physical memory: size(18690 kB) [ 9.054100] mpt2sas_cm0: Current Controller Queue Depth(10104),Max Controller Queue Depth(10240) [ 9.054101] mpt2sas_cm0: Scatter Gather Elements per IO(128) [ 9.100053] mpt2sas_cm0: LSISAS2308: FWVersion(20.00.07.00), ChipRevision(0x05), BiosVersion(07.29.00.00) [ 9.100054] mpt2sas_cm0: Protocol=( [ 9.100054] Initiator [ 9.100055] ,Target [ 9.100055] ), [ 9.100056] Capabilities=( [ 9.100056] TLR [ 9.100056] ,EEDP [ 9.100057] ,Snapshot Buffer [ 9.100057] ,Diag Trace Buffer [ 9.100058] ,Task Set Full [ 9.100058] ,NCQ [ 9.100058] ) [ 9.100114] scsi host0: Fusion MPT SAS Host [ 9.100760] mpt2sas_cm0: sending port enable !! [ 9.103151] random: fast init done [ 9.103390] mpt2sas_cm0: host_add: handle(0x0001), sas_addr(0x500605b005d6e8b0), phys(8) [ 9.105855] igb 0000:02:00.2: added PHC on eth2 [ 9.105857] igb 0000:02:00.2: Intel(R) Gigabit Ethernet Network Connection [ 9.105858] igb 0000:02:00.2: eth2: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:11:11 [ 9.105931] igb 0000:02:00.2: eth2: PBA No: 100000-000 [ 9.105933] igb 0000:02:00.2: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 9.112009] mpt2sas_cm0: port enable: SUCCESS [ 9.113101] scsi 0:0:0:0: Direct-Access LSI INF-01-00 0820 PQ: 0 ANSI: 5 [ 9.113106] scsi 0:0:0:0: SSP: handle(0x000a), sas_addr(0x50080e52ffd82004), phy(4), device_name(0x50080e52ffd82004) [ 9.113107] scsi 0:0:0:0: SSP: enclosure_logical_id(0x500605b005d6e8b0), slot(7) [ 9.113110] scsi 0:0:0:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) [ 9.120305] igb 0000:02:00.3: irq 90 for MSI/MSI-X [ 9.120401] igb 0000:02:00.3: irq 90 for MSI/MSI-X [ 9.120472] igb 0000:02:00.3: irq 91 for MSI/MSI-X [ 9.120539] igb 0000:02:00.3: irq 92 for MSI/MSI-X [ 9.120606] igb 0000:02:00.3: irq 93 for MSI/MSI-X [ 9.120676] igb 0000:02:00.3: irq 94 for MSI/MSI-X [ 9.120742] igb 0000:02:00.3: irq 95 for MSI/MSI-X [ 9.120807] igb 0000:02:00.3: irq 96 for MSI/MSI-X [ 9.120873] igb 0000:02:00.3: irq 97 for MSI/MSI-X [ 9.120938] igb 0000:02:00.3: irq 98 for MSI/MSI-X [ 9.175625] igb 0000:02:00.3: added PHC on eth3 [ 9.175626] igb 0000:02:00.3: Intel(R) Gigabit Ethernet Network Connection [ 9.175628] igb 0000:02:00.3: eth3: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:11:12 [ 9.175701] igb 0000:02:00.3: eth3: PBA No: 100000-000 [ 9.175702] igb 0000:02:00.3: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 9.192033] ata5: SATA link down (SStatus 0 SControl 300) [ 9.192064] ata3: SATA link down (SStatus 0 SControl 300) [ 9.192101] ata6: SATA link down (SStatus 0 SControl 300) [ 9.192131] ata4: SATA link down (SStatus 0 SControl 300) [ 9.193034] ata2: SATA link down (SStatus 0 SControl 300) [ 9.199040] ata1: SATA link down (SStatus 0 SControl 300) [ 9.279599] [TTM] Zone kernel: Available graphics memory: 16254622 kiB [ 9.279599] [TTM] Zone dma32: Available graphics memory: 2097152 kiB [ 9.279600] [TTM] Initializing pool allocator [ 9.279603] [TTM] Initializing DMA pool allocator [ 9.335964] fbcon: mgadrmfb (fb0) is primary device [ 9.361030] scsi 0:0:0:1: Direct-Access LSI INF-01-00 0820 PQ: 0 ANSI: 5 [ 9.361038] scsi 0:0:0:1: SSP: handle(0x000a), sas_addr(0x50080e52ffd82004), phy(4), device_name(0x50080e52ffd82004) [ 9.361041] scsi 0:0:0:1: SSP: enclosure_logical_id(0x500605b005d6e8b0), slot(7) [ 9.361046] scsi 0:0:0:1: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) [ 9.372601] scsi 0:0:0:2: Direct-Access LSI INF-01-00 0820 PQ: 0 ANSI: 5 [ 9.372608] scsi 0:0:0:2: SSP: handle(0x000a), sas_addr(0x50080e52ffd82004), phy(4), device_name(0x50080e52ffd82004) [ 9.372624] scsi 0:0:0:2: SSP: enclosure_logical_id(0x500605b005d6e8b0), slot(7) [ 9.372629] scsi 0:0:0:2: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) [ 9.390599] scsi 0:0:0:3: Direct-Access LSI INF-01-00 0820 PQ: 0 ANSI: 5 [ 9.390606] scsi 0:0:0:3: SSP: handle(0x000a), sas_addr(0x50080e52ffd82004), phy(4), device_name(0x50080e52ffd82004) [ 9.390609] scsi 0:0:0:3: SSP: enclosure_logical_id(0x500605b005d6e8b0), slot(7) [ 9.390614] scsi 0:0:0:3: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) [ 9.405543] scsi 0:0:0:7: Direct-Access LSI Universal Xport 0820 PQ: 0 ANSI: 5 [ 9.405549] scsi 0:0:0:7: SSP: handle(0x000a), sas_addr(0x50080e52ffd82004), phy(4), device_name(0x50080e52ffd82004) [ 9.405565] scsi 0:0:0:7: SSP: enclosure_logical_id(0x500605b005d6e8b0), slot(7) [ 9.405570] scsi 0:0:0:7: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) [ 9.442129] scsi 0:0:1:0: Direct-Access LSI INF-01-00 0820 PQ: 0 ANSI: 5 [ 9.442135] scsi 0:0:1:0: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0000), phy(0), device_name(0x50080e52ff4f0000) [ 9.442138] scsi 0:0:1:0: SSP: enclosure_logical_id(0x500605b005d6e8b0), slot(3) [ 9.442142] scsi 0:0:1:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) [ 9.458052] scsi 0:0:1:1: Direct-Access LSI INF-01-00 0820 PQ: 0 ANSI: 5 [ 9.458057] scsi 0:0:1:1: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0000), phy(0), device_name(0x50080e52ff4f0000) [ 9.458060] scsi 0:0:1:1: SSP: enclosure_logical_id(0x500605b005d6e8b0), slot(3) [ 9.458064] scsi 0:0:1:1: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) [ 9.458446] scsi 0:0:1:1: Mode parameters changed [ 9.472527] scsi 0:0:1:2: Direct-Access LSI INF-01-00 0820 PQ: 0 ANSI: 5 [ 9.472547] scsi 0:0:1:2: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0000), phy(0), device_name(0x50080e52ff4f0000) [ 9.472550] scsi 0:0:1:2: SSP: enclosure_logical_id(0x500605b005d6e8b0), slot(3) [ 9.472555] scsi 0:0:1:2: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) [ 9.472887] scsi 0:0:1:2: Mode parameters changed [ 9.487510] scsi 0:0:1:3: Direct-Access LSI INF-01-00 0820 PQ: 0 ANSI: 5 [ 9.487515] scsi 0:0:1:3: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0000), phy(0), device_name(0x50080e52ff4f0000) [ 9.487518] scsi 0:0:1:3: SSP: enclosure_logical_id(0x500605b005d6e8b0), slot(3) [ 9.487521] scsi 0:0:1:3: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) [ 9.487872] scsi 0:0:1:3: Mode parameters changed [ 9.504515] scsi 0:0:1:7: Direct-Access LSI Universal Xport 0820 PQ: 0 ANSI: 5 [ 9.504522] scsi 0:0:1:7: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0000), phy(0), device_name(0x50080e52ff4f0000) [ 9.504525] scsi 0:0:1:7: SSP: enclosure_logical_id(0x500605b005d6e8b0), slot(3) [ 9.504530] scsi 0:0:1:7: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) [ 9.568806] Console: switching to colour frame buffer device 128x48 [ 9.603183] mgag200 0000:09:00.0: fb0: mgadrmfb frame buffer device [ 9.616079] [drm] Initialized mgag200 1.0.0 20110418 for 0000:09:00.0 on minor 0 [ 10.477280] sas: phy-7:0 added to port-7:0, phy_mask:0x1 (5001e676b110f000) [ 10.477349] sas: phy-7:1 added to port-7:1, phy_mask:0x2 (5001e676b110f001) [ 10.477386] sas: DOING DISCOVERY on port 0, pid:228 [ 10.477434] sas: DONE DISCOVERY on port 0, pid:228, result:0 [ 10.477452] sas: DOING DISCOVERY on port 1, pid:228 [ 10.477483] sas: DONE DISCOVERY on port 1, pid:228, result:0 [ 10.477576] sas: Enter sas_scsi_recover_host busy: 0 failed: 0 [ 10.477633] sas: ata7: end_device-7:0: dev error handler [ 10.639524] ata7.00: ATA-8: ST500DM002-1BD142, KC45, max UDMA/133 [ 10.648952] ata7.00: 976773168 sectors, multi 0: LBA48 NCQ (depth 31/32) [ 10.660396] ata7.00: configured for UDMA/133 [ 10.667414] sas: --- Exit sas_scsi_recover_host: busy: 0 failed: 0 tries: 1 [ 10.679003] scsi 7:0:0:0: Direct-Access ATA ST500DM002-1BD14 KC45 PQ: 0 ANSI: 5 [ 15.421985] mlx4_core 0000:04:00.0: Old device ETS support detected [ 15.429857] mlx4_core 0000:04:00.0: Consider upgrading device FW. [ 15.437541] mlx4_core 0000:04:00.0: DMFS high rate mode not supported [ 15.445609] mlx4_core: device is working in RoCE mode: Roce V1 [ 15.452985] mlx4_core: UD QP Gid type is: V1 [ 16.533414] mlx4_core 0000:04:00.0: PCIe link speed is 8.0GT/s, device supports 8.0GT/s [ 16.543203] mlx4_core 0000:04:00.0: PCIe link width is x8, device supports x8 [ 16.552191] mlx4_core 0000:04:00.0: irq 99 for MSI/MSI-X [ 16.552210] mlx4_core 0000:04:00.0: irq 100 for MSI/MSI-X [ 16.552229] mlx4_core 0000:04:00.0: irq 101 for MSI/MSI-X [ 16.552247] mlx4_core 0000:04:00.0: irq 102 for MSI/MSI-X [ 16.552266] mlx4_core 0000:04:00.0: irq 103 for MSI/MSI-X [ 16.552285] mlx4_core 0000:04:00.0: irq 104 for MSI/MSI-X [ 16.552335] mlx4_core 0000:04:00.0: irq 105 for MSI/MSI-X [ 16.552364] mlx4_core 0000:04:00.0: irq 106 for MSI/MSI-X [ 16.552393] mlx4_core 0000:04:00.0: irq 107 for MSI/MSI-X [ 16.552412] mlx4_core 0000:04:00.0: irq 108 for MSI/MSI-X [ 16.552430] mlx4_core 0000:04:00.0: irq 109 for MSI/MSI-X [ 16.552448] mlx4_core 0000:04:00.0: irq 110 for MSI/MSI-X [ 16.552467] mlx4_core 0000:04:00.0: irq 111 for MSI/MSI-X [ 16.552485] mlx4_core 0000:04:00.0: irq 112 for MSI/MSI-X [ 16.552503] mlx4_core 0000:04:00.0: irq 113 for MSI/MSI-X [ 16.552524] mlx4_core 0000:04:00.0: irq 114 for MSI/MSI-X [ 16.552543] mlx4_core 0000:04:00.0: irq 115 for MSI/MSI-X [ 16.552561] mlx4_core 0000:04:00.0: irq 116 for MSI/MSI-X [ 16.552579] mlx4_core 0000:04:00.0: irq 117 for MSI/MSI-X [ 16.552598] mlx4_core 0000:04:00.0: irq 118 for MSI/MSI-X [ 16.552616] mlx4_core 0000:04:00.0: irq 119 for MSI/MSI-X [ 16.552634] mlx4_core 0000:04:00.0: irq 120 for MSI/MSI-X [ 16.552673] mlx4_core 0000:04:00.0: irq 121 for MSI/MSI-X [ 16.552695] mlx4_core 0000:04:00.0: irq 122 for MSI/MSI-X [ 16.552713] mlx4_core 0000:04:00.0: irq 123 for MSI/MSI-X [ 16.552731] mlx4_core 0000:04:00.0: irq 124 for MSI/MSI-X [ 16.552749] mlx4_core 0000:04:00.0: irq 125 for MSI/MSI-X [ 16.552767] mlx4_core 0000:04:00.0: irq 126 for MSI/MSI-X [ 16.552786] mlx4_core 0000:04:00.0: irq 127 for MSI/MSI-X [ 16.552804] mlx4_core 0000:04:00.0: irq 128 for MSI/MSI-X [ 16.552822] mlx4_core 0000:04:00.0: irq 129 for MSI/MSI-X [ 16.552844] mlx4_core 0000:04:00.0: irq 130 for MSI/MSI-X [ 16.552863] mlx4_core 0000:04:00.0: irq 131 for MSI/MSI-X [ 16.552881] mlx4_core 0000:04:00.0: irq 132 for MSI/MSI-X [ 16.552899] mlx4_core 0000:04:00.0: irq 133 for MSI/MSI-X [ 16.552917] mlx4_core 0000:04:00.0: irq 134 for MSI/MSI-X [ 16.552935] mlx4_core 0000:04:00.0: irq 135 for MSI/MSI-X [ 16.552954] mlx4_core 0000:04:00.0: irq 136 for MSI/MSI-X [ 16.552995] mlx4_core 0000:04:00.0: irq 137 for MSI/MSI-X [ 16.553016] mlx4_core 0000:04:00.0: irq 138 for MSI/MSI-X [ 16.553034] mlx4_core 0000:04:00.0: irq 139 for MSI/MSI-X [ 16.553053] mlx4_core 0000:04:00.0: irq 140 for MSI/MSI-X [ 16.553071] mlx4_core 0000:04:00.0: irq 141 for MSI/MSI-X [ 16.553089] mlx4_core 0000:04:00.0: irq 142 for MSI/MSI-X [ 16.553107] mlx4_core 0000:04:00.0: irq 143 for MSI/MSI-X [ 16.553128] mlx4_core 0000:04:00.0: irq 144 for MSI/MSI-X [ 16.553146] mlx4_core 0000:04:00.0: irq 145 for MSI/MSI-X [ 16.553167] mlx4_core 0000:04:00.0: irq 146 for MSI/MSI-X [ 16.553185] mlx4_core 0000:04:00.0: irq 147 for MSI/MSI-X [ 16.553203] mlx4_core 0000:04:00.0: irq 148 for MSI/MSI-X [ 16.553222] mlx4_core 0000:04:00.0: irq 149 for MSI/MSI-X [ 16.553240] mlx4_core 0000:04:00.0: irq 150 for MSI/MSI-X [ 16.553258] mlx4_core 0000:04:00.0: irq 151 for MSI/MSI-X [ 16.553276] mlx4_core 0000:04:00.0: irq 152 for MSI/MSI-X [ 16.553327] mlx4_core 0000:04:00.0: irq 153 for MSI/MSI-X [ 16.553354] mlx4_core 0000:04:00.0: irq 154 for MSI/MSI-X [ 16.553374] mlx4_core 0000:04:00.0: irq 155 for MSI/MSI-X [ 16.553403] mlx4_core 0000:04:00.0: irq 156 for MSI/MSI-X [ 16.553422] mlx4_core 0000:04:00.0: irq 157 for MSI/MSI-X [ 16.553440] mlx4_core 0000:04:00.0: irq 158 for MSI/MSI-X [ 16.553458] mlx4_core 0000:04:00.0: irq 159 for MSI/MSI-X [ 16.553476] mlx4_core 0000:04:00.0: irq 160 for MSI/MSI-X [ 16.553495] mlx4_core 0000:04:00.0: irq 161 for MSI/MSI-X [ 16.553516] mlx4_core 0000:04:00.0: irq 162 for MSI/MSI-X [ 16.553535] mlx4_core 0000:04:00.0: irq 163 for MSI/MSI-X [ 16.781439] sas: Enter sas_scsi_recover_host busy: 0 failed: 0 [ 16.781533] sas: ata7: end_device-7:0: dev error handler [ 16.781556] sas: ata8: end_device-7:1: dev error handler [ 16.793996] mlx4_ib_add: mlx4_ib: Mellanox ConnectX InfiniBand driver v4.3-1.0.1 [ 16.805834] mlx4_ib_add: counter index 0 for port 1 allocated 0 [ 16.814375] mlx4_ib_add: counter index 1 for port 2 allocated 0 [ 16.943320] ata8.00: ATA-8: ST500NM0011, SN02, max UDMA/133 [ 16.943323] ata8.00: 976773168 sectors, multi 0: LBA48 NCQ (depth 31/32) [ 16.944326] ata8.00: configured for UDMA/133 [ 16.944397] sas: --- Exit sas_scsi_recover_host: busy: 0 failed: 0 tries: 1 [ 16.956288] scsi 7:0:1:0: Direct-Access ATA ST500NM0011 SN02 PQ: 0 ANSI: 5 [ 16.998701] sd 7:0:0:0: [sda] 976773168 512-byte logical blocks: (500 GB/465 GiB) [ 16.998896] sd 7:0:1:0: [sdb] 976773168 512-byte logical blocks: (500 GB/465 GiB) [ 16.998929] sd 7:0:1:0: [sdb] Write Protect is off [ 16.998930] sd 7:0:1:0: [sdb] Mode Sense: 00 3a 00 00 [ 16.998944] sd 7:0:1:0: [sdb] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 16.999579] scsi 0:0:0:0: rdac: LUN 0 (RDAC) (owned) [ 17.000054] sd 0:0:0:0: [sdc] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB) [ 17.000515] scsi 0:0:0:1: rdac: LUN 1 (RDAC) (unowned) [ 17.000873] sd 0:0:0:0: [sdc] Write Protect is off [ 17.000875] sd 0:0:0:0: [sdc] Mode Sense: 83 00 10 08 [ 17.001051] sd 0:0:0:1: [sdd] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB) [ 17.001211] sd 0:0:0:0: [sdc] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 17.001945] scsi 0:0:0:2: rdac: LUN 2 (RDAC) (owned) [ 17.002255] sd 0:0:0:1: [sdd] Write Protect is off [ 17.002257] sd 0:0:0:1: [sdd] Mode Sense: 83 00 10 08 [ 17.002367] sd 0:0:0:2: [sde] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB) [ 17.002711] sd 0:0:0:1: [sdd] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 17.003277] scsi 0:0:0:3: rdac: LUN 3 (RDAC) (unowned) [ 17.003750] sd 0:0:0:2: [sde] Write Protect is off [ 17.003752] sd 0:0:0:2: [sde] Mode Sense: 83 00 10 08 [ 17.003917] sd 0:0:0:3: [sdf] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB) [ 17.004236] sd 0:0:0:7: [sdg] 40960 512-byte logical blocks: (20.9 MB/20.0 MiB) [ 17.004280] sd 0:0:0:2: [sde] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 17.004463] scsi 0:0:1:0: rdac: LUN 0 (RDAC) (unowned) [ 17.004887] sd 0:0:1:0: [sdh] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB) [ 17.005492] scsi 0:0:1:1: rdac: LUN 1 (RDAC) (owned) [ 17.005737] sd 0:0:0:3: [sdf] Write Protect is off [ 17.005739] sd 0:0:0:3: [sdf] Mode Sense: 83 00 10 08 [ 17.005755] sd 0:0:1:0: [sdh] Write Protect is off [ 17.005758] sd 0:0:1:0: [sdh] Mode Sense: 83 00 10 08 [ 17.006001] sd 0:0:1:0: [sdh] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 17.006064] sd 0:0:0:7: [sdg] Write Protect is off [ 17.006067] sd 0:0:0:7: [sdg] Mode Sense: 83 00 10 08 [ 17.006117] sd 0:0:1:1: [sdi] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB) [ 17.006322] sd 0:0:0:3: [sdf] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 17.006821] sd 0:0:0:7: [sdg] Write cache: disabled, read cache: enabled, supports DPO and FUA [ 17.007006] scsi 0:0:1:2: rdac: LUN 2 (RDAC) (unowned) [ 17.007016] Dev sdd: unable to read RDB block 0 [ 17.007029] sdd: unable to read partition table [ 17.007307] sd 0:0:1:1: [sdi] Write Protect is off [ 17.007310] sd 0:0:1:1: [sdi] Mode Sense: 83 00 10 08 [ 17.007685] sd 0:0:1:2: [sdj] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB) [ 17.007760] sd 0:0:1:1: [sdi] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 17.008381] scsi 0:0:1:3: rdac: LUN 3 (RDAC) (owned) [ 17.009048] sd 0:0:1:2: [sdj] Write Protect is off [ 17.009050] sd 0:0:0:0: [sdc] Attached SCSI disk [ 17.009051] sd 0:0:1:2: [sdj] Mode Sense: 83 00 10 08 [ 17.009103] sd 0:0:1:3: [sdk] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB) [ 17.009308] Dev sdh: unable to read RDB block 0 [ 17.009318] sdh: unable to read partition table [ 17.009491] sd 0:0:1:7: [sdl] 40960 512-byte logical blocks: (20.9 MB/20.0 MiB) [ 17.009547] sd 0:0:1:2: [sdj] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 17.010158] sd 0:0:0:1: [sdd] Attached SCSI disk [ 17.010443] Dev sdf: unable to read RDB block 0 [ 17.010455] sdf: unable to read partition table [ 17.010833] sd 0:0:1:3: [sdk] Write Protect is off [ 17.010836] sd 0:0:1:3: [sdk] Mode Sense: 83 00 10 08 [ 17.010900] sdg: [ 17.011256] sd 0:0:1:7: [sdl] Write Protect is off [ 17.011258] sd 0:0:1:7: [sdl] Mode Sense: 83 00 10 08 [ 17.011528] sd 0:0:1:3: [sdk] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 17.011640] sd 0:0:0:2: [sde] Attached SCSI disk [ 17.011976] sd 0:0:1:7: [sdl] Write cache: disabled, read cache: enabled, supports DPO and FUA [ 17.012570] sd 0:0:0:3: [sdf] Attached SCSI disk [ 17.012775] sd 0:0:0:7: [sdg] Attached SCSI disk [ 17.013134] sd 0:0:1:0: [sdh] Attached SCSI disk [ 17.013879] Dev sdj: unable to read RDB block 0 [ 17.013886] sdj: unable to read partition table [ 17.014506] sdb: [ 17.014690] sd 7:0:1:0: [sdb] Attached SCSI disk [ 17.015632] sd 0:0:1:1: [sdi] Attached SCSI disk [ 17.016146] sdl: [ 17.016636] sd 0:0:1:2: [sdj] Attached SCSI disk [ 17.017581] sd 0:0:1:3: [sdk] Attached SCSI disk [ 17.017826] sd 0:0:1:7: [sdl] Attached SCSI disk [ 17.473012] sd 7:0:0:0: [sda] 4096-byte physical blocks [ 17.479646] sd 7:0:0:0: [sda] Write Protect is off [ 17.485740] sd 7:0:0:0: [sda] Mode Sense: 00 3a 00 00 [ 17.485758] sd 7:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 17.524232] sda: sda1 sda2 [ 17.528702] sd 7:0:0:0: [sda] Attached SCSI disk [ 17.550272] random: crng init done [ 20.008278] EXT4-fs (sda1): mounting ext3 file system using the ext4 subsystem [ 20.057710] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null) [ 20.557174] systemd-journald[289]: Received SIGTERM from PID 1 (systemd). [ 21.419988] SELinux: Disabled at runtime. [ 21.425947] SELinux: Unregistering netfilter hooks [ 21.466603] type=1404 audit(1524526647.396:2): selinux=0 auid=4294967295 ses=4294967295 [ 21.780814] ip_tables: (C) 2000-2006 Netfilter Core Team [ 21.788338] systemd[1]: Inserted module 'ip_tables' [ 23.638789] RPC: Registered named UNIX socket transport module. [ 23.646630] RPC: Registered udp transport module. [ 23.652998] RPC: Registered tcp transport module. [ 23.659366] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 24.484402] Installing knfsd (copyright (C) 1996 okir@monad.swb.de). [ 24.551112] EXT4-fs (sda1): re-mounted. Opts: (null) [ 24.638738] systemd-journald[672]: Received request to flush runtime journal from PID 1 [ 24.701691] device-mapper: uevent: version 1.0.3 [ 24.701837] device-mapper: ioctl: 4.35.0-ioctl (2016-06-23) initialised: dm-devel@redhat.com [ 26.020313] ioatdma: Intel(R) QuickData Technology Driver 4.00 [ 26.028050] ioatdma 0000:00:04.0: irq 165 for MSI/MSI-X [ 26.028581] igb 0000:02:00.0: DCA enabled [ 26.034099] igb 0000:02:00.1: DCA enabled [ 26.039711] ioatdma 0000:00:04.1: irq 167 for MSI/MSI-X [ 26.040396] igb 0000:02:00.2: DCA enabled [ 26.045807] igb 0000:02:00.3: DCA enabled [ 26.051329] ioatdma 0000:00:04.2: irq 168 for MSI/MSI-X [ 26.052018] ioatdma 0000:00:04.3: irq 169 for MSI/MSI-X [ 26.052708] ioatdma 0000:00:04.4: irq 170 for MSI/MSI-X [ 26.053444] ioatdma 0000:00:04.5: irq 171 for MSI/MSI-X [ 26.054144] ioatdma 0000:00:04.6: irq 172 for MSI/MSI-X [ 26.054804] ioatdma 0000:00:04.7: irq 173 for MSI/MSI-X [ 26.055507] ioatdma 0000:80:04.0: irq 175 for MSI/MSI-X [ 26.056114] ioatdma 0000:80:04.1: irq 177 for MSI/MSI-X [ 26.056659] ioatdma 0000:80:04.2: irq 178 for MSI/MSI-X [ 26.057212] ioatdma 0000:80:04.3: irq 179 for MSI/MSI-X [ 26.057754] ioatdma 0000:80:04.4: irq 180 for MSI/MSI-X [ 26.058305] ioatdma 0000:80:04.5: irq 181 for MSI/MSI-X [ 26.058828] ioatdma 0000:80:04.6: irq 182 for MSI/MSI-X [ 26.059345] ioatdma 0000:80:04.7: irq 183 for MSI/MSI-X [ 26.075774] ACPI Warning: SystemIO range 0x0000000000004000-0x000000000000401f conflicts with OpRegion 0x0000000000004000-0x000000000000400f (\_SB_.PCI0.SBUS.SMBI) (20130517/utaddress-254) [ 26.096072] ACPI: If an ACPI driver is available for this device, you should use it instead of the native driver [ 26.108377] i801_smbus 0000:07:00.3: SMBus using PCI interrupt [ 26.116183] input: PC Speaker as /devices/platform/pcspkr/input/input3 [ 26.124841] wmi: Mapper loaded [ 26.130519] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 26.188432] ipmi message handler version 39.2 [ 26.274815] mei_me 0000:00:16.0: Device doesn't have valid ME Interface [ 26.537363] iTCO_vendor_support: vendor-support=0 [ 26.546533] sd 7:0:0:0: Attached scsi generic sg0 type 0 [ 26.553411] sd 7:0:1:0: Attached scsi generic sg1 type 0 [ 26.560228] sd 0:0:0:0: Attached scsi generic sg2 type 0 [ 26.567117] sd 0:0:0:1: Attached scsi generic sg3 type 0 [ 26.567182] ipmi device interface [ 26.578463] sd 0:0:0:2: Attached scsi generic sg4 type 0 [ 26.585305] sd 0:0:0:3: Attached scsi generic sg5 type 0 [ 26.592170] sd 0:0:0:7: Attached scsi generic sg6 type 0 [ 26.599062] sd 0:0:1:0: Attached scsi generic sg7 type 0 [ 26.605950] sd 0:0:1:1: Attached scsi generic sg8 type 0 [ 26.612874] sd 0:0:1:2: Attached scsi generic sg9 type 0 [ 26.619699] sd 0:0:1:3: Attached scsi generic sg10 type 0 [ 26.626620] sd 0:0:1:7: Attached scsi generic sg11 type 0 [ 26.633795] iTCO_wdt: Intel TCO WatchDog Timer Driver v1.11 [ 26.641239] iTCO_wdt: unable to reset NO_REBOOT flag, device disabled by hardware/BIOS [ 26.899323] IPMI System Interface driver. [ 26.905530] ipmi_si: probing via SMBIOS [ 26.911262] ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0 [ 26.919242] ipmi_si: Adding SMBIOS-specified kcs state machine [ 26.927057] ipmi_si: probing via SPMI [ 26.932420] ipmi_si: SPMI: io 0xca2 regsize 1 spacing 1 irq 0 [ 26.940120] ipmi_si: Adding SPMI-specified kcs state machine duplicate interface [ 26.949641] ipmi_si: Trying SMBIOS-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0 [ 27.013181] AES CTR mode by8 optimization enabled [ 27.022139] alg: No test for __gcm-aes-aesni (__driver-gcm-aes-aesni) [ 27.034923] ipmi_si ipmi_si.0: Found new BMC (man_id: 0x000157, prod_id: 0x0049, dev_id: 0x21) [ 27.045396] ipmi_si ipmi_si.0: IPMI kcs interface initialized [ 27.112115] alg: No test for crc32 (crc32-pclmul) [ 27.433489] IPMI SSIF Interface driver [ 28.290553] kvm: disabled by bios [ 28.307653] kvm: disabled by bios [ 28.319689] kvm: disabled by bios [ 28.333901] kvm: disabled by bios [ 28.361699] intel_rapl: Found RAPL domain package [ 28.368091] intel_rapl: Found RAPL domain core [ 28.374190] intel_rapl: Found RAPL domain dram [ 28.380328] intel_rapl: Found RAPL domain package [ 28.386364] intel_rapl: Found RAPL domain core [ 28.392101] intel_rapl: Found RAPL domain dram [ 28.866263] EDAC MC: Ver: 3.0.0 [ 28.894065] EDAC sbridge: Seeking for: PCI ID 8086:3ca0 [ 28.894085] EDAC sbridge: Seeking for: PCI ID 8086:3ca0 [ 28.894097] EDAC sbridge: Seeking for: PCI ID 8086:3ca0 [ 28.894103] EDAC sbridge: Seeking for: PCI ID 8086:3ca8 [ 28.894116] EDAC sbridge: Seeking for: PCI ID 8086:3ca8 [ 28.894127] EDAC sbridge: Seeking for: PCI ID 8086:3ca8 [ 28.894132] EDAC sbridge: Seeking for: PCI ID 8086:3c71 [ 28.894146] EDAC sbridge: Seeking for: PCI ID 8086:3c71 [ 28.894156] EDAC sbridge: Seeking for: PCI ID 8086:3c71 [ 28.894162] EDAC sbridge: Seeking for: PCI ID 8086:3caa [ 28.894175] EDAC sbridge: Seeking for: PCI ID 8086:3caa [ 28.894185] EDAC sbridge: Seeking for: PCI ID 8086:3caa [ 28.894190] EDAC sbridge: Seeking for: PCI ID 8086:3cab [ 28.894203] EDAC sbridge: Seeking for: PCI ID 8086:3cab [ 28.894214] EDAC sbridge: Seeking for: PCI ID 8086:3cab [ 28.894219] EDAC sbridge: Seeking for: PCI ID 8086:3cac [ 28.894232] EDAC sbridge: Seeking for: PCI ID 8086:3cac [ 28.894243] EDAC sbridge: Seeking for: PCI ID 8086:3cac [ 28.894248] EDAC sbridge: Seeking for: PCI ID 8086:3cad [ 28.894261] EDAC sbridge: Seeking for: PCI ID 8086:3cad [ 28.894271] EDAC sbridge: Seeking for: PCI ID 8086:3cad [ 28.894277] EDAC sbridge: Seeking for: PCI ID 8086:3cb8 [ 28.894291] EDAC sbridge: Seeking for: PCI ID 8086:3cb8 [ 28.894301] EDAC sbridge: Seeking for: PCI ID 8086:3cb8 [ 28.894305] EDAC sbridge: Seeking for: PCI ID 8086:3cf4 [ 28.894317] EDAC sbridge: Seeking for: PCI ID 8086:3cf4 [ 28.894327] EDAC sbridge: Seeking for: PCI ID 8086:3cf4 [ 28.894334] EDAC sbridge: Seeking for: PCI ID 8086:3cf6 [ 28.894346] EDAC sbridge: Seeking for: PCI ID 8086:3cf6 [ 28.894356] EDAC sbridge: Seeking for: PCI ID 8086:3cf6 [ 28.894362] EDAC sbridge: Seeking for: PCI ID 8086:3cf5 [ 28.894375] EDAC sbridge: Seeking for: PCI ID 8086:3cf5 [ 28.894385] EDAC sbridge: Seeking for: PCI ID 8086:3cf5 [ 28.894757] EDAC MC0: Giving out device to 'sbridge_edac.c' 'Sandy Bridge Socket#0': DEV 0000:7f:0e.0 [ 28.906488] EDAC MC1: Giving out device to 'sbridge_edac.c' 'Sandy Bridge Socket#1': DEV 0000:ff:0e.0 [ 28.917851] EDAC sbridge: Ver: 1.1.1 [ 31.104173] SPL: Loaded module v0.7.8-1 [ 31.470828] znvpair: module license 'CDDL' taints kernel. [ 31.470871] znvpair: module license 'CDDL' taints kernel. [ 31.470872] Disabling lock debugging due to kernel taint [ 33.948692] ZFS: Loaded module v0.7.8-1, ZFS pool version 5000, ZFS filesystem version 5 [ 34.268711] device-mapper: multipath round-robin: version 1.2.0 loaded [ 34.332799] device-mapper: table: 253:3: multipath: error getting device [ 34.341020] device-mapper: ioctl: error adding target to table [ 34.763033] sd 0:0:1:2: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command [ 35.061396] sd 0:0:1:2: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT completed [ 35.095096] Adding 16319484k swap on /dev/sda2. Priority:-1 extents:1 across:16319484k FS [ 35.160554] sd 0:0:0:2: rdac: array soak-netapp2624-1, ctlr 0, queueing MODE_SELECT command [ 35.551611] sd 0:0:0:2: rdac: array soak-netapp2624-1, ctlr 0, MODE_SELECT completed [ 35.572441] sd 0:0:0:2: [sde] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE [ 35.582942] sd 0:0:0:2: [sde] Sense Key : Illegal Request [current] [ 35.583146] device-mapper: multipath: Failing path 8:64. [ 35.599611] sd 0:0:0:2: [sde] <>ASC=0x94 ASCQ=0x1 [ 35.607533] sd 0:0:0:2: [sde] CDB: Read(16) 88 00 00 00 00 00 00 00 00 00 00 00 00 08 00 00 [ 35.618746] blk_update_request: I/O error, dev sde, sector 0 [ 35.627010] sd 0:0:1:2: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command [ 36.072300] sd 0:0:1:2: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT completed [ 36.725486] type=1305 audit(1524526662.654:3): audit_pid=1725 old=0 auid=4294967295 ses=4294967295 res=1 [ 37.583175] mlx4_en: Mellanox ConnectX HCA Ethernet driver v4.3-1.0.1 [ 37.917843] IPv6: ADDRCONF(NETDEV_UP): eth0: link is not ready [ 37.953024] card: mlx4_0, QP: 0x220, inline size: 120 [ 38.006272] igb 0000:02:00.0 eth0: igb: eth0 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX [ 38.007196] IPv6: ADDRCONF(NETDEV_UP): eth0: link is not ready [ 38.014342] IPv6: ADDRCONF(NETDEV_UP): eth1: link is not ready [ 38.017380] card: mlx4_0, QP: 0x300, inline size: 120 [ 38.095985] IPv6: ADDRCONF(NETDEV_UP): eth1: link is not ready [ 38.104688] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready [ 38.117134] ib0: enabling connected mode will cause multicast packet drops [ 38.117378] ib0: mtu > 4092 will cause multicast packet drops. [ 38.119044] IPv6: ADDRCONF(NETDEV_UP): eth2: link is not ready [ 38.230544] IPv6: ADDRCONF(NETDEV_UP): eth2: link is not ready [ 38.242248] IPv6: ADDRCONF(NETDEV_UP): eth3: link is not ready [ 38.363222] IPv6: ADDRCONF(NETDEV_UP): eth3: link is not ready [ 38.376450] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready [ 38.395940] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready [ 38.404166] IPv6: ADDRCONF(NETDEV_UP): ib1: link is not ready [ 38.419454] IPv6: ADDRCONF(NETDEV_UP): ib1: link is not ready [ 40.216370] device-mapper: multipath: Reinstating path 8:64. [ 40.225461] sd 0:0:0:2: rdac: array soak-netapp2624-1, ctlr 0, queueing MODE_SELECT command [ 40.556664] sd 0:0:0:2: rdac: array soak-netapp2624-1, ctlr 0, MODE_SELECT completed [ 44.674242] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready [ 44.725444] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready [ 44.736424] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready [ 44.991472] FS-Cache: Loaded [ 45.022633] FS-Cache: Netfs 'nfs' registered for caching [ 45.027586] Key type dns_resolver registered [ 45.064337] NFS: Registering the id_resolver key type [ 45.064341] Key type id_resolver registered [ 45.064342] Key type id_legacy registered [ 61.440227] IPv6: ADDRCONF(NETDEV_CHANGE): ib0: link becomes ready [54007.090124] LNet: HW NUMA nodes: 2, HW CPU cores: 32, npartitions: 2 [54007.114079] alg: No test for adler32 (adler32-zlib) [54007.130318] alg: No test for crc32 (crc32-table) [54008.015216] Lustre: Lustre: Build Version: 2.11.51 [54008.251248] LNet: Using FMR for registration [54008.278064] LNet: Added LNI 192.168.1.109@o2ib [8/256/0/180] [54008.447525] LDISKFS-fs warning (device dm-0): ldiskfs_multi_mount_protect:322: MMP interval 42 higher than expected, please wait. [54056.297541] LDISKFS-fs (dm-0): recovery complete [54056.313150] LDISKFS-fs (dm-0): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,user_xattr,no_mbcache,nodelalloc [54059.061890] LustreError: 11-0: soaked-MDT0000-osp-MDT0001: operation mds_connect to node 192.168.1.108@o2ib failed: rc = -114 [54084.061624] LustreError: 137-5: soaked-MDT0000_UUID: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. [54102.251216] LNet: 8161:0:(o2iblnd_cb.c:3296:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 6 seconds [54115.251333] LNet: 8161:0:(o2iblnd_cb.c:3296:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 19 seconds [54128.251450] LNet: 8161:0:(o2iblnd_cb.c:3296:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 32 seconds [54128.285985] LustreError: 11-0: soaked-MDT0003-osp-MDT0001: operation mds_connect to node 192.168.1.111@o2ib failed: rc = -114 [54128.484191] Lustre: soaked-MDT0001: Imperative Recovery enabled, recovery window shrunk from 300-900 down to 150-900 [54128.529091] Lustre: soaked-MDT0001: in recovery but waiting for the first client to connect [54128.801235] Lustre: 8344:0:(llog.c:577:llog_process_thread()) soaked-MDT0000-osp-MDT0001: invalid length 0 in llog [0xe0db:0x2356:0x2]record for index 0/30773 [54128.848063] LustreError: 8344:0:(lod_dev.c:427:lod_sub_recovery_thread()) soaked-MDT0000-osp-MDT0001 get update log failed: rc = -22 [54129.201474] Lustre: soaked-MDT0001: Connection restored to (at 192.168.1.123@o2ib) [54129.229664] Lustre: 8347:0:(ldlm_lib.c:2040:target_recovery_overseer()) recovery is aborted, evict exports in recovery [54130.490843] Lustre: soaked-MDT0001: Connection restored to 3118d425-00c1-8d38-d781-c01639d8d93c (at 192.168.1.130@o2ib) [54130.526468] Lustre: Skipped 1 previous similar message [54133.012041] Lustre: soaked-MDT0001: Connection restored to (at 192.168.1.128@o2ib) [54133.037326] Lustre: Skipped 4 previous similar messages [54135.326002] Lustre: soaked-MDT0001: Connection restored to (at 192.168.1.127@o2ib) [54135.351295] Lustre: Skipped 18 previous similar messages [54143.237960] Lustre: soaked-MDT0001: Connection restored to (at 192.168.1.108@o2ib) [54143.263286] Lustre: Skipped 16 previous similar messages [54178.857648] LustreError: 8346:0:(lod_dev.c:427:lod_sub_recovery_thread()) soaked-MDT0003-osp-MDT0001 get update log failed: rc = -108 [54178.897257] LustreError: 8346:0:(lod_dev.c:427:lod_sub_recovery_thread()) Skipped 1 previous similar message [54179.986012] LustreError: 8345:0:(lod_dev.c:427:lod_sub_recovery_thread()) soaked-MDT0002-osp-MDT0001 get update log failed: rc = -108 [54180.025714] Lustre: soaked-MDT0001: disconnecting 1 stale clients [54180.045959] Lustre: soaked-MDT0001: in recovery but waiting for the first client to connect [54180.073548] Lustre: 8347:0:(ldlm_lib.c:2040:target_recovery_overseer()) recovery is aborted, evict exports in recovery [54181.629802] Lustre: soaked-MDT0001: Connection restored to (at 192.168.1.110@o2ib) [54181.657859] Lustre: Skipped 9 previous similar messages [57242.399097] Lustre: 8285:0:(client.c:2099:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1524583860/real 0] req@ffff8807811c8c00 x1598638746244112/t0(0) o1000->soaked-MDT0003-osp-MDT0001@192.168.1.111@o2ib:24/4 lens 488/4320 e 0 to 1 dl 1524583867 ref 3 fl Rpc:X/0/ffffffff rc 0/-1 [57242.743271] Lustre: soaked-MDT0003-osp-MDT0001: Connection to soaked-MDT0003 (at 192.168.1.111@o2ib) was lost; in progress operations using this service will wait for recovery to complete [57441.358552] LNet: Service thread pid 8615 was inactive for 200.06s. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes: [57441.566938] Pid: 8615, comm: mdt01_014 [57441.614967] Call Trace: [57441.668056] [] ? ktime_get_real_seconds+0xe/0x10 [libcfs] [57441.755600] [] schedule+0x29/0x70 [57441.818076] [] schedule_timeout+0x174/0x2c0 [57441.890997] [] ? process_timeout+0x0/0x10 [57441.961807] [] ? ldlm_expired_completion_wait+0x0/0x220 [ptlrpc] [57442.056531] [] ldlm_completion_ast+0x5b1/0x920 [ptlrpc] [57442.141798] [] ? default_wake_function+0x0/0x20 [57442.218750] [] ldlm_cli_enqueue_fini+0x93b/0xdc0 [ptlrpc] [57442.306042] [] ? lprocfs_counter_sub+0xc1/0x130 [obdclass] [57442.394437] [] ldlm_cli_enqueue+0x40e/0x920 [ptlrpc] [57442.476607] [] ? ldlm_completion_ast+0x0/0x920 [ptlrpc] [57442.561811] [] ? mdt_remote_blocking_ast+0x0/0x590 [mdt] [57442.648018] [] osp_md_object_lock+0x162/0x2d0 [osp] [57442.729015] [] lod_object_lock+0xf3/0x950 [lod] [57442.805810] [] ? lprocfs_counter_add+0xf9/0x160 [obdclass] [57442.894021] [] ? htable_lookup+0xa9/0x180 [obdclass] [57442.975925] [] mdd_object_lock+0x3e/0xe0 [mdd] [57443.051510] [] mdt_remote_object_lock_try+0x1e1/0x770 [mdt] [57443.140620] [] mdt_remote_object_lock+0x2a/0x30 [mdt] [57443.223379] [] mdt_reint_rename_or_migrate.isra.40+0x362/0x860 [mdt] [57443.321726] [] ? mdt_root_squash+0x21/0x430 [mdt] [57443.400284] [] ? ucred_set_audit_enabled.isra.13+0x22/0x60 [mdt] [57443.494456] [] mdt_reint_rename+0x13/0x20 [mdt] [57443.570955] [] mdt_reint_rec+0x83/0x210 [mdt] [57443.645328] [] mdt_reint_internal+0x5fb/0x9c0 [mdt] [57443.725973] [] mdt_reint+0x67/0x140 [mdt] [57443.796211] [] tgt_request_handle+0x92a/0x13b0 [ptlrpc] [57443.881086] [] ptlrpc_server_handle_request+0x253/0xab0 [ptlrpc] [57443.975195] [] ? ptlrpc_wait_event+0x98/0x340 [ptlrpc] [57444.058811] [] ? default_wake_function+0x12/0x20 [57444.136118] [] ? __wake_up_common+0x5b/0x90 [57444.208358] [] ptlrpc_main+0xa92/0x1f40 [ptlrpc] [57444.285696] [] ? ptlrpc_main+0x0/0x1f40 [ptlrpc] [57444.362921] [] kthread+0xd1/0xe0 [57444.423478] [] ? kthread+0x0/0xe0 [57444.485019] [] ret_from_fork+0x77/0xb0 [57444.551711] [] ? kthread+0x0/0xe0 [57444.613181] [57444.632988] LustreError: dumping log to /tmp/lustre-log.1524584069.8615 [57454.783664] Lustre: soaked-MDT0001: haven't heard from client soaked-MDT0003-mdtlov_UUID (at 192.168.1.111@o2ib) in 227 seconds. I think it's dead, and I am evicting it. exp ffff88080c531000, cur 1524584080 expire 1524583930 last 1524583853 [57454.989239] LNet: Service thread pid 8615 completed after 213.69s. This indicates the system was overloaded (too many service threads, or there were not enough hardware resources). [57473.277749] LNet: 8161:0:(o2iblnd_cb.c:3296:kiblnd_check_conns()) Timed out tx for 192.168.1.111@o2ib: 0 seconds [57494.606846] LNet: Service thread pid 8764 was inactive for 200.43s. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes: [57494.810871] Pid: 8764, comm: mdt01_028 [57494.856698] Call Trace: [57494.905540] [] schedule+0x29/0x70 [57494.965973] [] top_trans_wait_result+0xa6/0x155 [ptlrpc] [57495.050456] [] ? default_wake_function+0x0/0x20 [57495.125573] [] top_trans_stop+0x42b/0x930 [ptlrpc] [57495.203754] [] lod_trans_stop+0x259/0x340 [lod] [57495.278666] [] ? mdd_changelog_ns_store+0x30/0x8d0 [mdd] [57495.363093] [] mdd_trans_stop+0x2a/0x46 [mdd] [57495.435983] [] mdd_create+0x1072/0x13a0 [mdd] [57495.508911] [] mdt_create+0x849/0xbb0 [mdt] [57495.579748] [] ? lprocfs_stats_lock+0x24/0xd0 [obdclass] [57495.664136] [] mdt_reint_create+0x16b/0x350 [mdt] [57495.741137] [] mdt_reint_rec+0x83/0x210 [mdt] [57495.813990] [] mdt_reint_internal+0x5fb/0x9c0 [mdt] [57495.892983] [] mdt_reint+0x67/0x140 [mdt] [57495.961610] [] tgt_request_handle+0x92a/0x13b0 [ptlrpc] [57496.044957] [] ptlrpc_server_handle_request+0x253/0xab0 [ptlrpc] [57496.137519] [] ? ptlrpc_wait_event+0x98/0x340 [ptlrpc] [57496.219642] [] ? default_wake_function+0x12/0x20 [57496.295552] [] ? __wake_up_common+0x5b/0x90 [57496.366266] [] ptlrpc_main+0xa92/0x1f40 [ptlrpc] [57496.442138] [] ? ptlrpc_main+0x0/0x1f40 [ptlrpc] [57496.517999] [] kthread+0xd1/0xe0 [57496.577181] [] ? kthread+0x0/0xe0 [57496.637383] [] ret_from_fork+0x77/0xb0 [57496.702797] [] ? kthread+0x0/0xe0 [57496.762979] [57496.781509] LustreError: dumping log to /tmp/lustre-log.1524584121.8764 [57508.377078] Lustre: soaked-MDT0001: Connection restored to (at 192.168.1.110@o2ib) [57508.469981] Lustre: Skipped 1 previous similar message [57528.217736] LNet: 236:0:(o2iblnd_cb.c:2501:kiblnd_passive_connect()) Conn stale 192.168.1.111@o2ib version 12/12 incarnation 1524584148250799/1524584148250799 [57528.791187] Lustre: soaked-MDT0001: Connection restored to (at 192.168.1.111@o2ib) [57592.951929] LustreError: 167-0: soaked-MDT0003-osp-MDT0001: This client was evicted by soaked-MDT0003; in progress operations using this service will fail. [57592.969721] LustreError: 8686:0:(osp_object.c:582:osp_attr_get()) soaked-MDT0003-osp-MDT0001:osp_attr_get update error [0x2c0009870:0xe828:0x0]: rc = -5 [57592.969931] LNet: Service thread pid 8764 completed after 298.79s. This indicates the system was overloaded (too many service threads, or there were not enough hardware resources). [57592.972376] Lustre: soaked-MDT0003-osp-MDT0001: Connection restored to 192.168.1.111@o2ib (at 192.168.1.111@o2ib) [57593.019275] LustreError: 8686:0:(osp_object.c:582:osp_attr_get()) Skipped 1 previous similar message [57593.037930] LustreError: 8342:0:(llog_cat.c:795:llog_cat_cancel_records()) soaked-MDT0003-osp-MDT0001: fail to cancel 1 of 1 llog-records: rc = -116 [58650.452931] perf: interrupt took too long (2515 > 2500), lowering kernel.perf_event_max_sample_rate to 79000 [58691.039260] Lustre: 8370:0:(client.c:2099:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1524585309/real 0] req@ffff8807325d5a00 x1598638809860832/t0(0) o1000->soaked-MDT0002-osp-MDT0001@192.168.1.110@o2ib:24/4 lens 304/4320 e 0 to 1 dl 1524585316 ref 3 fl Rpc:X/0/ffffffff rc 0/-1 [58691.381144] Lustre: soaked-MDT0002-osp-MDT0001: Connection to soaked-MDT0002 (at 192.168.1.110@o2ib) was lost; in progress operations using this service will wait for recovery to complete [58695.771264] Lustre: 8762:0:(client.c:2099:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1524585313/real 0] req@ffff8807346f2700 x1598638810047504/t0(0) o101->soaked-MDT0002-osp-MDT0001@192.168.1.110@o2ib:24/4 lens 328/344 e 0 to 1 dl 1524585320 ref 3 fl Rpc:X/0/ffffffff rc 0/-1 [58696.111692] Lustre: 8762:0:(client.c:2099:ptlrpc_expire_one_request()) Skipped 1 previous similar message [58697.342334] Lustre: 8194:0:(client.c:2099:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1524585313/real 0] req@ffff880733664800 x1598638810035456/t0(0) o103->soaked-MDT0002-osp-MDT0001@192.168.1.110@o2ib:17/18 lens 328/224 e 0 to 1 dl 1524585320 ref 2 fl Rpc:X/0/ffffffff rc 0/-1 [58884.181800] LNet: Service thread pid 8615 was inactive for 200.03s. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes: [58884.389624] Pid: 8615, comm: mdt01_014 [58884.437414] Call Trace: [58884.490170] [] ? ktime_get_real_seconds+0xe/0x10 [libcfs] [58884.577507] [] schedule+0x29/0x70 [58884.639871] [] schedule_timeout+0x174/0x2c0 [58884.712627] [] ? process_timeout+0x0/0x10 [58884.783364] [] ? ldlm_expired_completion_wait+0x0/0x220 [ptlrpc] [58884.878127] [] ldlm_completion_ast+0x5b1/0x920 [ptlrpc] [58884.963468] [] ? default_wake_function+0x0/0x20 [58885.040434] [] ldlm_cli_enqueue_fini+0x93b/0xdc0 [ptlrpc] [58885.127847] [] ? lprocfs_counter_sub+0xc1/0x130 [obdclass] [58885.216403] [] ldlm_cli_enqueue+0x40e/0x920 [ptlrpc] [58885.298621] [] ? ldlm_completion_ast+0x0/0x920 [ptlrpc] [58885.383952] [] ? mdt_remote_blocking_ast+0x0/0x590 [mdt] [58885.470320] [] osp_md_object_lock+0x162/0x2d0 [osp] [58885.551581] [] lod_object_lock+0xf3/0x950 [lod] [58885.628683] [] ? lprocfs_counter_add+0xf9/0x160 [obdclass] [58885.717131] [] ? htable_lookup+0xa9/0x180 [obdclass] [58885.799310] [] mdd_object_lock+0x3e/0xe0 [mdd] [58885.875273] [] mdt_remote_object_lock_try+0x1e1/0x770 [mdt] [58885.964632] [] mdt_remote_object_lock+0x2a/0x30 [mdt] [58886.047720] [] mdt_reint_rename_or_migrate.isra.40+0x362/0x860 [mdt] [58886.146372] [] ? mdt_root_squash+0x21/0x430 [mdt] [58886.225228] [] ? ucred_set_audit_enabled.isra.13+0x22/0x60 [mdt] [58886.319643] [] mdt_reint_rename+0x13/0x20 [mdt] [58886.396316] [] mdt_reint_rec+0x83/0x210 [mdt] [58886.470847] [] mdt_reint_internal+0x5fb/0x9c0 [mdt] [58886.551574] [] mdt_reint+0x67/0x140 [mdt] [58886.621915] [] tgt_request_handle+0x92a/0x13b0 [ptlrpc] [58886.706774] [] ptlrpc_server_handle_request+0x253/0xab0 [ptlrpc] [58886.801060] [] ? ptlrpc_wait_event+0x98/0x340 [ptlrpc] [58886.884733] [] ? default_wake_function+0x12/0x20 [58886.962134] [] ? __wake_up_common+0x5b/0x90 [58887.034330] [] ptlrpc_main+0xa92/0x1f40 [ptlrpc] [58887.111685] [] ? ptlrpc_main+0x0/0x1f40 [ptlrpc] [58887.188921] [] kthread+0xd1/0xe0 [58887.249447] [] ? kthread+0x0/0xe0 [58887.310948] [] ret_from_fork+0x77/0xb0 [58887.377667] [] ? kthread+0x0/0xe0 [58887.439048] [58887.458753] LustreError: dumping log to /tmp/lustre-log.1524585512.8615 [58889.105435] LNet: Service thread pid 8693 was inactive for 203.38s. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes: [58889.311298] Pid: 8693, comm: mdt01_018 [58889.358069] Call Trace: [58889.408550] [] ? ktime_get_real_seconds+0xe/0x10 [libcfs] [58889.494683] [] schedule+0x29/0x70 [58889.555923] [] schedule_timeout+0x174/0x2c0 [58889.627584] [] ? process_timeout+0x0/0x10 [58889.697241] [] ? ldlm_expired_completion_wait+0x0/0x220 [ptlrpc] [58889.790772] [] ldlm_completion_ast+0x5b1/0x920 [ptlrpc] [58889.874934] [] ? default_wake_function+0x0/0x20 [58889.950765] [] ldlm_cli_enqueue_fini+0x93b/0xdc0 [ptlrpc] [58890.037098] [] ? lprocfs_counter_sub+0xc1/0x130 [obdclass] [58890.124431] [] ldlm_cli_enqueue+0x40e/0x920 [ptlrpc] [58890.205554] [] ? ldlm_completion_ast+0x0/0x920 [ptlrpc] [58890.289769] [] ? mdt_remote_blocking_ast+0x0/0x590 [mdt] [58890.374977] [] osp_md_object_lock+0x162/0x2d0 [osp] [58890.454999] [] lod_object_lock+0xf3/0x950 [lod] [58890.530819] [] ? lprocfs_counter_add+0xf9/0x160 [obdclass] [58890.618170] [] ? htable_lookup+0xa9/0x180 [obdclass] [58890.699221] [] mdd_object_lock+0x3e/0xe0 [mdd] [58890.774018] [] mdt_remote_object_lock_try+0x1e1/0x770 [mdt] [58890.862367] [] mdt_remote_object_lock+0x2a/0x30 [mdt] [58890.944457] [] mdt_reint_rename_or_migrate.isra.40+0x362/0x860 [mdt] [58891.042155] [] ? mdt_root_squash+0x21/0x430 [mdt] [58891.120113] [] ? ucred_set_audit_enabled.isra.13+0x22/0x60 [mdt] [58891.213692] [] mdt_reint_rename+0x13/0x20 [mdt] [58891.289575] [] mdt_reint_rec+0x83/0x210 [mdt] [58891.363330] [] mdt_reint_internal+0x5fb/0x9c0 [mdt] [58891.443340] [] mdt_reint+0x67/0x140 [mdt] [58891.512937] [] tgt_request_handle+0x92a/0x13b0 [ptlrpc] [58891.597211] [] ptlrpc_server_handle_request+0x253/0xab0 [ptlrpc] [58891.690797] [] ? ptlrpc_wait_event+0x98/0x340 [ptlrpc] [58891.773891] [] ? default_wake_function+0x12/0x20 [58891.850851] [] ? __wake_up_common+0x5b/0x90 [58891.922578] [] ptlrpc_main+0xa92/0x1f40 [ptlrpc] [58891.999501] [] ? ptlrpc_main+0x0/0x1f40 [ptlrpc] [58892.076342] [] kthread+0xd1/0xe0 [58892.136522] [] ? kthread+0x0/0xe0 [58892.197736] [] ret_from_fork+0x77/0xb0 [58892.264181] [] ? kthread+0x0/0xe0 [58892.325393] [58892.344923] LNet: Service thread pid 8242 was inactive for 206.62s. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes: [58892.550369] Pid: 8242, comm: mdt01_001 [58892.597140] Call Trace: [58892.647762] [] ? ktime_get_real_seconds+0xe/0x10 [libcfs] [58892.733970] [] schedule+0x29/0x70 [58892.795194] [] schedule_timeout+0x174/0x2c0 [58892.866801] [] ? process_timeout+0x0/0x10 [58892.936444] [] ? ldlm_expired_completion_wait+0x0/0x220 [ptlrpc] [58893.029969] [] ldlm_completion_ast+0x5b1/0x920 [ptlrpc] [58893.114103] [] ? default_wake_function+0x0/0x20 [58893.189998] [] ldlm_cli_enqueue_fini+0x93b/0xdc0 [ptlrpc] [58893.276293] [] ? lprocfs_counter_sub+0xc1/0x130 [obdclass] [58893.363653] [] ldlm_cli_enqueue+0x40e/0x920 [ptlrpc] [58893.444716] [] ? ldlm_completion_ast+0x0/0x920 [ptlrpc] [58893.528844] [] ? mdt_remote_blocking_ast+0x0/0x590 [mdt] [58893.614084] [] osp_md_object_lock+0x162/0x2d0 [osp] [58893.694072] [] lod_object_lock+0xf3/0x950 [lod] [58893.769891] [] ? lprocfs_counter_add+0xf9/0x160 [obdclass] [58893.857190] [] ? htable_lookup+0xa9/0x180 [obdclass] [58893.938218] [] mdd_object_lock+0x3e/0xe0 [mdd] [58894.013005] [] mdt_remote_object_lock_try+0x1e1/0x770 [mdt] [58894.101295] [] mdt_remote_object_lock+0x2a/0x30 [mdt] [58894.183322] [] mdt_reint_rename_or_migrate.isra.40+0x362/0x860 [mdt] [58894.280993] [] ? mdt_root_squash+0x21/0x430 [mdt] [58894.358867] [] ? ucred_set_audit_enabled.isra.13+0x22/0x60 [mdt] [58894.452388] [] mdt_reint_rename+0x13/0x20 [mdt] [58894.528226] [] mdt_reint_rec+0x83/0x210 [mdt] [58894.601979] [] mdt_reint_internal+0x5fb/0x9c0 [mdt] [58894.681955] [] mdt_reint+0x67/0x140 [mdt] [58894.751567] [] tgt_request_handle+0x92a/0x13b0 [ptlrpc] [58894.835748] [] ptlrpc_server_handle_request+0x253/0xab0 [ptlrpc] [58894.929283] [] ? ptlrpc_wait_event+0x98/0x340 [ptlrpc] [58895.012384] [] ? default_wake_function+0x12/0x20 [58895.089245] [] ? __wake_up_common+0x5b/0x90 [58895.160983] [] ptlrpc_main+0xa92/0x1f40 [ptlrpc] [58895.237881] [] ? ptlrpc_main+0x0/0x1f40 [ptlrpc] [58895.314688] [] kthread+0xd1/0xe0 [58895.374815] [] ? kthread+0x0/0xe0 [58895.436019] [] ret_from_fork+0x77/0xb0 [58895.502414] [] ? kthread+0x0/0xe0 [58895.563604] [58895.583177] LNet: Service thread pid 8283 was inactive for 209.86s. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes: [58895.788570] Pid: 8283, comm: mdt00_003 [58895.835325] Call Trace: [58895.885983] [] ? ktime_get_real_seconds+0xe/0x10 [libcfs] [58895.972196] [] schedule+0x29/0x70 [58896.033403] [] schedule_timeout+0x174/0x2c0 [58896.105039] [] ? process_timeout+0x0/0x10 [58896.174688] [] ? ldlm_expired_completion_wait+0x0/0x220 [ptlrpc] [58896.268252] [] ldlm_completion_ast+0x5b1/0x920 [ptlrpc] [58896.352367] [] ? default_wake_function+0x0/0x20 [58896.428262] [] ldlm_cli_enqueue_fini+0x93b/0xdc0 [ptlrpc] [58896.514536] [] ? lprocfs_counter_sub+0xc1/0x130 [obdclass] [58896.601852] [] ldlm_cli_enqueue+0x40e/0x920 [ptlrpc] [58896.682899] [] ? ldlm_completion_ast+0x0/0x920 [ptlrpc] [58896.767049] [] ? mdt_remote_blocking_ast+0x0/0x590 [mdt] [58896.852254] [] osp_md_object_lock+0x162/0x2d0 [osp] [58896.932263] [] lod_object_lock+0xf3/0x950 [lod] [58897.008116] [] ? lprocfs_counter_add+0xf9/0x160 [obdclass] [58897.095404] [] ? htable_lookup+0xa9/0x180 [obdclass] [58897.176446] [] mdd_object_lock+0x3e/0xe0 [mdd] [58897.251227] [] mdt_remote_object_lock_try+0x1e1/0x770 [mdt] [58897.339548] [] mdt_remote_object_lock+0x2a/0x30 [mdt] [58897.421607] [] mdt_reint_rename_or_migrate.isra.40+0x362/0x860 [mdt] [58897.519252] [] ? mdt_root_squash+0x21/0x430 [mdt] [58897.597143] [] ? ucred_set_audit_enabled.isra.13+0x22/0x60 [mdt] [58897.690665] [] mdt_reint_rename+0x13/0x20 [mdt] [58897.766519] [] mdt_reint_rec+0x83/0x210 [mdt] [58897.840273] [] mdt_reint_internal+0x5fb/0x9c0 [mdt] [58897.920241] [] mdt_reint+0x67/0x140 [mdt] [58897.989835] [] tgt_request_handle+0x92a/0x13b0 [ptlrpc] [58898.073977] [] ptlrpc_server_handle_request+0x253/0xab0 [ptlrpc] [58898.167557] [] ? ptlrpc_wait_event+0x98/0x340 [ptlrpc] [58898.250637] [] ? default_wake_function+0x12/0x20 [58898.327543] [] ? __wake_up_common+0x5b/0x90 [58898.399252] [] ptlrpc_main+0xa92/0x1f40 [ptlrpc] [58898.476154] [] ? ptlrpc_main+0x0/0x1f40 [ptlrpc] [58898.552955] [] kthread+0xd1/0xe0 [58898.613112] [] ? kthread+0x0/0xe0 [58898.674278] [] ret_from_fork+0x77/0xb0 [58898.740683] [] ? kthread+0x0/0xe0 [58898.801833] [58898.821404] Pid: 8614, comm: mdt00_015 [58898.867855] Call Trace: [58898.918249] [] ? ktime_get_real_seconds+0xe/0x10 [libcfs] [58899.004414] [] schedule+0x29/0x70 [58899.065555] [] schedule_timeout+0x174/0x2c0 [58899.137037] [] ? process_timeout+0x0/0x10 [58899.206538] [] ? ldlm_expired_completion_wait+0x0/0x220 [ptlrpc] [58899.299914] [] ldlm_completion_ast+0x5b1/0x920 [ptlrpc] [58899.383933] [] ? default_wake_function+0x0/0x20 [58899.459678] [] ldlm_cli_enqueue_fini+0x93b/0xdc0 [ptlrpc] [58899.545792] [] ? lprocfs_counter_sub+0xc1/0x130 [obdclass] [58899.632851] [] ldlm_cli_enqueue+0x40e/0x920 [ptlrpc] [58899.713798] [] ? ldlm_completion_ast+0x0/0x920 [ptlrpc] [58899.797820] [] ? mdt_remote_blocking_ast+0x0/0x590 [mdt] [58899.882883] [] osp_md_object_lock+0x162/0x2d0 [osp] [58899.962733] [] lod_object_lock+0xf3/0x950 [lod] [58900.038472] [] ? lprocfs_counter_add+0xf9/0x160 [obdclass] [58900.125667] [] ? htable_lookup+0xa9/0x180 [obdclass] [58900.206620] [] mdd_object_lock+0x3e/0xe0 [mdd] [58900.281267] [] mdt_remote_object_lock_try+0x1e1/0x770 [mdt] [58900.369482] [] mdt_remote_object_lock+0x2a/0x30 [mdt] [58900.451428] [] mdt_reint_rename_or_migrate.isra.40+0x362/0x860 [mdt] [58900.548972] [] ? mdt_root_squash+0x21/0x430 [mdt] [58900.626686] [] ? ucred_set_audit_enabled.isra.13+0x22/0x60 [mdt] [58900.720093] [] mdt_reint_rename+0x13/0x20 [mdt] [58900.795788] [] mdt_reint_rec+0x83/0x210 [mdt] [58900.869403] [] mdt_reint_internal+0x5fb/0x9c0 [mdt] [58900.949273] [] mdt_reint+0x67/0x140 [mdt] [58901.018799] [] tgt_request_handle+0x92a/0x13b0 [ptlrpc] [58901.102831] [] ptlrpc_server_handle_request+0x253/0xab0 [ptlrpc] [58901.196270] [] ? ptlrpc_wait_event+0x98/0x340 [ptlrpc] [58901.279224] [] ? default_wake_function+0x12/0x20 [58901.355939] [] ? __wake_up_common+0x5b/0x90 [58901.427554] [] ptlrpc_main+0xa92/0x1f40 [ptlrpc] [58901.504350] [] ? ptlrpc_main+0x0/0x1f40 [ptlrpc] [58901.581078] [] kthread+0xd1/0xe0 [58901.641140] [] ? kthread+0x0/0xe0 [58901.702223] [] ret_from_fork+0x77/0xb0 [58901.768495] [] ? kthread+0x0/0xe0 [58901.829581] [58901.849004] LNet: Service thread pid 8367 was inactive for 216.12s. Watchdog stack traces are limited to 3 per 300 seconds, skipping this one. [58950.285424] LNet: 8161:0:(o2iblnd_cb.c:3296:kiblnd_check_conns()) Timed out tx for 192.168.1.110@o2ib: 8 seconds [58963.149191] Lustre: soaked-MDT0001: Received LWP connection from 192.168.1.111@o2ib, removing former export from 192.168.1.110@o2ib [58963.294682] Lustre: soaked-MDT0001: Connection restored to (at 192.168.1.111@o2ib) [58966.589020] LustreError: 167-0: soaked-MDT0002-osp-MDT0001: This client was evicted by soaked-MDT0002; in progress operations using this service will fail. [58966.759910] LustreError: 8370:0:(osp_object.c:582:osp_attr_get()) soaked-MDT0002-osp-MDT0001:osp_attr_get update error [0x28000e691:0x100d2:0x0]: rc = -5 [58966.760206] LNet: Service thread pid 8762 completed after 283.05s. This indicates the system was overloaded (too many service threads, or there were not enough hardware resources). [58966.765355] Lustre: soaked-MDT0002-osp-MDT0001: Connection restored to 192.168.1.111@o2ib (at 192.168.1.111@o2ib) [58967.251186] LustreError: 8370:0:(mdt_reint.c:1340:mdt_is_subdir()) soaked-MDT0001: failed subdir check in [0x28000e691:0x100d2:0x0] for [0x24000fe00:0x100d4:0x0]: rc = -5 [58967.438514] LNet: Service thread pid 8370 completed after 283.77s. This indicates the system was overloaded (too many service threads, or there were not enough hardware resources). [58967.635913] LNet: Skipped 14 previous similar messages [58989.047726] Lustre: soaked-MDT0001: Connection restored to (at 192.168.1.110@o2ib) [58991.588906] Lustre: soaked-MDT0002-osp-MDT0001: Connection to soaked-MDT0002 (at 192.168.1.111@o2ib) was lost; in progress operations using this service will wait for recovery to complete [59016.589426] LustreError: 167-0: soaked-MDT0002-osp-MDT0001: This client was evicted by soaked-MDT0002; in progress operations using this service will fail. [59016.765524] LustreError: 8914:0:(osp_object.c:582:osp_attr_get()) soaked-MDT0002-osp-MDT0001:osp_attr_get update error [0x28000e691:0x1a090:0x0]: rc = -108 [59016.766341] Lustre: soaked-MDT0002-osp-MDT0001: Connection restored to 192.168.1.110@o2ib (at 192.168.1.110@o2ib) [59017.165768] LustreError: 8342:0:(llog_cat.c:795:llog_cat_cancel_records()) soaked-MDT0002-osp-MDT0001: fail to cancel 1 of 1 llog-records: rc = -116 [59017.329534] LustreError: 8342:0:(llog_cat.c:795:llog_cat_cancel_records()) Skipped 1 previous similar message [59132.270832] Lustre: 8191:0:(client.c:2099:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1524585750/real 0] req@ffff8807c1aa3900 x1598638833328672/t0(0) o13->soaked-OST0007-osc-MDT0001@192.168.1.103@o2ib:7/4 lens 224/368 e 0 to 1 dl 1524585757 ref 2 fl Rpc:X/0/ffffffff rc 0/-1 [59132.310873] Lustre: soaked-OST0007-osc-MDT0001: Connection to soaked-OST0007 (at 192.168.1.103@o2ib) was lost; in progress operations using this service will wait for recovery to complete [59134.840893] Lustre: soaked-OST000d-osc-MDT0001: Connection to soaked-OST000d (at 192.168.1.103@o2ib) was lost; in progress operations using this service will wait for recovery to complete [59138.439872] Lustre: 8189:0:(client.c:2099:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1524585755/real 0] req@ffff88076e80aa00 x1598638833468992/t0(0) o13->soaked-OST0013-osc-MDT0001@192.168.1.103@o2ib:7/4 lens 224/368 e 0 to 1 dl 1524585763 ref 2 fl Rpc:X/0/ffffffff rc 0/-1 [59138.480938] Lustre: 8189:0:(client.c:2099:ptlrpc_expire_one_request()) Skipped 1 previous similar message [59149.437084] Lustre: 8203:0:(client.c:2099:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1524585750/real 1524585774] req@ffff8807fdf88300 x1598638833202688/t0(0) o6->soaked-OST0013-osc-MDT0001@192.168.1.103@o2ib:28/4 lens 664/432 e 0 to 1 dl 1524585823 ref 1 fl Rpc:eX/0/ffffffff rc 0/-1 [59149.480251] Lustre: 8203:0:(client.c:2099:ptlrpc_expire_one_request()) Skipped 7 previous similar messages [59177.287221] LNet: 8161:0:(o2iblnd_cb.c:3296:kiblnd_check_conns()) Timed out tx for 192.168.1.103@o2ib: 1 seconds [59177.302485] Lustre: 8189:0:(client.c:2099:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1524585750/real 1524585802] req@ffff8807de8a1200 x1598638833213840/t0(0) o6->soaked-OST000d-osc-MDT0001@192.168.1.103@o2ib:28/4 lens 664/432 e 0 to 1 dl 1524585822 ref 1 fl Rpc:eX/0/ffffffff rc 0/-1 [59177.345202] Lustre: 8189:0:(client.c:2099:ptlrpc_expire_one_request()) Skipped 7 previous similar messages [59188.347286] Lustre: soaked-OST0001-osc-MDT0001: Connection to soaked-OST0001 (at 192.168.1.103@o2ib) was lost; in progress operations using this service will wait for recovery to complete [59188.372257] Lustre: Skipped 1 previous similar message [59188.380737] LustreError: 8292:0:(osp_precreate.c:647:osp_precreate_send()) soaked-OST0001-osc-MDT0001: can't precreate: rc = -11 [59188.398455] LustreError: 8292:0:(osp_precreate.c:1287:osp_precreate_thread()) soaked-OST0001-osc-MDT0001: cannot precreate objects: rc = -11 [59189.287252] LNet: 8161:0:(o2iblnd_cb.c:3296:kiblnd_check_conns()) Timed out tx for 192.168.1.103@o2ib: 13 seconds [59189.300428] LNet: 8161:0:(o2iblnd_cb.c:3296:kiblnd_check_conns()) Skipped 7 previous similar messages [59202.287385] LNet: 8161:0:(o2iblnd_cb.c:3296:kiblnd_check_conns()) Timed out tx for 192.168.1.103@o2ib: 26 seconds [59202.302588] LNet: 8161:0:(o2iblnd_cb.c:3296:kiblnd_check_conns()) Skipped 7 previous similar messages [59303.288227] LNet: 8161:0:(o2iblnd_cb.c:3296:kiblnd_check_conns()) Timed out tx for 192.168.1.103@o2ib: 3 seconds [59303.325377] LNet: 8161:0:(o2iblnd_cb.c:3296:kiblnd_check_conns()) Skipped 7 previous similar messages [59316.288326] LNet: 8161:0:(o2iblnd_cb.c:3296:kiblnd_check_conns()) Timed out tx for 192.168.1.103@o2ib: 6 seconds [59391.288693] LNet: 8161:0:(o2iblnd_cb.c:3296:kiblnd_check_conns()) Timed out tx for 192.168.1.103@o2ib: 27 seconds [59442.288885] LNet: 8161:0:(o2iblnd_cb.c:3296:kiblnd_check_conns()) Timed out tx for 192.168.1.103@o2ib: 7 seconds [59442.414157] LNet: 8161:0:(o2iblnd_cb.c:3296:kiblnd_check_conns()) Skipped 1 previous similar message [59518.289155] LNet: 8161:0:(o2iblnd_cb.c:3296:kiblnd_check_conns()) Timed out tx for 192.168.1.103@o2ib: 8 seconds [59518.303937] LNet: 8161:0:(o2iblnd_cb.c:3296:kiblnd_check_conns()) Skipped 4 previous similar messages [59630.792170] Lustre: soaked-MDT0001: Received new LWP connection from 192.168.1.103@o2ib, removing former export from same NID [59630.832915] format at ldlm_lib.c:1206:target_handle_connect doesn't end in newline [59635.991141] Lustre: soaked-MDT0001: Received new LWP connection from 192.168.1.103@o2ib, removing former export from same NID [59636.034998] format at ldlm_lib.c:1206:target_handle_connect doesn't end in newline [59630.861146] Lustre: soaked-MDT0001: Rejecting reconnect from the known client soaked-MDT0001-lwp-OST0013_UUID (at 192.168.1.103@o2ib) because it is indicating it is a new client [59636.063224] Lustre: soaked-MDT0001: Rejecting reconnect from the known client soaked-MDT0001-lwp-OST0001_UUID (at 192.168.1.103@o2ib) because it is indicating it is a new client [59640.764933] Lustre: soaked-MDT0001: Received new LWP connection from 192.168.1.103@o2ib, removing former export from same NID [59640.808866] format at ldlm_lib.c:1206:target_handle_connect doesn't end in newline [59640.837037] Lustre: soaked-MDT0001: Rejecting reconnect from the known client soaked-MDT0001-lwp-OST0007_UUID (at 192.168.1.103@o2ib) because it is indicating it is a new client [59645.285577] Lustre: soaked-MDT0001: Received new LWP connection from 192.168.1.103@o2ib, removing former export from same NID [59645.329930] format at ldlm_lib.c:1206:target_handle_connect doesn't end in newline [59670.288795] LustreError: 137-5: soaked-MDT0000_UUID: not available for connect from 192.168.1.103@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server. [59670.353699] LustreError: Skipped 3 previous similar messages [59695.288849] Lustre: soaked-MDT0001: Received new LWP connection from 192.168.1.103@o2ib, removing former export from same NID [59695.329407] Lustre: Skipped 3 previous similar messages [59645.358091] Lustre: soaked-MDT0001: Rejecting reconnect from the known client soaked-MDT0001-lwp-OST000d_UUID (at 192.168.1.103@o2ib) because it is indicating it is a new client [59720.289127] LustreError: 137-5: soaked-MDT0000_UUID: not available for connect from 192.168.1.103@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server. [59720.357805] LustreError: Skipped 3 previous similar messages [59745.289149] Lustre: soaked-MDT0001: Received new LWP connection from 192.168.1.103@o2ib, removing former export from same NID [59745.329628] Lustre: Skipped 3 previous similar messages [59770.289428] LustreError: 137-5: soaked-MDT0000_UUID: not available for connect from 192.168.1.103@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server. [59770.354300] LustreError: Skipped 3 previous similar messages [59795.289488] Lustre: soaked-MDT0001: Received new LWP connection from 192.168.1.103@o2ib, removing former export from same NID [59795.329957] Lustre: Skipped 3 previous similar messages [59820.289709] LustreError: 137-5: soaked-MDT0000_UUID: not available for connect from 192.168.1.103@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server. [59820.354535] LustreError: Skipped 3 previous similar messages [59824.983929] Lustre: soaked-OST0013-osc-MDT0001: Connection restored to 192.168.1.103@o2ib (at 192.168.1.103@o2ib) [59830.332383] Lustre: soaked-OST0001-osc-MDT0001: Connection restored to 192.168.1.103@o2ib (at 192.168.1.103@o2ib) [59832.545824] Lustre: soaked-OST0007-osc-MDT0001: Connection restored to 192.168.1.103@o2ib (at 192.168.1.103@o2ib) [59841.472449] Lustre: soaked-OST000d-osc-MDT0001: Connection restored to 192.168.1.103@o2ib (at 192.168.1.103@o2ib) [59845.289759] Lustre: soaked-MDT0001: Received new LWP connection from 192.168.1.103@o2ib, removing former export from same NID [59845.330461] Lustre: Skipped 2 previous similar messages [59870.289946] LustreError: 137-5: soaked-MDT0000_UUID: not available for connect from 192.168.1.103@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server. [59870.289948] LustreError: 137-5: soaked-MDT0000_UUID: not available for connect from 192.168.1.103@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server. [59870.289951] LustreError: 137-5: soaked-MDT0000_UUID: not available for connect from 192.168.1.103@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server. [59870.485851] LustreError: Skipped 1 previous similar message [59920.290041] LustreError: 137-5: soaked-MDT0000_UUID: not available for connect from 192.168.1.103@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server. [59920.351386] LustreError: Skipped 3 previous similar messages [59945.290371] Lustre: soaked-MDT0001: Received new LWP connection from 192.168.1.103@o2ib, removing former export from same NID [59945.329195] Lustre: Skipped 5 previous similar messages [59970.290414] LustreError: 137-5: soaked-MDT0000_UUID: not available for connect from 192.168.1.103@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server. [59970.351547] LustreError: Skipped 3 previous similar messages [60070.291398] LustreError: 137-5: soaked-MDT0000_UUID: not available for connect from 192.168.1.103@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server. [60070.510850] LustreError: Skipped 7 previous similar messages [60095.291463] Lustre: soaked-MDT0001: Received new LWP connection from 192.168.1.103@o2ib, removing former export from same NID [60095.291465] Lustre: soaked-MDT0001: Received new LWP connection from 192.168.1.103@o2ib, removing former export from same NID [60095.291470] Lustre: Skipped 8 previous similar messages [60095.634572] Lustre: Skipped 2 previous similar messages [60220.291820] LustreError: 137-5: soaked-MDT0000_UUID: not available for connect from 192.168.1.103@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server. [60220.353140] LustreError: Skipped 11 previous similar messages [60645.293246] Lustre: soaked-MDT0001: Received new LWP connection from 192.168.1.103@o2ib, removing former export from same NID [60645.333308] Lustre: Skipped 43 previous similar messages [60715.172423] perf: interrupt took too long (3181 > 3143), lowering kernel.perf_event_max_sample_rate to 62000 [61295.296200] Lustre: soaked-MDT0001: Received new LWP connection from 192.168.1.103@o2ib, removing former export from same NID [61295.432984] Lustre: Skipped 50 previous similar messages [61895.299298] Lustre: soaked-MDT0001: Received new LWP connection from 192.168.1.103@o2ib, removing former export from same NID [61895.437391] Lustre: Skipped 45 previous similar messages [62545.302963] Lustre: soaked-MDT0001: Received new LWP connection from 192.168.1.103@o2ib, removing former export from same NID [62545.318250] Lustre: Skipped 50 previous similar messages [63018.370687] Lustre: 8179:0:(client.c:2099:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1524589635/real 0] req@ffff880809b4a100 x1598638994091792/t0(0) o13->soaked-OST0003-osc-MDT0001@192.168.1.105@o2ib:7/4 lens 224/368 e 0 to 1 dl 1524589643 ref 2 fl Rpc:X/0/ffffffff rc 0/-1 [63018.391695] Lustre: soaked-OST000f-osc-MDT0001: Connection to soaked-OST000f (at 192.168.1.105@o2ib) was lost; in progress operations using this service will wait for recovery to complete [63018.391696] Lustre: Skipped 1 previous similar message [63018.553078] Lustre: 8179:0:(client.c:2099:ptlrpc_expire_one_request()) Skipped 20 previous similar messages [63032.983155] Lustre: 8182:0:(client.c:2099:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1524589634/real 1524589658] req@ffff88008e390600 x1598638994059008/t0(0) o6->soaked-OST000f-osc-MDT0001@192.168.1.105@o2ib:28/4 lens 664/432 e 0 to 1 dl 1524589707 ref 1 fl Rpc:eX/0/ffffffff rc 0/-1 [63033.087855] Lustre: 8182:0:(client.c:2099:ptlrpc_expire_one_request()) Skipped 4 previous similar messages [63065.303981] LNet: 8161:0:(o2iblnd_cb.c:3296:kiblnd_check_conns()) Timed out tx for 192.168.1.105@o2ib: 6 seconds [63065.340964] LNet: 8161:0:(o2iblnd_cb.c:3296:kiblnd_check_conns()) Skipped 4 previous similar messages [63065.374778] Lustre: 8196:0:(client.c:2099:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1524589636/real 1524589690] req@ffff8807e53a3600 x1598638994092432/t0(0) o6->soaked-OST0003-osc-MDT0001@192.168.1.105@o2ib:28/4 lens 664/432 e 0 to 1 dl 1524589709 ref 1 fl Rpc:eX/0/ffffffff rc 0/-1 [63065.474107] Lustre: 8196:0:(client.c:2099:ptlrpc_expire_one_request()) Skipped 6 previous similar messages [63145.305650] Lustre: soaked-MDT0001: Received new LWP connection from 192.168.1.103@o2ib, removing former export from same NID [63145.442478] Lustre: Skipped 47 previous similar messages [63166.304622] LNet: 8161:0:(o2iblnd_cb.c:3296:kiblnd_check_conns()) Timed out tx for 192.168.1.105@o2ib: 0 seconds [63166.429884] LNet: 8161:0:(o2iblnd_cb.c:3296:kiblnd_check_conns()) Skipped 15 previous similar messages [63230.305015] LNet: 8161:0:(o2iblnd_cb.c:3296:kiblnd_check_conns()) Timed out tx for 192.168.1.105@o2ib: 1 seconds [63230.319739] LNet: 8161:0:(o2iblnd_cb.c:3296:kiblnd_check_conns()) Skipped 2 previous similar messages [63318.305629] LNet: 8161:0:(o2iblnd_cb.c:3296:kiblnd_check_conns()) Timed out tx for 192.168.1.105@o2ib: 2 seconds [63318.342427] LNet: 8161:0:(o2iblnd_cb.c:3296:kiblnd_check_conns()) Skipped 2 previous similar messages [63495.306684] LNet: 8161:0:(o2iblnd_cb.c:3296:kiblnd_check_conns()) Timed out tx for 192.168.1.105@o2ib: 4 seconds [63495.321292] LNet: 8161:0:(o2iblnd_cb.c:3296:kiblnd_check_conns()) Skipped 7 previous similar messages [63554.735055] format at ldlm_lib.c:1206:target_handle_connect doesn't end in newline [63554.746718] Lustre: soaked-MDT0001: Rejecting reconnect from the known client soaked-MDT0001-lwp-OST0009_UUID (at 192.168.1.105@o2ib) because it is indicating it is a new client [63559.402403] format at ldlm_lib.c:1206:target_handle_connect doesn't end in newline [63559.417395] Lustre: soaked-MDT0001: Rejecting reconnect from the known client soaked-MDT0001-lwp-OST0015_UUID (at 192.168.1.105@o2ib) because it is indicating it is a new client [63564.201340] format at ldlm_lib.c:1206:target_handle_connect doesn't end in newline [63564.216487] Lustre: soaked-MDT0001: Rejecting reconnect from the known client soaked-MDT0001-lwp-OST0003_UUID (at 192.168.1.105@o2ib) because it is indicating it is a new client [63568.733795] format at ldlm_lib.c:1206:target_handle_connect doesn't end in newline [63584.045364] Lustre: soaked-OST0003-osc-MDT0001: Connection restored to 192.168.1.105@o2ib (at 192.168.1.105@o2ib) [63586.628537] Lustre: soaked-OST0015-osc-MDT0001: Connection restored to 192.168.1.105@o2ib (at 192.168.1.105@o2ib) [63589.574853] Lustre: soaked-OST000f-osc-MDT0001: Connection restored to 192.168.1.105@o2ib (at 192.168.1.105@o2ib) [63593.737228] LustreError: 137-5: soaked-MDT0000_UUID: not available for connect from 192.168.1.105@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server. [63593.760151] LustreError: Skipped 18 previous similar messages [63643.737484] LustreError: 137-5: soaked-MDT0000_UUID: not available for connect from 192.168.1.105@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server. [63643.760066] LustreError: Skipped 1 previous similar message [63743.738093] LustreError: 137-5: soaked-MDT0000_UUID: not available for connect from 192.168.1.105@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server. [63743.799375] LustreError: Skipped 7 previous similar messages [63763.603108] perf: interrupt took too long (3991 > 3976), lowering kernel.perf_event_max_sample_rate to 50000 [63768.738175] Lustre: soaked-MDT0001: Received new LWP connection from 192.168.1.105@o2ib, removing former export from same NID [63768.776894] Lustre: Skipped 66 previous similar messages [63893.739028] LustreError: 137-5: soaked-MDT0000_UUID: not available for connect from 192.168.1.105@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server. [63893.761431] LustreError: Skipped 11 previous similar messages [64193.740817] LustreError: 137-5: soaked-MDT0000_UUID: not available for connect from 192.168.1.105@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server. [64193.801768] LustreError: Skipped 23 previous similar messages [64395.311508] Lustre: soaked-MDT0001: Received new LWP connection from 192.168.1.103@o2ib, removing former export from same NID [64395.350267] Lustre: Skipped 96 previous similar messages [64995.314645] Lustre: soaked-MDT0001: Received new LWP connection from 192.168.1.103@o2ib, removing former export from same NID [64995.354945] Lustre: Skipped 95 previous similar messages [65618.749799] Lustre: soaked-MDT0001: Received new LWP connection from 192.168.1.105@o2ib, removing former export from same NID [65618.886477] Lustre: Skipped 98 previous similar messages [66218.752753] Lustre: soaked-MDT0001: Received new LWP connection from 192.168.1.105@o2ib, removing former export from same NID [66218.891055] Lustre: Skipped 91 previous similar messages [66818.757706] Lustre: soaked-MDT0001: Received new LWP connection from 192.168.1.105@o2ib, removing former export from same NID [66818.897485] Lustre: Skipped 93 previous similar messages [67060.839121] Lustre: 8184:0:(client.c:2099:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1524593676/real 0] req@ffff8802d85e3f00 x1598639357935696/t0(0) o103->soaked-MDT0000-osp-MDT0001@192.168.1.108@o2ib:17/18 lens 328/224 e 0 to 1 dl 1524593686 ref 2 fl Rpc:X/0/ffffffff rc 0/-1 [67060.839135] Lustre: soaked-MDT0000-osp-MDT0001: Connection to soaked-MDT0000 (at 192.168.1.108@o2ib) was lost; in progress operations using this service will wait for recovery to complete [67060.839150] Lustre: Skipped 3 previous similar messages [67061.456940] Lustre: 8184:0:(client.c:2099:ptlrpc_expire_one_request()) Skipped 5 previous similar messages [67061.839096] LustreError: 166-1: MGC192.168.1.108@o2ib: Connection to MGS (at 192.168.1.108@o2ib) was lost; in progress operations using this service will fail [67064.255102] Lustre: 8193:0:(client.c:2099:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1524593680/real 0] req@ffff8807314b4500 x1598639357936272/t0(0) o400->soaked-MDT0000-lwp-MDT0001@192.168.1.108@o2ib:12/10 lens 224/224 e 0 to 1 dl 1524593689 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1 [67064.600734] Lustre: 8193:0:(client.c:2099:ptlrpc_expire_one_request()) Skipped 8 previous similar messages [67064.719860] Lustre: soaked-MDT0000-lwp-MDT0001: Connection to soaked-MDT0000 (at 192.168.1.108@o2ib) was lost; in progress operations using this service will wait for recovery to complete [67084.988903] LustreError: 137-5: soaked-MDT0000_UUID: not available for connect from 192.168.1.139@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server. [67085.208619] LustreError: Skipped 14 previous similar messages [67150.426591] LustreError: 137-5: soaked-MDT0000_UUID: not available for connect from 192.168.1.102@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server. [67150.453817] LustreError: Skipped 96 previous similar messages [67252.343729] LNet: Service thread pid 8758 was inactive for 200.23s. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes: [67252.406468] LNet: Skipped 1 previous similar message [67252.426331] Pid: 8758, comm: mdt01_025 [67252.442001] Call Trace: [67252.460774] [] schedule+0x29/0x70 [67252.479820] [] schedule_timeout+0x174/0x2c0 [67252.501576] [] ? process_timeout+0x0/0x10 [67252.522661] [] ? ptlrpc_interrupted_set+0x0/0x110 [ptlrpc] [67252.548425] [] ptlrpc_set_wait+0x218/0x7c0 [ptlrpc] [67252.571981] [] ? default_wake_function+0x0/0x20 [67252.594319] [] ptlrpc_queue_wait+0x7d/0x220 [ptlrpc] [67252.617965] [] ldlm_cli_enqueue+0x3d2/0x920 [ptlrpc] [67252.641462] [] ? ldlm_completion_ast+0x0/0x920 [ptlrpc] [67252.665749] [] ? mdt_remote_blocking_ast+0x0/0x590 [mdt] [67252.690227] [] osp_md_object_lock+0x162/0x2d0 [osp] [67252.713167] [] lod_object_lock+0xf3/0x950 [lod] [67252.734922] [] ? lprocfs_counter_add+0xf9/0x160 [obdclass] [67252.759733] [] ? htable_lookup+0xa9/0x180 [obdclass] [67252.782795] [] mdd_object_lock+0x3e/0xe0 [mdd] [67252.804111] [] mdt_remote_object_lock_try+0x1e1/0x770 [mdt] [67252.829123] [] mdt_remote_object_lock+0x2a/0x30 [mdt] [67252.852386] [] mdt_reint_rename_or_migrate.isra.40+0x362/0x860 [mdt] [67252.879949] [] ? mdt_root_squash+0x21/0x430 [mdt] [67252.902061] [] ? ucred_set_audit_enabled.isra.13+0x22/0x60 [mdt] [67252.928448] [] mdt_reint_rename+0x13/0x20 [mdt] [67252.949942] [] mdt_reint_rec+0x83/0x210 [mdt] [67252.970835] [] mdt_reint_internal+0x5fb/0x9c0 [mdt] [67252.993426] [] mdt_reint+0x67/0x140 [mdt] [67253.013167] [] tgt_request_handle+0x92a/0x13b0 [ptlrpc] [67253.036874] [] ptlrpc_server_handle_request+0x253/0xab0 [ptlrpc] [67253.063161] [] ? ptlrpc_wait_event+0x98/0x340 [ptlrpc] [67253.086552] [] ? default_wake_function+0x12/0x20 [67253.108212] [] ? __wake_up_common+0x5b/0x90 [67253.128445] [] ptlrpc_main+0xa92/0x1f40 [ptlrpc] [67253.150080] [] ? ptlrpc_main+0x0/0x1f40 [ptlrpc] [67253.171656] [] kthread+0xd1/0xe0 [67253.188627] [] ? kthread+0x0/0xe0 [67253.205859] [] ret_from_fork+0x77/0xb0 [67253.224506] [] ? kthread+0x0/0xe0 [67253.241696] [67253.247410] LustreError: dumping log to /tmp/lustre-log.1524593878.8758 [67254.796208] LNet: Service thread pid 8243 was inactive for 202.74s. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes: [67254.855785] Pid: 8243, comm: mdt01_002 [67254.870000] Call Trace: [67254.886117] [] schedule+0x29/0x70 [67254.903938] [] schedule_timeout+0x174/0x2c0 [67254.924492] [] ? process_timeout+0x0/0x10 [67254.944462] [] ? ptlrpc_interrupted_set+0x0/0x110 [ptlrpc] [67254.969211] [] ptlrpc_set_wait+0x218/0x7c0 [ptlrpc] [67254.991873] [] ? default_wake_function+0x0/0x20 [67255.013378] [] ptlrpc_queue_wait+0x7d/0x220 [ptlrpc] [67255.036254] [] ldlm_cli_enqueue+0x3d2/0x920 [ptlrpc] [67255.059064] [] ? ldlm_completion_ast+0x0/0x920 [ptlrpc] [67255.082653] [] ? mdt_remote_blocking_ast+0x0/0x590 [mdt] [67255.106476] [] osp_md_object_lock+0x162/0x2d0 [osp] [67255.128860] [] lod_object_lock+0xf3/0x950 [lod] [67255.150068] [] ? lprocfs_counter_add+0xf9/0x160 [obdclass] [67255.174361] [] ? htable_lookup+0xa9/0x180 [obdclass] [67255.196914] [] mdd_object_lock+0x3e/0xe0 [mdd] [67255.217734] [] mdt_remote_object_lock_try+0x1e1/0x770 [mdt] [67255.242282] [] mdt_remote_object_lock+0x2a/0x30 [mdt] [67255.265106] [] mdt_reint_rename_or_migrate.isra.40+0x362/0x860 [mdt] [67255.292224] [] ? mdt_root_squash+0x21/0x430 [mdt] [67255.313903] [] ? ucred_set_audit_enabled.isra.13+0x22/0x60 [mdt] [67255.339881] [] mdt_reint_rename+0x13/0x20 [mdt] [67255.360998] [] mdt_reint_rec+0x83/0x210 [mdt] [67255.381538] [] mdt_reint_internal+0x5fb/0x9c0 [mdt] [67255.403787] [] mdt_reint+0x67/0x140 [mdt] [67255.423193] [] tgt_request_handle+0x92a/0x13b0 [ptlrpc] [67255.446606] [] ptlrpc_server_handle_request+0x253/0xab0 [ptlrpc] [67255.472590] [] ? ptlrpc_wait_event+0x98/0x340 [ptlrpc] [67255.495683] [] ? default_wake_function+0x12/0x20 [67255.517072] [] ? __wake_up_common+0x5b/0x90 [67255.537067] [] ptlrpc_main+0xa92/0x1f40 [ptlrpc] [67255.558481] [] ? ptlrpc_main+0x0/0x1f40 [ptlrpc] [67255.579870] [] kthread+0xd1/0xe0 [67255.596663] [] ? kthread+0x0/0xe0 [67255.613734] [] ret_from_fork+0x77/0xb0 [67255.632250] [] ? kthread+0x0/0xe0 [67255.649314] [67255.654938] Pid: 8242, comm: mdt01_001 [67255.667992] Call Trace: [67255.682336] [] schedule+0x29/0x70 [67255.699407] [] schedule_timeout+0x174/0x2c0 [67255.719303] [] ? process_timeout+0x0/0x10 [67255.738651] [] ? ptlrpc_interrupted_set+0x0/0x110 [ptlrpc] [67255.762830] [] ptlrpc_set_wait+0x218/0x7c0 [ptlrpc] [67255.784931] [] ? default_wake_function+0x0/0x20 [67255.805886] [] ptlrpc_queue_wait+0x7d/0x220 [ptlrpc] [67255.828268] [] ldlm_cli_enqueue+0x3d2/0x920 [ptlrpc] [67255.850635] [] ? ldlm_completion_ast+0x0/0x920 [ptlrpc] [67255.873840] [] ? mdt_remote_blocking_ast+0x0/0x590 [mdt] [67255.897305] [] osp_md_object_lock+0x162/0x2d0 [osp] [67255.919344] [] lod_object_lock+0xf3/0x950 [lod] [67255.940248] [] ? lprocfs_counter_add+0xf9/0x160 [obdclass] [67255.964303] [] ? htable_lookup+0xa9/0x180 [obdclass] [67255.986634] [] mdd_object_lock+0x3e/0xe0 [mdd] [67256.007230] [] mdt_remote_object_lock_try+0x1e1/0x770 [mdt] [67256.031562] [] mdt_remote_object_lock+0x2a/0x30 [mdt] [67256.054176] [] mdt_reint_rename_or_migrate.isra.40+0x362/0x860 [mdt] [67256.081090] [] ? mdt_root_squash+0x21/0x430 [mdt] [67256.102562] [] ? ucred_set_audit_enabled.isra.13+0x22/0x60 [mdt] [67256.128327] [] mdt_reint_rename+0x13/0x20 [mdt] [67256.149229] [] mdt_reint_rec+0x83/0x210 [mdt] [67256.169554] [] mdt_reint_internal+0x5fb/0x9c0 [mdt] [67256.191595] [] mdt_reint+0x67/0x140 [mdt] [67256.210793] [] tgt_request_handle+0x92a/0x13b0 [ptlrpc] [67256.234003] [] ptlrpc_server_handle_request+0x253/0xab0 [ptlrpc] [67256.259783] [] ? ptlrpc_wait_event+0x98/0x340 [ptlrpc] [67256.282678] [] ? default_wake_function+0x12/0x20 [67256.303858] [] ? __wake_up_common+0x5b/0x90 [67256.323624] [] ptlrpc_main+0xa92/0x1f40 [ptlrpc] [67256.344828] [] ? ptlrpc_main+0x0/0x1f40 [ptlrpc] [67256.365991] [] kthread+0xd1/0xe0 [67256.382592] [] ? kthread+0x0/0xe0 [67256.399467] [] ret_from_fork+0x77/0xb0 [67256.417748] [] ? kthread+0x0/0xe0 [67256.434616] [67256.440086] LNet: Service thread pid 8694 was inactive for 204.46s. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes: [67256.496733] LNet: Skipped 1 previous similar message [67256.514095] Pid: 8694, comm: mdt01_019 [67256.527410] Call Trace: [67256.542157] [] schedule+0x29/0x70 [67256.559379] [] schedule_timeout+0x174/0x2c0 [67256.579415] [] ? process_timeout+0x0/0x10 [67256.598894] [] ? ptlrpc_interrupted_set+0x0/0x110 [ptlrpc] [67256.623208] [] ptlrpc_set_wait+0x218/0x7c0 [ptlrpc] [67256.645494] [] ? default_wake_function+0x0/0x20 [67256.666605] [] ptlrpc_queue_wait+0x7d/0x220 [ptlrpc] [67256.689153] [] ldlm_cli_enqueue+0x3d2/0x920 [ptlrpc] [67256.711707] [] ? ldlm_completion_ast+0x0/0x920 [ptlrpc] [67256.735101] [] ? mdt_remote_blocking_ast+0x0/0x590 [mdt] [67256.758768] [] osp_md_object_lock+0x162/0x2d0 [osp] [67256.781001] [] lod_object_lock+0xf3/0x950 [lod] [67256.802105] [] ? lprocfs_counter_add+0xf9/0x160 [obdclass] [67256.826369] [] ? htable_lookup+0xa9/0x180 [obdclass] [67256.848902] [] mdd_object_lock+0x3e/0xe0 [mdd] [67256.869710] [] mdt_remote_object_lock_try+0x1e1/0x770 [mdt] [67256.894240] [] mdt_remote_object_lock+0x2a/0x30 [mdt] [67256.917052] [] mdt_reint_rename_or_migrate.isra.40+0x362/0x860 [mdt] [67256.944171] [] ? mdt_root_squash+0x21/0x430 [mdt] [67256.965849] [] ? ucred_set_audit_enabled.isra.13+0x22/0x60 [mdt] [67256.991822] [] mdt_reint_rename+0x13/0x20 [mdt] [67257.012921] [] mdt_reint_rec+0x83/0x210 [mdt] [67257.033452] [] mdt_reint_internal+0x5fb/0x9c0 [mdt] [67257.055692] [] mdt_reint+0x67/0x140 [mdt] [67257.075065] [] tgt_request_handle+0x92a/0x13b0 [ptlrpc] [67257.098431] [] ptlrpc_server_handle_request+0x253/0xab0 [ptlrpc] [67257.124368] [] ? ptlrpc_wait_event+0x98/0x340 [ptlrpc] [67257.147399] [] ? default_wake_function+0x12/0x20 [67257.168676] [] ? __wake_up_common+0x5b/0x90 [67257.188528] [] ptlrpc_main+0xa92/0x1f40 [ptlrpc] [67257.209802] [] ? ptlrpc_main+0x0/0x1f40 [ptlrpc] [67257.231027] [] kthread+0xd1/0xe0 [67257.247662] [] ? kthread+0x0/0xe0 [67257.264554] [] ret_from_fork+0x77/0xb0 [67257.282899] [] ? kthread+0x0/0xe0 [67257.299802] [67257.305259] Pid: 8279, comm: mdt01_003 [67257.318170] Call Trace: [67257.332182] [] schedule+0x29/0x70 [67257.349077] [] schedule_timeout+0x174/0x2c0 [67257.368835] [] ? process_timeout+0x0/0x10 [67257.388034] [] ? ptlrpc_interrupted_set+0x0/0x110 [ptlrpc] [67257.412074] [] ptlrpc_set_wait+0x218/0x7c0 [ptlrpc] [67257.434094] [] ? default_wake_function+0x0/0x20 [67257.454988] [] ptlrpc_queue_wait+0x7d/0x220 [ptlrpc] [67257.477316] [] ldlm_cli_enqueue+0x3d2/0x920 [ptlrpc] [67257.499658] [] ? ldlm_completion_ast+0x0/0x920 [ptlrpc] [67257.522819] [] ? mdt_remote_blocking_ast+0x0/0x590 [mdt] [67257.546292] [] osp_md_object_lock+0x162/0x2d0 [osp] [67257.568333] [] lod_object_lock+0xf3/0x950 [lod] [67257.589234] [] ? lprocfs_counter_add+0xf9/0x160 [obdclass] [67257.613286] [] ? htable_lookup+0xa9/0x180 [obdclass] [67257.635610] [] mdd_object_lock+0x3e/0xe0 [mdd] [67257.656217] [] mdt_remote_object_lock_try+0x1e1/0x770 [mdt] [67257.680546] [] mdt_remote_object_lock+0x2a/0x30 [mdt] [67257.703152] [] mdt_reint_rename_or_migrate.isra.40+0x362/0x860 [mdt] [67257.730059] [] ? mdt_root_squash+0x21/0x430 [mdt] [67257.751528] [] ? ucred_set_audit_enabled.isra.13+0x22/0x60 [mdt] [67257.777298] [] mdt_reint_rename+0x13/0x20 [mdt] [67257.798199] [] mdt_reint_rec+0x83/0x210 [mdt] [67257.818523] [] mdt_reint_internal+0x5fb/0x9c0 [mdt] [67257.840561] [] mdt_reint+0x67/0x140 [mdt] [67257.859760] [] tgt_request_handle+0x92a/0x13b0 [ptlrpc] [67257.882955] [] ptlrpc_server_handle_request+0x253/0xab0 [ptlrpc] [67257.908733] [] ? ptlrpc_wait_event+0x98/0x340 [ptlrpc] [67257.931633] [] ? default_wake_function+0x12/0x20 [67257.952802] [] ? __wake_up_common+0x5b/0x90 [67257.972556] [] ptlrpc_main+0xa92/0x1f40 [ptlrpc] [67257.993748] [] ? ptlrpc_main+0x0/0x1f40 [ptlrpc] [67258.014902] [] kthread+0xd1/0xe0 [67258.031508] [] ? kthread+0x0/0xe0 [67258.048381] [] ret_from_fork+0x77/0xb0 [67258.066681] [] ? kthread+0x0/0xe0 [67258.083537] [67258.088949] LNet: Service thread pid 8695 was inactive for 206.14s. Watchdog stack traces are limited to 3 per 300 seconds, skipping this one. [67258.132136] LNet: Skipped 10 previous similar messages [67272.282694] LDISKFS-fs warning (device dm-1): ldiskfs_multi_mount_protect:322: MMP interval 42 higher than expected, please wait. [67277.829482] Lustre: soaked-MDT0001: haven't heard from client soaked-MDT0000-mdtlov_UUID (at 192.168.1.108@o2ib) in 228 seconds. I think it's dead, and I am evicting it. exp ffff88080c532c00, cur 1524593903 expire 1524593753 last 1524593675 [67285.177134] LustreError: 137-5: soaked-MDT0000_UUID: not available for connect from 192.168.1.139@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server. [67285.239319] LustreError: Skipped 125 previous similar messages [67324.966777] LDISKFS-fs (dm-1): recovery complete [67324.983626] LDISKFS-fs (dm-1): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,user_xattr,no_mbcache,nodelalloc [67337.317968] Lustre: MGS: Connection restored to (at 0@lo) [67337.338131] Lustre: Skipped 1 previous similar message [67337.775947] Lustre: soaked-MDT0000: Imperative Recovery not enabled, recovery window 300-900 [67337.828174] Lustre: soaked-MDT0000: in recovery but waiting for the first client to connect [67337.834978] Lustre: 9785:0:(llog.c:577:llog_process_thread()) soaked-MDT0001-osp-MDT0000: invalid length 0 in llog [0x1:0x4000bf92:0x2]record for index 0/155 [67337.834989] LustreError: 9785:0:(lod_dev.c:427:lod_sub_recovery_thread()) soaked-MDT0001-osp-MDT0000 get update log failed: rc = -22 [67337.851230] Lustre: soaked-MDT0000: Connection restored to (at 192.168.1.104@o2ib) [67337.851233] Lustre: Skipped 1 previous similar message [67337.999736] Lustre: Skipped 1 previous similar message [67338.018593] Lustre: 9788:0:(ldlm_lib.c:2040:target_recovery_overseer()) recovery is aborted, evict exports in recovery [67338.055593] Lustre: 9788:0:(ldlm_lib.c:2040:target_recovery_overseer()) Skipped 1 previous similar message [67338.362075] ------------[ cut here ]------------ [67338.379624] WARNING: CPU: 22 PID: 9797 at lib/vsprintf.c:1741 vsnprintf+0x691/0x6a0 [63568.749042] Lustre: soaked-MDT0001: Rejecting reconnect from the known client soaked-MDT0001-lwp-OST000f_UUID (at 192.168.1.105@o2ib) because it is indicating it is a new client [67338.406961] Modules linked in: [67338.419003] mgs(OE) osp(OE) mdd(OE) lod(OE) mdt(OE) lfsck(OE) mgc(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) fid(OE) fld(OE) ko2iblnd(OE) ptlrpc(OE) obdclass(OE) lnet(OE) libcfs(OE) rpcsec_gss_krb5 nfsv4 dns_resolver nfs fscache rdma_ucm(OE) ib_ucm(OE) rdma_cm(OE) iw_cm(OE) ib_ipoib(OE) ib_cm(OE) ib_uverbs(OE) ib_umad(OE) mlx5_ib(OE) mlx5_core(OE) mlx4_en(OE) dm_round_robin zfs(POE) zunicode(POE) zavl(POE) icp(POE) zcommon(POE) znvpair(POE) spl(OE) sb_edac edac_core intel_powerclamp coretemp intel_rapl iosf_mbi kvm irqbypass ipmi_ssif crc32_pclmul ghash_clmulni_intel aesni_intel ipmi_si lrw gf128mul glue_helper ablk_helper cryptd iTCO_wdt ipmi_devintf sg iTCO_vendor_support joydev mei_me lpc_ich ipmi_msghandler mei shpchp wmi pcspkr i2c_i801 ioatdma dm_multipath dm_mod nfsd nfs_acl lockd grace auth_rpcgss [67338.659290] sunrpc ip_tables ext4 mbcache jbd2 mlx4_ib(OE) ib_core(OE) sd_mod crc_t10dif crct10dif_generic mgag200 drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops ttm isci igb mpt2sas ptp ahci drm pps_core libsas mlx4_core(OE) libahci crct10dif_pclmul devlink dca raid_class crct10dif_common i2c_algo_bit crc32c_intel libata scsi_transport_sas mlx_compat(OE) i2c_core [67338.771526] CPU: 22 PID: 9797 Comm: lctl Tainted: P OE ------------ 3.10.0-693.21.1.el7_lustre.x86_64 #1 [67338.807811] Hardware name: Intel Corporation S2600GZ ........../S2600GZ, BIOS SE5C600.86B.01.08.0003.022620131521 02/26/2013 [67338.847669] Call Trace: [67338.858875] [] dump_stack+0x19/0x1b [67338.878497] [] __warn+0xd8/0x100 [67338.896971] [] warn_slowpath_null+0x1d/0x20 [67338.918426] [] vsnprintf+0x691/0x6a0 [67338.937778] [] ? free_reserved_area+0x8f/0x140 [67338.959832] [] snprintf+0x49/0x70 [67338.978029] [] ? lodname2mdt_index+0xb0/0x2f0 [lod] [67339.001314] [] lod_show_update_logs_retrievers+0x137/0x2d0 [lod] [67339.026991] LustreError: 9784:0:(lod_dev.c:427:lod_sub_recovery_thread()) soaked-MDT0000-osd get update log failed: rc = -108 [67339.026994] LustreError: 9784:0:(lod_dev.c:427:lod_sub_recovery_thread()) Skipped 2 previous similar messages [67339.027174] Lustre: soaked-MDT0000: disconnecting 30 stale clients [67339.027795] Lustre: soaked-MDT0000: in recovery but waiting for the first client to connect [67339.027803] Lustre: 9788:0:(ldlm_lib.c:2040:target_recovery_overseer()) recovery is aborted, evict exports in recovery [67339.194537] [] lprocfs_recovery_status_seq_show+0xa2/0x4c0 [obdclass] [67339.224227] [] mdt_recovery_status_seq_show+0x12/0x20 [mdt] [67339.250781] [] seq_read+0x110/0x3e0 [67339.270238] [] proc_reg_read+0x40/0x80 [67339.290340] [] vfs_read+0x9f/0x170 [67339.309152] [] SyS_read+0x7f/0xe0 [67339.327503] [] ? system_call_after_swapgs+0xae/0x146 [67339.351190] [] system_call_fastpath+0x1c/0x21 [67339.372790] [] ? system_call_after_swapgs+0xae/0x146 [67339.396246] ---[ end trace 59e91bfb5f08d22e ]--- [67339.596186] Lustre: soaked-MDT0000: Connection restored to ac928d0b-b198-abfc-8c00-ab82d878e706 (at 192.168.1.144@o2ib) [67339.634535] Lustre: Skipped 2 previous similar messages [67343.038649] Lustre: MGS: Connection restored to (at 192.168.1.140@o2ib) [67343.063467] Lustre: Skipped 1 previous similar message [67346.319075] LNet: 8161:0:(o2iblnd_cb.c:3296:kiblnd_check_conns()) Timed out tx for 192.168.1.108@o2ib: 2 seconds [67346.355146] LNet: 8161:0:(o2iblnd_cb.c:3296:kiblnd_check_conns()) Skipped 3 previous similar messages [67350.427534] Lustre: MGS: Connection restored to (at 192.168.1.102@o2ib) [67350.452413] Lustre: Skipped 7 previous similar messages [67360.177380] Lustre: MGS: Connection restored to (at 192.168.1.139@o2ib) [67360.201136] Lustre: Skipped 14 previous similar messages [67362.761351] LustreError: 167-0: soaked-MDT0000-lwp-MDT0001: This client was evicted by soaked-MDT0000; in progress operations using this service will fail. [67385.907674] Lustre: MGS: Connection restored to (at 192.168.1.136@o2ib) [67385.930954] Lustre: Skipped 23 previous similar messages [67387.761484] LustreError: 167-0: soaked-MDT0000-osp-MDT0001: This client was evicted by soaked-MDT0000; in progress operations using this service will fail. [67387.810434] LustreError: 8279:0:(mdt_reint.c:2181:mdt_reint_rename_or_migrate()) soaked-MDT0001: can't lock FS for rename: rc = -5 [67387.810699] LNet: Service thread pid 8242 completed after 336.00s. This indicates the system was overloaded (too many service threads, or there were not enough hardware resources). [67387.810700] LNet: Service thread pid 8615 completed after 335.77s. This indicates the system was overloaded (too many service threads, or there were not enough hardware resources). [67387.811812] LustreError: 8615:0:(lu_object.h:688:lu_object_get()) ASSERTION( atomic_read(&o->lo_header->loh_ref) > 0 ) failed: [67387.811814] LustreError: 8615:0:(lu_object.h:688:lu_object_get()) LBUG [67387.811815] Pid: 8615, comm: mdt01_014 [67387.811816] Call Trace: [67387.811831] [] libcfs_call_trace+0x4e/0x60 [libcfs] [67387.811837] [] lbug_with_loc+0x4c/0xb0 [libcfs] [67387.811847] LustreError: 8692:0:(lu_object.h:688:lu_object_get()) ASSERTION( atomic_read(&o->lo_header->loh_ref) > 0 ) failed: [67387.811850] LustreError: 8692:0:(lu_object.h:688:lu_object_get()) LBUG [67387.811851] Pid: 8692, comm: mdt01_017 [67387.811851] Call Trace: [67387.811860] [] err_serious.part.38+0x0/0x36 [mdt] [67387.811861] [] libcfs_call_trace+0x4e/0x60 [libcfs] [67387.811867] [] lbug_with_loc+0x4c/0xb0 [libcfs] [67387.811873] [] mdt_remote_object_lock_try+0x736/0x770 [mdt] [67387.811884] [] err_serious.part.38+0x0/0x36 [mdt] [67387.811895] [] mdt_remote_object_lock_try+0x736/0x770 [mdt] [67387.811901] [] ? lprocfs_stats_lock+0x24/0xd0 [obdclass] [67387.811912] [] mdt_remote_object_lock+0x2a/0x30 [mdt] [67387.811918] [] ? lprocfs_stats_lock+0x24/0xd0 [obdclass] [67387.811927] [] mdt_reint_open+0x2769/0x3270 [mdt] [67387.811928] [] mdt_remote_object_lock+0x2a/0x30 [mdt] [67387.811940] [] mdt_reint_open+0x2769/0x3270 [mdt] [67387.811949] [] ? upcall_cache_get_entry+0x211/0x8e0 [obdclass] [67387.811965] [] ? upcall_cache_get_entry+0x211/0x8e0 [obdclass] [67387.811968] [] ? lu_ucred+0x1e/0x30 [obdclass] [67387.811980] [] ? mdt_ucred+0x15/0x20 [mdt] [67387.811984] [] ? lu_ucred+0x1e/0x30 [obdclass] [67387.811990] [] ? mdt_root_squash+0x21/0x430 [mdt] [67387.811995] [] ? mdt_ucred+0x15/0x20 [mdt] [67387.812002] [] mdt_reint_rec+0x83/0x210 [mdt] [67387.812006] [] ? mdt_root_squash+0x21/0x430 [mdt] [67387.812012] [] mdt_reint_internal+0x5fb/0x9c0 [mdt] [67387.812017] [] mdt_reint_rec+0x83/0x210 [mdt] [67387.812022] [] mdt_intent_reint+0x157/0x420 [mdt] [67387.812027] [] mdt_reint_internal+0x5fb/0x9c0 [mdt] [67387.812032] [] mdt_intent_opc+0x455/0xae0 [mdt] [67387.812036] [] mdt_intent_reint+0x157/0x420 [mdt] [67387.812046] [] mdt_intent_opc+0x455/0xae0 [mdt] [67387.812090] [] ? lustre_swab_ldlm_intent+0x0/0x20 [ptlrpc] [67387.812099] [] ? lustre_swab_ldlm_intent+0x0/0x20 [ptlrpc] [67387.812102] [] mdt_intent_policy+0x1a3/0x360 [mdt] [67387.812111] [] mdt_intent_policy+0x1a3/0x360 [mdt] [67387.812127] [] ldlm_lock_enqueue+0x34e/0xa50 [ptlrpc] [67387.812136] [] ? cfs_hash_add+0xbe/0x1a0 [libcfs] [67387.812137] [] ldlm_lock_enqueue+0x34e/0xa50 [ptlrpc] [67387.812145] [] ? cfs_hash_add+0xbe/0x1a0 [libcfs] [67387.812164] [] ldlm_handle_enqueue0+0x8f3/0x1410 [ptlrpc] [67387.812173] [] ldlm_handle_enqueue0+0x8f3/0x1410 [ptlrpc] [67387.812198] [] ? lustre_swab_ldlm_request+0x0/0x30 [ptlrpc] [67387.812204] [] ? lustre_swab_ldlm_request+0x0/0x30 [ptlrpc] [67387.812238] [] tgt_enqueue+0x62/0x210 [ptlrpc] [67387.812245] [] tgt_enqueue+0x62/0x210 [ptlrpc] [67387.812288] [] tgt_request_handle+0x92a/0x13b0 [ptlrpc] [67387.812294] [] tgt_request_handle+0x92a/0x13b0 [ptlrpc] [67387.812322] [] ptlrpc_server_handle_request+0x253/0xab0 [ptlrpc] [67387.812330] [] ptlrpc_server_handle_request+0x253/0xab0 [ptlrpc] [67387.812355] [] ? ptlrpc_wait_event+0x98/0x340 [ptlrpc] [67387.812361] [] ? default_wake_function+0x12/0x20 [67387.812364] [] ? __wake_up_common+0x5b/0x90 [67387.812366] [] ? ptlrpc_wait_event+0x98/0x340 [ptlrpc] [67387.812370] [] ? default_wake_function+0x12/0x20 [67387.812372] [] ? __wake_up_common+0x5b/0x90 [67387.812397] [] ptlrpc_main+0xa92/0x1f40 [ptlrpc] [67387.812405] [] ptlrpc_main+0xa92/0x1f40 [ptlrpc] [67387.812429] [] ? ptlrpc_main+0x0/0x1f40 [ptlrpc] [67387.812433] [] kthread+0xd1/0xe0 [67387.812435] [] ? kthread+0x0/0xe0 [67387.812439] [] ret_from_fork+0x77/0xb0 [67387.812440] [] ? ptlrpc_main+0x0/0x1f40 [ptlrpc] [67387.812441] [] ? kthread+0x0/0xe0 [67387.812442] [67387.812443] [] kthread+0xd1/0xe0 [67387.812443] Kernel panic - not syncing: LBUG [67387.812446] CPU: 25 PID: 8615 Comm: mdt01_014 Tainted: P W OE ------------ 3.10.0-693.21.1.el7_lustre.x86_64 #1 [67387.812447] [] ? kthread+0x0/0xe0 [67387.812448] Hardware name: Intel Corporation S2600GZ ........../S2600GZ, BIOS SE5C600.86B.01.08.0003.022620131521 02/26/2013 [67387.812449] Call Trace: [67387.812450] [] ret_from_fork+0x77/0xb0 [67387.812468] [] dump_stack+0x19/0x1b [67387.812469] [] ? kthread+0x0/0xe0 [67387.812471] [] panic+0xe8/0x21f [67387.812472] [67387.812478] [] lbug_with_loc+0x64/0xb0 [libcfs] [67387.812492] [] lu_object_get.isra.33.part.34+0x36/0x36 [mdt] [67387.812502] [] mdt_remote_object_lock_try+0x736/0x770 [mdt] [67387.812521] [] ? lprocfs_stats_lock+0x24/0xd0 [obdclass] [67387.812531] [] mdt_remote_object_lock+0x2a/0x30 [mdt] [67387.812543] [] mdt_reint_open+0x2769/0x3270 [mdt] [67387.812563] [] ? upcall_cache_get_entry+0x211/0x8e0 [obdclass] [67387.812582] [] ? lu_ucred+0x1e/0x30 [obdclass] [67387.812592] [] ? mdt_ucred+0x15/0x20 [mdt] [67387.812602] [] ? mdt_root_squash+0x21/0x430 [mdt] [67387.812614] [] mdt_reint_rec+0x83/0x210 [mdt] [67387.812623] [] mdt_reint_internal+0x5fb/0x9c0 [mdt] [67387.812633] [] mdt_intent_reint+0x157/0x420 [mdt] [67387.812643] [] mdt_intent_opc+0x455/0xae0 [mdt] [67387.812674] [] ? lustre_swab_ldlm_policy_data+0x30/0x30 [ptlrpc] [67387.812685] [] mdt_intent_policy+0x1a3/0x360 [mdt] [67387.812711] [] ldlm_lock_enqueue+0x34e/0xa50 [ptlrpc] [67387.812719] [] ? cfs_hash_add+0xbe/0x1a0 [libcfs] [67387.812747] [] ldlm_handle_enqueue0+0x8f3/0x1410 [ptlrpc] [67387.812779] [] ? lustre_swab_ldlm_lock_desc+0x30/0x30 [ptlrpc] [67387.812831] [] tgt_enqueue+0x62/0x210 [ptlrpc] [67387.812869] [] tgt_request_handle+0x92a/0x13b0 [ptlrpc] [67387.812903] [] ptlrpc_server_handle_request+0x253/0xab0 [ptlrpc] [67387.812946] [] ? ptlrpc_wait_event+0x98/0x340 [ptlrpc] [67387.812949] LustreError: 8696:0:(lu_object.h:688:lu_object_get()) ASSERTION( atomic_read(&o->lo_header->loh_ref) > 0 ) failed: [67387.812951] [] ? default_wake_function+0x12/0x20 [67387.812953] LustreError: 8696:0:(lu_object.h:688:lu_object_get()) LBUG [67387.812954] Pid: 8696, comm: mdt01_021 [67387.812956] [] ? __wake_up_common+0x5b/0x90 [67387.812956] Call Trace: [67387.812999] [] ptlrpc_main+0xa92/0x1f40 [ptlrpc] [67387.813000] [] libcfs_call_trace+0x4e/0x60 [libcfs] [67387.813036] [] ? ptlrpc_register_service+0xe90/0xe90 [ptlrpc] [67387.813036] [] lbug_with_loc+0x4c/0xb0 [libcfs] [67387.813051] [] kthread+0xd1/0xe0 [67387.813053] [] ? insert_kthread_work+0x40/0x40 [67387.813055] [] ret_from_fork+0x77/0xb0 [67387.813057] [] ? insert_kthread_work+0x40/0x40 [67387.813062] [] err_serious.part.38+0x0/0x36 [mdt] [67387.813072] [] mdt_remote_object_lock_try+0x736/0x770 [mdt] [67387.813097] [] ? lprocfs_stats_lock+0x24/0xd0 [obdclass] [67387.813119] [] mdt_remote_object_lock+0x2a/0x30 [mdt] [67387.813132] [] mdt_reint_open+0x2769/0x3270 [mdt] [67387.813156] [] ? upcall_cache_get_entry+0x211/0x8e0 [obdclass] [67387.813168] LustreError: 8762:0:(lu_object.h:688:lu_object_get()) ASSERTION( atomic_read(&o->lo_header->loh_ref) > 0 ) failed: [67387.813171] LustreError: 8762:0:(lu_object.h:688:lu_object_get()) LBUG [67387.813172] Pid: 8762, comm: mdt01_026 [67387.813172] Call Trace: [67387.813176] [] ? lu_ucred+0x1e/0x30 [obdclass] [67387.813184] [] libcfs_call_trace+0x4e/0x60 [libcfs] [67387.813187] [] ? mdt_ucred+0x15/0x20 [mdt] [67387.813191] [] lbug_with_loc+0x4c/0xb0 [libcfs] [67387.813198] [] ? mdt_root_squash+0x21/0x430 [mdt] [67387.813205] [] err_serious.part.38+0x0/0x36 [mdt] [67387.813210] [] mdt_reint_rec+0x83/0x210 [mdt] [67387.813216] [] mdt_remote_object_lock_try+0x736/0x770 [mdt] [67387.813219] [] mdt_reint_internal+0x5fb/0x9c0 [mdt] [67387.813242] [] mdt_intent_reint+0x157/0x420 [mdt] [67387.813246] [] ? lprocfs_stats_lock+0x24/0xd0 [obdclass] [67387.813251] [] mdt_intent_opc+0x455/0xae0 [mdt] [67387.813256] [] mdt_remote_object_lock+0x2a/0x30 [mdt] [67387.813268] [] mdt_reint_open+0x2769/0x3270 [mdt] [67387.813295] [] ? lustre_swab_ldlm_intent+0x0/0x20 [ptlrpc] [67387.813301] [] ? upcall_cache_get_entry+0x211/0x8e0 [obdclass] [67387.813306] [] mdt_intent_policy+0x1a3/0x360 [mdt] [67387.813320] [] ? lu_ucred+0x1e/0x30 [obdclass] [67387.813330] [] ? mdt_ucred+0x15/0x20 [mdt] [67387.813338] [] ldlm_lock_enqueue+0x34e/0xa50 [ptlrpc] [67387.813342] [] ? mdt_root_squash+0x21/0x430 [mdt] [67387.813359] [] ? cfs_hash_add+0xbe/0x1a0 [libcfs] [67387.813366] [] mdt_reint_rec+0x83/0x210 [mdt] [67387.813375] [] mdt_reint_internal+0x5fb/0x9c0 [mdt] [67387.813385] [] mdt_intent_reint+0x157/0x420 [mdt] [67387.813389] [] ldlm_handle_enqueue0+0x8f3/0x1410 [ptlrpc] [67387.813394] [] mdt_intent_opc+0x455/0xae0 [mdt] [67387.813433] [] ? lustre_swab_ldlm_request+0x0/0x30 [ptlrpc] [67387.813440] [] ? lustre_swab_ldlm_intent+0x0/0x20 [ptlrpc] [67387.813451] [] mdt_intent_policy+0x1a3/0x360 [mdt] [67387.813471] [] tgt_enqueue+0x62/0x210 [ptlrpc] [67387.813477] [] ldlm_lock_enqueue+0x34e/0xa50 [ptlrpc] [67387.813485] [] ? cfs_hash_add+0xbe/0x1a0 [libcfs] [67387.813508] [] tgt_request_handle+0x92a/0x13b0 [ptlrpc] [67387.813515] [] ldlm_handle_enqueue0+0x8f3/0x1410 [ptlrpc] [67387.813541] [] ptlrpc_server_handle_request+0x253/0xab0 [ptlrpc] [67387.813549] [] ? lustre_swab_ldlm_request+0x0/0x30 [ptlrpc] [67387.813573] [] ? ptlrpc_wait_event+0x98/0x340 [ptlrpc] [67387.813575] [] ? default_wake_function+0x12/0x20 [67387.813577] [] ? __wake_up_common+0x5b/0x90 [67387.813588] [] tgt_enqueue+0x62/0x210 [ptlrpc] [67387.813609] [] ptlrpc_main+0xa92/0x1f40 [ptlrpc] [67387.813625] [] tgt_request_handle+0x92a/0x13b0 [ptlrpc] [67387.813640] [] ? ptlrpc_main+0x0/0x1f40 [ptlrpc] [67387.813642] [] kthread+0xd1/0xe0 [67387.813644] [] ? kthread+0x0/0xe0 [67387.813647] [] ret_from_fork+0x77/0xb0 [67387.813649] [] ? kthread+0x0/0xe0 [67387.813649] [67387.813658] [] ptlrpc_server_handle_request+0x253/0xab0 [ptlrpc] [67387.813690] [] ? ptlrpc_wait_event+0x98/0x340 [ptlrpc] [67387.813692] [] ? default_wake_function+0x12/0x20 [67387.813694] [] ? __wake_up_common+0x5b/0x90 [67387.813726] [] ptlrpc_main+0xa92/0x1f40 [ptlrpc] [67387.813757] [] ? ptlrpc_main+0x0/0x1f40 [ptlrpc] [67387.813759] [] kthread+0xd1/0xe0 [67387.813761] [] ? kthread+0x0/0xe0 [67387.813764] [] ret_from_fork+0x77/0xb0 [67387.813766] [] ? kthread+0x0/0xe0 [67387.813766]