[ 0.000000] microcode: microcode updated early to revision 0x710, date = 2013-06-17 [ 0.000000] Initializing cgroup subsys cpuset [ 0.000000] Initializing cgroup subsys cpu [ 0.000000] Initializing cgroup subsys cpuacct [ 0.000000] Linux version 3.10.0-693.11.6.el7_lustre.x86_64 (jenkins@trevis-309-el7-x8664-2.trevis.hpdd.intel.com) (gcc version 4.8.5 20150623 (Red Hat 4.8.5-4) (GCC) ) #1 SMP Wed Jan 17 07:36:29 UTC 2018 [ 0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-3.10.0-693.11.6.el7_lustre.x86_64 root=UUID=4dfe900a-c2ad-4424-b141-9a27a9c3d15c ro crashkernel=320M console=tty0 LANG=en_US.UTF-8 console=ttyS0,115200 net.ifnames=0 [ 0.000000] e820: BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008efff] usable [ 0.000000] BIOS-e820: [mem 0x000000000008f000-0x000000000009ffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bb3c6fff] usable [ 0.000000] BIOS-e820: [mem 0x00000000bb3c7000-0x00000000bdd2efff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000bdd2f000-0x00000000bddccfff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x00000000bddcd000-0x00000000bdea0fff] ACPI data [ 0.000000] BIOS-e820: [mem 0x00000000bdea1000-0x00000000bdf2efff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x00000000bdf2f000-0x00000000bdfabfff] ACPI data [ 0.000000] BIOS-e820: [mem 0x00000000bdfac000-0x00000000bdffffff] usable [ 0.000000] BIOS-e820: [mem 0x00000000be000000-0x00000000cfffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fec00000-0x00000000fec00fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed19000-0x00000000fed19fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fee00000-0x00000000fee00fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ffa20000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000083fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 2.6 present. [ 0.000000] DMI: Intel Corporation S2600GZ ........../S2600GZ, BIOS SE5C600.86B.01.08.0003.022620131521 02/26/2013 [ 0.000000] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved [ 0.000000] e820: remove [mem 0x000a0000-0x000fffff] usable [ 0.000000] e820: last_pfn = 0x840000 max_arch_pfn = 0x400000000 [ 0.000000] MTRR default type: uncachable [ 0.000000] MTRR fixed ranges enabled: [ 0.000000] 00000-9FFFF write-back [ 0.000000] A0000-BFFFF uncachable [ 0.000000] C0000-DBFFF write-through [ 0.000000] DC000-E7FFF uncachable [ 0.000000] E8000-FFFFF write-protect [ 0.000000] MTRR variable ranges enabled: [ 0.000000] 0 base 000000000000 mask 3FFF80000000 write-back [ 0.000000] 1 base 000080000000 mask 3FFFC0000000 write-back [ 0.000000] 2 base 000100000000 mask 3FFF00000000 write-back [ 0.000000] 3 base 000200000000 mask 3FFE00000000 write-back [ 0.000000] 4 base 000400000000 mask 3FFC00000000 write-back [ 0.000000] 5 base 000800000000 mask 3FFFC0000000 write-back [ 0.000000] 6 base 0000FF800000 mask 3FFFFF800000 write-protect [ 0.000000] 7 disabled [ 0.000000] 8 disabled [ 0.000000] 9 disabled [ 0.000000] x86 PAT enabled: cpu 0, old 0x7040600070406, new 0x7010600070106 [ 0.000000] e820: last_pfn = 0xbe000 max_arch_pfn = 0x400000000 [ 0.000000] found SMP MP-table at [mem 0x000fcd70-0x000fcd7f] mapped at [ffff8800000fcd70] [ 0.000000] Base memory trampoline at [ffff880000089000] 89000 size 24576 [ 0.000000] Using GB pages for direct mapping [ 0.000000] BRK [0x01ffb000, 0x01ffbfff] PGTABLE [ 0.000000] BRK [0x01ffc000, 0x01ffcfff] PGTABLE [ 0.000000] BRK [0x01ffd000, 0x01ffdfff] PGTABLE [ 0.000000] BRK [0x01ffe000, 0x01ffefff] PGTABLE [ 0.000000] RAMDISK: [mem 0x35b78000-0x36db3fff] [ 0.000000] Early table checksum verification disabled [ 0.000000] ACPI: RSDP 00000000000f0410 00024 (v02 INTEL ) [ 0.000000] ACPI: XSDT 00000000bdfa9d98 000BC (v01 INTEL S2600GZ 06222004 INTL 20090903) [ 0.000000] ACPI: FACP 00000000bdfa9918 000F4 (v04 INTEL S2600GZ 06222004 INTL 20090903) [ 0.000000] ACPI BIOS Warning (bug): Invalid length for FADT/Pm1aControlBlock: 32, using default 16 (20130517/tbfadt-672) [ 0.000000] ACPI: DSDT 00000000bdf8f018 18762 (v02 INTEL S2600GZ 00000008 INTL 20100331) [ 0.000000] ACPI: FACS 00000000bdfa9f40 00040 [ 0.000000] ACPI: APIC 00000000bdfa8018 00BAA (v03 INTEL S2600GZ 06222004 INTL 20090903) [ 0.000000] ACPI: SPMI 00000000bdfabb18 00040 (v05 INTEL S2600GZ 06222004 INTL 20090903) [ 0.000000] ACPI: MCFG 00000000bdfaba98 0003C (v01 INTEL S2600GZ 06222004 INTL 20090903) [ 0.000000] ACPI: WDDT 00000000bdfabf18 00040 (v01 INTEL S2600GZ 06222004 INTL 20090903) [ 0.000000] ACPI: SRAT 00000000bdf8cc18 002A8 (v03 INTEL S2600GZ 06222004 INTL 20090903) [ 0.000000] ACPI: SLIT 00000000bdfabe98 00030 (v01 INTEL S2600GZ 06222004 INTL 20090903) [ 0.000000] ACPI: MSCT 00000000bdfaae18 00090 (v01 INTEL S2600GZ 06222004 INTL 20090903) [ 0.000000] ACPI: HPET 00000000bdfabe18 00038 (v01 INTEL S2600GZ 06222004 INTL 20090903) [ 0.000000] ACPI: SSDT 00000000bdfabd18 0002B (v02 INTEL S2600GZ 00001000 INTL 20100331) [ 0.000000] ACPI: SSDT 00000000bddcd018 D30C8 (v02 INTEL S2600GZ 00004000 INTL 20100331) [ 0.000000] ACPI: SPCR 00000000bdfabd98 00050 (v01 INTEL S2600GZ 06222004 INTL 20090903) [ 0.000000] ACPI: HEST 00000000bdf8ef18 000A8 (v01 INTEL S2600GZ 00000001 INTL 00000001) [ 0.000000] ACPI: BERT 00000000bdfabc18 00030 (v01 INTEL S2600GZ 00000001 INTL 00000001) [ 0.000000] ACPI: ERST 00000000bdf8ec98 00230 (v01 INTEL S2600GZ 00000001 INTL 00000001) [ 0.000000] ACPI: EINJ 00000000bdfa9798 00130 (v01 INTEL S2600GZ 00000001 INTL 00000001) [ 0.000000] ACPI: SSDT 00000000bdf8a018 01729 (v02 INTEL S2600GZ 00000002 INTL 20100331) [ 0.000000] ACPI: SSDT 00000000bdfabc98 00045 (v02 INTEL S2600GZ 00000001 INTL 20100331) [ 0.000000] ACPI: SSDT 00000000bdf8de18 00181 (v02 INTEL S2600GZ 00000003 INTL 20100331) [ 0.000000] ACPI: Local APIC address 0xfee00000 [ 0.000000] SRAT: PXM 0 -> APIC 0x00 -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x01 -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x02 -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x03 -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x04 -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x05 -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x06 -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x07 -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x08 -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x09 -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x0a -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x0b -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x0c -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x0d -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x0e -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x0f -> Node 0 [ 0.000000] SRAT: PXM 1 -> APIC 0x20 -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x21 -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x22 -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x23 -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x24 -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x25 -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x26 -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x27 -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x28 -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x29 -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x2a -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x2b -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x2c -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x2d -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x2e -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x2f -> Node 1 [ 0.000000] SRAT: Node 0 PXM 0 [mem 0x00000000-0xbfffffff] [ 0.000000] SRAT: Node 0 PXM 0 [mem 0x100000000-0x43fffffff] [ 0.000000] SRAT: Node 1 PXM 1 [mem 0x440000000-0x83fffffff] [ 0.000000] NUMA: Initialized distance table, cnt=2 [ 0.000000] NUMA: Node 0 [mem 0x00000000-0xbfffffff] + [mem 0x100000000-0x43fffffff] -> [mem 0x00000000-0x43fffffff] [ 0.000000] NODE_DATA(0) allocated [mem 0x43ffd9000-0x43fffffff] [ 0.000000] NODE_DATA(1) allocated [mem 0x83ffd6000-0x83fffcfff] [ 0.000000] Reserving 320MB of memory at 528MB for crashkernel (System RAM: 32691MB) [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x00001000-0x00ffffff] [ 0.000000] DMA32 [mem 0x01000000-0xffffffff] [ 0.000000] Normal [mem 0x100000000-0x83fffffff] [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x00001000-0x0008efff] [ 0.000000] node 0: [mem 0x00100000-0xbb3c6fff] [ 0.000000] node 0: [mem 0xbdfac000-0xbdffffff] [ 0.000000] node 0: [mem 0x100000000-0x43fffffff] [ 0.000000] node 1: [mem 0x440000000-0x83fffffff] [ 0.000000] Initmem setup node 0 [mem 0x00001000-0x43fffffff] [ 0.000000] On node 0 totalpages: 4174761 [ 0.000000] DMA zone: 64 pages used for memmap [ 0.000000] DMA zone: 21 pages reserved [ 0.000000] DMA zone: 3982 pages, LIFO batch:0 [ 0.000000] DMA32 zone: 11921 pages used for memmap [ 0.000000] DMA32 zone: 762907 pages, LIFO batch:31 [ 0.000000] Normal zone: 53248 pages used for memmap [ 0.000000] Normal zone: 3407872 pages, LIFO batch:31 [ 0.000000] Initmem setup node 1 [mem 0x440000000-0x83fffffff] [ 0.000000] On node 1 totalpages: 4194304 [ 0.000000] Normal zone: 65536 pages used for memmap [ 0.000000] Normal zone: 4194304 pages, LIFO batch:31 [ 0.000000] ACPI: PM-Timer IO Port: 0x408 [ 0.000000] ACPI: Local APIC address 0xfee00000 [ 0.000000] ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x01] lapic_id[0x02] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x02] lapic_id[0x04] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x03] lapic_id[0x06] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x04] lapic_id[0x08] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x05] lapic_id[0x0a] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x06] lapic_id[0x0c] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x07] lapic_id[0x0e] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x08] lapic_id[0x20] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x09] lapic_id[0x22] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x24] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x26] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x0c] lapic_id[0x28] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x0d] lapic_id[0x2a] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x0e] lapic_id[0x2c] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x0f] lapic_id[0x2e] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x10] lapic_id[0x01] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x11] lapic_id[0x03] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x12] lapic_id[0x05] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x13] lapic_id[0x07] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x14] lapic_id[0x09] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x15] lapic_id[0x0b] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x16] lapic_id[0x0d] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x17] lapic_id[0x0f] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x18] lapic_id[0x21] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x19] lapic_id[0x23] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x1a] lapic_id[0x25] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x1b] lapic_id[0x27] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x1c] lapic_id[0x29] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x1d] lapic_id[0x2b] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x1e] lapic_id[0x2d] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x1f] lapic_id[0x2f] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x20] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x21] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x22] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x23] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x24] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x25] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x26] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x27] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x28] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x29] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x2a] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x2b] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x2c] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x2d] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x2e] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x2f] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x30] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x31] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x32] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x33] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x34] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x35] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x36] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x37] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x38] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x39] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x3a] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x3b] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x3c] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x3d] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x3e] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x3f] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x40] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x41] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x42] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x43] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x44] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x45] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x46] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x47] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x48] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x49] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x4a] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x4b] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x4c] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x4d] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x4e] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x4f] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x50] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x51] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x52] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x53] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x54] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x55] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x56] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x57] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x58] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x59] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x5a] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x5b] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x5c] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x5d] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x5e] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x5f] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x60] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x61] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x62] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x63] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x64] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x65] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x66] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x67] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x68] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x69] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x6a] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x6b] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x6c] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x6d] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x6e] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x6f] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x70] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x71] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x72] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x73] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x74] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x75] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x76] lapic_id[0xff] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x77] lapic_id[0xff] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x00] uid[0x00] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x01] uid[0x01] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x02] uid[0x02] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x03] uid[0x03] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x04] uid[0x04] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x05] uid[0x05] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x06] uid[0x06] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x07] uid[0x07] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x08] uid[0x08] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x09] uid[0x09] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x0a] uid[0x0a] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x0b] uid[0x0b] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x0c] uid[0x0c] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x0d] uid[0x0d] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x0e] uid[0x0e] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x0f] uid[0x0f] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x10] uid[0x10] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x11] uid[0x11] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x12] uid[0x12] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x13] uid[0x13] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x14] uid[0x14] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x15] uid[0x15] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x16] uid[0x16] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x17] uid[0x17] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x18] uid[0x18] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x19] uid[0x19] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x1a] uid[0x1a] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x1b] uid[0x1b] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x1c] uid[0x1c] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x1d] uid[0x1d] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x1e] uid[0x1e] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x1f] uid[0x1f] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x20] uid[0x20] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x21] uid[0x21] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x22] uid[0x22] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x23] uid[0x23] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x24] uid[0x24] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x25] uid[0x25] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x26] uid[0x26] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x27] uid[0x27] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x28] uid[0x28] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x29] uid[0x29] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x2a] uid[0x2a] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x2b] uid[0x2b] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x2c] uid[0x2c] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x2d] uid[0x2d] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x2e] uid[0x2e] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x2f] uid[0x2f] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x30] uid[0x30] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x31] uid[0x31] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x32] uid[0x32] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x33] uid[0x33] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x34] uid[0x34] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x35] uid[0x35] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x36] uid[0x36] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x37] uid[0x37] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x38] uid[0x38] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x39] uid[0x39] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x3a] uid[0x3a] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x3b] uid[0x3b] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x3c] uid[0x3c] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x3d] uid[0x3d] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x3e] uid[0x3e] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x3f] uid[0x3f] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x40] uid[0x40] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x41] uid[0x41] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x42] uid[0x42] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x43] uid[0x43] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x44] uid[0x44] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x45] uid[0x45] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x46] uid[0x46] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x47] uid[0x47] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x48] uid[0x48] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x49] uid[0x49] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x4a] uid[0x4a] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x4b] uid[0x4b] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x4c] uid[0x4c] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x4d] uid[0x4d] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x4e] uid[0x4e] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x4f] uid[0x4f] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x50] uid[0x50] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x51] uid[0x51] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x52] uid[0x52] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x53] uid[0x53] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x54] uid[0x54] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x55] uid[0x55] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x56] uid[0x56] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x57] uid[0x57] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x58] uid[0x58] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x59] uid[0x59] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x5a] uid[0x5a] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x5b] uid[0x5b] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x5c] uid[0x5c] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x5d] uid[0x5d] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x5e] uid[0x5e] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x5f] uid[0x5f] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x60] uid[0x60] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x61] uid[0x61] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x62] uid[0x62] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x63] uid[0x63] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x64] uid[0x64] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x65] uid[0x65] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x66] uid[0x66] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x67] uid[0x67] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x68] uid[0x68] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x69] uid[0x69] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x6a] uid[0x6a] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x6b] uid[0x6b] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x6c] uid[0x6c] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x6d] uid[0x6d] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x6e] uid[0x6e] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x6f] uid[0x6f] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x70] uid[0x70] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x71] uid[0x71] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x72] uid[0x72] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x73] uid[0x73] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x74] uid[0x74] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x75] uid[0x75] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x76] uid[0x76] disabled) [ 0.000000] ACPI: X2APIC (apic_id[0x77] uid[0x77] disabled) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) [ 0.000000] ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0]) [ 0.000000] IOAPIC[0]: apic_id 0, version 32, address 0xfec00000, GSI 0-23 [ 0.000000] ACPI: IOAPIC (id[0x01] address[0xfec3f000] gsi_base[24]) [ 0.000000] IOAPIC[1]: apic_id 1, version 32, address 0xfec3f000, GSI 24-47 [ 0.000000] ACPI: IOAPIC (id[0x02] address[0xfec7f000] gsi_base[48]) [ 0.000000] IOAPIC[2]: apic_id 2, version 32, address 0xfec7f000, GSI 48-71 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.000000] ACPI: IRQ0 used by override. [ 0.000000] ACPI: IRQ9 used by override. [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.000000] smpboot: Allowing 240 CPUs, 208 hotplug CPUs [ 0.000000] PM: Registered nosave memory: [mem 0x0008f000-0x0009ffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000dffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.000000] PM: Registered nosave memory: [mem 0xbb3c7000-0xbdd2efff] [ 0.000000] PM: Registered nosave memory: [mem 0xbdd2f000-0xbddccfff] [ 0.000000] PM: Registered nosave memory: [mem 0xbddcd000-0xbdea0fff] [ 0.000000] PM: Registered nosave memory: [mem 0xbdea1000-0xbdf2efff] [ 0.000000] PM: Registered nosave memory: [mem 0xbdf2f000-0xbdfabfff] [ 0.000000] PM: Registered nosave memory: [mem 0xbe000000-0xcfffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xd0000000-0xfebfffff] [ 0.000000] PM: Registered nosave memory: [mem 0xfec00000-0xfec00fff] [ 0.000000] PM: Registered nosave memory: [mem 0xfec01000-0xfed18fff] [ 0.000000] PM: Registered nosave memory: [mem 0xfed19000-0xfed19fff] [ 0.000000] PM: Registered nosave memory: [mem 0xfed1a000-0xfed1bfff] [ 0.000000] PM: Registered nosave memory: [mem 0xfed1c000-0xfed1ffff] [ 0.000000] PM: Registered nosave memory: [mem 0xfed20000-0xfedfffff] [ 0.000000] PM: Registered nosave memory: [mem 0xfee00000-0xfee00fff] [ 0.000000] PM: Registered nosave memory: [mem 0xfee01000-0xffa1ffff] [ 0.000000] PM: Registered nosave memory: [mem 0xffa20000-0xffffffff] [ 0.000000] e820: [mem 0xd0000000-0xfebfffff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on bare hardware [ 0.000000] setup_percpu: NR_CPUS:5120 nr_cpumask_bits:240 nr_cpu_ids:240 nr_node_ids:2 [ 0.000000] PERCPU: Embedded 35 pages/cpu @ffff88042e000000 s104536 r8192 d30632 u262144 [ 0.000000] pcpu-alloc: s104536 r8192 d30632 u262144 alloc=1*2097152 [ 0.000000] pcpu-alloc: [0] 000 001 002 003 004 005 006 007 [ 0.000000] pcpu-alloc: [0] 016 017 018 019 020 021 022 023 [ 0.000000] pcpu-alloc: [0] 032 034 036 038 040 042 044 046 [ 0.000000] pcpu-alloc: [0] 048 050 052 054 056 058 060 062 [ 0.000000] pcpu-alloc: [0] 064 066 068 070 072 074 076 078 [ 0.000000] pcpu-alloc: [0] 080 082 084 086 088 090 092 094 [ 0.000000] pcpu-alloc: [0] 096 098 100 102 104 106 108 110 [ 0.000000] pcpu-alloc: [0] 112 114 116 118 120 122 124 126 [ 0.000000] pcpu-alloc: [0] 128 130 132 134 136 138 140 142 [ 0.000000] pcpu-alloc: [0] 144 146 148 150 152 154 156 158 [ 0.000000] pcpu-alloc: [0] 160 162 164 166 168 170 172 174 [ 0.000000] pcpu-alloc: [0] 176 178 180 182 184 186 188 190 [ 0.000000] pcpu-alloc: [0] 192 194 196 198 200 202 204 206 [ 0.000000] pcpu-alloc: [0] 208 210 212 214 216 218 220 222 [ 0.000000] pcpu-alloc: [0] 224 226 228 230 232 234 236 238 [ 0.000000] pcpu-alloc: [1] 008 009 010 011 012 013 014 015 [ 0.000000] pcpu-alloc: [1] 024 025 026 027 028 029 030 031 [ 0.000000] pcpu-alloc: [1] 033 035 037 039 041 043 045 047 [ 0.000000] pcpu-alloc: [1] 049 051 053 055 057 059 061 063 [ 0.000000] pcpu-alloc: [1] 065 067 069 071 073 075 077 079 [ 0.000000] pcpu-alloc: [1] 081 083 085 087 089 091 093 095 [ 0.000000] pcpu-alloc: [1] 097 099 101 103 105 107 109 111 [ 0.000000] pcpu-alloc: [1] 113 115 117 119 121 123 125 127 [ 0.000000] pcpu-alloc: [1] 129 131 133 135 137 139 141 143 [ 0.000000] pcpu-alloc: [1] 145 147 149 151 153 155 157 159 [ 0.000000] pcpu-alloc: [1] 161 163 165 167 169 171 173 175 [ 0.000000] pcpu-alloc: [1] 177 179 181 183 185 187 189 191 [ 0.000000] pcpu-alloc: [1] 193 195 197 199 201 203 205 207 [ 0.000000] pcpu-alloc: [1] 209 211 213 215 217 219 221 223 [ 0.000000] pcpu-alloc: [1] 225 227 229 231 233 235 237 239 [ 0.000000] Built 2 zonelists in Zone order, mobility grouping on. Total pages: 8238275 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-3.10.0-693.11.6.el7_lustre.x86_64 root=UUID=4dfe900a-c2ad-4424-b141-9a27a9c3d15c ro crashkernel=320M console=tty0 LANG=en_US.UTF-8 console=ttyS0,115200 net.ifnames=0 [ 0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes) [ 0.000000] x86/fpu: xstate_offset[2]: 0240, xstate_sizes[2]: 0100 [ 0.000000] xsave: enabled xstate_bv 0x7, cntxt size 0x340 using standard form [ 0.000000] Memory: 6833444k/34603008k available (6916k kernel code, 1126748k absent, 987480k reserved, 4551k data, 1800k init) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=240, Nodes=2 [ 0.000000] x86/pti: Unmapping kernel while in userspace [ 0.000000] Hierarchical RCU implementation. [ 0.000000] RCU restricting CPUs from NR_CPUS=5120 to nr_cpu_ids=240. [ 0.000000] NR_IRQS:327936 nr_irqs:3160 0 [ 0.000000] Console: colour VGA+ 80x25 [ 0.000000] console [tty0] enabled [ 0.000000] console [ttyS0] enabled [ 0.000000] allocated 134217728 bytes of page_cgroup [ 0.000000] please try 'cgroup_disable=memory' option if you don't want memory cgroups [ 0.000000] Enabling automatic NUMA balancing. Configure with numa_balancing= or the kernel.numa_balancing sysctl [ 0.000000] hpet clockevent registered [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 2693.371 MHz processor [ 0.000109] Calibrating delay loop (skipped), value calculated using timer frequency.. 5386.74 BogoMIPS (lpj=2693371) [ 0.012540] pid_max: default: 245760 minimum: 1920 [ 0.018828] Security Framework initialized [ 0.023691] SELinux: Initializing. [ 0.027939] SELinux: Starting in permissive mode [ 0.027940] Yama: becoming mindful. [ 0.034578] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes) [ 0.049867] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes) [ 0.061280] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes) [ 0.069286] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes) [ 0.079870] Initializing cgroup subsys memory [ 0.085068] Initializing cgroup subsys devices [ 0.090321] Initializing cgroup subsys freezer [ 0.095566] Initializing cgroup subsys net_cls [ 0.100811] Initializing cgroup subsys blkio [ 0.105857] Initializing cgroup subsys perf_event [ 0.111427] Initializing cgroup subsys hugetlb [ 0.116671] Initializing cgroup subsys pids [ 0.121621] Initializing cgroup subsys net_prio [ 0.127114] CPU: Physical Processor ID: 0 [ 0.131871] CPU: Processor Core ID: 0 [ 0.136245] FEATURE SPEC_CTRL Not Present [ 0.141148] FEATURE IBPB_SUPPORT Not Present [ 0.146198] mce: CPU supports 20 MCE banks [ 0.151068] CPU0: Thermal monitoring enabled (TM1) [ 0.156732] Last level iTLB entries: 4KB 512, 2MB 0, 4MB 0 [ 0.163141] Last level dTLB entries: 4KB 512, 2MB 32, 4MB 32 [ 0.169748] tlb_flushall_shift: 6 [ 0.173899] Freeing SMP alternatives: 24k freed [ 0.181725] ACPI: Core revision 20130517 [ 0.223729] ACPI: All ACPI Tables successfully acquired [ 0.270191] ftrace: allocating 26619 entries in 104 pages [ 0.289284] smpboot: Max logical packages: 30 [ 0.295081] IRQ remapping doesn't support X2APIC mode, disable x2apic. [ 0.302735] Switched APIC routing to physical flat. [ 0.309079] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.326071] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2680 0 @ 2.70GHz (fam: 06, model: 2d, stepping: 07) [ 0.337206] TSC deadline timer enabled [ 0.337237] Performance Events: PEBS fmt1+, 16-deep LBR, SandyBridge events, full-width counters, Intel PMU driver. [ 0.349798] ... version: 3 [ 0.354548] ... bit width: 48 [ 0.359398] ... generic registers: 4 [ 0.364149] ... value mask: 0000ffffffffffff [ 0.370357] ... max period: 00007fffffffffff [ 0.381141] ... fixed-purpose events: 3 [ 0.385886] ... event mask: 000000070000000f [ 0.412533] NMI watchdog: enabled on all CPUs, permanently consumes one hw-PMU counter. [ 0.396722] smpboot: Booting Node 0, Processors #1 #2 #3 #4 #5 #6 #7 OK [ 0.449880] smpboot: Booting Node 1, Processors #8 #9 #10 #11 #12 #13 #14 #15 OK [ 0.576334] smpboot: Booting Node 0, Processors #16 #17 #18 #19 #20 #21 #22 #23 OK [ 0.611323] smpboot: Booting Node 1, Processors #24 #25 #26 #27 #28 #29 #30 #31 [ 0.651797] Brought up 32 CPUs [ 0.655956] smpboot: Total of 32 processors activated (172455.29 BogoMIPS) [ 0.778416] node 0 initialised, 2813731 pages in 59ms [ 0.794881] node 1 initialised, 3600099 pages in 70ms [ 0.802094] devtmpfs: initialized [ 0.815175] EVM: security.selinux [ 0.819166] EVM: security.ima [ 0.822766] EVM: security.capability [ 0.827318] PM: Registering ACPI NVS region [mem 0xbdd2f000-0xbddccfff] (647168 bytes) [ 0.836695] PM: Registering ACPI NVS region [mem 0xbdea1000-0xbdf2efff] (581632 bytes) [ 0.848532] atomic64 test passed for x86-64 platform with CX8 and with SSE [ 0.856514] pinctrl core: initialized pinctrl subsystem [ 0.862917] RTC time: 19:22:57, date: 02/07/18 [ 0.868674] NET: Registered protocol family 16 [ 0.874395] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 0.883352] ACPI: bus type PCI registered [ 0.888123] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.896229] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0xc0000000-0xcfffffff] (base 0xc0000000) [ 0.907134] PCI: MMCONFIG at [mem 0xc0000000-0xcfffffff] reserved in E820 [ 0.915046] PCI: Using configuration type 1 for base access [ 0.921625] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on [ 0.939927] ACPI: Added _OSI(Module Device) [ 0.944896] ACPI: Added _OSI(Processor Device) [ 0.950149] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.955692] ACPI: Added _OSI(Processor Aggregator Device) [ 0.979954] ACPI: EC: Look up EC in DSDT [ 0.998325] ACPI: Executed 1 blocks of module-level executable AML code [ 1.270092] [Firmware Bug]: ACPI: BIOS _OSI(Linux) query ignored [ 1.301093] ACPI: Interpreter enabled [ 1.305506] ACPI: (supports S0 S1 S5) [ 1.309884] ACPI: Using IOAPIC for interrupt routing [ 1.315820] HEST: Table parsing has been initialized. [ 1.321759] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 1.385326] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-7e]) [ 1.392540] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI] [ 1.402679] acpi PNP0A08:00: _OSC: platform does not support [AER] [ 1.410271] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.419331] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.429239] acpi PNP0A08:00: ignoring host bridge window [mem 0x000cc000-0x000cffff window] (conflicts with Adapter ROM [mem 0x000c8000-0x000cdbff]) [ 1.444618] acpi PNP0A08:00: ignoring host bridge window [mem 0x000d4000-0x000d7fff window] (conflicts with Adapter ROM [mem 0x000ce000-0x000d7bff]) [ 1.460364] PCI host bridge to bus 0000:00 [ 1.465231] pci_bus 0000:00: root bus resource [bus 00-7e] [ 1.471656] pci_bus 0000:00: root bus resource [io 0x0000-0xbfff window] [ 1.479536] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 1.488400] pci_bus 0000:00: root bus resource [mem 0x000c0000-0x000c3fff window] [ 1.497260] pci_bus 0000:00: root bus resource [mem 0x000c4000-0x000c7fff window] [ 1.506120] pci_bus 0000:00: root bus resource [mem 0x000c8000-0x000cbfff window] [ 1.514977] pci_bus 0000:00: root bus resource [mem 0x000d0000-0x000d3fff window] [ 1.523839] pci_bus 0000:00: root bus resource [mem 0x000d8000-0x000dbfff window] [ 1.532702] pci_bus 0000:00: root bus resource [mem 0x000dc000-0x000dffff window] [ 1.541563] pci_bus 0000:00: root bus resource [mem 0x000e0000-0x000e3fff window] [ 1.550426] pci_bus 0000:00: root bus resource [mem 0x000e4000-0x000e7fff window] [ 1.559290] pci_bus 0000:00: root bus resource [mem 0x000e8000-0x000ebfff window] [ 1.568149] pci_bus 0000:00: root bus resource [mem 0x000ec000-0x000effff window] [ 1.577011] pci_bus 0000:00: root bus resource [mem 0x000f0000-0x000fffff window] [ 1.585870] pci_bus 0000:00: root bus resource [mem 0xd0000000-0xebffffff window] [ 1.594728] pci_bus 0000:00: root bus resource [mem 0x380000000000-0x38007fffffff window] [ 1.604384] pci 0000:00:00.0: [8086:3c00] type 00 class 0x060000 [ 1.604482] pci 0000:00:00.0: PME# supported from D0 D3hot D3cold [ 1.604636] pci 0000:00:01.0: [8086:3c02] type 01 class 0x060400 [ 1.604737] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 1.604839] pci 0000:00:01.0: System wakeup disabled by ACPI [ 1.611513] pci 0000:00:01.1: [8086:3c03] type 01 class 0x060400 [ 1.611613] pci 0000:00:01.1: PME# supported from D0 D3hot D3cold [ 1.611712] pci 0000:00:01.1: System wakeup disabled by ACPI [ 1.618395] pci 0000:00:02.0: [8086:3c04] type 01 class 0x060400 [ 1.618497] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 1.618605] pci 0000:00:02.0: System wakeup disabled by ACPI [ 1.625273] pci 0000:00:02.2: [8086:3c06] type 01 class 0x060400 [ 1.625373] pci 0000:00:02.2: PME# supported from D0 D3hot D3cold [ 1.625479] pci 0000:00:02.2: System wakeup disabled by ACPI [ 1.632160] pci 0000:00:03.0: [8086:3c08] type 01 class 0x060400 [ 1.632260] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 1.632358] pci 0000:00:03.0: System wakeup disabled by ACPI [ 1.639035] pci 0000:00:04.0: [8086:3c20] type 00 class 0x088000 [ 1.639059] pci 0000:00:04.0: reg 0x10: [mem 0xebf90000-0xebf93fff 64bit] [ 1.639260] pci 0000:00:04.1: [8086:3c21] type 00 class 0x088000 [ 1.639282] pci 0000:00:04.1: reg 0x10: [mem 0xebf80000-0xebf83fff 64bit] [ 1.639477] pci 0000:00:04.2: [8086:3c22] type 00 class 0x088000 [ 1.639498] pci 0000:00:04.2: reg 0x10: [mem 0xebf70000-0xebf73fff 64bit] [ 1.639697] pci 0000:00:04.3: [8086:3c23] type 00 class 0x088000 [ 1.639719] pci 0000:00:04.3: reg 0x10: [mem 0xebf60000-0xebf63fff 64bit] [ 1.639915] pci 0000:00:04.4: [8086:3c24] type 00 class 0x088000 [ 1.639937] pci 0000:00:04.4: reg 0x10: [mem 0xebf50000-0xebf53fff 64bit] [ 1.640141] pci 0000:00:04.5: [8086:3c25] type 00 class 0x088000 [ 1.640163] pci 0000:00:04.5: reg 0x10: [mem 0xebf40000-0xebf43fff 64bit] [ 1.640353] pci 0000:00:04.6: [8086:3c26] type 00 class 0x088000 [ 1.640375] pci 0000:00:04.6: reg 0x10: [mem 0xebf30000-0xebf33fff 64bit] [ 1.640574] pci 0000:00:04.7: [8086:3c27] type 00 class 0x088000 [ 1.640596] pci 0000:00:04.7: reg 0x10: [mem 0xebf20000-0xebf23fff 64bit] [ 1.640792] pci 0000:00:05.0: [8086:3c28] type 00 class 0x088000 [ 1.640978] pci 0000:00:05.2: [8086:3c2a] type 00 class 0x088000 [ 1.641166] pci 0000:00:05.4: [8086:3c2c] type 00 class 0x080020 [ 1.641184] pci 0000:00:05.4: reg 0x10: [mem 0xd0f60000-0xd0f60fff] [ 1.641385] pci 0000:00:11.0: [8086:1d3e] type 01 class 0x060400 [ 1.641504] pci 0000:00:11.0: PME# supported from D0 D3hot D3cold [ 1.641661] pci 0000:00:16.0: [8086:1d3a] type 00 class 0x078000 [ 1.641687] pci 0000:00:16.0: reg 0x10: [mem 0xd0f50000-0xd0f5000f 64bit] [ 1.641774] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 1.641908] pci 0000:00:16.1: [8086:1d3b] type 00 class 0x078000 [ 1.641934] pci 0000:00:16.1: reg 0x10: [mem 0xd0f40000-0xd0f4000f 64bit] [ 1.642025] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 1.642166] pci 0000:00:1a.0: [8086:1d2d] type 00 class 0x0c0320 [ 1.642190] pci 0000:00:1a.0: reg 0x10: [mem 0xd0f20000-0xd0f203ff] [ 1.642300] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 1.642415] pci 0000:00:1a.0: System wakeup disabled by ACPI [ 1.649090] pci 0000:00:1c.0: [8086:1d10] type 01 class 0x060400 [ 1.649225] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 1.649325] pci 0000:00:1c.0: System wakeup disabled by ACPI [ 1.656005] pci 0000:00:1c.7: [8086:1d1e] type 01 class 0x060400 [ 1.656108] pci 0000:00:1c.7: PME# supported from D0 D3hot D3cold [ 1.656207] pci 0000:00:1c.7: System wakeup disabled by ACPI [ 1.662872] pci 0000:00:1d.0: [8086:1d26] type 00 class 0x0c0320 [ 1.662897] pci 0000:00:1d.0: reg 0x10: [mem 0xd0f10000-0xd0f103ff] [ 1.663008] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 1.663120] pci 0000:00:1d.0: System wakeup disabled by ACPI [ 1.669789] pci 0000:00:1e.0: [8086:244e] type 01 class 0x060401 [ 1.669938] pci 0000:00:1e.0: System wakeup disabled by ACPI [ 1.676606] pci 0000:00:1f.0: [8086:1d41] type 00 class 0x060100 [ 1.676864] pci 0000:00:1f.2: [8086:1d02] type 00 class 0x010601 [ 1.676887] pci 0000:00:1f.2: reg 0x10: [io 0x4070-0x4077] [ 1.676898] pci 0000:00:1f.2: reg 0x14: [io 0x4060-0x4063] [ 1.676910] pci 0000:00:1f.2: reg 0x18: [io 0x4050-0x4057] [ 1.676921] pci 0000:00:1f.2: reg 0x1c: [io 0x4040-0x4043] [ 1.676933] pci 0000:00:1f.2: reg 0x20: [io 0x4020-0x403f] [ 1.676945] pci 0000:00:1f.2: reg 0x24: [mem 0xd0f00000-0xd0f007ff] [ 1.677003] pci 0000:00:1f.2: PME# supported from D3hot [ 1.677128] pci 0000:00:1f.3: [8086:1d22] type 00 class 0x0c0500 [ 1.677149] pci 0000:00:1f.3: reg 0x10: [mem 0xebf10000-0xebf100ff 64bit] [ 1.677178] pci 0000:00:1f.3: reg 0x20: [io 0x4000-0x401f] [ 1.677405] pci 0000:00:01.0: PCI bridge to [bus 01] [ 1.683400] acpiphp: Slot [2] registered [ 1.688131] pci 0000:02:00.0: [8086:1521] type 00 class 0x020000 [ 1.688149] pci 0000:02:00.0: reg 0x10: [mem 0xd0b60000-0xd0b7ffff] [ 1.688168] pci 0000:02:00.0: reg 0x18: [io 0x3060-0x307f] [ 1.688180] pci 0000:02:00.0: reg 0x1c: [mem 0xd0bb0000-0xd0bb3fff] [ 1.688311] pci 0000:02:00.0: PME# supported from D0 D3hot D3cold [ 1.688344] pci 0000:02:00.0: reg 0x184: [mem 0xd0ca0000-0xd0ca3fff] [ 1.688348] pci 0000:02:00.0: VF(n) BAR0 space: [mem 0xd0ca0000-0xd0cbffff] (contains BAR0 for 8 VFs) [ 1.699177] pci 0000:02:00.0: reg 0x190: [mem 0xd0c80000-0xd0c83fff] [ 1.699181] pci 0000:02:00.0: VF(n) BAR3 space: [mem 0xd0c80000-0xd0c9ffff] (contains BAR3 for 8 VFs) [ 1.710132] pci 0000:02:00.1: [8086:1521] type 00 class 0x020000 [ 1.710150] pci 0000:02:00.1: reg 0x10: [mem 0xd0b40000-0xd0b5ffff] [ 1.710169] pci 0000:02:00.1: reg 0x18: [io 0x3040-0x305f] [ 1.710181] pci 0000:02:00.1: reg 0x1c: [mem 0xd0ba0000-0xd0ba3fff] [ 1.710291] pci 0000:02:00.1: PME# supported from D0 D3hot D3cold [ 1.710318] pci 0000:02:00.1: reg 0x184: [mem 0xd0c60000-0xd0c63fff] [ 1.710322] pci 0000:02:00.1: VF(n) BAR0 space: [mem 0xd0c60000-0xd0c7ffff] (contains BAR0 for 8 VFs) [ 1.721150] pci 0000:02:00.1: reg 0x190: [mem 0xd0c40000-0xd0c43fff] [ 1.721154] pci 0000:02:00.1: VF(n) BAR3 space: [mem 0xd0c40000-0xd0c5ffff] (contains BAR3 for 8 VFs) [ 1.732097] pci 0000:02:00.2: [8086:1521] type 00 class 0x020000 [ 1.732114] pci 0000:02:00.2: reg 0x10: [mem 0xd0b20000-0xd0b3ffff] [ 1.732133] pci 0000:02:00.2: reg 0x18: [io 0x3020-0x303f] [ 1.732145] pci 0000:02:00.2: reg 0x1c: [mem 0xd0b90000-0xd0b93fff] [ 1.732255] pci 0000:02:00.2: PME# supported from D0 D3hot D3cold [ 1.732281] pci 0000:02:00.2: reg 0x184: [mem 0xd0c20000-0xd0c23fff] [ 1.732285] pci 0000:02:00.2: VF(n) BAR0 space: [mem 0xd0c20000-0xd0c3ffff] (contains BAR0 for 8 VFs) [ 1.743112] pci 0000:02:00.2: reg 0x190: [mem 0xd0c00000-0xd0c03fff] [ 1.743116] pci 0000:02:00.2: VF(n) BAR3 space: [mem 0xd0c00000-0xd0c1ffff] (contains BAR3 for 8 VFs) [ 1.754049] pci 0000:02:00.3: [8086:1521] type 00 class 0x020000 [ 1.754067] pci 0000:02:00.3: reg 0x10: [mem 0xd0b00000-0xd0b1ffff] [ 1.754086] pci 0000:02:00.3: reg 0x18: [io 0x3000-0x301f] [ 1.754097] pci 0000:02:00.3: reg 0x1c: [mem 0xd0b80000-0xd0b83fff] [ 1.754206] pci 0000:02:00.3: PME# supported from D0 D3hot D3cold [ 1.754233] pci 0000:02:00.3: reg 0x184: [mem 0xd0be0000-0xd0be3fff] [ 1.754236] pci 0000:02:00.3: VF(n) BAR0 space: [mem 0xd0be0000-0xd0bfffff] (contains BAR0 for 8 VFs) [ 1.765060] pci 0000:02:00.3: reg 0x190: [mem 0xd0bc0000-0xd0bc3fff] [ 1.765064] pci 0000:02:00.3: VF(n) BAR3 space: [mem 0xd0bc0000-0xd0bdffff] (contains BAR3 for 8 VFs) [ 1.777894] pci 0000:00:01.1: PCI bridge to [bus 02-03] [ 1.784028] pci 0000:00:01.1: bridge window [io 0x3000-0x3fff] [ 1.784034] pci 0000:00:01.1: bridge window [mem 0xd0b00000-0xd0cfffff] [ 1.784197] acpiphp: Slot [2-2] registered [ 1.789335] pci 0000:04:00.0: [15b3:1003] type 00 class 0x028000 [ 1.789613] pci 0000:04:00.0: reg 0x10: [mem 0xd0e00000-0xd0efffff 64bit] [ 1.789815] pci 0000:04:00.0: reg 0x18: [mem 0xeb000000-0xeb7fffff 64bit pref] [ 1.791551] pci 0000:00:02.0: PCI bridge to [bus 04] [ 1.797394] pci 0000:00:02.0: bridge window [mem 0xd0e00000-0xd0efffff] [ 1.797403] pci 0000:00:02.0: bridge window [mem 0xeb000000-0xeb7fffff 64bit pref] [ 1.797560] acpiphp: Slot [2-3] registered [ 1.802471] pci 0000:00:02.2: PCI bridge to [bus 05] [ 1.808454] acpiphp: Slot [2-4] registered [ 1.813369] pci 0000:06:00.0: [1000:0087] type 00 class 0x010700 [ 1.813385] pci 0000:06:00.0: reg 0x10: [io 0x2000-0x20ff] [ 1.813399] pci 0000:06:00.0: reg 0x14: [mem 0xd0a40000-0xd0a4ffff 64bit] [ 1.813413] pci 0000:06:00.0: reg 0x1c: [mem 0xd0a00000-0xd0a3ffff 64bit] [ 1.813430] pci 0000:06:00.0: reg 0x30: [mem 0xd0900000-0xd09fffff pref] [ 1.813507] pci 0000:06:00.0: supports D1 D2 [ 1.816338] pci 0000:00:03.0: PCI bridge to [bus 06] [ 1.822182] pci 0000:00:03.0: bridge window [io 0x2000-0x2fff] [ 1.822187] pci 0000:00:03.0: bridge window [mem 0xd0900000-0xd0afffff] [ 1.822303] pci 0000:07:00.0: [8086:1d6b] type 00 class 0x010700 [ 1.822332] pci 0000:07:00.0: reg 0x10: [mem 0xebc00000-0xebc03fff 64bit pref] [ 1.822352] pci 0000:07:00.0: reg 0x18: [mem 0xeb800000-0xebbfffff 64bit pref] [ 1.822366] pci 0000:07:00.0: reg 0x20: [io 0x1000-0x10ff] [ 1.822502] pci 0000:07:00.0: reg 0x164: [mem 0xebc10000-0xebc13fff 64bit pref] [ 1.822506] pci 0000:07:00.0: VF(n) BAR0 space: [mem 0xebc10000-0xebc8bfff 64bit pref] (contains BAR0 for 31 VFs) [ 1.834706] pci 0000:07:00.3: [8086:1d70] type 00 class 0x0c0500 [ 1.834730] pci 0000:07:00.3: reg 0x10: [mem 0xd0d00000-0xd0d00fff] [ 1.834781] pci 0000:07:00.3: reg 0x20: [io 0x1100-0x111f] [ 1.834878] pci 0000:07:00.3: PME# supported from D0 D3hot D3cold [ 1.834981] pci 0000:00:11.0: PCI bridge to [bus 07] [ 1.840823] pci 0000:00:11.0: bridge window [io 0x1000-0x1fff] [ 1.840830] pci 0000:00:11.0: bridge window [mem 0xd0d00000-0xd0dfffff] [ 1.840840] pci 0000:00:11.0: bridge window [mem 0xeb800000-0xebcfffff 64bit pref] [ 1.840934] pci 0000:00:1c.0: PCI bridge to [bus 08] [ 1.846887] pci 0000:09:00.0: [102b:0522] type 00 class 0x030000 [ 1.846922] pci 0000:09:00.0: reg 0x10: [mem 0xea000000-0xeaffffff pref] [ 1.846942] pci 0000:09:00.0: reg 0x14: [mem 0xd0810000-0xd0813fff] [ 1.846963] pci 0000:09:00.0: reg 0x18: [mem 0xd0000000-0xd07fffff] [ 1.847036] pci 0000:09:00.0: reg 0x30: [mem 0xd0800000-0xd080ffff pref] [ 1.847174] pci 0000:09:00.0: System wakeup disabled by ACPI [ 1.855812] pci 0000:00:1c.7: PCI bridge to [bus 09] [ 1.861659] pci 0000:00:1c.7: bridge window [mem 0xd0000000-0xd08fffff] [ 1.861667] pci 0000:00:1c.7: bridge window [mem 0xea000000-0xeaffffff 64bit pref] [ 1.861780] pci 0000:00:1e.0: PCI bridge to [bus 0a] (subtractive decode) [ 1.869673] pci 0000:00:1e.0: bridge window [io 0x0000-0xbfff window] (subtractive decode) [ 1.869677] pci 0000:00:1e.0: bridge window [mem 0x000a0000-0x000bffff window] (subtractive decode) [ 1.869680] pci 0000:00:1e.0: bridge window [mem 0x000c0000-0x000c3fff window] (subtractive decode) [ 1.869684] pci 0000:00:1e.0: bridge window [mem 0x000c4000-0x000c7fff window] (subtractive decode) [ 1.869687] pci 0000:00:1e.0: bridge window [mem 0x000c8000-0x000cbfff window] (subtractive decode) [ 1.869690] pci 0000:00:1e.0: bridge window [mem 0x000d0000-0x000d3fff window] (subtractive decode) [ 1.869693] pci 0000:00:1e.0: bridge window [mem 0x000d8000-0x000dbfff window] (subtractive decode) [ 1.869697] pci 0000:00:1e.0: bridge window [mem 0x000dc000-0x000dffff window] (subtractive decode) [ 1.869700] pci 0000:00:1e.0: bridge window [mem 0x000e0000-0x000e3fff window] (subtractive decode) [ 1.869703] pci 0000:00:1e.0: bridge window [mem 0x000e4000-0x000e7fff window] (subtractive decode) [ 1.869706] pci 0000:00:1e.0: bridge window [mem 0x000e8000-0x000ebfff window] (subtractive decode) [ 1.869719] pci 0000:00:1e.0: bridge window [mem 0x000ec000-0x000effff window] (subtractive decode) [ 1.869722] pci 0000:00:1e.0: bridge window [mem 0x000f0000-0x000fffff window] (subtractive decode) [ 1.869725] pci 0000:00:1e.0: bridge window [mem 0xd0000000-0xebffffff window] (subtractive decode) [ 1.869729] pci 0000:00:1e.0: bridge window [mem 0x380000000000-0x38007fffffff window] (subtractive decode) [ 1.869807] pci_bus 0000:00: on NUMA node 0 [ 1.870979] ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 10 *11 12 14 15) [ 1.879997] ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 *10 11 12 14 15) [ 1.889008] ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 *5 6 10 11 12 14 15) [ 1.898026] ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 10 *11 12 14 15) [ 1.907017] ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 *5 6 10 11 12 14 15) [ 1.916015] ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 10 *11 12 14 15) [ 1.925027] ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 *10 11 12 14 15) [ 1.934030] ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 *10 11 12 14 15) [ 1.943212] ACPI: PCI Root Bridge [PCI1] (domain 0000 [bus 80-fe]) [ 1.950420] acpi PNP0A08:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI] [ 1.960315] acpi PNP0A08:01: _OSC: platform does not support [AER] [ 1.967760] acpi PNP0A08:01: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.976815] acpi PNP0A08:01: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.986856] PCI host bridge to bus 0000:80 [ 1.991723] pci_bus 0000:80: root bus resource [bus 80-fe] [ 1.998145] pci_bus 0000:80: root bus resource [io 0x03b0-0x03df window] [ 2.006024] pci_bus 0000:80: root bus resource [io 0xc000-0xffff window] [ 2.013902] pci_bus 0000:80: root bus resource [mem 0x000a0000-0x000bffff window] [ 2.022766] pci_bus 0000:80: root bus resource [mem 0xec000000-0xfbffffff window] [ 2.031627] pci_bus 0000:80: root bus resource [mem 0x380080000000-0x3800ffffffff window] [ 2.041286] pci 0000:80:01.0: [8086:3c02] type 01 class 0x060400 [ 2.041397] pci 0000:80:01.0: PME# supported from D0 D3hot D3cold [ 2.041465] pci 0000:80:01.0: System wakeup disabled by ACPI [ 2.048154] pci 0000:80:02.0: [8086:3c04] type 01 class 0x060400 [ 2.048261] pci 0000:80:02.0: PME# supported from D0 D3hot D3cold [ 2.048326] pci 0000:80:02.0: System wakeup disabled by ACPI [ 2.055001] pci 0000:80:03.0: [8086:3c08] type 01 class 0x060400 [ 2.055107] pci 0000:80:03.0: PME# supported from D0 D3hot D3cold [ 2.055175] pci 0000:80:03.0: System wakeup disabled by ACPI [ 2.061846] pci 0000:80:03.2: [8086:3c0a] type 01 class 0x060400 [ 2.061952] pci 0000:80:03.2: PME# supported from D0 D3hot D3cold [ 2.062022] pci 0000:80:03.2: System wakeup disabled by ACPI [ 2.068695] pci 0000:80:04.0: [8086:3c20] type 00 class 0x088000 [ 2.068719] pci 0000:80:04.0: reg 0x10: [mem 0xfbf70000-0xfbf73fff 64bit] [ 2.068891] pci 0000:80:04.1: [8086:3c21] type 00 class 0x088000 [ 2.068916] pci 0000:80:04.1: reg 0x10: [mem 0xfbf60000-0xfbf63fff 64bit] [ 2.069087] pci 0000:80:04.2: [8086:3c22] type 00 class 0x088000 [ 2.069110] pci 0000:80:04.2: reg 0x10: [mem 0xfbf50000-0xfbf53fff 64bit] [ 2.069275] pci 0000:80:04.3: [8086:3c23] type 00 class 0x088000 [ 2.069298] pci 0000:80:04.3: reg 0x10: [mem 0xfbf40000-0xfbf43fff 64bit] [ 2.069462] pci 0000:80:04.4: [8086:3c24] type 00 class 0x088000 [ 2.069485] pci 0000:80:04.4: reg 0x10: [mem 0xfbf30000-0xfbf33fff 64bit] [ 2.069665] pci 0000:80:04.5: [8086:3c25] type 00 class 0x088000 [ 2.069689] pci 0000:80:04.5: reg 0x10: [mem 0xfbf20000-0xfbf23fff 64bit] [ 2.069860] pci 0000:80:04.6: [8086:3c26] type 00 class 0x088000 [ 2.069883] pci 0000:80:04.6: reg 0x10: [mem 0xfbf10000-0xfbf13fff 64bit] [ 2.070050] pci 0000:80:04.7: [8086:3c27] type 00 class 0x088000 [ 2.070073] pci 0000:80:04.7: reg 0x10: [mem 0xfbf00000-0xfbf03fff 64bit] [ 2.070235] pci 0000:80:05.0: [8086:3c28] type 00 class 0x088000 [ 2.070389] pci 0000:80:05.2: [8086:3c2a] type 00 class 0x088000 [ 2.070542] pci 0000:80:05.4: [8086:3c2c] type 00 class 0x080020 [ 2.070560] pci 0000:80:05.4: reg 0x10: [mem 0xec000000-0xec000fff] [ 2.070809] pci 0000:80:01.0: PCI bridge to [bus 81] [ 2.076732] pci 0000:80:02.0: PCI bridge to [bus 82] [ 2.082647] pci 0000:80:03.0: PCI bridge to [bus 83] [ 2.088549] pci 0000:80:03.2: PCI bridge to [bus 84] [ 2.094432] pci_bus 0000:80: on NUMA node 1 [ 2.104399] ACPI: PCI Root Bridge [UCR0] (domain 0000 [bus 7f]) [ 2.111316] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI] [ 2.121014] acpi PNP0A03:00: _OSC: platform does not support [PCIeHotplug PME AER] [ 2.130019] acpi PNP0A03:00: _OSC: OS now controls [PCIeCapability] [ 2.137314] acpi PNP0A03:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 2.147057] PCI host bridge to bus 0000:7f [ 2.151924] pci_bus 0000:7f: root bus resource [bus 7f] [ 2.158071] pci 0000:7f:08.0: [8086:3c80] type 00 class 0x088000 [ 2.158173] pci 0000:7f:09.0: [8086:3c90] type 00 class 0x088000 [ 2.158264] pci 0000:7f:0a.0: [8086:3cc0] type 00 class 0x088000 [ 2.158347] pci 0000:7f:0a.1: [8086:3cc1] type 00 class 0x088000 [ 2.158426] pci 0000:7f:0a.2: [8086:3cc2] type 00 class 0x088000 [ 2.158503] pci 0000:7f:0a.3: [8086:3cd0] type 00 class 0x088000 [ 2.158583] pci 0000:7f:0b.0: [8086:3ce0] type 00 class 0x088000 [ 2.158662] pci 0000:7f:0b.3: [8086:3ce3] type 00 class 0x088000 [ 2.158742] pci 0000:7f:0c.0: [8086:3ce8] type 00 class 0x088000 [ 2.158820] pci 0000:7f:0c.1: [8086:3ce8] type 00 class 0x088000 [ 2.158897] pci 0000:7f:0c.2: [8086:3ce8] type 00 class 0x088000 [ 2.158973] pci 0000:7f:0c.3: [8086:3ce8] type 00 class 0x088000 [ 2.159049] pci 0000:7f:0c.6: [8086:3cf4] type 00 class 0x088000 [ 2.159133] pci 0000:7f:0c.7: [8086:3cf6] type 00 class 0x088000 [ 2.159214] pci 0000:7f:0d.0: [8086:3ce8] type 00 class 0x088000 [ 2.159295] pci 0000:7f:0d.1: [8086:3ce8] type 00 class 0x088000 [ 2.159372] pci 0000:7f:0d.2: [8086:3ce8] type 00 class 0x088000 [ 2.159450] pci 0000:7f:0d.3: [8086:3ce8] type 00 class 0x088000 [ 2.159528] pci 0000:7f:0d.6: [8086:3cf5] type 00 class 0x088000 [ 2.159606] pci 0000:7f:0e.0: [8086:3ca0] type 00 class 0x088000 [ 2.159687] pci 0000:7f:0e.1: [8086:3c46] type 00 class 0x110100 [ 2.159778] pci 0000:7f:0f.0: [8086:3ca8] type 00 class 0x088000 [ 2.159878] pci 0000:7f:0f.1: [8086:3c71] type 00 class 0x088000 [ 2.159983] pci 0000:7f:0f.2: [8086:3caa] type 00 class 0x088000 [ 2.160088] pci 0000:7f:0f.3: [8086:3cab] type 00 class 0x088000 [ 2.160192] pci 0000:7f:0f.4: [8086:3cac] type 00 class 0x088000 [ 2.160291] pci 0000:7f:0f.5: [8086:3cad] type 00 class 0x088000 [ 2.160387] pci 0000:7f:0f.6: [8086:3cae] type 00 class 0x088000 [ 2.160482] pci 0000:7f:10.0: [8086:3cb0] type 00 class 0x088000 [ 2.160582] pci 0000:7f:10.1: [8086:3cb1] type 00 class 0x088000 [ 2.160682] pci 0000:7f:10.2: [8086:3cb2] type 00 class 0x088000 [ 2.160783] pci 0000:7f:10.3: [8086:3cb3] type 00 class 0x088000 [ 2.160882] pci 0000:7f:10.4: [8086:3cb4] type 00 class 0x088000 [ 2.160991] pci 0000:7f:10.5: [8086:3cb5] type 00 class 0x088000 [ 2.161097] pci 0000:7f:10.6: [8086:3cb6] type 00 class 0x088000 [ 2.161198] pci 0000:7f:10.7: [8086:3cb7] type 00 class 0x088000 [ 2.161295] pci 0000:7f:11.0: [8086:3cb8] type 00 class 0x088000 [ 2.161390] pci 0000:7f:13.0: [8086:3ce4] type 00 class 0x088000 [ 2.161468] pci 0000:7f:13.1: [8086:3c43] type 00 class 0x110100 [ 2.161553] pci 0000:7f:13.4: [8086:3ce6] type 00 class 0x110100 [ 2.161632] pci 0000:7f:13.5: [8086:3c44] type 00 class 0x110100 [ 2.161710] pci 0000:7f:13.6: [8086:3c45] type 00 class 0x088000 [ 2.161891] ACPI: PCI Root Bridge [UCR1] (domain 0000 [bus ff]) [ 2.168806] acpi PNP0A03:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI] [ 2.183162] acpi PNP0A03:01: _OSC: platform does not support [PCIeHotplug PME AER] [ 2.192160] acpi PNP0A03:01: _OSC: OS now controls [PCIeCapability] [ 2.199449] acpi PNP0A03:01: FADT indicates ASPM is unsupported, using BIOS configuration [ 2.209188] PCI host bridge to bus 0000:ff [ 2.214056] pci_bus 0000:ff: root bus resource [bus ff] [ 2.220200] pci 0000:ff:08.0: [8086:3c80] type 00 class 0x088000 [ 2.220300] pci 0000:ff:09.0: [8086:3c90] type 00 class 0x088000 [ 2.220400] pci 0000:ff:0a.0: [8086:3cc0] type 00 class 0x088000 [ 2.220482] pci 0000:ff:0a.1: [8086:3cc1] type 00 class 0x088000 [ 2.220569] pci 0000:ff:0a.2: [8086:3cc2] type 00 class 0x088000 [ 2.220650] pci 0000:ff:0a.3: [8086:3cd0] type 00 class 0x088000 [ 2.220735] pci 0000:ff:0b.0: [8086:3ce0] type 00 class 0x088000 [ 2.220816] pci 0000:ff:0b.3: [8086:3ce3] type 00 class 0x088000 [ 2.220896] pci 0000:ff:0c.0: [8086:3ce8] type 00 class 0x088000 [ 2.220971] pci 0000:ff:0c.1: [8086:3ce8] type 00 class 0x088000 [ 2.221050] pci 0000:ff:0c.2: [8086:3ce8] type 00 class 0x088000 [ 2.221129] pci 0000:ff:0c.3: [8086:3ce8] type 00 class 0x088000 [ 2.221218] pci 0000:ff:0c.6: [8086:3cf4] type 00 class 0x088000 [ 2.221303] pci 0000:ff:0c.7: [8086:3cf6] type 00 class 0x088000 [ 2.221389] pci 0000:ff:0d.0: [8086:3ce8] type 00 class 0x088000 [ 2.221471] pci 0000:ff:0d.1: [8086:3ce8] type 00 class 0x088000 [ 2.221550] pci 0000:ff:0d.2: [8086:3ce8] type 00 class 0x088000 [ 2.221629] pci 0000:ff:0d.3: [8086:3ce8] type 00 class 0x088000 [ 2.221711] pci 0000:ff:0d.6: [8086:3cf5] type 00 class 0x088000 [ 2.221794] pci 0000:ff:0e.0: [8086:3ca0] type 00 class 0x088000 [ 2.221879] pci 0000:ff:0e.1: [8086:3c46] type 00 class 0x110100 [ 2.221980] pci 0000:ff:0f.0: [8086:3ca8] type 00 class 0x088000 [ 2.222091] pci 0000:ff:0f.1: [8086:3c71] type 00 class 0x088000 [ 2.222202] pci 0000:ff:0f.2: [8086:3caa] type 00 class 0x088000 [ 2.222307] pci 0000:ff:0f.3: [8086:3cab] type 00 class 0x088000 [ 2.222416] pci 0000:ff:0f.4: [8086:3cac] type 00 class 0x088000 [ 2.222529] pci 0000:ff:0f.5: [8086:3cad] type 00 class 0x088000 [ 2.222626] pci 0000:ff:0f.6: [8086:3cae] type 00 class 0x088000 [ 2.222716] pci 0000:ff:10.0: [8086:3cb0] type 00 class 0x088000 [ 2.222823] pci 0000:ff:10.1: [8086:3cb1] type 00 class 0x088000 [ 2.222928] pci 0000:ff:10.2: [8086:3cb2] type 00 class 0x088000 [ 2.223037] pci 0000:ff:10.3: [8086:3cb3] type 00 class 0x088000 [ 2.223141] pci 0000:ff:10.4: [8086:3cb4] type 00 class 0x088000 [ 2.223251] pci 0000:ff:10.5: [8086:3cb5] type 00 class 0x088000 [ 2.223357] pci 0000:ff:10.6: [8086:3cb6] type 00 class 0x088000 [ 2.223467] pci 0000:ff:10.7: [8086:3cb7] type 00 class 0x088000 [ 2.223569] pci 0000:ff:11.0: [8086:3cb8] type 00 class 0x088000 [ 2.223668] pci 0000:ff:13.0: [8086:3ce4] type 00 class 0x088000 [ 2.223749] pci 0000:ff:13.1: [8086:3c43] type 00 class 0x110100 [ 2.223834] pci 0000:ff:13.4: [8086:3ce6] type 00 class 0x110100 [ 2.223915] pci 0000:ff:13.5: [8086:3c44] type 00 class 0x110100 [ 2.223997] pci 0000:ff:13.6: [8086:3c45] type 00 class 0x088000 [ 2.224334] ACPI: Enabled 6 GPEs in block 00 to 3F [ 2.230306] vgaarb: device added: PCI:0000:09:00.0,decodes=io+mem,owns=io+mem,locks=none [ 2.239875] vgaarb: loaded [ 2.243175] vgaarb: bridge control possible 0000:09:00.0 [ 2.249625] SCSI subsystem initialized [ 2.254158] ACPI: bus type USB registered [ 2.258959] usbcore: registered new interface driver usbfs [ 2.265395] usbcore: registered new interface driver hub [ 2.271909] usbcore: registered new device driver usb [ 2.278381] PCI: Using ACPI for IRQ routing [ 2.289945] PCI: pci_cache_line_size set to 64 bytes [ 2.290296] e820: reserve RAM buffer [mem 0x0008f000-0x0008ffff] [ 2.290299] e820: reserve RAM buffer [mem 0xbb3c7000-0xbbffffff] [ 2.290302] e820: reserve RAM buffer [mem 0xbe000000-0xbfffffff] [ 2.290706] NetLabel: Initializing [ 2.294797] NetLabel: domain hash size = 128 [ 2.299953] NetLabel: protocols = UNLABELED CIPSOv4 [ 2.305813] NetLabel: unlabeled traffic allowed by default [ 2.312401] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 2.320367] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 2.329227] amd_nb: Cannot enumerate AMD northbridges [ 2.335394] Switched to clocksource hpet [ 2.354381] pnp: PnP ACPI init [ 2.358106] ACPI: bus type PNP registered [ 2.363128] system 00:00: [io 0x0680-0x069f] has been reserved [ 2.370044] system 00:00: [io 0xffff] has been reserved [ 2.376272] system 00:00: [io 0xffff] has been reserved [ 2.382502] system 00:00: [io 0xffff] has been reserved [ 2.388738] system 00:00: [io 0x0400-0x0453] could not be reserved [ 2.396038] system 00:00: [io 0x0458-0x047f] has been reserved [ 2.402957] system 00:00: [io 0x0500-0x057f] has been reserved [ 2.409865] system 00:00: [io 0x0600-0x061f] has been reserved [ 2.416772] system 00:00: [io 0x0ca2-0x0ca5] has been reserved [ 2.423684] system 00:00: [io 0x0cf9] could not be reserved [ 2.430306] system 00:00: Plug and Play ACPI device, IDs PNP0c02 (active) [ 2.430378] pnp 00:01: Plug and Play ACPI device, IDs PNP0b00 (active) [ 2.430506] system 00:02: [io 0x0454-0x0457] has been reserved [ 2.437424] system 00:02: Plug and Play ACPI device, IDs INT3f0d PNP0c02 (active) [ 2.437795] pnp 00:03: [dma 0 disabled] [ 2.437898] pnp 00:03: Plug and Play ACPI device, IDs PNP0501 (active) [ 2.438157] pnp 00:04: [dma 0 disabled] [ 2.438256] pnp 00:04: Plug and Play ACPI device, IDs PNP0501 (active) [ 2.438825] system 00:05: [mem 0xfed1c000-0xfed1ffff] has been reserved [ 2.446521] system 00:05: [mem 0xebfff000-0xebffffff] has been reserved [ 2.454209] system 00:05: [mem 0xc0000000-0xcfffffff] has been reserved [ 2.461897] system 00:05: [mem 0xfed20000-0xfed3ffff] has been reserved [ 2.469586] system 00:05: [mem 0xfed45000-0xfed8ffff] has been reserved [ 2.477273] system 00:05: [mem 0xff000000-0xffffffff] could not be reserved [ 2.485348] system 00:05: [mem 0xfee00000-0xfeefffff] could not be reserved [ 2.493426] system 00:05: [mem 0xfec00000-0xfecfffff] could not be reserved [ 2.501504] system 00:05: [mem 0xd0f70000-0xd0f70fff] has been reserved [ 2.509194] system 00:05: Plug and Play ACPI device, IDs PNP0c02 (active) [ 2.509697] system 00:06: [mem 0x00000000-0x0009cfff] could not be reserved [ 2.517788] system 00:06: Plug and Play ACPI device, IDs PNP0c01 (active) [ 2.518284] pnp: PnP ACPI: found 7 devices [ 2.523156] ACPI: bus type PNP unregistered [ 2.536690] pci 0000:00:01.0: PCI bridge to [bus 01] [ 2.542547] pci 0000:00:01.1: PCI bridge to [bus 02-03] [ 2.548681] pci 0000:00:01.1: bridge window [io 0x3000-0x3fff] [ 2.555786] pci 0000:00:01.1: bridge window [mem 0xd0b00000-0xd0cfffff] [ 2.563675] pci 0000:00:02.0: PCI bridge to [bus 04] [ 2.569518] pci 0000:00:02.0: bridge window [mem 0xd0e00000-0xd0efffff] [ 2.577401] pci 0000:00:02.0: bridge window [mem 0xeb000000-0xeb7fffff 64bit pref] [ 2.586551] pci 0000:00:02.2: PCI bridge to [bus 05] [ 2.592398] pci 0000:00:03.0: PCI bridge to [bus 06] [ 2.598236] pci 0000:00:03.0: bridge window [io 0x2000-0x2fff] [ 2.605349] pci 0000:00:03.0: bridge window [mem 0xd0900000-0xd0afffff] [ 2.613240] pci 0000:00:11.0: PCI bridge to [bus 07] [ 2.619071] pci 0000:00:11.0: bridge window [io 0x1000-0x1fff] [ 2.626179] pci 0000:00:11.0: bridge window [mem 0xd0d00000-0xd0dfffff] [ 2.634064] pci 0000:00:11.0: bridge window [mem 0xeb800000-0xebcfffff 64bit pref] [ 2.643219] pci 0000:00:1c.0: PCI bridge to [bus 08] [ 2.649077] pci 0000:00:1c.7: PCI bridge to [bus 09] [ 2.654919] pci 0000:00:1c.7: bridge window [mem 0xd0000000-0xd08fffff] [ 2.662800] pci 0000:00:1c.7: bridge window [mem 0xea000000-0xeaffffff 64bit pref] [ 2.671958] pci 0000:00:1e.0: PCI bridge to [bus 0a] [ 2.677809] pci_bus 0000:00: resource 4 [io 0x0000-0xbfff window] [ 2.677813] pci_bus 0000:00: resource 5 [mem 0x000a0000-0x000bffff window] [ 2.677816] pci_bus 0000:00: resource 6 [mem 0x000c0000-0x000c3fff window] [ 2.677820] pci_bus 0000:00: resource 7 [mem 0x000c4000-0x000c7fff window] [ 2.677823] pci_bus 0000:00: resource 8 [mem 0x000c8000-0x000cbfff window] [ 2.677826] pci_bus 0000:00: resource 9 [mem 0x000d0000-0x000d3fff window] [ 2.677829] pci_bus 0000:00: resource 10 [mem 0x000d8000-0x000dbfff window] [ 2.677833] pci_bus 0000:00: resource 11 [mem 0x000dc000-0x000dffff window] [ 2.677836] pci_bus 0000:00: resource 12 [mem 0x000e0000-0x000e3fff window] [ 2.677839] pci_bus 0000:00: resource 13 [mem 0x000e4000-0x000e7fff window] [ 2.677842] pci_bus 0000:00: resource 14 [mem 0x000e8000-0x000ebfff window] [ 2.677846] pci_bus 0000:00: resource 15 [mem 0x000ec000-0x000effff window] [ 2.677849] pci_bus 0000:00: resource 16 [mem 0x000f0000-0x000fffff window] [ 2.677852] pci_bus 0000:00: resource 17 [mem 0xd0000000-0xebffffff window] [ 2.677856] pci_bus 0000:00: resource 18 [mem 0x380000000000-0x38007fffffff window] [ 2.677860] pci_bus 0000:02: resource 0 [io 0x3000-0x3fff] [ 2.677863] pci_bus 0000:02: resource 1 [mem 0xd0b00000-0xd0cfffff] [ 2.677866] pci_bus 0000:04: resource 1 [mem 0xd0e00000-0xd0efffff] [ 2.677870] pci_bus 0000:04: resource 2 [mem 0xeb000000-0xeb7fffff 64bit pref] [ 2.677873] pci_bus 0000:06: resource 0 [io 0x2000-0x2fff] [ 2.677876] pci_bus 0000:06: resource 1 [mem 0xd0900000-0xd0afffff] [ 2.677880] pci_bus 0000:07: resource 0 [io 0x1000-0x1fff] [ 2.677883] pci_bus 0000:07: resource 1 [mem 0xd0d00000-0xd0dfffff] [ 2.677886] pci_bus 0000:07: resource 2 [mem 0xeb800000-0xebcfffff 64bit pref] [ 2.677890] pci_bus 0000:09: resource 1 [mem 0xd0000000-0xd08fffff] [ 2.677893] pci_bus 0000:09: resource 2 [mem 0xea000000-0xeaffffff 64bit pref] [ 2.677896] pci_bus 0000:0a: resource 4 [io 0x0000-0xbfff window] [ 2.677900] pci_bus 0000:0a: resource 5 [mem 0x000a0000-0x000bffff window] [ 2.677903] pci_bus 0000:0a: resource 6 [mem 0x000c0000-0x000c3fff window] [ 2.677906] pci_bus 0000:0a: resource 7 [mem 0x000c4000-0x000c7fff window] [ 2.677909] pci_bus 0000:0a: resource 8 [mem 0x000c8000-0x000cbfff window] [ 2.677913] pci_bus 0000:0a: resource 9 [mem 0x000d0000-0x000d3fff window] [ 2.677916] pci_bus 0000:0a: resource 10 [mem 0x000d8000-0x000dbfff window] [ 2.677920] pci_bus 0000:0a: resource 11 [mem 0x000dc000-0x000dffff window] [ 2.677923] pci_bus 0000:0a: resource 12 [mem 0x000e0000-0x000e3fff window] [ 2.677926] pci_bus 0000:0a: resource 13 [mem 0x000e4000-0x000e7fff window] [ 2.677929] pci_bus 0000:0a: resource 14 [mem 0x000e8000-0x000ebfff window] [ 2.677932] pci_bus 0000:0a: resource 15 [mem 0x000ec000-0x000effff window] [ 2.677936] pci_bus 0000:0a: resource 16 [mem 0x000f0000-0x000fffff window] [ 2.677939] pci_bus 0000:0a: resource 17 [mem 0xd0000000-0xebffffff window] [ 2.677942] pci_bus 0000:0a: resource 18 [mem 0x380000000000-0x38007fffffff window] [ 2.677981] pci 0000:80:01.0: PCI bridge to [bus 81] [ 2.683839] pci 0000:80:02.0: PCI bridge to [bus 82] [ 2.689696] pci 0000:80:03.0: PCI bridge to [bus 83] [ 2.695544] pci 0000:80:03.2: PCI bridge to [bus 84] [ 2.701394] pci_bus 0000:80: resource 4 [io 0x03b0-0x03df window] [ 2.701397] pci_bus 0000:80: resource 5 [io 0xc000-0xffff window] [ 2.701400] pci_bus 0000:80: resource 6 [mem 0x000a0000-0x000bffff window] [ 2.701403] pci_bus 0000:80: resource 7 [mem 0xec000000-0xfbffffff window] [ 2.701407] pci_bus 0000:80: resource 8 [mem 0x380080000000-0x3800ffffffff window] [ 2.701747] NET: Registered protocol family 2 [ 2.709172] TCP established hash table entries: 262144 (order: 9, 2097152 bytes) [ 2.718825] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes) [ 2.726843] TCP: Hash tables configured (established 262144 bind 65536) [ 2.734649] TCP: reno registered [ 2.738704] UDP hash table entries: 16384 (order: 7, 524288 bytes) [ 2.746151] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes) [ 2.755206] NET: Registered protocol family 1 [ 3.860420] pci 0000:00:1a.0: EHCI: BIOS handoff failed (BIOS bug?) 01010001 [ 4.968476] pci 0000:00:1d.0: EHCI: BIOS handoff failed (BIOS bug?) 01010001 [ 4.976940] PCI: CLS mismatch (64 != 32), using 64 bytes [ 4.976965] pci 0000:09:00.0: Boot video device [ 4.977257] Unpacking initramfs... [ 5.542210] Freeing initrd memory: 18672k freed [ 5.554723] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 5.562239] software IO TLB [mem 0xb73c7000-0xbb3c7000] (64MB) mapped at [ffff8800b73c7000-ffff8800bb3c6fff] [ 5.574194] RAPL PMU: API unit is 2^-32 Joules, 3 fixed counters, 163840 ms ovfl timer [ 5.583556] RAPL PMU: hw unit of domain pp0-core 2^-16 Joules [ 5.590282] RAPL PMU: hw unit of domain package 2^-16 Joules [ 5.596913] RAPL PMU: hw unit of domain dram 2^-16 Joules [ 5.615155] sha1_ssse3: Using AVX optimized SHA-1 implementation [ 5.622279] sha256_ssse3: Using AVX optimized SHA-256 implementation [ 5.634666] futex hash table entries: 65536 (order: 10, 4194304 bytes) [ 5.643227] Initialise system trusted keyring [ 5.648553] audit: initializing netlink socket (disabled) [ 5.654905] type=2000 audit(1518031379.225:1): initialized [ 5.712550] HugeTLB registered 1 GB page size, pre-allocated 0 pages [ 5.719947] HugeTLB registered 2 MB page size, pre-allocated 0 pages [ 5.729406] zpool: loaded [ 5.732638] zbud: loaded [ 5.736680] VFS: Disk quotas dquot_6.6.0 [ 5.741864] Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 5.750708] msgmni has been set to 32768 [ 5.755771] Key type big_key registered [ 5.760364] SELinux: Registering netfilter hooks [ 5.762957] NET: Registered protocol family 38 [ 5.768254] Key type asymmetric registered [ 5.773140] Asymmetric key parser 'x509' registered [ 5.779032] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 250) [ 5.788086] io scheduler noop registered [ 5.792767] io scheduler deadline registered (default) [ 5.799060] io scheduler cfq registered [ 5.804585] pcieport 0000:00:01.0: irq 25 for MSI/MSI-X [ 5.804962] pcieport 0000:00:01.1: irq 26 for MSI/MSI-X [ 5.805312] pcieport 0000:00:02.0: irq 27 for MSI/MSI-X [ 5.805683] pcieport 0000:00:02.2: irq 28 for MSI/MSI-X [ 5.806125] pcieport 0000:00:03.0: irq 29 for MSI/MSI-X [ 5.806496] pcieport 0000:00:11.0: irq 30 for MSI/MSI-X [ 5.806876] pcieport 0000:00:1c.0: irq 31 for MSI/MSI-X [ 5.807325] pcieport 0000:00:1c.7: irq 32 for MSI/MSI-X [ 5.807825] pcieport 0000:80:01.0: irq 34 for MSI/MSI-X [ 5.808109] pcieport 0000:80:02.0: irq 35 for MSI/MSI-X [ 5.808362] pcieport 0000:80:03.0: irq 36 for MSI/MSI-X [ 5.808566] pcieport 0000:80:03.2: irq 37 for MSI/MSI-X [ 5.808736] pcieport 0000:00:01.0: Signaling PME through PCIe PME interrupt [ 5.816826] pcie_pme 0000:00:01.0:pcie01: service driver pcie_pme loaded [ 5.816855] pcieport 0000:00:01.1: Signaling PME through PCIe PME interrupt [ 5.824936] pci 0000:02:00.0: Signaling PME through PCIe PME interrupt [ 5.832532] pci 0000:02:00.1: Signaling PME through PCIe PME interrupt [ 5.840138] pci 0000:02:00.2: Signaling PME through PCIe PME interrupt [ 5.847728] pci 0000:02:00.3: Signaling PME through PCIe PME interrupt [ 5.855334] pcie_pme 0000:00:01.1:pcie01: service driver pcie_pme loaded [ 5.855368] pcieport 0000:00:02.0: Signaling PME through PCIe PME interrupt [ 5.863460] pci 0000:04:00.0: Signaling PME through PCIe PME interrupt [ 5.871067] pcie_pme 0000:00:02.0:pcie01: service driver pcie_pme loaded [ 5.871101] pcieport 0000:00:02.2: Signaling PME through PCIe PME interrupt [ 5.879205] pcie_pme 0000:00:02.2:pcie01: service driver pcie_pme loaded [ 5.879231] pcieport 0000:00:03.0: Signaling PME through PCIe PME interrupt [ 5.887327] pci 0000:06:00.0: Signaling PME through PCIe PME interrupt [ 5.894917] pcie_pme 0000:00:03.0:pcie01: service driver pcie_pme loaded [ 5.894946] pcieport 0000:00:11.0: Signaling PME through PCIe PME interrupt [ 5.903022] pci 0000:07:00.0: Signaling PME through PCIe PME interrupt [ 5.910618] pci 0000:07:00.3: Signaling PME through PCIe PME interrupt [ 5.918225] pcie_pme 0000:00:11.0:pcie01: service driver pcie_pme loaded [ 5.918287] pcieport 0000:00:1c.0: Signaling PME through PCIe PME interrupt [ 5.926380] pcie_pme 0000:00:1c.0:pcie01: service driver pcie_pme loaded [ 5.926407] pcieport 0000:00:1c.7: Signaling PME through PCIe PME interrupt [ 5.934503] pci 0000:09:00.0: Signaling PME through PCIe PME interrupt [ 5.942116] pcie_pme 0000:00:1c.7:pcie01: service driver pcie_pme loaded [ 5.942150] pcieport 0000:80:01.0: Signaling PME through PCIe PME interrupt [ 5.950243] pcie_pme 0000:80:01.0:pcie01: service driver pcie_pme loaded [ 5.950273] pcieport 0000:80:02.0: Signaling PME through PCIe PME interrupt [ 5.958364] pcie_pme 0000:80:02.0:pcie01: service driver pcie_pme loaded [ 5.958393] pcieport 0000:80:03.0: Signaling PME through PCIe PME interrupt [ 5.966491] pcie_pme 0000:80:03.0:pcie01: service driver pcie_pme loaded [ 5.966539] pcieport 0000:80:03.2: Signaling PME through PCIe PME interrupt [ 5.974626] pcie_pme 0000:80:03.2:pcie01: service driver pcie_pme loaded [ 5.974748] pci_hotplug: PCI Hot Plug PCI Core version: 0.5 [ 5.981310] pciehp: PCI Express Hot Plug Controller Driver version: 0.4 [ 5.989163] intel_idle: MWAIT substates: 0x21120 [ 5.989165] intel_idle: v0.4.1 model 0x2D [ 5.989438] intel_idle: lapic_timer_reliable_states 0xffffffff [ 5.989568] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 [ 5.998333] ACPI: Power Button [PWRF] [ 6.002743] ACPI: Requesting acpi_cpufreq [ 6.042772] ERST: Error Record Serialization Table (ERST) support is initialized. [ 6.051655] pstore: Registered erst as persistent store backend [ 6.058742] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 6.067621] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 6.095650] 00:03: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A [ 6.122892] 00:04: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A [ 6.129890] Non-volatile memory driver v1.3 [ 6.134897] Linux agpgart interface v0.103 [ 6.139951] crash memory driver: version 1.1 [ 6.145222] rdac: device handler registered [ 6.150238] hp_sw: device handler registered [ 6.155319] emc: device handler registered [ 6.160195] alua: device handler registered [ 6.165209] libphy: Fixed MDIO Bus: probed [ 6.170132] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver [ 6.177742] ehci-pci: EHCI PCI platform driver [ 6.183242] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 6.189417] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1 [ 6.198197] ehci-pci 0000:00:1a.0: debug port 2 [ 6.207477] ehci-pci 0000:00:1a.0: cache line size of 64 is not supported [ 6.207511] ehci-pci 0000:00:1a.0: irq 22, io mem 0xd0f20000 [ 6.219542] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 6.226310] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002 [ 6.234183] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 6.242765] usb usb1: Product: EHCI Host Controller [ 6.248506] usb usb1: Manufacturer: Linux 3.10.0-693.11.6.el7_lustre.x86_64 ehci_hcd [ 6.257643] usb usb1: SerialNumber: 0000:00:1a.0 [ 6.263156] hub 1-0:1.0: USB hub found [ 6.272262] hub 1-0:1.0: 2 ports detected [ 6.277291] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 6.283473] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2 [ 6.292253] ehci-pci 0000:00:1d.0: debug port 2 [ 6.301519] ehci-pci 0000:00:1d.0: cache line size of 64 is not supported [ 6.301559] ehci-pci 0000:00:1d.0: irq 20, io mem 0xd0f10000 [ 6.313544] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 6.320293] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002 [ 6.328161] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 6.336728] usb usb2: Product: EHCI Host Controller [ 6.342467] usb usb2: Manufacturer: Linux 3.10.0-693.11.6.el7_lustre.x86_64 ehci_hcd [ 6.351626] usb usb2: SerialNumber: 0000:00:1d.0 [ 6.357147] hub 2-0:1.0: USB hub found [ 6.361630] hub 2-0:1.0: 2 ports detected [ 6.366493] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver [ 6.373705] ohci-pci: OHCI PCI platform driver [ 6.378973] uhci_hcd: USB Universal Host Controller Interface driver [ 6.386434] usbcore: registered new interface driver usbserial [ 6.393266] usbcore: registered new interface driver usbserial_generic [ 6.400876] usbserial: USB Serial support registered for generic [ 6.407921] i8042: PNP: No PS/2 controller found. Probing ports directly. [ 6.578560] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 6.612570] tsc: Refined TSC clocksource calibration: 2693.509 MHz [ 7.454876] i8042: No controller found [ 7.459359] usb 2-1: new high-speed USB device number 2 using ehci-pci [ 7.459395] Switched to clocksource tsc [ 7.459445] mousedev: PS/2 mouse device common for all mice [ 7.459714] rtc_cmos 00:01: RTC can wake from S4 [ 7.459923] rtc_cmos 00:01: rtc core: registered rtc_cmos as rtc0 [ 7.459973] rtc_cmos 00:01: alarms up to one month, y3k, 242 bytes nvram, hpet irqs [ 7.460019] Intel P-state driver initializing. [ 7.468884] cpuidle: using governor menu [ 7.469836] hidraw: raw HID events driver (C) Jiri Kosina [ 7.470019] usbcore: registered new interface driver usbhid [ 7.470020] usbhid: USB HID core driver [ 7.470153] drop_monitor: Initializing network drop monitor service [ 7.470795] TCP: cubic registered [ 7.470802] Initializing XFRM netlink socket [ 7.471444] NET: Registered protocol family 10 [ 7.473096] NET: Registered protocol family 17 [ 7.478034] microcode: CPU0 sig=0x206d7, pf=0x1, revision=0x710 [ 7.478048] microcode: CPU1 sig=0x206d7, pf=0x1, revision=0x710 [ 7.478059] microcode: CPU2 sig=0x206d7, pf=0x1, revision=0x710 [ 7.478070] microcode: CPU3 sig=0x206d7, pf=0x1, revision=0x710 [ 7.478080] microcode: CPU4 sig=0x206d7, pf=0x1, revision=0x710 [ 7.478101] microcode: CPU5 sig=0x206d7, pf=0x1, revision=0x710 [ 7.478108] microcode: CPU6 sig=0x206d7, pf=0x1, revision=0x710 [ 7.478115] microcode: CPU7 sig=0x206d7, pf=0x1, revision=0x710 [ 7.478122] microcode: CPU8 sig=0x206d7, pf=0x1, revision=0x710 [ 7.478132] microcode: CPU9 sig=0x206d7, pf=0x1, revision=0x710 [ 7.478142] microcode: CPU10 sig=0x206d7, pf=0x1, revision=0x710 [ 7.478151] microcode: CPU11 sig=0x206d7, pf=0x1, revision=0x710 [ 7.478161] microcode: CPU12 sig=0x206d7, pf=0x1, revision=0x710 [ 7.478170] microcode: CPU13 sig=0x206d7, pf=0x1, revision=0x710 [ 7.478180] microcode: CPU14 sig=0x206d7, pf=0x1, revision=0x710 [ 7.478189] microcode: CPU15 sig=0x206d7, pf=0x1, revision=0x710 [ 7.478198] microcode: CPU16 sig=0x206d7, pf=0x1, revision=0x710 [ 7.478208] microcode: CPU17 sig=0x206d7, pf=0x1, revision=0x710 [ 7.478214] microcode: CPU18 sig=0x206d7, pf=0x1, revision=0x710 [ 7.478221] microcode: CPU19 sig=0x206d7, pf=0x1, revision=0x710 [ 7.478227] microcode: CPU20 sig=0x206d7, pf=0x1, revision=0x710 [ 7.478233] microcode: CPU21 sig=0x206d7, pf=0x1, revision=0x710 [ 7.478240] microcode: CPU22 sig=0x206d7, pf=0x1, revision=0x710 [ 7.478246] microcode: CPU23 sig=0x206d7, pf=0x1, revision=0x710 [ 7.478256] microcode: CPU24 sig=0x206d7, pf=0x1, revision=0x710 [ 7.478266] microcode: CPU25 sig=0x206d7, pf=0x1, revision=0x710 [ 7.478274] microcode: CPU26 sig=0x206d7, pf=0x1, revision=0x710 [ 7.478281] microcode: CPU27 sig=0x206d7, pf=0x1, revision=0x710 [ 7.478289] microcode: CPU28 sig=0x206d7, pf=0x1, revision=0x710 [ 7.478301] microcode: CPU29 sig=0x206d7, pf=0x1, revision=0x710 [ 7.478309] microcode: CPU30 sig=0x206d7, pf=0x1, revision=0x710 [ 7.478317] microcode: CPU31 sig=0x206d7, pf=0x1, revision=0x710 [ 7.478373] microcode: Microcode Update Driver: v2.01 , Peter Oruba [ 7.478552] PM: Hibernation image not present or could not be loaded. [ 7.478557] Loading compiled-in X.509 certificates [ 7.478604] Loaded X.509 cert 'CentOS Linux kpatch signing key: ea0413152cde1d98ebdca3fe6f0230904c9ef717' [ 7.478624] Loaded X.509 cert 'CentOS Linux Driver update signing key: 7f421ee0ab69461574bb358861dbe77762a4201b' [ 7.479679] Loaded X.509 cert 'CentOS Linux kernel signing key: 3088de489a926bfb35304e98e5edf531c989bc6b' [ 7.479707] registered taskstats version 1 [ 7.484440] Key type trusted registered [ 7.488740] Key type encrypted registered [ 7.493173] IMA: No TPM chip found, activating TPM-bypass! [ 7.494671] Magic number: 6:339:394 [ 7.494689] thermal cooling_device9: hash matches [ 7.494804] pci 0000:ff:13.0: hash matches [ 7.499653] rtc_cmos 00:01: setting system clock to 2018-02-07 19:23:04 UTC (1518031384) [ 7.573077] usb 1-1: New USB device found, idVendor=8087, idProduct=0024 [ 7.573080] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 7.573417] hub 1-1:1.0: USB hub found [ 7.573493] hub 1-1:1.0: 6 ports detected [ 7.625019] usb 2-1: New USB device found, idVendor=8087, idProduct=0024 [ 7.625022] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 7.625301] hub 2-1:1.0: USB hub found [ 7.625372] hub 2-1:1.0: 8 ports detected [ 7.900663] usb 2-1.4: new full-speed USB device number 3 using ehci-pci [ 7.931815] Freeing unused kernel memory: 1800k freed [ 7.944862] random: systemd: uninitialized urandom read (16 bytes read) [ 7.955566] random: systemd: uninitialized urandom read (16 bytes read) [ 7.963305] random: systemd: uninitialized urandom read (16 bytes read) [ 7.973552] systemd[1]: systemd 219 running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ -LZ4 -SECCOMP +BLKID +ELFUTILS +KMOD +IDN) [ 7.995281] systemd[1]: Detected architecture x86-64. [ 8.001226] systemd[1]: Running in initial RAM disk. [ 8.003391] usb 2-1.4: New USB device found, idVendor=046b, idProduct=ff10 [ 8.003394] usb 2-1.4: New USB device strings: Mfr=1, Product=2, SerialNumber=3 [ 8.003395] usb 2-1.4: Product: Virtual Keyboard and Mouse [ 8.003397] usb 2-1.4: Manufacturer: American Megatrends Inc. [ 8.003399] usb 2-1.4: SerialNumber: serial [ 8.004930] input: American Megatrends Inc. Virtual Keyboard and Mouse as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.4/2-1.4:1.0/input/input1 [ 8.055908] hid-generic 0003:046B:FF10.0001: input,hidraw0: USB HID v1.10 Keyboard [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:1d.0-1.4/input0 [ 8.057017] input: American Megatrends Inc. Virtual Keyboard and Mouse as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.4/2-1.4:1.1/input/input2 [ 8.057295] hid-generic 0003:046B:FF10.0002: input,hidraw1: USB HID v1.10 Mouse [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:1d.0-1.4/input1 [ 8.116801] systemd[1]: Set hostname to . [ 8.184167] random: systemd: uninitialized urandom read (16 bytes read) [ 8.191964] random: systemd: uninitialized urandom read (16 bytes read) [ 8.199765] random: systemd: uninitialized urandom read (16 bytes read) [ 8.207598] random: systemd: uninitialized urandom read (16 bytes read) [ 8.216480] random: systemd: uninitialized urandom read (16 bytes read) [ 8.224445] random: systemd: uninitialized urandom read (16 bytes read) [ 8.232476] random: systemd: uninitialized urandom read (16 bytes read) [ 8.251784] systemd[1]: Reached target Timers. [ 8.257086] systemd[1]: Starting Timers. [ 8.266762] systemd[1]: Reached target Swap. [ 8.271867] systemd[1]: Starting Swap. [ 8.282766] systemd[1]: Reached target Local File Systems. [ 8.289207] systemd[1]: Starting Local File Systems. [ 8.300754] systemd[1]: Created slice Root Slice. [ 8.306327] systemd[1]: Starting Root Slice. [ 8.316764] systemd[1]: Created slice System Slice. [ 8.322541] systemd[1]: Starting System Slice. [ 8.332761] systemd[1]: Reached target Slices. [ 8.338059] systemd[1]: Starting Slices. [ 8.349809] systemd[1]: Listening on Journal Socket. [ 8.355706] systemd[1]: Starting Journal Socket. [ 8.362030] systemd[1]: Starting Create list of required static device nodes for the current kernel... [ 8.383615] systemd[1]: Starting Journal Service... [ 8.395535] systemd[1]: Starting Setup Virtual Console... [ 8.413799] systemd[1]: Listening on udev Kernel Socket. [ 8.413822] systemd[1]: Starting udev Kernel Socket. [ 8.414823] systemd[1]: Starting dracut cmdline hook... [ 8.443049] systemd[1]: Starting Load Kernel Modules... [ 8.460735] systemd[1]: Listening on udev Control Socket. [ 8.467087] systemd[1]: Starting udev Control Socket. [ 8.477723] systemd[1]: Reached target Sockets. [ 8.483116] systemd[1]: Starting Sockets. [ 8.493744] systemd[1]: Started Journal Service. [ 8.729386] mlx_compat: loading out-of-tree module taints kernel. [ 8.738523] mlx_compat: module verification failed: signature and/or required key missing - tainting kernel [ 8.751119] Compat-mlnx-ofed backport release: f8de107 [ 8.757153] Backport based on mlnx_ofed/mlnx-ofa_kernel-4.0.git f8de107 [ 8.764873] compat.git: mlnx_ofed/mlnx-ofa_kernel-4.0.git [ 8.774895] libata version 3.00 loaded. [ 8.775552] dca service started, version 1.12.1 [ 8.784816] pps_core: LinuxPPS API ver. 1 registered [ 8.790976] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 8.804666] mpt2sas version 20.103.00.00 loaded [ 8.804754] mpt2sas 0000:06:00.0: can't disable ASPM; OS doesn't have ASPM control [ 8.804996] mpt2sas_cm0: 64 BIT PCI BUS DMA ADDRESSING SUPPORTED, total mem (32509276 kB) [ 8.805157] isci: Intel(R) C600 SAS Controller Driver - version 1.2.0 [ 8.805524] isci 0000:07:00.0: driver configured for rev: 6 silicon [ 8.805540] isci 0000:07:00.0: OEM parameter table found in OROM [ 8.805542] isci 0000:07:00.0: OEM SAS parameters (version: 1.1) loaded (platform) [ 8.805820] isci 0000:07:00.0: SCU controller 0: phy 3-0 cables: {short, short, short, short} [ 8.808301] scsi host1: isci [ 8.808382] ahci 0000:00:1f.2: version 3.0 [ 8.808686] ahci 0000:00:1f.2: irq 39 for MSI/MSI-X [ 8.809250] isci 0000:07:00.0: irq 40 for MSI/MSI-X [ 8.809312] isci 0000:07:00.0: irq 41 for MSI/MSI-X [ 8.819743] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 8.819746] ahci 0000:00:1f.2: flags: 64bit ncq sntf pm led clo pio slum part ems apst [ 8.832381] scsi host2: ahci [ 8.832516] scsi host3: ahci [ 8.832608] scsi host4: ahci [ 8.832698] scsi host5: ahci [ 8.832783] scsi host6: ahci [ 8.832864] scsi host7: ahci [ 8.832917] ata1: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00100 irq 39 [ 8.832919] ata2: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00180 irq 39 [ 8.832921] ata3: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00200 irq 39 [ 8.832924] ata4: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00280 irq 39 [ 8.832927] ata5: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00300 irq 39 [ 8.832930] ata6: SATA max UDMA/133 abar m2048@0xd0f00000 port 0xd0f00380 irq 39 [ 8.846192] PTP clock support registered [ 8.860678] mpt2sas_cm0: MSI-X vectors supported: 16, no of cores: 32, max_msix_vectors: -1 [ 8.860758] mpt2sas 0000:06:00.0: irq 42 for MSI/MSI-X [ 8.860820] mpt2sas 0000:06:00.0: irq 43 for MSI/MSI-X [ 8.860883] mpt2sas 0000:06:00.0: irq 44 for MSI/MSI-X [ 8.860943] mpt2sas 0000:06:00.0: irq 45 for MSI/MSI-X [ 8.861005] mpt2sas 0000:06:00.0: irq 46 for MSI/MSI-X [ 8.861067] mpt2sas 0000:06:00.0: irq 47 for MSI/MSI-X [ 8.861128] mpt2sas 0000:06:00.0: irq 48 for MSI/MSI-X [ 8.861189] mpt2sas 0000:06:00.0: irq 49 for MSI/MSI-X [ 8.861250] mpt2sas 0000:06:00.0: irq 50 for MSI/MSI-X [ 8.861310] mpt2sas 0000:06:00.0: irq 51 for MSI/MSI-X [ 8.861372] mpt2sas 0000:06:00.0: irq 52 for MSI/MSI-X [ 8.861433] mpt2sas 0000:06:00.0: irq 53 for MSI/MSI-X [ 8.861494] mpt2sas 0000:06:00.0: irq 54 for MSI/MSI-X [ 8.861560] mpt2sas 0000:06:00.0: irq 55 for MSI/MSI-X [ 8.861622] mpt2sas 0000:06:00.0: irq 56 for MSI/MSI-X [ 8.861688] mpt2sas 0000:06:00.0: irq 57 for MSI/MSI-X [ 8.861804] mpt2sas0-msix0: PCI-MSI-X enabled: IRQ 42 [ 8.861805] mpt2sas0-msix1: PCI-MSI-X enabled: IRQ 43 [ 8.861805] mpt2sas0-msix2: PCI-MSI-X enabled: IRQ 44 [ 8.861806] mpt2sas0-msix3: PCI-MSI-X enabled: IRQ 45 [ 8.861806] mpt2sas0-msix4: PCI-MSI-X enabled: IRQ 46 [ 8.861807] mpt2sas0-msix5: PCI-MSI-X enabled: IRQ 47 [ 8.861807] mpt2sas0-msix6: PCI-MSI-X enabled: IRQ 48 [ 8.861808] mpt2sas0-msix7: PCI-MSI-X enabled: IRQ 49 [ 8.861808] mpt2sas0-msix8: PCI-MSI-X enabled: IRQ 50 [ 8.861809] mpt2sas0-msix9: PCI-MSI-X enabled: IRQ 51 [ 8.861809] mpt2sas0-msix10: PCI-MSI-X enabled: IRQ 52 [ 8.861810] mpt2sas0-msix11: PCI-MSI-X enabled: IRQ 53 [ 8.861810] mpt2sas0-msix12: PCI-MSI-X enabled: IRQ 54 [ 8.861811] mpt2sas0-msix13: PCI-MSI-X enabled: IRQ 55 [ 8.861811] mpt2sas0-msix14: PCI-MSI-X enabled: IRQ 56 [ 8.861811] mpt2sas0-msix15: PCI-MSI-X enabled: IRQ 57 [ 8.861813] mpt2sas_cm0: iomem(0x00000000d0a40000), mapped(0xffffc90003bc0000), size(65536) [ 8.861813] mpt2sas_cm0: ioport(0x0000000000002000), size(256) [ 8.883060] mlx4_core: Mellanox ConnectX core driver v4.2-1.2.0 [ 8.883093] mlx4_core: Initializing 0000:04:00.0 [ 8.916185] mpt2sas_cm0: sending message unit reset !! [ 8.917683] mpt2sas_cm0: message unit reset: SUCCESS [ 8.923209] [drm] Initialized [ 8.978215] mpt2sas_cm0: Allocated physical memory: size(18690 kB) [ 8.978216] mpt2sas_cm0: Current Controller Queue Depth(10104),Max Controller Queue Depth(10240) [ 8.978216] mpt2sas_cm0: Scatter Gather Elements per IO(128) [ 8.990060] igb: Intel(R) Gigabit Ethernet Network Driver - version 5.4.0-k [ 8.990060] igb: Copyright (c) 2007-2014 Intel Corporation. [ 8.990558] igb 0000:02:00.0: irq 60 for MSI/MSI-X [ 8.990653] igb 0000:02:00.0: irq 60 for MSI/MSI-X [ 8.990723] igb 0000:02:00.0: irq 61 for MSI/MSI-X [ 8.990787] igb 0000:02:00.0: irq 62 for MSI/MSI-X [ 8.990849] igb 0000:02:00.0: irq 63 for MSI/MSI-X [ 8.990911] igb 0000:02:00.0: irq 64 for MSI/MSI-X [ 8.990973] igb 0000:02:00.0: irq 65 for MSI/MSI-X [ 8.991034] igb 0000:02:00.0: irq 66 for MSI/MSI-X [ 8.991095] igb 0000:02:00.0: irq 67 for MSI/MSI-X [ 8.991157] igb 0000:02:00.0: irq 68 for MSI/MSI-X [ 8.991184] igb 0000:02:00.0: PHY reset is blocked due to SOL/IDER session. [ 9.027376] igb 0000:02:00.0: added PHC on eth0 [ 9.027377] igb 0000:02:00.0: Intel(R) Gigabit Ethernet Network Connection [ 9.027379] igb 0000:02:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:11:0f [ 9.027453] igb 0000:02:00.0: eth0: PBA No: 100000-000 [ 9.027454] igb 0000:02:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 9.027902] igb 0000:02:00.1: irq 70 for MSI/MSI-X [ 9.027993] igb 0000:02:00.1: irq 70 for MSI/MSI-X [ 9.028056] igb 0000:02:00.1: irq 71 for MSI/MSI-X [ 9.028116] igb 0000:02:00.1: irq 72 for MSI/MSI-X [ 9.028180] igb 0000:02:00.1: irq 73 for MSI/MSI-X [ 9.028245] igb 0000:02:00.1: irq 74 for MSI/MSI-X [ 9.028306] igb 0000:02:00.1: irq 75 for MSI/MSI-X [ 9.028368] igb 0000:02:00.1: irq 76 for MSI/MSI-X [ 9.028430] igb 0000:02:00.1: irq 77 for MSI/MSI-X [ 9.028490] igb 0000:02:00.1: irq 78 for MSI/MSI-X [ 9.028517] igb 0000:02:00.1: PHY reset is blocked due to SOL/IDER session. [ 9.033420] random: fast init done [ 9.033649] mpt2sas_cm0: LSISAS2308: FWVersion(20.00.07.00), ChipRevision(0x05), BiosVersion(07.29.00.00) [ 9.033650] mpt2sas_cm0: Protocol=( [ 9.033650] Initiator [ 9.033651] ,Target [ 9.033651] ), [ 9.033651] Capabilities=( [ 9.033652] TLR [ 9.033652] ,EEDP [ 9.033652] ,Snapshot Buffer [ 9.033653] ,Diag Trace Buffer [ 9.033653] ,Task Set Full [ 9.033653] ,NCQ [ 9.033654] ) [ 9.033705] scsi host0: Fusion MPT SAS Host [ 9.034157] mpt2sas_cm0: sending port enable !! [ 9.036658] mpt2sas_cm0: host_add: handle(0x0001), sas_addr(0x500605b005d6e8b0), phys(8) [ 9.044689] mpt2sas_cm0: port enable: SUCCESS [ 9.045569] scsi 0:0:0:0: Direct-Access LSI INF-01-00 0820 PQ: 0 ANSI: 5 [ 9.045573] scsi 0:0:0:0: SSP: handle(0x000a), sas_addr(0x50080e52ffd82004), phy(4), device_name(0x50080e52ffd82004) [ 9.045575] scsi 0:0:0:0: SSP: enclosure_logical_id(0x500605b005d6e8b0), slot(7) [ 9.045577] scsi 0:0:0:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) [ 9.064005] igb 0000:02:00.1: added PHC on eth1 [ 9.064006] igb 0000:02:00.1: Intel(R) Gigabit Ethernet Network Connection [ 9.064008] igb 0000:02:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:11:10 [ 9.064082] igb 0000:02:00.1: eth1: PBA No: 100000-000 [ 9.064083] igb 0000:02:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 9.077911] igb 0000:02:00.2: irq 80 for MSI/MSI-X [ 9.077998] igb 0000:02:00.2: irq 80 for MSI/MSI-X [ 9.078063] igb 0000:02:00.2: irq 81 for MSI/MSI-X [ 9.078124] igb 0000:02:00.2: irq 82 for MSI/MSI-X [ 9.078189] igb 0000:02:00.2: irq 83 for MSI/MSI-X [ 9.078250] igb 0000:02:00.2: irq 84 for MSI/MSI-X [ 9.078310] igb 0000:02:00.2: irq 85 for MSI/MSI-X [ 9.078372] igb 0000:02:00.2: irq 86 for MSI/MSI-X [ 9.078433] igb 0000:02:00.2: irq 87 for MSI/MSI-X [ 9.078494] igb 0000:02:00.2: irq 88 for MSI/MSI-X [ 9.130542] igb 0000:02:00.2: added PHC on eth2 [ 9.130543] igb 0000:02:00.2: Intel(R) Gigabit Ethernet Network Connection [ 9.130545] igb 0000:02:00.2: eth2: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:11:11 [ 9.130619] igb 0000:02:00.2: eth2: PBA No: 100000-000 [ 9.130620] igb 0000:02:00.2: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 9.137711] ata4: SATA link down (SStatus 0 SControl 300) [ 9.138712] ata3: SATA link down (SStatus 0 SControl 300) [ 9.138739] ata5: SATA link down (SStatus 0 SControl 300) [ 9.138769] ata2: SATA link down (SStatus 0 SControl 300) [ 9.138795] ata1: SATA link down (SStatus 0 SControl 300) [ 9.141711] ata6: SATA link down (SStatus 0 SControl 300) [ 9.144911] igb 0000:02:00.3: irq 90 for MSI/MSI-X [ 9.145000] igb 0000:02:00.3: irq 90 for MSI/MSI-X [ 9.145061] igb 0000:02:00.3: irq 91 for MSI/MSI-X [ 9.145122] igb 0000:02:00.3: irq 92 for MSI/MSI-X [ 9.145184] igb 0000:02:00.3: irq 93 for MSI/MSI-X [ 9.145252] igb 0000:02:00.3: irq 94 for MSI/MSI-X [ 9.145314] igb 0000:02:00.3: irq 95 for MSI/MSI-X [ 9.145374] igb 0000:02:00.3: irq 96 for MSI/MSI-X [ 9.145435] igb 0000:02:00.3: irq 97 for MSI/MSI-X [ 9.145502] igb 0000:02:00.3: irq 98 for MSI/MSI-X [ 9.197500] igb 0000:02:00.3: added PHC on eth3 [ 9.197501] igb 0000:02:00.3: Intel(R) Gigabit Ethernet Network Connection [ 9.197503] igb 0000:02:00.3: eth3: (PCIe:5.0Gb/s:Width x4) 00:1e:67:6b:11:12 [ 9.197576] igb 0000:02:00.3: eth3: PBA No: 100000-000 [ 9.197577] igb 0000:02:00.3: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 9.283554] [TTM] Zone kernel: Available graphics memory: 16254638 kiB [ 9.283554] [TTM] Zone dma32: Available graphics memory: 2097152 kiB [ 9.283555] [TTM] Initializing pool allocator [ 9.283561] [TTM] Initializing DMA pool allocator [ 9.318433] fbcon: mgadrmfb (fb0) is primary device [ 9.341487] scsi 0:0:0:1: Direct-Access LSI INF-01-00 0820 PQ: 0 ANSI: 5 [ 9.341495] scsi 0:0:0:1: SSP: handle(0x000a), sas_addr(0x50080e52ffd82004), phy(4), device_name(0x50080e52ffd82004) [ 9.341498] scsi 0:0:0:1: SSP: enclosure_logical_id(0x500605b005d6e8b0), slot(7) [ 9.341502] scsi 0:0:0:1: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) [ 9.355212] scsi 0:0:0:2: Direct-Access LSI INF-01-00 0820 PQ: 0 ANSI: 5 [ 9.355217] scsi 0:0:0:2: SSP: handle(0x000a), sas_addr(0x50080e52ffd82004), phy(4), device_name(0x50080e52ffd82004) [ 9.355220] scsi 0:0:0:2: SSP: enclosure_logical_id(0x500605b005d6e8b0), slot(7) [ 9.355223] scsi 0:0:0:2: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) [ 9.367206] scsi 0:0:0:3: Direct-Access LSI INF-01-00 0820 PQ: 0 ANSI: 5 [ 9.367210] scsi 0:0:0:3: SSP: handle(0x000a), sas_addr(0x50080e52ffd82004), phy(4), device_name(0x50080e52ffd82004) [ 9.367226] scsi 0:0:0:3: SSP: enclosure_logical_id(0x500605b005d6e8b0), slot(7) [ 9.367229] scsi 0:0:0:3: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) [ 9.385158] scsi 0:0:0:7: Direct-Access LSI Universal Xport 0820 PQ: 0 ANSI: 5 [ 9.385163] scsi 0:0:0:7: SSP: handle(0x000a), sas_addr(0x50080e52ffd82004), phy(4), device_name(0x50080e52ffd82004) [ 9.385165] scsi 0:0:0:7: SSP: enclosure_logical_id(0x500605b005d6e8b0), slot(7) [ 9.385168] scsi 0:0:0:7: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) [ 9.400965] scsi 0:0:1:0: Direct-Access LSI INF-01-00 0820 PQ: 0 ANSI: 5 [ 9.400973] scsi 0:0:1:0: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0000), phy(0), device_name(0x50080e52ff4f0000) [ 9.400975] scsi 0:0:1:0: SSP: enclosure_logical_id(0x500605b005d6e8b0), slot(3) [ 9.400979] scsi 0:0:1:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) [ 9.436703] scsi 0:0:1:1: Direct-Access LSI INF-01-00 0820 PQ: 0 ANSI: 5 [ 9.436708] scsi 0:0:1:1: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0000), phy(0), device_name(0x50080e52ff4f0000) [ 9.436710] scsi 0:0:1:1: SSP: enclosure_logical_id(0x500605b005d6e8b0), slot(3) [ 9.436713] scsi 0:0:1:1: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) [ 9.437099] scsi 0:0:1:1: Mode parameters changed [ 9.452191] scsi 0:0:1:2: Direct-Access LSI INF-01-00 0820 PQ: 0 ANSI: 5 [ 9.452199] scsi 0:0:1:2: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0000), phy(0), device_name(0x50080e52ff4f0000) [ 9.452202] scsi 0:0:1:2: SSP: enclosure_logical_id(0x500605b005d6e8b0), slot(3) [ 9.452206] scsi 0:0:1:2: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) [ 9.452545] scsi 0:0:1:2: Mode parameters changed [ 9.468139] scsi 0:0:1:3: Direct-Access LSI INF-01-00 0820 PQ: 0 ANSI: 5 [ 9.468145] scsi 0:0:1:3: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0000), phy(0), device_name(0x50080e52ff4f0000) [ 9.468147] scsi 0:0:1:3: SSP: enclosure_logical_id(0x500605b005d6e8b0), slot(3) [ 9.468150] scsi 0:0:1:3: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) [ 9.468491] scsi 0:0:1:3: Mode parameters changed [ 9.484135] scsi 0:0:1:7: Direct-Access LSI Universal Xport 0820 PQ: 0 ANSI: 5 [ 9.484140] scsi 0:0:1:7: SSP: handle(0x0009), sas_addr(0x50080e52ff4f0000), phy(0), device_name(0x50080e52ff4f0000) [ 9.484142] scsi 0:0:1:7: SSP: enclosure_logical_id(0x500605b005d6e8b0), slot(3) [ 9.484146] scsi 0:0:1:7: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(6), cmd_que(1) [ 9.549775] Console: switching to colour frame buffer device 128x48 [ 9.605591] mgag200 0000:09:00.0: fb0: mgadrmfb frame buffer device [ 9.631786] [drm] Initialized mgag200 1.0.0 20110418 for 0000:09:00.0 on minor 0 [ 10.321842] sas: phy-1:0 added to port-1:0, phy_mask:0x1 (5001e676b110f000) [ 10.321878] sas: phy-1:1 added to port-1:1, phy_mask:0x2 (5001e676b110f001) [ 10.321895] sas: DOING DISCOVERY on port 0, pid:254 [ 10.321928] sas: DONE DISCOVERY on port 0, pid:254, result:0 [ 10.321942] sas: DOING DISCOVERY on port 1, pid:254 [ 10.321957] sas: DONE DISCOVERY on port 1, pid:254, result:0 [ 10.321988] sas: Enter sas_scsi_recover_host busy: 0 failed: 0 [ 10.322103] sas: ata7: end_device-1:0: dev error handler [ 10.483074] ata7.00: ATA-8: ST500DM002-1BD142, KC45, max UDMA/133 [ 10.490836] ata7.00: 976773168 sectors, multi 0: LBA48 NCQ (depth 31/32) [ 10.500833] ata7.00: configured for UDMA/133 [ 10.506558] sas: --- Exit sas_scsi_recover_host: busy: 0 failed: 0 tries: 1 [ 10.517162] scsi 1:0:0:0: Direct-Access ATA ST500DM002-1BD14 KC45 PQ: 0 ANSI: 5 [ 15.430794] mlx4_core 0000:04:00.0: Old device ETS support detected [ 15.438776] mlx4_core 0000:04:00.0: Consider upgrading device FW. [ 15.446545] mlx4_core 0000:04:00.0: DMFS high rate mode not supported [ 15.454696] mlx4_core: device is working in RoCE mode: Roce V1 [ 15.462148] mlx4_core: UD QP Gid type is: V1 [ 16.530351] mlx4_core 0000:04:00.0: PCIe link speed is 8.0GT/s, device supports 8.0GT/s [ 16.540238] mlx4_core 0000:04:00.0: PCIe link width is x8, device supports x8 [ 16.549297] mlx4_core 0000:04:00.0: irq 99 for MSI/MSI-X [ 16.549322] mlx4_core 0000:04:00.0: irq 100 for MSI/MSI-X [ 16.549341] mlx4_core 0000:04:00.0: irq 101 for MSI/MSI-X [ 16.549361] mlx4_core 0000:04:00.0: irq 102 for MSI/MSI-X [ 16.549380] mlx4_core 0000:04:00.0: irq 103 for MSI/MSI-X [ 16.549399] mlx4_core 0000:04:00.0: irq 104 for MSI/MSI-X [ 16.549441] mlx4_core 0000:04:00.0: irq 105 for MSI/MSI-X [ 16.549461] mlx4_core 0000:04:00.0: irq 106 for MSI/MSI-X [ 16.549480] mlx4_core 0000:04:00.0: irq 107 for MSI/MSI-X [ 16.549503] mlx4_core 0000:04:00.0: irq 108 for MSI/MSI-X [ 16.549523] mlx4_core 0000:04:00.0: irq 109 for MSI/MSI-X [ 16.549543] mlx4_core 0000:04:00.0: irq 110 for MSI/MSI-X [ 16.549562] mlx4_core 0000:04:00.0: irq 111 for MSI/MSI-X [ 16.549582] mlx4_core 0000:04:00.0: irq 112 for MSI/MSI-X [ 16.549601] mlx4_core 0000:04:00.0: irq 113 for MSI/MSI-X [ 16.549621] mlx4_core 0000:04:00.0: irq 114 for MSI/MSI-X [ 16.549640] mlx4_core 0000:04:00.0: irq 115 for MSI/MSI-X [ 16.549663] mlx4_core 0000:04:00.0: irq 116 for MSI/MSI-X [ 16.549683] mlx4_core 0000:04:00.0: irq 117 for MSI/MSI-X [ 16.549703] mlx4_core 0000:04:00.0: irq 118 for MSI/MSI-X [ 16.549722] mlx4_core 0000:04:00.0: irq 119 for MSI/MSI-X [ 16.549742] mlx4_core 0000:04:00.0: irq 120 for MSI/MSI-X [ 16.549782] mlx4_core 0000:04:00.0: irq 121 for MSI/MSI-X [ 16.549801] mlx4_core 0000:04:00.0: irq 122 for MSI/MSI-X [ 16.549820] mlx4_core 0000:04:00.0: irq 123 for MSI/MSI-X [ 16.549843] mlx4_core 0000:04:00.0: irq 124 for MSI/MSI-X [ 16.549862] mlx4_core 0000:04:00.0: irq 125 for MSI/MSI-X [ 16.549881] mlx4_core 0000:04:00.0: irq 126 for MSI/MSI-X [ 16.549901] mlx4_core 0000:04:00.0: irq 127 for MSI/MSI-X [ 16.549920] mlx4_core 0000:04:00.0: irq 128 for MSI/MSI-X [ 16.549940] mlx4_core 0000:04:00.0: irq 129 for MSI/MSI-X [ 16.549959] mlx4_core 0000:04:00.0: irq 130 for MSI/MSI-X [ 16.549978] mlx4_core 0000:04:00.0: irq 131 for MSI/MSI-X [ 16.550001] mlx4_core 0000:04:00.0: irq 132 for MSI/MSI-X [ 16.550020] mlx4_core 0000:04:00.0: irq 133 for MSI/MSI-X [ 16.550039] mlx4_core 0000:04:00.0: irq 134 for MSI/MSI-X [ 16.550063] mlx4_core 0000:04:00.0: irq 135 for MSI/MSI-X [ 16.550083] mlx4_core 0000:04:00.0: irq 136 for MSI/MSI-X [ 16.550133] mlx4_core 0000:04:00.0: irq 137 for MSI/MSI-X [ 16.550153] mlx4_core 0000:04:00.0: irq 138 for MSI/MSI-X [ 16.550179] mlx4_core 0000:04:00.0: irq 139 for MSI/MSI-X [ 16.550204] mlx4_core 0000:04:00.0: irq 140 for MSI/MSI-X [ 16.550224] mlx4_core 0000:04:00.0: irq 141 for MSI/MSI-X [ 16.550243] mlx4_core 0000:04:00.0: irq 142 for MSI/MSI-X [ 16.550262] mlx4_core 0000:04:00.0: irq 143 for MSI/MSI-X [ 16.550281] mlx4_core 0000:04:00.0: irq 144 for MSI/MSI-X [ 16.550301] mlx4_core 0000:04:00.0: irq 145 for MSI/MSI-X [ 16.550320] mlx4_core 0000:04:00.0: irq 146 for MSI/MSI-X [ 16.550339] mlx4_core 0000:04:00.0: irq 147 for MSI/MSI-X [ 16.550363] mlx4_core 0000:04:00.0: irq 148 for MSI/MSI-X [ 16.550382] mlx4_core 0000:04:00.0: irq 149 for MSI/MSI-X [ 16.550402] mlx4_core 0000:04:00.0: irq 150 for MSI/MSI-X [ 16.550421] mlx4_core 0000:04:00.0: irq 151 for MSI/MSI-X [ 16.550440] mlx4_core 0000:04:00.0: irq 152 for MSI/MSI-X [ 16.550481] mlx4_core 0000:04:00.0: irq 153 for MSI/MSI-X [ 16.550500] mlx4_core 0000:04:00.0: irq 154 for MSI/MSI-X [ 16.550519] mlx4_core 0000:04:00.0: irq 155 for MSI/MSI-X [ 16.550542] mlx4_core 0000:04:00.0: irq 156 for MSI/MSI-X [ 16.550561] mlx4_core 0000:04:00.0: irq 157 for MSI/MSI-X [ 16.550580] mlx4_core 0000:04:00.0: irq 158 for MSI/MSI-X [ 16.550599] mlx4_core 0000:04:00.0: irq 159 for MSI/MSI-X [ 16.550618] mlx4_core 0000:04:00.0: irq 160 for MSI/MSI-X [ 16.550637] mlx4_core 0000:04:00.0: irq 161 for MSI/MSI-X [ 16.550657] mlx4_core 0000:04:00.0: irq 162 for MSI/MSI-X [ 16.550676] mlx4_core 0000:04:00.0: irq 163 for MSI/MSI-X [ 16.805162] sas: Enter sas_scsi_recover_host busy: 0 failed: 0 [ 16.805180] sas: ata7: end_device-1:0: dev error handler [ 16.805201] sas: ata8: end_device-1:1: dev error handler [ 16.809280] mlx4_ib_add: mlx4_ib: Mellanox ConnectX InfiniBand driver v4.2-1.2.0 [ 16.820152] mlx4_ib_add: counter index 0 for port 1 allocated 0 [ 16.828700] mlx4_ib_add: counter index 1 for port 2 allocated 0 [ 16.971015] ata8.00: ATA-8: ST500NM0011, SN02, max UDMA/133 [ 16.979058] ata8.00: 976773168 sectors, multi 0: LBA48 NCQ (depth 31/32) [ 16.989106] ata8.00: configured for UDMA/133 [ 16.995587] sas: --- Exit sas_scsi_recover_host: busy: 0 failed: 0 tries: 1 [ 17.007011] scsi 1:0:1:0: Direct-Access ATA ST500NM0011 SN02 PQ: 0 ANSI: 5 [ 17.029506] sd 1:0:0:0: [sda] 976773168 512-byte logical blocks: (500 GB/465 GiB) [ 17.029889] sd 1:0:1:0: [sdb] 976773168 512-byte logical blocks: (500 GB/465 GiB) [ 17.030033] sd 1:0:1:0: [sdb] Write Protect is off [ 17.030035] sd 1:0:1:0: [sdb] Mode Sense: 00 3a 00 00 [ 17.030098] sd 1:0:1:0: [sdb] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 17.050277] sdb: [ 17.051011] sd 1:0:1:0: [sdb] Attached SCSI disk [ 17.070144] scsi 0:0:0:0: rdac: LUN 0 (RDAC) (owned) [ 17.081339] sd 0:0:0:0: [sdc] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB) [ 17.099100] sd 1:0:0:0: [sda] 4096-byte physical blocks [ 17.099125] scsi 0:0:0:1: rdac: LUN 1 (RDAC) (unowned) [ 17.114044] sd 0:0:0:1: [sdd] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB) [ 17.114110] sd 1:0:0:0: [sda] Write Protect is off [ 17.114112] sd 1:0:0:0: [sda] Mode Sense: 00 3a 00 00 [ 17.114138] sd 1:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 17.114250] sd 0:0:0:0: [sdc] Write Protect is off [ 17.114252] sd 0:0:0:0: [sdc] Mode Sense: 83 00 10 08 [ 17.114469] scsi 0:0:0:2: rdac: LUN 2 (RDAC) (owned) [ 17.114568] sd 0:0:0:0: [sdc] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 17.115207] sd 0:0:0:2: [sde] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB) [ 17.115834] scsi 0:0:0:3: rdac: LUN 3 (RDAC) (unowned) [ 17.116321] sd 0:0:0:3: [sdf] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB) [ 17.116392] sd 0:0:0:2: [sde] Write Protect is off [ 17.116394] sd 0:0:0:2: [sde] Mode Sense: 83 00 10 08 [ 17.116776] sd 0:0:0:7: [sdg] 40960 512-byte logical blocks: (20.9 MB/20.0 MiB) [ 17.116937] sd 0:0:0:2: [sde] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 17.117798] sd 0:0:0:3: [sdf] Write Protect is off [ 17.117800] sd 0:0:0:3: [sdf] Mode Sense: 83 00 10 08 [ 17.118331] scsi 0:0:1:0: rdac: LUN 0 (RDAC) (unowned) [ 17.118346] sd 0:0:0:7: [sdg] Write Protect is off [ 17.118349] sd 0:0:0:7: [sdg] Mode Sense: 83 00 10 08 [ 17.118564] sd 0:0:0:3: [sdf] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 17.118689] sd 0:0:1:0: [sdh] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB) [ 17.119294] scsi 0:0:1:1: rdac: LUN 1 (RDAC) (owned) [ 17.119528] sd 0:0:1:0: [sdh] Write Protect is off [ 17.119530] sd 0:0:1:0: [sdh] Mode Sense: 83 00 10 08 [ 17.119820] sd 0:0:1:1: [sdi] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB) [ 17.119863] sd 0:0:1:0: [sdh] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 17.120622] scsi 0:0:1:2: rdac: LUN 2 (RDAC) (unowned) [ 17.120975] sd 0:0:1:1: [sdi] Write Protect is off [ 17.120977] sd 0:0:1:1: [sdi] Mode Sense: 83 00 10 08 [ 17.121143] sd 0:0:1:2: [sdj] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB) [ 17.121325] sd 0:0:0:7: [sdg] Write cache: disabled, read cache: enabled, supports DPO and FUA [ 17.121684] sd 0:0:1:1: [sdi] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 17.122419] scsi 0:0:1:3: rdac: LUN 3 (RDAC) (owned) [ 17.122710] sd 0:0:1:2: [sdj] Write Protect is off [ 17.122712] sd 0:0:1:2: [sdj] Mode Sense: 83 00 10 08 [ 17.123232] sd 0:0:1:3: [sdk] 6986547200 512-byte logical blocks: (3.57 TB/3.25 TiB) [ 17.123267] sd 0:0:1:2: [sdj] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 17.123743] sd 0:0:1:7: [sdl] 40960 512-byte logical blocks: (20.9 MB/20.0 MiB) [ 17.123824] Dev sdh: unable to read RDB block 0 [ 17.123840] sdh: unable to read partition table [ 17.123844] sd 0:0:0:0: [sdc] Attached SCSI disk [ 17.124369] Dev sdf: unable to read RDB block 0 [ 17.124379] sdf: unable to read partition table [ 17.124869] sd 0:0:1:3: [sdk] Write Protect is off [ 17.124871] sd 0:0:1:3: [sdk] Mode Sense: 83 00 10 08 [ 17.125312] sd 0:0:1:7: [sdl] Write Protect is off [ 17.125313] sd 0:0:1:7: [sdl] Mode Sense: 83 00 10 08 [ 17.125429] sdg: [ 17.125534] sd 0:0:1:3: [sdk] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 17.126113] sd 0:0:0:2: [sde] Attached SCSI disk [ 17.126129] sd 0:0:1:7: [sdl] Write cache: disabled, read cache: enabled, supports DPO and FUA [ 17.126727] sd 0:0:0:3: [sdf] Attached SCSI disk [ 17.127326] sd 0:0:0:7: [sdg] Attached SCSI disk [ 17.127664] sd 0:0:1:0: [sdh] Attached SCSI disk [ 17.128111] Dev sdj: unable to read RDB block 0 [ 17.128119] sdj: unable to read partition table [ 17.129907] sd 0:0:1:1: [sdi] Attached SCSI disk [ 17.131479] sdl: [ 17.131815] sd 0:0:1:2: [sdj] Attached SCSI disk [ 17.133228] sd 0:0:1:3: [sdk] Attached SCSI disk [ 17.134513] sd 0:0:1:7: [sdl] Attached SCSI disk [ 17.134967] sda: sda1 sda2 [ 17.135399] sd 1:0:0:0: [sda] Attached SCSI disk [ 17.143048] random: crng init done [ 17.405423] sd 0:0:0:1: [sdd] Write Protect is off [ 17.405425] sd 0:0:0:1: [sdd] Mode Sense: 83 00 10 08 [ 17.405645] sd 0:0:0:1: [sdd] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 17.407377] Dev sdd: unable to read RDB block 0 [ 17.407389] sdd: unable to read partition table [ 17.408708] sd 0:0:0:1: [sdd] Attached SCSI disk [ 19.484288] EXT4-fs (sda1): mounting ext3 file system using the ext4 subsystem [ 19.526607] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null) [ 20.020651] systemd-journald[283]: Received SIGTERM from PID 1 (systemd). [ 20.889315] SELinux: Disabled at runtime. [ 20.895289] SELinux: Unregistering netfilter hooks [ 20.954338] type=1404 audit(1518031397.957:2): selinux=0 auid=4294967295 ses=4294967295 [ 21.278185] ip_tables: (C) 2000-2006 Netfilter Core Team [ 21.285905] systemd[1]: Inserted module 'ip_tables' [ 23.233944] RPC: Registered named UNIX socket transport module. [ 23.241921] RPC: Registered udp transport module. [ 23.248364] RPC: Registered tcp transport module. [ 23.254785] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 24.106599] Installing knfsd (copyright (C) 1996 okir@monad.swb.de). [ 24.529686] EXT4-fs (sda1): re-mounted. Opts: (null) [ 24.600741] systemd-journald[673]: Received request to flush runtime journal from PID 1 [ 24.787713] device-mapper: uevent: version 1.0.3 [ 24.788215] device-mapper: ioctl: 4.35.0-ioctl (2016-06-23) initialised: dm-devel@redhat.com [ 25.411435] ioatdma: Intel(R) QuickData Technology Driver 4.00 [ 25.419113] ioatdma 0000:00:04.0: irq 165 for MSI/MSI-X [ 25.419851] igb 0000:02:00.0: DCA enabled [ 25.425509] igb 0000:02:00.1: DCA enabled [ 25.430993] ioatdma 0000:00:04.1: irq 167 for MSI/MSI-X [ 25.431661] igb 0000:02:00.2: DCA enabled [ 25.431735] igb 0000:02:00.3: DCA enabled [ 25.432004] ioatdma 0000:00:04.2: irq 168 for MSI/MSI-X [ 25.432654] ioatdma 0000:00:04.3: irq 169 for MSI/MSI-X [ 25.433259] wmi: Mapper loaded [ 25.433562] ioatdma 0000:00:04.4: irq 170 for MSI/MSI-X [ 25.434232] ioatdma 0000:00:04.5: irq 171 for MSI/MSI-X [ 25.435065] ioatdma 0000:00:04.6: irq 172 for MSI/MSI-X [ 25.435706] ioatdma 0000:00:04.7: irq 173 for MSI/MSI-X [ 25.436442] ioatdma 0000:80:04.0: irq 175 for MSI/MSI-X [ 25.437092] ioatdma 0000:80:04.1: irq 177 for MSI/MSI-X [ 25.437641] ioatdma 0000:80:04.2: irq 178 for MSI/MSI-X [ 25.438168] ioatdma 0000:80:04.3: irq 179 for MSI/MSI-X [ 25.438742] ioatdma 0000:80:04.4: irq 180 for MSI/MSI-X [ 25.439265] ioatdma 0000:80:04.5: irq 181 for MSI/MSI-X [ 25.439805] ioatdma 0000:80:04.6: irq 182 for MSI/MSI-X [ 25.440348] ioatdma 0000:80:04.7: irq 183 for MSI/MSI-X [ 25.468788] input: PC Speaker as /devices/platform/pcspkr/input/input3 [ 25.468998] ACPI Warning: SystemIO range 0x0000000000004000-0x000000000000401f conflicts with OpRegion 0x0000000000004000-0x000000000000400f (\_SB_.PCI0.SBUS.SMBI) (20130517/utaddress-254) [ 25.468999] ACPI: If an ACPI driver is available for this device, you should use it instead of the native driver [ 25.469240] i801_smbus 0000:07:00.3: SMBus using PCI interrupt [ 25.479633] ipmi message handler version 39.2 [ 25.712368] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 25.751635] mei_me 0000:00:16.0: Device doesn't have valid ME Interface [ 25.817802] ipmi device interface [ 26.077502] iTCO_vendor_support: vendor-support=0 [ 26.138200] sd 1:0:0:0: Attached scsi generic sg0 type 0 [ 26.138262] sd 1:0:1:0: Attached scsi generic sg1 type 0 [ 26.138321] sd 0:0:0:0: Attached scsi generic sg2 type 0 [ 26.138378] sd 0:0:0:1: Attached scsi generic sg3 type 0 [ 26.138434] sd 0:0:0:2: Attached scsi generic sg4 type 0 [ 26.138491] sd 0:0:0:3: Attached scsi generic sg5 type 0 [ 26.138555] sd 0:0:0:7: Attached scsi generic sg6 type 0 [ 26.138630] sd 0:0:1:0: Attached scsi generic sg7 type 0 [ 26.138687] sd 0:0:1:1: Attached scsi generic sg8 type 0 [ 26.138745] sd 0:0:1:2: Attached scsi generic sg9 type 0 [ 26.138804] sd 0:0:1:3: Attached scsi generic sg10 type 0 [ 26.138863] sd 0:0:1:7: Attached scsi generic sg11 type 0 [ 26.191813] iTCO_wdt: Intel TCO WatchDog Timer Driver v1.11 [ 26.191855] iTCO_wdt: unable to reset NO_REBOOT flag, device disabled by hardware/BIOS [ 26.287899] IPMI System Interface driver. [ 26.293593] ipmi_si: probing via SMBIOS [ 26.299005] ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0 [ 26.306678] ipmi_si: Adding SMBIOS-specified kcs state machine [ 26.314177] ipmi_si: probing via SPMI [ 26.319320] ipmi_si: SPMI: io 0xca2 regsize 1 spacing 1 irq 0 [ 26.326449] ipmi_si: Adding SPMI-specified kcs state machine duplicate interface [ 26.333615] ipmi_si: Trying SMBIOS-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0 [ 26.391045] ipmi_si ipmi_si.0: Found new BMC (man_id: 0x000157, prod_id: 0x0049, dev_id: 0x21) [ 26.401715] ipmi_si ipmi_si.0: IPMI kcs interface initialized [ 26.477467] IPMI SSIF Interface driver [ 26.872801] sd 0:0:0:2: [sde] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE [ 26.882600] sd 0:0:0:2: [sde] Sense Key : Illegal Request [current] [ 26.890815] sd 0:0:0:2: [sde] <>ASC=0x94 ASCQ=0x1 [ 26.898051] sd 0:0:0:2: [sde] CDB: Read(16) 88 00 00 00 00 01 a0 6e 3f 80 00 00 00 08 00 00 [ 26.908502] blk_update_request: I/O error, dev sde, sector 6986547072 [ 26.916843] sd 0:0:0:0: [sdc] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE [ 26.927233] sd 0:0:0:0: [sdc] Sense Key : Illegal Request [current] [ 26.936071] sd 0:0:0:0: [sdc] <>ASC=0x94 ASCQ=0x1 [ 26.943924] sd 0:0:0:0: [sdc] CDB: Read(16) 88 00 00 00 00 01 a0 6e 3f 80 00 00 00 08 00 00 [ 26.955042] blk_update_request: I/O error, dev sdc, sector 6986547072 [ 27.025466] device-mapper: multipath round-robin: version 1.2.0 loaded [ 27.265087] AES CTR mode by8 optimization enabled [ 27.276081] alg: No test for __gcm-aes-aesni (__driver-gcm-aes-aesni) [ 27.584168] sd 0:0:1:2: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command [ 27.607996] alg: No test for crc32 (crc32-pclmul) [ 27.621433] device-mapper: table: 253:5: multipath: error getting device [ 27.629719] device-mapper: ioctl: error adding target to table [ 28.100045] sd 0:0:1:0: [sdh] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE [ 28.110468] sd 0:0:1:0: [sdh] Sense Key : Illegal Request [current] [ 28.119288] sd 0:0:1:0: [sdh] <>ASC=0x94 ASCQ=0x1 [ 28.127101] sd 0:0:1:0: [sdh] CDB: Read(16) 88 00 00 00 00 01 a0 6e 3f 80 00 00 00 08 00 00 [ 28.138144] blk_update_request: I/O error, dev sdh, sector 6986547072 [ 28.147096] device-mapper: multipath: Failing path 8:112. [ 28.334530] sd 0:0:1:2: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT completed [ 28.344980] sd 0:0:0:3: rdac: array soak-netapp2624-1, ctlr 0, queueing MODE_SELECT command [ 28.608569] kvm: disabled by bios [ 28.619561] kvm: disabled by bios [ 28.630781] kvm: disabled by bios [ 28.645585] kvm: disabled by bios [ 28.657381] kvm: disabled by bios [ 28.688805] intel_rapl: Found RAPL domain package [ 28.695196] intel_rapl: Found RAPL domain core [ 28.701115] intel_rapl: Found RAPL domain dram [ 28.707072] intel_rapl: Found RAPL domain package [ 28.713297] intel_rapl: Found RAPL domain core [ 28.713337] intel_rapl: Found RAPL domain dram [ 28.752400] Adding 16319484k swap on /dev/sda2. Priority:-1 extents:1 across:16319484k FS [ 28.966481] EDAC MC: Ver: 3.0.0 [ 28.995255] EDAC sbridge: Seeking for: PCI ID 8086:3ca0 [ 28.995289] EDAC sbridge: Seeking for: PCI ID 8086:3ca0 [ 28.995298] EDAC sbridge: Seeking for: PCI ID 8086:3ca0 [ 28.995302] EDAC sbridge: Seeking for: PCI ID 8086:3ca8 [ 28.995309] EDAC sbridge: Seeking for: PCI ID 8086:3ca8 [ 28.995315] EDAC sbridge: Seeking for: PCI ID 8086:3ca8 [ 28.995318] EDAC sbridge: Seeking for: PCI ID 8086:3c71 [ 28.995337] EDAC sbridge: Seeking for: PCI ID 8086:3c71 [ 28.995342] EDAC sbridge: Seeking for: PCI ID 8086:3c71 [ 28.995345] EDAC sbridge: Seeking for: PCI ID 8086:3caa [ 28.995352] EDAC sbridge: Seeking for: PCI ID 8086:3caa [ 28.995358] EDAC sbridge: Seeking for: PCI ID 8086:3caa [ 28.995360] EDAC sbridge: Seeking for: PCI ID 8086:3cab [ 28.995367] EDAC sbridge: Seeking for: PCI ID 8086:3cab [ 28.995372] EDAC sbridge: Seeking for: PCI ID 8086:3cab [ 28.995375] EDAC sbridge: Seeking for: PCI ID 8086:3cac [ 28.995382] EDAC sbridge: Seeking for: PCI ID 8086:3cac [ 28.995387] EDAC sbridge: Seeking for: PCI ID 8086:3cac [ 28.995389] EDAC sbridge: Seeking for: PCI ID 8086:3cad [ 28.995397] EDAC sbridge: Seeking for: PCI ID 8086:3cad [ 28.995402] EDAC sbridge: Seeking for: PCI ID 8086:3cad [ 28.995404] EDAC sbridge: Seeking for: PCI ID 8086:3cb8 [ 28.995412] EDAC sbridge: Seeking for: PCI ID 8086:3cb8 [ 28.995418] EDAC sbridge: Seeking for: PCI ID 8086:3cb8 [ 28.995419] EDAC sbridge: Seeking for: PCI ID 8086:3cf4 [ 28.995426] EDAC sbridge: Seeking for: PCI ID 8086:3cf4 [ 28.995431] EDAC sbridge: Seeking for: PCI ID 8086:3cf4 [ 28.995434] EDAC sbridge: Seeking for: PCI ID 8086:3cf6 [ 28.995440] EDAC sbridge: Seeking for: PCI ID 8086:3cf6 [ 28.995445] EDAC sbridge: Seeking for: PCI ID 8086:3cf6 [ 28.995448] EDAC sbridge: Seeking for: PCI ID 8086:3cf5 [ 28.995455] EDAC sbridge: Seeking for: PCI ID 8086:3cf5 [ 28.995460] EDAC sbridge: Seeking for: PCI ID 8086:3cf5 [ 28.995654] EDAC MC0: Giving out device to 'sbridge_edac.c' 'Sandy Bridge Socket#0': DEV 0000:7f:0e.0 [ 29.007385] EDAC MC1: Giving out device to 'sbridge_edac.c' 'Sandy Bridge Socket#1': DEV 0000:ff:0e.0 [ 29.018897] EDAC sbridge: Ver: 1.1.1 [ 29.036642] sd 0:0:0:3: rdac: array soak-netapp2624-1, ctlr 0, MODE_SELECT completed [ 29.046150] sd 0:0:0:2: rdac: array soak-netapp2624-1, ctlr 0, queueing MODE_SELECT command [ 29.769962] sd 0:0:0:2: rdac: array soak-netapp2624-1, ctlr 0, MODE_SELECT completed [ 29.779437] sd 0:0:1:1: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command [ 30.444284] sd 0:0:1:1: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT completed [ 31.745194] sd 0:0:1:2: [sdj] FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE [ 31.755693] sd 0:0:1:2: [sdj] Sense Key : Illegal Request [current] [ 31.764585] sd 0:0:1:2: [sdj] <>ASC=0x94 ASCQ=0x1 [ 31.772478] sd 0:0:1:2: [sdj] CDB: Read(16) 88 00 00 00 00 00 00 00 00 00 00 00 00 08 00 00 [ 31.783601] blk_update_request: I/O error, dev sdj, sector 0 [ 32.300032] type=1305 audit(1518031409.302:3): audit_pid=1077 old=0 auid=4294967295 ses=4294967295 res=1 [ 32.791493] device-mapper: multipath: Reinstating path 8:112. [ 32.791809] device-mapper: multipath: Failing path 8:112. [ 33.542739] IPv6: ADDRCONF(NETDEV_UP): eth0: link is not ready [ 33.631350] igb 0000:02:00.0 eth0: igb: eth0 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX [ 33.640633] IPv6: ADDRCONF(NETDEV_UP): eth1: link is not ready [ 33.722816] IPv6: ADDRCONF(NETDEV_UP): eth1: link is not ready [ 33.734169] IPv6: ADDRCONF(NETDEV_UP): eth2: link is not ready [ 33.852674] IPv6: ADDRCONF(NETDEV_UP): eth2: link is not ready [ 33.864045] IPv6: ADDRCONF(NETDEV_UP): eth3: link is not ready [ 33.877187] mlx4_en: Mellanox ConnectX HCA Ethernet driver v4.2-1.2.0 [ 33.982576] IPv6: ADDRCONF(NETDEV_UP): eth3: link is not ready [ 34.835626] card: mlx4_0, QP: 0x220, inline size: 120 [ 34.860791] card: mlx4_0, QP: 0x300, inline size: 120 [ 34.949221] ib0: enabling connected mode will cause multicast packet drops [ 34.957962] ib0: mtu > 4092 will cause multicast packet drops. [ 34.987765] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready [ 35.012514] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready [ 35.023685] IPv6: ADDRCONF(NETDEV_UP): ib1: link is not ready [ 35.047333] IPv6: ADDRCONF(NETDEV_UP): ib1: link is not ready [ 37.794756] device-mapper: multipath: Reinstating path 8:112. [ 37.802883] device-mapper: multipath: Failing path 8:112. [ 41.677368] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready [ 41.737141] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready [ 41.747347] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready [ 41.959353] FS-Cache: Loaded [ 42.004906] FS-Cache: Netfs 'nfs' registered for caching [ 42.018286] Key type dns_resolver registered [ 42.045826] NFS: Registering the id_resolver key type [ 42.045832] Key type id_resolver registered [ 42.045833] Key type id_legacy registered [ 42.808486] device-mapper: multipath: Reinstating path 8:112. [ 42.815970] device-mapper: multipath: Failing path 8:112. [ 47.818814] device-mapper: multipath: Reinstating path 8:112. [ 47.825535] device-mapper: multipath: Failing path 8:112. [ 52.827404] device-mapper: multipath: Reinstating path 8:112. [ 52.834100] device-mapper: multipath: Failing path 8:112. [ 589.118255] IPv6: ADDRCONF(NETDEV_CHANGE): ib0: link becomes ready [ 611.570673] LNet: HW NUMA nodes: 2, HW CPU cores: 32, npartitions: 2 [ 611.594918] alg: No test for adler32 (adler32-zlib) [ 611.611202] alg: No test for crc32 (crc32-table) [ 612.473516] Lustre: Lustre: Build Version: 2.10.57_58_gcd8a85a [ 612.643847] LNet: Using FMR for registration [ 612.671224] LNet: Added LNI 192.168.1.109@o2ib [8/256/0/180] [ 9659.292905] SPL: Loaded module v0.7.3-1 [ 9659.363346] znvpair: module license 'CDDL' taints kernel. [ 9659.428005] Disabling lock debugging due to kernel taint [ 9661.281271] ZFS: Loaded module v0.7.3-1, ZFS pool version 5000, ZFS filesystem version 5 [ 9661.742363] LDISKFS-fs warning (device dm-4): ldiskfs_multi_mount_protect:322: MMP interval 42 higher than expected, please wait. [ 9715.579236] LDISKFS-fs (dm-4): recovery complete [ 9715.634888] LDISKFS-fs (dm-4): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,user_xattr,no_mbcache,nodelalloc [ 9716.618064] Lustre: MGS: Connection restored to 7a7deb8b-7071-6d6f-4204-cb4120095c9b (at 0@lo) [ 9717.975176] Lustre: soaked-MDT0000: Imperative Recovery not enabled, recovery window 300-900 [ 9718.017880] Lustre: MGS: Connection restored to ed5cd75d-fa48-40a0-ab52-2521e445f3ad (at 192.168.1.129@o2ib) [ 9718.235936] Lustre: soaked-MDT0000: in recovery but waiting for the first client to connect [ 9718.534815] Lustre: soaked-MDT0000: Will be in recovery for at least 5:00, or until 29 clients reconnect [ 9719.098291] Lustre: soaked-MDT0000: Connection restored to c71da41a-3fb2-8b64-c531-7c1ee29ba5e7 (at 192.168.1.131@o2ib) [ 9719.227442] Lustre: Skipped 5 previous similar messages [ 9725.202495] Lustre: MGS: Connection restored to d30060ce-9d00-0dbe-226c-106a01bf1630 (at 192.168.1.120@o2ib) [ 9725.320275] Lustre: Skipped 2 previous similar messages [ 9730.380697] Lustre: MGS: Connection restored to 26a620d5-4757-cf06-8d2e-97bbb31835c5 (at 192.168.1.135@o2ib) [ 9730.498459] Lustre: Skipped 3 previous similar messages [ 9741.659333] Lustre: soaked-MDT0000: Connection restored to c9e3038f-481a-18cb-0978-603ed0904f4c (at 192.168.1.137@o2ib) [ 9741.788524] Lustre: Skipped 8 previous similar messages [ 9760.262441] Lustre: MGS: Connection restored to 192.168.1.102@o2ib (at 192.168.1.102@o2ib) [ 9760.361601] Lustre: Skipped 17 previous similar messages [ 9771.751691] LNet: 2245:0:(o2iblnd_cb.c:3294:kiblnd_check_conns()) Timed out tx for 192.168.1.108@o2ib: 3 seconds [ 9792.957330] Lustre: soaked-MDT0000: Connection restored to 7a7deb8b-7071-6d6f-4204-cb4120095c9b (at 0@lo) [ 9793.071935] Lustre: Skipped 23 previous similar messages [ 9837.788124] Lustre: soaked-MDT0000: Recovery over after 1:59, of 29 clients 29 recovered and 0 were evicted. [ 9842.461172] Lustre: Failing over soaked-MDT0000 [ 9842.804824] LustreError: 3494:0:(lod_dev.c:1688:lod_device_free()) header@ffff880823219740[0x0, 1, [0x1:0x0:0x0] hash exist]{ [ 9842.816853] Lustre: soaked-MDT0000: Not available for connect from 192.168.1.124@o2ib (stopping) [ 9843.065514] LustreError: 3494:0:(lod_dev.c:1688:lod_device_free()) ....local_storage@ffff880823219790 [ 9843.199061] LustreError: 3494:0:(lod_dev.c:1688:lod_device_free()) ....osd-ldiskfs@ffff8807f9bf1600osd-ldiskfs-object@ffff8807f9bf1600(i:ffff8803dd650520:79/234542790)[plain] [ 9843.411532] LustreError: 3494:0:(lod_dev.c:1688:lod_device_free()) } header@ffff880823219740 [ 9843.536639] LustreError: 3494:0:(lod_dev.c:1688:lod_device_free()) header@ffff8808232192c0[0x0, 1, [0x200000003:0x0:0x0] hash exist]{ [ 9843.706836] LustreError: 3494:0:(lod_dev.c:1688:lod_device_free()) ....local_storage@ffff880823219310 [ 9843.840720] LustreError: 3494:0:(lod_dev.c:1688:lod_device_free()) ....osd-ldiskfs@ffff8807f9bf0600osd-ldiskfs-object@ffff8807f9bf0600(i:ffff8803dd6472d0:77/234542754)[plain] [ 9844.053928] LustreError: 3494:0:(lod_dev.c:1688:lod_device_free()) } header@ffff8808232192c0 [ 9844.179732] LustreError: 3494:0:(lod_dev.c:1688:lod_device_free()) header@ffff880823219500[0x0, 1, [0x200000003:0x2:0x0] hash exist]{ [ 9844.350512] LustreError: 3494:0:(lod_dev.c:1688:lod_device_free()) ....local_storage@ffff880823219550 [ 9844.484922] LustreError: 3494:0:(lod_dev.c:1688:lod_device_free()) ....osd-ldiskfs@ffff8807f9bf1100osd-ldiskfs-object@ffff8807f9bf1100(i:ffff8803dd623388:78/234542755)[lfix] [ 9844.697399] LustreError: 3494:0:(lod_dev.c:1688:lod_device_free()) } header@ffff880823219500 [ 9844.822779] LustreError: 3494:0:(lod_dev.c:1688:lod_device_free()) header@ffff880823218900[0x0, 1, [0x200000003:0x3:0x0] hash exist]{ [ 9844.993615] LustreError: 3494:0:(lod_dev.c:1688:lod_device_free()) ....local_storage@ffff880823218950 [ 9845.048240] Lustre: soaked-MDT0000: Not available for connect from 192.168.1.106@o2ib (stopping) [ 9845.048241] Lustre: soaked-MDT0000: Not available for connect from 192.168.1.106@o2ib (stopping) [ 9845.048243] Lustre: Skipped 6 previous similar messages [ 9845.048244] Lustre: Skipped 6 previous similar messages [ 9845.475644] LustreError: 3494:0:(lod_dev.c:1688:lod_device_free()) ....osd-ldiskfs@ffff8807f9bf1300osd-ldiskfs-object@ffff8807f9bf1300(i:ffff8803dd5ef708:354418689/234542756)[plain] [ 9845.695969] LustreError: 3494:0:(lod_dev.c:1688:lod_device_free()) } header@ffff880823218900 [ 9845.821933] LustreError: 3494:0:(lod_dev.c:1688:lod_device_free()) header@ffff880823219800[0x0, 1, [0xa:0x0:0x0] hash exist]{ [ 9845.980998] LustreError: 3494:0:(lod_dev.c:1688:lod_device_free()) ....local_storage@ffff880823219850 [ 9846.115070] LustreError: 3494:0:(lod_dev.c:1688:lod_device_free()) ....osd-ldiskfs@ffff8807f9bf3f00osd-ldiskfs-object@ffff8807f9bf3f00(i:ffff8803dd659600:80/234542824)[plain] [ 9846.328115] LustreError: 3494:0:(lod_dev.c:1688:lod_device_free()) } header@ffff880823219800 [ 9846.457876] LustreError: 3494:0:(lod_dev.c:1688:lod_device_free()) header@ffff880823219440[0x1, 1, [0x200000001:0x1017:0x0] hash exist]{ [ 9846.631348] LustreError: 3494:0:(lod_dev.c:1688:lod_device_free()) ....local_storage@ffff880823219490 [ 9846.765436] LustreError: 3494:0:(lod_dev.c:1688:lod_device_free()) ....osd-ldiskfs@ffff8807f9bf1200osd-ldiskfs-object@ffff8807f9bf1200(i:ffff8803dd5ec030:326107137/3497924257)[plain] [ 9846.784444] Lustre: soaked-MDT0000: Not available for connect from 192.168.1.116@o2ib (stopping) [ 9846.784447] Lustre: Skipped 1 previous similar message [ 9847.159423] LustreError: 3494:0:(lod_dev.c:1688:lod_device_free()) } header@ffff880823219440 [ 9847.528665] LustreError: 137-5: soaked-MDT0000_UUID: not available for connect from 192.168.1.135@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9848.077164] LustreError: 137-5: soaked-MDT0000_UUID: not available for connect from 192.168.1.141@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9851.016613] LustreError: 137-5: soaked-MDT0000_UUID: not available for connect from 192.168.1.107@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server. [ 9851.235180] LustreError: Skipped 9 previous similar messages [ 9853.403719] Lustre: 3494:0:(client.c:2100:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1518041224/real 1518041224] req@ffff8800a3477b00 x1591771914282576/t0(0) o251->MGC192.168.1.109@o2ib@0@lo:26/25 lens 224/224 e 0 to 1 dl 1518041230 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1 [ 9853.893834] Lustre: server umount soaked-MDT0000 complete [31781.443242] LDISKFS-fs warning (device dm-4): ldiskfs_multi_mount_protect:322: MMP interval 42 higher than expected, please wait. [31830.412492] LDISKFS-fs (dm-4): recovery complete [31830.429534] LDISKFS-fs (dm-4): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,user_xattr,no_mbcache,nodelalloc [31831.267313] Lustre: MGS: Connection restored to 7a7deb8b-7071-6d6f-4204-cb4120095c9b (at 0@lo) [31831.298307] Lustre: Skipped 23 previous similar messages [31832.360694] Lustre: soaked-MDT0000: Imperative Recovery not enabled, recovery window 300-900 [31832.424314] Lustre: soaked-MDT0000: in recovery but waiting for the first client to connect [31832.621971] Lustre: soaked-MDT0000: Will be in recovery for at least 5:00, or until 29 clients reconnect [31841.527450] Lustre: MGS: Connection restored to bafa37f7-76ed-e4d7-7443-fc74dd1aead6 (at 192.168.1.118@o2ib) [31841.563039] Lustre: Skipped 13 previous similar messages [31858.894071] Lustre: MGS: Connection restored to 9eb9e6e8-d1b6-9f5d-3970-c9a5ec8c4e55 (at 192.168.1.144@o2ib) [31858.929631] Lustre: Skipped 35 previous similar messages [31891.014414] LNet: 2245:0:(o2iblnd_cb.c:3294:kiblnd_check_conns()) Timed out tx for 192.168.1.108@o2ib: 8 seconds [31891.474481] Lustre: soaked-MDT0000: Connection restored to dd74b0f0-5394-a791-e547-7cdc7c12cb4f (at 192.168.1.136@o2ib) [31891.513192] Lustre: Skipped 33 previous similar messages [31914.402622] Lustre: soaked-MDT0000: Recovery over after 1:22, of 29 clients 29 recovered and 0 were evicted. [31925.744947] Lustre: Failing over soaked-MDT0000 [31925.778298] LustreError: 6219:0:(osp_precreate.c:645:osp_precreate_send()) soaked-OST0002-osc-MDT0000: can't precreate: rc = -5 [31925.778307] LustreError: 6219:0:(osp_precreate.c:1285:osp_precreate_thread()) soaked-OST0002-osc-MDT0000: cannot precreate objects: rc = -5 [31925.778438] LustreError: 6221:0:(osp_precreate.c:929:osp_precreate_cleanup_orphans()) soaked-OST0003-osc-MDT0000: cannot cleanup orphans: rc = -5 [31925.872165] LustreError: 6496:0:(ldlm_resource.c:1093:ldlm_resource_complain()) mdt-soaked-MDT0000_UUID: namespace resource [0x20007dcb9:0x8ec8:0x0].0x0 (ffff88082add2a80) refcount nonzero (2) after lock cleanup; forcing cleanup. [31925.872170] LustreError: 6496:0:(ldlm_resource.c:1669:ldlm_resource_dump()) --- Resource: [0x20007dcb9:0x8ec8:0x0].0x0 (ffff88082add2a80) refcount = 3 [31925.872173] LustreError: 6496:0:(ldlm_resource.c:1672:ldlm_resource_dump()) Granted locks (in reverse order): [31925.872183] LustreError: 6496:0:(ldlm_resource.c:1675:ldlm_resource_dump()) ### ### ns: mdt-soaked-MDT0000_UUID lock: ffff8807e42dbcc0/0xb208a0fe58ed6fc5 lrc: 2/0,1 mode: CW/CW res: [0x20007dcb9:0x8ec8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40316400000000 nid: local remote: 0x0 expref: -99 pid: 6452 timeout: 0 lvb_type: 0 [31925.872245] LustreError: 6496:0:(ldlm_resource.c:1669:ldlm_resource_dump()) --- Resource: [0x20007dce0:0xfa8:0x0].0x55708479 (ffff8807dc25ca80) refcount = 2 [31925.872247] LustreError: 6496:0:(ldlm_resource.c:1672:ldlm_resource_dump()) Granted locks (in reverse order): [31925.872523] LustreError: 6496:0:(ldlm_resource.c:1669:ldlm_resource_dump()) --- Resource: [0x20007dd17:0xd26d:0x0].0x0 (ffff8807e0883080) refcount = 3 [31925.872525] LustreError: 6496:0:(ldlm_resource.c:1672:ldlm_resource_dump()) Granted locks (in reverse order): [31925.872599] LustreError: 6496:0:(ldlm_resource.c:1669:ldlm_resource_dump()) --- Resource: [0x20007dcde:0x135e6:0x0].0x44f17e40 (ffff8803e0b25080) refcount = 2 [31925.872600] LustreError: 6496:0:(ldlm_resource.c:1672:ldlm_resource_dump()) Granted locks (in reverse order): [31925.873071] LustreError: 6496:0:(ldlm_resource.c:1669:ldlm_resource_dump()) --- Resource: [0x20007dce0:0xfa8:0x0].0x0 (ffff8807e2006600) refcount = 3 [31925.873073] LustreError: 6496:0:(ldlm_resource.c:1672:ldlm_resource_dump()) Granted locks (in reverse order): [31925.873596] LustreError: 6496:0:(ldlm_resource.c:1669:ldlm_resource_dump()) --- Resource: [0x20007dc9a:0xa42a:0x0].0x3174bcc9 (ffff8807dfcc3740) refcount = 2 [31925.873598] LustreError: 6496:0:(ldlm_resource.c:1672:ldlm_resource_dump()) Granted locks (in reverse order): [31925.873719] LustreError: 6496:0:(ldlm_resource.c:1669:ldlm_resource_dump()) --- Resource: [0x20007dd17:0xf02f:0x0].0x31748cc8 (ffff8803cdd05800) refcount = 2 [31925.873721] LustreError: 6496:0:(ldlm_resource.c:1672:ldlm_resource_dump()) Granted locks (in reverse order): [31925.875587] LustreError: 6496:0:(ldlm_resource.c:1669:ldlm_resource_dump()) --- Resource: [0x20007dcec:0x1e6ca:0x0].0x7c9101e8 (ffff8807dc3f3ec0) refcount = 2 [31925.875589] LustreError: 6496:0:(ldlm_resource.c:1672:ldlm_resource_dump()) Granted locks (in reverse order): [31925.878252] LustreError: 6496:0:(ldlm_resource.c:1669:ldlm_resource_dump()) --- Resource: [0x20007dcec:0x1e6ca:0x0].0x0 (ffff8807dc3f2840) refcount = 3 [31925.878254] LustreError: 6496:0:(ldlm_resource.c:1672:ldlm_resource_dump()) Granted locks (in reverse order): [31925.879036] LustreError: 6496:0:(ldlm_resource.c:1669:ldlm_resource_dump()) --- Resource: [0x20007dcb9:0x8ec8:0x0].0xe20c743c (ffff8807e1859ec0) refcount = 2 [31925.879038] LustreError: 6496:0:(ldlm_resource.c:1672:ldlm_resource_dump()) Granted locks (in reverse order): [31925.879748] LustreError: 6496:0:(ldlm_resource.c:1669:ldlm_resource_dump()) --- Resource: [0x20007dc9a:0xa42a:0x0].0x0 (ffff8807dc0c89c0) refcount = 3 [31925.879750] LustreError: 6496:0:(ldlm_resource.c:1672:ldlm_resource_dump()) Granted locks (in reverse order): [31925.879834] LustreError: 6496:0:(ldlm_resource.c:1669:ldlm_resource_dump()) --- Resource: [0x20007dcde:0x135e6:0x0].0x0 (ffff8803e0b24540) refcount = 3 [31925.879836] LustreError: 6496:0:(ldlm_resource.c:1672:ldlm_resource_dump()) Granted locks (in reverse order): [31925.879997] LustreError: 6496:0:(ldlm_resource.c:1669:ldlm_resource_dump()) --- Resource: [0x20007dd17:0xf02f:0x0].0x0 (ffff880415239800) refcount = 3 [31925.879999] LustreError: 6496:0:(ldlm_resource.c:1672:ldlm_resource_dump()) Granted locks (in reverse order): [31925.884042] LustreError: 6496:0:(ldlm_resource.c:1669:ldlm_resource_dump()) --- Resource: [0x20007dd17:0xd26d:0x0].0x7c9101e8 (ffff8803e0b0b440) refcount = 2 [31925.884044] LustreError: 6496:0:(ldlm_resource.c:1672:ldlm_resource_dump()) Granted locks (in reverse order): [31926.109393] Lustre: soaked-MDT0000: Not available for connect from 192.168.1.117@o2ib (stopping) [31928.099533] Lustre: soaked-MDT0000: Not available for connect from 192.168.1.104@o2ib (stopping) [31928.131779] Lustre: Skipped 1 previous similar message [31929.549257] Lustre: soaked-MDT0000: Not available for connect from 192.168.1.142@o2ib (stopping) [31929.581360] Lustre: Skipped 2 previous similar messages [31933.953582] Lustre: soaked-MDT0000: Not available for connect from 192.168.1.144@o2ib (stopping) [31933.985817] Lustre: Skipped 5 previous similar messages [31941.706911] Lustre: soaked-MDT0000: Not available for connect from 192.168.1.137@o2ib (stopping) [31941.738860] Lustre: Skipped 2 previous similar messages [31949.813956] Lustre: soaked-MDT0000: Not available for connect from 192.168.1.121@o2ib (stopping) [31949.846007] Lustre: Skipped 16 previous similar messages [31950.886092] LustreError: 0-0: Forced cleanup waiting for mdt-soaked-MDT0000_UUID namespace with 11 resources in use, (rc=-110) [31966.741114] Lustre: soaked-MDT0000: Not available for connect from 192.168.1.118@o2ib (stopping) [31966.773389] Lustre: Skipped 10 previous similar messages [31975.929382] LustreError: 0-0: Forced cleanup waiting for mdt-soaked-MDT0000_UUID namespace with 11 resources in use, (rc=-110) [32000.972873] LustreError: 0-0: Forced cleanup waiting for mdt-soaked-MDT0000_UUID namespace with 11 resources in use, (rc=-110) [32005.547280] Lustre: soaked-MDT0000: Not available for connect from 192.168.1.105@o2ib (stopping) [32005.579417] Lustre: Skipped 6 previous similar messages [32014.523656] LustreError: 6304:0:(lod_qos.c:208:lod_statfs_and_check()) soaked-MDT0000-mdtlov: statfs: rc = -108 [32014.560260] Lustre: 6304:0:(service.c:2132:ptlrpc_server_handle_request()) @@@ Request took longer than estimated (57:43s); client may timeout. req@ffff8807e5b4f500 x1591774541468496/t0(0) o101->0d0d1124-f9c2-48b7-e4d9-3ef82f4c9fc5@192.168.1.117@o2ib:703/0 lens 1280/544 e 0 to 0 dl 1518063348 ref 1 fl Complete:/0/0 rc -19/-19 [32014.783388] LustreError: 6354:0:(ldlm_lockd.c:1362:ldlm_handle_enqueue0()) ### lock on destroyed export ffff8803e0074800 ns: mdt-soaked-MDT0000_UUID lock: ffff8803cf6fcec0/0xb208a0fe58ef8a47 lrc: 3/0,0 mode: CR/CR res: [0x20007dd20:0x198e1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50200000000000 nid: 192.168.1.128@o2ib remote: 0x6986cad9989895b4 expref: 7 pid: 6354 timeout: 0 lvb_type: 0 [32015.161878] LustreError: 6181:0:(lod_qos.c:208:lod_statfs_and_check()) soaked-MDT0000-mdtlov: statfs: rc = -108 [32015.198460] LustreError: 6181:0:(lod_qos.c:208:lod_statfs_and_check()) Skipped 92 previous similar messages [32015.234155] Lustre: 6181:0:(service.c:2132:ptlrpc_server_handle_request()) @@@ Request took longer than estimated (56:44s); client may timeout. req@ffff8803e4132400 x1591773125500688/t1065151954315(0) o101->fd75d2ff-51a5-bc15-b010-e8768792a1d9@192.168.1.128@o2ib:702/0 lens 1272/544 e 0 to 0 dl 1518063347 ref 1 fl Complete:/0/0 rc -19/-19 [32015.342950] Lustre: 6181:0:(service.c:2132:ptlrpc_server_handle_request()) Skipped 4 previous similar messages [32021.267659] LustreError: 6496:0:(lod_dev.c:1688:lod_device_free()) header@ffff8807e61e2780[0x0, 1, [0x1:0x0:0x0] hash exist]{ [32021.315697] LustreError: 6496:0:(lod_dev.c:1688:lod_device_free()) ....local_storage@ffff8807e61e27d0 [32021.357540] LustreError: 6496:0:(lod_dev.c:1688:lod_device_free()) ....osd-ldiskfs@ffff8803ce5d4400osd-ldiskfs-object@ffff8803ce5d4400(i:ffff8803cd7372d0:79/234542790)[plain] [32021.423583] LustreError: 6496:0:(lod_dev.c:1688:lod_device_free()) } header@ffff8807e61e2780 [32021.463296] LustreError: 6496:0:(lod_dev.c:1688:lod_device_free()) header@ffff8807e3f09a40[0x0, 1, [0x200000003:0x0:0x0] hash exist]{ [32021.517487] LustreError: 6496:0:(lod_dev.c:1688:lod_device_free()) ....local_storage@ffff8807e3f09a90 [32021.559244] LustreError: 6496:0:(lod_dev.c:1688:lod_device_free()) ....osd-ldiskfs@ffff8803ce5d7b00osd-ldiskfs-object@ffff8803ce5d7b00(i:ffff8800a3846e98:77/234542754)[plain] [32021.625345] LustreError: 6496:0:(lod_dev.c:1688:lod_device_free()) } header@ffff8807e3f09a40 [32021.665419] LustreError: 6496:0:(lod_dev.c:1688:lod_device_free()) header@ffff8807e3f09ec0[0x0, 1, [0x200000003:0x2:0x0] hash exist]{ [32021.719829] LustreError: 6496:0:(lod_dev.c:1688:lod_device_free()) ....local_storage@ffff8807e3f09f10 [32021.761720] LustreError: 6496:0:(lod_dev.c:1688:lod_device_free()) ....osd-ldiskfs@ffff8803ce5d4100osd-ldiskfs-object@ffff8803ce5d4100(i:ffff8803cd6f4030:78/234542755)[lfix] [32021.827517] LustreError: 6496:0:(lod_dev.c:1688:lod_device_free()) } header@ffff8807e3f09ec0 [32021.867137] LustreError: 6496:0:(lod_dev.c:1688:lod_device_free()) header@ffff8807e61e20c0[0x0, 1, [0x200000003:0x3:0x0] hash exist]{ [32021.921225] LustreError: 6496:0:(lod_dev.c:1688:lod_device_free()) ....local_storage@ffff8807e61e2110 [32021.962894] LustreError: 6496:0:(lod_dev.c:1688:lod_device_free()) ....osd-ldiskfs@ffff8803ce5d4300osd-ldiskfs-object@ffff8803ce5d4300(i:ffff8803cd6f4cd8:354418689/234542756)[plain] [32022.030619] LustreError: 6496:0:(lod_dev.c:1688:lod_device_free()) } header@ffff8807e61e20c0 [32022.070774] LustreError: 6496:0:(lod_dev.c:1688:lod_device_free()) header@ffff8807e61e26c0[0x0, 1, [0xa:0x0:0x0] hash exist]{ [32022.119107] LustreError: 6496:0:(lod_dev.c:1688:lod_device_free()) ....local_storage@ffff8807e61e2710 [32022.160548] LustreError: 6496:0:(lod_dev.c:1688:lod_device_free()) ....osd-ldiskfs@ffff8803ce5d4600osd-ldiskfs-object@ffff8803ce5d4600(i:ffff8803cd755980:80/234542824)[plain] [32022.225964] LustreError: 6496:0:(lod_dev.c:1688:lod_device_free()) } header@ffff8807e61e26c0 [32022.269760] LustreError: 6496:0:(lod_dev.c:1688:lod_device_free()) header@ffff8807e3f09740[0x1, 1, [0x200000001:0x1017:0x0] hash exist]{ [32022.324092] LustreError: 6496:0:(lod_dev.c:1688:lod_device_free()) ....local_storage@ffff8807e3f09790 [32022.365305] LustreError: 6496:0:(lod_dev.c:1688:lod_device_free()) ....osd-ldiskfs@ffff8803ce5d4000osd-ldiskfs-object@ffff8803ce5d4000(i:ffff8803cd74b7c0:326107137/3497924257)[plain] [32022.432767] LustreError: 6496:0:(lod_dev.c:1688:lod_device_free()) } header@ffff8807e3f09740 [32023.216840] LustreError: 137-5: soaked-MDT0000_UUID: not available for connect from 192.168.1.126@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server. [32023.928347] LustreError: 137-5: soaked-MDT0000_UUID: not available for connect from 192.168.1.127@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server. [32028.100856] LustreError: 137-5: soaked-MDT0000_UUID: not available for connect from 192.168.1.104@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server. [32028.165547] LustreError: Skipped 11 previous similar messages [32028.593053] Lustre: 6496:0:(client.c:2100:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1518063399/real 1518063399] req@ffff8800a5292d00 x1591771914990880/t0(0) o251->MGC192.168.1.109@o2ib@0@lo:26/25 lens 224/224 e 0 to 1 dl 1518063405 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1 [32028.852390] Lustre: server umount soaked-MDT0000 complete [38008.457027] LDISKFS-fs warning (device dm-4): ldiskfs_multi_mount_protect:322: MMP interval 42 higher than expected, please wait. [38053.120440] LDISKFS-fs (dm-4): recovery complete [38053.177510] LDISKFS-fs (dm-4): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,user_xattr,no_mbcache,nodelalloc [38054.246242] Lustre: MGS: Connection restored to 7a7deb8b-7071-6d6f-4204-cb4120095c9b (at 0@lo) [38054.352585] Lustre: Skipped 4 previous similar messages [38055.467568] Lustre: soaked-MDT0000: Imperative Recovery not enabled, recovery window 300-900 [38055.601442] Lustre: soaked-MDT0000: in recovery but waiting for the first client to connect [38059.249252] Lustre: soaked-MDT0000: Will be in recovery for at least 5:00, or until 29 clients reconnect [38062.529213] Lustre: MGS: Connection restored to 10aa2cc9-724e-0b85-da3f-79154d50e4c2 (at 192.168.1.143@o2ib) [38062.650134] Lustre: Skipped 3 previous similar messages [38078.619552] Lustre: soaked-MDT0000: Connection restored to bb694f0e-35cb-54bb-9ab4-6713c402fdad (at 192.168.1.140@o2ib) [38078.751845] Lustre: Skipped 52 previous similar messages [38108.444041] Lustre: soaked-MDT0000: Recovery over after 0:49, of 29 clients 29 recovered and 0 were evicted. [38115.088291] LNet: 2245:0:(o2iblnd_cb.c:3294:kiblnd_check_conns()) Timed out tx for 192.168.1.108@o2ib: 9 seconds [38117.798967] Lustre: Failing over soaked-MDT0000 [38117.928152] LustreError: 7080:0:(osp_precreate.c:645:osp_precreate_send()) soaked-OST0002-osc-MDT0000: can't precreate: rc = -5 [38117.929217] LustreError: 7082:0:(osp_precreate.c:1285:osp_precreate_thread()) soaked-OST0003-osc-MDT0000: cannot precreate objects: rc = -5 [38117.929219] LustreError: 7082:0:(osp_precreate.c:1285:osp_precreate_thread()) Skipped 6 previous similar messages [38118.212913] Lustre: soaked-MDT0000: Not available for connect from 192.168.1.130@o2ib (stopping) [38118.212915] Lustre: Skipped 8 previous similar messages [38118.521638] LustreError: 7080:0:(osp_precreate.c:645:osp_precreate_send()) Skipped 8 previous similar messages [38118.644726] LustreError: 7080:0:(osp_precreate.c:1285:osp_precreate_thread()) soaked-OST0002-osc-MDT0000: cannot precreate objects: rc = -5 [38118.801221] LustreError: 7080:0:(osp_precreate.c:1285:osp_precreate_thread()) Skipped 1 previous similar message [38118.937778] LustreError: 7340:0:(lod_dev.c:1688:lod_device_free()) header@ffff8804b9b6e780[0x0, 1, [0x1:0x0:0x0] hash exist]{ [38119.096670] LustreError: 7340:0:(lod_dev.c:1688:lod_device_free()) ....local_storage@ffff8804b9b6e7d0 [38119.231555] LustreError: 7340:0:(lod_dev.c:1688:lod_device_free()) ....osd-ldiskfs@ffff8807e4ee7d00osd-ldiskfs-object@ffff8807e4ee7d00(i:ffff8803cd748520:79/234542790)[plain] [38119.445817] LustreError: 7340:0:(lod_dev.c:1688:lod_device_free()) } header@ffff8804b9b6e780 [38119.571905] LustreError: 7340:0:(lod_dev.c:1688:lod_device_free()) header@ffff8804b9b6f080[0x0, 1, [0x200000003:0x0:0x0] hash exist]{ [38119.743298] LustreError: 7340:0:(lod_dev.c:1688:lod_device_free()) ....local_storage@ffff8804b9b6f0d0 [38119.877938] LustreError: 7340:0:(lod_dev.c:1688:lod_device_free()) ....osd-ldiskfs@ffff8807e4ee6600osd-ldiskfs-object@ffff8807e4ee6600(i:ffff8800a38dddb8:77/234542754)[plain] [38120.091754] LustreError: 7340:0:(lod_dev.c:1688:lod_device_free()) } header@ffff8804b9b6f080 [38120.217818] LustreError: 7340:0:(lod_dev.c:1688:lod_device_free()) header@ffff8804b9b6f380[0x0, 1, [0x200000003:0x2:0x0] hash exist]{ [38120.388953] LustreError: 7340:0:(lod_dev.c:1688:lod_device_free()) ....local_storage@ffff8804b9b6f3d0 [38120.523578] LustreError: 7340:0:(lod_dev.c:1688:lod_device_free()) ....osd-ldiskfs@ffff8807e4ee7600osd-ldiskfs-object@ffff8807e4ee7600(i:ffff8803e5365548:78/234542755)[lfix] [38120.736391] LustreError: 7340:0:(lod_dev.c:1688:lod_device_free()) } header@ffff8804b9b6f380 [38120.862122] LustreError: 7340:0:(lod_dev.c:1688:lod_device_free()) header@ffff8804b9b6e180[0x0, 1, [0x200000003:0x3:0x0] hash exist]{ [38121.033413] LustreError: 7340:0:(lod_dev.c:1688:lod_device_free()) ....local_storage@ffff8804b9b6e1d0 [38121.168026] LustreError: 7340:0:(lod_dev.c:1688:lod_device_free()) ....osd-ldiskfs@ffff8807e4ee7e00osd-ldiskfs-object@ffff8807e4ee7e00(i:ffff8800a38c4468:354418689/234542756)[plain] [38121.389154] LustreError: 7340:0:(lod_dev.c:1688:lod_device_free()) } header@ffff8804b9b6e180 [38121.515699] LustreError: 7340:0:(lod_dev.c:1688:lod_device_free()) header@ffff8804b9b6f2c0[0x0, 1, [0xa:0x0:0x0] hash exist]{ [38121.675124] LustreError: 7340:0:(lod_dev.c:1688:lod_device_free()) ....local_storage@ffff8804b9b6f310 [38121.809579] LustreError: 7340:0:(lod_dev.c:1688:lod_device_free()) ....osd-ldiskfs@ffff8807e4ee7900osd-ldiskfs-object@ffff8807e4ee7900(i:ffff8803f7fd9600:80/234542824)[plain] [38122.023193] LustreError: 7340:0:(lod_dev.c:1688:lod_device_free()) } header@ffff8804b9b6f2c0 [38122.153636] LustreError: 7340:0:(lod_dev.c:1688:lod_device_free()) header@ffff8804b9b6fec0[0x1, 1, [0x200000001:0x1017:0x0] hash exist]{ [38122.327646] LustreError: 7340:0:(lod_dev.c:1688:lod_device_free()) ....local_storage@ffff8804b9b6ff10 [38122.461932] LustreError: 7340:0:(lod_dev.c:1688:lod_device_free()) ....osd-ldiskfs@ffff8807e4ee4c00osd-ldiskfs-object@ffff8807e4ee4c00(i:ffff8800a38c7b40:326107137/3497924257)[plain] [38122.683708] LustreError: 7340:0:(lod_dev.c:1688:lod_device_free()) } header@ffff8804b9b6fec0 [38123.266647] LustreError: 137-5: soaked-MDT0000_UUID: not available for connect from 192.168.1.104@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server. [38123.266671] LustreError: 137-5: soaked-MDT0000_UUID: not available for connect from 192.168.1.104@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server. [38123.703698] LustreError: Skipped 2 previous similar messages [38123.890425] LustreError: 137-5: soaked-MDT0000_UUID: not available for connect from 192.168.1.120@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server. [38124.109001] LustreError: Skipped 4 previous similar messages [38125.636725] LustreError: 137-5: soaked-MDT0000_UUID: not available for connect from 192.168.1.103@o2ib (no target). If you are running an HA pair check that the target is mounted on the other server. [38125.854439] LustreError: Skipped 5 previous similar messages [38128.936526] Lustre: 7340:0:(client.c:2100:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1518069499/real 1518069499] req@ffff880812aa9200 x1591771922434064/t0(0) o251->MGC192.168.1.109@o2ib@0@lo:26/25 lens 224/224 e 0 to 1 dl 1518069505 ref 2 fl Rpc:XN/0/ffffffff rc 0/-1 [38129.436503] Lustre: server umount soaked-MDT0000 complete [45228.416190] sd 0:0:1:1: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command [45229.019826] sd 0:0:1:1: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT returned with sense 05/91/36 [45229.135503] sd 0:0:1:1: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command [45230.259242] sd 0:0:1:1: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT returned with sense 05/91/36 [45230.374872] sd 0:0:1:1: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command [45230.479511] sd 0:0:1:1: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT completed [45230.575165] sd 0:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, queueing MODE_SELECT command [45230.679719] sd 0:0:1:3: rdac: array soak-netapp2624-1, ctlr 1, MODE_SELECT completed [45254.785202] LDISKFS-fs warning (device dm-4): ldiskfs_multi_mount_protect:322: MMP interval 42 higher than expected, please wait. [45325.890129] LDISKFS-fs (dm-4): recovery complete [45325.897066] LDISKFS-fs (dm-4): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,user_xattr,no_mbcache,nodelalloc [45330.013707] Lustre: MGS: Connection restored to 7a7deb8b-7071-6d6f-4204-cb4120095c9b (at 0@lo) [45330.026059] Lustre: Skipped 29 previous similar messages [45330.395372] Lustre: soaked-MDT0000: Not available for connect from 192.168.1.121@o2ib (not set up) [45330.408364] Lustre: Skipped 5 previous similar messages [45331.589878] Lustre: soaked-MDT0000: Imperative Recovery not enabled, recovery window 300-900 [45331.636672] Lustre: soaked-MDT0000: in recovery but waiting for the first client to connect [45335.822920] Lustre: soaked-MDT0000: Will be in recovery for at least 5:00, or until 29 clients reconnect [45335.834934] Lustre: soaked-MDT0000: Connection restored to 00af346d-b4b1-8e19-0f0f-35e4c8dc8db0 (at 192.168.1.121@o2ib) [45335.849660] Lustre: Skipped 2 previous similar messages [45345.260272] Lustre: soaked-MDT0000: Connection restored to 192.168.1.106@o2ib (at 192.168.1.106@o2ib) [45345.273511] Lustre: Skipped 15 previous similar messages [45361.915998] Lustre: MGS: Connection restored to 192.168.1.102@o2ib (at 192.168.1.102@o2ib) [45361.928182] Lustre: Skipped 21 previous similar messages [45387.174734] LNet: 2245:0:(o2iblnd_cb.c:3294:kiblnd_check_conns()) Timed out tx for 192.168.1.108@o2ib: 5 seconds [45396.861462] Lustre: soaked-MDT0000: Connection restored to fd75d2ff-51a5-bc15-b010-e8768792a1d9 (at 192.168.1.128@o2ib) [45396.876443] Lustre: Skipped 10 previous similar messages [45485.832038] Lustre: soaked-MDT0000: Recovery over after 2:30, of 29 clients 29 recovered and 0 were evicted. [45486.558566] Lustre: Failing over soaked-MDT0000 [45486.647963] LustreError: 8046:0:(osp_precreate.c:929:osp_precreate_cleanup_orphans()) soaked-OST0005-osc-MDT0000: cannot cleanup orphans: rc = -5 [45486.654977] Lustre: soaked-MDT0000: Not available for connect from 192.168.1.144@o2ib (stopping) [45486.655861] LustreError: 8441:0:(lod_qos.c:208:lod_statfs_and_check()) soaked-MDT0000-mdtlov: statfs: rc = -108 [45486.655864] LustreError: 8441:0:(lod_qos.c:208:lod_statfs_and_check()) Skipped 306 previous similar messages [45486.656152] LustreError: 8403:0:(ldlm_lockd.c:1362:ldlm_handle_enqueue0()) ### lock on destroyed export ffff8807dfaef400 ns: mdt-soaked-MDT0000_UUID lock: ffff8807f2bd3cc0/0xb208a0fe5949edc3 lrc: 3/0,0 mode: CR/CR res: [0x20008030c:0x1d0b1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50200000000000 nid: 192.168.1.122@o2ib remote: 0x34cb49beb3f37553 expref: 6 pid: 8403 timeout: 0 lvb_type: 0 [45486.656155] LustreError: 8403:0:(ldlm_lockd.c:1362:ldlm_handle_enqueue0()) Skipped 1 previous similar message [45486.781728] LustreError: 8499:0:(ldlm_resource.c:1093:ldlm_resource_complain()) mdt-soaked-MDT0000_UUID: namespace resource [0x200080313:0x130ee:0x0].0x0 (ffff880419069200) refcount nonzero (2) after lock cleanup; forcing cleanup. [45486.781732] LustreError: 8499:0:(ldlm_resource.c:1093:ldlm_resource_complain()) Skipped 13 previous similar messages [45486.781736] LustreError: 8499:0:(ldlm_resource.c:1669:ldlm_resource_dump()) --- Resource: [0x200080313:0x130ee:0x0].0x0 (ffff880419069200) refcount = 3 [45486.781739] LustreError: 8499:0:(ldlm_resource.c:1672:ldlm_resource_dump()) Granted locks (in reverse order): [45486.781754] LustreError: 8499:0:(ldlm_resource.c:1675:ldlm_resource_dump()) ### ### ns: mdt-soaked-MDT0000_UUID lock: ffff880417a6b3c0/0xb208a0fe5940efa3 lrc: 2/0,1 mode: CW/CW res: [0x200080313:0x130ee:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40316400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 [45486.781755] LustreError: 8499:0:(ldlm_resource.c:1675:ldlm_resource_dump()) Skipped 13 previous similar messages [45486.782315] LustreError: 8499:0:(ldlm_resource.c:1669:ldlm_resource_dump()) --- Resource: [0x200080313:0x12055:0x0].0x2ecc929d (ffff8807f22180c0) refcount = 2 [45486.782317] LustreError: 8499:0:(ldlm_resource.c:1672:ldlm_resource_dump()) Granted locks (in reverse order): [45486.783219] LustreError: 8499:0:(ldlm_resource.c:1669:ldlm_resource_dump()) --- Resource: [0x200080313:0x154e6:0x0].0xd6fca993 (ffff88042cda6c00) refcount = 2 [45486.783222] LustreError: 8499:0:(ldlm_resource.c:1672:ldlm_resource_dump()) Granted locks (in reverse order): [45486.784463] LustreError: 8499:0:(ldlm_resource.c:1669:ldlm_resource_dump()) --- Resource: [0x20007f362:0x1ccc5:0x0].0x54cb7170 (ffff8807e0678d80) refcount = 7 [45486.784465] LustreError: 8499:0:(ldlm_resource.c:1672:ldlm_resource_dump()) Granted locks (in reverse order): [45486.784472] LustreError: 8499:0:(ldlm_resource.c:1686:ldlm_resource_dump()) Waiting locks: [45486.784479] LustreError: 8499:0:(ldlm_resource.c:1688:ldlm_resource_dump()) ### ### ns: mdt-soaked-MDT0000_UUID lock: ffff8807f12cc5c0/0xb208a0fe593f992f lrc: 2/0,1 mode: --/PW res: [0x20007f362:0x1ccc5:0x0].0x54cb7170 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40316400000020 nid: local remote: 0x0 expref: -99 pid: 8003 timeout: 0 lvb_type: 0 [45486.785190] LustreError: 8499:0:(ldlm_resource.c:1669:ldlm_resource_dump()) --- Resource: [0x200080337:0x5e65:0x0].0x0 (ffff8807e2646540) refcount = 3 [45486.785193] LustreError: 8499:0:(ldlm_resource.c:1672:ldlm_resource_dump()) Granted locks (in reverse order): [45486.786102] LustreError: 8499:0:(ldlm_resource.c:1669:ldlm_resource_dump()) --- Resource: [0x200080321:0x1a002:0x0].0x0 (ffff8807e1604600) refcount = 3 [45486.786104] LustreError: 8499:0:(ldlm_resource.c:1672:ldlm_resource_dump()) Granted locks (in reverse order): [45486.786183] LustreError: 8499:0:(ldlm_resource.c:1669:ldlm_resource_dump()) --- Resource: [0x20008030c:0xb3c3:0x0].0x61fcb155 (ffff8807f3286900) refcount = 2 [45486.786185] LustreError: 8499:0:(ldlm_resource.c:1672:ldlm_resource_dump()) Granted locks (in reverse order): [45486.786206] LustreError: 8499:0:(ldlm_resource.c:1669:ldlm_resource_dump()) --- Resource: [0x200080313:0x13c91:0x0].0x0 (ffff8807e0678480) refcount = 3 [45486.786208] LustreError: 8499:0:(ldlm_resource.c:1672:ldlm_resource_dump()) Granted locks (in reverse order): [45486.786523] LustreError: 8499:0:(ldlm_resource.c:1669:ldlm_resource_dump()) --- Resource: [0x20007f362:0x1ccc5:0x0].0x0 (ffff88081e2ac240) refcount = 13 [45486.786525] LustreError: 8499:0:(ldlm_resource.c:1672:ldlm_resource_dump()) Granted locks (in reverse order): [45486.786760] LustreError: 8499:0:(ldlm_resource.c:1669:ldlm_resource_dump()) --- Resource: [0x20008032b:0x4afe:0x0].0x0 (ffff8807e084c480) refcount = 3 [45486.786762] LustreError: 8499:0:(ldlm_resource.c:1672:ldlm_resource_dump()) Granted locks (in reverse order): [45486.787122] LustreError: 8499:0:(ldlm_resource.c:1669:ldlm_resource_dump()) --- Resource: [0x200080333:0x111b4:0x0].0x1cf61c5 (ffff88082ad5a840) refcount = 2 [45486.787124] LustreError: 8499:0:(ldlm_resource.c:1672:ldlm_resource_dump()) Granted locks (in reverse order): [45486.787944] LustreError: 8499:0:(ldlm_resource.c:1669:ldlm_resource_dump()) --- Resource: [0x200080313:0x13156:0x0].0xd371a74a (ffff8803db3c20c0) refcount = 2 [45486.787946] LustreError: 8499:0:(ldlm_resource.c:1672:ldlm_resource_dump()) Granted locks (in reverse order): [45486.789019] LustreError: 8499:0:(ldlm_resource.c:1669:ldlm_resource_dump()) --- Resource: [0x200080321:0x1a002:0x0].0xb3c66e99 (ffff88080ae75c80) refcount = 2 [45486.789021] LustreError: 8499:0:(ldlm_resource.c:1672:ldlm_resource_dump()) Granted locks (in reverse order): [45486.789305] LustreError: 8499:0:(ldlm_resource.c:1669:ldlm_resource_dump()) --- Resource: [0x200080313:0x13c91:0x0].0x9e68f91b (ffff8807e0678fc0) refcount = 2 [45486.789307] LustreError: 8499:0:(ldlm_resource.c:1672:ldlm_resource_dump()) Granted locks (in reverse order): [45486.789397] LustreError: 8499:0:(ldlm_resource.c:1669:ldlm_resource_dump()) --- Resource: [0x20008032b:0x4afe:0x0].0x50b95d96 (ffff8807e084c600) refcount = 2 [45486.789399] LustreError: 8499:0:(ldlm_resource.c:1672:ldlm_resource_dump()) Granted locks (in reverse order): [45486.791186] LustreError: 8499:0:(ldlm_resource.c:1669:ldlm_resource_dump()) --- Resource: [0x20008030c:0xb3c3:0x0].0x0 (ffff8807f3287800) refcount = 3 [45486.791189] LustreError: 8499:0:(ldlm_resource.c:1672:ldlm_resource_dump()) Granted locks (in reverse order): [45486.792002] LustreError: 8499:0:(ldlm_resource.c:1669:ldlm_resource_dump()) --- Resource: [0x200080329:0x1e53c:0x0].0x54cba971 (ffff8807e0735140) refcount = 2 [45486.792004] LustreError: 8499:0:(ldlm_resource.c:1672:ldlm_resource_dump()) Granted locks (in reverse order): [45486.792023] LustreError: 8499:0:(ldlm_resource.c:1669:ldlm_resource_dump()) --- Resource: [0x200080329:0x1e53c:0x0].0x54cba671 (ffff8807e12efc80) refcount = 2 [45486.792025] LustreError: 8499:0:(ldlm_resource.c:1672:ldlm_resource_dump()) Granted locks (in reverse order): [45486.792042] LustreError: 8499:0:(ldlm_resource.c:1669:ldlm_resource_dump()) --- Resource: [0x200080329:0x1e53c:0x0].0x54cba771 (ffff8807e1f940c0) refcount = 2 [45486.792044] LustreError: 8499:0:(ldlm_resource.c:1672:ldlm_resource_dump()) Granted locks (in reverse order): [45486.792054] LustreError: 8499:0:(ldlm_resource.c:1669:ldlm_resource_dump()) --- Resource: [0x200080329:0x1e53c:0x0].0x54cb7171 (ffff8807e3970e40) refcount = 2 [45486.792056] LustreError: 8499:0:(ldlm_resource.c:1672:ldlm_resource_dump()) Granted locks (in reverse order): [45486.792077] LustreError: 8499:0:(ldlm_resource.c:1669:ldlm_resource_dump()) --- Resource: [0x200080329:0x1e53c:0x0].0x54cba571 (ffff8803aaa0c9c0) refcount = 2 [45486.792079] LustreError: 8499:0:(ldlm_resource.c:1672:ldlm_resource_dump()) Granted locks (in reverse order): [45486.792102] LustreError: 8499:0:(ldlm_resource.c:1669:ldlm_resource_dump()) --- Resource: [0x200080329:0x1e53c:0x0].0x54cba271 (ffff8803d2fb86c0) refcount = 2 [45486.792104] LustreError: 8499:0:(ldlm_resource.c:1672:ldlm_resource_dump()) Granted locks (in reverse order): [45486.792188] LustreError: 8499:0:(ldlm_resource.c:1669:ldlm_resource_dump()) --- Resource: [0x200080329:0x1e53c:0x0].0x54cba272 (ffff8807f1f58000) refcount = 2 [45486.792190] LustreError: 8499:0:(ldlm_resource.c:1672:ldlm_resource_dump()) Granted locks (in reverse order): [45486.792217] LustreError: 8499:0:(ldlm_resource.c:1669:ldlm_resource_dump()) --- Resource: [0x200080329:0x1e53c:0x0].0x54cba172 (ffff880414fbac00) refcount = 2 [45486.792219] LustreError: 8499:0:(ldlm_resource.c:1672:ldlm_resource_dump()) Granted locks (in reverse order): [45486.792654] LustreError: 8499:0:(ldlm_resource.c:1669:ldlm_resource_dump()) --- Resource: [0x200080313:0x130ee:0x0].0x61e1a0da (ffff880419068240) refcount = 2 [45486.792656] LustreError: 8499:0:(ldlm_resource.c:1672:ldlm_resource_dump()) Granted locks (in reverse order): [45486.792744] LustreError: 8499:0:(ldlm_resource.c:1669:ldlm_resource_dump()) --- Resource: [0x200080313:0x11f49:0x0].0x0 (ffff8807f2218f00) refcount = 3 [45486.792746] LustreError: 8499:0:(ldlm_resource.c:1672:ldlm_resource_dump()) Granted locks (in reverse order): [45486.793049] LustreError: 8499:0:(ldlm_resource.c:1669:ldlm_resource_dump()) --- Resource: [0x200080329:0x1e53c:0x0].0x54cb7179 (ffff8807efe120c0) refcount = 2 [45486.793051] LustreError: 8499:0:(ldlm_resource.c:1672:ldlm_resource_dump()) Granted locks (in reverse order): [45486.793388] LustreError: 8499:0:(ldlm_resource.c:1669:ldlm_resource_dump()) --- Resource: [0x200080337:0x5e65:0x0].0x1cfa0c5 (ffff8807e2647680) refcount = 2 [45486.793389] LustreError: 8499:0:(ldlm_resource.c:1672:ldlm_resource_dump()) Granted locks (in reverse order): [45486.793945] LustreError: 8499:0:(ldlm_resource.c:1669:ldlm_resource_dump()) --- Resource: [0x200080329:0x1e53c:0x0].0x0 (ffff8800b1152cc0) refcount = 19 [45486.793947] LustreError: 8499:0:(ldlm_resource.c:1672:ldlm_resource_dump()) Granted locks (in reverse order): [45486.794194] LustreError: 8499:0:(ldlm_resource.c:1669:ldlm_resource_dump()) --- Resource: [0x200080333:0x111b4:0x0].0x0 (ffff88082ad5b2c0) refcount = 3 [45486.794196] LustreError: 8499:0:(ldlm_resource.c:1672:ldlm_resource_dump()) Granted locks (in reverse order): [45486.794333] LustreError: 8499:0:(ldlm_resource.c:1669:ldlm_resource_dump()) --- Resource: [0x200080313:0x12055:0x0].0x0 (ffff8807f2218cc0) refcount = 3 [45486.794334] LustreError: 8499:0:(ldlm_resource.c:1672:ldlm_resource_dump()) Granted locks (in reverse order): [45486.794369] LustreError: 8499:0:(ldlm_resource.c:1669:ldlm_resource_dump()) --- Resource: [0x200080313:0x13156:0x0].0x0 (ffff8803db3c2600) refcount = 3 [45486.794371] LustreError: 8499:0:(ldlm_resource.c:1672:ldlm_resource_dump()) Granted locks (in reverse order): [45486.794969] LustreError: 8499:0:(ldlm_resource.c:1669:ldlm_resource_dump()) --- Resource: [0x200080313:0x11f49:0x0].0xd929c692 (ffff8803e43c6f00) refcount = 2 [45486.794971] LustreError: 8499:0:(ldlm_resource.c:1672:ldlm_resource_dump()) Granted locks (in reverse order): [45486.796303] LustreError: 8499:0:(ldlm_resource.c:1669:ldlm_resource_dump()) --- Resource: [0x200080313:0x154e6:0x0].0x0 (ffff88042cda7440) refcount = 3 [45486.796305] LustreError: 8499:0:(ldlm_resource.c:1672:ldlm_resource_dump()) Granted locks (in reverse order): [45490.359294] LustreError: 8046:0:(osp_precreate.c:929:osp_precreate_cleanup_orphans()) Skipped 6 previous similar messages [45491.189672] Lustre: soaked-MDT0000: Not available for connect from 192.168.1.116@o2ib (stopping) [45491.221824] Lustre: Skipped 16 previous similar messages [45495.262649] Lustre: soaked-MDT0000: Not available for connect from 192.168.1.106@o2ib (stopping) [45495.294552] Lustre: Skipped 7 previous similar messages [45503.861035] Lustre: soaked-MDT0000: Not available for connect from 192.168.1.105@o2ib (stopping) [45503.893181] Lustre: Skipped 6 previous similar messages [45511.797352] LustreError: 0-0: Forced cleanup waiting for mdt-soaked-MDT0000_UUID namespace with 26 resources in use, (rc=-110) [45536.841542] LustreError: 0-0: Forced cleanup waiting for mdt-soaked-MDT0000_UUID namespace with 26 resources in use, (rc=-110) [45542.581756] Lustre: soaked-MDT0000: Not available for connect from 192.168.1.117@o2ib (stopping) [45542.614395] Lustre: Skipped 15 previous similar messages [45561.885770] LustreError: 0-0: Forced cleanup waiting for mdt-soaked-MDT0000_UUID namespace with 26 resources in use, (rc=-110) [45575.263197] Lustre: soaked-MDT0000: Not available for connect from 192.168.1.141@o2ib (stopping) [45575.295496] Lustre: Skipped 11 previous similar messages [45585.871075] LustreError: 8199:0:(lod_qos.c:208:lod_statfs_and_check()) soaked-MDT0000-mdtlov: statfs: rc = -108 [45585.871486] Lustre: 8198:0:(service.c:2132:ptlrpc_server_handle_request()) @@@ Request took longer than estimated (68:32s); client may timeout. req@ffff88080b752a00 x1591773810670976/t0(0) o101->249fa6c6-4f38-be86-0183-56e8b27aa614@192.168.1.122@o2ib:695/0 lens 1728/544 e 0 to 0 dl 1518076930 ref 1 fl Complete:/0/0 rc -19/-19 [45586.012687] LustreError: 8199:0:(lod_qos.c:208:lod_statfs_and_check()) Skipped 208 previous similar messages [45586.348500] LustreError: 8425:0:(ldlm_lockd.c:1362:ldlm_handle_enqueue0()) ### lock on destroyed export ffff8807e0498400 ns: mdt-soaked-MDT0000_UUID lock: ffff8803cf6f8fc0/0xb208a0fe5949ee17 lrc: 3/0,0 mode: CR/CR res: [0x200080313:0x168e5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50200000000000 nid: 192.168.1.126@o2ib remote: 0x15f81a049a84b904 expref: 13 pid: 8425 timeout: 0 lvb_type: 0 [45586.376423] Lustre: 8421:0:(service.c:2132:ptlrpc_server_handle_request()) @@@ Request took longer than estimated (70:30s); client may timeout. req@ffff8800a4cbda00 x1591772639939936/t1086626759263(0) o101->25b1b98e-aee7-71d2-93a5-921b3e1c4e6c@192.168.1.126@o2ib:697/0 lens 1176/544 e 0 to 0 dl 1518076932 ref 1 fl Complete:/0/0 rc -19/-19 [45586.376426] Lustre: 8421:0:(service.c:2132:ptlrpc_server_handle_request()) Skipped 5 previous similar messages [45586.622891] LustreError: 8425:0:(ldlm_lockd.c:1362:ldlm_handle_enqueue0()) Skipped 20 previous similar messages [45592.731033] LustreError: 8499:0:(lod_dev.c:1688:lod_device_free()) header@ffff8803c8edf500[0x0, 1, [0x1:0x0:0x0] hash exist]{ [45592.777928] LustreError: 8499:0:(lod_dev.c:1688:lod_device_free()) ....local_storage@ffff8803c8edf550 [45592.820161] LustreError: 8499:0:(lod_dev.c:1688:lod_device_free()) ....osd-ldiskfs@ffff88040aab4500osd-ldiskfs-object@ffff88040aab4500(i:ffff88080facfb40:79/234542790)[plain] [45592.886669] LustreError: 8499:0:(lod_dev.c:1688:lod_device_free()) } header@ffff8803c8edf500 [45592.926822] LustreError: 8499:0:(lod_dev.c:1688:lod_device_free()) header@ffff8803c8edf980[0x0, 1, [0x200000003:0x0:0x0] hash exist]{ [45592.981652] LustreError: 8499:0:(lod_dev.c:1688:lod_device_free()) ....local_storage@ffff8803c8edf9d0 [45593.023786] LustreError: 8499:0:(lod_dev.c:1688:lod_device_free()) ....osd-ldiskfs@ffff88040aab6a00osd-ldiskfs-object@ffff88040aab6a00(i:ffff8803cd676e98:77/234542754)[plain] [45593.090293] LustreError: 8499:0:(lod_dev.c:1688:lod_device_free()) } header@ffff8803c8edf980 [45593.130651] LustreError: 8499:0:(lod_dev.c:1688:lod_device_free()) header@ffff8803f8724e40[0x0, 1, [0x200000003:0x2:0x0] hash exist]{ [45593.185412] LustreError: 8499:0:(lod_dev.c:1688:lod_device_free()) ....local_storage@ffff8803f8724e90 [45593.227520] LustreError: 8499:0:(lod_dev.c:1688:lod_device_free()) ....osd-ldiskfs@ffff880411141000osd-ldiskfs-object@ffff880411141000(i:ffff8803cd76af50:78/234542755)[lfix] [45593.293564] LustreError: 8499:0:(lod_dev.c:1688:lod_device_free()) } header@ffff8803f8724e40 [45593.333416] LustreError: 8499:0:(lod_dev.c:1688:lod_device_free()) header@ffff8803c8edea80[0x0, 1, [0x200000003:0x3:0x0] hash exist]{ [45593.387821] LustreError: 8499:0:(lod_dev.c:1688:lod_device_free()) ....local_storage@ffff8803c8edead0 [45593.429682] LustreError: 8499:0:(lod_dev.c:1688:lod_device_free()) ....osd-ldiskfs@ffff88040aab6800osd-ldiskfs-object@ffff88040aab6800(i:ffff8803cd438d90:354418689/234542756)[plain] [45593.497698] LustreError: 8499:0:(lod_dev.c:1688:lod_device_free()) } header@ffff8803c8edea80 [45593.537511] LustreError: 8499:0:(lod_dev.c:1688:lod_device_free()) header@ffff8807dc04ee80[0x0, 1, [0x200000007:0x1:0x0] hash exist]{ [45593.591495] LustreError: 8499:0:(lod_dev.c:1688:lod_device_free()) ....mdt@ffff8807dc04eed0mdt-object@ffff8807dc04ee80( , writecount=0) [45593.645796] LustreError: 8499:0:(lod_dev.c:1688:lod_device_free()) ....mdd@ffff8803cadf5820mdd-object@ffff8803cadf5820(open_count=0, valid=0, cltime=0ns, flags=0) [45593.707707] LustreError: 8499:0:(lod_dev.c:1688:lod_device_free()) ....lod@ffff8807e3599340lod-object@ffff8807e3599340 [45593.753930] LustreError: 8499:0:(lod_dev.c:1688:lod_device_free()) ....osd-ldiskfs@ffff8803e0367600osd-ldiskfs-object@ffff8803e0367600(i:ffff8803cd4380e8:530055169/234542853)[plain] [45593.821286] LustreError: 8499:0:(lod_dev.c:1688:lod_device_free()) } header@ffff8807dc04ee80 [45593.860810] LustreError: 8499:0:(lod_dev.c:1688:lod_device_free()) header@ffff8803c8edf5c0[0x0, 1, [0xa:0x0:0x0] hash exist]{ [45593.909097] LustreError: 8499:0:(lod_dev.c:1688:lod_device_free()) ....local_storage@ffff8803c8edf610 [45593.950495] LustreError: 8499:0:(lod_dev.c:1688:lod_device_free()) ....osd-ldiskfs@ffff88040aab7500osd-ldiskfs-object@ffff88040aab7500(i:ffff8803ec3b9a38:80/234542824)[plain] [45594.016006] LustreError: 8499:0:(lod_dev.c:1688:lod_device_free()) } header@ffff8803c8edf5c0 [45594.060210] LustreError: 8499:0:(lod_dev.c:1688:lod_device_free()) header@ffff8803f8724300[0x1, 1, [0x200000001:0x1017:0x0] hash exist]{ [45594.114853] LustreError: 8499:0:(lod_dev.c:1688:lod_device_free()) ....local_storage@ffff8803f8724350 [45594.156290] LustreError: 8499:0:(lod_dev.c:1688:lod_device_free()) ....osd-ldiskfs@ffff880411143400osd-ldiskfs-object@ffff880411143400(i:ffff8803cd439600:326107137/3497924257)[plain] [45594.224093] LustreError: 8499:0:(lod_dev.c:1688:lod_device_free()) } header@ffff8803f8724300 [45594.332490] LustreError: 8499:0:(lod_dev.c:1691:lod_device_free()) ASSERTION( atomic_read(&lu->ld_ref) == 0 ) failed: lu is ffff8807e63c2000 [45594.332492] LustreError: 8499:0:(lod_dev.c:1691:lod_device_free()) LBUG [45594.332494] Pid: 8499, comm: umount [45594.332494] Call Trace: [45594.332520] [] libcfs_call_trace+0x4e/0x60 [libcfs] [45594.332527] [] lbug_with_loc+0x4c/0xb0 [libcfs] [45594.332539] [] lod_device_free+0x2ed/0x2f0 [lod] [45594.332570] [] class_free_dev+0x4dc/0x730 [obdclass] [45594.332591] [] class_export_put+0x220/0x2f0 [obdclass] [45594.332611] [] class_unlink_export+0x135/0x170 [obdclass] [45594.332635] [] class_decref+0x80/0x160 [obdclass] [45594.332657] [] class_detach+0x1b3/0x2e0 [obdclass] [45594.332680] [] class_process_config+0x19d9/0x28a0 [obdclass] [45594.332689] [] ? libcfs_debug_msg+0x57/0x80 [libcfs] [45594.332711] [] class_manual_cleanup+0x1e0/0x710 [obdclass] [45594.332719] [] lod_obd_disconnect+0x93/0x1c0 [lod] [45594.332729] [] mdd_process_config+0x3de/0x630 [mdd] [45594.332750] [] mdt_stack_fini+0x2bc/0xd40 [mdt] [45594.332761] [] mdt_device_fini+0x383/0x970 [mdt] [45594.332783] [] class_cleanup+0x8cc/0xc40 [obdclass] [45594.332804] [] class_process_config+0x62c/0x28a0 [obdclass] [45594.332812] [] ? libcfs_debug_msg+0x57/0x80 [libcfs] [45594.332833] [] class_manual_cleanup+0x1c6/0x710 [obdclass] [45594.332859] [] server_put_super+0x8de/0xcd0 [obdclass] [45594.332866] [] generic_shutdown_super+0x72/0x100 [45594.332868] [] kill_anon_super+0x12/0x20 [45594.332890] [] lustre_kill_super+0x32/0x50 [obdclass] [45594.332893] [] deactivate_locked_super+0x49/0x60 [45594.332895] [] deactivate_super+0x46/0x60 [45594.332900] [] cleanup_mnt+0x3f/0x80 [45594.332903] [] __cleanup_mnt+0x12/0x20 [45594.332907] [] task_work_run+0xc5/0xf0 [45594.332911] [] do_notify_resume+0x92/0xb0 [45594.332916] [] int_signal+0x12/0x17 [45594.332917] [45594.332918] Kernel panic - not syncing: LBUG [45594.332922] CPU: 13 PID: 8499 Comm: umount Tainted: P OE ------------ 3.10.0-693.11.6.el7_lustre.x86_64 #1 [45594.332923] Hardware name: Intel Corporation S2600GZ ........../S2600GZ, BIOS SE5C600.86B.01.08.0003.022620131521 02/26/2013 [45594.332924] Call Trace: [45594.332931] [] dump_stack+0x19/0x1b [45594.332936] [] panic+0xe8/0x20d [45594.332944] [] lbug_with_loc+0x64/0xb0 [libcfs] [45594.332952] [] lod_device_free+0x2ed/0x2f0 [lod] [45594.332973] [] class_free_dev+0x4dc/0x730 [obdclass] [45594.332993] [] class_export_put+0x220/0x2f0 [obdclass] [45594.333013] [] class_unlink_export+0x135/0x170 [obdclass] [45594.333035] [] class_decref+0x80/0x160 [obdclass] [45594.333056] [] class_detach+0x1b3/0x2e0 [obdclass] [45594.333076] [] class_process_config+0x19d9/0x28a0 [obdclass] [45594.333085] [] ? libcfs_debug_msg+0x57/0x80 [libcfs] [45594.333106] [] class_manual_cleanup+0x1e0/0x710 [obdclass] [45594.333113] [] lod_obd_disconnect+0x93/0x1c0 [lod] [45594.333120] [] mdd_process_config+0x3de/0x630 [mdd] [45594.333132] [] mdt_stack_fini+0x2bc/0xd40 [mdt] [45594.333143] [] mdt_device_fini+0x383/0x970 [mdt] [45594.333164] [] class_cleanup+0x8cc/0xc40 [obdclass] [45594.333185] [] class_process_config+0x62c/0x28a0 [obdclass] [45594.333193] [] ? libcfs_debug_msg+0x57/0x80 [libcfs] [45594.333213] [] class_manual_cleanup+0x1c6/0x710 [obdclass] [45594.333236] [] server_put_super+0x8de/0xcd0 [obdclass] [45594.333239] [] generic_shutdown_super+0x72/0x100 [45594.333242] [] kill_anon_super+0x12/0x20 [45594.333263] [] lustre_kill_super+0x32/0x50 [obdclass] [45594.333265] [] deactivate_locked_super+0x49/0x60 [45594.333267] [] deactivate_super+0x46/0x60 [45594.333270] [] cleanup_mnt+0x3f/0x80 [45594.333272] [] __cleanup_mnt+0x12/0x20 [45594.333275] [] task_work_run+0xc5/0xf0 [45594.333277] [] do_notify_resume+0x92/0xb0 [45594.333279] [] int_signal+0x12/0x17