[ 0.000000] Initializing cgroup subsys cpuset [ 0.000000] Initializing cgroup subsys cpu [ 0.000000] Initializing cgroup subsys cpuacct [ 0.000000] Linux version 3.10.0-957.1.3.el7_lustre.x86_64 (sthiell@fir-io1-s1) (gcc version 4.8.5 20150623 (Red Hat 4.8.5-36) (GCC) ) #1 SMP Fri Dec 7 14:50:35 PST 2018 [ 0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-3.10.0-957.1.3.el7_lustre.x86_64 root=UUID=678f7e0b-b88d-484c-88a6-2c6850d78597 ro crashkernel=auto nomodeset console=ttyS0,115200 LANG=en_US.UTF-8 [ 0.000000] e820: BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008efff] usable [ 0.000000] BIOS-e820: [mem 0x000000000008f000-0x000000000008ffff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000000090000-0x000000000009ffff] usable [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005c3dffff] usable [ 0.000000] BIOS-e820: [mem 0x000000005c3e0000-0x00000000643e7fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000643e8000-0x000000006cacefff] usable [ 0.000000] BIOS-e820: [mem 0x000000006cacf000-0x000000006efcefff] reserved [ 0.000000] BIOS-e820: [mem 0x000000006efcf000-0x000000006fdfefff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x000000006fdff000-0x000000006fffefff] ACPI data [ 0.000000] BIOS-e820: [mem 0x000000006ffff000-0x000000006fffffff] usable [ 0.000000] BIOS-e820: [mem 0x0000000070000000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fec10000-0x00000000fec10fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed80000-0x00000000fed80fff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000107f37ffff] usable [ 0.000000] BIOS-e820: [mem 0x000000107f380000-0x000000107fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000001080000000-0x000000207ff7ffff] usable [ 0.000000] BIOS-e820: [mem 0x000000207ff80000-0x000000207fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000002080000000-0x000000307ff7ffff] usable [ 0.000000] BIOS-e820: [mem 0x000000307ff80000-0x000000307fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000003080000000-0x000000407ff7ffff] usable [ 0.000000] BIOS-e820: [mem 0x000000407ff80000-0x000000407fffffff] reserved [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] e820: update [mem 0x446da020-0x4470b25f] usable ==> usable [ 0.000000] e820: update [mem 0x446a8020-0x446d925f] usable ==> usable [ 0.000000] e820: update [mem 0x5b488020-0x5b49005f] usable ==> usable [ 0.000000] e820: update [mem 0x4468f020-0x446a765f] usable ==> usable [ 0.000000] extended physical RAM map: [ 0.000000] reserve setup_data: [mem 0x0000000000000000-0x000000000008efff] usable [ 0.000000] reserve setup_data: [mem 0x000000000008f000-0x000000000008ffff] ACPI NVS [ 0.000000] reserve setup_data: [mem 0x0000000000090000-0x000000000009ffff] usable [ 0.000000] reserve setup_data: [mem 0x0000000000100000-0x000000004468f01f] usable [ 0.000000] reserve setup_data: [mem 0x000000004468f020-0x00000000446a765f] usable [ 0.000000] reserve setup_data: [mem 0x00000000446a7660-0x00000000446a801f] usable [ 0.000000] reserve setup_data: [mem 0x00000000446a8020-0x00000000446d925f] usable [ 0.000000] reserve setup_data: [mem 0x00000000446d9260-0x00000000446da01f] usable [ 0.000000] reserve setup_data: [mem 0x00000000446da020-0x000000004470b25f] usable [ 0.000000] reserve setup_data: [mem 0x000000004470b260-0x000000005b48801f] usable [ 0.000000] reserve setup_data: [mem 0x000000005b488020-0x000000005b49005f] usable [ 0.000000] reserve setup_data: [mem 0x000000005b490060-0x000000005c3dffff] usable [ 0.000000] reserve setup_data: [mem 0x000000005c3e0000-0x00000000643e7fff] reserved [ 0.000000] reserve setup_data: [mem 0x00000000643e8000-0x000000006cacefff] usable [ 0.000000] reserve setup_data: [mem 0x000000006cacf000-0x000000006efcefff] reserved [ 0.000000] reserve setup_data: [mem 0x000000006efcf000-0x000000006fdfefff] ACPI NVS [ 0.000000] reserve setup_data: [mem 0x000000006fdff000-0x000000006fffefff] ACPI data [ 0.000000] reserve setup_data: [mem 0x000000006ffff000-0x000000006fffffff] usable [ 0.000000] reserve setup_data: [mem 0x0000000070000000-0x000000008fffffff] reserved [ 0.000000] reserve setup_data: [mem 0x00000000fec10000-0x00000000fec10fff] reserved [ 0.000000] reserve setup_data: [mem 0x00000000fed80000-0x00000000fed80fff] reserved [ 0.000000] reserve setup_data: [mem 0x0000000100000000-0x000000107f37ffff] usable [ 0.000000] reserve setup_data: [mem 0x000000107f380000-0x000000107fffffff] reserved [ 0.000000] reserve setup_data: [mem 0x0000001080000000-0x000000207ff7ffff] usable [ 0.000000] reserve setup_data: [mem 0x000000207ff80000-0x000000207fffffff] reserved [ 0.000000] reserve setup_data: [mem 0x0000002080000000-0x000000307ff7ffff] usable [ 0.000000] reserve setup_data: [mem 0x000000307ff80000-0x000000307fffffff] reserved [ 0.000000] reserve setup_data: [mem 0x0000003080000000-0x000000407ff7ffff] usable [ 0.000000] reserve setup_data: [mem 0x000000407ff80000-0x000000407fffffff] reserved [ 0.000000] efi: EFI v2.50 by Dell Inc. [ 0.000000] efi: ACPI=0x6fffe000 ACPI 2.0=0x6fffe014 SMBIOS=0x6eab5000 SMBIOS 3.0=0x6eab3000 [ 0.000000] efi: mem00: type=3, attr=0xf, range=[0x0000000000000000-0x0000000000001000) (0MB) [ 0.000000] efi: mem01: type=2, attr=0xf, range=[0x0000000000001000-0x0000000000002000) (0MB) [ 0.000000] efi: mem02: type=7, attr=0xf, range=[0x0000000000002000-0x0000000000010000) (0MB) [ 0.000000] efi: mem03: type=3, attr=0xf, range=[0x0000000000010000-0x0000000000014000) (0MB) [ 0.000000] efi: mem04: type=7, attr=0xf, range=[0x0000000000014000-0x0000000000063000) (0MB) [ 0.000000] efi: mem05: type=3, attr=0xf, range=[0x0000000000063000-0x000000000008f000) (0MB) [ 0.000000] efi: mem06: type=10, attr=0xf, range=[0x000000000008f000-0x0000000000090000) (0MB) [ 0.000000] efi: mem07: type=3, attr=0xf, range=[0x0000000000090000-0x00000000000a0000) (0MB) [ 0.000000] efi: mem08: type=4, attr=0xf, range=[0x0000000000100000-0x0000000000120000) (0MB) [ 0.000000] efi: mem09: type=7, attr=0xf, range=[0x0000000000120000-0x0000000000c00000) (10MB) [ 0.000000] efi: mem10: type=3, attr=0xf, range=[0x0000000000c00000-0x0000000001000000) (4MB) [ 0.000000] efi: mem11: type=2, attr=0xf, range=[0x0000000001000000-0x000000000267a000) (22MB) [ 0.000000] efi: mem12: type=7, attr=0xf, range=[0x000000000267a000-0x0000000004000000) (25MB) [ 0.000000] efi: mem13: type=4, attr=0xf, range=[0x0000000004000000-0x000000000403b000) (0MB) [ 0.000000] efi: mem14: type=7, attr=0xf, range=[0x000000000403b000-0x000000003eca9000) (940MB) [ 0.000000] efi: mem15: type=2, attr=0xf, range=[0x000000003eca9000-0x0000000040000000) (19MB) [ 0.000000] efi: mem16: type=7, attr=0xf, range=[0x0000000040000000-0x000000004468f000) (70MB) [ 0.000000] efi: mem17: type=2, attr=0xf, range=[0x000000004468f000-0x000000005b25c000) (363MB) [ 0.000000] efi: mem18: type=1, attr=0xf, range=[0x000000005b25c000-0x000000005b475000) (2MB) [ 0.000000] efi: mem19: type=7, attr=0xf, range=[0x000000005b475000-0x000000005b488000) (0MB) [ 0.000000] efi: mem20: type=2, attr=0xf, range=[0x000000005b488000-0x000000005b59c000) (1MB) [ 0.000000] efi: mem21: type=4, attr=0xf, range=[0x000000005b59c000-0x000000005b6bf000) (1MB) [ 0.000000] efi: mem22: type=3, attr=0xf, range=[0x000000005b6bf000-0x000000005b70d000) (0MB) [ 0.000000] efi: mem23: type=4, attr=0xf, range=[0x000000005b70d000-0x000000005b75b000) (0MB) [ 0.000000] efi: mem24: type=3, attr=0xf, range=[0x000000005b75b000-0x000000005b7bd000) (0MB) [ 0.000000] efi: mem25: type=4, attr=0xf, range=[0x000000005b7bd000-0x000000005b7c7000) (0MB) [ 0.000000] efi: mem26: type=3, attr=0xf, range=[0x000000005b7c7000-0x000000005b8b2000) (0MB) [ 0.000000] efi: mem27: type=4, attr=0xf, range=[0x000000005b8b2000-0x000000005b8c1000) (0MB) [ 0.000000] efi: mem28: type=7, attr=0xf, range=[0x000000005b8c1000-0x000000005b8c4000) (0MB) [ 0.000000] efi: mem29: type=4, attr=0xf, range=[0x000000005b8c4000-0x000000005b8cc000) (0MB) [ 0.000000] efi: mem30: type=3, attr=0xf, range=[0x000000005b8cc000-0x000000005b927000) (0MB) [ 0.000000] efi: mem31: type=4, attr=0xf, range=[0x000000005b927000-0x000000005b931000) (0MB) [ 0.000000] efi: mem32: type=3, attr=0xf, range=[0x000000005b931000-0x000000005b960000) (0MB) [ 0.000000] efi: mem33: type=4, attr=0xf, range=[0x000000005b960000-0x000000005bc2f000) (2MB) [ 0.000000] efi: mem34: type=3, attr=0xf, range=[0x000000005bc2f000-0x000000005bc3c000) (0MB) [ 0.000000] efi: mem35: type=4, attr=0xf, range=[0x000000005bc3c000-0x000000005be3a000) (1MB) [ 0.000000] efi: mem36: type=7, attr=0xf, range=[0x000000005be3a000-0x000000005be3b000) (0MB) [ 0.000000] efi: mem37: type=4, attr=0xf, range=[0x000000005be3b000-0x000000005be4f000) (0MB) [ 0.000000] efi: mem38: type=7, attr=0xf, range=[0x000000005be4f000-0x000000005be50000) (0MB) [ 0.000000] efi: mem39: type=4, attr=0xf, range=[0x000000005be50000-0x000000005be5a000) (0MB) [ 0.000000] efi: mem40: type=7, attr=0xf, range=[0x000000005be5a000-0x000000005be5b000) (0MB) [ 0.000000] efi: mem41: type=4, attr=0xf, range=[0x000000005be5b000-0x000000005be61000) (0MB) [ 0.000000] efi: mem42: type=2, attr=0xf, range=[0x000000005be61000-0x000000005be63000) (0MB) [ 0.000000] efi: mem43: type=4, attr=0xf, range=[0x000000005be63000-0x000000005be64000) (0MB) [ 0.000000] efi: mem44: type=7, attr=0xf, range=[0x000000005be64000-0x000000005be65000) (0MB) [ 0.000000] efi: mem45: type=4, attr=0xf, range=[0x000000005be65000-0x000000005be77000) (0MB) [ 0.000000] efi: mem46: type=7, attr=0xf, range=[0x000000005be77000-0x000000005be78000) (0MB) [ 0.000000] efi: mem47: type=4, attr=0xf, range=[0x000000005be78000-0x000000005be79000) (0MB) [ 0.000000] efi: mem48: type=7, attr=0xf, range=[0x000000005be79000-0x000000005be7a000) (0MB) [ 0.000000] efi: mem49: type=2, attr=0xf, range=[0x000000005be7a000-0x000000005be7b000) (0MB) [ 0.000000] efi: mem50: type=4, attr=0xf, range=[0x000000005be7b000-0x000000005be7f000) (0MB) [ 0.000000] efi: mem51: type=3, attr=0xf, range=[0x000000005be7f000-0x000000005bea2000) (0MB) [ 0.000000] efi: mem52: type=4, attr=0xf, range=[0x000000005bea2000-0x000000005c003000) (1MB) [ 0.000000] efi: mem53: type=3, attr=0xf, range=[0x000000005c003000-0x000000005c3e0000) (3MB) [ 0.000000] efi: mem54: type=0, attr=0xf, range=[0x000000005c3e0000-0x00000000643e8000) (128MB) [ 0.000000] efi: mem55: type=3, attr=0xf, range=[0x00000000643e8000-0x0000000064fae000) (11MB) [ 0.000000] efi: mem56: type=4, attr=0xf, range=[0x0000000064fae000-0x0000000068acf000) (59MB) [ 0.000000] efi: mem57: type=3, attr=0xf, range=[0x0000000068acf000-0x0000000068ecf000) (4MB) [ 0.000000] efi: mem58: type=7, attr=0xf, range=[0x0000000068ecf000-0x0000000068ed1000) (0MB) [ 0.000000] efi: mem59: type=4, attr=0xf, range=[0x0000000068ed1000-0x0000000069066000) (1MB) [ 0.000000] efi: mem60: type=7, attr=0xf, range=[0x0000000069066000-0x0000000069067000) (0MB) [ 0.000000] efi: mem61: type=4, attr=0xf, range=[0x0000000069067000-0x000000006907a000) (0MB) [ 0.000000] efi: mem62: type=7, attr=0xf, range=[0x000000006907a000-0x000000006907b000) (0MB) [ 0.000000] efi: mem63: type=4, attr=0xf, range=[0x000000006907b000-0x0000000069087000) (0MB) [ 0.000000] efi: mem64: type=7, attr=0xf, range=[0x0000000069087000-0x0000000069088000) (0MB) [ 0.000000] efi: mem65: type=4, attr=0xf, range=[0x0000000069088000-0x0000000069089000) (0MB) [ 0.000000] efi: mem66: type=7, attr=0xf, range=[0x0000000069089000-0x000000006908a000) (0MB) [ 0.000000] efi: mem67: type=4, attr=0xf, range=[0x000000006908a000-0x0000000069097000) (0MB) [ 0.000000] efi: mem68: type=7, attr=0xf, range=[0x0000000069097000-0x0000000069098000) (0MB) [ 0.000000] efi: mem69: type=4, attr=0xf, range=[0x0000000069098000-0x000000006909b000) (0MB) [ 0.000000] efi: mem70: type=7, attr=0xf, range=[0x000000006909b000-0x000000006909c000) (0MB) [ 0.000000] efi: mem71: type=4, attr=0xf, range=[0x000000006909c000-0x00000000690dc000) (0MB) [ 0.000000] efi: mem72: type=7, attr=0xf, range=[0x00000000690dc000-0x00000000690dd000) (0MB) [ 0.000000] efi: mem73: type=4, attr=0xf, range=[0x00000000690dd000-0x000000006911a000) (0MB) [ 0.000000] efi: mem74: type=7, attr=0xf, range=[0x000000006911a000-0x000000006911b000) (0MB) [ 0.000000] efi: mem75: type=4, attr=0xf, range=[0x000000006911b000-0x000000006911f000) (0MB) [ 0.000000] efi: mem76: type=7, attr=0xf, range=[0x000000006911f000-0x0000000069120000) (0MB) [ 0.000000] efi: mem77: type=4, attr=0xf, range=[0x0000000069120000-0x000000006914c000) (0MB) [ 0.000000] efi: mem78: type=7, attr=0xf, range=[0x000000006914c000-0x000000006914d000) (0MB) [ 0.000000] efi: mem79: type=4, attr=0xf, range=[0x000000006914d000-0x0000000069152000) (0MB) [ 0.000000] efi: mem80: type=7, attr=0xf, range=[0x0000000069152000-0x0000000069153000) (0MB) [ 0.000000] efi: mem81: type=4, attr=0xf, range=[0x0000000069153000-0x0000000069164000) (0MB) [ 0.000000] efi: mem82: type=7, attr=0xf, range=[0x0000000069164000-0x0000000069165000) (0MB) [ 0.000000] efi: mem83: type=4, attr=0xf, range=[0x0000000069165000-0x000000006917a000) (0MB) [ 0.000000] efi: mem84: type=7, attr=0xf, range=[0x000000006917a000-0x000000006917b000) (0MB) [ 0.000000] efi: mem85: type=4, attr=0xf, range=[0x000000006917b000-0x000000006918b000) (0MB) [ 0.000000] efi: mem86: type=7, attr=0xf, range=[0x000000006918b000-0x000000006918c000) (0MB) [ 0.000000] efi: mem87: type=4, attr=0xf, range=[0x000000006918c000-0x00000000691ff000) (0MB) [ 0.000000] efi: mem88: type=7, attr=0xf, range=[0x00000000691ff000-0x0000000069200000) (0MB) [ 0.000000] efi: mem89: type=4, attr=0xf, range=[0x0000000069200000-0x0000000069204000) (0MB) [ 0.000000] efi: mem90: type=7, attr=0xf, range=[0x0000000069204000-0x0000000069205000) (0MB) [ 0.000000] efi: mem91: type=4, attr=0xf, range=[0x0000000069205000-0x000000006920e000) (0MB) [ 0.000000] efi: mem92: type=7, attr=0xf, range=[0x000000006920e000-0x000000006920f000) (0MB) [ 0.000000] efi: mem93: type=4, attr=0xf, range=[0x000000006920f000-0x0000000069216000) (0MB) [ 0.000000] efi: mem94: type=7, attr=0xf, range=[0x0000000069216000-0x0000000069217000) (0MB) [ 0.000000] efi: mem95: type=4, attr=0xf, range=[0x0000000069217000-0x0000000069218000) (0MB) [ 0.000000] efi: mem96: type=7, attr=0xf, range=[0x0000000069218000-0x0000000069219000) (0MB) [ 0.000000] efi: mem97: type=4, attr=0xf, range=[0x0000000069219000-0x000000006921c000) (0MB) [ 0.000000] efi: mem98: type=7, attr=0xf, range=[0x000000006921c000-0x000000006921e000) (0MB) [ 0.000000] efi: mem99: type=4, attr=0xf, range=[0x000000006921e000-0x0000000069223000) (0MB) [ 0.000000] efi: mem100: type=7, attr=0xf, range=[0x0000000069223000-0x0000000069224000) (0MB) [ 0.000000] efi: mem101: type=4, attr=0xf, range=[0x0000000069224000-0x0000000069226000) (0MB) [ 0.000000] efi: mem102: type=7, attr=0xf, range=[0x0000000069226000-0x0000000069227000) (0MB) [ 0.000000] efi: mem103: type=4, attr=0xf, range=[0x0000000069227000-0x000000006922f000) (0MB) [ 0.000000] efi: mem104: type=7, attr=0xf, range=[0x000000006922f000-0x0000000069230000) (0MB) [ 0.000000] efi: mem105: type=4, attr=0xf, range=[0x0000000069230000-0x000000006924f000) (0MB) [ 0.000000] efi: mem106: type=7, attr=0xf, range=[0x000000006924f000-0x0000000069250000) (0MB) [ 0.000000] efi: mem107: type=4, attr=0xf, range=[0x0000000069250000-0x000000006a2d3000) (16MB) [ 0.000000] efi: mem108: type=7, attr=0xf, range=[0x000000006a2d3000-0x000000006a2d5000) (0MB) [ 0.000000] efi: mem109: type=4, attr=0xf, range=[0x000000006a2d5000-0x000000006c3cf000) (32MB) [ 0.000000] efi: mem110: type=7, attr=0xf, range=[0x000000006c3cf000-0x000000006c3d1000) (0MB) [ 0.000000] efi: mem111: type=3, attr=0xf, range=[0x000000006c3d1000-0x000000006cacf000) (6MB) [ 0.000000] efi: mem112: type=6, attr=0x800000000000000f, range=[0x000000006cacf000-0x000000006cbcf000) (1MB) [ 0.000000] efi: mem113: type=5, attr=0x800000000000000f, range=[0x000000006cbcf000-0x000000006cdcf000) (2MB) [ 0.000000] efi: mem114: type=0, attr=0xf, range=[0x000000006cdcf000-0x000000006efcf000) (34MB) [ 0.000000] efi: mem115: type=10, attr=0xf, range=[0x000000006efcf000-0x000000006fdff000) (14MB) [ 0.000000] efi: mem116: type=9, attr=0xf, range=[0x000000006fdff000-0x000000006ffff000) (2MB) [ 0.000000] efi: mem117: type=4, attr=0xf, range=[0x000000006ffff000-0x0000000070000000) (0MB) [ 0.000000] efi: mem118: type=7, attr=0xf, range=[0x0000000100000000-0x000000107f380000) (63475MB) [ 0.000000] efi: mem119: type=7, attr=0xf, range=[0x0000001080000000-0x000000207ff80000) (65535MB) [ 0.000000] efi: mem120: type=7, attr=0xf, range=[0x0000002080000000-0x000000307ff80000) (65535MB) [ 0.000000] efi: mem121: type=7, attr=0xf, range=[0x0000003080000000-0x000000407ff80000) (65535MB) [ 0.000000] efi: mem122: type=0, attr=0x9, range=[0x0000000070000000-0x0000000080000000) (256MB) [ 0.000000] efi: mem123: type=11, attr=0x800000000000000f, range=[0x0000000080000000-0x0000000090000000) (256MB) [ 0.000000] efi: mem124: type=11, attr=0x800000000000000f, range=[0x00000000fec10000-0x00000000fec11000) (0MB) [ 0.000000] efi: mem125: type=11, attr=0x800000000000000f, range=[0x00000000fed80000-0x00000000fed81000) (0MB) [ 0.000000] efi: mem126: type=0, attr=0x0, range=[0x000000107f380000-0x0000001080000000) (12MB) [ 0.000000] efi: mem127: type=0, attr=0x0, range=[0x000000207ff80000-0x0000002080000000) (0MB) [ 0.000000] efi: mem128: type=0, attr=0x0, range=[0x000000307ff80000-0x0000003080000000) (0MB) [ 0.000000] efi: mem129: type=0, attr=0x0, range=[0x000000407ff80000-0x0000004080000000) (0MB) [ 0.000000] SMBIOS 3.0.0 present. [ 0.000000] DMI: Dell Inc. PowerEdge R6415/065PKD, BIOS 1.6.7 10/29/2018 [ 0.000000] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved [ 0.000000] e820: remove [mem 0x000a0000-0x000fffff] usable [ 0.000000] e820: last_pfn = 0x407ff80 max_arch_pfn = 0x400000000 [ 0.000000] MTRR default type: uncachable [ 0.000000] MTRR fixed ranges enabled: [ 0.000000] 00000-9FFFF write-back [ 0.000000] A0000-FFFFF uncachable [ 0.000000] MTRR variable ranges enabled: [ 0.000000] 0 base 0000FF000000 mask FFFFFF000000 write-protect [ 0.000000] 1 base 000000000000 mask FFFF80000000 write-back [ 0.000000] 2 base 000070000000 mask FFFFF0000000 uncachable [ 0.000000] 3 disabled [ 0.000000] 4 disabled [ 0.000000] 5 disabled [ 0.000000] 6 disabled [ 0.000000] 7 disabled [ 0.000000] TOM2: 0000004080000000 aka 264192M [ 0.000000] PAT configuration [0-7]: WB WC UC- UC WB WP UC- UC [ 0.000000] e820: last_pfn = 0x70000 max_arch_pfn = 0x400000000 [ 0.000000] Base memory trampoline at [ffff97ed80099000] 99000 size 24576 [ 0.000000] Using GB pages for direct mapping [ 0.000000] BRK [0x8c6652000, 0x8c6652fff] PGTABLE [ 0.000000] BRK [0x8c6653000, 0x8c6653fff] PGTABLE [ 0.000000] BRK [0x8c6654000, 0x8c6654fff] PGTABLE [ 0.000000] BRK [0x8c6655000, 0x8c6655fff] PGTABLE [ 0.000000] BRK [0x8c6656000, 0x8c6656fff] PGTABLE [ 0.000000] BRK [0x8c6657000, 0x8c6657fff] PGTABLE [ 0.000000] BRK [0x8c6658000, 0x8c6658fff] PGTABLE [ 0.000000] BRK [0x8c6659000, 0x8c6659fff] PGTABLE [ 0.000000] BRK [0x8c665a000, 0x8c665afff] PGTABLE [ 0.000000] BRK [0x8c665b000, 0x8c665bfff] PGTABLE [ 0.000000] BRK [0x8c665c000, 0x8c665cfff] PGTABLE [ 0.000000] BRK [0x8c665d000, 0x8c665dfff] PGTABLE [ 0.000000] RAMDISK: [mem 0x3eca9000-0x3fffdfff] [ 0.000000] Early table checksum verification disabled [ 0.000000] ACPI: RSDP 000000006fffe014 00024 (v02 DELL ) [ 0.000000] ACPI: XSDT 000000006fffd0e8 000B4 (v01 DELL PE_SC3 00000002 DELL 00000001) [ 0.000000] ACPI: FACP 000000006ffef000 00114 (v06 DELL PE_SC3 00000002 DELL 00000001) [ 0.000000] ACPI: DSDT 000000006ffe2000 0950B (v02 DELL PE_SC3 00000002 DELL 00000001) [ 0.000000] ACPI: FACS 000000006fdd4000 00040 [ 0.000000] ACPI: SSDT 000000006fffc000 000D2 (v02 DELL PE_SC3 00000002 MSFT 04000000) [ 0.000000] ACPI: BERT 000000006fffb000 00030 (v01 DELL BERT 00000001 DELL 00000001) [ 0.000000] ACPI: HEST 000000006fffa000 006DC (v01 DELL HEST 00000001 DELL 00000001) [ 0.000000] ACPI: SSDT 000000006fff9000 00294 (v01 DELL PE_SC3 00000001 AMD 00000001) [ 0.000000] ACPI: SRAT 000000006fff8000 00420 (v03 DELL PE_SC3 00000001 AMD 00000001) [ 0.000000] ACPI: MSCT 000000006fff7000 0004E (v01 DELL PE_SC3 00000000 AMD 00000001) [ 0.000000] ACPI: SLIT 000000006fff6000 0003C (v01 DELL PE_SC3 00000001 AMD 00000001) [ 0.000000] ACPI: CRAT 000000006fff3000 02DC0 (v01 DELL PE_SC3 00000001 AMD 00000001) [ 0.000000] ACPI: CDIT 000000006fff2000 00038 (v01 DELL PE_SC3 00000001 AMD 00000001) [ 0.000000] ACPI: EINJ 000000006fff1000 00150 (v01 DELL PE_SC3 00000001 AMD 00000001) [ 0.000000] ACPI: SLIC 000000006fff0000 00024 (v01 DELL PE_SC3 00000002 DELL 00000001) [ 0.000000] ACPI: HPET 000000006ffee000 00038 (v01 DELL PE_SC3 00000002 DELL 00000001) [ 0.000000] ACPI: APIC 000000006ffed000 004B2 (v03 DELL PE_SC3 00000002 DELL 00000001) [ 0.000000] ACPI: MCFG 000000006ffec000 0003C (v01 DELL PE_SC3 00000002 DELL 00000001) [ 0.000000] ACPI: SSDT 000000006ffe1000 00629 (v02 DELL xhc_port 00000001 INTL 20170119) [ 0.000000] ACPI: IVRS 000000006ffe0000 00210 (v02 DELL PE_SC3 00000001 AMD 00000000) [ 0.000000] ACPI: SSDT 000000006ffde000 01658 (v01 AMD CPMCMN 00000001 INTL 20170119) [ 0.000000] ACPI: Local APIC address 0xfee00000 [ 0.000000] SRAT: PXM 0 -> APIC 0x00 -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x01 -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x02 -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x03 -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x04 -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x05 -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x08 -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x09 -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x0a -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x0b -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x0c -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x0d -> Node 0 [ 0.000000] SRAT: PXM 1 -> APIC 0x10 -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x11 -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x12 -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x13 -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x14 -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x15 -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x18 -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x19 -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x1a -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x1b -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x1c -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x1d -> Node 1 [ 0.000000] SRAT: PXM 2 -> APIC 0x20 -> Node 2 [ 0.000000] SRAT: PXM 2 -> APIC 0x21 -> Node 2 [ 0.000000] SRAT: PXM 2 -> APIC 0x22 -> Node 2 [ 0.000000] SRAT: PXM 2 -> APIC 0x23 -> Node 2 [ 0.000000] SRAT: PXM 2 -> APIC 0x24 -> Node 2 [ 0.000000] SRAT: PXM 2 -> APIC 0x25 -> Node 2 [ 0.000000] SRAT: PXM 2 -> APIC 0x28 -> Node 2 [ 0.000000] SRAT: PXM 2 -> APIC 0x29 -> Node 2 [ 0.000000] SRAT: PXM 2 -> APIC 0x2a -> Node 2 [ 0.000000] SRAT: PXM 2 -> APIC 0x2b -> Node 2 [ 0.000000] SRAT: PXM 2 -> APIC 0x2c -> Node 2 [ 0.000000] SRAT: PXM 2 -> APIC 0x2d -> Node 2 [ 0.000000] SRAT: PXM 3 -> APIC 0x30 -> Node 3 [ 0.000000] SRAT: PXM 3 -> APIC 0x31 -> Node 3 [ 0.000000] SRAT: PXM 3 -> APIC 0x32 -> Node 3 [ 0.000000] SRAT: PXM 3 -> APIC 0x33 -> Node 3 [ 0.000000] SRAT: PXM 3 -> APIC 0x34 -> Node 3 [ 0.000000] SRAT: PXM 3 -> APIC 0x35 -> Node 3 [ 0.000000] SRAT: PXM 3 -> APIC 0x38 -> Node 3 [ 0.000000] SRAT: PXM 3 -> APIC 0x39 -> Node 3 [ 0.000000] SRAT: PXM 3 -> APIC 0x3a -> Node 3 [ 0.000000] SRAT: PXM 3 -> APIC 0x3b -> Node 3 [ 0.000000] SRAT: PXM 3 -> APIC 0x3c -> Node 3 [ 0.000000] SRAT: PXM 3 -> APIC 0x3d -> Node 3 [ 0.000000] SRAT: Node 0 PXM 0 [mem 0x00000000-0x0009ffff] [ 0.000000] SRAT: Node 0 PXM 0 [mem 0x00100000-0x7fffffff] [ 0.000000] SRAT: Node 0 PXM 0 [mem 0x100000000-0x107fffffff] [ 0.000000] SRAT: Node 1 PXM 1 [mem 0x1080000000-0x207fffffff] [ 0.000000] SRAT: Node 2 PXM 2 [mem 0x2080000000-0x307fffffff] [ 0.000000] SRAT: Node 3 PXM 3 [mem 0x3080000000-0x407fffffff] [ 0.000000] NUMA: Initialized distance table, cnt=4 [ 0.000000] NUMA: Node 0 [mem 0x00000000-0x0009ffff] + [mem 0x00100000-0x7fffffff] -> [mem 0x00000000-0x7fffffff] [ 0.000000] NUMA: Node 0 [mem 0x00000000-0x7fffffff] + [mem 0x100000000-0x107fffffff] -> [mem 0x00000000-0x107fffffff] [ 0.000000] NODE_DATA(0) allocated [mem 0x107f359000-0x107f37ffff] [ 0.000000] NODE_DATA(1) allocated [mem 0x207ff59000-0x207ff7ffff] [ 0.000000] NODE_DATA(2) allocated [mem 0x307ff59000-0x307ff7ffff] [ 0.000000] NODE_DATA(3) allocated [mem 0x407ff58000-0x407ff7efff] [ 0.000000] Reserving 176MB of memory at 720MB for crashkernel (System RAM: 261692MB) [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x00001000-0x00ffffff] [ 0.000000] DMA32 [mem 0x01000000-0xffffffff] [ 0.000000] Normal [mem 0x100000000-0x407ff7ffff] [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x00001000-0x0008efff] [ 0.000000] node 0: [mem 0x00090000-0x0009ffff] [ 0.000000] node 0: [mem 0x00100000-0x5c3dffff] [ 0.000000] node 0: [mem 0x643e8000-0x6cacefff] [ 0.000000] node 0: [mem 0x6ffff000-0x6fffffff] [ 0.000000] node 0: [mem 0x100000000-0x107f37ffff] [ 0.000000] node 1: [mem 0x1080000000-0x207ff7ffff] [ 0.000000] node 2: [mem 0x2080000000-0x307ff7ffff] [ 0.000000] node 3: [mem 0x3080000000-0x407ff7ffff] [ 0.000000] Initmem setup node 0 [mem 0x00001000-0x107f37ffff] [ 0.000000] On node 0 totalpages: 16661990 [ 0.000000] DMA zone: 64 pages used for memmap [ 0.000000] DMA zone: 1126 pages reserved [ 0.000000] DMA zone: 3998 pages, LIFO batch:0 [ 0.000000] DMA32 zone: 6380 pages used for memmap [ 0.000000] DMA32 zone: 408264 pages, LIFO batch:31 [ 0.000000] Normal zone: 253902 pages used for memmap [ 0.000000] Normal zone: 16249728 pages, LIFO batch:31 [ 0.000000] Initmem setup node 1 [mem 0x1080000000-0x207ff7ffff] [ 0.000000] On node 1 totalpages: 16777088 [ 0.000000] Normal zone: 262142 pages used for memmap [ 0.000000] Normal zone: 16777088 pages, LIFO batch:31 [ 0.000000] Initmem setup node 2 [mem 0x2080000000-0x307ff7ffff] [ 0.000000] On node 2 totalpages: 16777088 [ 0.000000] Normal zone: 262142 pages used for memmap [ 0.000000] Normal zone: 16777088 pages, LIFO batch:31 [ 0.000000] Initmem setup node 3 [mem 0x3080000000-0x407ff7ffff] [ 0.000000] On node 3 totalpages: 16777088 [ 0.000000] Normal zone: 262142 pages used for memmap [ 0.000000] Normal zone: 16777088 pages, LIFO batch:31 [ 0.000000] ACPI: PM-Timer IO Port: 0x408 [ 0.000000] ACPI: Local APIC address 0xfee00000 [ 0.000000] ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x01] lapic_id[0x10] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x02] lapic_id[0x20] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x03] lapic_id[0x30] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x04] lapic_id[0x08] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x05] lapic_id[0x18] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x06] lapic_id[0x28] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x07] lapic_id[0x38] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x08] lapic_id[0x02] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x09] lapic_id[0x12] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x22] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x32] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x0c] lapic_id[0x0a] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x0d] lapic_id[0x1a] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x0e] lapic_id[0x2a] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x0f] lapic_id[0x3a] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x10] lapic_id[0x04] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x11] lapic_id[0x14] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x12] lapic_id[0x24] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x13] lapic_id[0x34] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x14] lapic_id[0x0c] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x15] lapic_id[0x1c] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x16] lapic_id[0x2c] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x17] lapic_id[0x3c] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x18] lapic_id[0x01] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x19] lapic_id[0x11] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x1a] lapic_id[0x21] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x1b] lapic_id[0x31] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x1c] lapic_id[0x09] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x1d] lapic_id[0x19] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x1e] lapic_id[0x29] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x1f] lapic_id[0x39] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x20] lapic_id[0x03] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x21] lapic_id[0x13] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x22] lapic_id[0x23] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x23] lapic_id[0x33] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x24] lapic_id[0x0b] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x25] lapic_id[0x1b] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x26] lapic_id[0x2b] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x27] lapic_id[0x3b] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x28] lapic_id[0x05] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x29] lapic_id[0x15] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x2a] lapic_id[0x25] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x2b] lapic_id[0x35] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x2c] lapic_id[0x0d] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x2d] lapic_id[0x1d] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x2e] lapic_id[0x2d] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x2f] lapic_id[0x3d] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x30] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x31] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x32] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x33] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x34] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x35] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x36] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x37] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x38] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x39] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x3a] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x3b] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x3c] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x3d] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x3e] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x3f] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x40] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x41] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x42] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x43] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x44] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x45] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x46] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x47] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x48] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x49] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x4a] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x4b] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x4c] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x4d] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x4e] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x4f] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x50] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x51] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x52] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x53] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x54] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x55] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x56] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x57] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x58] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x59] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x5a] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x5b] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x5c] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x5d] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x5e] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x5f] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x60] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x61] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x62] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x63] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x64] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x65] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x66] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x67] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x68] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x69] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x6a] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x6b] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x6c] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x6d] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x6e] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x6f] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x70] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x71] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x72] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x73] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x74] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x75] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x76] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x77] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x78] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x79] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x7a] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x7b] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x7c] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x7d] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x7e] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x7f] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] high edge lint[0x1]) [ 0.000000] ACPI: IOAPIC (id[0x80] address[0xfec00000] gsi_base[0]) [ 0.000000] IOAPIC[0]: apic_id 128, version 33, address 0xfec00000, GSI 0-23 [ 0.000000] ACPI: IOAPIC (id[0x81] address[0xfd880000] gsi_base[24]) [ 0.000000] IOAPIC[1]: apic_id 129, version 33, address 0xfd880000, GSI 24-55 [ 0.000000] ACPI: IOAPIC (id[0x82] address[0xe0900000] gsi_base[56]) [ 0.000000] IOAPIC[2]: apic_id 130, version 33, address 0xe0900000, GSI 56-87 [ 0.000000] ACPI: IOAPIC (id[0x83] address[0xc5900000] gsi_base[88]) [ 0.000000] IOAPIC[3]: apic_id 131, version 33, address 0xc5900000, GSI 88-119 [ 0.000000] ACPI: IOAPIC (id[0x84] address[0xaa900000] gsi_base[120]) [ 0.000000] IOAPIC[4]: apic_id 132, version 33, address 0xaa900000, GSI 120-151 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 low level) [ 0.000000] ACPI: IRQ0 used by override. [ 0.000000] ACPI: IRQ9 used by override. [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] ACPI: HPET id: 0x10228201 base: 0xfed00000 [ 0.000000] smpboot: Allowing 128 CPUs, 80 hotplug CPUs [ 0.000000] PM: Registered nosave memory: [mem 0x0008f000-0x0008ffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000fffff] [ 0.000000] PM: Registered nosave memory: [mem 0x4468f000-0x4468ffff] [ 0.000000] PM: Registered nosave memory: [mem 0x446a7000-0x446a7fff] [ 0.000000] PM: Registered nosave memory: [mem 0x446a8000-0x446a8fff] [ 0.000000] PM: Registered nosave memory: [mem 0x446d9000-0x446d9fff] [ 0.000000] PM: Registered nosave memory: [mem 0x446da000-0x446dafff] [ 0.000000] PM: Registered nosave memory: [mem 0x4470b000-0x4470bfff] [ 0.000000] PM: Registered nosave memory: [mem 0x5b488000-0x5b488fff] [ 0.000000] PM: Registered nosave memory: [mem 0x5b490000-0x5b490fff] [ 0.000000] PM: Registered nosave memory: [mem 0x5c3e0000-0x643e7fff] [ 0.000000] PM: Registered nosave memory: [mem 0x6cacf000-0x6efcefff] [ 0.000000] PM: Registered nosave memory: [mem 0x6efcf000-0x6fdfefff] [ 0.000000] PM: Registered nosave memory: [mem 0x6fdff000-0x6fffefff] [ 0.000000] PM: Registered nosave memory: [mem 0x70000000-0x8fffffff] [ 0.000000] PM: Registered nosave memory: [mem 0x90000000-0xfec0ffff] [ 0.000000] PM: Registered nosave memory: [mem 0xfec10000-0xfec10fff] [ 0.000000] PM: Registered nosave memory: [mem 0xfec11000-0xfed7ffff] [ 0.000000] PM: Registered nosave memory: [mem 0xfed80000-0xfed80fff] [ 0.000000] PM: Registered nosave memory: [mem 0xfed81000-0xffffffff] [ 0.000000] PM: Registered nosave memory: [mem 0x107f380000-0x107fffffff] [ 0.000000] PM: Registered nosave memory: [mem 0x207ff80000-0x207fffffff] [ 0.000000] PM: Registered nosave memory: [mem 0x307ff80000-0x307fffffff] [ 0.000000] e820: [mem 0x90000000-0xfec0ffff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on bare hardware [ 0.000000] setup_percpu: NR_CPUS:5120 nr_cpumask_bits:128 nr_cpu_ids:128 nr_node_ids:4 [ 0.000000] PERCPU: Embedded 38 pages/cpu @ffff97fdbee00000 s118784 r8192 d28672 u262144 [ 0.000000] pcpu-alloc: s118784 r8192 d28672 u262144 alloc=1*2097152 [ 0.000000] pcpu-alloc: [0] 000 004 008 012 016 020 024 028 [ 0.000000] pcpu-alloc: [0] 032 036 040 044 048 052 056 060 [ 0.000000] pcpu-alloc: [0] 064 068 072 076 080 084 088 092 [ 0.000000] pcpu-alloc: [0] 096 100 104 108 112 116 120 124 [ 0.000000] pcpu-alloc: [1] 001 005 009 013 017 021 025 029 [ 0.000000] pcpu-alloc: [1] 033 037 041 045 049 053 057 061 [ 0.000000] pcpu-alloc: [1] 065 069 073 077 081 085 089 093 [ 0.000000] pcpu-alloc: [1] 097 101 105 109 113 117 121 125 [ 0.000000] pcpu-alloc: [2] 002 006 010 014 018 022 026 030 [ 0.000000] pcpu-alloc: [2] 034 038 042 046 050 054 058 062 [ 0.000000] pcpu-alloc: [2] 066 070 074 078 082 086 090 094 [ 0.000000] pcpu-alloc: [2] 098 102 106 110 114 118 122 126 [ 0.000000] pcpu-alloc: [3] 003 007 011 015 019 023 027 031 [ 0.000000] pcpu-alloc: [3] 035 039 043 047 051 055 059 063 [ 0.000000] pcpu-alloc: [3] 067 071 075 079 083 087 091 095 [ 0.000000] pcpu-alloc: [3] 099 103 107 111 115 119 123 127 [ 0.000000] Built 4 zonelists in Zone order, mobility grouping on. Total pages: 65945356 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-3.10.0-957.1.3.el7_lustre.x86_64 root=UUID=678f7e0b-b88d-484c-88a6-2c6850d78597 ro crashkernel=auto nomodeset console=ttyS0,115200 LANG=en_US.UTF-8 [ 0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes) [ 0.000000] x86/fpu: xstate_offset[2]: 0240, xstate_sizes[2]: 0100 [ 0.000000] xsave: enabled xstate_bv 0x7, cntxt size 0x340 using standard form [ 0.000000] Memory: 9614204k/270532096k available (7664k kernel code, 2559080k absent, 4653756k reserved, 6055k data, 1876k init) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=128, Nodes=4 [ 0.000000] Hierarchical RCU implementation. [ 0.000000] RCU restricting CPUs from NR_CPUS=5120 to nr_cpu_ids=128. [ 0.000000] NR_IRQS:327936 nr_irqs:3624 0 [ 0.000000] Console: colour dummy device 80x25 [ 0.000000] console [ttyS0] enabled [ 0.000000] allocated 1072693248 bytes of page_cgroup [ 0.000000] please try 'cgroup_disable=memory' option if you don't want memory cgroups [ 0.000000] Enabling automatic NUMA balancing. Configure with numa_balancing= or the kernel.numa_balancing sysctl [ 0.000000] hpet clockevent registered [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 1996.233 MHz processor [ 0.000056] Calibrating delay loop (skipped), value calculated using timer frequency.. 3992.46 BogoMIPS (lpj=1996233) [ 0.010705] pid_max: default: 131072 minimum: 1024 [ 0.016342] Security Framework initialized [ 0.020457] SELinux: Initializing. [ 0.024025] SELinux: Starting in permissive mode [ 0.024026] Yama: becoming mindful. [ 0.043376] Dentry cache hash table entries: 33554432 (order: 16, 268435456 bytes) [ 0.098716] Inode-cache hash table entries: 16777216 (order: 15, 134217728 bytes) [ 0.126527] Mount-cache hash table entries: 524288 (order: 10, 4194304 bytes) [ 0.133918] Mountpoint-cache hash table entries: 524288 (order: 10, 4194304 bytes) [ 0.143056] Initializing cgroup subsys memory [ 0.147457] Initializing cgroup subsys devices [ 0.151913] Initializing cgroup subsys freezer [ 0.156366] Initializing cgroup subsys net_cls [ 0.160822] Initializing cgroup subsys blkio [ 0.165104] Initializing cgroup subsys perf_event [ 0.169826] Initializing cgroup subsys hugetlb [ 0.174281] Initializing cgroup subsys pids [ 0.178475] Initializing cgroup subsys net_prio [ 0.183081] tseg: 0070000000 [ 0.188661] mce: CPU supports 23 MCE banks [ 0.192807] LVT offset 2 assigned for vector 0xf4 [ 0.197538] Last level iTLB entries: 4KB 1024, 2MB 1024, 4MB 512 [ 0.203558] Last level dTLB entries: 4KB 1536, 2MB 1536, 4MB 768 [ 0.209572] tlb_flushall_shift: 6 [ 0.212919] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl and seccomp [ 0.222494] FEATURE SPEC_CTRL Not Present [ 0.226516] FEATURE IBPB_SUPPORT Present [ 0.230536] Spectre V2 : Mitigation: Full retpoline [ 0.235825] Freeing SMP alternatives: 28k freed [ 0.242026] ACPI: Core revision 20130517 [ 0.250147] ACPI: All ACPI Tables successfully acquired [ 0.260749] ftrace: allocating 29188 entries in 115 pages [ 0.600442] Switched APIC routing to physical flat. [ 0.607364] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.623374] smpboot: CPU0: AMD EPYC 7401P 24-Core Processor (fam: 17, model: 01, stepping: 02) [ 0.706622] random: fast init done [ 0.735622] APIC calibration not consistent with PM-Timer: 101ms instead of 100ms [ 0.743104] APIC delta adjusted to PM-Timer: 623827 (636297) [ 0.748791] Performance Events: Fam17h core perfctr, AMD PMU driver. [ 0.755222] ... version: 0 [ 0.759234] ... bit width: 48 [ 0.763333] ... generic registers: 6 [ 0.767346] ... value mask: 0000ffffffffffff [ 0.772658] ... max period: 00007fffffffffff [ 0.777970] ... fixed-purpose events: 0 [ 0.781983] ... event mask: 000000000000003f [ 0.790269] NMI watchdog: enabled on all CPUs, permanently consumes one hw-PMU counter. [ 0.798351] smpboot: Booting Node 1, Processors #1 OK [ 0.811553] smpboot: Booting Node 2, Processors #2 OK [ 0.824754] smpboot: Booting Node 3, Processors #3 OK [ 0.837948] smpboot: Booting Node 0, Processors #4 OK [ 0.851131] smpboot: Booting Node 1, Processors #5 OK [ 0.864316] smpboot: Booting Node 2, Processors #6 OK [ 0.877498] smpboot: Booting Node 3, Processors #7 OK [ 0.890672] smpboot: Booting Node 0, Processors #8 OK [ 0.904066] smpboot: Booting Node 1, Processors #9 OK [ 0.917264] smpboot: Booting Node 2, Processors #10 OK [ 0.930541] smpboot: Booting Node 3, Processors #11 OK [ 0.943804] smpboot: Booting Node 0, Processors #12 OK [ 0.957073] smpboot: Booting Node 1, Processors #13 OK [ 0.970346] smpboot: Booting Node 2, Processors #14 OK [ 0.983625] smpboot: Booting Node 3, Processors #15 OK [ 0.996895] smpboot: Booting Node 0, Processors #16 OK [ 1.010274] smpboot: Booting Node 1, Processors #17 OK [ 1.023552] smpboot: Booting Node 2, Processors #18 OK [ 1.036832] smpboot: Booting Node 3, Processors #19 OK [ 1.050102] smpboot: Booting Node 0, Processors #20 OK [ 1.063376] smpboot: Booting Node 1, Processors #21 OK [ 1.076653] smpboot: Booting Node 2, Processors #22 OK [ 1.089943] smpboot: Booting Node 3, Processors #23 OK [ 1.103212] smpboot: Booting Node 0, Processors #24 OK [ 1.116521] smpboot: Booting Node 1, Processors #25 OK [ 1.129754] smpboot: Booting Node 2, Processors #26 OK [ 1.142999] smpboot: Booting Node 3, Processors #27 OK [ 1.156243] smpboot: Booting Node 0, Processors #28 OK [ 1.169466] smpboot: Booting Node 1, Processors #29 OK [ 1.182699] smpboot: Booting Node 2, Processors #30 OK [ 1.195936] smpboot: Booting Node 3, Processors #31 OK [ 1.209161] smpboot: Booting Node 0, Processors #32 OK [ 1.222489] smpboot: Booting Node 1, Processors #33 OK [ 1.235725] smpboot: Booting Node 2, Processors #34 OK [ 1.248967] smpboot: Booting Node 3, Processors #35 OK [ 1.262195] smpboot: Booting Node 0, Processors #36 OK [ 1.275417] smpboot: Booting Node 1, Processors #37 OK [ 1.288652] smpboot: Booting Node 2, Processors #38 OK [ 1.301896] smpboot: Booting Node 3, Processors #39 OK [ 1.315121] smpboot: Booting Node 0, Processors #40 OK [ 1.328457] smpboot: Booting Node 1, Processors #41 OK [ 1.341691] smpboot: Booting Node 2, Processors #42 OK [ 1.354929] smpboot: Booting Node 3, Processors #43 OK [ 1.368162] smpboot: Booting Node 0, Processors #44 OK [ 1.381395] smpboot: Booting Node 1, Processors #45 OK [ 1.394628] smpboot: Booting Node 2, Processors #46 OK [ 1.407866] smpboot: Booting Node 3, Processors #47 [ 1.420570] Brought up 48 CPUs [ 1.423828] smpboot: Max logical packages: 3 [ 1.428105] smpboot: Total of 48 processors activated (191638.36 BogoMIPS) [ 1.724886] node 0 initialised, 15458278 pages in 283ms [ 1.735388] node 1 initialised, 15989367 pages in 289ms [ 1.735406] node 3 initialised, 15989250 pages in 289ms [ 1.735463] node 2 initialised, 15989367 pages in 289ms [ 1.751612] devtmpfs: initialized [ 1.776958] EVM: security.selinux [ 1.780275] EVM: security.ima [ 1.783247] EVM: security.capability [ 1.786919] PM: Registering ACPI NVS region [mem 0x0008f000-0x0008ffff] (4096 bytes) [ 1.794664] PM: Registering ACPI NVS region [mem 0x6efcf000-0x6fdfefff] (14876672 bytes) [ 1.804272] atomic64 test passed for x86-64 platform with CX8 and with SSE [ 1.811150] pinctrl core: initialized pinctrl subsystem [ 1.816471] RTC time: 14:53:56, date: 04/22/19 [ 1.821063] NET: Registered protocol family 16 [ 1.825848] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 1.833413] ACPI: bus type PCI registered [ 1.837426] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 1.844010] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000) [ 1.853313] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in E820 [ 1.860104] PCI: Using configuration type 1 for base access [ 1.865688] PCI: Dell System detected, enabling pci=bfsort. [ 1.881147] ACPI: Added _OSI(Module Device) [ 1.885337] ACPI: Added _OSI(Processor Device) [ 1.889779] ACPI: Added _OSI(3.0 _SCP Extensions) [ 1.894485] ACPI: Added _OSI(Processor Aggregator Device) [ 1.899887] ACPI: Added _OSI(Linux-Dell-Video) [ 1.905057] ACPI: EC: Look up EC in DSDT [ 1.905951] ACPI: Executed 2 blocks of module-level executable AML code [ 1.917902] ACPI: Interpreter enabled [ 1.921577] ACPI: (supports S0 S5) [ 1.924985] ACPI: Using IOAPIC for interrupt routing [ 1.930147] HEST: Table parsing has been initialized. [ 1.935207] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 1.944353] ACPI: Enabled 1 GPEs in block 00 to 1F [ 1.956050] ACPI: PCI Interrupt Link [LNKA] (IRQs 4 5 7 10 11 14 15) *0 [ 1.962959] ACPI: PCI Interrupt Link [LNKB] (IRQs 4 5 7 10 11 14 15) *0 [ 1.969872] ACPI: PCI Interrupt Link [LNKC] (IRQs 4 5 7 10 11 14 15) *0 [ 1.976779] ACPI: PCI Interrupt Link [LNKD] (IRQs 4 5 7 10 11 14 15) *0 [ 1.983683] ACPI: PCI Interrupt Link [LNKE] (IRQs 4 5 7 10 11 14 15) *0 [ 1.990590] ACPI: PCI Interrupt Link [LNKF] (IRQs 4 5 7 10 11 14 15) *0 [ 1.997500] ACPI: PCI Interrupt Link [LNKG] (IRQs 4 5 7 10 11 14 15) *0 [ 2.004406] ACPI: PCI Interrupt Link [LNKH] (IRQs 4 5 7 10 11 14 15) *0 [ 2.011459] ACPI: PCI Root Bridge [PC00] (domain 0000 [bus 00-3f]) [ 2.017645] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI] [ 2.025864] acpi PNP0A08:00: PCIe AER handled by firmware [ 2.031306] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug] [ 2.038253] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 2.045904] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 2.054343] PCI host bridge to bus 0000:00 [ 2.058445] pci_bus 0000:00: root bus resource [io 0x0000-0x03af window] [ 2.065230] pci_bus 0000:00: root bus resource [io 0x03e0-0x0cf7 window] [ 2.072017] pci_bus 0000:00: root bus resource [mem 0x000c0000-0x000c3fff window] [ 2.079495] pci_bus 0000:00: root bus resource [mem 0x000c4000-0x000c7fff window] [ 2.086977] pci_bus 0000:00: root bus resource [mem 0x000c8000-0x000cbfff window] [ 2.094457] pci_bus 0000:00: root bus resource [mem 0x000cc000-0x000cffff window] [ 2.101935] pci_bus 0000:00: root bus resource [mem 0x000d0000-0x000d3fff window] [ 2.109415] pci_bus 0000:00: root bus resource [mem 0x000d4000-0x000d7fff window] [ 2.116893] pci_bus 0000:00: root bus resource [mem 0x000d8000-0x000dbfff window] [ 2.124375] pci_bus 0000:00: root bus resource [mem 0x000dc000-0x000dffff window] [ 2.131852] pci_bus 0000:00: root bus resource [mem 0x000e0000-0x000e3fff window] [ 2.139335] pci_bus 0000:00: root bus resource [mem 0x000e4000-0x000e7fff window] [ 2.146811] pci_bus 0000:00: root bus resource [mem 0x000e8000-0x000ebfff window] [ 2.154289] pci_bus 0000:00: root bus resource [mem 0x000ec000-0x000effff window] [ 2.161770] pci_bus 0000:00: root bus resource [mem 0x000f0000-0x000fffff window] [ 2.169249] pci_bus 0000:00: root bus resource [io 0x0d00-0x3fff window] [ 2.176035] pci_bus 0000:00: root bus resource [mem 0xe1000000-0xfebfffff window] [ 2.183515] pci_bus 0000:00: root bus resource [mem 0x10000000000-0x2bf3fffffff window] [ 2.191514] pci_bus 0000:00: root bus resource [bus 00-3f] [ 2.197006] pci 0000:00:00.0: [1022:1450] type 00 class 0x060000 [ 2.197111] pci 0000:00:00.2: [1022:1451] type 00 class 0x080600 [ 2.197221] pci 0000:00:01.0: [1022:1452] type 00 class 0x060000 [ 2.197322] pci 0000:00:02.0: [1022:1452] type 00 class 0x060000 [ 2.197419] pci 0000:00:03.0: [1022:1452] type 00 class 0x060000 [ 2.197504] pci 0000:00:03.1: [1022:1453] type 01 class 0x060400 [ 2.197974] pci 0000:00:03.1: PME# supported from D0 D3hot D3cold [ 2.198072] pci 0000:00:04.0: [1022:1452] type 00 class 0x060000 [ 2.198175] pci 0000:00:07.0: [1022:1452] type 00 class 0x060000 [ 2.198259] pci 0000:00:07.1: [1022:1454] type 01 class 0x060400 [ 2.198964] pci 0000:00:07.1: PME# supported from D0 D3hot D3cold [ 2.199041] pci 0000:00:08.0: [1022:1452] type 00 class 0x060000 [ 2.199126] pci 0000:00:08.1: [1022:1454] type 01 class 0x060400 [ 2.199957] pci 0000:00:08.1: PME# supported from D0 D3hot D3cold [ 2.200070] pci 0000:00:14.0: [1022:790b] type 00 class 0x0c0500 [ 2.200301] pci 0000:00:14.3: [1022:790e] type 00 class 0x060100 [ 2.200535] pci 0000:00:18.0: [1022:1460] type 00 class 0x060000 [ 2.200609] pci 0000:00:18.1: [1022:1461] type 00 class 0x060000 [ 2.200682] pci 0000:00:18.2: [1022:1462] type 00 class 0x060000 [ 2.200757] pci 0000:00:18.3: [1022:1463] type 00 class 0x060000 [ 2.200830] pci 0000:00:18.4: [1022:1464] type 00 class 0x060000 [ 2.200902] pci 0000:00:18.5: [1022:1465] type 00 class 0x060000 [ 2.200977] pci 0000:00:18.6: [1022:1466] type 00 class 0x060000 [ 2.201051] pci 0000:00:18.7: [1022:1467] type 00 class 0x060000 [ 2.201122] pci 0000:00:19.0: [1022:1460] type 00 class 0x060000 [ 2.201199] pci 0000:00:19.1: [1022:1461] type 00 class 0x060000 [ 2.201273] pci 0000:00:19.2: [1022:1462] type 00 class 0x060000 [ 2.201349] pci 0000:00:19.3: [1022:1463] type 00 class 0x060000 [ 2.201424] pci 0000:00:19.4: [1022:1464] type 00 class 0x060000 [ 2.201503] pci 0000:00:19.5: [1022:1465] type 00 class 0x060000 [ 2.201580] pci 0000:00:19.6: [1022:1466] type 00 class 0x060000 [ 2.201658] pci 0000:00:19.7: [1022:1467] type 00 class 0x060000 [ 2.201732] pci 0000:00:1a.0: [1022:1460] type 00 class 0x060000 [ 2.201812] pci 0000:00:1a.1: [1022:1461] type 00 class 0x060000 [ 2.201887] pci 0000:00:1a.2: [1022:1462] type 00 class 0x060000 [ 2.201966] pci 0000:00:1a.3: [1022:1463] type 00 class 0x060000 [ 2.202041] pci 0000:00:1a.4: [1022:1464] type 00 class 0x060000 [ 2.202117] pci 0000:00:1a.5: [1022:1465] type 00 class 0x060000 [ 2.202194] pci 0000:00:1a.6: [1022:1466] type 00 class 0x060000 [ 2.202269] pci 0000:00:1a.7: [1022:1467] type 00 class 0x060000 [ 2.202344] pci 0000:00:1b.0: [1022:1460] type 00 class 0x060000 [ 2.202419] pci 0000:00:1b.1: [1022:1461] type 00 class 0x060000 [ 2.202494] pci 0000:00:1b.2: [1022:1462] type 00 class 0x060000 [ 2.202569] pci 0000:00:1b.3: [1022:1463] type 00 class 0x060000 [ 2.202644] pci 0000:00:1b.4: [1022:1464] type 00 class 0x060000 [ 2.202721] pci 0000:00:1b.5: [1022:1465] type 00 class 0x060000 [ 2.202801] pci 0000:00:1b.6: [1022:1466] type 00 class 0x060000 [ 2.202877] pci 0000:00:1b.7: [1022:1467] type 00 class 0x060000 [ 2.203034] pci 0000:01:00.0: [1000:00d1] type 00 class 0x010700 [ 2.203057] pci 0000:01:00.0: reg 0x10: [mem 0xe1000000-0xe10fffff 64bit pref] [ 2.203067] pci 0000:01:00.0: reg 0x18: [mem 0xe1100000-0xe11fffff 64bit pref] [ 2.203074] pci 0000:01:00.0: reg 0x20: [mem 0xf7500000-0xf75fffff] [ 2.203081] pci 0000:01:00.0: reg 0x24: [io 0x1000-0x10ff] [ 2.203088] pci 0000:01:00.0: reg 0x30: [mem 0xfffc0000-0xffffffff pref] [ 2.203176] pci 0000:01:00.0: supports D1 D2 [ 2.205753] pci 0000:00:03.1: PCI bridge to [bus 01] [ 2.210723] pci 0000:00:03.1: bridge window [io 0x1000-0x1fff] [ 2.210726] pci 0000:00:03.1: bridge window [mem 0xf7500000-0xf75fffff] [ 2.210729] pci 0000:00:03.1: bridge window [mem 0xe1000000-0xe11fffff 64bit pref] [ 2.210922] pci 0000:02:00.0: [1022:145a] type 00 class 0x130000 [ 2.211049] pci 0000:02:00.2: [1022:1456] type 00 class 0x108000 [ 2.211066] pci 0000:02:00.2: reg 0x18: [mem 0xf7300000-0xf73fffff] [ 2.211079] pci 0000:02:00.2: reg 0x24: [mem 0xf7400000-0xf7401fff] [ 2.211182] pci 0000:02:00.3: [1022:145f] type 00 class 0x0c0330 [ 2.211194] pci 0000:02:00.3: reg 0x10: [mem 0xf7200000-0xf72fffff 64bit] [ 2.211270] pci 0000:02:00.3: PME# supported from D0 D3hot D3cold [ 2.211324] pci 0000:00:07.1: PCI bridge to [bus 02] [ 2.216296] pci 0000:00:07.1: bridge window [mem 0xf7200000-0xf74fffff] [ 2.216959] pci 0000:03:00.0: [1022:1455] type 00 class 0x130000 [ 2.217096] pci 0000:03:00.1: [1022:1468] type 00 class 0x108000 [ 2.217114] pci 0000:03:00.1: reg 0x18: [mem 0xf7000000-0xf70fffff] [ 2.217127] pci 0000:03:00.1: reg 0x24: [mem 0xf7100000-0xf7101fff] [ 2.217246] pci 0000:00:08.1: PCI bridge to [bus 03] [ 2.222215] pci 0000:00:08.1: bridge window [mem 0xf7000000-0xf71fffff] [ 2.222232] pci_bus 0000:00: on NUMA node 0 [ 2.222602] ACPI: PCI Root Bridge [PC01] (domain 0000 [bus 40-7f]) [ 2.228783] acpi PNP0A08:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI] [ 2.236994] acpi PNP0A08:01: PCIe AER handled by firmware [ 2.242437] acpi PNP0A08:01: _OSC: platform does not support [SHPCHotplug] [ 2.249383] acpi PNP0A08:01: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 2.257035] acpi PNP0A08:01: FADT indicates ASPM is unsupported, using BIOS configuration [ 2.265441] PCI host bridge to bus 0000:40 [ 2.269542] pci_bus 0000:40: root bus resource [io 0x4000-0x7fff window] [ 2.276329] pci_bus 0000:40: root bus resource [mem 0xc6000000-0xe0ffffff window] [ 2.283808] pci_bus 0000:40: root bus resource [mem 0x2bf40000000-0x47e7fffffff window] [ 2.291807] pci_bus 0000:40: root bus resource [bus 40-7f] [ 2.297297] pci 0000:40:00.0: [1022:1450] type 00 class 0x060000 [ 2.297393] pci 0000:40:00.2: [1022:1451] type 00 class 0x080600 [ 2.297506] pci 0000:40:01.0: [1022:1452] type 00 class 0x060000 [ 2.297603] pci 0000:40:02.0: [1022:1452] type 00 class 0x060000 [ 2.297702] pci 0000:40:03.0: [1022:1452] type 00 class 0x060000 [ 2.297803] pci 0000:40:04.0: [1022:1452] type 00 class 0x060000 [ 2.297906] pci 0000:40:07.0: [1022:1452] type 00 class 0x060000 [ 2.297990] pci 0000:40:07.1: [1022:1454] type 01 class 0x060400 [ 2.298133] pci 0000:40:07.1: PME# supported from D0 D3hot D3cold [ 2.298211] pci 0000:40:08.0: [1022:1452] type 00 class 0x060000 [ 2.298296] pci 0000:40:08.1: [1022:1454] type 01 class 0x060400 [ 2.298792] pci 0000:40:08.1: PME# supported from D0 D3hot D3cold [ 2.298998] pci 0000:41:00.0: [1022:145a] type 00 class 0x130000 [ 2.299132] pci 0000:41:00.2: [1022:1456] type 00 class 0x108000 [ 2.299151] pci 0000:41:00.2: reg 0x18: [mem 0xdb300000-0xdb3fffff] [ 2.299164] pci 0000:41:00.2: reg 0x24: [mem 0xdb400000-0xdb401fff] [ 2.299276] pci 0000:41:00.3: [1022:145f] type 00 class 0x0c0330 [ 2.299290] pci 0000:41:00.3: reg 0x10: [mem 0xdb200000-0xdb2fffff 64bit] [ 2.299373] pci 0000:41:00.3: PME# supported from D0 D3hot D3cold [ 2.299431] pci 0000:40:07.1: PCI bridge to [bus 41] [ 2.304404] pci 0000:40:07.1: bridge window [mem 0xdb200000-0xdb4fffff] [ 2.304758] pci 0000:42:00.0: [1022:1455] type 00 class 0x130000 [ 2.304902] pci 0000:42:00.1: [1022:1468] type 00 class 0x108000 [ 2.304922] pci 0000:42:00.1: reg 0x18: [mem 0xdb000000-0xdb0fffff] [ 2.304936] pci 0000:42:00.1: reg 0x24: [mem 0xdb100000-0xdb101fff] [ 2.305065] pci 0000:40:08.1: PCI bridge to [bus 42] [ 2.310036] pci 0000:40:08.1: bridge window [mem 0xdb000000-0xdb1fffff] [ 2.310050] pci_bus 0000:40: on NUMA node 1 [ 2.310226] ACPI: PCI Root Bridge [PC02] (domain 0000 [bus 80-bf]) [ 2.316404] acpi PNP0A08:02: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI] [ 2.324614] acpi PNP0A08:02: PCIe AER handled by firmware [ 2.330050] acpi PNP0A08:02: _OSC: platform does not support [SHPCHotplug] [ 2.336999] acpi PNP0A08:02: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 2.344657] acpi PNP0A08:02: FADT indicates ASPM is unsupported, using BIOS configuration [ 2.353087] PCI host bridge to bus 0000:80 [ 2.357190] pci_bus 0000:80: root bus resource [io 0x03b0-0x03df window] [ 2.363976] pci_bus 0000:80: root bus resource [mem 0x000a0000-0x000bffff window] [ 2.371454] pci_bus 0000:80: root bus resource [io 0x8000-0xbfff window] [ 2.378240] pci_bus 0000:80: root bus resource [mem 0xab000000-0xc5ffffff window] [ 2.385720] pci_bus 0000:80: root bus resource [mem 0x47e80000000-0x63dbfffffff window] [ 2.393718] pci_bus 0000:80: root bus resource [bus 80-bf] [ 2.399209] pci 0000:80:00.0: [1022:1450] type 00 class 0x060000 [ 2.399307] pci 0000:80:00.2: [1022:1451] type 00 class 0x080600 [ 2.399418] pci 0000:80:01.0: [1022:1452] type 00 class 0x060000 [ 2.399504] pci 0000:80:01.1: [1022:1453] type 01 class 0x060400 [ 2.399958] pci 0000:80:01.1: PME# supported from D0 D3hot D3cold [ 2.400032] pci 0000:80:01.2: [1022:1453] type 01 class 0x060400 [ 2.400192] pci 0000:80:01.2: PME# supported from D0 D3hot D3cold [ 2.400272] pci 0000:80:02.0: [1022:1452] type 00 class 0x060000 [ 2.400371] pci 0000:80:03.0: [1022:1452] type 00 class 0x060000 [ 2.400453] pci 0000:80:03.1: [1022:1453] type 01 class 0x060400 [ 2.400949] pci 0000:80:03.1: PME# supported from D0 D3hot D3cold [ 2.401047] pci 0000:80:04.0: [1022:1452] type 00 class 0x060000 [ 2.401152] pci 0000:80:07.0: [1022:1452] type 00 class 0x060000 [ 2.401236] pci 0000:80:07.1: [1022:1454] type 01 class 0x060400 [ 2.401844] pci 0000:80:07.1: PME# supported from D0 D3hot D3cold [ 2.401923] pci 0000:80:08.0: [1022:1452] type 00 class 0x060000 [ 2.402009] pci 0000:80:08.1: [1022:1454] type 01 class 0x060400 [ 2.402164] pci 0000:80:08.1: PME# supported from D0 D3hot D3cold [ 2.402375] pci 0000:81:00.0: [14e4:165f] type 00 class 0x020000 [ 2.402401] pci 0000:81:00.0: reg 0x10: [mem 0xaf030000-0xaf03ffff 64bit pref] [ 2.402416] pci 0000:81:00.0: reg 0x18: [mem 0xaf040000-0xaf04ffff 64bit pref] [ 2.402431] pci 0000:81:00.0: reg 0x20: [mem 0xaf050000-0xaf05ffff 64bit pref] [ 2.402441] pci 0000:81:00.0: reg 0x30: [mem 0xfffc0000-0xffffffff pref] [ 2.402558] pci 0000:81:00.0: PME# supported from D0 D3hot D3cold [ 2.402653] pci 0000:81:00.1: [14e4:165f] type 00 class 0x020000 [ 2.402679] pci 0000:81:00.1: reg 0x10: [mem 0xaf000000-0xaf00ffff 64bit pref] [ 2.402694] pci 0000:81:00.1: reg 0x18: [mem 0xaf010000-0xaf01ffff 64bit pref] [ 2.402709] pci 0000:81:00.1: reg 0x20: [mem 0xaf020000-0xaf02ffff 64bit pref] [ 2.402719] pci 0000:81:00.1: reg 0x30: [mem 0xfffc0000-0xffffffff pref] [ 2.402837] pci 0000:81:00.1: PME# supported from D0 D3hot D3cold [ 2.402923] pci 0000:80:01.1: PCI bridge to [bus 81] [ 2.407896] pci 0000:80:01.1: bridge window [mem 0xaf000000-0xaf0fffff 64bit pref] [ 2.407984] pci 0000:82:00.0: [1556:be00] type 01 class 0x060400 [ 2.410770] pci 0000:80:01.2: PCI bridge to [bus 82-83] [ 2.416006] pci 0000:80:01.2: bridge window [mem 0xc0000000-0xc08fffff] [ 2.416010] pci 0000:80:01.2: bridge window [mem 0xae000000-0xaeffffff 64bit pref] [ 2.416057] pci 0000:83:00.0: [102b:0536] type 00 class 0x030000 [ 2.416076] pci 0000:83:00.0: reg 0x10: [mem 0xae000000-0xaeffffff pref] [ 2.416088] pci 0000:83:00.0: reg 0x14: [mem 0xc0808000-0xc080bfff] [ 2.416099] pci 0000:83:00.0: reg 0x18: [mem 0xc0000000-0xc07fffff] [ 2.416269] pci 0000:82:00.0: PCI bridge to [bus 83] [ 2.421245] pci 0000:82:00.0: bridge window [mem 0xc0000000-0xc08fffff] [ 2.421251] pci 0000:82:00.0: bridge window [mem 0xae000000-0xaeffffff 64bit pref] [ 2.421389] pci 0000:84:00.0: [15b3:1013] type 00 class 0x020700 [ 2.421520] pci 0000:84:00.0: reg 0x10: [mem 0xac000000-0xadffffff 64bit pref] [ 2.421768] pci 0000:84:00.0: reg 0x30: [mem 0xfff00000-0xffffffff pref] [ 2.422320] pci 0000:84:00.0: PME# supported from D3cold [ 2.422551] pci 0000:80:03.1: PCI bridge to [bus 84] [ 2.427525] pci 0000:80:03.1: bridge window [mem 0xac000000-0xadffffff 64bit pref] [ 2.427959] pci 0000:85:00.0: [1022:145a] type 00 class 0x130000 [ 2.428095] pci 0000:85:00.2: [1022:1456] type 00 class 0x108000 [ 2.428114] pci 0000:85:00.2: reg 0x18: [mem 0xc0b00000-0xc0bfffff] [ 2.428128] pci 0000:85:00.2: reg 0x24: [mem 0xc0c00000-0xc0c01fff] [ 2.428245] pci 0000:80:07.1: PCI bridge to [bus 85] [ 2.433216] pci 0000:80:07.1: bridge window [mem 0xc0b00000-0xc0cfffff] [ 2.433310] pci 0000:86:00.0: [1022:1455] type 00 class 0x130000 [ 2.433456] pci 0000:86:00.1: [1022:1468] type 00 class 0x108000 [ 2.433476] pci 0000:86:00.1: reg 0x18: [mem 0xc0900000-0xc09fffff] [ 2.433491] pci 0000:86:00.1: reg 0x24: [mem 0xc0a00000-0xc0a01fff] [ 2.433606] pci 0000:86:00.2: [1022:7901] type 00 class 0x010601 [ 2.433639] pci 0000:86:00.2: reg 0x24: [mem 0xc0a02000-0xc0a02fff] [ 2.433706] pci 0000:86:00.2: PME# supported from D3hot D3cold [ 2.433775] pci 0000:80:08.1: PCI bridge to [bus 86] [ 2.438746] pci 0000:80:08.1: bridge window [mem 0xc0900000-0xc0afffff] [ 2.438773] pci_bus 0000:80: on NUMA node 2 [ 2.438942] ACPI: PCI Root Bridge [PC03] (domain 0000 [bus c0-ff]) [ 2.445125] acpi PNP0A08:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI] [ 2.453332] acpi PNP0A08:03: PCIe AER handled by firmware [ 2.458769] acpi PNP0A08:03: _OSC: platform does not support [SHPCHotplug] [ 2.465714] acpi PNP0A08:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 2.473367] acpi PNP0A08:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 2.481685] acpi PNP0A08:03: host bridge window [mem 0x63dc0000000-0xffffffffffff window] ([0x80000000000-0xffffffffffff] ignored, not CPU addressable) [ 2.495324] PCI host bridge to bus 0000:c0 [ 2.499427] pci_bus 0000:c0: root bus resource [io 0xc000-0xffff window] [ 2.506214] pci_bus 0000:c0: root bus resource [mem 0x90000000-0xaaffffff window] [ 2.513693] pci_bus 0000:c0: root bus resource [mem 0x63dc0000000-0x7ffffffffff window] [ 2.521692] pci_bus 0000:c0: root bus resource [bus c0-ff] [ 2.527182] pci 0000:c0:00.0: [1022:1450] type 00 class 0x060000 [ 2.527277] pci 0000:c0:00.2: [1022:1451] type 00 class 0x080600 [ 2.527391] pci 0000:c0:01.0: [1022:1452] type 00 class 0x060000 [ 2.527475] pci 0000:c0:01.1: [1022:1453] type 01 class 0x060400 [ 2.527623] pci 0000:c0:01.1: PME# supported from D0 D3hot D3cold [ 2.527719] pci 0000:c0:02.0: [1022:1452] type 00 class 0x060000 [ 2.527819] pci 0000:c0:03.0: [1022:1452] type 00 class 0x060000 [ 2.527918] pci 0000:c0:04.0: [1022:1452] type 00 class 0x060000 [ 2.528022] pci 0000:c0:07.0: [1022:1452] type 00 class 0x060000 [ 2.528107] pci 0000:c0:07.1: [1022:1454] type 01 class 0x060400 [ 2.528253] pci 0000:c0:07.1: PME# supported from D0 D3hot D3cold [ 2.528330] pci 0000:c0:08.0: [1022:1452] type 00 class 0x060000 [ 2.528417] pci 0000:c0:08.1: [1022:1454] type 01 class 0x060400 [ 2.528559] pci 0000:c0:08.1: PME# supported from D0 D3hot D3cold [ 2.529197] pci 0000:c1:00.0: [1000:005f] type 00 class 0x010400 [ 2.529211] pci 0000:c1:00.0: reg 0x10: [io 0xc000-0xc0ff] [ 2.529221] pci 0000:c1:00.0: reg 0x14: [mem 0xa5500000-0xa550ffff 64bit] [ 2.529230] pci 0000:c1:00.0: reg 0x1c: [mem 0xa5400000-0xa54fffff 64bit] [ 2.529242] pci 0000:c1:00.0: reg 0x30: [mem 0xfff00000-0xffffffff pref] [ 2.529333] pci 0000:c1:00.0: supports D1 D2 [ 2.529386] pci 0000:c0:01.1: PCI bridge to [bus c1] [ 2.534357] pci 0000:c0:01.1: bridge window [io 0xc000-0xcfff] [ 2.534360] pci 0000:c0:01.1: bridge window [mem 0xa5400000-0xa55fffff] [ 2.534439] pci 0000:c2:00.0: [1022:145a] type 00 class 0x130000 [ 2.534573] pci 0000:c2:00.2: [1022:1456] type 00 class 0x108000 [ 2.534592] pci 0000:c2:00.2: reg 0x18: [mem 0xa5200000-0xa52fffff] [ 2.534605] pci 0000:c2:00.2: reg 0x24: [mem 0xa5300000-0xa5301fff] [ 2.534724] pci 0000:c0:07.1: PCI bridge to [bus c2] [ 2.539697] pci 0000:c0:07.1: bridge window [mem 0xa5200000-0xa53fffff] [ 2.540241] pci 0000:c3:00.0: [1022:1455] type 00 class 0x130000 [ 2.540387] pci 0000:c3:00.1: [1022:1468] type 00 class 0x108000 [ 2.540406] pci 0000:c3:00.1: reg 0x18: [mem 0xa5000000-0xa50fffff] [ 2.540420] pci 0000:c3:00.1: reg 0x24: [mem 0xa5100000-0xa5101fff] [ 2.540544] pci 0000:c0:08.1: PCI bridge to [bus c3] [ 2.545512] pci 0000:c0:08.1: bridge window [mem 0xa5000000-0xa51fffff] [ 2.545529] pci_bus 0000:c0: on NUMA node 3 [ 2.547646] vgaarb: device added: PCI:0000:83:00.0,decodes=io+mem,owns=io+mem,locks=none [ 2.555739] vgaarb: loaded [ 2.558447] vgaarb: bridge control possible 0000:83:00.0 [ 2.563872] SCSI subsystem initialized [ 2.567650] ACPI: bus type USB registered [ 2.571680] usbcore: registered new interface driver usbfs [ 2.577174] usbcore: registered new interface driver hub [ 2.582699] usbcore: registered new device driver usb [ 2.588070] EDAC MC: Ver: 3.0.0 [ 2.591470] PCI: Using ACPI for IRQ routing [ 2.614627] PCI: pci_cache_line_size set to 64 bytes [ 2.614781] e820: reserve RAM buffer [mem 0x0008f000-0x0008ffff] [ 2.614783] e820: reserve RAM buffer [mem 0x4468f020-0x47ffffff] [ 2.614784] e820: reserve RAM buffer [mem 0x446a8020-0x47ffffff] [ 2.614786] e820: reserve RAM buffer [mem 0x446da020-0x47ffffff] [ 2.614787] e820: reserve RAM buffer [mem 0x5b488020-0x5bffffff] [ 2.614788] e820: reserve RAM buffer [mem 0x5c3e0000-0x5fffffff] [ 2.614789] e820: reserve RAM buffer [mem 0x6cacf000-0x6fffffff] [ 2.614791] e820: reserve RAM buffer [mem 0x107f380000-0x107fffffff] [ 2.614792] e820: reserve RAM buffer [mem 0x207ff80000-0x207fffffff] [ 2.614793] e820: reserve RAM buffer [mem 0x307ff80000-0x307fffffff] [ 2.614794] e820: reserve RAM buffer [mem 0x407ff80000-0x407fffffff] [ 2.615034] NetLabel: Initializing [ 2.618439] NetLabel: domain hash size = 128 [ 2.622799] NetLabel: protocols = UNLABELED CIPSOv4 [ 2.627780] NetLabel: unlabeled traffic allowed by default [ 2.633547] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 [ 2.638528] hpet0: 3 comparators, 32-bit 14.318180 MHz counter [ 2.646531] Switched to clocksource hpet [ 2.655027] pnp: PnP ACPI init [ 2.658108] ACPI: bus type PNP registered [ 2.662296] system 00:00: [mem 0x80000000-0x8fffffff] has been reserved [ 2.668919] system 00:00: Plug and Play ACPI device, IDs PNP0c01 (active) [ 2.668977] pnp 00:01: Plug and Play ACPI device, IDs PNP0b00 (active) [ 2.669171] pnp 00:02: Plug and Play ACPI device, IDs PNP0501 (active) [ 2.669349] pnp 00:03: Plug and Play ACPI device, IDs PNP0501 (active) [ 2.669520] pnp: PnP ACPI: found 4 devices [ 2.673629] ACPI: bus type PNP unregistered [ 2.685078] pci 0000:01:00.0: can't claim BAR 6 [mem 0xfffc0000-0xffffffff pref]: no compatible bridge window [ 2.694996] pci 0000:81:00.0: can't claim BAR 6 [mem 0xfffc0000-0xffffffff pref]: no compatible bridge window [ 2.704909] pci 0000:81:00.1: can't claim BAR 6 [mem 0xfffc0000-0xffffffff pref]: no compatible bridge window [ 2.714824] pci 0000:84:00.0: can't claim BAR 6 [mem 0xfff00000-0xffffffff pref]: no compatible bridge window [ 2.724738] pci 0000:c1:00.0: can't claim BAR 6 [mem 0xfff00000-0xffffffff pref]: no compatible bridge window [ 2.734671] pci 0000:01:00.0: BAR 6: no space for [mem size 0x00040000 pref] [ 2.741726] pci 0000:01:00.0: BAR 6: failed to assign [mem size 0x00040000 pref] [ 2.749127] pci 0000:00:03.1: PCI bridge to [bus 01] [ 2.754102] pci 0000:00:03.1: bridge window [io 0x1000-0x1fff] [ 2.760203] pci 0000:00:03.1: bridge window [mem 0xf7500000-0xf75fffff] [ 2.766998] pci 0000:00:03.1: bridge window [mem 0xe1000000-0xe11fffff 64bit pref] [ 2.774748] pci 0000:00:07.1: PCI bridge to [bus 02] [ 2.779722] pci 0000:00:07.1: bridge window [mem 0xf7200000-0xf74fffff] [ 2.786529] pci 0000:00:08.1: PCI bridge to [bus 03] [ 2.791509] pci 0000:00:08.1: bridge window [mem 0xf7000000-0xf71fffff] [ 2.798308] pci_bus 0000:00: resource 4 [io 0x0000-0x03af window] [ 2.798310] pci_bus 0000:00: resource 5 [io 0x03e0-0x0cf7 window] [ 2.798312] pci_bus 0000:00: resource 6 [mem 0x000c0000-0x000c3fff window] [ 2.798314] pci_bus 0000:00: resource 7 [mem 0x000c4000-0x000c7fff window] [ 2.798316] pci_bus 0000:00: resource 8 [mem 0x000c8000-0x000cbfff window] [ 2.798317] pci_bus 0000:00: resource 9 [mem 0x000cc000-0x000cffff window] [ 2.798319] pci_bus 0000:00: resource 10 [mem 0x000d0000-0x000d3fff window] [ 2.798321] pci_bus 0000:00: resource 11 [mem 0x000d4000-0x000d7fff window] [ 2.798323] pci_bus 0000:00: resource 12 [mem 0x000d8000-0x000dbfff window] [ 2.798324] pci_bus 0000:00: resource 13 [mem 0x000dc000-0x000dffff window] [ 2.798326] pci_bus 0000:00: resource 14 [mem 0x000e0000-0x000e3fff window] [ 2.798328] pci_bus 0000:00: resource 15 [mem 0x000e4000-0x000e7fff window] [ 2.798329] pci_bus 0000:00: resource 16 [mem 0x000e8000-0x000ebfff window] [ 2.798331] pci_bus 0000:00: resource 17 [mem 0x000ec000-0x000effff window] [ 2.798333] pci_bus 0000:00: resource 18 [mem 0x000f0000-0x000fffff window] [ 2.798334] pci_bus 0000:00: resource 19 [io 0x0d00-0x3fff window] [ 2.798336] pci_bus 0000:00: resource 20 [mem 0xe1000000-0xfebfffff window] [ 2.798338] pci_bus 0000:00: resource 21 [mem 0x10000000000-0x2bf3fffffff window] [ 2.798340] pci_bus 0000:01: resource 0 [io 0x1000-0x1fff] [ 2.798341] pci_bus 0000:01: resource 1 [mem 0xf7500000-0xf75fffff] [ 2.798343] pci_bus 0000:01: resource 2 [mem 0xe1000000-0xe11fffff 64bit pref] [ 2.798345] pci_bus 0000:02: resource 1 [mem 0xf7200000-0xf74fffff] [ 2.798347] pci_bus 0000:03: resource 1 [mem 0xf7000000-0xf71fffff] [ 2.798359] pci 0000:40:07.1: PCI bridge to [bus 41] [ 2.803342] pci 0000:40:07.1: bridge window [mem 0xdb200000-0xdb4fffff] [ 2.810143] pci 0000:40:08.1: PCI bridge to [bus 42] [ 2.815117] pci 0000:40:08.1: bridge window [mem 0xdb000000-0xdb1fffff] [ 2.821913] pci_bus 0000:40: resource 4 [io 0x4000-0x7fff window] [ 2.821915] pci_bus 0000:40: resource 5 [mem 0xc6000000-0xe0ffffff window] [ 2.821916] pci_bus 0000:40: resource 6 [mem 0x2bf40000000-0x47e7fffffff window] [ 2.821918] pci_bus 0000:41: resource 1 [mem 0xdb200000-0xdb4fffff] [ 2.821920] pci_bus 0000:42: resource 1 [mem 0xdb000000-0xdb1fffff] [ 2.821953] pci 0000:80:01.1: BAR 14: assigned [mem 0xab000000-0xab0fffff] [ 2.828834] pci 0000:80:03.1: BAR 14: assigned [mem 0xab100000-0xab1fffff] [ 2.835718] pci 0000:81:00.0: BAR 6: assigned [mem 0xab000000-0xab03ffff pref] [ 2.842943] pci 0000:81:00.1: BAR 6: assigned [mem 0xab040000-0xab07ffff pref] [ 2.850172] pci 0000:80:01.1: PCI bridge to [bus 81] [ 2.855147] pci 0000:80:01.1: bridge window [mem 0xab000000-0xab0fffff] [ 2.861944] pci 0000:80:01.1: bridge window [mem 0xaf000000-0xaf0fffff 64bit pref] [ 2.869693] pci 0000:82:00.0: PCI bridge to [bus 83] [ 2.874669] pci 0000:82:00.0: bridge window [mem 0xc0000000-0xc08fffff] [ 2.881471] pci 0000:82:00.0: bridge window [mem 0xae000000-0xaeffffff 64bit pref] [ 2.889221] pci 0000:80:01.2: PCI bridge to [bus 82-83] [ 2.894460] pci 0000:80:01.2: bridge window [mem 0xc0000000-0xc08fffff] [ 2.901255] pci 0000:80:01.2: bridge window [mem 0xae000000-0xaeffffff 64bit pref] [ 2.909004] pci 0000:84:00.0: BAR 6: assigned [mem 0xab100000-0xab1fffff pref] [ 2.916230] pci 0000:80:03.1: PCI bridge to [bus 84] [ 2.921206] pci 0000:80:03.1: bridge window [mem 0xab100000-0xab1fffff] [ 2.928000] pci 0000:80:03.1: bridge window [mem 0xac000000-0xadffffff 64bit pref] [ 2.935750] pci 0000:80:07.1: PCI bridge to [bus 85] [ 2.940723] pci 0000:80:07.1: bridge window [mem 0xc0b00000-0xc0cfffff] [ 2.947521] pci 0000:80:08.1: PCI bridge to [bus 86] [ 2.952493] pci 0000:80:08.1: bridge window [mem 0xc0900000-0xc0afffff] [ 2.959290] pci_bus 0000:80: resource 4 [io 0x03b0-0x03df window] [ 2.959292] pci_bus 0000:80: resource 5 [mem 0x000a0000-0x000bffff window] [ 2.959294] pci_bus 0000:80: resource 6 [io 0x8000-0xbfff window] [ 2.959295] pci_bus 0000:80: resource 7 [mem 0xab000000-0xc5ffffff window] [ 2.959297] pci_bus 0000:80: resource 8 [mem 0x47e80000000-0x63dbfffffff window] [ 2.959299] pci_bus 0000:81: resource 1 [mem 0xab000000-0xab0fffff] [ 2.959301] pci_bus 0000:81: resource 2 [mem 0xaf000000-0xaf0fffff 64bit pref] [ 2.959302] pci_bus 0000:82: resource 1 [mem 0xc0000000-0xc08fffff] [ 2.959304] pci_bus 0000:82: resource 2 [mem 0xae000000-0xaeffffff 64bit pref] [ 2.959306] pci_bus 0000:83: resource 1 [mem 0xc0000000-0xc08fffff] [ 2.959308] pci_bus 0000:83: resource 2 [mem 0xae000000-0xaeffffff 64bit pref] [ 2.959309] pci_bus 0000:84: resource 1 [mem 0xab100000-0xab1fffff] [ 2.959311] pci_bus 0000:84: resource 2 [mem 0xac000000-0xadffffff 64bit pref] [ 2.959313] pci_bus 0000:85: resource 1 [mem 0xc0b00000-0xc0cfffff] [ 2.959315] pci_bus 0000:86: resource 1 [mem 0xc0900000-0xc0afffff] [ 2.959330] pci 0000:c1:00.0: BAR 6: no space for [mem size 0x00100000 pref] [ 2.966385] pci 0000:c1:00.0: BAR 6: failed to assign [mem size 0x00100000 pref] [ 2.973786] pci 0000:c0:01.1: PCI bridge to [bus c1] [ 2.978763] pci 0000:c0:01.1: bridge window [io 0xc000-0xcfff] [ 2.984864] pci 0000:c0:01.1: bridge window [mem 0xa5400000-0xa55fffff] [ 2.991660] pci 0000:c0:07.1: PCI bridge to [bus c2] [ 2.996632] pci 0000:c0:07.1: bridge window [mem 0xa5200000-0xa53fffff] [ 3.003431] pci 0000:c0:08.1: PCI bridge to [bus c3] [ 3.008404] pci 0000:c0:08.1: bridge window [mem 0xa5000000-0xa51fffff] [ 3.015199] pci_bus 0000:c0: resource 4 [io 0xc000-0xffff window] [ 3.015201] pci_bus 0000:c0: resource 5 [mem 0x90000000-0xaaffffff window] [ 3.015203] pci_bus 0000:c0: resource 6 [mem 0x63dc0000000-0x7ffffffffff window] [ 3.015205] pci_bus 0000:c1: resource 0 [io 0xc000-0xcfff] [ 3.015206] pci_bus 0000:c1: resource 1 [mem 0xa5400000-0xa55fffff] [ 3.015208] pci_bus 0000:c2: resource 1 [mem 0xa5200000-0xa53fffff] [ 3.015210] pci_bus 0000:c3: resource 1 [mem 0xa5000000-0xa51fffff] [ 3.015293] NET: Registered protocol family 2 [ 3.020313] TCP established hash table entries: 524288 (order: 10, 4194304 bytes) [ 3.028442] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes) [ 3.035262] TCP: Hash tables configured (established 524288 bind 65536) [ 3.041898] TCP: reno registered [ 3.045236] UDP hash table entries: 65536 (order: 9, 2097152 bytes) [ 3.051852] UDP-Lite hash table entries: 65536 (order: 9, 2097152 bytes) [ 3.059046] NET: Registered protocol family 1 [ 3.063852] pci 0000:83:00.0: Boot video device [ 3.064012] PCI: CLS 32 bytes, default 64 [ 3.064055] Unpacking initramfs... [ 3.337586] Freeing initrd memory: 19796k freed [ 3.344284] AMD-Vi: IOMMU performance counters supported [ 3.349661] AMD-Vi: IOMMU performance counters supported [ 3.355019] AMD-Vi: IOMMU performance counters supported [ 3.360378] AMD-Vi: IOMMU performance counters supported [ 3.367000] iommu: Adding device 0000:00:01.0 to group 0 [ 3.373025] iommu: Adding device 0000:00:02.0 to group 1 [ 3.379004] iommu: Adding device 0000:00:03.0 to group 2 [ 3.384340] iommu: Adding device 0000:00:03.1 to group 2 [ 3.390445] iommu: Adding device 0000:00:04.0 to group 3 [ 3.396458] iommu: Adding device 0000:00:07.0 to group 4 [ 3.401797] iommu: Adding device 0000:00:07.1 to group 4 [ 3.407785] iommu: Adding device 0000:00:08.0 to group 5 [ 3.413125] iommu: Adding device 0000:00:08.1 to group 5 [ 3.419168] iommu: Adding device 0000:00:14.0 to group 6 [ 3.424510] iommu: Adding device 0000:00:14.3 to group 6 [ 3.430586] iommu: Adding device 0000:00:18.0 to group 7 [ 3.435926] iommu: Adding device 0000:00:18.1 to group 7 [ 3.441260] iommu: Adding device 0000:00:18.2 to group 7 [ 3.446600] iommu: Adding device 0000:00:18.3 to group 7 [ 3.451944] iommu: Adding device 0000:00:18.4 to group 7 [ 3.457280] iommu: Adding device 0000:00:18.5 to group 7 [ 3.462621] iommu: Adding device 0000:00:18.6 to group 7 [ 3.467955] iommu: Adding device 0000:00:18.7 to group 7 [ 3.474035] iommu: Adding device 0000:00:19.0 to group 8 [ 3.479372] iommu: Adding device 0000:00:19.1 to group 8 [ 3.484710] iommu: Adding device 0000:00:19.2 to group 8 [ 3.490049] iommu: Adding device 0000:00:19.3 to group 8 [ 3.495386] iommu: Adding device 0000:00:19.4 to group 8 [ 3.500724] iommu: Adding device 0000:00:19.5 to group 8 [ 3.506066] iommu: Adding device 0000:00:19.6 to group 8 [ 3.511406] iommu: Adding device 0000:00:19.7 to group 8 [ 3.517472] iommu: Adding device 0000:00:1a.0 to group 9 [ 3.522812] iommu: Adding device 0000:00:1a.1 to group 9 [ 3.528149] iommu: Adding device 0000:00:1a.2 to group 9 [ 3.533488] iommu: Adding device 0000:00:1a.3 to group 9 [ 3.538828] iommu: Adding device 0000:00:1a.4 to group 9 [ 3.544165] iommu: Adding device 0000:00:1a.5 to group 9 [ 3.549502] iommu: Adding device 0000:00:1a.6 to group 9 [ 3.554838] iommu: Adding device 0000:00:1a.7 to group 9 [ 3.560907] iommu: Adding device 0000:00:1b.0 to group 10 [ 3.566338] iommu: Adding device 0000:00:1b.1 to group 10 [ 3.571770] iommu: Adding device 0000:00:1b.2 to group 10 [ 3.577194] iommu: Adding device 0000:00:1b.3 to group 10 [ 3.582620] iommu: Adding device 0000:00:1b.4 to group 10 [ 3.588044] iommu: Adding device 0000:00:1b.5 to group 10 [ 3.593473] iommu: Adding device 0000:00:1b.6 to group 10 [ 3.598898] iommu: Adding device 0000:00:1b.7 to group 10 [ 3.604315] iommu: Adding device 0000:01:00.0 to group 2 [ 3.609645] iommu: Adding device 0000:02:00.0 to group 4 [ 3.614970] iommu: Adding device 0000:02:00.2 to group 4 [ 3.620300] iommu: Adding device 0000:02:00.3 to group 4 [ 3.625636] iommu: Adding device 0000:03:00.0 to group 5 [ 3.630962] iommu: Adding device 0000:03:00.1 to group 5 [ 3.636981] iommu: Adding device 0000:40:01.0 to group 11 [ 3.643096] iommu: Adding device 0000:40:02.0 to group 12 [ 3.649212] iommu: Adding device 0000:40:03.0 to group 13 [ 3.655293] iommu: Adding device 0000:40:04.0 to group 14 [ 3.661389] iommu: Adding device 0000:40:07.0 to group 15 [ 3.666827] iommu: Adding device 0000:40:07.1 to group 15 [ 3.672916] iommu: Adding device 0000:40:08.0 to group 16 [ 3.678351] iommu: Adding device 0000:40:08.1 to group 16 [ 3.683768] iommu: Adding device 0000:41:00.0 to group 15 [ 3.689185] iommu: Adding device 0000:41:00.2 to group 15 [ 3.694602] iommu: Adding device 0000:41:00.3 to group 15 [ 3.700020] iommu: Adding device 0000:42:00.0 to group 16 [ 3.705437] iommu: Adding device 0000:42:00.1 to group 16 [ 3.711576] iommu: Adding device 0000:80:01.0 to group 17 [ 3.717016] iommu: Adding device 0000:80:01.1 to group 17 [ 3.722453] iommu: Adding device 0000:80:01.2 to group 17 [ 3.728574] iommu: Adding device 0000:80:02.0 to group 18 [ 3.734705] iommu: Adding device 0000:80:03.0 to group 19 [ 3.740139] iommu: Adding device 0000:80:03.1 to group 19 [ 3.746248] iommu: Adding device 0000:80:04.0 to group 20 [ 3.752341] iommu: Adding device 0000:80:07.0 to group 21 [ 3.757777] iommu: Adding device 0000:80:07.1 to group 21 [ 3.763901] iommu: Adding device 0000:80:08.0 to group 22 [ 3.769336] iommu: Adding device 0000:80:08.1 to group 22 [ 3.774758] iommu: Adding device 0000:81:00.0 to group 17 [ 3.780181] iommu: Adding device 0000:81:00.1 to group 17 [ 3.785599] iommu: Adding device 0000:82:00.0 to group 17 [ 3.791010] iommu: Adding device 0000:83:00.0 to group 17 [ 3.796451] iommu: Adding device 0000:84:00.0 to group 19 [ 3.801873] iommu: Adding device 0000:85:00.0 to group 21 [ 3.807285] iommu: Adding device 0000:85:00.2 to group 21 [ 3.812705] iommu: Adding device 0000:86:00.0 to group 22 [ 3.818121] iommu: Adding device 0000:86:00.1 to group 22 [ 3.823539] iommu: Adding device 0000:86:00.2 to group 22 [ 3.829635] iommu: Adding device 0000:c0:01.0 to group 23 [ 3.835081] iommu: Adding device 0000:c0:01.1 to group 23 [ 3.841180] iommu: Adding device 0000:c0:02.0 to group 24 [ 3.847198] iommu: Adding device 0000:c0:03.0 to group 25 [ 3.853251] iommu: Adding device 0000:c0:04.0 to group 26 [ 3.859281] iommu: Adding device 0000:c0:07.0 to group 27 [ 3.864717] iommu: Adding device 0000:c0:07.1 to group 27 [ 3.870757] iommu: Adding device 0000:c0:08.0 to group 28 [ 3.876187] iommu: Adding device 0000:c0:08.1 to group 28 [ 3.881606] iommu: Adding device 0000:c1:00.0 to group 23 [ 3.887021] iommu: Adding device 0000:c2:00.0 to group 27 [ 3.892436] iommu: Adding device 0000:c2:00.2 to group 27 [ 3.897854] iommu: Adding device 0000:c3:00.0 to group 28 [ 3.903272] iommu: Adding device 0000:c3:00.1 to group 28 [ 3.908882] AMD-Vi: Found IOMMU at 0000:00:00.2 cap 0x40 [ 3.914201] AMD-Vi: Extended features (0xf77ef22294ada): [ 3.919532] PPR NX GT IA GA PC GA_vAPIC [ 3.923671] AMD-Vi: Found IOMMU at 0000:40:00.2 cap 0x40 [ 3.928995] AMD-Vi: Extended features (0xf77ef22294ada): [ 3.934316] PPR NX GT IA GA PC GA_vAPIC [ 3.938448] AMD-Vi: Found IOMMU at 0000:80:00.2 cap 0x40 [ 3.943770] AMD-Vi: Extended features (0xf77ef22294ada): [ 3.949092] PPR NX GT IA GA PC GA_vAPIC [ 3.953225] AMD-Vi: Found IOMMU at 0000:c0:00.2 cap 0x40 [ 3.958546] AMD-Vi: Extended features (0xf77ef22294ada): [ 3.963871] PPR NX GT IA GA PC GA_vAPIC [ 3.968003] AMD-Vi: Interrupt remapping enabled [ 3.972544] AMD-Vi: virtual APIC enabled [ 3.976544] pci 0000:00:00.2: irq 26 for MSI/MSI-X [ 3.976635] pci 0000:40:00.2: irq 27 for MSI/MSI-X [ 3.976716] pci 0000:80:00.2: irq 28 for MSI/MSI-X [ 3.976797] pci 0000:c0:00.2: irq 29 for MSI/MSI-X [ 3.976848] AMD-Vi: Lazy IO/TLB flushing enabled [ 3.983162] perf: AMD NB counters detected [ 3.987295] perf: AMD LLC counters detected [ 3.997356] sha1_ssse3: Using SHA-NI optimized SHA-1 implementation [ 4.003710] sha256_ssse3: Using SHA-256-NI optimized SHA-256 implementation [ 4.012240] futex hash table entries: 32768 (order: 9, 2097152 bytes) [ 4.018878] Initialise system trusted keyring [ 4.023283] audit: initializing netlink socket (disabled) [ 4.028695] type=2000 audit(1555944834.187:1): initialized [ 4.059298] HugeTLB registered 1 GB page size, pre-allocated 0 pages [ 4.065660] HugeTLB registered 2 MB page size, pre-allocated 0 pages [ 4.073241] zpool: loaded [ 4.075879] zbud: loaded [ 4.078780] VFS: Disk quotas dquot_6.5.2 [ 4.082807] Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 4.089593] msgmni has been set to 32768 [ 4.093624] Key type big_key registered [ 4.097477] SELinux: Registering netfilter hooks [ 4.099893] NET: Registered protocol family 38 [ 4.104353] Key type asymmetric registered [ 4.108457] Asymmetric key parser 'x509' registered [ 4.113387] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) [ 4.120938] io scheduler noop registered [ 4.124871] io scheduler deadline registered (default) [ 4.130058] io scheduler cfq registered [ 4.133904] io scheduler mq-deadline registered [ 4.138443] io scheduler kyber registered [ 4.142766] pcieport 0000:00:03.1: irq 30 for MSI/MSI-X [ 4.143652] pcieport 0000:00:07.1: irq 31 for MSI/MSI-X [ 4.144611] pcieport 0000:00:08.1: irq 33 for MSI/MSI-X [ 4.145278] pcieport 0000:40:07.1: irq 34 for MSI/MSI-X [ 4.145601] pcieport 0000:40:08.1: irq 36 for MSI/MSI-X [ 4.146238] pcieport 0000:80:01.1: irq 37 for MSI/MSI-X [ 4.146493] pcieport 0000:80:01.2: irq 38 for MSI/MSI-X [ 4.147193] pcieport 0000:80:03.1: irq 39 for MSI/MSI-X [ 4.147496] pcieport 0000:80:07.1: irq 41 for MSI/MSI-X [ 4.148227] pcieport 0000:80:08.1: irq 43 for MSI/MSI-X [ 4.148573] pcieport 0000:c0:01.1: irq 44 for MSI/MSI-X [ 4.149287] pcieport 0000:c0:07.1: irq 46 for MSI/MSI-X [ 4.149520] pcieport 0000:c0:08.1: irq 48 for MSI/MSI-X [ 4.149638] pcieport 0000:00:03.1: Signaling PME through PCIe PME interrupt [ 4.156610] pci 0000:01:00.0: Signaling PME through PCIe PME interrupt [ 4.163144] pcie_pme 0000:00:03.1:pcie001: service driver pcie_pme loaded [ 4.163156] pcieport 0000:00:07.1: Signaling PME through PCIe PME interrupt [ 4.170120] pci 0000:02:00.0: Signaling PME through PCIe PME interrupt [ 4.176655] pci 0000:02:00.2: Signaling PME through PCIe PME interrupt [ 4.183189] pci 0000:02:00.3: Signaling PME through PCIe PME interrupt [ 4.189723] pcie_pme 0000:00:07.1:pcie001: service driver pcie_pme loaded [ 4.189734] pcieport 0000:00:08.1: Signaling PME through PCIe PME interrupt [ 4.196700] pci 0000:03:00.0: Signaling PME through PCIe PME interrupt [ 4.203236] pci 0000:03:00.1: Signaling PME through PCIe PME interrupt [ 4.209772] pcie_pme 0000:00:08.1:pcie001: service driver pcie_pme loaded [ 4.209794] pcieport 0000:40:07.1: Signaling PME through PCIe PME interrupt [ 4.216764] pci 0000:41:00.0: Signaling PME through PCIe PME interrupt [ 4.223299] pci 0000:41:00.2: Signaling PME through PCIe PME interrupt [ 4.229834] pci 0000:41:00.3: Signaling PME through PCIe PME interrupt [ 4.236371] pcie_pme 0000:40:07.1:pcie001: service driver pcie_pme loaded [ 4.236386] pcieport 0000:40:08.1: Signaling PME through PCIe PME interrupt [ 4.243352] pci 0000:42:00.0: Signaling PME through PCIe PME interrupt [ 4.249887] pci 0000:42:00.1: Signaling PME through PCIe PME interrupt [ 4.256424] pcie_pme 0000:40:08.1:pcie001: service driver pcie_pme loaded [ 4.256441] pcieport 0000:80:01.1: Signaling PME through PCIe PME interrupt [ 4.263409] pci 0000:81:00.0: Signaling PME through PCIe PME interrupt [ 4.269944] pci 0000:81:00.1: Signaling PME through PCIe PME interrupt [ 4.276480] pcie_pme 0000:80:01.1:pcie001: service driver pcie_pme loaded [ 4.276495] pcieport 0000:80:01.2: Signaling PME through PCIe PME interrupt [ 4.283465] pci 0000:82:00.0: Signaling PME through PCIe PME interrupt [ 4.289999] pci 0000:83:00.0: Signaling PME through PCIe PME interrupt [ 4.296535] pcie_pme 0000:80:01.2:pcie001: service driver pcie_pme loaded [ 4.296549] pcieport 0000:80:03.1: Signaling PME through PCIe PME interrupt [ 4.303519] pci 0000:84:00.0: Signaling PME through PCIe PME interrupt [ 4.310055] pcie_pme 0000:80:03.1:pcie001: service driver pcie_pme loaded [ 4.310070] pcieport 0000:80:07.1: Signaling PME through PCIe PME interrupt [ 4.317038] pci 0000:85:00.0: Signaling PME through PCIe PME interrupt [ 4.323573] pci 0000:85:00.2: Signaling PME through PCIe PME interrupt [ 4.330109] pcie_pme 0000:80:07.1:pcie001: service driver pcie_pme loaded [ 4.330125] pcieport 0000:80:08.1: Signaling PME through PCIe PME interrupt [ 4.337094] pci 0000:86:00.0: Signaling PME through PCIe PME interrupt [ 4.343629] pci 0000:86:00.1: Signaling PME through PCIe PME interrupt [ 4.350165] pci 0000:86:00.2: Signaling PME through PCIe PME interrupt [ 4.356699] pcie_pme 0000:80:08.1:pcie001: service driver pcie_pme loaded [ 4.356715] pcieport 0000:c0:01.1: Signaling PME through PCIe PME interrupt [ 4.363684] pci 0000:c1:00.0: Signaling PME through PCIe PME interrupt [ 4.370220] pcie_pme 0000:c0:01.1:pcie001: service driver pcie_pme loaded [ 4.370234] pcieport 0000:c0:07.1: Signaling PME through PCIe PME interrupt [ 4.377202] pci 0000:c2:00.0: Signaling PME through PCIe PME interrupt [ 4.383738] pci 0000:c2:00.2: Signaling PME through PCIe PME interrupt [ 4.390275] pcie_pme 0000:c0:07.1:pcie001: service driver pcie_pme loaded [ 4.390288] pcieport 0000:c0:08.1: Signaling PME through PCIe PME interrupt [ 4.397258] pci 0000:c3:00.0: Signaling PME through PCIe PME interrupt [ 4.403793] pci 0000:c3:00.1: Signaling PME through PCIe PME interrupt [ 4.410329] pcie_pme 0000:c0:08.1:pcie001: service driver pcie_pme loaded [ 4.410351] pci_hotplug: PCI Hot Plug PCI Core version: 0.5 [ 4.415932] pciehp: PCI Express Hot Plug Controller Driver version: 0.4 [ 4.422580] shpchp 0000:82:00.0: Cannot get control of SHPC hotplug [ 4.428884] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 4.435688] efifb: probing for efifb [ 4.439288] efifb: framebuffer at 0xae000000, mapped to 0xffffb1e119800000, using 3072k, total 3072k [ 4.448418] efifb: mode is 1024x768x32, linelength=4096, pages=1 [ 4.454433] efifb: scrolling: redraw [ 4.458024] efifb: Truecolor: size=8:8:8:8, shift=24:16:8:0 [ 4.479619] Console: switching to colour frame buffer device 128x48 [ 4.501653] fb0: EFI VGA frame buffer device [ 4.506025] input: Power Button as /devices/LNXSYSTM:00/device:00/PNP0C0C:00/input/input0 [ 4.514212] ACPI: Power Button [PWRB] [ 4.517933] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 4.525339] ACPI: Power Button [PWRF] [ 4.530176] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 4.537653] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 4.564848] 00:02: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A [ 4.591391] 00:03: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A [ 4.597422] Non-volatile memory driver v1.3 [ 4.601651] Linux agpgart interface v0.103 [ 4.607404] crash memory driver: version 1.1 [ 4.611902] rdac: device handler registered [ 4.616144] hp_sw: device handler registered [ 4.620432] emc: device handler registered [ 4.624687] alua: device handler registered [ 4.628910] libphy: Fixed MDIO Bus: probed [ 4.633073] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver [ 4.639614] ehci-pci: EHCI PCI platform driver [ 4.644080] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver [ 4.650272] ohci-pci: OHCI PCI platform driver [ 4.654738] uhci_hcd: USB Universal Host Controller Interface driver [ 4.661211] xhci_hcd 0000:02:00.3: xHCI Host Controller [ 4.666496] xhci_hcd 0000:02:00.3: new USB bus registered, assigned bus number 1 [ 4.674000] xhci_hcd 0000:02:00.3: hcc params 0x0270f665 hci version 0x100 quirks 0x00000410 [ 4.682473] xhci_hcd 0000:02:00.3: irq 50 for MSI/MSI-X [ 4.682492] xhci_hcd 0000:02:00.3: irq 51 for MSI/MSI-X [ 4.682510] xhci_hcd 0000:02:00.3: irq 52 for MSI/MSI-X [ 4.682539] xhci_hcd 0000:02:00.3: irq 53 for MSI/MSI-X [ 4.682558] xhci_hcd 0000:02:00.3: irq 54 for MSI/MSI-X [ 4.682578] xhci_hcd 0000:02:00.3: irq 55 for MSI/MSI-X [ 4.682596] xhci_hcd 0000:02:00.3: irq 56 for MSI/MSI-X [ 4.682616] xhci_hcd 0000:02:00.3: irq 57 for MSI/MSI-X [ 4.682744] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002 [ 4.689540] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.696767] usb usb1: Product: xHCI Host Controller [ 4.701655] usb usb1: Manufacturer: Linux 3.10.0-957.1.3.el7_lustre.x86_64 xhci-hcd [ 4.709316] usb usb1: SerialNumber: 0000:02:00.3 [ 4.714048] hub 1-0:1.0: USB hub found [ 4.717814] hub 1-0:1.0: 2 ports detected [ 4.722050] xhci_hcd 0000:02:00.3: xHCI Host Controller [ 4.727333] xhci_hcd 0000:02:00.3: new USB bus registered, assigned bus number 2 [ 4.734749] usb usb2: We don't know the algorithms for LPM for this host, disabling LPM. [ 4.742853] usb usb2: New USB device found, idVendor=1d6b, idProduct=0003 [ 4.749643] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.756872] usb usb2: Product: xHCI Host Controller [ 4.761760] usb usb2: Manufacturer: Linux 3.10.0-957.1.3.el7_lustre.x86_64 xhci-hcd [ 4.769422] usb usb2: SerialNumber: 0000:02:00.3 [ 4.774140] hub 2-0:1.0: USB hub found [ 4.777908] hub 2-0:1.0: 2 ports detected [ 4.782222] xhci_hcd 0000:41:00.3: xHCI Host Controller [ 4.787541] xhci_hcd 0000:41:00.3: new USB bus registered, assigned bus number 3 [ 4.795050] xhci_hcd 0000:41:00.3: hcc params 0x0270f665 hci version 0x100 quirks 0x00000410 [ 4.803537] xhci_hcd 0000:41:00.3: irq 59 for MSI/MSI-X [ 4.803556] xhci_hcd 0000:41:00.3: irq 60 for MSI/MSI-X [ 4.803578] xhci_hcd 0000:41:00.3: irq 61 for MSI/MSI-X [ 4.803597] xhci_hcd 0000:41:00.3: irq 62 for MSI/MSI-X [ 4.803615] xhci_hcd 0000:41:00.3: irq 63 for MSI/MSI-X [ 4.803639] xhci_hcd 0000:41:00.3: irq 64 for MSI/MSI-X [ 4.803657] xhci_hcd 0000:41:00.3: irq 65 for MSI/MSI-X [ 4.803675] xhci_hcd 0000:41:00.3: irq 66 for MSI/MSI-X [ 4.803827] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002 [ 4.810624] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.817850] usb usb3: Product: xHCI Host Controller [ 4.822741] usb usb3: Manufacturer: Linux 3.10.0-957.1.3.el7_lustre.x86_64 xhci-hcd [ 4.830400] usb usb3: SerialNumber: 0000:41:00.3 [ 4.835134] hub 3-0:1.0: USB hub found [ 4.838897] hub 3-0:1.0: 2 ports detected [ 4.843153] xhci_hcd 0000:41:00.3: xHCI Host Controller [ 4.848425] xhci_hcd 0000:41:00.3: new USB bus registered, assigned bus number 4 [ 4.855866] usb usb4: We don't know the algorithms for LPM for this host, disabling LPM. [ 4.863972] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003 [ 4.870770] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.877998] usb usb4: Product: xHCI Host Controller [ 4.882886] usb usb4: Manufacturer: Linux 3.10.0-957.1.3.el7_lustre.x86_64 xhci-hcd [ 4.890548] usb usb4: SerialNumber: 0000:41:00.3 [ 4.895265] hub 4-0:1.0: USB hub found [ 4.899026] hub 4-0:1.0: 2 ports detected [ 4.903290] usbcore: registered new interface driver usbserial_generic [ 4.909828] usbserial: USB Serial support registered for generic [ 4.915878] i8042: PNP: No PS/2 controller found. Probing ports directly. [ 5.154549] usb 3-1: new high-speed USB device number 2 using xhci_hcd [ 5.284494] usb 3-1: New USB device found, idVendor=1604, idProduct=10c0 [ 5.291205] usb 3-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 5.304009] hub 3-1:1.0: USB hub found [ 5.307994] hub 3-1:1.0: 4 ports detected [ 5.953758] i8042: No controller found [ 5.957526] sched: RT throttling activated [ 5.957534] tsc: Refined TSC clocksource calibration: 1996.249 MHz [ 5.957678] mousedev: PS/2 mouse device common for all mice [ 5.957892] rtc_cmos 00:01: RTC can wake from S4 [ 5.958237] rtc_cmos 00:01: rtc core: registered rtc_cmos as rtc0 [ 5.958337] rtc_cmos 00:01: alarms up to one month, y3k, 114 bytes nvram, hpet irqs [ 5.958389] cpuidle: using governor menu [ 5.958628] EFI Variables Facility v0.08 2004-May-17 [ 5.979829] hidraw: raw HID events driver (C) Jiri Kosina [ 5.979935] usbcore: registered new interface driver usbhid [ 5.979936] usbhid: USB HID core driver [ 5.980025] drop_monitor: Initializing network drop monitor service [ 5.980158] TCP: cubic registered [ 5.980162] Initializing XFRM netlink socket [ 5.980332] NET: Registered protocol family 10 [ 5.980876] NET: Registered protocol family 17 [ 5.980881] mpls_gso: MPLS GSO support [ 5.981957] microcode: CPU0: patch_level=0x08001227 [ 5.981966] microcode: CPU1: patch_level=0x08001227 [ 5.981977] microcode: CPU2: patch_level=0x08001227 [ 5.981988] microcode: CPU3: patch_level=0x08001227 [ 5.982000] microcode: CPU4: patch_level=0x08001227 [ 5.982012] microcode: CPU5: patch_level=0x08001227 [ 5.982028] microcode: CPU6: patch_level=0x08001227 [ 5.982042] microcode: CPU7: patch_level=0x08001227 [ 5.982051] microcode: CPU8: patch_level=0x08001227 [ 5.982059] microcode: CPU9: patch_level=0x08001227 [ 5.982070] microcode: CPU10: patch_level=0x08001227 [ 5.982081] microcode: CPU11: patch_level=0x08001227 [ 5.982092] microcode: CPU12: patch_level=0x08001227 [ 5.982100] microcode: CPU13: patch_level=0x08001227 [ 5.982111] microcode: CPU14: patch_level=0x08001227 [ 5.982121] microcode: CPU15: patch_level=0x08001227 [ 5.986444] microcode: CPU16: patch_level=0x08001227 [ 5.986452] microcode: CPU17: patch_level=0x08001227 [ 5.986462] microcode: CPU18: patch_level=0x08001227 [ 5.986472] microcode: CPU19: patch_level=0x08001227 [ 5.986483] microcode: CPU20: patch_level=0x08001227 [ 5.986491] microcode: CPU21: patch_level=0x08001227 [ 5.986502] microcode: CPU22: patch_level=0x08001227 [ 5.986513] microcode: CPU23: patch_level=0x08001227 [ 5.986523] microcode: CPU24: patch_level=0x08001227 [ 5.986531] microcode: CPU25: patch_level=0x08001227 [ 5.986544] microcode: CPU26: patch_level=0x08001227 [ 5.986554] microcode: CPU27: patch_level=0x08001227 [ 5.986564] microcode: CPU28: patch_level=0x08001227 [ 5.986572] microcode: CPU29: patch_level=0x08001227 [ 5.986583] microcode: CPU30: patch_level=0x08001227 [ 5.986593] microcode: CPU31: patch_level=0x08001227 [ 5.986600] microcode: CPU32: patch_level=0x08001227 [ 5.986607] microcode: CPU33: patch_level=0x08001227 [ 5.986615] microcode: CPU34: patch_level=0x08001227 [ 5.986622] microcode: CPU35: patch_level=0x08001227 [ 5.986630] microcode: CPU36: patch_level=0x08001227 [ 5.986639] microcode: CPU37: patch_level=0x08001227 [ 5.986647] microcode: CPU38: patch_level=0x08001227 [ 5.986655] microcode: CPU39: patch_level=0x08001227 [ 5.986663] microcode: CPU40: patch_level=0x08001227 [ 5.986671] microcode: CPU41: patch_level=0x08001227 [ 5.986679] microcode: CPU42: patch_level=0x08001227 [ 5.986687] microcode: CPU43: patch_level=0x08001227 [ 5.986695] microcode: CPU44: patch_level=0x08001227 [ 5.986703] microcode: CPU45: patch_level=0x08001227 [ 5.986712] microcode: CPU46: patch_level=0x08001227 [ 5.986720] microcode: CPU47: patch_level=0x08001227 [ 5.986769] microcode: Microcode Update Driver: v2.01 <tigran@aivazian.fsnet.co.uk>, Peter Oruba [ 5.986910] PM: Hibernation image not present or could not be loaded. [ 5.986912] Loading compiled-in X.509 certificates [ 5.987286] Loaded X.509 cert 'Red Hat Enterprise Linux Driver Update Program (key 3): bf57f3e87362bc7229d9f465321773dfd1f77a80' [ 5.987562] usb 3-1.1: new high-speed USB device number 3 using xhci_hcd [ 5.987661] Loaded X.509 cert 'Red Hat Enterprise Linux kpatch signing key: 4d38fd864ebe18c5f0b72e3852e2014c3a676fc8' [ 5.988022] Loaded X.509 cert 'Red Hat Enterprise Linux kernel signing key: 26463bf7b35aa6e910b2216d61318fa5ff5b7954' [ 5.988037] registered taskstats version 1 [ 5.990094] Key type trusted registered [ 5.991621] Key type encrypted registered [ 5.991665] IMA: No TPM chip found, activating TPM-bypass! (rc=-19) [ 5.993884] Magic number: 15:464:890 [ 5.993942] cpuid cpu42: hash matches [ 5.993987] processor cpu42: hash matches [ 5.994008] memory memory1797: hash matches [ 5.994038] memory memory1116: hash matches [ 5.994083] memory memory329: hash matches [ 6.000223] rtc_cmos 00:01: setting system clock to 2019-04-22 14:54:01 UTC (1555944841) [ 6.391906] Switched to clocksource tsc [ 6.396842] Freeing unused kernel memory: 1876k freed [ 6.402069] Write protecting the kernel read-only data: 12288k [ 6.403500] usb 3-1.1: New USB device found, idVendor=1604, idProduct=10c0 [ 6.403502] usb 3-1.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 6.423582] Freeing unused kernel memory: 516k freed [ 6.424020] hub 3-1.1:1.0: USB hub found [ 6.424374] hub 3-1.1:1.0: 4 ports detected [ 6.438087] Freeing unused kernel memory: 600k freed [ 6.488550] usb 3-1.4: new high-speed USB device number 4 using xhci_hcd [ 6.490514] systemd[1]: systemd 219 running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 -SECCOMP +BLKID +ELFUTILS +KMOD +IDN) [ 6.491625] systemd[1]: Detected architecture x86-64. [ 6.491628] systemd[1]: Running in initial RAM disk. [ 6.507551] usb 1-1: new high-speed USB device number 2 using xhci_hcd [ 6.538682] systemd[1]: Set hostname to <fir-io3-s2>. [ 6.574275] systemd[1]: Created slice Root Slice. [ 6.583697] systemd[1]: Listening on Journal Socket. [ 6.593640] systemd[1]: Listening on udev Control Socket. [ 6.597505] usb 3-1.4: New USB device found, idVendor=1604, idProduct=10c0 [ 6.597507] usb 3-1.4: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 6.616023] hub 3-1.4:1.0: USB hub found [ 6.620251] hub 3-1.4:1.0: 4 ports detected [ 6.627623] systemd[1]: Listening on udev Kernel Socket. [ 6.635394] usb 1-1: New USB device found, idVendor=0424, idProduct=2744 [ 6.642550] usb 1-1: New USB device strings: Mfr=1, Product=2, SerialNumber=0 [ 6.651067] usb 1-1: Product: USB2734 [ 6.655081] usb 1-1: Manufacturer: Microchip Tech [ 6.659845] systemd[1]: Reached target Timers. [ 6.668603] systemd[1]: Reached target Local File Systems. [ 6.679674] systemd[1]: Created slice System Slice. [ 6.686925] hub 1-1:1.0: USB hub found [ 6.691394] hub 1-1:1.0: 4 ports detected [ 6.697187] systemd[1]: Starting Load Kernel Modules... [ 6.707025] systemd[1]: Starting Create list of required static device nodes for the current kernel... [ 6.724607] systemd[1]: Reached target Slices. [ 6.733970] systemd[1]: Starting Journal Service... [ 6.744096] systemd[1]: Starting dracut cmdline hook... [ 6.749333] usb 2-1: new SuperSpeed USB device number 2 using xhci_hcd [ 6.760612] systemd[1]: Reached target Sockets. [ 6.769771] usb 2-1: New USB device found, idVendor=0424, idProduct=5744 [ 6.770014] systemd[1]: Starting Setup Virtual Console... [ 6.781877] usb 2-1: New USB device strings: Mfr=2, Product=3, SerialNumber=0 [ 6.781879] usb 2-1: Product: USB5734 [ 6.781880] usb 2-1: Manufacturer: Microchip Tech [ 6.792727] hub 2-1:1.0: USB hub found [ 6.797412] hub 2-1:1.0: 4 ports detected [ 6.805497] usb: port power management may be unreliable [ 6.814611] systemd[1]: Reached target Swap. [ 6.836861] systemd[1]: Started Journal Service. [ 7.018127] mpt3sas: loading out-of-tree module taints kernel. [ 7.030532] mpt3sas: module verification failed: signature and/or required key missing - tainting kernel [ 7.050207] mpt3sas version 27.00.00.00 loaded [ 7.056114] pps_core: LinuxPPS API ver. 1 registered [ 7.057386] mpt3sas_cm0: 64 BIT PCI BUS DMA ADDRESSING SUPPORTED, total mem (263565260 kB) [ 7.069392] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it> [ 7.071611] mpt3sas_cm0: IOC Number : 0 [ 7.071614] mpt3sas_cm0: CurrentHostPageSize is 0: Setting default host page size to 4k [ 7.071708] mpt3sas 0000:01:00.0: irq 68 for MSI/MSI-X [ 7.071731] mpt3sas 0000:01:00.0: irq 69 for MSI/MSI-X [ 7.071754] mpt3sas 0000:01:00.0: irq 70 for MSI/MSI-X [ 7.071777] mpt3sas 0000:01:00.0: irq 71 for MSI/MSI-X [ 7.071799] mpt3sas 0000:01:00.0: irq 72 for MSI/MSI-X [ 7.071819] mpt3sas 0000:01:00.0: irq 73 for MSI/MSI-X [ 7.071844] mpt3sas 0000:01:00.0: irq 74 for MSI/MSI-X [ 7.071866] mpt3sas 0000:01:00.0: irq 75 for MSI/MSI-X [ 7.071887] mpt3sas 0000:01:00.0: irq 76 for MSI/MSI-X [ 7.071907] mpt3sas 0000:01:00.0: irq 77 for MSI/MSI-X [ 7.071930] mpt3sas 0000:01:00.0: irq 78 for MSI/MSI-X [ 7.071952] mpt3sas 0000:01:00.0: irq 79 for MSI/MSI-X [ 7.071975] mpt3sas 0000:01:00.0: irq 80 for MSI/MSI-X [ 7.071996] mpt3sas 0000:01:00.0: irq 81 for MSI/MSI-X [ 7.072020] mpt3sas 0000:01:00.0: irq 82 for MSI/MSI-X [ 7.072041] mpt3sas 0000:01:00.0: irq 83 for MSI/MSI-X [ 7.072062] mpt3sas 0000:01:00.0: irq 84 for MSI/MSI-X [ 7.072085] mpt3sas 0000:01:00.0: irq 85 for MSI/MSI-X [ 7.072108] mpt3sas 0000:01:00.0: irq 86 for MSI/MSI-X [ 7.072131] mpt3sas 0000:01:00.0: irq 87 for MSI/MSI-X [ 7.072153] mpt3sas 0000:01:00.0: irq 88 for MSI/MSI-X [ 7.072176] mpt3sas 0000:01:00.0: irq 89 for MSI/MSI-X [ 7.072200] mpt3sas 0000:01:00.0: irq 90 for MSI/MSI-X [ 7.072221] mpt3sas 0000:01:00.0: irq 91 for MSI/MSI-X [ 7.072242] mpt3sas 0000:01:00.0: irq 92 for MSI/MSI-X [ 7.072263] mpt3sas 0000:01:00.0: irq 93 for MSI/MSI-X [ 7.072284] mpt3sas 0000:01:00.0: irq 94 for MSI/MSI-X [ 7.072307] mpt3sas 0000:01:00.0: irq 95 for MSI/MSI-X [ 7.072328] mpt3sas 0000:01:00.0: irq 96 for MSI/MSI-X [ 7.072349] mpt3sas 0000:01:00.0: irq 97 for MSI/MSI-X [ 7.072373] mpt3sas 0000:01:00.0: irq 98 for MSI/MSI-X [ 7.072395] mpt3sas 0000:01:00.0: irq 99 for MSI/MSI-X [ 7.072416] mpt3sas 0000:01:00.0: irq 100 for MSI/MSI-X [ 7.072437] mpt3sas 0000:01:00.0: irq 101 for MSI/MSI-X [ 7.072458] mpt3sas 0000:01:00.0: irq 102 for MSI/MSI-X [ 7.072479] mpt3sas 0000:01:00.0: irq 103 for MSI/MSI-X [ 7.072502] mpt3sas 0000:01:00.0: irq 104 for MSI/MSI-X [ 7.072524] mpt3sas 0000:01:00.0: irq 105 for MSI/MSI-X [ 7.072554] mpt3sas 0000:01:00.0: irq 106 for MSI/MSI-X [ 7.072576] mpt3sas 0000:01:00.0: irq 107 for MSI/MSI-X [ 7.072598] mpt3sas 0000:01:00.0: irq 108 for MSI/MSI-X [ 7.072623] mpt3sas 0000:01:00.0: irq 109 for MSI/MSI-X [ 7.072644] mpt3sas 0000:01:00.0: irq 110 for MSI/MSI-X [ 7.072666] mpt3sas 0000:01:00.0: irq 111 for MSI/MSI-X [ 7.072687] mpt3sas 0000:01:00.0: irq 112 for MSI/MSI-X [ 7.072707] mpt3sas 0000:01:00.0: irq 113 for MSI/MSI-X [ 7.072732] mpt3sas 0000:01:00.0: irq 114 for MSI/MSI-X [ 7.072753] mpt3sas 0000:01:00.0: irq 115 for MSI/MSI-X [ 7.073597] mpt3sas0-msix0: PCI-MSI-X enabled: IRQ 68 [ 7.073598] mpt3sas0-msix1: PCI-MSI-X enabled: IRQ 69 [ 7.073599] mpt3sas0-msix2: PCI-MSI-X enabled: IRQ 70 [ 7.073599] mpt3sas0-msix3: PCI-MSI-X enabled: IRQ 71 [ 7.073600] mpt3sas0-msix4: PCI-MSI-X enabled: IRQ 72 [ 7.073600] mpt3sas0-msix5: PCI-MSI-X enabled: IRQ 73 [ 7.073601] mpt3sas0-msix6: PCI-MSI-X enabled: IRQ 74 [ 7.073602] mpt3sas0-msix7: PCI-MSI-X enabled: IRQ 75 [ 7.073602] mpt3sas0-msix8: PCI-MSI-X enabled: IRQ 76 [ 7.073603] mpt3sas0-msix9: PCI-MSI-X enabled: IRQ 77 [ 7.073603] mpt3sas0-msix10: PCI-MSI-X enabled: IRQ 78 [ 7.073604] mpt3sas0-msix11: PCI-MSI-X enabled: IRQ 79 [ 7.073604] mpt3sas0-msix12: PCI-MSI-X enabled: IRQ 80 [ 7.073605] mpt3sas0-msix13: PCI-MSI-X enabled: IRQ 81 [ 7.073605] mpt3sas0-msix14: PCI-MSI-X enabled: IRQ 82 [ 7.073606] mpt3sas0-msix15: PCI-MSI-X enabled: IRQ 83 [ 7.073607] mpt3sas0-msix16: PCI-MSI-X enabled: IRQ 84 [ 7.073608] mpt3sas0-msix17: PCI-MSI-X enabled: IRQ 85 [ 7.073608] mpt3sas0-msix18: PCI-MSI-X enabled: IRQ 86 [ 7.073609] mpt3sas0-msix19: PCI-MSI-X enabled: IRQ 87 [ 7.073609] mpt3sas0-msix20: PCI-MSI-X enabled: IRQ 88 [ 7.073610] mpt3sas0-msix21: PCI-MSI-X enabled: IRQ 89 [ 7.073610] mpt3sas0-msix22: PCI-MSI-X enabled: IRQ 90 [ 7.073611] mpt3sas0-msix23: PCI-MSI-X enabled: IRQ 91 [ 7.073612] mpt3sas0-msix24: PCI-MSI-X enabled: IRQ 92 [ 7.073612] mpt3sas0-msix25: PCI-MSI-X enabled: IRQ 93 [ 7.073613] mpt3sas0-msix26: PCI-MSI-X enabled: IRQ 94 [ 7.073613] mpt3sas0-msix27: PCI-MSI-X enabled: IRQ 95 [ 7.073614] mpt3sas0-msix28: PCI-MSI-X enabled: IRQ 96 [ 7.073614] mpt3sas0-msix29: PCI-MSI-X enabled: IRQ 97 [ 7.073615] mpt3sas0-msix30: PCI-MSI-X enabled: IRQ 98 [ 7.073615] mpt3sas0-msix31: PCI-MSI-X enabled: IRQ 99 [ 7.073616] mpt3sas0-msix32: PCI-MSI-X enabled: IRQ 100 [ 7.073617] mpt3sas0-msix33: PCI-MSI-X enabled: IRQ 101 [ 7.073618] mpt3sas0-msix34: PCI-MSI-X enabled: IRQ 102 [ 7.073618] mpt3sas0-msix35: PCI-MSI-X enabled: IRQ 103 [ 7.073619] mpt3sas0-msix36: PCI-MSI-X enabled: IRQ 104 [ 7.073620] mpt3sas0-msix37: PCI-MSI-X enabled: IRQ 105 [ 7.073620] mpt3sas0-msix38: PCI-MSI-X enabled: IRQ 106 [ 7.073621] mpt3sas0-msix39: PCI-MSI-X enabled: IRQ 107 [ 7.073622] mpt3sas0-msix40: PCI-MSI-X enabled: IRQ 108 [ 7.073623] mpt3sas0-msix41: PCI-MSI-X enabled: IRQ 109 [ 7.073623] mpt3sas0-msix42: PCI-MSI-X enabled: IRQ 110 [ 7.073624] mpt3sas0-msix43: PCI-MSI-X enabled: IRQ 111 [ 7.073624] mpt3sas0-msix44: PCI-MSI-X enabled: IRQ 112 [ 7.073625] mpt3sas0-msix45: PCI-MSI-X enabled: IRQ 113 [ 7.073625] mpt3sas0-msix46: PCI-MSI-X enabled: IRQ 114 [ 7.073626] mpt3sas0-msix47: PCI-MSI-X enabled: IRQ 115 [ 7.073628] mpt3sas_cm0: iomem(0x00000000e1000000), mapped(0xffffb1e11a000000), size(1048576) [ 7.073629] mpt3sas_cm0: ioport(0x0000000000001000), size(256) [ 7.082653] mpt3sas_cm0: IOC Number : 0 [ 7.082654] mpt3sas_cm0: CurrentHostPageSize is 0: Setting default host page size to 4k [ 7.196491] PTP clock support registered [ 7.227700] Request for unknown module key 'Mellanox Technologies signing key: 61feb074fc7292f958419386ffdd9d5ca999e403' err -11 [ 7.258046] Compat-mlnx-ofed backport release: b4fdfac [ 7.258048] Backport based on mlnx_ofed/mlnx-ofa_kernel-4.0.git b4fdfac [ 7.258048] compat.git: mlnx_ofed/mlnx-ofa_kernel-4.0.git [ 7.262248] mpt3sas_cm0: Allocated physical memory: size(38831 kB) [ 7.262250] mpt3sas_cm0: Current Controller Queue Depth(7564), Max Controller Queue Depth(7680) [ 7.262250] mpt3sas_cm0: Scatter Gather Elements per IO(128) [ 7.370905] mpt3sas_cm0: FW Package Version(08.00.00.00) [ 7.371206] mpt3sas_cm0: SAS3616: FWVersion(08.00.00.00), ChipRevision(0x02), BiosVersion(00.00.00.00) [ 7.371211] mpt3sas_cm0: Protocol=(Initiator,Target,NVMe), Capabilities=(TLR,EEDP,Diag Trace Buffer,Task Set Full,NCQ) [ 7.371292] mpt3sas_cm0: : host protection capabilities enabled DIF1 DIF2 DIF3 [ 7.371301] scsi host0: Fusion MPT SAS Host [ 7.371914] mpt3sas_cm0: sending port enable !! [ 7.377103] megasas: 07.705.02.00-rh1 [ 7.377536] megaraid_sas 0000:c1:00.0: FW now in Ready state [ 7.377541] megaraid_sas 0000:c1:00.0: 64 bit DMA mask and 32 bit consistent mask [ 7.377902] megaraid_sas 0000:c1:00.0: irq 117 for MSI/MSI-X [ 7.377927] megaraid_sas 0000:c1:00.0: irq 118 for MSI/MSI-X [ 7.377952] megaraid_sas 0000:c1:00.0: irq 119 for MSI/MSI-X [ 7.377979] megaraid_sas 0000:c1:00.0: irq 120 for MSI/MSI-X [ 7.378004] megaraid_sas 0000:c1:00.0: irq 121 for MSI/MSI-X [ 7.378032] megaraid_sas 0000:c1:00.0: irq 122 for MSI/MSI-X [ 7.378057] megaraid_sas 0000:c1:00.0: irq 123 for MSI/MSI-X [ 7.378080] megaraid_sas 0000:c1:00.0: irq 124 for MSI/MSI-X [ 7.378105] megaraid_sas 0000:c1:00.0: irq 125 for MSI/MSI-X [ 7.378130] megaraid_sas 0000:c1:00.0: irq 126 for MSI/MSI-X [ 7.378154] megaraid_sas 0000:c1:00.0: irq 127 for MSI/MSI-X [ 7.378186] megaraid_sas 0000:c1:00.0: irq 128 for MSI/MSI-X [ 7.378215] megaraid_sas 0000:c1:00.0: irq 129 for MSI/MSI-X [ 7.378240] megaraid_sas 0000:c1:00.0: irq 130 for MSI/MSI-X [ 7.378264] megaraid_sas 0000:c1:00.0: irq 131 for MSI/MSI-X [ 7.378290] megaraid_sas 0000:c1:00.0: irq 132 for MSI/MSI-X [ 7.378312] megaraid_sas 0000:c1:00.0: irq 133 for MSI/MSI-X [ 7.378333] megaraid_sas 0000:c1:00.0: irq 134 for MSI/MSI-X [ 7.378354] megaraid_sas 0000:c1:00.0: irq 135 for MSI/MSI-X [ 7.378377] megaraid_sas 0000:c1:00.0: irq 136 for MSI/MSI-X [ 7.378398] megaraid_sas 0000:c1:00.0: irq 137 for MSI/MSI-X [ 7.378420] megaraid_sas 0000:c1:00.0: irq 138 for MSI/MSI-X [ 7.378447] megaraid_sas 0000:c1:00.0: irq 139 for MSI/MSI-X [ 7.378472] megaraid_sas 0000:c1:00.0: irq 140 for MSI/MSI-X [ 7.378503] megaraid_sas 0000:c1:00.0: irq 141 for MSI/MSI-X [ 7.378528] megaraid_sas 0000:c1:00.0: irq 142 for MSI/MSI-X [ 7.378559] megaraid_sas 0000:c1:00.0: irq 143 for MSI/MSI-X [ 7.378583] megaraid_sas 0000:c1:00.0: irq 144 for MSI/MSI-X [ 7.378608] megaraid_sas 0000:c1:00.0: irq 145 for MSI/MSI-X [ 7.378631] megaraid_sas 0000:c1:00.0: irq 146 for MSI/MSI-X [ 7.378655] megaraid_sas 0000:c1:00.0: irq 147 for MSI/MSI-X [ 7.378679] megaraid_sas 0000:c1:00.0: irq 148 for MSI/MSI-X [ 7.378703] megaraid_sas 0000:c1:00.0: irq 149 for MSI/MSI-X [ 7.378726] megaraid_sas 0000:c1:00.0: irq 150 for MSI/MSI-X [ 7.378750] megaraid_sas 0000:c1:00.0: irq 151 for MSI/MSI-X [ 7.378776] megaraid_sas 0000:c1:00.0: irq 152 for MSI/MSI-X [ 7.378802] megaraid_sas 0000:c1:00.0: irq 153 for MSI/MSI-X [ 7.378823] megaraid_sas 0000:c1:00.0: irq 154 for MSI/MSI-X [ 7.378844] megaraid_sas 0000:c1:00.0: irq 155 for MSI/MSI-X [ 7.378866] megaraid_sas 0000:c1:00.0: irq 156 for MSI/MSI-X [ 7.378890] megaraid_sas 0000:c1:00.0: irq 157 for MSI/MSI-X [ 7.378928] megaraid_sas 0000:c1:00.0: irq 158 for MSI/MSI-X [ 7.378953] megaraid_sas 0000:c1:00.0: irq 159 for MSI/MSI-X [ 7.378980] megaraid_sas 0000:c1:00.0: irq 160 for MSI/MSI-X [ 7.379002] megaraid_sas 0000:c1:00.0: irq 161 for MSI/MSI-X [ 7.379025] megaraid_sas 0000:c1:00.0: irq 162 for MSI/MSI-X [ 7.379047] megaraid_sas 0000:c1:00.0: irq 163 for MSI/MSI-X [ 7.379071] megaraid_sas 0000:c1:00.0: irq 164 for MSI/MSI-X [ 7.379199] megaraid_sas 0000:c1:00.0: firmware supports msix : (96) [ 7.379200] megaraid_sas 0000:c1:00.0: current msix/online cpus : (48/48) [ 7.379202] megaraid_sas 0000:c1:00.0: RDPQ mode : (disabled) [ 7.379205] megaraid_sas 0000:c1:00.0: Current firmware supports maximum commands: 928 LDIO threshold: 237 [ 7.379571] megaraid_sas 0000:c1:00.0: Configured max firmware commands: 927 [ 7.382410] megaraid_sas 0000:c1:00.0: FW supports sync cache : No [ 7.529575] Request for unknown module key 'Mellanox Technologies signing key: 61feb074fc7292f958419386ffdd9d5ca999e403' err -11 [ 7.542376] tg3.c:v3.137 (May 11, 2014) [ 7.542735] libata version 3.00 loaded. [ 7.544680] Request for unknown module key 'Mellanox Technologies signing key: 61feb074fc7292f958419386ffdd9d5ca999e403' err -11 [ 7.562894] tg3 0000:81:00.0 eth0: Tigon3 [partno(BCM95720) rev 5720000] (PCI Express) MAC address d0:94:66:34:4a:ef [ 7.562897] tg3 0000:81:00.0 eth0: attached PHY is 5720C (10/100/1000Base-T Ethernet) (WireSpeed[1], EEE[1]) [ 7.562899] tg3 0000:81:00.0 eth0: RXcsums[1] LinkChgREG[0] MIirq[0] ASF[1] TSOcap[1] [ 7.562900] tg3 0000:81:00.0 eth0: dma_rwctrl[00000001] dma_mask[64-bit] [ 7.581507] tg3 0000:81:00.1 eth1: Tigon3 [partno(BCM95720) rev 5720000] (PCI Express) MAC address d0:94:66:34:4a:f0 [ 7.581510] tg3 0000:81:00.1 eth1: attached PHY is 5720C (10/100/1000Base-T Ethernet) (WireSpeed[1], EEE[1]) [ 7.581512] tg3 0000:81:00.1 eth1: RXcsums[1] LinkChgREG[0] MIirq[0] ASF[1] TSOcap[1] [ 7.581513] tg3 0000:81:00.1 eth1: dma_rwctrl[00000001] dma_mask[64-bit] [ 7.586702] ahci 0000:86:00.2: version 3.0 [ 7.587485] ahci 0000:86:00.2: irq 169 for MSI/MSI-X [ 7.587517] ahci 0000:86:00.2: irq 170 for MSI/MSI-X [ 7.587550] ahci 0000:86:00.2: irq 171 for MSI/MSI-X [ 7.587576] ahci 0000:86:00.2: irq 172 for MSI/MSI-X [ 7.587580] ahci 0000:86:00.2: irq 173 for MSI/MSI-X [ 7.587583] ahci 0000:86:00.2: irq 174 for MSI/MSI-X [ 7.587586] ahci 0000:86:00.2: irq 175 for MSI/MSI-X [ 7.587589] ahci 0000:86:00.2: irq 176 for MSI/MSI-X [ 7.587613] ahci 0000:86:00.2: irq 177 for MSI/MSI-X [ 7.587644] ahci 0000:86:00.2: irq 178 for MSI/MSI-X [ 7.587675] ahci 0000:86:00.2: irq 179 for MSI/MSI-X [ 7.587708] ahci 0000:86:00.2: irq 180 for MSI/MSI-X [ 7.587740] ahci 0000:86:00.2: irq 181 for MSI/MSI-X [ 7.587771] ahci 0000:86:00.2: irq 182 for MSI/MSI-X [ 7.587803] ahci 0000:86:00.2: irq 183 for MSI/MSI-X [ 7.587834] ahci 0000:86:00.2: irq 184 for MSI/MSI-X [ 7.588249] ahci 0000:86:00.2: AHCI 0001.0301 32 slots 1 ports 6 Gbps 0x1 impl SATA mode [ 7.588251] ahci 0000:86:00.2: flags: 64bit ncq sntf ilck pm led clo only pmp fbs pio slum part [ 7.588863] scsi host2: ahci [ 7.588930] ata1: SATA max UDMA/133 abar m4096@0xc0a02000 port 0xc0a02100 irq 169 [ 7.589064] mlx5_core 0000:84:00.0: firmware version: 12.24.1000 [ 7.589121] mlx5_core 0000:84:00.0: 126.016 Gb/s available PCIe bandwidth (8 GT/s x16 link) [ 7.742567] megaraid_sas 0000:c1:00.0: Init cmd return status SUCCESS for SCSI host 1 [ 7.771558] megaraid_sas 0000:c1:00.0: firmware type : Legacy(64 VD) firmware [ 7.778695] megaraid_sas 0000:c1:00.0: controller type : iMR(0MB) [ 7.784834] megaraid_sas 0000:c1:00.0: Online Controller Reset(OCR) : Enabled [ 7.791972] megaraid_sas 0000:c1:00.0: Secure JBOD support : No [ 7.797890] megaraid_sas 0000:c1:00.0: NVMe passthru support : No [ 7.826120] megaraid_sas 0000:c1:00.0: INIT adapter done [ 7.831441] megaraid_sas 0000:c1:00.0: Jbod map is not supported megasas_setup_jbod_map 5146 [ 7.852744] megaraid_sas 0000:c1:00.0: pci id : (0x1000)/(0x005f)/(0x1028)/(0x1f4b) [ 7.860490] megaraid_sas 0000:c1:00.0: unevenspan support : yes [ 7.866429] megaraid_sas 0000:c1:00.0: firmware crash dump : no [ 7.872355] megaraid_sas 0000:c1:00.0: jbod sync map : no [ 7.877844] scsi host1: Avago SAS based MegaRAID driver [ 7.895574] ata1: SATA link down (SStatus 0 SControl 300) [ 7.902462] scsi 1:2:0:0: Direct-Access DELL PERC H330 Mini 4.29 PQ: 0 ANSI: 5 [ 9.490343] mpt3sas_cm0: hba_port entry: ffff981db60ade80, port: 255 is added to hba_port list [ 9.501160] mpt3sas_cm0: host_add: handle(0x0001), sas_addr(0x500605b00db90e40), phys(17) [ 9.509692] mpt3sas_cm0: detecting: handle(0x0011), sas_address(0x510600b00db90e40), phy(16) [ 9.518129] mpt3sas_cm0: REPORT_LUNS: handle(0x0011), retries(0) [ 9.524167] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0011), lun(0) [ 9.530674] scsi 0:0:0:0: Enclosure LSI virtualSES 02 PQ: 0 ANSI: 6 [ 9.538812] scsi 0:0:0:0: set ignore_delay_remove for handle(0x0011) [ 9.545163] scsi 0:0:0:0: SES: handle(0x0011), sas_addr(0x510600b00db90e40), phy(16), device_name(0x510600b00db90e40) [ 9.555761] scsi 0:0:0:0: enclosure logical id(0x500605b00db90e40), slot(16) [ 9.562893] scsi 0:0:0:0: enclosure level(0x0000), connector name( C2 ) [ 9.569622] scsi 0:0:0:0: serial_number(500605B00DB90E40) [ 9.575022] scsi 0:0:0:0: qdepth(1), tagged(0), simple(0), ordered(0), scsi_level(7), cmd_que(0) [ 9.593425] mlx5_core 0000:84:00.0: irq 185 for MSI/MSI-X [ 9.593449] mlx5_core 0000:84:00.0: irq 186 for MSI/MSI-X [ 9.593470] mlx5_core 0000:84:00.0: irq 187 for MSI/MSI-X [ 9.593489] mlx5_core 0000:84:00.0: irq 188 for MSI/MSI-X [ 9.593509] mlx5_core 0000:84:00.0: irq 189 for MSI/MSI-X [ 9.593528] mlx5_core 0000:84:00.0: irq 190 for MSI/MSI-X [ 9.593546] mlx5_core 0000:84:00.0: irq 191 for MSI/MSI-X [ 9.593593] mlx5_core 0000:84:00.0: irq 192 for MSI/MSI-X [ 9.593612] mlx5_core 0000:84:00.0: irq 193 for MSI/MSI-X [ 9.593631] mlx5_core 0000:84:00.0: irq 194 for MSI/MSI-X [ 9.593648] mlx5_core 0000:84:00.0: irq 195 for MSI/MSI-X [ 9.593668] mlx5_core 0000:84:00.0: irq 196 for MSI/MSI-X [ 9.593688] mlx5_core 0000:84:00.0: irq 197 for MSI/MSI-X [ 9.593707] mlx5_core 0000:84:00.0: irq 198 for MSI/MSI-X [ 9.593725] mlx5_core 0000:84:00.0: irq 199 for MSI/MSI-X [ 9.593745] mlx5_core 0000:84:00.0: irq 200 for MSI/MSI-X [ 9.593764] mlx5_core 0000:84:00.0: irq 201 for MSI/MSI-X [ 9.593785] mlx5_core 0000:84:00.0: irq 202 for MSI/MSI-X [ 9.593805] mlx5_core 0000:84:00.0: irq 203 for MSI/MSI-X [ 9.593823] mlx5_core 0000:84:00.0: irq 204 for MSI/MSI-X [ 9.593843] mlx5_core 0000:84:00.0: irq 205 for MSI/MSI-X [ 9.593862] mlx5_core 0000:84:00.0: irq 206 for MSI/MSI-X [ 9.593881] mlx5_core 0000:84:00.0: irq 207 for MSI/MSI-X [ 9.593899] mlx5_core 0000:84:00.0: irq 208 for MSI/MSI-X [ 9.593920] mlx5_core 0000:84:00.0: irq 209 for MSI/MSI-X [ 9.593939] mlx5_core 0000:84:00.0: irq 210 for MSI/MSI-X [ 9.593959] mlx5_core 0000:84:00.0: irq 211 for MSI/MSI-X [ 9.593977] mlx5_core 0000:84:00.0: irq 212 for MSI/MSI-X [ 9.593996] mlx5_core 0000:84:00.0: irq 213 for MSI/MSI-X [ 9.594015] mlx5_core 0000:84:00.0: irq 214 for MSI/MSI-X [ 9.594034] mlx5_core 0000:84:00.0: irq 215 for MSI/MSI-X [ 9.594052] mlx5_core 0000:84:00.0: irq 216 for MSI/MSI-X [ 9.594072] mlx5_core 0000:84:00.0: irq 217 for MSI/MSI-X [ 9.594096] mlx5_core 0000:84:00.0: irq 218 for MSI/MSI-X [ 9.594115] mlx5_core 0000:84:00.0: irq 219 for MSI/MSI-X [ 9.594132] mlx5_core 0000:84:00.0: irq 220 for MSI/MSI-X [ 9.594151] mlx5_core 0000:84:00.0: irq 221 for MSI/MSI-X [ 9.594172] mlx5_core 0000:84:00.0: irq 222 for MSI/MSI-X [ 9.594190] mlx5_core 0000:84:00.0: irq 223 for MSI/MSI-X [ 9.594208] mlx5_core 0000:84:00.0: irq 224 for MSI/MSI-X [ 9.594227] mlx5_core 0000:84:00.0: irq 225 for MSI/MSI-X [ 9.594245] mlx5_core 0000:84:00.0: irq 226 for MSI/MSI-X [ 9.594263] mlx5_core 0000:84:00.0: irq 227 for MSI/MSI-X [ 9.594282] mlx5_core 0000:84:00.0: irq 228 for MSI/MSI-X [ 9.594303] mlx5_core 0000:84:00.0: irq 229 for MSI/MSI-X [ 9.594320] mlx5_core 0000:84:00.0: irq 230 for MSI/MSI-X [ 9.594339] mlx5_core 0000:84:00.0: irq 231 for MSI/MSI-X [ 9.594359] mlx5_core 0000:84:00.0: irq 232 for MSI/MSI-X [ 9.594377] mlx5_core 0000:84:00.0: irq 233 for MSI/MSI-X [ 9.594394] mlx5_core 0000:84:00.0: irq 234 for MSI/MSI-X [ 9.594412] mlx5_core 0000:84:00.0: irq 235 for MSI/MSI-X [ 9.594431] mlx5_core 0000:84:00.0: irq 236 for MSI/MSI-X [ 9.597011] mlx5_core 0000:84:00.0: Port module event: module 0, Cable plugged [ 9.609445] mpt3sas_cm0: log_info(0x31200206): originator(PL), code(0x20), sub_code(0x0206) [ 9.661363] mpt3sas_cm0: expander_add: handle(0x0012), parent(0x0009), sas_addr(0x5001636001a06d7f), phys(79) [ 9.685236] mpt3sas_cm0: detecting: handle(0x0013), sas_address(0x5000c500954327d1), phy(0) [ 9.693590] mpt3sas_cm0: REPORT_LUNS: handle(0x0013), retries(0) [ 9.760026] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0013), lun(0) [ 9.760203] mlx5_core 0000:84:00.0: FW Tracer Owner [ 9.762813] Request for unknown module key 'Mellanox Technologies signing key: 61feb074fc7292f958419386ffdd9d5ca999e403' err -11 [ 9.787410] Request for unknown module key 'Mellanox Technologies signing key: 61feb074fc7292f958419386ffdd9d5ca999e403' err -11 [ 9.800900] Request for unknown module key 'Mellanox Technologies signing key: 61feb074fc7292f958419386ffdd9d5ca999e403' err -11 [ 9.801366] scsi 0:0:1:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 9.801739] scsi 0:0:1:0: SSP: handle(0x0013), sas_addr(0x5000c500954327d1), phy(0), device_name(0x5000c500954327d0) [ 9.801741] scsi 0:0:1:0: enclosure logical id(0x5001636001a06d7d), slot(0) [ 9.801742] scsi 0:0:1:0: enclosure level(0x0000), connector name( C1 ) [ 9.801743] scsi 0:0:1:0: serial_number(ZA1AGGPM0000R829CTE6) [ 9.801746] scsi 0:0:1:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 9.862580] mlx5_ib: Mellanox Connect-IB Infiniband driver v4.5-1.0.1 [ 9.869028] mlx5_ib: Mellanox Connect-IB Infiniband driver v4.5-1.0.1 [ 9.893071] mpt3sas_cm0: detecting: handle(0x0014), sas_address(0x5000c5009543210d), phy(1) [ 9.901426] mpt3sas_cm0: REPORT_LUNS: handle(0x0014), retries(0) [ 9.917088] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0014), lun(0) [ 9.926325] scsi 0:0:2:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 9.934816] scsi 0:0:2:0: SSP: handle(0x0014), sas_addr(0x5000c5009543210d), phy(1), device_name(0x5000c5009543210c) [ 9.945331] scsi 0:0:2:0: enclosure logical id(0x5001636001a06d7d), slot(1) [ 9.952377] scsi 0:0:2:0: enclosure level(0x0000), connector name( C1 ) [ 9.959099] scsi 0:0:2:0: serial_number(ZA1AGGYR0000C72542A6) [ 9.964844] scsi 0:0:2:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 9.991022] mpt3sas_cm0: detecting: handle(0x0015), sas_address(0x5000c500954322bd), phy(2) [ 9.999400] mpt3sas_cm0: REPORT_LUNS: handle(0x0015), retries(0) [ 10.012519] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0015), lun(0) [ 10.019694] scsi 0:0:3:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 10.028183] scsi 0:0:3:0: SSP: handle(0x0015), sas_addr(0x5000c500954322bd), phy(2), device_name(0x5000c500954322bc) [ 10.038700] scsi 0:0:3:0: enclosure logical id(0x5001636001a06d7d), slot(2) [ 10.045747] scsi 0:0:3:0: enclosure level(0x0000), connector name( C1 ) [ 10.052465] scsi 0:0:3:0: serial_number(ZA1AGGX60000R70426B4) [ 10.058211] scsi 0:0:3:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 10.087023] mpt3sas_cm0: detecting: handle(0x0016), sas_address(0x5000c50095431eed), phy(3) [ 10.093608] random: crng init done [ 10.098797] mpt3sas_cm0: REPORT_LUNS: handle(0x0016), retries(0) [ 10.115893] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0016), lun(0) [ 10.123073] scsi 0:0:4:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 10.131556] scsi 0:0:4:0: SSP: handle(0x0016), sas_addr(0x5000c50095431eed), phy(3), device_name(0x5000c50095431eec) [ 10.142067] scsi 0:0:4:0: enclosure logical id(0x5001636001a06d7d), slot(3) [ 10.149115] scsi 0:0:4:0: enclosure level(0x0000), connector name( C1 ) [ 10.155835] scsi 0:0:4:0: serial_number(ZA1AGH0M0000C8316G8B) [ 10.161582] scsi 0:0:4:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 10.184028] mpt3sas_cm0: detecting: handle(0x0017), sas_address(0x5000c500954307e9), phy(4) [ 10.192377] mpt3sas_cm0: REPORT_LUNS: handle(0x0017), retries(0) [ 10.209022] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0017), lun(0) [ 10.216193] scsi 0:0:5:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 10.224679] scsi 0:0:5:0: SSP: handle(0x0017), sas_addr(0x5000c500954307e9), phy(4), device_name(0x5000c500954307e8) [ 10.235192] scsi 0:0:5:0: enclosure logical id(0x5001636001a06d7d), slot(4) [ 10.242239] scsi 0:0:5:0: enclosure level(0x0000), connector name( C1 ) [ 10.248960] scsi 0:0:5:0: serial_number(ZA1AG8FH0000R8301BKX) [ 10.254704] scsi 0:0:5:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 10.281033] mpt3sas_cm0: detecting: handle(0x0018), sas_address(0x5000c500954d3c9d), phy(5) [ 10.289382] mpt3sas_cm0: REPORT_LUNS: handle(0x0018), retries(0) [ 10.309443] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0018), lun(0) [ 10.316732] scsi 0:0:6:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 10.325216] scsi 0:0:6:0: SSP: handle(0x0018), sas_addr(0x5000c500954d3c9d), phy(5), device_name(0x5000c500954d3c9c) [ 10.335727] scsi 0:0:6:0: enclosure logical id(0x5001636001a06d7d), slot(5) [ 10.342773] scsi 0:0:6:0: enclosure level(0x0000), connector name( C1 ) [ 10.349490] scsi 0:0:6:0: serial_number(ZA1ALXTG0000R8314UFV) [ 10.355237] scsi 0:0:6:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 10.378040] mpt3sas_cm0: detecting: handle(0x0019), sas_address(0x5000c5009537de21), phy(6) [ 10.386392] mpt3sas_cm0: REPORT_LUNS: handle(0x0019), retries(0) [ 10.399205] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0019), lun(0) [ 10.435522] scsi 0:0:7:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 10.443994] scsi 0:0:7:0: SSP: handle(0x0019), sas_addr(0x5000c5009537de21), phy(6), device_name(0x5000c5009537de20) [ 10.454505] scsi 0:0:7:0: enclosure logical id(0x5001636001a06d7d), slot(6) [ 10.461551] scsi 0:0:7:0: enclosure level(0x0000), connector name( C1 ) [ 10.468256] scsi 0:0:7:0: serial_number(ZA1ACKPT0000R828A04K) [ 10.474009] scsi 0:0:7:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 10.497028] mpt3sas_cm0: detecting: handle(0x001a), sas_address(0x5000c500954cd561), phy(7) [ 10.505376] mpt3sas_cm0: REPORT_LUNS: handle(0x001a), retries(0) [ 10.511932] mpt3sas_cm0: TEST_UNIT_READY: handle(0x001a), lun(0) [ 10.519056] scsi 0:0:8:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 10.527538] scsi 0:0:8:0: SSP: handle(0x001a), sas_addr(0x5000c500954cd561), phy(7), device_name(0x5000c500954cd560) [ 10.538054] scsi 0:0:8:0: enclosure logical id(0x5001636001a06d7d), slot(7) [ 10.545100] scsi 0:0:8:0: enclosure level(0x0000), connector name( C1 ) [ 10.551817] scsi 0:0:8:0: serial_number(ZA1ALGB20000R8314QNY) [ 10.557563] scsi 0:0:8:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 10.581039] mpt3sas_cm0: detecting: handle(0x001b), sas_address(0x5000c500954d2ed9), phy(8) [ 10.589391] mpt3sas_cm0: REPORT_LUNS: handle(0x001b), retries(0) [ 10.595954] mpt3sas_cm0: TEST_UNIT_READY: handle(0x001b), lun(0) [ 10.603112] scsi 0:0:9:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 10.611603] scsi 0:0:9:0: SSP: handle(0x001b), sas_addr(0x5000c500954d2ed9), phy(8), device_name(0x5000c500954d2ed8) [ 10.622113] scsi 0:0:9:0: enclosure logical id(0x5001636001a06d7d), slot(8) [ 10.629157] scsi 0:0:9:0: enclosure level(0x0000), connector name( C1 ) [ 10.635879] scsi 0:0:9:0: serial_number(ZA1ALV4P0000R830XC2X) [ 10.641625] scsi 0:0:9:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 10.675068] mpt3sas_cm0: detecting: handle(0x001c), sas_address(0x5000c50095430afd), phy(9) [ 10.683432] mpt3sas_cm0: REPORT_LUNS: handle(0x001c), retries(0) [ 10.713966] mpt3sas_cm0: TEST_UNIT_READY: handle(0x001c), lun(0) [ 10.721150] scsi 0:0:10:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 10.729722] scsi 0:0:10:0: SSP: handle(0x001c), sas_addr(0x5000c50095430afd), phy(9), device_name(0x5000c50095430afc) [ 10.740319] scsi 0:0:10:0: enclosure logical id(0x5001636001a06d7d), slot(9) [ 10.747451] scsi 0:0:10:0: enclosure level(0x0000), connector name( C1 ) [ 10.754256] scsi 0:0:10:0: serial_number(ZA1ABZKP0000R8301BVX) [ 10.760090] scsi 0:0:10:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 10.783039] mpt3sas_cm0: detecting: handle(0x001d), sas_address(0x5000c500954303f9), phy(10) [ 10.791474] mpt3sas_cm0: REPORT_LUNS: handle(0x001d), retries(0) [ 10.812514] mpt3sas_cm0: TEST_UNIT_READY: handle(0x001d), lun(0) [ 10.849297] scsi 0:0:11:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 10.857856] scsi 0:0:11:0: SSP: handle(0x001d), sas_addr(0x5000c500954303f9), phy(10), device_name(0x5000c500954303f8) [ 10.868544] scsi 0:0:11:0: enclosure logical id(0x5001636001a06d7d), slot(10) [ 10.875761] scsi 0:0:11:0: enclosure level(0x0000), connector name( C1 ) [ 10.882552] scsi 0:0:11:0: serial_number(ZA1AG8K80000C8316HBT) [ 10.888383] scsi 0:0:11:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 10.912030] mpt3sas_cm0: detecting: handle(0x001e), sas_address(0x5000c50095431ea5), phy(11) [ 10.920471] mpt3sas_cm0: REPORT_LUNS: handle(0x001e), retries(0) [ 10.932454] mpt3sas_cm0: TEST_UNIT_READY: handle(0x001e), lun(0) [ 10.939689] scsi 0:0:12:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 10.948256] scsi 0:0:12:0: SSP: handle(0x001e), sas_addr(0x5000c50095431ea5), phy(11), device_name(0x5000c50095431ea4) [ 10.958939] scsi 0:0:12:0: enclosure logical id(0x5001636001a06d7d), slot(11) [ 10.966157] scsi 0:0:12:0: enclosure level(0x0000), connector name( C1 ) [ 10.972964] scsi 0:0:12:0: serial_number(ZA1AGN3P0000R829D5A4) [ 10.978795] scsi 0:0:12:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 11.003030] mpt3sas_cm0: detecting: handle(0x001f), sas_address(0x5000c5009542c79d), phy(12) [ 11.011472] mpt3sas_cm0: REPORT_LUNS: handle(0x001f), retries(0) [ 11.023299] mpt3sas_cm0: TEST_UNIT_READY: handle(0x001f), lun(0) [ 11.030435] scsi 0:0:13:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 11.039010] scsi 0:0:13:0: SSP: handle(0x001f), sas_addr(0x5000c5009542c79d), phy(12), device_name(0x5000c5009542c79c) [ 11.049697] scsi 0:0:13:0: enclosure logical id(0x5001636001a06d7d), slot(12) [ 11.056914] scsi 0:0:13:0: enclosure level(0x0000), connector name( C1 ) [ 11.063720] scsi 0:0:13:0: serial_number(ZA1AGACY0000R8301U8F) [ 11.069555] scsi 0:0:13:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 11.093035] mpt3sas_cm0: detecting: handle(0x0020), sas_address(0x5000c50095431551), phy(13) [ 11.101476] mpt3sas_cm0: REPORT_LUNS: handle(0x0020), retries(0) [ 11.116038] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0020), lun(0) [ 11.123215] scsi 0:0:14:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 11.131790] scsi 0:0:14:0: SSP: handle(0x0020), sas_addr(0x5000c50095431551), phy(13), device_name(0x5000c50095431550) [ 11.142473] scsi 0:0:14:0: enclosure logical id(0x5001636001a06d7d), slot(13) [ 11.149692] scsi 0:0:14:0: enclosure level(0x0000), connector name( C1 ) [ 11.156499] scsi 0:0:14:0: serial_number(ZA1AFWDA0000C83153E9) [ 11.162332] scsi 0:0:14:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 11.185035] mpt3sas_cm0: detecting: handle(0x0021), sas_address(0x5000c5009543270d), phy(14) [ 11.193476] mpt3sas_cm0: REPORT_LUNS: handle(0x0021), retries(0) [ 11.215412] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0021), lun(0) [ 11.222589] scsi 0:0:15:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 11.231162] scsi 0:0:15:0: SSP: handle(0x0021), sas_addr(0x5000c5009543270d), phy(14), device_name(0x5000c5009543270c) [ 11.241847] scsi 0:0:15:0: enclosure logical id(0x5001636001a06d7d), slot(14) [ 11.249067] scsi 0:0:15:0: enclosure level(0x0000), connector name( C1 ) [ 11.255870] scsi 0:0:15:0: serial_number(ZA1AGGQF0000C83153PC) [ 11.261706] scsi 0:0:15:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 11.285038] mpt3sas_cm0: detecting: handle(0x0022), sas_address(0x5000c5009543269d), phy(15) [ 11.293481] mpt3sas_cm0: REPORT_LUNS: handle(0x0022), retries(0) [ 11.307693] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0022), lun(0) [ 11.314848] scsi 0:0:16:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 11.323421] scsi 0:0:16:0: SSP: handle(0x0022), sas_addr(0x5000c5009543269d), phy(15), device_name(0x5000c5009543269c) [ 11.334107] scsi 0:0:16:0: enclosure logical id(0x5001636001a06d7d), slot(15) [ 11.341325] scsi 0:0:16:0: enclosure level(0x0000), connector name( C1 ) [ 11.348131] scsi 0:0:16:0: serial_number(ZA1AGGVJ0000R829CUL1) [ 11.353964] scsi 0:0:16:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 11.377036] mpt3sas_cm0: detecting: handle(0x0023), sas_address(0x5000c500954306f9), phy(16) [ 11.385472] mpt3sas_cm0: REPORT_LUNS: handle(0x0023), retries(0) [ 11.391931] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0023), lun(0) [ 11.399077] scsi 0:0:17:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 11.407656] scsi 0:0:17:0: SSP: handle(0x0023), sas_addr(0x5000c500954306f9), phy(16), device_name(0x5000c500954306f8) [ 11.418347] scsi 0:0:17:0: enclosure logical id(0x5001636001a06d7d), slot(16) [ 11.425565] scsi 0:0:17:0: enclosure level(0x0000), connector name( C1 ) [ 11.432373] scsi 0:0:17:0: serial_number(ZA1AG8GS0000R8301BGG) [ 11.438203] scsi 0:0:17:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 11.461038] mpt3sas_cm0: detecting: handle(0x0024), sas_address(0x5000c500954d3a85), phy(17) [ 11.469478] mpt3sas_cm0: REPORT_LUNS: handle(0x0024), retries(0) [ 11.475962] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0024), lun(0) [ 11.483123] scsi 0:0:18:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 11.491700] scsi 0:0:18:0: SSP: handle(0x0024), sas_addr(0x5000c500954d3a85), phy(17), device_name(0x5000c500954d3a84) [ 11.502388] scsi 0:0:18:0: enclosure logical id(0x5001636001a06d7d), slot(17) [ 11.509608] scsi 0:0:18:0: enclosure level(0x0000), connector name( C1 ) [ 11.516416] scsi 0:0:18:0: serial_number(ZA1ALTNS0000R8314U9A) [ 11.522254] scsi 0:0:18:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 11.554503] mpt3sas_cm0: detecting: handle(0x0025), sas_address(0x5000c500954d9729), phy(18) [ 11.562962] mpt3sas_cm0: REPORT_LUNS: handle(0x0025), retries(0) [ 11.584457] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0025), lun(0) [ 11.591732] scsi 0:0:19:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 11.600310] scsi 0:0:19:0: SSP: handle(0x0025), sas_addr(0x5000c500954d9729), phy(18), device_name(0x5000c500954d9728) [ 11.611001] scsi 0:0:19:0: enclosure logical id(0x5001636001a06d7d), slot(18) [ 11.618218] scsi 0:0:19:0: enclosure level(0x0000), connector name( C1 ) [ 11.625025] scsi 0:0:19:0: serial_number(ZA1AM3T00000R8314URZ) [ 11.630858] scsi 0:0:19:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 11.655042] mpt3sas_cm0: detecting: handle(0x0026), sas_address(0x5000c5009543190d), phy(19) [ 11.663483] mpt3sas_cm0: REPORT_LUNS: handle(0x0026), retries(0) [ 11.681779] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0026), lun(0) [ 11.721067] scsi 0:0:20:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 11.729628] scsi 0:0:20:0: SSP: handle(0x0026), sas_addr(0x5000c5009543190d), phy(19), device_name(0x5000c5009543190c) [ 11.740316] scsi 0:0:20:0: enclosure logical id(0x5001636001a06d7d), slot(19) [ 11.747536] scsi 0:0:20:0: enclosure level(0x0000), connector name( C1 ) [ 11.754327] scsi 0:0:20:0: serial_number(ZA1AFH3W0000C8316GJ6) [ 11.760158] scsi 0:0:20:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 11.784036] mpt3sas_cm0: detecting: handle(0x0027), sas_address(0x5000c500954325c1), phy(20) [ 11.792469] mpt3sas_cm0: REPORT_LUNS: handle(0x0027), retries(0) [ 11.798938] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0027), lun(0) [ 11.828270] scsi 0:0:21:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 11.836853] scsi 0:0:21:0: SSP: handle(0x0027), sas_addr(0x5000c500954325c1), phy(20), device_name(0x5000c500954325c0) [ 11.847541] scsi 0:0:21:0: enclosure logical id(0x5001636001a06d7d), slot(20) [ 11.854763] scsi 0:0:21:0: enclosure level(0x0000), connector name( C1 ) [ 11.861552] scsi 0:0:21:0: serial_number(ZA1AGGV20000R829CG7B) [ 11.867384] scsi 0:0:21:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 11.891035] mpt3sas_cm0: detecting: handle(0x0028), sas_address(0x5000c50095431ef5), phy(21) [ 11.899470] mpt3sas_cm0: REPORT_LUNS: handle(0x0028), retries(0) [ 11.905959] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0028), lun(0) [ 11.913129] scsi 0:0:22:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 11.921709] scsi 0:0:22:0: SSP: handle(0x0028), sas_addr(0x5000c50095431ef5), phy(21), device_name(0x5000c50095431ef4) [ 11.932398] scsi 0:0:22:0: enclosure logical id(0x5001636001a06d7d), slot(21) [ 11.939617] scsi 0:0:22:0: enclosure level(0x0000), connector name( C1 ) [ 11.946424] scsi 0:0:22:0: serial_number(ZA1AGH4R0000C72541L0) [ 11.952255] scsi 0:0:22:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 11.975627] mpt3sas_cm0: detecting: handle(0x0029), sas_address(0x5000c500954328c1), phy(22) [ 11.984066] mpt3sas_cm0: REPORT_LUNS: handle(0x0029), retries(0) [ 11.990632] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0029), lun(0) [ 12.033091] scsi 0:0:23:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 12.041651] scsi 0:0:23:0: SSP: handle(0x0029), sas_addr(0x5000c500954328c1), phy(22), device_name(0x5000c500954328c0) [ 12.052338] scsi 0:0:23:0: enclosure logical id(0x5001636001a06d7d), slot(22) [ 12.059558] scsi 0:0:23:0: enclosure level(0x0000), connector name( C1 ) [ 12.066347] scsi 0:0:23:0: serial_number(ZA1AGGMS0000C8316FAT) [ 12.072179] scsi 0:0:23:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 12.095041] mpt3sas_cm0: detecting: handle(0x002a), sas_address(0x5000c50095431c8d), phy(23) [ 12.103477] mpt3sas_cm0: REPORT_LUNS: handle(0x002a), retries(0) [ 12.118641] mpt3sas_cm0: TEST_UNIT_READY: handle(0x002a), lun(0) [ 12.125778] scsi 0:0:24:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 12.134352] scsi 0:0:24:0: SSP: handle(0x002a), sas_addr(0x5000c50095431c8d), phy(23), device_name(0x5000c50095431c8c) [ 12.145039] scsi 0:0:24:0: enclosure logical id(0x5001636001a06d7d), slot(23) [ 12.152258] scsi 0:0:24:0: enclosure level(0x0000), connector name( C1 ) [ 12.159064] scsi 0:0:24:0: serial_number(ZA1AGH310000R727Y825) [ 12.164897] scsi 0:0:24:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 12.188043] mpt3sas_cm0: detecting: handle(0x002b), sas_address(0x5000c50095430e75), phy(24) [ 12.196480] mpt3sas_cm0: REPORT_LUNS: handle(0x002b), retries(0) [ 12.214967] mpt3sas_cm0: TEST_UNIT_READY: handle(0x002b), lun(0) [ 12.222152] scsi 0:0:25:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 12.230736] scsi 0:0:25:0: SSP: handle(0x002b), sas_addr(0x5000c50095430e75), phy(24), device_name(0x5000c50095430e74) [ 12.241421] scsi 0:0:25:0: enclosure logical id(0x5001636001a06d7d), slot(24) [ 12.248640] scsi 0:0:25:0: enclosure level(0x0000), connector name( C1 ) [ 12.255447] scsi 0:0:25:0: serial_number(ZA1AGHKG0000R829D7P9) [ 12.261279] scsi 0:0:25:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 12.284046] mpt3sas_cm0: detecting: handle(0x002c), sas_address(0x5000c500954cec31), phy(25) [ 12.292483] mpt3sas_cm0: REPORT_LUNS: handle(0x002c), retries(0) [ 12.303726] mpt3sas_cm0: TEST_UNIT_READY: handle(0x002c), lun(0) [ 12.310885] scsi 0:0:26:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 12.319465] scsi 0:0:26:0: SSP: handle(0x002c), sas_addr(0x5000c500954cec31), phy(25), device_name(0x5000c500954cec30) [ 12.330151] scsi 0:0:26:0: enclosure logical id(0x5001636001a06d7d), slot(25) [ 12.337371] scsi 0:0:26:0: enclosure level(0x0000), connector name( C1 ) [ 12.344180] scsi 0:0:26:0: serial_number(ZA1ALFQC0000R8314S0C) [ 12.350020] scsi 0:0:26:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 12.374038] mpt3sas_cm0: detecting: handle(0x002d), sas_address(0x5000c500954d2d0d), phy(26) [ 12.382479] mpt3sas_cm0: REPORT_LUNS: handle(0x002d), retries(0) [ 12.400768] mpt3sas_cm0: TEST_UNIT_READY: handle(0x002d), lun(0) [ 12.407898] scsi 0:0:27:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 12.416475] scsi 0:0:27:0: SSP: handle(0x002d), sas_addr(0x5000c500954d2d0d), phy(26), device_name(0x5000c500954d2d0c) [ 12.427160] scsi 0:0:27:0: enclosure logical id(0x5001636001a06d7d), slot(26) [ 12.434378] scsi 0:0:27:0: enclosure level(0x0000), connector name( C1 ) [ 12.441187] scsi 0:0:27:0: serial_number(ZA1ALV770000R8314TF5) [ 12.447026] scsi 0:0:27:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 12.470048] mpt3sas_cm0: detecting: handle(0x002e), sas_address(0x5000c500954de6bd), phy(27) [ 12.478491] mpt3sas_cm0: REPORT_LUNS: handle(0x002e), retries(0) [ 12.485031] mpt3sas_cm0: TEST_UNIT_READY: handle(0x002e), lun(0) [ 12.492159] scsi 0:0:28:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 12.500730] scsi 0:0:28:0: SSP: handle(0x002e), sas_addr(0x5000c500954de6bd), phy(27), device_name(0x5000c500954de6bc) [ 12.511417] scsi 0:0:28:0: enclosure logical id(0x5001636001a06d7d), slot(27) [ 12.518637] scsi 0:0:28:0: enclosure level(0x0000), connector name( C1 ) [ 12.525443] scsi 0:0:28:0: serial_number(ZA1AM5MM0000R8317PAM) [ 12.531274] scsi 0:0:28:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 12.556046] mpt3sas_cm0: detecting: handle(0x002f), sas_address(0x5000c500954321cd), phy(28) [ 12.564480] mpt3sas_cm0: REPORT_LUNS: handle(0x002f), retries(0) [ 12.575832] mpt3sas_cm0: TEST_UNIT_READY: handle(0x002f), lun(0) [ 12.595854] scsi 0:0:29:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 12.611568] scsi 0:0:29:0: SSP: handle(0x002f), sas_addr(0x5000c500954321cd), phy(28), device_name(0x5000c500954321cc) [ 12.622257] scsi 0:0:29:0: enclosure logical id(0x5001636001a06d7d), slot(28) [ 12.629475] scsi 0:0:29:0: enclosure level(0x0000), connector name( C1 ) [ 12.636282] scsi 0:0:29:0: serial_number(ZA1AGN0J0000R8288A2R) [ 12.642116] scsi 0:0:29:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 12.665053] mpt3sas_cm0: detecting: handle(0x0030), sas_address(0x5000c5009542a60d), phy(29) [ 12.673492] mpt3sas_cm0: REPORT_LUNS: handle(0x0030), retries(0) [ 12.679982] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0030), lun(0) [ 12.687150] scsi 0:0:30:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 12.695728] scsi 0:0:30:0: SSP: handle(0x0030), sas_addr(0x5000c5009542a60d), phy(29), device_name(0x5000c5009542a60c) [ 12.706412] scsi 0:0:30:0: enclosure logical id(0x5001636001a06d7d), slot(29) [ 12.713631] scsi 0:0:30:0: enclosure level(0x0000), connector name( C1 ) [ 12.720435] scsi 0:0:30:0: serial_number(ZA1AG6DF0000R829CG6J) [ 12.726269] scsi 0:0:30:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 12.749057] mpt3sas_cm0: detecting: handle(0x0031), sas_address(0x5000c50095432269), phy(30) [ 12.757497] mpt3sas_cm0: REPORT_LUNS: handle(0x0031), retries(0) [ 12.768769] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0031), lun(0) [ 12.775903] scsi 0:0:31:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 12.784477] scsi 0:0:31:0: SSP: handle(0x0031), sas_addr(0x5000c50095432269), phy(30), device_name(0x5000c50095432268) [ 12.795160] scsi 0:0:31:0: enclosure logical id(0x5001636001a06d7d), slot(30) [ 12.802378] scsi 0:0:31:0: enclosure level(0x0000), connector name( C1 ) [ 12.809186] scsi 0:0:31:0: serial_number(ZA1AGGXE0000R735TYMG) [ 12.815017] scsi 0:0:31:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 12.838045] mpt3sas_cm0: detecting: handle(0x0032), sas_address(0x5000c500953816ed), phy(31) [ 12.846484] mpt3sas_cm0: REPORT_LUNS: handle(0x0032), retries(0) [ 12.866107] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0032), lun(0) [ 12.873257] scsi 0:0:32:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 12.881833] scsi 0:0:32:0: SSP: handle(0x0032), sas_addr(0x5000c500953816ed), phy(31), device_name(0x5000c500953816ec) [ 12.892522] scsi 0:0:32:0: enclosure logical id(0x5001636001a06d7d), slot(31) [ 12.899742] scsi 0:0:32:0: enclosure level(0x0000), connector name( C1 ) [ 12.906548] scsi 0:0:32:0: serial_number(ZA1ACHTF0000R82892CY) [ 12.912380] scsi 0:0:32:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 12.937049] mpt3sas_cm0: detecting: handle(0x0033), sas_address(0x5000c500954321a5), phy(32) [ 12.945490] mpt3sas_cm0: REPORT_LUNS: handle(0x0033), retries(0) [ 12.957684] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0033), lun(0) [ 12.996441] scsi 0:0:33:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 13.005020] scsi 0:0:33:0: SSP: handle(0x0033), sas_addr(0x5000c500954321a5), phy(32), device_name(0x5000c500954321a4) [ 13.015703] scsi 0:0:33:0: enclosure logical id(0x5001636001a06d7d), slot(32) [ 13.022921] scsi 0:0:33:0: enclosure level(0x0000), connector name( C1 ) [ 13.029728] scsi 0:0:33:0: serial_number(ZA1AGGY00000C724RWTP) [ 13.035560] scsi 0:0:33:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 13.059050] mpt3sas_cm0: detecting: handle(0x0034), sas_address(0x5000c5009538bc35), phy(33) [ 13.067493] mpt3sas_cm0: REPORT_LUNS: handle(0x0034), retries(0) [ 13.073971] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0034), lun(0) [ 13.081134] scsi 0:0:34:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 13.089712] scsi 0:0:34:0: SSP: handle(0x0034), sas_addr(0x5000c5009538bc35), phy(33), device_name(0x5000c5009538bc34) [ 13.100394] scsi 0:0:34:0: enclosure logical id(0x5001636001a06d7d), slot(33) [ 13.107613] scsi 0:0:34:0: enclosure level(0x0000), connector name( C1 ) [ 13.114419] scsi 0:0:34:0: serial_number(ZA1A9XY50000R8289594) [ 13.120251] scsi 0:0:34:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 13.146055] mpt3sas_cm0: detecting: handle(0x0035), sas_address(0x5000c500954325d5), phy(34) [ 13.154487] mpt3sas_cm0: REPORT_LUNS: handle(0x0035), retries(0) [ 13.175483] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0035), lun(0) [ 13.182642] scsi 0:0:35:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 13.191217] scsi 0:0:35:0: SSP: handle(0x0035), sas_addr(0x5000c500954325d5), phy(34), device_name(0x5000c500954325d4) [ 13.201900] scsi 0:0:35:0: enclosure logical id(0x5001636001a06d7d), slot(34) [ 13.209118] scsi 0:0:35:0: enclosure level(0x0000), connector name( C1 ) [ 13.215922] scsi 0:0:35:0: serial_number(ZA1AGGSE0000R829CGBW) [ 13.221757] scsi 0:0:35:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 13.247052] mpt3sas_cm0: detecting: handle(0x0036), sas_address(0x5000c50095430221), phy(35) [ 13.255493] mpt3sas_cm0: REPORT_LUNS: handle(0x0036), retries(0) [ 13.274535] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0036), lun(0) [ 13.281746] scsi 0:0:36:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 13.290319] scsi 0:0:36:0: SSP: handle(0x0036), sas_addr(0x5000c50095430221), phy(35), device_name(0x5000c50095430220) [ 13.301003] scsi 0:0:36:0: enclosure logical id(0x5001636001a06d7d), slot(35) [ 13.308222] scsi 0:0:36:0: enclosure level(0x0000), connector name( C1 ) [ 13.315031] scsi 0:0:36:0: serial_number(ZA1AG8NE0000C8316HG9) [ 13.320862] scsi 0:0:36:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 13.345053] mpt3sas_cm0: detecting: handle(0x0037), sas_address(0x5000c500953ad691), phy(36) [ 13.353496] mpt3sas_cm0: REPORT_LUNS: handle(0x0037), retries(0) [ 13.374505] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0037), lun(0) [ 13.381661] scsi 0:0:37:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 13.390236] scsi 0:0:37:0: SSP: handle(0x0037), sas_addr(0x5000c500953ad691), phy(36), device_name(0x5000c500953ad690) [ 13.400924] scsi 0:0:37:0: enclosure logical id(0x5001636001a06d7d), slot(36) [ 13.408141] scsi 0:0:37:0: enclosure level(0x0000), connector name( C1 ) [ 13.414947] scsi 0:0:37:0: serial_number(ZA1ADPEX0000R8301P5K) [ 13.420781] scsi 0:0:37:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 13.444050] mpt3sas_cm0: detecting: handle(0x0038), sas_address(0x5000c500953ad5b5), phy(37) [ 13.452489] mpt3sas_cm0: REPORT_LUNS: handle(0x0038), retries(0) [ 13.472574] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0038), lun(0) [ 13.479750] scsi 0:0:38:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 13.488325] scsi 0:0:38:0: SSP: handle(0x0038), sas_addr(0x5000c500953ad5b5), phy(37), device_name(0x5000c500953ad5b4) [ 13.499015] scsi 0:0:38:0: enclosure logical id(0x5001636001a06d7d), slot(37) [ 13.506232] scsi 0:0:38:0: enclosure level(0x0000), connector name( C1 ) [ 13.513040] scsi 0:0:38:0: serial_number(ZA1ADPDH0000R83027NK) [ 13.518872] scsi 0:0:38:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 13.543053] mpt3sas_cm0: detecting: handle(0x0039), sas_address(0x5000c50095431bf1), phy(38) [ 13.551489] mpt3sas_cm0: REPORT_LUNS: handle(0x0039), retries(0) [ 13.572457] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0039), lun(0) [ 13.579605] scsi 0:0:39:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 13.588175] scsi 0:0:39:0: SSP: handle(0x0039), sas_addr(0x5000c50095431bf1), phy(38), device_name(0x5000c50095431bf0) [ 13.598865] scsi 0:0:39:0: enclosure logical id(0x5001636001a06d7d), slot(38) [ 13.606083] scsi 0:0:39:0: enclosure level(0x0000), connector name( C1 ) [ 13.612886] scsi 0:0:39:0: serial_number(ZA1AGH5T0000R8300NS1) [ 13.618722] scsi 0:0:39:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 13.642053] mpt3sas_cm0: detecting: handle(0x003a), sas_address(0x5000c50095430edd), phy(39) [ 13.650489] mpt3sas_cm0: REPORT_LUNS: handle(0x003a), retries(0) [ 13.672564] mpt3sas_cm0: TEST_UNIT_READY: handle(0x003a), lun(0) [ 13.679718] scsi 0:0:40:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 13.688288] scsi 0:0:40:0: SSP: handle(0x003a), sas_addr(0x5000c50095430edd), phy(39), device_name(0x5000c50095430edc) [ 13.698975] scsi 0:0:40:0: enclosure logical id(0x5001636001a06d7d), slot(39) [ 13.706194] scsi 0:0:40:0: enclosure level(0x0000), connector name( C1 ) [ 13.712997] scsi 0:0:40:0: serial_number(ZA1AGHK20000R829D817) [ 13.718833] scsi 0:0:40:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 13.742052] mpt3sas_cm0: detecting: handle(0x003b), sas_address(0x5000c50095430769), phy(40) [ 13.750485] mpt3sas_cm0: REPORT_LUNS: handle(0x003b), retries(0) [ 13.767775] mpt3sas_cm0: TEST_UNIT_READY: handle(0x003b), lun(0) [ 13.774927] scsi 0:0:41:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 13.783505] scsi 0:0:41:0: SSP: handle(0x003b), sas_addr(0x5000c50095430769), phy(40), device_name(0x5000c50095430768) [ 13.794186] scsi 0:0:41:0: enclosure logical id(0x5001636001a06d7d), slot(40) [ 13.801406] scsi 0:0:41:0: enclosure level(0x0000), connector name( C1 ) [ 13.808215] scsi 0:0:41:0: serial_number(ZA1AG3EV0000R82513S7) [ 13.814054] scsi 0:0:41:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 13.839057] mpt3sas_cm0: detecting: handle(0x003c), sas_address(0x5000c50095431f31), phy(41) [ 13.847493] mpt3sas_cm0: REPORT_LUNS: handle(0x003c), retries(0) [ 13.866778] mpt3sas_cm0: TEST_UNIT_READY: handle(0x003c), lun(0) [ 13.873969] scsi 0:0:42:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 13.882546] scsi 0:0:42:0: SSP: handle(0x003c), sas_addr(0x5000c50095431f31), phy(41), device_name(0x5000c50095431f30) [ 13.893232] scsi 0:0:42:0: enclosure logical id(0x5001636001a06d7d), slot(41) [ 13.900450] scsi 0:0:42:0: enclosure level(0x0000), connector name( C1 ) [ 13.907257] scsi 0:0:42:0: serial_number(ZA1AGH0L0000C8316HPB) [ 13.913090] scsi 0:0:42:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 13.937057] mpt3sas_cm0: detecting: handle(0x003d), sas_address(0x5000c500954319a5), phy(42) [ 13.945497] mpt3sas_cm0: REPORT_LUNS: handle(0x003d), retries(0) [ 13.963268] mpt3sas_cm0: TEST_UNIT_READY: handle(0x003d), lun(0) [ 13.970422] scsi 0:0:43:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 13.978999] scsi 0:0:43:0: SSP: handle(0x003d), sas_addr(0x5000c500954319a5), phy(42), device_name(0x5000c500954319a4) [ 13.989684] scsi 0:0:43:0: enclosure logical id(0x5001636001a06d7d), slot(42) [ 13.996903] scsi 0:0:43:0: enclosure level(0x0000), connector name( C1 ) [ 14.003709] scsi 0:0:43:0: serial_number(ZA1AB9SF0000C8316GFV) [ 14.009542] scsi 0:0:43:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 14.034059] mpt3sas_cm0: detecting: handle(0x003e), sas_address(0x5000c500954329bd), phy(43) [ 14.042495] mpt3sas_cm0: REPORT_LUNS: handle(0x003e), retries(0) [ 14.057637] mpt3sas_cm0: TEST_UNIT_READY: handle(0x003e), lun(0) [ 14.064773] scsi 0:0:44:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 14.073349] scsi 0:0:44:0: SSP: handle(0x003e), sas_addr(0x5000c500954329bd), phy(43), device_name(0x5000c500954329bc) [ 14.084037] scsi 0:0:44:0: enclosure logical id(0x5001636001a06d7d), slot(43) [ 14.091257] scsi 0:0:44:0: enclosure level(0x0000), connector name( C1 ) [ 14.098064] scsi 0:0:44:0: serial_number(ZA1AGGLY0000R829CFMV) [ 14.103897] scsi 0:0:44:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 14.127644] mpt3sas_cm0: detecting: handle(0x003f), sas_address(0x5000c50095432b19), phy(44) [ 14.136082] mpt3sas_cm0: REPORT_LUNS: handle(0x003f), retries(0) [ 14.153408] mpt3sas_cm0: TEST_UNIT_READY: handle(0x003f), lun(0) [ 14.160575] scsi 0:0:45:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 14.169149] scsi 0:0:45:0: SSP: handle(0x003f), sas_addr(0x5000c50095432b19), phy(44), device_name(0x5000c50095432b18) [ 14.179832] scsi 0:0:45:0: enclosure logical id(0x5001636001a06d7d), slot(44) [ 14.187051] scsi 0:0:45:0: enclosure level(0x0000), connector name( C1 ) [ 14.193859] scsi 0:0:45:0: serial_number(ZA1AGGJK0000C8315317) [ 14.199690] scsi 0:0:45:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 14.228062] mpt3sas_cm0: detecting: handle(0x0040), sas_address(0x5000c500954327a9), phy(45) [ 14.236501] mpt3sas_cm0: REPORT_LUNS: handle(0x0040), retries(0) [ 14.257675] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0040), lun(0) [ 14.264834] scsi 0:0:46:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 14.273409] scsi 0:0:46:0: SSP: handle(0x0040), sas_addr(0x5000c500954327a9), phy(45), device_name(0x0000000000000000) [ 14.284094] scsi 0:0:46:0: enclosure logical id(0x5001636001a06d7d), slot(45) [ 14.291313] scsi 0:0:46:0: enclosure level(0x0000), connector name( C1 ) [ 14.298117] scsi 0:0:46:0: serial_number(ZA1AGGPV0000C83153P7) [ 14.303952] scsi 0:0:46:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 14.327057] mpt3sas_cm0: detecting: handle(0x0041), sas_address(0x5000c50095432299), phy(46) [ 14.335492] mpt3sas_cm0: REPORT_LUNS: handle(0x0041), retries(0) [ 14.355164] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0041), lun(0) [ 14.389492] scsi 0:0:47:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 14.398049] scsi 0:0:47:0: SSP: handle(0x0041), sas_addr(0x5000c50095432299), phy(46), device_name(0x5000c50095432298) [ 14.408731] scsi 0:0:47:0: enclosure logical id(0x5001636001a06d7d), slot(46) [ 14.415950] scsi 0:0:47:0: enclosure level(0x0000), connector name( C1 ) [ 14.422741] scsi 0:0:47:0: serial_number(ZA1AGGXB0000R704G6EZ) [ 14.428573] scsi 0:0:47:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 14.453062] mpt3sas_cm0: detecting: handle(0x0042), sas_address(0x5000c500954328f9), phy(47) [ 14.461501] mpt3sas_cm0: REPORT_LUNS: handle(0x0042), retries(0) [ 14.478309] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0042), lun(0) [ 14.485404] scsi 0:0:48:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 14.493982] scsi 0:0:48:0: SSP: handle(0x0042), sas_addr(0x5000c500954328f9), phy(47), device_name(0x5000c500954328f8) [ 14.504664] scsi 0:0:48:0: enclosure logical id(0x5001636001a06d7d), slot(47) [ 14.511883] scsi 0:0:48:0: enclosure level(0x0000), connector name( C1 ) [ 14.518688] scsi 0:0:48:0: serial_number(ZA1AGGMK0000R83026KX) [ 14.524521] scsi 0:0:48:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 14.551065] mpt3sas_cm0: detecting: handle(0x0043), sas_address(0x5000c500954cfc85), phy(48) [ 14.559510] mpt3sas_cm0: REPORT_LUNS: handle(0x0043), retries(0) [ 14.566013] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0043), lun(0) [ 14.573125] scsi 0:0:49:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 14.581695] scsi 0:0:49:0: SSP: handle(0x0043), sas_addr(0x5000c500954cfc85), phy(48), device_name(0x5000c500954cfc84) [ 14.592381] scsi 0:0:49:0: enclosure logical id(0x5001636001a06d7d), slot(48) [ 14.599600] scsi 0:0:49:0: enclosure level(0x0000), connector name( C1 ) [ 14.606404] scsi 0:0:49:0: serial_number(ZA1ALFE50000R830288F) [ 14.612239] scsi 0:0:49:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 14.638051] mpt3sas_cm0: detecting: handle(0x0044), sas_address(0x5000c500954d361d), phy(49) [ 14.646507] mpt3sas_cm0: REPORT_LUNS: handle(0x0044), retries(0) [ 14.652979] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0044), lun(0) [ 14.660086] scsi 0:0:50:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 14.668658] scsi 0:0:50:0: SSP: handle(0x0044), sas_addr(0x5000c500954d361d), phy(49), device_name(0x5000c500954d361c) [ 14.679342] scsi 0:0:50:0: enclosure logical id(0x5001636001a06d7d), slot(49) [ 14.686561] scsi 0:0:50:0: enclosure level(0x0000), connector name( C1 ) [ 14.693367] scsi 0:0:50:0: serial_number(ZA1ALTVB0000R8314VBJ) [ 14.699200] scsi 0:0:50:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 14.723064] mpt3sas_cm0: detecting: handle(0x0045), sas_address(0x5000c500954cb9b9), phy(50) [ 14.731504] mpt3sas_cm0: REPORT_LUNS: handle(0x0045), retries(0) [ 14.742643] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0045), lun(0) [ 14.749718] scsi 0:0:51:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 14.758286] scsi 0:0:51:0: SSP: handle(0x0045), sas_addr(0x5000c500954cb9b9), phy(50), device_name(0x5000c500954cb9b8) [ 14.768974] scsi 0:0:51:0: enclosure logical id(0x5001636001a06d7d), slot(50) [ 14.776194] scsi 0:0:51:0: enclosure level(0x0000), connector name( C1 ) [ 14.782999] scsi 0:0:51:0: serial_number(ZA1ALH520000C8326DUN) [ 14.788832] scsi 0:0:51:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 14.812058] mpt3sas_cm0: detecting: handle(0x0046), sas_address(0x5000c500954ce225), phy(51) [ 14.820495] mpt3sas_cm0: REPORT_LUNS: handle(0x0046), retries(0) [ 14.838045] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0046), lun(0) [ 14.877954] scsi 0:0:52:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 14.886508] scsi 0:0:52:0: SSP: handle(0x0046), sas_addr(0x5000c500954ce225), phy(51), device_name(0x5000c500954ce224) [ 14.897190] scsi 0:0:52:0: enclosure logical id(0x5001636001a06d7d), slot(51) [ 14.904409] scsi 0:0:52:0: enclosure level(0x0000), connector name( C1 ) [ 14.911202] scsi 0:0:52:0: serial_number(ZA1ALFZF0000C83198RH) [ 14.917039] scsi 0:0:52:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 14.940067] mpt3sas_cm0: detecting: handle(0x0047), sas_address(0x5000c500954d03f9), phy(52) [ 14.948502] mpt3sas_cm0: REPORT_LUNS: handle(0x0047), retries(0) [ 14.966503] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0047), lun(0) [ 14.985077] scsi 0:0:53:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 15.009173] scsi 0:0:53:0: SSP: handle(0x0047), sas_addr(0x5000c500954d03f9), phy(52), device_name(0x5000c500954d03f8) [ 15.019861] scsi 0:0:53:0: enclosure logical id(0x5001636001a06d7d), slot(52) [ 15.027078] scsi 0:0:53:0: enclosure level(0x0000), connector name( C1 ) [ 15.033886] scsi 0:0:53:0: serial_number(ZA1ALF8W0000R8314REA) [ 15.039719] scsi 0:0:53:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 15.063064] mpt3sas_cm0: detecting: handle(0x0048), sas_address(0x5000c500954d0481), phy(53) [ 15.071502] mpt3sas_cm0: REPORT_LUNS: handle(0x0048), retries(0) [ 15.077982] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0048), lun(0) [ 15.085082] scsi 0:0:54:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 15.093657] scsi 0:0:54:0: SSP: handle(0x0048), sas_addr(0x5000c500954d0481), phy(53), device_name(0x5000c500954d0480) [ 15.104343] scsi 0:0:54:0: enclosure logical id(0x5001636001a06d7d), slot(53) [ 15.111562] scsi 0:0:54:0: enclosure level(0x0000), connector name( C1 ) [ 15.118367] scsi 0:0:54:0: serial_number(ZA1ALF8F0000R8314T49) [ 15.124201] scsi 0:0:54:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 15.148063] mpt3sas_cm0: detecting: handle(0x0049), sas_address(0x5000c500954de805), phy(54) [ 15.156497] mpt3sas_cm0: REPORT_LUNS: handle(0x0049), retries(0) [ 15.175139] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0049), lun(0) [ 15.182248] scsi 0:0:55:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 15.190822] scsi 0:0:55:0: SSP: handle(0x0049), sas_addr(0x5000c500954de805), phy(54), device_name(0x5000c500954de804) [ 15.201507] scsi 0:0:55:0: enclosure logical id(0x5001636001a06d7d), slot(54) [ 15.208726] scsi 0:0:55:0: enclosure level(0x0000), connector name( C1 ) [ 15.215532] scsi 0:0:55:0: serial_number(ZA1AM5L80000R8317PC6) [ 15.221365] scsi 0:0:55:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 15.244069] mpt3sas_cm0: detecting: handle(0x004a), sas_address(0x5000c500954e0321), phy(55) [ 15.252509] mpt3sas_cm0: REPORT_LUNS: handle(0x004a), retries(0) [ 15.264136] mpt3sas_cm0: TEST_UNIT_READY: handle(0x004a), lun(0) [ 15.305104] scsi 0:0:56:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 15.313661] scsi 0:0:56:0: SSP: handle(0x004a), sas_addr(0x5000c500954e0321), phy(55), device_name(0x5000c500954e0320) [ 15.324351] scsi 0:0:56:0: enclosure logical id(0x5001636001a06d7d), slot(55) [ 15.331569] scsi 0:0:56:0: enclosure level(0x0000), connector name( C1 ) [ 15.338361] scsi 0:0:56:0: serial_number(ZA1AM1Z30000R8317REB) [ 15.344199] scsi 0:0:56:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 15.369065] mpt3sas_cm0: detecting: handle(0x004b), sas_address(0x5000c500954d3865), phy(56) [ 15.377501] mpt3sas_cm0: REPORT_LUNS: handle(0x004b), retries(0) [ 15.395627] mpt3sas_cm0: TEST_UNIT_READY: handle(0x004b), lun(0) [ 15.412880] scsi 0:0:57:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 15.421445] scsi 0:0:57:0: SSP: handle(0x004b), sas_addr(0x5000c500954d3865), phy(56), device_name(0x5000c500954d3864) [ 15.432128] scsi 0:0:57:0: enclosure logical id(0x5001636001a06d7d), slot(56) [ 15.439350] scsi 0:0:57:0: enclosure level(0x0000), connector name( C1 ) [ 15.446140] scsi 0:0:57:0: serial_number(ZA1ALTQH0000R8303HV0) [ 15.451970] scsi 0:0:57:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 15.475071] mpt3sas_cm0: detecting: handle(0x004c), sas_address(0x5000c500954d8791), phy(57) [ 15.483514] mpt3sas_cm0: REPORT_LUNS: handle(0x004c), retries(0) [ 15.489995] mpt3sas_cm0: TEST_UNIT_READY: handle(0x004c), lun(0) [ 15.497095] scsi 0:0:58:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 15.505667] scsi 0:0:58:0: SSP: handle(0x004c), sas_addr(0x5000c500954d8791), phy(57), device_name(0x5000c500954d8790) [ 15.516353] scsi 0:0:58:0: enclosure logical id(0x5001636001a06d7d), slot(57) [ 15.523573] scsi 0:0:58:0: enclosure level(0x0000), connector name( C1 ) [ 15.530382] scsi 0:0:58:0: serial_number(ZA1AM40E0000R8301CKS) [ 15.536223] scsi 0:0:58:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 15.562076] mpt3sas_cm0: detecting: handle(0x004d), sas_address(0x5000c500954d3d6d), phy(58) [ 15.570517] mpt3sas_cm0: REPORT_LUNS: handle(0x004d), retries(0) [ 15.585165] mpt3sas_cm0: TEST_UNIT_READY: handle(0x004d), lun(0) [ 15.592247] scsi 0:0:59:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 15.600823] scsi 0:0:59:0: SSP: handle(0x004d), sas_addr(0x5000c500954d3d6d), phy(58), device_name(0x5000c500954d3d6c) [ 15.611507] scsi 0:0:59:0: enclosure logical id(0x5001636001a06d7d), slot(58) [ 15.618724] scsi 0:0:59:0: enclosure level(0x0000), connector name( C1 ) [ 15.625545] scsi 0:0:59:0: serial_number(ZA1ALTKA0000R8302V05) [ 15.631383] scsi 0:0:59:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 15.655082] mpt3sas_cm0: detecting: handle(0x004e), sas_address(0x5000c500954d33c9), phy(59) [ 15.663521] mpt3sas_cm0: REPORT_LUNS: handle(0x004e), retries(0) [ 15.677627] mpt3sas_cm0: TEST_UNIT_READY: handle(0x004e), lun(0) [ 15.684713] scsi 0:0:60:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 15.693292] scsi 0:0:60:0: SSP: handle(0x004e), sas_addr(0x5000c500954d33c9), phy(59), device_name(0x5000c500954d33c8) [ 15.703980] scsi 0:0:60:0: enclosure logical id(0x5001636001a06d7d), slot(59) [ 15.711199] scsi 0:0:60:0: enclosure level(0x0000), connector name( C1 ) [ 15.718006] scsi 0:0:60:0: serial_number(ZA1ALY100000R83028GN) [ 15.723838] scsi 0:0:60:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 15.749192] mpt3sas_cm0: detecting: handle(0x0050), sas_address(0x5001636001a06d7d), phy(76) [ 15.757648] mpt3sas_cm0: REPORT_LUNS: handle(0x0050), retries(0) [ 15.763863] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0050), lun(0) [ 15.770323] scsi 0:0:61:0: Enclosure QCT JB4602 SIM 0 1500 PQ: 0 ANSI: 6 [ 15.778709] scsi 0:0:61:0: set ignore_delay_remove for handle(0x0050) [ 15.785146] scsi 0:0:61:0: SES: handle(0x0050), sas_addr(0x5001636001a06d7d), phy(76), device_name(0x5001636001a06d7d) [ 15.795832] scsi 0:0:61:0: enclosure logical id(0x5001636001a06d7d), slot(60) [ 15.803050] scsi 0:0:61:0: enclosure level(0x0000), connector name( C1 ) [ 15.809857] scsi 0:0:61:0: serial_number(EO0153300063 ) [ 15.815342] scsi 0:0:61:0: qdepth(1), tagged(0), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 15.840167] mpt3sas_cm0: expander_add: handle(0x0051), parent(0x0001), sas_addr(0x500163600190cd7f), phys(79) [ 15.865341] mpt3sas_cm0: detecting: handle(0x0053), sas_address(0x5000c50095430dd1), phy(0) [ 15.873694] mpt3sas_cm0: REPORT_LUNS: handle(0x0053), retries(0) [ 15.880277] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0053), lun(0) [ 15.887483] scsi 0:0:62:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 15.896067] scsi 0:0:62:0: SSP: handle(0x0053), sas_addr(0x5000c50095430dd1), phy(0), device_name(0x5000c50095430dd0) [ 15.906673] scsi 0:0:62:0: enclosure logical id(0x500163600190cd7d), slot(0) [ 15.913804] scsi 0:0:62:0: enclosure level(0x0000), connector name( C3 ) [ 15.920615] scsi 0:0:62:0: serial_number(ZA1AGHL00000C8316HQ4) [ 15.926451] scsi 0:0:62:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 15.954070] mpt3sas_cm0: detecting: handle(0x0054), sas_address(0x5000c50095432245), phy(1) [ 15.962436] mpt3sas_cm0: REPORT_LUNS: handle(0x0054), retries(0) [ 15.980584] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0054), lun(0) [ 15.987693] scsi 0:0:63:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 15.996270] scsi 0:0:63:0: SSP: handle(0x0054), sas_addr(0x5000c50095432245), phy(1), device_name(0x5000c50095432244) [ 16.006868] scsi 0:0:63:0: enclosure logical id(0x500163600190cd7d), slot(1) [ 16.014001] scsi 0:0:63:0: enclosure level(0x0000), connector name( C3 ) [ 16.020804] scsi 0:0:63:0: serial_number(ZA1AGN060000R828A07T) [ 16.026637] scsi 0:0:63:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 16.050077] mpt3sas_cm0: detecting: handle(0x0055), sas_address(0x5000c5009569935d), phy(2) [ 16.058432] mpt3sas_cm0: REPORT_LUNS: handle(0x0055), retries(0) [ 16.078902] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0055), lun(0) [ 16.086000] scsi 0:0:64:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 16.094575] scsi 0:0:64:0: SSP: handle(0x0055), sas_addr(0x5000c5009569935d), phy(2), device_name(0x5000c5009569935c) [ 16.105175] scsi 0:0:64:0: enclosure logical id(0x500163600190cd7d), slot(2) [ 16.112306] scsi 0:0:64:0: enclosure level(0x0000), connector name( C3 ) [ 16.119112] scsi 0:0:64:0: serial_number(ZA1AZL5Y0000R832DW4F) [ 16.124945] scsi 0:0:64:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 16.149076] mpt3sas_cm0: detecting: handle(0x0056), sas_address(0x5000c500a6102e85), phy(3) [ 16.157433] mpt3sas_cm0: REPORT_LUNS: handle(0x0056), retries(0) [ 16.176986] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0056), lun(0) [ 16.184113] scsi 0:0:65:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 16.192678] scsi 0:0:65:0: SSP: handle(0x0056), sas_addr(0x5000c500a6102e85), phy(3), device_name(0x5000c500a6102e84) [ 16.203273] scsi 0:0:65:0: enclosure logical id(0x500163600190cd7d), slot(3) [ 16.210406] scsi 0:0:65:0: enclosure level(0x0000), connector name( C3 ) [ 16.217212] scsi 0:0:65:0: serial_number(ZA1B72S80000R8332SVA) [ 16.223045] scsi 0:0:65:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 16.247077] mpt3sas_cm0: detecting: handle(0x0057), sas_address(0x5000c50095431c1d), phy(4) [ 16.255426] mpt3sas_cm0: REPORT_LUNS: handle(0x0057), retries(0) [ 16.261875] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0057), lun(0) [ 16.268979] scsi 0:0:66:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 16.277549] scsi 0:0:66:0: SSP: handle(0x0057), sas_addr(0x5000c50095431c1d), phy(4), device_name(0x0000000000000000) [ 16.288148] scsi 0:0:66:0: enclosure logical id(0x500163600190cd7d), slot(4) [ 16.295279] scsi 0:0:66:0: enclosure level(0x0000), connector name( C3 ) [ 16.302085] scsi 0:0:66:0: serial_number(ZA1AGN520000C8316G32) [ 16.307920] scsi 0:0:66:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 16.332075] mpt3sas_cm0: detecting: handle(0x0058), sas_address(0x5000c500957faccd), phy(5) [ 16.340429] mpt3sas_cm0: REPORT_LUNS: handle(0x0058), retries(0) [ 16.346888] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0058), lun(0) [ 16.353998] scsi 0:0:67:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 16.362572] scsi 0:0:67:0: SSP: handle(0x0058), sas_addr(0x5000c500957faccd), phy(5), device_name(0x5000c500957faccc) [ 16.373169] scsi 0:0:67:0: enclosure logical id(0x500163600190cd7d), slot(5) [ 16.380300] scsi 0:0:67:0: enclosure level(0x0000), connector name( C3 ) [ 16.387107] scsi 0:0:67:0: serial_number(ZA1B4F0J0000R833TXB0) [ 16.392938] scsi 0:0:67:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 16.421096] mpt3sas_cm0: detecting: handle(0x0059), sas_address(0x5000c5009543265d), phy(6) [ 16.429449] mpt3sas_cm0: REPORT_LUNS: handle(0x0059), retries(0) [ 16.449225] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0059), lun(0) [ 16.456346] scsi 0:0:68:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 16.464915] scsi 0:0:68:0: SSP: handle(0x0059), sas_addr(0x5000c5009543265d), phy(6), device_name(0x5000c5009543265c) [ 16.475515] scsi 0:0:68:0: enclosure logical id(0x500163600190cd7d), slot(6) [ 16.482646] scsi 0:0:68:0: enclosure level(0x0000), connector name( C3 ) [ 16.489453] scsi 0:0:68:0: serial_number(ZA1AGGRH0000R829CU3W) [ 16.495285] scsi 0:0:68:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 16.519077] mpt3sas_cm0: detecting: handle(0x005a), sas_address(0x5000c50095432469), phy(7) [ 16.527424] mpt3sas_cm0: REPORT_LUNS: handle(0x005a), retries(0) [ 16.538746] mpt3sas_cm0: TEST_UNIT_READY: handle(0x005a), lun(0) [ 16.545833] scsi 0:0:69:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 16.554420] scsi 0:0:69:0: SSP: handle(0x005a), sas_addr(0x5000c50095432469), phy(7), device_name(0x5000c50095432468) [ 16.565017] scsi 0:0:69:0: enclosure logical id(0x500163600190cd7d), slot(7) [ 16.572148] scsi 0:0:69:0: enclosure level(0x0000), connector name( C3 ) [ 16.578954] scsi 0:0:69:0: serial_number(ZA1AGMY10000C8316H8M) [ 16.584788] scsi 0:0:69:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 16.608075] mpt3sas_cm0: detecting: handle(0x0063), sas_address(0x5000c5009543205d), phy(8) [ 16.616422] mpt3sas_cm0: REPORT_LUNS: handle(0x0063), retries(0) [ 16.630327] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0063), lun(0) [ 16.637450] scsi 0:0:70:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 16.646030] scsi 0:0:70:0: SSP: handle(0x0063), sas_addr(0x5000c5009543205d), phy(8), device_name(0x5000c5009543205c) [ 16.656633] scsi 0:0:70:0: enclosure logical id(0x500163600190cd7d), slot(8) [ 16.663766] scsi 0:0:70:0: enclosure level(0x0000), connector name( C3 ) [ 16.670570] scsi 0:0:70:0: serial_number(ZA1AGN210000R82892FE) [ 16.676406] scsi 0:0:70:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 16.700080] mpt3sas_cm0: detecting: handle(0x0064), sas_address(0x5000c50095432225), phy(9) [ 16.708429] mpt3sas_cm0: REPORT_LUNS: handle(0x0064), retries(0) [ 16.715012] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0064), lun(0) [ 16.722120] scsi 0:0:71:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 16.730689] scsi 0:0:71:0: SSP: handle(0x0064), sas_addr(0x5000c50095432225), phy(9), device_name(0x5000c50095432224) [ 16.741290] scsi 0:0:71:0: enclosure logical id(0x500163600190cd7d), slot(9) [ 16.748422] scsi 0:0:71:0: enclosure level(0x0000), connector name( C3 ) [ 16.755231] scsi 0:0:71:0: serial_number(ZA1AGN0E0000R82893RN) [ 16.761071] scsi 0:0:71:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 16.784080] mpt3sas_cm0: detecting: handle(0x0065), sas_address(0x5000c50095431219), phy(10) [ 16.792515] mpt3sas_cm0: REPORT_LUNS: handle(0x0065), retries(0) [ 16.799062] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0065), lun(0) [ 16.806153] scsi 0:0:72:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 16.814723] scsi 0:0:72:0: SSP: handle(0x0065), sas_addr(0x5000c50095431219), phy(10), device_name(0x5000c50095431218) [ 16.825410] scsi 0:0:72:0: enclosure logical id(0x500163600190cd7d), slot(10) [ 16.832630] scsi 0:0:72:0: enclosure level(0x0000), connector name( C3 ) [ 16.839434] scsi 0:0:72:0: serial_number(ZA1AGHEZ0000R8289ZB0) [ 16.845268] scsi 0:0:72:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 16.869084] mpt3sas_cm0: detecting: handle(0x0066), sas_address(0x5000c5009543250d), phy(11) [ 16.877519] mpt3sas_cm0: REPORT_LUNS: handle(0x0066), retries(0) [ 16.884064] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0066), lun(0) [ 16.891162] scsi 0:0:73:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 16.899732] scsi 0:0:73:0: SSP: handle(0x0066), sas_addr(0x5000c5009543250d), phy(11), device_name(0x5000c5009543250c) [ 16.910423] scsi 0:0:73:0: enclosure logical id(0x500163600190cd7d), slot(11) [ 16.917642] scsi 0:0:73:0: enclosure level(0x0000), connector name( C3 ) [ 16.924450] scsi 0:0:73:0: serial_number(ZA1AGMX90000C8316H8U) [ 16.930290] scsi 0:0:73:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 16.956080] mpt3sas_cm0: detecting: handle(0x0067), sas_address(0x5000c500954cf2a9), phy(12) [ 16.964515] mpt3sas_cm0: REPORT_LUNS: handle(0x0067), retries(0) [ 16.984681] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0067), lun(0) [ 16.991781] scsi 0:0:74:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 17.000348] scsi 0:0:74:0: SSP: handle(0x0067), sas_addr(0x5000c500954cf2a9), phy(12), device_name(0x5000c500954cf2a8) [ 17.011034] scsi 0:0:74:0: enclosure logical id(0x500163600190cd7d), slot(12) [ 17.018255] scsi 0:0:74:0: enclosure level(0x0000), connector name( C3 ) [ 17.025061] scsi 0:0:74:0: serial_number(ZA1ALFL80000R8314RU0) [ 17.030892] scsi 0:0:74:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 17.057094] mpt3sas_cm0: detecting: handle(0x0068), sas_address(0x5000c500954d4119), phy(13) [ 17.065529] mpt3sas_cm0: REPORT_LUNS: handle(0x0068), retries(0) [ 17.077781] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0068), lun(0) [ 17.084899] scsi 0:0:75:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 17.093476] scsi 0:0:75:0: SSP: handle(0x0068), sas_addr(0x5000c500954d4119), phy(13), device_name(0x5000c500954d4118) [ 17.104160] scsi 0:0:75:0: enclosure logical id(0x500163600190cd7d), slot(13) [ 17.111379] scsi 0:0:75:0: enclosure level(0x0000), connector name( C3 ) [ 17.118184] scsi 0:0:75:0: serial_number(ZA1ALXPR0000R8302J8K) [ 17.124016] scsi 0:0:75:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 17.147083] mpt3sas_cm0: detecting: handle(0x0069), sas_address(0x5000c500954cb5e1), phy(14) [ 17.155525] mpt3sas_cm0: REPORT_LUNS: handle(0x0069), retries(0) [ 17.175663] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0069), lun(0) [ 17.211764] scsi 0:0:76:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 17.220323] scsi 0:0:76:0: SSP: handle(0x0069), sas_addr(0x5000c500954cb5e1), phy(14), device_name(0x5000c500954cb5e0) [ 17.231007] scsi 0:0:76:0: enclosure logical id(0x500163600190cd7d), slot(14) [ 17.238225] scsi 0:0:76:0: enclosure level(0x0000), connector name( C3 ) [ 17.245017] scsi 0:0:76:0: serial_number(ZA1ALH7V0000C8326GSW) [ 17.250856] scsi 0:0:76:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 17.274082] mpt3sas_cm0: detecting: handle(0x006a), sas_address(0x5000c500954df389), phy(15) [ 17.282518] mpt3sas_cm0: REPORT_LUNS: handle(0x006a), retries(0) [ 17.294093] mpt3sas_cm0: TEST_UNIT_READY: handle(0x006a), lun(0) [ 17.301187] scsi 0:0:77:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 17.309763] scsi 0:0:77:0: SSP: handle(0x006a), sas_addr(0x5000c500954df389), phy(15), device_name(0x5000c500954df388) [ 17.320447] scsi 0:0:77:0: enclosure logical id(0x500163600190cd7d), slot(15) [ 17.327666] scsi 0:0:77:0: enclosure level(0x0000), connector name( C3 ) [ 17.334475] scsi 0:0:77:0: serial_number(ZA1AM2550000R8317NB5) [ 17.340315] scsi 0:0:77:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 17.363086] mpt3sas_cm0: detecting: handle(0x0073), sas_address(0x5000c500954d8f5d), phy(16) [ 17.371525] mpt3sas_cm0: REPORT_LUNS: handle(0x0073), retries(0) [ 17.392551] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0073), lun(0) [ 17.399662] scsi 0:0:78:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 17.408232] scsi 0:0:78:0: SSP: handle(0x0073), sas_addr(0x5000c500954d8f5d), phy(16), device_name(0x5000c500954d8f5c) [ 17.418920] scsi 0:0:78:0: enclosure logical id(0x500163600190cd7d), slot(16) [ 17.426138] scsi 0:0:78:0: enclosure level(0x0000), connector name( C3 ) [ 17.432949] scsi 0:0:78:0: serial_number(ZA1A3EEM0000R8301QYF) [ 17.438787] scsi 0:0:78:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 17.465078] mpt3sas_cm0: detecting: handle(0x0074), sas_address(0x5000c500954ccd99), phy(17) [ 17.473533] mpt3sas_cm0: REPORT_LUNS: handle(0x0074), retries(0) [ 17.485923] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0074), lun(0) [ 17.493054] scsi 0:0:79:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 17.501660] scsi 0:0:79:0: SSP: handle(0x0074), sas_addr(0x5000c500954ccd99), phy(17), device_name(0x5000c500954ccd98) [ 17.512346] scsi 0:0:79:0: enclosure logical id(0x500163600190cd7d), slot(17) [ 17.519567] scsi 0:0:79:0: enclosure level(0x0000), connector name( C3 ) [ 17.526372] scsi 0:0:79:0: serial_number(ZA1ALL1N0000R8301RWS) [ 17.532205] scsi 0:0:79:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 17.555084] mpt3sas_cm0: detecting: handle(0x0075), sas_address(0x5000c500954d2dbd), phy(18) [ 17.563529] mpt3sas_cm0: REPORT_LUNS: handle(0x0075), retries(0) [ 17.574725] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0075), lun(0) [ 17.614142] scsi 0:0:80:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 17.622698] scsi 0:0:80:0: SSP: handle(0x0075), sas_addr(0x5000c500954d2dbd), phy(18), device_name(0x5000c500954d2dbc) [ 17.633388] scsi 0:0:80:0: enclosure logical id(0x500163600190cd7d), slot(18) [ 17.640607] scsi 0:0:80:0: enclosure level(0x0000), connector name( C3 ) [ 17.647399] scsi 0:0:80:0: serial_number(ZA1ALV6M0000R8314SFK) [ 17.653237] scsi 0:0:80:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 17.677086] mpt3sas_cm0: detecting: handle(0x0076), sas_address(0x5000c500954cc1b5), phy(19) [ 17.685522] mpt3sas_cm0: REPORT_LUNS: handle(0x0076), retries(0) [ 17.707541] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0076), lun(0) [ 17.714644] scsi 0:0:81:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 17.723213] scsi 0:0:81:0: SSP: handle(0x0076), sas_addr(0x5000c500954cc1b5), phy(19), device_name(0x5000c500954cc1b4) [ 17.733895] scsi 0:0:81:0: enclosure logical id(0x500163600190cd7d), slot(19) [ 17.741116] scsi 0:0:81:0: enclosure level(0x0000), connector name( C3 ) [ 17.747921] scsi 0:0:81:0: serial_number(ZA1ALGWT0000C8325X34) [ 17.753754] scsi 0:0:81:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 17.778089] mpt3sas_cm0: detecting: handle(0x0077), sas_address(0x5000c500954310fd), phy(20) [ 17.786527] mpt3sas_cm0: REPORT_LUNS: handle(0x0077), retries(0) [ 17.816514] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0077), lun(0) [ 17.823790] scsi 0:0:82:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 17.832366] scsi 0:0:82:0: SSP: handle(0x0077), sas_addr(0x5000c500954310fd), phy(20), device_name(0x5000c500954310fc) [ 17.843053] scsi 0:0:82:0: enclosure logical id(0x500163600190cd7d), slot(20) [ 17.850274] scsi 0:0:82:0: enclosure level(0x0000), connector name( C3 ) [ 17.857092] scsi 0:0:82:0: serial_number(ZA1AGHGR0000C8316FM1) [ 17.862931] scsi 0:0:82:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 17.888087] mpt3sas_cm0: detecting: handle(0x0078), sas_address(0x5000c500954cc171), phy(21) [ 17.896524] mpt3sas_cm0: REPORT_LUNS: handle(0x0078), retries(0) [ 17.903017] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0078), lun(0) [ 17.910152] scsi 0:0:83:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 17.918725] scsi 0:0:83:0: SSP: handle(0x0078), sas_addr(0x5000c500954cc171), phy(21), device_name(0x5000c500954cc170) [ 17.929410] scsi 0:0:83:0: enclosure logical id(0x500163600190cd7d), slot(21) [ 17.936628] scsi 0:0:83:0: enclosure level(0x0000), connector name( C3 ) [ 17.943436] scsi 0:0:83:0: serial_number(ZA1ALGXA0000C8325WZ8) [ 17.949269] scsi 0:0:83:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 17.972675] mpt3sas_cm0: detecting: handle(0x0079), sas_address(0x5000c500954ddfe1), phy(22) [ 17.981112] mpt3sas_cm0: REPORT_LUNS: handle(0x0079), retries(0) [ 17.994297] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0079), lun(0) [ 18.001434] scsi 0:0:84:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 18.010003] scsi 0:0:84:0: SSP: handle(0x0079), sas_addr(0x5000c500954ddfe1), phy(22), device_name(0x5000c500954ddfe0) [ 18.020688] scsi 0:0:84:0: enclosure logical id(0x500163600190cd7d), slot(22) [ 18.027907] scsi 0:0:84:0: enclosure level(0x0000), connector name( C3 ) [ 18.034714] scsi 0:0:84:0: serial_number(ZA1AM5R10000R8317NT7) [ 18.040546] scsi 0:0:84:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 18.068087] mpt3sas_cm0: detecting: handle(0x007a), sas_address(0x5000c500954cb455), phy(23) [ 18.076540] mpt3sas_cm0: REPORT_LUNS: handle(0x007a), retries(0) [ 18.095371] mpt3sas_cm0: TEST_UNIT_READY: handle(0x007a), lun(0) [ 18.102477] scsi 0:0:85:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 18.111050] scsi 0:0:85:0: SSP: handle(0x007a), sas_addr(0x5000c500954cb455), phy(23), device_name(0x5000c500954cb454) [ 18.121735] scsi 0:0:85:0: enclosure logical id(0x500163600190cd7d), slot(23) [ 18.128953] scsi 0:0:85:0: enclosure level(0x0000), connector name( C3 ) [ 18.135756] scsi 0:0:85:0: serial_number(ZA1ALHA50000C8325WZL) [ 18.141593] scsi 0:0:85:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 18.164094] mpt3sas_cm0: detecting: handle(0x0083), sas_address(0x5000c500a6104dbd), phy(24) [ 18.172535] mpt3sas_cm0: REPORT_LUNS: handle(0x0083), retries(0) [ 18.179007] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0083), lun(0) [ 18.186109] scsi 0:0:86:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 18.194687] scsi 0:0:86:0: SSP: handle(0x0083), sas_addr(0x5000c500a6104dbd), phy(24), device_name(0x5000c500a6104dbc) [ 18.205377] scsi 0:0:86:0: enclosure logical id(0x500163600190cd7d), slot(24) [ 18.212597] scsi 0:0:86:0: enclosure level(0x0000), connector name( C3 ) [ 18.219405] scsi 0:0:86:0: serial_number(ZA1B729S0000R824UQU0) [ 18.225245] scsi 0:0:86:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 18.249094] mpt3sas_cm0: detecting: handle(0x0084), sas_address(0x5000c500954d0c09), phy(25) [ 18.257532] mpt3sas_cm0: REPORT_LUNS: handle(0x0084), retries(0) [ 18.264104] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0084), lun(0) [ 18.271227] scsi 0:0:87:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 18.279799] scsi 0:0:87:0: SSP: handle(0x0084), sas_addr(0x5000c500954d0c09), phy(25), device_name(0x5000c500954d0c08) [ 18.290486] scsi 0:0:87:0: enclosure logical id(0x500163600190cd7d), slot(25) [ 18.297705] scsi 0:0:87:0: enclosure level(0x0000), connector name( C3 ) [ 18.304511] scsi 0:0:87:0: serial_number(ZA1AFAX70000R8314QSP) [ 18.310343] scsi 0:0:87:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 18.334097] mpt3sas_cm0: detecting: handle(0x0085), sas_address(0x5000c500954d91a1), phy(26) [ 18.342535] mpt3sas_cm0: REPORT_LUNS: handle(0x0085), retries(0) [ 18.356405] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0085), lun(0) [ 18.363506] scsi 0:0:88:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 18.372079] scsi 0:0:88:0: SSP: handle(0x0085), sas_addr(0x5000c500954d91a1), phy(26), device_name(0x5000c500954d91a0) [ 18.382768] scsi 0:0:88:0: enclosure logical id(0x500163600190cd7d), slot(26) [ 18.389987] scsi 0:0:88:0: enclosure level(0x0000), connector name( C3 ) [ 18.396794] scsi 0:0:88:0: serial_number(ZA1A7W9H0000R8302K3E) [ 18.402628] scsi 0:0:88:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 18.427087] mpt3sas_cm0: detecting: handle(0x0086), sas_address(0x5000c500a610243d), phy(27) [ 18.435541] mpt3sas_cm0: REPORT_LUNS: handle(0x0086), retries(0) [ 18.450563] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0086), lun(0) [ 18.457761] scsi 0:0:89:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 18.466334] scsi 0:0:89:0: SSP: handle(0x0086), sas_addr(0x5000c500a610243d), phy(27), device_name(0x5000c500a610243c) [ 18.477021] scsi 0:0:89:0: enclosure logical id(0x500163600190cd7d), slot(27) [ 18.484240] scsi 0:0:89:0: enclosure level(0x0000), connector name( C3 ) [ 18.491046] scsi 0:0:89:0: serial_number(ZA1B72Z10000R833TUKN) [ 18.496878] scsi 0:0:89:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 18.520096] mpt3sas_cm0: detecting: handle(0x0087), sas_address(0x5000c500a6102eb1), phy(28) [ 18.528534] mpt3sas_cm0: REPORT_LUNS: handle(0x0087), retries(0) [ 18.550813] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0087), lun(0) [ 18.557941] scsi 0:0:90:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 18.566518] scsi 0:0:90:0: SSP: handle(0x0087), sas_addr(0x5000c500a6102eb1), phy(28), device_name(0x5000c500a6102eb0) [ 18.577207] scsi 0:0:90:0: enclosure logical id(0x500163600190cd7d), slot(28) [ 18.584426] scsi 0:0:90:0: enclosure level(0x0000), connector name( C3 ) [ 18.591233] scsi 0:0:90:0: serial_number(ZA1B72R60000R83323UR) [ 18.597066] scsi 0:0:90:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 18.620099] mpt3sas_cm0: detecting: handle(0x0088), sas_address(0x5000c500a6102439), phy(29) [ 18.628538] mpt3sas_cm0: REPORT_LUNS: handle(0x0088), retries(0) [ 18.643450] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0088), lun(0) [ 18.650562] scsi 0:0:91:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 18.659138] scsi 0:0:91:0: SSP: handle(0x0088), sas_addr(0x5000c500a6102439), phy(29), device_name(0x5000c500a6102438) [ 18.669821] scsi 0:0:91:0: enclosure logical id(0x500163600190cd7d), slot(29) [ 18.677039] scsi 0:0:91:0: enclosure level(0x0000), connector name( C3 ) [ 18.683846] scsi 0:0:91:0: serial_number(ZA1B72ZL0000R833UX7J) [ 18.689680] scsi 0:0:91:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 18.717099] mpt3sas_cm0: detecting: handle(0x0089), sas_address(0x5000c500954d9981), phy(30) [ 18.725539] mpt3sas_cm0: REPORT_LUNS: handle(0x0089), retries(0) [ 18.739192] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0089), lun(0) [ 18.746319] scsi 0:0:92:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 18.754903] scsi 0:0:92:0: SSP: handle(0x0089), sas_addr(0x5000c500954d9981), phy(30), device_name(0x5000c500954d9980) [ 18.765590] scsi 0:0:92:0: enclosure logical id(0x500163600190cd7d), slot(30) [ 18.772807] scsi 0:0:92:0: enclosure level(0x0000), connector name( C3 ) [ 18.779615] scsi 0:0:92:0: serial_number(ZA1AM3Q20000R8302N04) [ 18.785446] scsi 0:0:92:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 18.812095] mpt3sas_cm0: detecting: handle(0x008a), sas_address(0x5000c500954deab9), phy(31) [ 18.820531] mpt3sas_cm0: REPORT_LUNS: handle(0x008a), retries(0) [ 18.839530] mpt3sas_cm0: TEST_UNIT_READY: handle(0x008a), lun(0) [ 18.846630] scsi 0:0:93:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 18.855206] scsi 0:0:93:0: SSP: handle(0x008a), sas_addr(0x5000c500954deab9), phy(31), device_name(0x5000c500954deab8) [ 18.865888] scsi 0:0:93:0: enclosure logical id(0x500163600190cd7d), slot(31) [ 18.873110] scsi 0:0:93:0: enclosure level(0x0000), connector name( C3 ) [ 18.879915] scsi 0:0:93:0: serial_number(ZA1AJVZZ0000R8317PEX) [ 18.885748] scsi 0:0:93:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 18.909107] mpt3sas_cm0: detecting: handle(0x0093), sas_address(0x5000c500954cc8d5), phy(32) [ 18.917550] mpt3sas_cm0: REPORT_LUNS: handle(0x0093), retries(0) [ 18.924364] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0093), lun(0) [ 18.939267] scsi 0:0:94:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 18.948245] scsi 0:0:94:0: SSP: handle(0x0093), sas_addr(0x5000c500954cc8d5), phy(32), device_name(0x5000c500954cc8d4) [ 18.958928] scsi 0:0:94:0: enclosure logical id(0x500163600190cd7d), slot(32) [ 18.966147] scsi 0:0:94:0: enclosure level(0x0000), connector name( C3 ) [ 18.972941] scsi 0:0:94:0: serial_number(ZA1ALGNR0000R8302KGJ) [ 18.978777] scsi 0:0:94:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 19.005099] mpt3sas_cm0: detecting: handle(0x0094), sas_address(0x5000c500a6102de1), phy(33) [ 19.013550] mpt3sas_cm0: REPORT_LUNS: handle(0x0094), retries(0) [ 19.020022] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0094), lun(0) [ 19.027150] scsi 0:0:95:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 19.035734] scsi 0:0:95:0: SSP: handle(0x0094), sas_addr(0x5000c500a6102de1), phy(33), device_name(0x5000c500a6102de0) [ 19.046418] scsi 0:0:95:0: enclosure logical id(0x500163600190cd7d), slot(33) [ 19.053637] scsi 0:0:95:0: enclosure level(0x0000), connector name( C3 ) [ 19.060447] scsi 0:0:95:0: serial_number(ZA1B72S70000R833V13M) [ 19.066285] scsi 0:0:95:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 19.090115] mpt3sas_cm0: detecting: handle(0x0095), sas_address(0x5000c500954cc655), phy(34) [ 19.098554] mpt3sas_cm0: REPORT_LUNS: handle(0x0095), retries(0) [ 19.117517] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0095), lun(0) [ 19.124777] scsi 0:0:96:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 19.133353] scsi 0:0:96:0: SSP: handle(0x0095), sas_addr(0x5000c500954cc655), phy(34), device_name(0x5000c500954cc654) [ 19.144040] scsi 0:0:96:0: enclosure logical id(0x500163600190cd7d), slot(34) [ 19.151260] scsi 0:0:96:0: enclosure level(0x0000), connector name( C3 ) [ 19.158067] scsi 0:0:96:0: serial_number(ZA1ALGS20000C8327479) [ 19.163899] scsi 0:0:96:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 19.188103] mpt3sas_cm0: detecting: handle(0x0096), sas_address(0x5000c500954d38c9), phy(35) [ 19.196543] mpt3sas_cm0: REPORT_LUNS: handle(0x0096), retries(0) [ 19.214399] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0096), lun(0) [ 19.221490] scsi 0:0:97:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 19.230061] scsi 0:0:97:0: SSP: handle(0x0096), sas_addr(0x5000c500954d38c9), phy(35), device_name(0x5000c500954d38c8) [ 19.240745] scsi 0:0:97:0: enclosure logical id(0x500163600190cd7d), slot(35) [ 19.247964] scsi 0:0:97:0: enclosure level(0x0000), connector name( C3 ) [ 19.254772] scsi 0:0:97:0: serial_number(ZA1ALXWM0000R83026JR) [ 19.260603] scsi 0:0:97:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 19.282102] mpt3sas_cm0: detecting: handle(0x0097), sas_address(0x5000c500954d94d1), phy(36) [ 19.290542] mpt3sas_cm0: REPORT_LUNS: handle(0x0097), retries(0) [ 19.297022] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0097), lun(0) [ 19.304135] scsi 0:0:98:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 19.312702] scsi 0:0:98:0: SSP: handle(0x0097), sas_addr(0x5000c500954d94d1), phy(36), device_name(0x5000c500954d94d0) [ 19.323391] scsi 0:0:98:0: enclosure logical id(0x500163600190cd7d), slot(36) [ 19.330611] scsi 0:0:98:0: enclosure level(0x0000), connector name( C3 ) [ 19.337418] scsi 0:0:98:0: serial_number(ZA1AM3VG0000R8313JPX) [ 19.343249] scsi 0:0:98:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 19.366108] mpt3sas_cm0: detecting: handle(0x0098), sas_address(0x5000c500a6105289), phy(37) [ 19.374550] mpt3sas_cm0: REPORT_LUNS: handle(0x0098), retries(0) [ 19.381039] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0098), lun(0) [ 19.388178] scsi 0:0:99:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 19.396748] scsi 0:0:99:0: SSP: handle(0x0098), sas_addr(0x5000c500a6105289), phy(37), device_name(0x5000c500a6105288) [ 19.407432] scsi 0:0:99:0: enclosure logical id(0x500163600190cd7d), slot(37) [ 19.414653] scsi 0:0:99:0: enclosure level(0x0000), connector name( C3 ) [ 19.421460] scsi 0:0:99:0: serial_number(ZA1B727K0000R8372HYT) [ 19.427291] scsi 0:0:99:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 19.450108] mpt3sas_cm0: detecting: handle(0x0099), sas_address(0x5000c500a6103fd9), phy(38) [ 19.458547] mpt3sas_cm0: REPORT_LUNS: handle(0x0099), retries(0) [ 19.479797] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0099), lun(0) [ 19.486917] scsi 0:0:100:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 19.495577] scsi 0:0:100:0: SSP: handle(0x0099), sas_addr(0x5000c500a6103fd9), phy(38), device_name(0x5000c500a6103fd8) [ 19.506348] scsi 0:0:100:0: enclosure logical id(0x500163600190cd7d), slot(38) [ 19.513653] scsi 0:0:100:0: enclosure level(0x0000), connector name( C3 ) [ 19.520548] scsi 0:0:100:0: serial_number(ZA1B72HS0000R8331QSS) [ 19.526476] scsi 0:0:100:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 19.549103] mpt3sas_cm0: detecting: handle(0x009a), sas_address(0x5000c500a6105755), phy(39) [ 19.557540] mpt3sas_cm0: REPORT_LUNS: handle(0x009a), retries(0) [ 19.570061] mpt3sas_cm0: TEST_UNIT_READY: handle(0x009a), lun(0) [ 19.577184] scsi 0:0:101:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 19.585843] scsi 0:0:101:0: SSP: handle(0x009a), sas_addr(0x5000c500a6105755), phy(39), device_name(0x5000c500a6105754) [ 19.596612] scsi 0:0:101:0: enclosure logical id(0x500163600190cd7d), slot(39) [ 19.603918] scsi 0:0:101:0: enclosure level(0x0000), connector name( C3 ) [ 19.610810] scsi 0:0:101:0: serial_number(ZA1B72670000R833UYPW) [ 19.616729] scsi 0:0:101:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 19.640109] mpt3sas_cm0: detecting: handle(0x00a3), sas_address(0x5000c500956c75a1), phy(40) [ 19.648548] mpt3sas_cm0: REPORT_LUNS: handle(0x00a3), retries(0) [ 19.655122] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00a3), lun(0) [ 19.662241] scsi 0:0:102:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 19.670907] scsi 0:0:102:0: SSP: handle(0x00a3), sas_addr(0x5000c500956c75a1), phy(40), device_name(0x5000c500956c75a0) [ 19.681677] scsi 0:0:102:0: enclosure logical id(0x500163600190cd7d), slot(40) [ 19.688981] scsi 0:0:102:0: enclosure level(0x0000), connector name( C3 ) [ 19.695877] scsi 0:0:102:0: serial_number(ZA1B0V530000R8332QYC) [ 19.701793] scsi 0:0:102:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 19.726102] mpt3sas_cm0: detecting: handle(0x00a4), sas_address(0x5000c500a61033e1), phy(41) [ 19.734540] mpt3sas_cm0: REPORT_LUNS: handle(0x00a4), retries(0) [ 19.752713] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00a4), lun(0) [ 19.759835] scsi 0:0:103:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 19.768489] scsi 0:0:103:0: SSP: handle(0x00a4), sas_addr(0x5000c500a61033e1), phy(41), device_name(0x5000c500a61033e0) [ 19.779264] scsi 0:0:103:0: enclosure logical id(0x500163600190cd7d), slot(41) [ 19.786570] scsi 0:0:103:0: enclosure level(0x0000), connector name( C3 ) [ 19.793463] scsi 0:0:103:0: serial_number(ZA1B737J0000R8332RQ1) [ 19.799383] scsi 0:0:103:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 19.822112] mpt3sas_cm0: detecting: handle(0x00a5), sas_address(0x5000c500a6104d25), phy(42) [ 19.830551] mpt3sas_cm0: REPORT_LUNS: handle(0x00a5), retries(0) [ 19.837099] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00a5), lun(0) [ 19.844189] scsi 0:0:104:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 19.852848] scsi 0:0:104:0: SSP: handle(0x00a5), sas_addr(0x5000c500a6104d25), phy(42), device_name(0x5000c500a6104d24) [ 19.863618] scsi 0:0:104:0: enclosure logical id(0x500163600190cd7d), slot(42) [ 19.870924] scsi 0:0:104:0: enclosure level(0x0000), connector name( C3 ) [ 19.877817] scsi 0:0:104:0: serial_number(ZA1B72AS0000R833UYB9) [ 19.883737] scsi 0:0:104:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 19.908109] mpt3sas_cm0: detecting: handle(0x00a6), sas_address(0x5000c500a6102115), phy(43) [ 19.916552] mpt3sas_cm0: REPORT_LUNS: handle(0x00a6), retries(0) [ 19.929427] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00a6), lun(0) [ 19.965636] scsi 0:0:105:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 19.974278] scsi 0:0:105:0: SSP: handle(0x00a6), sas_addr(0x5000c500a6102115), phy(43), device_name(0x5000c500a6102114) [ 19.985048] scsi 0:0:105:0: enclosure logical id(0x500163600190cd7d), slot(43) [ 19.992354] scsi 0:0:105:0: enclosure level(0x0000), connector name( C3 ) [ 19.999234] scsi 0:0:105:0: serial_number(ZA1B731E0000R833UYGB) [ 20.005157] scsi 0:0:105:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 20.029700] mpt3sas_cm0: detecting: handle(0x00a7), sas_address(0x5000c500a6106479), phy(44) [ 20.038138] mpt3sas_cm0: REPORT_LUNS: handle(0x00a7), retries(0) [ 20.058956] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00a7), lun(0) [ 20.066111] scsi 0:0:106:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 20.074771] scsi 0:0:106:0: SSP: handle(0x00a7), sas_addr(0x5000c500a6106479), phy(44), device_name(0x5000c500a6106478) [ 20.085547] scsi 0:0:106:0: enclosure logical id(0x500163600190cd7d), slot(44) [ 20.092853] scsi 0:0:106:0: enclosure level(0x0000), connector name( C3 ) [ 20.099745] scsi 0:0:106:0: serial_number(ZA1B72310000R8314SBW) [ 20.105666] scsi 0:0:106:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 20.130111] mpt3sas_cm0: detecting: handle(0x00a8), sas_address(0x5000c500a610264d), phy(45) [ 20.138549] mpt3sas_cm0: REPORT_LUNS: handle(0x00a8), retries(0) [ 20.154218] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00a8), lun(0) [ 20.161339] scsi 0:0:107:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 20.169995] scsi 0:0:107:0: SSP: handle(0x00a8), sas_addr(0x5000c500a610264d), phy(45), device_name(0x5000c500a610264c) [ 20.180771] scsi 0:0:107:0: enclosure logical id(0x500163600190cd7d), slot(45) [ 20.188076] scsi 0:0:107:0: enclosure level(0x0000), connector name( C3 ) [ 20.194968] scsi 0:0:107:0: serial_number(ZA1B72XL0000R833UYDL) [ 20.200887] scsi 0:0:107:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 20.224111] mpt3sas_cm0: detecting: handle(0x00a9), sas_address(0x5000c500954d4401), phy(46) [ 20.232549] mpt3sas_cm0: REPORT_LUNS: handle(0x00a9), retries(0) [ 20.239099] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00a9), lun(0) [ 20.246186] scsi 0:0:108:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 20.254841] scsi 0:0:108:0: SSP: handle(0x00a9), sas_addr(0x5000c500954d4401), phy(46), device_name(0x5000c500954d4400) [ 20.265616] scsi 0:0:108:0: enclosure logical id(0x500163600190cd7d), slot(46) [ 20.272923] scsi 0:0:108:0: enclosure level(0x0000), connector name( C3 ) [ 20.279817] scsi 0:0:108:0: serial_number(ZA1AHBRF0000R8318PP8) [ 20.285736] scsi 0:0:108:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 20.550115] mpt3sas_cm0: detecting: handle(0x00aa), sas_address(0x5000c500957eb4c5), phy(47) [ 20.558559] mpt3sas_cm0: REPORT_LUNS: handle(0x00aa), retries(0) [ 20.565136] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00aa), lun(0) [ 20.824902] scsi 0:0:109:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 20.833681] scsi 0:0:109:0: SSP: handle(0x00aa), sas_addr(0x5000c500957eb4c5), phy(47), device_name(0x5000c500957eb4c4) [ 20.844455] scsi 0:0:109:0: enclosure logical id(0x500163600190cd7d), slot(47) [ 20.851760] scsi 0:0:109:0: enclosure level(0x0000), connector name( C3 ) [ 20.858640] scsi 0:0:109:0: serial_number(ZA1B6AXY0000R8332SL8) [ 20.864565] scsi 0:0:109:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 20.889116] mpt3sas_cm0: detecting: handle(0x00b3), sas_address(0x5000c500954328f5), phy(48) [ 20.897553] mpt3sas_cm0: REPORT_LUNS: handle(0x00b3), retries(0) [ 20.914898] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00b3), lun(0) [ 20.922052] scsi 0:0:110:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 20.930718] scsi 0:0:110:0: SSP: handle(0x00b3), sas_addr(0x5000c500954328f5), phy(48), device_name(0x5000c500954328f4) [ 20.941488] scsi 0:0:110:0: enclosure logical id(0x500163600190cd7d), slot(48) [ 20.948792] scsi 0:0:110:0: enclosure level(0x0000), connector name( C3 ) [ 20.955686] scsi 0:0:110:0: serial_number(ZA1AGMWA0000C8316H64) [ 20.961606] scsi 0:0:110:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 20.985115] mpt3sas_cm0: detecting: handle(0x00b4), sas_address(0x5000c50095432165), phy(49) [ 20.993556] mpt3sas_cm0: REPORT_LUNS: handle(0x00b4), retries(0) [ 21.014876] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00b4), lun(0) [ 21.021991] scsi 0:0:111:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 21.030655] scsi 0:0:111:0: SSP: handle(0x00b4), sas_addr(0x5000c50095432165), phy(49), device_name(0x5000c50095432164) [ 21.041423] scsi 0:0:111:0: enclosure logical id(0x500163600190cd7d), slot(49) [ 21.048729] scsi 0:0:111:0: enclosure level(0x0000), connector name( C3 ) [ 21.055625] scsi 0:0:111:0: serial_number(ZA1AGGY80000C724RXCM) [ 21.061544] scsi 0:0:111:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 21.085120] mpt3sas_cm0: detecting: handle(0x00b5), sas_address(0x5000c500954313bd), phy(50) [ 21.093561] mpt3sas_cm0: REPORT_LUNS: handle(0x00b5), retries(0) [ 21.100138] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00b5), lun(0) [ 21.354387] scsi 0:0:112:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 21.363151] scsi 0:0:112:0: SSP: handle(0x00b5), sas_addr(0x5000c500954313bd), phy(50), device_name(0x5000c500954313bc) [ 21.373925] scsi 0:0:112:0: enclosure logical id(0x500163600190cd7d), slot(50) [ 21.381232] scsi 0:0:112:0: enclosure level(0x0000), connector name( C3 ) [ 21.388109] scsi 0:0:112:0: serial_number(ZA1AGHD30000C8316HPY) [ 21.394035] scsi 0:0:112:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 21.417118] mpt3sas_cm0: detecting: handle(0x00b6), sas_address(0x5000c50095431581), phy(51) [ 21.425559] mpt3sas_cm0: REPORT_LUNS: handle(0x00b6), retries(0) [ 21.432130] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00b6), lun(0) [ 21.691543] scsi 0:0:113:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 21.700309] scsi 0:0:113:0: SSP: handle(0x00b6), sas_addr(0x5000c50095431581), phy(51), device_name(0x5000c50095431580) [ 21.711080] scsi 0:0:113:0: enclosure logical id(0x500163600190cd7d), slot(51) [ 21.718385] scsi 0:0:113:0: enclosure level(0x0000), connector name( C3 ) [ 21.725263] scsi 0:0:113:0: serial_number(ZA1AGHB90000R7245BUM) [ 21.731182] scsi 0:0:113:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 21.754121] mpt3sas_cm0: detecting: handle(0x00b7), sas_address(0x5000c50095430f29), phy(52) [ 21.762559] mpt3sas_cm0: REPORT_LUNS: handle(0x00b7), retries(0) [ 21.769363] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00b7), lun(0) [ 21.776502] scsi 0:0:114:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 21.785164] scsi 0:0:114:0: SSP: handle(0x00b7), sas_addr(0x5000c50095430f29), phy(52), device_name(0x5000c50095430f28) [ 21.795936] scsi 0:0:114:0: enclosure logical id(0x500163600190cd7d), slot(52) [ 21.803242] scsi 0:0:114:0: enclosure level(0x0000), connector name( C3 ) [ 21.810134] scsi 0:0:114:0: serial_number(ZA1AGHJF0000C8316HQY) [ 21.816055] scsi 0:0:114:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 21.848131] mpt3sas_cm0: detecting: handle(0x00b8), sas_address(0x5000c500954327f1), phy(53) [ 21.856565] mpt3sas_cm0: REPORT_LUNS: handle(0x00b8), retries(0) [ 21.863019] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00b8), lun(0) [ 21.870142] scsi 0:0:115:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 21.878799] scsi 0:0:115:0: SSP: handle(0x00b8), sas_addr(0x5000c500954327f1), phy(53), device_name(0x5000c500954327f0) [ 21.889573] scsi 0:0:115:0: enclosure logical id(0x500163600190cd7d), slot(53) [ 21.896877] scsi 0:0:115:0: enclosure level(0x0000), connector name( C3 ) [ 21.903771] scsi 0:0:115:0: serial_number(ZA1AGGP90000R814TJY2) [ 21.909690] scsi 0:0:115:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 21.936124] mpt3sas_cm0: detecting: handle(0x00b9), sas_address(0x5000c500954327f9), phy(54) [ 21.944559] mpt3sas_cm0: REPORT_LUNS: handle(0x00b9), retries(0) [ 21.951133] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00b9), lun(0) [ 22.219820] scsi 0:0:116:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 22.228577] scsi 0:0:116:0: SSP: handle(0x00b9), sas_addr(0x5000c500954327f9), phy(54), device_name(0x5000c500954327f8) [ 22.239345] scsi 0:0:116:0: enclosure logical id(0x500163600190cd7d), slot(54) [ 22.246651] scsi 0:0:116:0: enclosure level(0x0000), connector name( C3 ) [ 22.253531] scsi 0:0:116:0: serial_number(ZA1AGGP70000C8316FPD) [ 22.259455] scsi 0:0:116:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 22.282122] mpt3sas_cm0: detecting: handle(0x00ba), sas_address(0x5000c5009543222d), phy(55) [ 22.290563] mpt3sas_cm0: REPORT_LUNS: handle(0x00ba), retries(0) [ 22.297128] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00ba), lun(0) [ 22.554289] scsi 0:0:117:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 22.563049] scsi 0:0:117:0: SSP: handle(0x00ba), sas_addr(0x5000c5009543222d), phy(55), device_name(0x5000c5009543222c) [ 22.573823] scsi 0:0:117:0: enclosure logical id(0x500163600190cd7d), slot(55) [ 22.581129] scsi 0:0:117:0: enclosure level(0x0000), connector name( C3 ) [ 22.588008] scsi 0:0:117:0: serial_number(ZA1AGH6Q0000C8316FPY) [ 22.593931] scsi 0:0:117:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 22.617128] mpt3sas_cm0: detecting: handle(0x00c3), sas_address(0x5000c50095372625), phy(56) [ 22.625569] mpt3sas_cm0: REPORT_LUNS: handle(0x00c3), retries(0) [ 22.647204] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00c3), lun(0) [ 22.654317] scsi 0:0:118:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 22.662983] scsi 0:0:118:0: SSP: handle(0x00c3), sas_addr(0x5000c50095372625), phy(56), device_name(0x5000c50095372624) [ 22.673760] scsi 0:0:118:0: enclosure logical id(0x500163600190cd7d), slot(56) [ 22.681065] scsi 0:0:118:0: enclosure level(0x0000), connector name( C3 ) [ 22.687958] scsi 0:0:118:0: serial_number(ZA1ABZ4Y0000R829D6VF) [ 22.693876] scsi 0:0:118:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 22.717125] mpt3sas_cm0: detecting: handle(0x00c4), sas_address(0x5000c50095430cb1), phy(57) [ 22.725565] mpt3sas_cm0: REPORT_LUNS: handle(0x00c4), retries(0) [ 22.743707] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00c4), lun(0) [ 22.750855] scsi 0:0:119:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 22.759521] scsi 0:0:119:0: SSP: handle(0x00c4), sas_addr(0x5000c50095430cb1), phy(57), device_name(0x5000c50095430cb0) [ 22.770291] scsi 0:0:119:0: enclosure logical id(0x500163600190cd7d), slot(57) [ 22.777596] scsi 0:0:119:0: enclosure level(0x0000), connector name( C3 ) [ 22.784487] scsi 0:0:119:0: serial_number(ZA1AGHLV0000R823QBK4) [ 22.790409] scsi 0:0:119:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 22.813129] mpt3sas_cm0: detecting: handle(0x00c5), sas_address(0x5000c50095430c31), phy(58) [ 22.821570] mpt3sas_cm0: REPORT_LUNS: handle(0x00c5), retries(0) [ 22.828141] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00c5), lun(0) [ 23.083432] scsi 0:0:120:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 23.092193] scsi 0:0:120:0: SSP: handle(0x00c5), sas_addr(0x5000c50095430c31), phy(58), device_name(0x5000c50095430c30) [ 23.102963] scsi 0:0:120:0: enclosure logical id(0x500163600190cd7d), slot(58) [ 23.110271] scsi 0:0:120:0: enclosure level(0x0000), connector name( C3 ) [ 23.117148] scsi 0:0:120:0: serial_number(ZA1AGHMK0000R824E79X) [ 23.123073] scsi 0:0:120:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 23.146138] mpt3sas_cm0: detecting: handle(0x00c6), sas_address(0x5000c500954327cd), phy(59) [ 23.154580] mpt3sas_cm0: REPORT_LUNS: handle(0x00c6), retries(0) [ 23.161143] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00c6), lun(0) [ 23.420083] scsi 0:0:121:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 23.428845] scsi 0:0:121:0: SSP: handle(0x00c6), sas_addr(0x5000c500954327cd), phy(59), device_name(0x5000c500954327cc) [ 23.439616] scsi 0:0:121:0: enclosure logical id(0x500163600190cd7d), slot(59) [ 23.446921] scsi 0:0:121:0: enclosure level(0x0000), connector name( C3 ) [ 23.453799] scsi 0:0:121:0: serial_number(ZA1AGGPH0000R829CU4W) [ 23.459718] scsi 0:0:121:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 23.484285] mpt3sas_cm0: detecting: handle(0x00cd), sas_address(0x500163600190cd7d), phy(76) [ 23.492739] mpt3sas_cm0: REPORT_LUNS: handle(0x00cd), retries(0) [ 23.498932] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00cd), lun(0) [ 23.505436] scsi 0:0:122:0: Enclosure QCT JB4602 SIM 0 1500 PQ: 0 ANSI: 6 [ 23.513901] scsi 0:0:122:0: set ignore_delay_remove for handle(0x00cd) [ 23.520425] scsi 0:0:122:0: SES: handle(0x00cd), sas_addr(0x500163600190cd7d), phy(76), device_name(0x500163600190cd7d) [ 23.531198] scsi 0:0:122:0: enclosure logical id(0x500163600190cd7d), slot(60) [ 23.538504] scsi 0:0:122:0: enclosure level(0x0000), connector name( C3 ) [ 23.545399] scsi 0:0:122:0: serial_number(EO0152000043 ) [ 23.550982] scsi 0:0:122:0: qdepth(1), tagged(0), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 23.573551] mpt3sas_cm0: expander_add: handle(0x0052), parent(0x000a), sas_addr(0x5001636001a0673f), phys(79) [ 23.598564] mpt3sas_cm0: detecting: handle(0x005b), sas_address(0x5000c500954327d2), phy(0) [ 23.606923] mpt3sas_cm0: REPORT_LUNS: handle(0x005b), retries(0) [ 23.621866] mpt3sas_cm0: TEST_UNIT_READY: handle(0x005b), lun(0) [ 23.629144] scsi 0:0:123:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 23.637810] scsi 0:0:123:0: SSP: handle(0x005b), sas_addr(0x5000c500954327d2), phy(0), device_name(0x5000c500954327d0) [ 23.648497] scsi 0:0:123:0: enclosure logical id(0x5001636001a0673d), slot(0) [ 23.655714] scsi 0:0:123:0: enclosure level(0x0000), connector name( C0 ) [ 23.662606] scsi 0:0:123:0: serial_number(ZA1AGGPM0000R829CTE6) [ 23.668528] scsi 0:0:123:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 23.691143] mpt3sas_cm0: detecting: handle(0x005c), sas_address(0x5000c5009543210e), phy(1) [ 23.699495] mpt3sas_cm0: REPORT_LUNS: handle(0x005c), retries(0) [ 23.711404] mpt3sas_cm0: TEST_UNIT_READY: handle(0x005c), lun(0) [ 23.718583] scsi 0:0:124:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 23.727244] scsi 0:0:124:0: SSP: handle(0x005c), sas_addr(0x5000c5009543210e), phy(1), device_name(0x5000c5009543210c) [ 23.737928] scsi 0:0:124:0: enclosure logical id(0x5001636001a0673d), slot(1) [ 23.745145] scsi 0:0:124:0: enclosure level(0x0000), connector name( C0 ) [ 23.752041] scsi 0:0:124:0: serial_number(ZA1AGGYR0000C72542A6) [ 23.757957] scsi 0:0:124:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 23.781138] mpt3sas_cm0: detecting: handle(0x005d), sas_address(0x5000c500954322be), phy(2) [ 23.789490] mpt3sas_cm0: REPORT_LUNS: handle(0x005d), retries(0) [ 23.807416] mpt3sas_cm0: TEST_UNIT_READY: handle(0x005d), lun(0) [ 23.814558] scsi 0:0:125:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 23.823221] scsi 0:0:125:0: SSP: handle(0x005d), sas_addr(0x5000c500954322be), phy(2), device_name(0x5000c500954322bc) [ 23.833904] scsi 0:0:125:0: enclosure logical id(0x5001636001a0673d), slot(2) [ 23.841121] scsi 0:0:125:0: enclosure level(0x0000), connector name( C0 ) [ 23.848017] scsi 0:0:125:0: serial_number(ZA1AGGX60000R70426B4) [ 23.853944] scsi 0:0:125:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 23.877143] mpt3sas_cm0: detecting: handle(0x005e), sas_address(0x5000c50095431eee), phy(3) [ 23.885490] mpt3sas_cm0: REPORT_LUNS: handle(0x005e), retries(0) [ 23.902683] mpt3sas_cm0: TEST_UNIT_READY: handle(0x005e), lun(0) [ 23.909799] scsi 0:0:126:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 23.918460] scsi 0:0:126:0: SSP: handle(0x005e), sas_addr(0x5000c50095431eee), phy(3), device_name(0x5000c50095431eec) [ 23.929142] scsi 0:0:126:0: enclosure logical id(0x5001636001a0673d), slot(3) [ 23.936360] scsi 0:0:126:0: enclosure level(0x0000), connector name( C0 ) [ 23.943254] scsi 0:0:126:0: serial_number(ZA1AGH0M0000C8316G8B) [ 23.949173] scsi 0:0:126:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 23.972141] mpt3sas_cm0: detecting: handle(0x005f), sas_address(0x5000c500954307ea), phy(4) [ 23.980488] mpt3sas_cm0: REPORT_LUNS: handle(0x005f), retries(0) [ 24.001584] mpt3sas_cm0: TEST_UNIT_READY: handle(0x005f), lun(0) [ 24.008764] scsi 0:0:127:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 24.017430] scsi 0:0:127:0: SSP: handle(0x005f), sas_addr(0x5000c500954307ea), phy(4), device_name(0x5000c500954307e8) [ 24.028116] scsi 0:0:127:0: enclosure logical id(0x5001636001a0673d), slot(4) [ 24.035335] scsi 0:0:127:0: enclosure level(0x0000), connector name( C0 ) [ 24.042228] scsi 0:0:127:0: serial_number(ZA1AG8FH0000R8301BKX) [ 24.048147] scsi 0:0:127:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 24.073142] mpt3sas_cm0: detecting: handle(0x0060), sas_address(0x5000c500954d3c9e), phy(5) [ 24.081493] mpt3sas_cm0: REPORT_LUNS: handle(0x0060), retries(0) [ 24.087986] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0060), lun(0) [ 24.095127] scsi 0:0:128:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 24.103792] scsi 0:0:128:0: SSP: handle(0x0060), sas_addr(0x5000c500954d3c9e), phy(5), device_name(0x5000c500954d3c9c) [ 24.114482] scsi 0:0:128:0: enclosure logical id(0x5001636001a0673d), slot(5) [ 24.121701] scsi 0:0:128:0: enclosure level(0x0000), connector name( C0 ) [ 24.128593] scsi 0:0:128:0: serial_number(ZA1ALXTG0000R8314UFV) [ 24.134511] scsi 0:0:128:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 24.160145] mpt3sas_cm0: detecting: handle(0x0061), sas_address(0x5000c5009537de22), phy(6) [ 24.168499] mpt3sas_cm0: REPORT_LUNS: handle(0x0061), retries(0) [ 24.182024] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0061), lun(0) [ 24.189136] scsi 0:0:129:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 24.197793] scsi 0:0:129:0: SSP: handle(0x0061), sas_addr(0x5000c5009537de22), phy(6), device_name(0x5000c5009537de20) [ 24.208480] scsi 0:0:129:0: enclosure logical id(0x5001636001a0673d), slot(6) [ 24.215699] scsi 0:0:129:0: enclosure level(0x0000), connector name( C0 ) [ 24.222593] scsi 0:0:129:0: serial_number(ZA1ACKPT0000R828A04K) [ 24.228511] scsi 0:0:129:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 24.251142] mpt3sas_cm0: detecting: handle(0x0062), sas_address(0x5000c500954cd562), phy(7) [ 24.259493] mpt3sas_cm0: REPORT_LUNS: handle(0x0062), retries(0) [ 24.275049] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0062), lun(0) [ 24.282181] scsi 0:0:130:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 24.290842] scsi 0:0:130:0: SSP: handle(0x0062), sas_addr(0x5000c500954cd562), phy(7), device_name(0x5000c500954cd560) [ 24.301527] scsi 0:0:130:0: enclosure logical id(0x5001636001a0673d), slot(7) [ 24.308746] scsi 0:0:130:0: enclosure level(0x0000), connector name( C0 ) [ 24.315642] scsi 0:0:130:0: serial_number(ZA1ALGB20000R8314QNY) [ 24.321566] scsi 0:0:130:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 24.345141] mpt3sas_cm0: detecting: handle(0x006b), sas_address(0x5000c500954d2eda), phy(8) [ 24.353490] mpt3sas_cm0: REPORT_LUNS: handle(0x006b), retries(0) [ 24.367213] mpt3sas_cm0: TEST_UNIT_READY: handle(0x006b), lun(0) [ 24.374360] scsi 0:0:131:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 24.383029] scsi 0:0:131:0: SSP: handle(0x006b), sas_addr(0x5000c500954d2eda), phy(8), device_name(0x5000c500954d2ed8) [ 24.393716] scsi 0:0:131:0: enclosure logical id(0x5001636001a0673d), slot(8) [ 24.400935] scsi 0:0:131:0: enclosure level(0x0000), connector name( C0 ) [ 24.407828] scsi 0:0:131:0: serial_number(ZA1ALV4P0000R830XC2X) [ 24.413746] scsi 0:0:131:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 24.437163] mpt3sas_cm0: detecting: handle(0x006c), sas_address(0x5000c50095430afe), phy(9) [ 24.445514] mpt3sas_cm0: REPORT_LUNS: handle(0x006c), retries(0) [ 24.458678] mpt3sas_cm0: TEST_UNIT_READY: handle(0x006c), lun(0) [ 24.465827] scsi 0:0:132:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 24.474488] scsi 0:0:132:0: SSP: handle(0x006c), sas_addr(0x5000c50095430afe), phy(9), device_name(0x5000c50095430afc) [ 24.485177] scsi 0:0:132:0: enclosure logical id(0x5001636001a0673d), slot(9) [ 24.492394] scsi 0:0:132:0: enclosure level(0x0000), connector name( C0 ) [ 24.499287] scsi 0:0:132:0: serial_number(ZA1ABZKP0000R8301BVX) [ 24.505206] scsi 0:0:132:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 24.528159] mpt3sas_cm0: detecting: handle(0x006d), sas_address(0x5000c500954303fa), phy(10) [ 24.536600] mpt3sas_cm0: REPORT_LUNS: handle(0x006d), retries(0) [ 24.552676] mpt3sas_cm0: TEST_UNIT_READY: handle(0x006d), lun(0) [ 24.559812] scsi 0:0:133:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 24.568472] scsi 0:0:133:0: SSP: handle(0x006d), sas_addr(0x5000c500954303fa), phy(10), device_name(0x5000c500954303f8) [ 24.579246] scsi 0:0:133:0: enclosure logical id(0x5001636001a0673d), slot(10) [ 24.586552] scsi 0:0:133:0: enclosure level(0x0000), connector name( C0 ) [ 24.593444] scsi 0:0:133:0: serial_number(ZA1AG8K80000C8316HBT) [ 24.599363] scsi 0:0:133:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 24.622147] mpt3sas_cm0: detecting: handle(0x006e), sas_address(0x5000c50095431ea6), phy(11) [ 24.630584] mpt3sas_cm0: REPORT_LUNS: handle(0x006e), retries(0) [ 24.649004] mpt3sas_cm0: TEST_UNIT_READY: handle(0x006e), lun(0) [ 24.656133] scsi 0:0:134:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 24.664792] scsi 0:0:134:0: SSP: handle(0x006e), sas_addr(0x5000c50095431ea6), phy(11), device_name(0x5000c50095431ea4) [ 24.675568] scsi 0:0:134:0: enclosure logical id(0x5001636001a0673d), slot(11) [ 24.682873] scsi 0:0:134:0: enclosure level(0x0000), connector name( C0 ) [ 24.689767] scsi 0:0:134:0: serial_number(ZA1AGN3P0000R829D5A4) [ 24.695686] scsi 0:0:134:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 24.719151] mpt3sas_cm0: detecting: handle(0x006f), sas_address(0x5000c5009542c79e), phy(12) [ 24.727591] mpt3sas_cm0: REPORT_LUNS: handle(0x006f), retries(0) [ 24.734156] mpt3sas_cm0: TEST_UNIT_READY: handle(0x006f), lun(0) [ 24.741304] scsi 0:0:135:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 24.749969] scsi 0:0:135:0: SSP: handle(0x006f), sas_addr(0x5000c5009542c79e), phy(12), device_name(0x5000c5009542c79c) [ 24.760744] scsi 0:0:135:0: enclosure logical id(0x5001636001a0673d), slot(12) [ 24.768050] scsi 0:0:135:0: enclosure level(0x0000), connector name( C0 ) [ 24.774945] scsi 0:0:135:0: serial_number(ZA1AGACY0000R8301U8F) [ 24.780863] scsi 0:0:135:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 24.804163] mpt3sas_cm0: detecting: handle(0x0070), sas_address(0x5000c50095431552), phy(13) [ 24.812603] mpt3sas_cm0: REPORT_LUNS: handle(0x0070), retries(0) [ 24.819396] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0070), lun(0) [ 24.826558] scsi 0:0:136:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 24.835222] scsi 0:0:136:0: SSP: handle(0x0070), sas_addr(0x5000c50095431552), phy(13), device_name(0x5000c50095431550) [ 24.845991] scsi 0:0:136:0: enclosure logical id(0x5001636001a0673d), slot(13) [ 24.853298] scsi 0:0:136:0: enclosure level(0x0000), connector name( C0 ) [ 24.860191] scsi 0:0:136:0: serial_number(ZA1AFWDA0000C83153E9) [ 24.866110] scsi 0:0:136:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 24.890152] mpt3sas_cm0: detecting: handle(0x0071), sas_address(0x5000c5009543270e), phy(14) [ 24.898588] mpt3sas_cm0: REPORT_LUNS: handle(0x0071), retries(0) [ 24.913555] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0071), lun(0) [ 24.920681] scsi 0:0:137:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 24.929341] scsi 0:0:137:0: SSP: handle(0x0071), sas_addr(0x5000c5009543270e), phy(14), device_name(0x5000c5009543270c) [ 24.940112] scsi 0:0:137:0: enclosure logical id(0x5001636001a0673d), slot(14) [ 24.947420] scsi 0:0:137:0: enclosure level(0x0000), connector name( C0 ) [ 24.954313] scsi 0:0:137:0: serial_number(ZA1AGGQF0000C83153PC) [ 24.960231] scsi 0:0:137:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 24.983146] mpt3sas_cm0: detecting: handle(0x0072), sas_address(0x5000c5009543269e), phy(15) [ 24.991584] mpt3sas_cm0: REPORT_LUNS: handle(0x0072), retries(0) [ 25.012287] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0072), lun(0) [ 25.019425] scsi 0:0:138:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 25.028086] scsi 0:0:138:0: SSP: handle(0x0072), sas_addr(0x5000c5009543269e), phy(15), device_name(0x5000c5009543269c) [ 25.038861] scsi 0:0:138:0: enclosure logical id(0x5001636001a0673d), slot(15) [ 25.046169] scsi 0:0:138:0: enclosure level(0x0000), connector name( C0 ) [ 25.053064] scsi 0:0:138:0: serial_number(ZA1AGGVJ0000R829CUL1) [ 25.058990] scsi 0:0:138:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 25.086156] mpt3sas_cm0: detecting: handle(0x007b), sas_address(0x5000c500954306fa), phy(16) [ 25.094597] mpt3sas_cm0: REPORT_LUNS: handle(0x007b), retries(0) [ 25.116385] mpt3sas_cm0: TEST_UNIT_READY: handle(0x007b), lun(0) [ 25.123549] scsi 0:0:139:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 25.132206] scsi 0:0:139:0: SSP: handle(0x007b), sas_addr(0x5000c500954306fa), phy(16), device_name(0x5000c500954306f8) [ 25.142976] scsi 0:0:139:0: enclosure logical id(0x5001636001a0673d), slot(16) [ 25.150283] scsi 0:0:139:0: enclosure level(0x0000), connector name( C0 ) [ 25.157177] scsi 0:0:139:0: serial_number(ZA1AG8GS0000R8301BGG) [ 25.163094] scsi 0:0:139:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 25.186154] mpt3sas_cm0: detecting: handle(0x007c), sas_address(0x5000c500954d3a86), phy(17) [ 25.194593] mpt3sas_cm0: REPORT_LUNS: handle(0x007c), retries(0) [ 25.214638] mpt3sas_cm0: TEST_UNIT_READY: handle(0x007c), lun(0) [ 25.221784] scsi 0:0:140:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 25.230451] scsi 0:0:140:0: SSP: handle(0x007c), sas_addr(0x5000c500954d3a86), phy(17), device_name(0x5000c500954d3a84) [ 25.241223] scsi 0:0:140:0: enclosure logical id(0x5001636001a0673d), slot(17) [ 25.248529] scsi 0:0:140:0: enclosure level(0x0000), connector name( C0 ) [ 25.255420] scsi 0:0:140:0: serial_number(ZA1ALTNS0000R8314U9A) [ 25.261342] scsi 0:0:140:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 25.284150] mpt3sas_cm0: detecting: handle(0x007d), sas_address(0x5000c500954d972a), phy(18) [ 25.292588] mpt3sas_cm0: REPORT_LUNS: handle(0x007d), retries(0) [ 25.311803] mpt3sas_cm0: TEST_UNIT_READY: handle(0x007d), lun(0) [ 25.318935] scsi 0:0:141:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 25.327603] scsi 0:0:141:0: SSP: handle(0x007d), sas_addr(0x5000c500954d972a), phy(18), device_name(0x5000c500954d9728) [ 25.338378] scsi 0:0:141:0: enclosure logical id(0x5001636001a0673d), slot(18) [ 25.345682] scsi 0:0:141:0: enclosure level(0x0000), connector name( C0 ) [ 25.352576] scsi 0:0:141:0: serial_number(ZA1AM3T00000R8314URZ) [ 25.358496] scsi 0:0:141:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 25.381156] mpt3sas_cm0: detecting: handle(0x007e), sas_address(0x5000c5009543190e), phy(19) [ 25.389594] mpt3sas_cm0: REPORT_LUNS: handle(0x007e), retries(0) [ 25.396152] mpt3sas_cm0: TEST_UNIT_READY: handle(0x007e), lun(0) [ 25.403463] scsi 0:0:142:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 25.412129] scsi 0:0:142:0: SSP: handle(0x007e), sas_addr(0x5000c5009543190e), phy(19), device_name(0x5000c5009543190c) [ 25.422904] scsi 0:0:142:0: enclosure logical id(0x5001636001a0673d), slot(19) [ 25.430210] scsi 0:0:142:0: enclosure level(0x0000), connector name( C0 ) [ 25.437104] scsi 0:0:142:0: serial_number(ZA1AFH3W0000C8316GJ6) [ 25.443021] scsi 0:0:142:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 25.466156] mpt3sas_cm0: detecting: handle(0x007f), sas_address(0x5000c500954325c2), phy(20) [ 25.474590] mpt3sas_cm0: REPORT_LUNS: handle(0x007f), retries(0) [ 25.481150] mpt3sas_cm0: TEST_UNIT_READY: handle(0x007f), lun(0) [ 25.488289] scsi 0:0:143:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 25.496943] scsi 0:0:143:0: SSP: handle(0x007f), sas_addr(0x5000c500954325c2), phy(20), device_name(0x5000c500954325c0) [ 25.507716] scsi 0:0:143:0: enclosure logical id(0x5001636001a0673d), slot(20) [ 25.515024] scsi 0:0:143:0: enclosure level(0x0000), connector name( C0 ) [ 25.521916] scsi 0:0:143:0: serial_number(ZA1AGGV20000R829CG7B) [ 25.527835] scsi 0:0:143:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 25.551161] mpt3sas_cm0: detecting: handle(0x0080), sas_address(0x5000c50095431ef6), phy(21) [ 25.559602] mpt3sas_cm0: REPORT_LUNS: handle(0x0080), retries(0) [ 25.575526] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0080), lun(0) [ 25.582692] scsi 0:0:144:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 25.591356] scsi 0:0:144:0: SSP: handle(0x0080), sas_addr(0x5000c50095431ef6), phy(21), device_name(0x5000c50095431ef4) [ 25.602133] scsi 0:0:144:0: enclosure logical id(0x5001636001a0673d), slot(21) [ 25.609439] scsi 0:0:144:0: enclosure level(0x0000), connector name( C0 ) [ 25.616332] scsi 0:0:144:0: serial_number(ZA1AGH4R0000C72541L0) [ 25.622251] scsi 0:0:144:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 25.647751] mpt3sas_cm0: detecting: handle(0x0081), sas_address(0x5000c500954328c2), phy(22) [ 25.656196] mpt3sas_cm0: REPORT_LUNS: handle(0x0081), retries(0) [ 25.670779] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0081), lun(0) [ 25.677900] scsi 0:0:145:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 25.686556] scsi 0:0:145:0: SSP: handle(0x0081), sas_addr(0x5000c500954328c2), phy(22), device_name(0x5000c500954328c0) [ 25.697329] scsi 0:0:145:0: enclosure logical id(0x5001636001a0673d), slot(22) [ 25.704635] scsi 0:0:145:0: enclosure level(0x0000), connector name( C0 ) [ 25.711527] scsi 0:0:145:0: serial_number(ZA1AGGMS0000C8316FAT) [ 25.717447] scsi 0:0:145:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 25.740153] mpt3sas_cm0: detecting: handle(0x0082), sas_address(0x5000c50095431c8e), phy(23) [ 25.748593] mpt3sas_cm0: REPORT_LUNS: handle(0x0082), retries(0) [ 25.763862] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0082), lun(0) [ 25.770999] scsi 0:0:146:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 25.779656] scsi 0:0:146:0: SSP: handle(0x0082), sas_addr(0x5000c50095431c8e), phy(23), device_name(0x5000c50095431c8c) [ 25.790428] scsi 0:0:146:0: enclosure logical id(0x5001636001a0673d), slot(23) [ 25.797733] scsi 0:0:146:0: enclosure level(0x0000), connector name( C0 ) [ 25.804625] scsi 0:0:146:0: serial_number(ZA1AGH310000R727Y825) [ 25.810545] scsi 0:0:146:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 25.834159] mpt3sas_cm0: detecting: handle(0x008b), sas_address(0x5000c50095430e76), phy(24) [ 25.842600] mpt3sas_cm0: REPORT_LUNS: handle(0x008b), retries(0) [ 25.855826] mpt3sas_cm0: TEST_UNIT_READY: handle(0x008b), lun(0) [ 25.862990] scsi 0:0:147:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 25.871643] scsi 0:0:147:0: SSP: handle(0x008b), sas_addr(0x5000c50095430e76), phy(24), device_name(0x5000c50095430e74) [ 25.882416] scsi 0:0:147:0: enclosure logical id(0x5001636001a0673d), slot(24) [ 25.889721] scsi 0:0:147:0: enclosure level(0x0000), connector name( C0 ) [ 25.896616] scsi 0:0:147:0: serial_number(ZA1AGHKG0000R829D7P9) [ 25.902536] scsi 0:0:147:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 25.925156] mpt3sas_cm0: detecting: handle(0x008c), sas_address(0x5000c500954cec32), phy(25) [ 25.933593] mpt3sas_cm0: REPORT_LUNS: handle(0x008c), retries(0) [ 25.953993] mpt3sas_cm0: TEST_UNIT_READY: handle(0x008c), lun(0) [ 25.961161] scsi 0:0:148:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 25.969824] scsi 0:0:148:0: SSP: handle(0x008c), sas_addr(0x5000c500954cec32), phy(25), device_name(0x5000c500954cec30) [ 25.980593] scsi 0:0:148:0: enclosure logical id(0x5001636001a0673d), slot(25) [ 25.987899] scsi 0:0:148:0: enclosure level(0x0000), connector name( C0 ) [ 25.994792] scsi 0:0:148:0: serial_number(ZA1ALFQC0000R8314S0C) [ 26.000712] scsi 0:0:148:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 26.024159] mpt3sas_cm0: detecting: handle(0x008d), sas_address(0x5000c500954d2d0e), phy(26) [ 26.032602] mpt3sas_cm0: REPORT_LUNS: handle(0x008d), retries(0) [ 26.050071] mpt3sas_cm0: TEST_UNIT_READY: handle(0x008d), lun(0) [ 26.057206] scsi 0:0:149:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 26.065872] scsi 0:0:149:0: SSP: handle(0x008d), sas_addr(0x5000c500954d2d0e), phy(26), device_name(0x5000c500954d2d0c) [ 26.076648] scsi 0:0:149:0: enclosure logical id(0x5001636001a0673d), slot(26) [ 26.083955] scsi 0:0:149:0: enclosure level(0x0000), connector name( C0 ) [ 26.090847] scsi 0:0:149:0: serial_number(ZA1ALV770000R8314TF5) [ 26.096766] scsi 0:0:149:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 26.120163] mpt3sas_cm0: detecting: handle(0x008e), sas_address(0x5000c500954de6be), phy(27) [ 26.128602] mpt3sas_cm0: REPORT_LUNS: handle(0x008e), retries(0) [ 26.140673] mpt3sas_cm0: TEST_UNIT_READY: handle(0x008e), lun(0) [ 26.147814] scsi 0:0:150:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 26.156472] scsi 0:0:150:0: SSP: handle(0x008e), sas_addr(0x5000c500954de6be), phy(27), device_name(0x5000c500954de6bc) [ 26.167242] scsi 0:0:150:0: enclosure logical id(0x5001636001a0673d), slot(27) [ 26.174548] scsi 0:0:150:0: enclosure level(0x0000), connector name( C0 ) [ 26.181440] scsi 0:0:150:0: serial_number(ZA1AM5MM0000R8317PAM) [ 26.187359] scsi 0:0:150:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 26.211169] mpt3sas_cm0: detecting: handle(0x008f), sas_address(0x5000c500954321ce), phy(28) [ 26.219605] mpt3sas_cm0: REPORT_LUNS: handle(0x008f), retries(0) [ 26.232172] mpt3sas_cm0: TEST_UNIT_READY: handle(0x008f), lun(0) [ 26.239319] scsi 0:0:151:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 26.247991] scsi 0:0:151:0: SSP: handle(0x008f), sas_addr(0x5000c500954321ce), phy(28), device_name(0x5000c500954321cc) [ 26.258764] scsi 0:0:151:0: enclosure logical id(0x5001636001a0673d), slot(28) [ 26.266070] scsi 0:0:151:0: enclosure level(0x0000), connector name( C0 ) [ 26.272963] scsi 0:0:151:0: serial_number(ZA1AGN0J0000R8288A2R) [ 26.278882] scsi 0:0:151:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 26.302162] mpt3sas_cm0: detecting: handle(0x0090), sas_address(0x5000c5009542a60e), phy(29) [ 26.310607] mpt3sas_cm0: REPORT_LUNS: handle(0x0090), retries(0) [ 26.317203] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0090), lun(0) [ 26.324350] scsi 0:0:152:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 26.333013] scsi 0:0:152:0: SSP: handle(0x0090), sas_addr(0x5000c5009542a60e), phy(29), device_name(0x5000c5009542a60c) [ 26.343784] scsi 0:0:152:0: enclosure logical id(0x5001636001a0673d), slot(29) [ 26.351091] scsi 0:0:152:0: enclosure level(0x0000), connector name( C0 ) [ 26.357985] scsi 0:0:152:0: serial_number(ZA1AG6DF0000R829CG6J) [ 26.363902] scsi 0:0:152:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 26.387166] mpt3sas_cm0: detecting: handle(0x0091), sas_address(0x5000c5009543226a), phy(30) [ 26.395610] mpt3sas_cm0: REPORT_LUNS: handle(0x0091), retries(0) [ 26.407533] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0091), lun(0) [ 26.414669] scsi 0:0:153:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 26.423331] scsi 0:0:153:0: SSP: handle(0x0091), sas_addr(0x5000c5009543226a), phy(30), device_name(0x5000c50095432268) [ 26.434101] scsi 0:0:153:0: enclosure logical id(0x5001636001a0673d), slot(30) [ 26.441405] scsi 0:0:153:0: enclosure level(0x0000), connector name( C0 ) [ 26.448298] scsi 0:0:153:0: serial_number(ZA1AGGXE0000R735TYMG) [ 26.454219] scsi 0:0:153:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 26.477161] mpt3sas_cm0: detecting: handle(0x0092), sas_address(0x5000c500953816ee), phy(31) [ 26.485596] mpt3sas_cm0: REPORT_LUNS: handle(0x0092), retries(0) [ 26.507217] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0092), lun(0) [ 26.514343] scsi 0:0:154:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 26.523008] scsi 0:0:154:0: SSP: handle(0x0092), sas_addr(0x5000c500953816ee), phy(31), device_name(0x5000c500953816ec) [ 26.533776] scsi 0:0:154:0: enclosure logical id(0x5001636001a0673d), slot(31) [ 26.541083] scsi 0:0:154:0: enclosure level(0x0000), connector name( C0 ) [ 26.547979] scsi 0:0:154:0: serial_number(ZA1ACHTF0000R82892CY) [ 26.553909] scsi 0:0:154:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 26.577164] mpt3sas_cm0: detecting: handle(0x009b), sas_address(0x5000c500954321a6), phy(32) [ 26.585602] mpt3sas_cm0: REPORT_LUNS: handle(0x009b), retries(0) [ 26.596568] mpt3sas_cm0: TEST_UNIT_READY: handle(0x009b), lun(0) [ 26.603703] scsi 0:0:155:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 26.612365] scsi 0:0:155:0: SSP: handle(0x009b), sas_addr(0x5000c500954321a6), phy(32), device_name(0x5000c500954321a4) [ 26.623140] scsi 0:0:155:0: enclosure logical id(0x5001636001a0673d), slot(32) [ 26.630447] scsi 0:0:155:0: enclosure level(0x0000), connector name( C0 ) [ 26.637340] scsi 0:0:155:0: serial_number(ZA1AGGY00000C724RWTP) [ 26.643257] scsi 0:0:155:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 26.666173] mpt3sas_cm0: detecting: handle(0x009c), sas_address(0x5000c5009538bc36), phy(33) [ 26.674610] mpt3sas_cm0: REPORT_LUNS: handle(0x009c), retries(0) [ 26.695760] mpt3sas_cm0: TEST_UNIT_READY: handle(0x009c), lun(0) [ 26.702900] scsi 0:0:156:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 26.711560] scsi 0:0:156:0: SSP: handle(0x009c), sas_addr(0x5000c5009538bc36), phy(33), device_name(0x5000c5009538bc34) [ 26.722331] scsi 0:0:156:0: enclosure logical id(0x5001636001a0673d), slot(33) [ 26.729637] scsi 0:0:156:0: enclosure level(0x0000), connector name( C0 ) [ 26.736529] scsi 0:0:156:0: serial_number(ZA1A9XY50000R8289594) [ 26.742449] scsi 0:0:156:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 26.765168] mpt3sas_cm0: detecting: handle(0x009d), sas_address(0x5000c500954325d6), phy(34) [ 26.773611] mpt3sas_cm0: REPORT_LUNS: handle(0x009d), retries(0) [ 26.780163] mpt3sas_cm0: TEST_UNIT_READY: handle(0x009d), lun(0) [ 26.787298] scsi 0:0:157:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 26.795955] scsi 0:0:157:0: SSP: handle(0x009d), sas_addr(0x5000c500954325d6), phy(34), device_name(0x5000c500954325d4) [ 26.806728] scsi 0:0:157:0: enclosure logical id(0x5001636001a0673d), slot(34) [ 26.814035] scsi 0:0:157:0: enclosure level(0x0000), connector name( C0 ) [ 26.820926] scsi 0:0:157:0: serial_number(ZA1AGGSE0000R829CGBW) [ 26.826847] scsi 0:0:157:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 26.850165] mpt3sas_cm0: detecting: handle(0x009e), sas_address(0x5000c50095430222), phy(35) [ 26.858605] mpt3sas_cm0: REPORT_LUNS: handle(0x009e), retries(0) [ 26.869972] mpt3sas_cm0: TEST_UNIT_READY: handle(0x009e), lun(0) [ 26.877112] scsi 0:0:158:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 26.885771] scsi 0:0:158:0: SSP: handle(0x009e), sas_addr(0x5000c50095430222), phy(35), device_name(0x5000c50095430220) [ 26.896542] scsi 0:0:158:0: enclosure logical id(0x5001636001a0673d), slot(35) [ 26.903847] scsi 0:0:158:0: enclosure level(0x0000), connector name( C0 ) [ 26.910741] scsi 0:0:158:0: serial_number(ZA1AG8NE0000C8316HG9) [ 26.916660] scsi 0:0:158:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 26.941165] mpt3sas_cm0: detecting: handle(0x009f), sas_address(0x5000c500953ad692), phy(36) [ 26.949605] mpt3sas_cm0: REPORT_LUNS: handle(0x009f), retries(0) [ 26.966717] mpt3sas_cm0: TEST_UNIT_READY: handle(0x009f), lun(0) [ 26.973867] scsi 0:0:159:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 26.982529] scsi 0:0:159:0: SSP: handle(0x009f), sas_addr(0x5000c500953ad692), phy(36), device_name(0x5000c500953ad690) [ 26.993299] scsi 0:0:159:0: enclosure logical id(0x5001636001a0673d), slot(36) [ 27.000604] scsi 0:0:159:0: enclosure level(0x0000), connector name( C0 ) [ 27.007497] scsi 0:0:159:0: serial_number(ZA1ADPEX0000R8301P5K) [ 27.013416] scsi 0:0:159:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 27.036166] mpt3sas_cm0: detecting: handle(0x00a0), sas_address(0x5000c500953ad5b6), phy(37) [ 27.044602] mpt3sas_cm0: REPORT_LUNS: handle(0x00a0), retries(0) [ 27.065842] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00a0), lun(0) [ 27.072975] scsi 0:0:160:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 27.081632] scsi 0:0:160:0: SSP: handle(0x00a0), sas_addr(0x5000c500953ad5b6), phy(37), device_name(0x5000c500953ad5b4) [ 27.092402] scsi 0:0:160:0: enclosure logical id(0x5001636001a0673d), slot(37) [ 27.099710] scsi 0:0:160:0: enclosure level(0x0000), connector name( C0 ) [ 27.106600] scsi 0:0:160:0: serial_number(ZA1ADPDH0000R83027NK) [ 27.112522] scsi 0:0:160:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 27.140177] mpt3sas_cm0: detecting: handle(0x00a1), sas_address(0x5000c50095431bf2), phy(38) [ 27.148612] mpt3sas_cm0: REPORT_LUNS: handle(0x00a1), retries(0) [ 27.168638] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00a1), lun(0) [ 27.175759] scsi 0:0:161:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 27.184421] scsi 0:0:161:0: SSP: handle(0x00a1), sas_addr(0x5000c50095431bf2), phy(38), device_name(0x5000c50095431bf0) [ 27.195190] scsi 0:0:161:0: enclosure logical id(0x5001636001a0673d), slot(38) [ 27.202496] scsi 0:0:161:0: enclosure level(0x0000), connector name( C0 ) [ 27.209389] scsi 0:0:161:0: serial_number(ZA1AGH5T0000R8300NS1) [ 27.215309] scsi 0:0:161:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 27.238166] mpt3sas_cm0: detecting: handle(0x00a2), sas_address(0x5000c50095430ede), phy(39) [ 27.246609] mpt3sas_cm0: REPORT_LUNS: handle(0x00a2), retries(0) [ 27.264107] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00a2), lun(0) [ 27.271232] scsi 0:0:162:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 27.279897] scsi 0:0:162:0: SSP: handle(0x00a2), sas_addr(0x5000c50095430ede), phy(39), device_name(0x5000c50095430edc) [ 27.290672] scsi 0:0:162:0: enclosure logical id(0x5001636001a0673d), slot(39) [ 27.297978] scsi 0:0:162:0: enclosure level(0x0000), connector name( C0 ) [ 27.304871] scsi 0:0:162:0: serial_number(ZA1AGHK20000R829D817) [ 27.310789] scsi 0:0:162:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 27.337174] mpt3sas_cm0: detecting: handle(0x00ab), sas_address(0x5000c5009543076a), phy(40) [ 27.345607] mpt3sas_cm0: REPORT_LUNS: handle(0x00ab), retries(0) [ 27.362578] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00ab), lun(0) [ 27.369776] scsi 0:0:163:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 27.378439] scsi 0:0:163:0: SSP: handle(0x00ab), sas_addr(0x5000c5009543076a), phy(40), device_name(0x5000c50095430768) [ 27.389215] scsi 0:0:163:0: enclosure logical id(0x5001636001a0673d), slot(40) [ 27.396521] scsi 0:0:163:0: enclosure level(0x0000), connector name( C0 ) [ 27.403413] scsi 0:0:163:0: serial_number(ZA1AG3EV0000R82513S7) [ 27.409333] scsi 0:0:163:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 27.432170] mpt3sas_cm0: detecting: handle(0x00ac), sas_address(0x5000c50095431f32), phy(41) [ 27.440604] mpt3sas_cm0: REPORT_LUNS: handle(0x00ac), retries(0) [ 27.447211] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00ac), lun(0) [ 27.454370] scsi 0:0:164:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 27.463035] scsi 0:0:164:0: SSP: handle(0x00ac), sas_addr(0x5000c50095431f32), phy(41), device_name(0x5000c50095431f30) [ 27.473811] scsi 0:0:164:0: enclosure logical id(0x5001636001a0673d), slot(41) [ 27.481115] scsi 0:0:164:0: enclosure level(0x0000), connector name( C0 ) [ 27.488011] scsi 0:0:164:0: serial_number(ZA1AGH0L0000C8316HPB) [ 27.493927] scsi 0:0:164:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 27.517184] mpt3sas_cm0: detecting: handle(0x00ad), sas_address(0x5000c500954319a6), phy(42) [ 27.525627] mpt3sas_cm0: REPORT_LUNS: handle(0x00ad), retries(0) [ 27.538546] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00ad), lun(0) [ 27.545721] scsi 0:0:165:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 27.554386] scsi 0:0:165:0: SSP: handle(0x00ad), sas_addr(0x5000c500954319a6), phy(42), device_name(0x5000c500954319a4) [ 27.565158] scsi 0:0:165:0: enclosure logical id(0x5001636001a0673d), slot(42) [ 27.572464] scsi 0:0:165:0: enclosure level(0x0000), connector name( C0 ) [ 27.579358] scsi 0:0:165:0: serial_number(ZA1AB9SF0000C8316GFV) [ 27.585277] scsi 0:0:165:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 27.608166] mpt3sas_cm0: detecting: handle(0x00ae), sas_address(0x5000c500954329be), phy(43) [ 27.616602] mpt3sas_cm0: REPORT_LUNS: handle(0x00ae), retries(0) [ 27.630875] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00ae), lun(0) [ 27.638019] scsi 0:0:166:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 27.646683] scsi 0:0:166:0: SSP: handle(0x00ae), sas_addr(0x5000c500954329be), phy(43), device_name(0x5000c500954329bc) [ 27.657461] scsi 0:0:166:0: enclosure logical id(0x5001636001a0673d), slot(43) [ 27.664764] scsi 0:0:166:0: enclosure level(0x0000), connector name( C0 ) [ 27.671660] scsi 0:0:166:0: serial_number(ZA1AGGLY0000R829CFMV) [ 27.677578] scsi 0:0:166:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 27.700761] mpt3sas_cm0: detecting: handle(0x00af), sas_address(0x5000c50095432b1a), phy(44) [ 27.709198] mpt3sas_cm0: REPORT_LUNS: handle(0x00af), retries(0) [ 27.719915] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00af), lun(0) [ 27.727061] scsi 0:0:167:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 27.735731] scsi 0:0:167:0: SSP: handle(0x00af), sas_addr(0x5000c50095432b1a), phy(44), device_name(0x5000c50095432b18) [ 27.746503] scsi 0:0:167:0: enclosure logical id(0x5001636001a0673d), slot(44) [ 27.753808] scsi 0:0:167:0: enclosure level(0x0000), connector name( C0 ) [ 27.760703] scsi 0:0:167:0: serial_number(ZA1AGGJK0000C8315317) [ 27.766630] scsi 0:0:167:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 27.790174] mpt3sas_cm0: detecting: handle(0x00b0), sas_address(0x5000c500954327aa), phy(45) [ 27.798613] mpt3sas_cm0: REPORT_LUNS: handle(0x00b0), retries(0) [ 27.820248] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00b0), lun(0) [ 27.827406] scsi 0:0:168:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 27.836070] scsi 0:0:168:0: SSP: handle(0x00b0), sas_addr(0x5000c500954327aa), phy(45), device_name(0x5000c500954327a8) [ 27.846845] scsi 0:0:168:0: enclosure logical id(0x5001636001a0673d), slot(45) [ 27.854151] scsi 0:0:168:0: enclosure level(0x0000), connector name( C0 ) [ 27.861045] scsi 0:0:168:0: serial_number(ZA1AGGPV0000C83153P7) [ 27.866964] scsi 0:0:168:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 27.890177] mpt3sas_cm0: detecting: handle(0x00b1), sas_address(0x5000c5009543229a), phy(46) [ 27.898619] mpt3sas_cm0: REPORT_LUNS: handle(0x00b1), retries(0) [ 27.911123] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00b1), lun(0) [ 27.918262] scsi 0:0:169:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 27.926917] scsi 0:0:169:0: SSP: handle(0x00b1), sas_addr(0x5000c5009543229a), phy(46), device_name(0x5000c50095432298) [ 27.937690] scsi 0:0:169:0: enclosure logical id(0x5001636001a0673d), slot(46) [ 27.944997] scsi 0:0:169:0: enclosure level(0x0000), connector name( C0 ) [ 27.951891] scsi 0:0:169:0: serial_number(ZA1AGGXB0000R704G6EZ) [ 27.957808] scsi 0:0:169:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 27.981173] mpt3sas_cm0: detecting: handle(0x00b2), sas_address(0x5000c500954328fa), phy(47) [ 27.989611] mpt3sas_cm0: REPORT_LUNS: handle(0x00b2), retries(0) [ 27.996172] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00b2), lun(0) [ 28.003311] scsi 0:0:170:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 28.011969] scsi 0:0:170:0: SSP: handle(0x00b2), sas_addr(0x5000c500954328fa), phy(47), device_name(0x5000c500954328f8) [ 28.022739] scsi 0:0:170:0: enclosure logical id(0x5001636001a0673d), slot(47) [ 28.030044] scsi 0:0:170:0: enclosure level(0x0000), connector name( C0 ) [ 28.036936] scsi 0:0:170:0: serial_number(ZA1AGGMK0000R83026KX) [ 28.042855] scsi 0:0:170:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 28.066176] mpt3sas_cm0: detecting: handle(0x00bb), sas_address(0x5000c500954cfc86), phy(48) [ 28.074612] mpt3sas_cm0: REPORT_LUNS: handle(0x00bb), retries(0) [ 28.081170] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00bb), lun(0) [ 28.088336] scsi 0:0:171:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 28.097001] scsi 0:0:171:0: SSP: handle(0x00bb), sas_addr(0x5000c500954cfc86), phy(48), device_name(0x5000c500954cfc84) [ 28.107776] scsi 0:0:171:0: enclosure logical id(0x5001636001a0673d), slot(48) [ 28.115082] scsi 0:0:171:0: enclosure level(0x0000), connector name( C0 ) [ 28.121976] scsi 0:0:171:0: serial_number(ZA1ALFE50000R830288F) [ 28.127894] scsi 0:0:171:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 28.155170] mpt3sas_cm0: detecting: handle(0x00bc), sas_address(0x5000c500954d361e), phy(49) [ 28.163619] mpt3sas_cm0: REPORT_LUNS: handle(0x00bc), retries(0) [ 28.184008] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00bc), lun(0) [ 28.191165] scsi 0:0:172:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 28.199834] scsi 0:0:172:0: SSP: handle(0x00bc), sas_addr(0x5000c500954d361e), phy(49), device_name(0x5000c500954d361c) [ 28.210607] scsi 0:0:172:0: enclosure logical id(0x5001636001a0673d), slot(49) [ 28.217913] scsi 0:0:172:0: enclosure level(0x0000), connector name( C0 ) [ 28.224807] scsi 0:0:172:0: serial_number(ZA1ALTVB0000R8314VBJ) [ 28.230726] scsi 0:0:172:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 28.254177] mpt3sas_cm0: detecting: handle(0x00bd), sas_address(0x5000c500954cb9ba), phy(50) [ 28.262612] mpt3sas_cm0: REPORT_LUNS: handle(0x00bd), retries(0) [ 28.276483] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00bd), lun(0) [ 28.283616] scsi 0:0:173:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 28.292268] scsi 0:0:173:0: SSP: handle(0x00bd), sas_addr(0x5000c500954cb9ba), phy(50), device_name(0x5000c500954cb9b8) [ 28.303038] scsi 0:0:173:0: enclosure logical id(0x5001636001a0673d), slot(50) [ 28.310346] scsi 0:0:173:0: enclosure level(0x0000), connector name( C0 ) [ 28.317239] scsi 0:0:173:0: serial_number(ZA1ALH520000C8326DUN) [ 28.323155] scsi 0:0:173:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 28.346180] mpt3sas_cm0: detecting: handle(0x00be), sas_address(0x5000c500954ce226), phy(51) [ 28.354620] mpt3sas_cm0: REPORT_LUNS: handle(0x00be), retries(0) [ 28.373592] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00be), lun(0) [ 28.380728] scsi 0:0:174:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 28.389387] scsi 0:0:174:0: SSP: handle(0x00be), sas_addr(0x5000c500954ce226), phy(51), device_name(0x5000c500954ce224) [ 28.400158] scsi 0:0:174:0: enclosure logical id(0x5001636001a0673d), slot(51) [ 28.407465] scsi 0:0:174:0: enclosure level(0x0000), connector name( C0 ) [ 28.414357] scsi 0:0:174:0: serial_number(ZA1ALFZF0000C83198RH) [ 28.420275] scsi 0:0:174:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 28.443181] mpt3sas_cm0: detecting: handle(0x00bf), sas_address(0x5000c500954d03fa), phy(52) [ 28.451617] mpt3sas_cm0: REPORT_LUNS: handle(0x00bf), retries(0) [ 28.458091] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00bf), lun(0) [ 28.465225] scsi 0:0:175:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 28.473897] scsi 0:0:175:0: SSP: handle(0x00bf), sas_addr(0x5000c500954d03fa), phy(52), device_name(0x5000c500954d03f8) [ 28.484668] scsi 0:0:175:0: enclosure logical id(0x5001636001a0673d), slot(52) [ 28.491974] scsi 0:0:175:0: enclosure level(0x0000), connector name( C0 ) [ 28.498867] scsi 0:0:175:0: serial_number(ZA1ALF8W0000R8314REA) [ 28.504786] scsi 0:0:175:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 28.528180] mpt3sas_cm0: detecting: handle(0x00c0), sas_address(0x5000c500954d0482), phy(53) [ 28.536614] mpt3sas_cm0: REPORT_LUNS: handle(0x00c0), retries(0) [ 28.543105] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00c0), lun(0) [ 28.550246] scsi 0:0:176:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 28.558918] scsi 0:0:176:0: SSP: handle(0x00c0), sas_addr(0x5000c500954d0482), phy(53), device_name(0x5000c500954d0480) [ 28.569690] scsi 0:0:176:0: enclosure logical id(0x5001636001a0673d), slot(53) [ 28.576995] scsi 0:0:176:0: enclosure level(0x0000), connector name( C0 ) [ 28.583891] scsi 0:0:176:0: serial_number(ZA1ALF8F0000R8314T49) [ 28.589817] scsi 0:0:176:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 28.613180] mpt3sas_cm0: detecting: handle(0x00c1), sas_address(0x5000c500954de806), phy(54) [ 28.621620] mpt3sas_cm0: REPORT_LUNS: handle(0x00c1), retries(0) [ 28.635838] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00c1), lun(0) [ 28.642981] scsi 0:0:177:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 28.651639] scsi 0:0:177:0: SSP: handle(0x00c1), sas_addr(0x5000c500954de806), phy(54), device_name(0x5000c500954de804) [ 28.662414] scsi 0:0:177:0: enclosure logical id(0x5001636001a0673d), slot(54) [ 28.669721] scsi 0:0:177:0: enclosure level(0x0000), connector name( C0 ) [ 28.676613] scsi 0:0:177:0: serial_number(ZA1AM5L80000R8317PC6) [ 28.682533] scsi 0:0:177:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 28.706179] mpt3sas_cm0: detecting: handle(0x00c2), sas_address(0x5000c500954e0322), phy(55) [ 28.714623] mpt3sas_cm0: REPORT_LUNS: handle(0x00c2), retries(0) [ 28.728806] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00c2), lun(0) [ 28.735942] scsi 0:0:178:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 28.744608] scsi 0:0:178:0: SSP: handle(0x00c2), sas_addr(0x5000c500954e0322), phy(55), device_name(0x5000c500954e0320) [ 28.755384] scsi 0:0:178:0: enclosure logical id(0x5001636001a0673d), slot(55) [ 28.762689] scsi 0:0:178:0: enclosure level(0x0000), connector name( C0 ) [ 28.769583] scsi 0:0:178:0: serial_number(ZA1AM1Z30000R8317REB) [ 28.775501] scsi 0:0:178:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 28.798180] mpt3sas_cm0: detecting: handle(0x00c8), sas_address(0x5000c500954d3866), phy(56) [ 28.806620] mpt3sas_cm0: REPORT_LUNS: handle(0x00c8), retries(0) [ 28.821129] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00c8), lun(0) [ 28.828266] scsi 0:0:179:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 28.836928] scsi 0:0:179:0: SSP: handle(0x00c8), sas_addr(0x5000c500954d3866), phy(56), device_name(0x5000c500954d3864) [ 28.847702] scsi 0:0:179:0: enclosure logical id(0x5001636001a0673d), slot(56) [ 28.855007] scsi 0:0:179:0: enclosure level(0x0000), connector name( C0 ) [ 28.861902] scsi 0:0:179:0: serial_number(ZA1ALTQH0000R8303HV0) [ 28.867821] scsi 0:0:179:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 28.891184] mpt3sas_cm0: detecting: handle(0x00c9), sas_address(0x5000c500954d8792), phy(57) [ 28.899626] mpt3sas_cm0: REPORT_LUNS: handle(0x00c9), retries(0) [ 28.906174] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00c9), lun(0) [ 28.913315] scsi 0:0:180:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 28.921976] scsi 0:0:180:0: SSP: handle(0x00c9), sas_addr(0x5000c500954d8792), phy(57), device_name(0x5000c500954d8790) [ 28.932749] scsi 0:0:180:0: enclosure logical id(0x5001636001a0673d), slot(57) [ 28.940056] scsi 0:0:180:0: enclosure level(0x0000), connector name( C0 ) [ 28.946947] scsi 0:0:180:0: serial_number(ZA1AM40E0000R8301CKS) [ 28.952868] scsi 0:0:180:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 28.976183] mpt3sas_cm0: detecting: handle(0x00ca), sas_address(0x5000c500954d3d6e), phy(58) [ 28.984626] mpt3sas_cm0: REPORT_LUNS: handle(0x00ca), retries(0) [ 28.998668] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00ca), lun(0) [ 29.005796] scsi 0:0:181:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 29.014455] scsi 0:0:181:0: SSP: handle(0x00ca), sas_addr(0x5000c500954d3d6e), phy(58), device_name(0x5000c500954d3d6c) [ 29.025224] scsi 0:0:181:0: enclosure logical id(0x5001636001a0673d), slot(58) [ 29.032529] scsi 0:0:181:0: enclosure level(0x0000), connector name( C0 ) [ 29.039426] scsi 0:0:181:0: serial_number(ZA1ALTKA0000R8302V05) [ 29.045351] scsi 0:0:181:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 29.074183] mpt3sas_cm0: detecting: handle(0x00cb), sas_address(0x5000c500954d33ca), phy(59) [ 29.082635] mpt3sas_cm0: REPORT_LUNS: handle(0x00cb), retries(0) [ 29.097169] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00cb), lun(0) [ 29.104294] scsi 0:0:182:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 29.112952] scsi 0:0:182:0: SSP: handle(0x00cb), sas_addr(0x5000c500954d33ca), phy(59), device_name(0x5000c500954d33c8) [ 29.123722] scsi 0:0:182:0: enclosure logical id(0x5001636001a0673d), slot(59) [ 29.131027] scsi 0:0:182:0: enclosure level(0x0000), connector name( C0 ) [ 29.137922] scsi 0:0:182:0: serial_number(ZA1ALY100000R83028GN) [ 29.143840] scsi 0:0:182:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 29.171339] mpt3sas_cm0: detecting: handle(0x00ce), sas_address(0x5001636001a0673d), phy(76) [ 29.179791] mpt3sas_cm0: REPORT_LUNS: handle(0x00ce), retries(0) [ 29.185983] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00ce), lun(0) [ 29.192493] scsi 0:0:183:0: Enclosure QCT JB4602 SIM 1 1500 PQ: 0 ANSI: 6 [ 29.200959] scsi 0:0:183:0: set ignore_delay_remove for handle(0x00ce) [ 29.207488] scsi 0:0:183:0: SES: handle(0x00ce), sas_addr(0x5001636001a0673d), phy(76), device_name(0x5001636001a0673d) [ 29.218259] scsi 0:0:183:0: enclosure logical id(0x5001636001a0673d), slot(60) [ 29.225564] scsi 0:0:183:0: enclosure level(0x0000), connector name( C0 ) [ 29.232459] scsi 0:0:183:0: serial_number(EO0153300021 ) [ 29.238032] scsi 0:0:183:0: qdepth(1), tagged(0), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 29.259450] mpt3sas_cm0: expander_add: handle(0x00cf), parent(0x0002), sas_addr(0x500163600190c8ff), phys(79) [ 29.283867] mpt3sas_cm0: detecting: handle(0x00d0), sas_address(0x5000c50095430dd2), phy(0) [ 29.292222] mpt3sas_cm0: REPORT_LUNS: handle(0x00d0), retries(0) [ 29.298693] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00d0), lun(0) [ 29.305975] scsi 0:0:184:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 29.314638] scsi 0:0:184:0: SSP: handle(0x00d0), sas_addr(0x5000c50095430dd2), phy(0), device_name(0x5000c50095430dd0) [ 29.325321] scsi 0:0:184:0: enclosure logical id(0x500163600190c8fd), slot(0) [ 29.332539] scsi 0:0:184:0: enclosure level(0x0000), connector name( C2 ) [ 29.339433] scsi 0:0:184:0: serial_number(ZA1AGHL00000C8316HQ4) [ 29.345351] scsi 0:0:184:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 29.368191] mpt3sas_cm0: detecting: handle(0x00d1), sas_address(0x5000c50095432246), phy(1) [ 29.376546] mpt3sas_cm0: REPORT_LUNS: handle(0x00d1), retries(0) [ 29.383041] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00d1), lun(0) [ 29.390218] scsi 0:0:185:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 29.398880] scsi 0:0:185:0: SSP: handle(0x00d1), sas_addr(0x5000c50095432246), phy(1), device_name(0x5000c50095432244) [ 29.409570] scsi 0:0:185:0: enclosure logical id(0x500163600190c8fd), slot(1) [ 29.416789] scsi 0:0:185:0: enclosure level(0x0000), connector name( C2 ) [ 29.423682] scsi 0:0:185:0: serial_number(ZA1AGN060000R828A07T) [ 29.429602] scsi 0:0:185:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 29.456182] mpt3sas_cm0: detecting: handle(0x00d2), sas_address(0x5000c5009569935e), phy(2) [ 29.464533] mpt3sas_cm0: REPORT_LUNS: handle(0x00d2), retries(0) [ 29.482366] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00d2), lun(0) [ 29.489543] scsi 0:0:186:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 29.498204] scsi 0:0:186:0: SSP: handle(0x00d2), sas_addr(0x5000c5009569935e), phy(2), device_name(0x5000c5009569935c) [ 29.508890] scsi 0:0:186:0: enclosure logical id(0x500163600190c8fd), slot(2) [ 29.516109] scsi 0:0:186:0: enclosure level(0x0000), connector name( C2 ) [ 29.523005] scsi 0:0:186:0: serial_number(ZA1AZL5Y0000R832DW4F) [ 29.528921] scsi 0:0:186:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 29.555190] mpt3sas_cm0: detecting: handle(0x00d3), sas_address(0x5000c500a6102e86), phy(3) [ 29.563570] mpt3sas_cm0: REPORT_LUNS: handle(0x00d3), retries(0) [ 29.584372] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00d3), lun(0) [ 29.591522] scsi 0:0:187:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 29.600185] scsi 0:0:187:0: SSP: handle(0x00d3), sas_addr(0x5000c500a6102e86), phy(3), device_name(0x5000c500a6102e84) [ 29.610871] scsi 0:0:187:0: enclosure logical id(0x500163600190c8fd), slot(3) [ 29.618092] scsi 0:0:187:0: enclosure level(0x0000), connector name( C2 ) [ 29.624987] scsi 0:0:187:0: serial_number(ZA1B72S80000R8332SVA) [ 29.630912] scsi 0:0:187:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 29.657195] mpt3sas_cm0: detecting: handle(0x00d4), sas_address(0x5000c50095431c1e), phy(4) [ 29.665552] mpt3sas_cm0: REPORT_LUNS: handle(0x00d4), retries(0) [ 29.672030] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00d4), lun(0) [ 29.679178] scsi 0:0:188:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 29.687835] scsi 0:0:188:0: SSP: handle(0x00d4), sas_addr(0x5000c50095431c1e), phy(4), device_name(0x5000c50095431c1c) [ 29.698519] scsi 0:0:188:0: enclosure logical id(0x500163600190c8fd), slot(4) [ 29.705740] scsi 0:0:188:0: enclosure level(0x0000), connector name( C2 ) [ 29.712633] scsi 0:0:188:0: serial_number(ZA1AGN520000C8316G32) [ 29.718551] scsi 0:0:188:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 29.741194] mpt3sas_cm0: detecting: handle(0x00d5), sas_address(0x5000c500957facce), phy(5) [ 29.749548] mpt3sas_cm0: REPORT_LUNS: handle(0x00d5), retries(0) [ 29.756042] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00d5), lun(0) [ 29.763217] scsi 0:0:189:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 29.771881] scsi 0:0:189:0: SSP: handle(0x00d5), sas_addr(0x5000c500957facce), phy(5), device_name(0x5000c500957faccc) [ 29.782569] scsi 0:0:189:0: enclosure logical id(0x500163600190c8fd), slot(5) [ 29.789789] scsi 0:0:189:0: enclosure level(0x0000), connector name( C2 ) [ 29.796683] scsi 0:0:189:0: serial_number(ZA1B4F0J0000R833TXB0) [ 29.802602] scsi 0:0:189:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 29.829207] mpt3sas_cm0: detecting: handle(0x00d6), sas_address(0x5000c5009543265e), phy(6) [ 29.837574] mpt3sas_cm0: REPORT_LUNS: handle(0x00d6), retries(0) [ 29.855055] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00d6), lun(0) [ 29.862197] scsi 0:0:190:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 29.870859] scsi 0:0:190:0: SSP: handle(0x00d6), sas_addr(0x5000c5009543265e), phy(6), device_name(0x5000c5009543265c) [ 29.881544] scsi 0:0:190:0: enclosure logical id(0x500163600190c8fd), slot(6) [ 29.888763] scsi 0:0:190:0: enclosure level(0x0000), connector name( C2 ) [ 29.895659] scsi 0:0:190:0: serial_number(ZA1AGGRH0000R829CU3W) [ 29.901576] scsi 0:0:190:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 29.924193] mpt3sas_cm0: detecting: handle(0x00d7), sas_address(0x5000c5009543246a), phy(7) [ 29.932546] mpt3sas_cm0: REPORT_LUNS: handle(0x00d7), retries(0) [ 29.947612] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00d7), lun(0) [ 29.954754] scsi 0:0:191:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 29.963418] scsi 0:0:191:0: SSP: handle(0x00d7), sas_addr(0x5000c5009543246a), phy(7), device_name(0x5000c50095432468) [ 29.974106] scsi 0:0:191:0: enclosure logical id(0x500163600190c8fd), slot(7) [ 29.981326] scsi 0:0:191:0: enclosure level(0x0000), connector name( C2 ) [ 29.988218] scsi 0:0:191:0: serial_number(ZA1AGMY10000C8316H8M) [ 29.994138] scsi 0:0:191:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 30.017192] mpt3sas_cm0: detecting: handle(0x00d8), sas_address(0x5000c5009543205e), phy(8) [ 30.025540] mpt3sas_cm0: REPORT_LUNS: handle(0x00d8), retries(0) [ 30.045152] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00d8), lun(0) [ 30.052322] scsi 0:0:192:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 30.060990] scsi 0:0:192:0: SSP: handle(0x00d8), sas_addr(0x5000c5009543205e), phy(8), device_name(0x5000c5009543205c) [ 30.071678] scsi 0:0:192:0: enclosure logical id(0x500163600190c8fd), slot(8) [ 30.078895] scsi 0:0:192:0: enclosure level(0x0000), connector name( C2 ) [ 30.085790] scsi 0:0:192:0: serial_number(ZA1AGN210000R82892FE) [ 30.091707] scsi 0:0:192:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 30.115195] mpt3sas_cm0: detecting: handle(0x00d9), sas_address(0x5000c50095432226), phy(9) [ 30.123546] mpt3sas_cm0: REPORT_LUNS: handle(0x00d9), retries(0) [ 30.136178] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00d9), lun(0) [ 30.143370] scsi 0:0:193:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 30.152032] scsi 0:0:193:0: SSP: handle(0x00d9), sas_addr(0x5000c50095432226), phy(9), device_name(0x5000c50095432224) [ 30.162720] scsi 0:0:193:0: enclosure logical id(0x500163600190c8fd), slot(9) [ 30.169941] scsi 0:0:193:0: enclosure level(0x0000), connector name( C2 ) [ 30.176834] scsi 0:0:193:0: serial_number(ZA1AGN0E0000R82893RN) [ 30.182753] scsi 0:0:193:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 30.206191] mpt3sas_cm0: detecting: handle(0x00da), sas_address(0x5000c5009543121a), phy(10) [ 30.214634] mpt3sas_cm0: REPORT_LUNS: handle(0x00da), retries(0) [ 30.227763] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00da), lun(0) [ 30.234903] scsi 0:0:194:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 30.243569] scsi 0:0:194:0: SSP: handle(0x00da), sas_addr(0x5000c5009543121a), phy(10), device_name(0x5000c50095431218) [ 30.254337] scsi 0:0:194:0: enclosure logical id(0x500163600190c8fd), slot(10) [ 30.261642] scsi 0:0:194:0: enclosure level(0x0000), connector name( C2 ) [ 30.268536] scsi 0:0:194:0: serial_number(ZA1AGHEZ0000R8289ZB0) [ 30.274455] scsi 0:0:194:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 30.298207] mpt3sas_cm0: detecting: handle(0x00db), sas_address(0x5000c5009543250e), phy(11) [ 30.306646] mpt3sas_cm0: REPORT_LUNS: handle(0x00db), retries(0) [ 30.324668] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00db), lun(0) [ 30.331800] scsi 0:0:195:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 30.340463] scsi 0:0:195:0: SSP: handle(0x00db), sas_addr(0x5000c5009543250e), phy(11), device_name(0x5000c5009543250c) [ 30.351233] scsi 0:0:195:0: enclosure logical id(0x500163600190c8fd), slot(11) [ 30.358539] scsi 0:0:195:0: enclosure level(0x0000), connector name( C2 ) [ 30.365430] scsi 0:0:195:0: serial_number(ZA1AGMX90000C8316H8U) [ 30.371350] scsi 0:0:195:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 30.395197] mpt3sas_cm0: detecting: handle(0x00dc), sas_address(0x5000c500954cf2aa), phy(12) [ 30.403637] mpt3sas_cm0: REPORT_LUNS: handle(0x00dc), retries(0) [ 30.417645] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00dc), lun(0) [ 30.424803] scsi 0:0:196:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 30.433461] scsi 0:0:196:0: SSP: handle(0x00dc), sas_addr(0x5000c500954cf2aa), phy(12), device_name(0x5000c500954cf2a8) [ 30.444235] scsi 0:0:196:0: enclosure logical id(0x500163600190c8fd), slot(12) [ 30.451542] scsi 0:0:196:0: enclosure level(0x0000), connector name( C2 ) [ 30.458435] scsi 0:0:196:0: serial_number(ZA1ALFL80000R8314RU0) [ 30.464354] scsi 0:0:196:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 30.488196] mpt3sas_cm0: detecting: handle(0x00dd), sas_address(0x5000c500954d411a), phy(13) [ 30.496635] mpt3sas_cm0: REPORT_LUNS: handle(0x00dd), retries(0) [ 30.512449] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00dd), lun(0) [ 30.519607] scsi 0:0:197:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 30.528277] scsi 0:0:197:0: SSP: handle(0x00dd), sas_addr(0x5000c500954d411a), phy(13), device_name(0x5000c500954d4118) [ 30.539049] scsi 0:0:197:0: enclosure logical id(0x500163600190c8fd), slot(13) [ 30.546357] scsi 0:0:197:0: enclosure level(0x0000), connector name( C2 ) [ 30.553252] scsi 0:0:197:0: serial_number(ZA1ALXPR0000R8302J8K) [ 30.559178] scsi 0:0:197:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 30.586198] mpt3sas_cm0: detecting: handle(0x00de), sas_address(0x5000c500954cb5e2), phy(14) [ 30.594638] mpt3sas_cm0: REPORT_LUNS: handle(0x00de), retries(0) [ 30.610118] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00de), lun(0) [ 30.617251] scsi 0:0:198:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 30.625915] scsi 0:0:198:0: SSP: handle(0x00de), sas_addr(0x5000c500954cb5e2), phy(14), device_name(0x5000c500954cb5e0) [ 30.636691] scsi 0:0:198:0: enclosure logical id(0x500163600190c8fd), slot(14) [ 30.643996] scsi 0:0:198:0: enclosure level(0x0000), connector name( C2 ) [ 30.650888] scsi 0:0:198:0: serial_number(ZA1ALH7V0000C8326GSW) [ 30.656807] scsi 0:0:198:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 30.680204] mpt3sas_cm0: detecting: handle(0x00df), sas_address(0x5000c500954df38a), phy(15) [ 30.688646] mpt3sas_cm0: REPORT_LUNS: handle(0x00df), retries(0) [ 30.706180] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00df), lun(0) [ 30.713321] scsi 0:0:199:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 30.721988] scsi 0:0:199:0: SSP: handle(0x00df), sas_addr(0x5000c500954df38a), phy(15), device_name(0x5000c500954df388) [ 30.732761] scsi 0:0:199:0: enclosure logical id(0x500163600190c8fd), slot(15) [ 30.740067] scsi 0:0:199:0: enclosure level(0x0000), connector name( C2 ) [ 30.746960] scsi 0:0:199:0: serial_number(ZA1AM2550000R8317NB5) [ 30.752878] scsi 0:0:199:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 30.776197] mpt3sas_cm0: detecting: handle(0x00e0), sas_address(0x5000c500954d8f5e), phy(16) [ 30.784637] mpt3sas_cm0: REPORT_LUNS: handle(0x00e0), retries(0) [ 30.797112] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00e0), lun(0) [ 30.804272] scsi 0:0:200:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 30.812937] scsi 0:0:200:0: SSP: handle(0x00e0), sas_addr(0x5000c500954d8f5e), phy(16), device_name(0x5000c500954d8f5c) [ 30.823711] scsi 0:0:200:0: enclosure logical id(0x500163600190c8fd), slot(16) [ 30.831016] scsi 0:0:200:0: enclosure level(0x0000), connector name( C2 ) [ 30.837910] scsi 0:0:200:0: serial_number(ZA1A3EEM0000R8301QYF) [ 30.843828] scsi 0:0:200:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 30.867198] mpt3sas_cm0: detecting: handle(0x00e1), sas_address(0x5000c500954ccd9a), phy(17) [ 30.875639] mpt3sas_cm0: REPORT_LUNS: handle(0x00e1), retries(0) [ 30.890645] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00e1), lun(0) [ 30.897788] scsi 0:0:201:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 30.906447] scsi 0:0:201:0: SSP: handle(0x00e1), sas_addr(0x5000c500954ccd9a), phy(17), device_name(0x5000c500954ccd98) [ 30.917217] scsi 0:0:201:0: enclosure logical id(0x500163600190c8fd), slot(17) [ 30.924523] scsi 0:0:201:0: enclosure level(0x0000), connector name( C2 ) [ 30.931414] scsi 0:0:201:0: serial_number(ZA1ALL1N0000R8301RWS) [ 30.937332] scsi 0:0:201:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 30.960204] mpt3sas_cm0: detecting: handle(0x00e2), sas_address(0x5000c500954d2dbe), phy(18) [ 30.968643] mpt3sas_cm0: REPORT_LUNS: handle(0x00e2), retries(0) [ 30.984590] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00e2), lun(0) [ 30.991731] scsi 0:0:202:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 31.000391] scsi 0:0:202:0: SSP: handle(0x00e2), sas_addr(0x5000c500954d2dbe), phy(18), device_name(0x5000c500954d2dbc) [ 31.011164] scsi 0:0:202:0: enclosure logical id(0x500163600190c8fd), slot(18) [ 31.018469] scsi 0:0:202:0: enclosure level(0x0000), connector name( C2 ) [ 31.025364] scsi 0:0:202:0: serial_number(ZA1ALV6M0000R8314SFK) [ 31.031281] scsi 0:0:202:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 31.054220] mpt3sas_cm0: detecting: handle(0x00e3), sas_address(0x5000c500954cc1b6), phy(19) [ 31.062660] mpt3sas_cm0: REPORT_LUNS: handle(0x00e3), retries(0) [ 31.079016] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00e3), lun(0) [ 31.086142] scsi 0:0:203:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 31.094800] scsi 0:0:203:0: SSP: handle(0x00e3), sas_addr(0x5000c500954cc1b6), phy(19), device_name(0x5000c500954cc1b4) [ 31.105570] scsi 0:0:203:0: enclosure logical id(0x500163600190c8fd), slot(19) [ 31.112876] scsi 0:0:203:0: enclosure level(0x0000), connector name( C2 ) [ 31.119771] scsi 0:0:203:0: serial_number(ZA1ALGWT0000C8325X34) [ 31.125690] scsi 0:0:203:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 31.149211] mpt3sas_cm0: detecting: handle(0x00e4), sas_address(0x5000c500954310fe), phy(20) [ 31.157647] mpt3sas_cm0: REPORT_LUNS: handle(0x00e4), retries(0) [ 31.170878] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00e4), lun(0) [ 31.178029] scsi 0:0:204:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 31.186683] scsi 0:0:204:0: SSP: handle(0x00e4), sas_addr(0x5000c500954310fe), phy(20), device_name(0x5000c500954310fc) [ 31.197455] scsi 0:0:204:0: enclosure logical id(0x500163600190c8fd), slot(20) [ 31.204762] scsi 0:0:204:0: enclosure level(0x0000), connector name( C2 ) [ 31.211656] scsi 0:0:204:0: serial_number(ZA1AGHGR0000C8316FM1) [ 31.217575] scsi 0:0:204:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 31.240203] mpt3sas_cm0: detecting: handle(0x00e5), sas_address(0x5000c500954cc172), phy(21) [ 31.248639] mpt3sas_cm0: REPORT_LUNS: handle(0x00e5), retries(0) [ 31.258435] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00e5), lun(0) [ 31.275688] scsi 0:0:205:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 31.291420] scsi 0:0:205:0: SSP: handle(0x00e5), sas_addr(0x5000c500954cc172), phy(21), device_name(0x5000c500954cc170) [ 31.302193] scsi 0:0:205:0: enclosure logical id(0x500163600190c8fd), slot(21) [ 31.309501] scsi 0:0:205:0: enclosure level(0x0000), connector name( C2 ) [ 31.316395] scsi 0:0:205:0: serial_number(ZA1ALGXA0000C8325WZ8) [ 31.322321] scsi 0:0:205:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 31.345801] mpt3sas_cm0: detecting: handle(0x00e6), sas_address(0x5000c500954ddfe2), phy(22) [ 31.354235] mpt3sas_cm0: REPORT_LUNS: handle(0x00e6), retries(0) [ 31.372737] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00e6), lun(0) [ 31.379890] scsi 0:0:206:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 31.388558] scsi 0:0:206:0: SSP: handle(0x00e6), sas_addr(0x5000c500954ddfe2), phy(22), device_name(0x5000c500954ddfe0) [ 31.399332] scsi 0:0:206:0: enclosure logical id(0x500163600190c8fd), slot(22) [ 31.406637] scsi 0:0:206:0: enclosure level(0x0000), connector name( C2 ) [ 31.413531] scsi 0:0:206:0: serial_number(ZA1AM5R10000R8317NT7) [ 31.419450] scsi 0:0:206:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 31.443203] mpt3sas_cm0: detecting: handle(0x00e7), sas_address(0x5000c500954cb456), phy(23) [ 31.451641] mpt3sas_cm0: REPORT_LUNS: handle(0x00e7), retries(0) [ 31.471627] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00e7), lun(0) [ 31.478777] scsi 0:0:207:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 31.487438] scsi 0:0:207:0: SSP: handle(0x00e7), sas_addr(0x5000c500954cb456), phy(23), device_name(0x5000c500954cb454) [ 31.498210] scsi 0:0:207:0: enclosure logical id(0x500163600190c8fd), slot(23) [ 31.505515] scsi 0:0:207:0: enclosure level(0x0000), connector name( C2 ) [ 31.512413] scsi 0:0:207:0: serial_number(ZA1ALHA50000C8325WZL) [ 31.518337] scsi 0:0:207:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 31.541204] mpt3sas_cm0: detecting: handle(0x00e8), sas_address(0x5000c500a6104dbe), phy(24) [ 31.549644] mpt3sas_cm0: REPORT_LUNS: handle(0x00e8), retries(0) [ 31.568437] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00e8), lun(0) [ 31.575787] scsi 0:0:208:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 31.596888] scsi 0:0:208:0: SSP: handle(0x00e8), sas_addr(0x5000c500a6104dbe), phy(24), device_name(0x5000c500a6104dbc) [ 31.607664] scsi 0:0:208:0: enclosure logical id(0x500163600190c8fd), slot(24) [ 31.614970] scsi 0:0:208:0: enclosure level(0x0000), connector name( C2 ) [ 31.621861] scsi 0:0:208:0: serial_number(ZA1B729S0000R824UQU0) [ 31.627782] scsi 0:0:208:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 31.673216] mpt3sas_cm0: detecting: handle(0x00e9), sas_address(0x5000c500954d0c0a), phy(25) [ 31.681671] mpt3sas_cm0: REPORT_LUNS: handle(0x00e9), retries(0) [ 31.688414] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00e9), lun(0) [ 31.695607] scsi 0:0:209:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 31.704269] scsi 0:0:209:0: SSP: handle(0x00e9), sas_addr(0x5000c500954d0c0a), phy(25), device_name(0x5000c500954d0c08) [ 31.715044] scsi 0:0:209:0: enclosure logical id(0x500163600190c8fd), slot(25) [ 31.722351] scsi 0:0:209:0: enclosure level(0x0000), connector name( C2 ) [ 31.729244] scsi 0:0:209:0: serial_number(ZA1AFAX70000R8314QSP) [ 31.735162] scsi 0:0:209:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 31.758205] mpt3sas_cm0: detecting: handle(0x00ea), sas_address(0x5000c500954d91a2), phy(26) [ 31.766642] mpt3sas_cm0: REPORT_LUNS: handle(0x00ea), retries(0) [ 31.773178] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00ea), lun(0) [ 31.780326] scsi 0:0:210:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 31.788982] scsi 0:0:210:0: SSP: handle(0x00ea), sas_addr(0x5000c500954d91a2), phy(26), device_name(0x5000c500954d91a0) [ 31.799755] scsi 0:0:210:0: enclosure logical id(0x500163600190c8fd), slot(26) [ 31.807059] scsi 0:0:210:0: enclosure level(0x0000), connector name( C2 ) [ 31.813952] scsi 0:0:210:0: serial_number(ZA1A7W9H0000R8302K3E) [ 31.819871] scsi 0:0:210:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 31.843212] mpt3sas_cm0: detecting: handle(0x00eb), sas_address(0x5000c500a610243e), phy(27) [ 31.851647] mpt3sas_cm0: REPORT_LUNS: handle(0x00eb), retries(0) [ 31.864463] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00eb), lun(0) [ 31.871606] scsi 0:0:211:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 31.880271] scsi 0:0:211:0: SSP: handle(0x00eb), sas_addr(0x5000c500a610243e), phy(27), device_name(0x5000c500a610243c) [ 31.891042] scsi 0:0:211:0: enclosure logical id(0x500163600190c8fd), slot(27) [ 31.898347] scsi 0:0:211:0: enclosure level(0x0000), connector name( C2 ) [ 31.905239] scsi 0:0:211:0: serial_number(ZA1B72Z10000R833TUKN) [ 31.911158] scsi 0:0:211:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 31.934208] mpt3sas_cm0: detecting: handle(0x00ec), sas_address(0x5000c500a6102eb2), phy(28) [ 31.942646] mpt3sas_cm0: REPORT_LUNS: handle(0x00ec), retries(0) [ 31.952450] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00ec), lun(0) [ 31.959620] scsi 0:0:212:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 31.968283] scsi 0:0:212:0: SSP: handle(0x00ec), sas_addr(0x5000c500a6102eb2), phy(28), device_name(0x5000c500a6102eb0) [ 31.979052] scsi 0:0:212:0: enclosure logical id(0x500163600190c8fd), slot(28) [ 31.986357] scsi 0:0:212:0: enclosure level(0x0000), connector name( C2 ) [ 31.993252] scsi 0:0:212:0: serial_number(ZA1B72R60000R83323UR) [ 31.999169] scsi 0:0:212:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 32.022210] mpt3sas_cm0: detecting: handle(0x00ed), sas_address(0x5000c500a610243a), phy(29) [ 32.030652] mpt3sas_cm0: REPORT_LUNS: handle(0x00ed), retries(0) [ 32.037143] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00ed), lun(0) [ 32.044317] scsi 0:0:213:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 32.052985] scsi 0:0:213:0: SSP: handle(0x00ed), sas_addr(0x5000c500a610243a), phy(29), device_name(0x5000c500a6102438) [ 32.063760] scsi 0:0:213:0: enclosure logical id(0x500163600190c8fd), slot(29) [ 32.071068] scsi 0:0:213:0: enclosure level(0x0000), connector name( C2 ) [ 32.077960] scsi 0:0:213:0: serial_number(ZA1B72ZL0000R833UX7J) [ 32.083879] scsi 0:0:213:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 32.107217] mpt3sas_cm0: detecting: handle(0x00ee), sas_address(0x5000c500954d9982), phy(30) [ 32.115654] mpt3sas_cm0: REPORT_LUNS: handle(0x00ee), retries(0) [ 32.122195] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00ee), lun(0) [ 32.129350] scsi 0:0:214:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 32.138009] scsi 0:0:214:0: SSP: handle(0x00ee), sas_addr(0x5000c500954d9982), phy(30), device_name(0x5000c500954d9980) [ 32.148782] scsi 0:0:214:0: enclosure logical id(0x500163600190c8fd), slot(30) [ 32.156089] scsi 0:0:214:0: enclosure level(0x0000), connector name( C2 ) [ 32.162982] scsi 0:0:214:0: serial_number(ZA1AM3Q20000R8302N04) [ 32.168899] scsi 0:0:214:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 32.192210] mpt3sas_cm0: detecting: handle(0x00ef), sas_address(0x5000c500954deaba), phy(31) [ 32.200649] mpt3sas_cm0: REPORT_LUNS: handle(0x00ef), retries(0) [ 32.219577] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00ef), lun(0) [ 32.226868] scsi 0:0:215:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 32.235528] scsi 0:0:215:0: SSP: handle(0x00ef), sas_addr(0x5000c500954deaba), phy(31), device_name(0x5000c500954deab8) [ 32.246300] scsi 0:0:215:0: enclosure logical id(0x500163600190c8fd), slot(31) [ 32.253607] scsi 0:0:215:0: enclosure level(0x0000), connector name( C2 ) [ 32.260499] scsi 0:0:215:0: serial_number(ZA1AJVZZ0000R8317PEX) [ 32.266418] scsi 0:0:215:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 32.289210] mpt3sas_cm0: detecting: handle(0x00f0), sas_address(0x5000c500954cc8d6), phy(32) [ 32.297646] mpt3sas_cm0: REPORT_LUNS: handle(0x00f0), retries(0) [ 32.312118] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00f0), lun(0) [ 32.319291] scsi 0:0:216:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 32.327954] scsi 0:0:216:0: SSP: handle(0x00f0), sas_addr(0x5000c500954cc8d6), phy(32), device_name(0x5000c500954cc8d4) [ 32.338723] scsi 0:0:216:0: enclosure logical id(0x500163600190c8fd), slot(32) [ 32.346028] scsi 0:0:216:0: enclosure level(0x0000), connector name( C2 ) [ 32.352923] scsi 0:0:216:0: serial_number(ZA1ALGNR0000R8302KGJ) [ 32.358842] scsi 0:0:216:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 32.382214] mpt3sas_cm0: detecting: handle(0x00f1), sas_address(0x5000c500a6102de2), phy(33) [ 32.390652] mpt3sas_cm0: REPORT_LUNS: handle(0x00f1), retries(0) [ 32.411566] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00f1), lun(0) [ 32.418758] scsi 0:0:217:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 32.427421] scsi 0:0:217:0: SSP: handle(0x00f1), sas_addr(0x5000c500a6102de2), phy(33), device_name(0x5000c500a6102de0) [ 32.438193] scsi 0:0:217:0: enclosure logical id(0x500163600190c8fd), slot(33) [ 32.445497] scsi 0:0:217:0: enclosure level(0x0000), connector name( C2 ) [ 32.452391] scsi 0:0:217:0: serial_number(ZA1B72S70000R833V13M) [ 32.458310] scsi 0:0:217:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 32.481210] mpt3sas_cm0: detecting: handle(0x00f2), sas_address(0x5000c500954cc656), phy(34) [ 32.489651] mpt3sas_cm0: REPORT_LUNS: handle(0x00f2), retries(0) [ 32.507025] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00f2), lun(0) [ 32.514157] scsi 0:0:218:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 32.522820] scsi 0:0:218:0: SSP: handle(0x00f2), sas_addr(0x5000c500954cc656), phy(34), device_name(0x5000c500954cc654) [ 32.533595] scsi 0:0:218:0: enclosure logical id(0x500163600190c8fd), slot(34) [ 32.540901] scsi 0:0:218:0: enclosure level(0x0000), connector name( C2 ) [ 32.547798] scsi 0:0:218:0: serial_number(ZA1ALGS20000C8327479) [ 32.553726] scsi 0:0:218:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 32.577216] mpt3sas_cm0: detecting: handle(0x00f3), sas_address(0x5000c500954d38ca), phy(35) [ 32.585654] mpt3sas_cm0: REPORT_LUNS: handle(0x00f3), retries(0) [ 32.602896] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00f3), lun(0) [ 32.610037] scsi 0:0:219:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 32.618715] scsi 0:0:219:0: SSP: handle(0x00f3), sas_addr(0x5000c500954d38ca), phy(35), device_name(0x5000c500954d38c8) [ 32.629486] scsi 0:0:219:0: enclosure logical id(0x500163600190c8fd), slot(35) [ 32.636792] scsi 0:0:219:0: enclosure level(0x0000), connector name( C2 ) [ 32.643685] scsi 0:0:219:0: serial_number(ZA1ALXWM0000R83026JR) [ 32.649603] scsi 0:0:219:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 32.672213] mpt3sas_cm0: detecting: handle(0x00f4), sas_address(0x5000c500954d94d2), phy(36) [ 32.680650] mpt3sas_cm0: REPORT_LUNS: handle(0x00f4), retries(0) [ 32.695772] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00f4), lun(0) [ 32.702927] scsi 0:0:220:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 32.711587] scsi 0:0:220:0: SSP: handle(0x00f4), sas_addr(0x5000c500954d94d2), phy(36), device_name(0x5000c500954d94d0) [ 32.722358] scsi 0:0:220:0: enclosure logical id(0x500163600190c8fd), slot(36) [ 32.729665] scsi 0:0:220:0: enclosure level(0x0000), connector name( C2 ) [ 32.736556] scsi 0:0:220:0: serial_number(ZA1AM3VG0000R8313JPX) [ 32.742477] scsi 0:0:220:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 32.766214] mpt3sas_cm0: detecting: handle(0x00f5), sas_address(0x5000c500a610528a), phy(37) [ 32.774650] mpt3sas_cm0: REPORT_LUNS: handle(0x00f5), retries(0) [ 32.788356] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00f5), lun(0) [ 32.795512] scsi 0:0:221:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 32.804177] scsi 0:0:221:0: SSP: handle(0x00f5), sas_addr(0x5000c500a610528a), phy(37), device_name(0x5000c500a6105288) [ 32.814946] scsi 0:0:221:0: enclosure logical id(0x500163600190c8fd), slot(37) [ 32.822251] scsi 0:0:221:0: enclosure level(0x0000), connector name( C2 ) [ 32.829143] scsi 0:0:221:0: serial_number(ZA1B727K0000R8372HYT) [ 32.835062] scsi 0:0:221:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 32.861208] mpt3sas_cm0: detecting: handle(0x00f6), sas_address(0x5000c500a6103fda), phy(38) [ 32.869662] mpt3sas_cm0: REPORT_LUNS: handle(0x00f6), retries(0) [ 32.881063] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00f6), lun(0) [ 32.888194] scsi 0:0:222:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 32.896861] scsi 0:0:222:0: SSP: handle(0x00f6), sas_addr(0x5000c500a6103fda), phy(38), device_name(0x5000c500a6103fd8) [ 32.907637] scsi 0:0:222:0: enclosure logical id(0x500163600190c8fd), slot(38) [ 32.914943] scsi 0:0:222:0: enclosure level(0x0000), connector name( C2 ) [ 32.921838] scsi 0:0:222:0: serial_number(ZA1B72HS0000R8331QSS) [ 32.927764] scsi 0:0:222:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 32.951225] mpt3sas_cm0: detecting: handle(0x00f7), sas_address(0x5000c500a6105756), phy(39) [ 32.959661] mpt3sas_cm0: REPORT_LUNS: handle(0x00f7), retries(0) [ 32.971937] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00f7), lun(0) [ 32.979069] scsi 0:0:223:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 32.987727] scsi 0:0:223:0: SSP: handle(0x00f7), sas_addr(0x5000c500a6105756), phy(39), device_name(0x5000c500a6105754) [ 32.998498] scsi 0:0:223:0: enclosure logical id(0x500163600190c8fd), slot(39) [ 33.005805] scsi 0:0:223:0: enclosure level(0x0000), connector name( C2 ) [ 33.012698] scsi 0:0:223:0: serial_number(ZA1B72670000R833UYPW) [ 33.018619] scsi 0:0:223:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 33.047238] mpt3sas_cm0: detecting: handle(0x00f8), sas_address(0x5000c500956c75a2), phy(40) [ 33.055679] mpt3sas_cm0: REPORT_LUNS: handle(0x00f8), retries(0) [ 33.076825] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00f8), lun(0) [ 33.083987] scsi 0:0:224:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 33.092649] scsi 0:0:224:0: SSP: handle(0x00f8), sas_addr(0x5000c500956c75a2), phy(40), device_name(0x5000c500956c75a0) [ 33.103418] scsi 0:0:224:0: enclosure logical id(0x500163600190c8fd), slot(40) [ 33.110726] scsi 0:0:224:0: enclosure level(0x0000), connector name( C2 ) [ 33.117617] scsi 0:0:224:0: serial_number(ZA1B0V530000R8332QYC) [ 33.123536] scsi 0:0:224:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 33.152211] mpt3sas_cm0: detecting: handle(0x00f9), sas_address(0x5000c500a61033e2), phy(41) [ 33.160665] mpt3sas_cm0: REPORT_LUNS: handle(0x00f9), retries(0) [ 33.171426] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00f9), lun(0) [ 33.178589] scsi 0:0:225:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 33.187248] scsi 0:0:225:0: SSP: handle(0x00f9), sas_addr(0x5000c500a61033e2), phy(41), device_name(0x5000c500a61033e0) [ 33.198018] scsi 0:0:225:0: enclosure logical id(0x500163600190c8fd), slot(41) [ 33.205324] scsi 0:0:225:0: enclosure level(0x0000), connector name( C2 ) [ 33.212216] scsi 0:0:225:0: serial_number(ZA1B737J0000R8332RQ1) [ 33.218134] scsi 0:0:225:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 33.244218] mpt3sas_cm0: detecting: handle(0x00fa), sas_address(0x5000c500a6104d26), phy(42) [ 33.252673] mpt3sas_cm0: REPORT_LUNS: handle(0x00fa), retries(0) [ 33.265575] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00fa), lun(0) [ 33.272736] scsi 0:0:226:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 33.281390] scsi 0:0:226:0: SSP: handle(0x00fa), sas_addr(0x5000c500a6104d26), phy(42), device_name(0x5000c500a6104d24) [ 33.292165] scsi 0:0:226:0: enclosure logical id(0x500163600190c8fd), slot(42) [ 33.299469] scsi 0:0:226:0: enclosure level(0x0000), connector name( C2 ) [ 33.306363] scsi 0:0:226:0: serial_number(ZA1B72AS0000R833UYB9) [ 33.312280] scsi 0:0:226:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 33.335227] mpt3sas_cm0: detecting: handle(0x00fb), sas_address(0x5000c500a6102116), phy(43) [ 33.343666] mpt3sas_cm0: REPORT_LUNS: handle(0x00fb), retries(0) [ 33.355738] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00fb), lun(0) [ 33.362878] scsi 0:0:227:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 33.371538] scsi 0:0:227:0: SSP: handle(0x00fb), sas_addr(0x5000c500a6102116), phy(43), device_name(0x5000c500a6102114) [ 33.382308] scsi 0:0:227:0: enclosure logical id(0x500163600190c8fd), slot(43) [ 33.389614] scsi 0:0:227:0: enclosure level(0x0000), connector name( C2 ) [ 33.396506] scsi 0:0:227:0: serial_number(ZA1B731E0000R833UYGB) [ 33.402426] scsi 0:0:227:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 33.425809] mpt3sas_cm0: detecting: handle(0x00fc), sas_address(0x5000c500a610647a), phy(44) [ 33.434243] mpt3sas_cm0: REPORT_LUNS: handle(0x00fc), retries(0) [ 33.440836] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00fc), lun(0) [ 33.447983] scsi 0:0:228:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 33.456647] scsi 0:0:228:0: SSP: handle(0x00fc), sas_addr(0x5000c500a610647a), phy(44), device_name(0x5000c500a6106478) [ 33.467424] scsi 0:0:228:0: enclosure logical id(0x500163600190c8fd), slot(44) [ 33.474729] scsi 0:0:228:0: enclosure level(0x0000), connector name( C2 ) [ 33.481624] scsi 0:0:228:0: serial_number(ZA1B72310000R8314SBW) [ 33.487541] scsi 0:0:228:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 33.510219] mpt3sas_cm0: detecting: handle(0x00fd), sas_address(0x5000c500a610264e), phy(45) [ 33.518659] mpt3sas_cm0: REPORT_LUNS: handle(0x00fd), retries(0) [ 33.525150] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00fd), lun(0) [ 33.532313] scsi 0:0:229:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 33.540977] scsi 0:0:229:0: SSP: handle(0x00fd), sas_addr(0x5000c500a610264e), phy(45), device_name(0x5000c500a610264c) [ 33.551751] scsi 0:0:229:0: enclosure logical id(0x500163600190c8fd), slot(45) [ 33.559057] scsi 0:0:229:0: enclosure level(0x0000), connector name( C2 ) [ 33.565957] scsi 0:0:229:0: serial_number(ZA1B72XL0000R833UYDL) [ 33.571880] scsi 0:0:229:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 33.595235] mpt3sas_cm0: detecting: handle(0x00fe), sas_address(0x5000c500954d4402), phy(46) [ 33.603671] mpt3sas_cm0: REPORT_LUNS: handle(0x00fe), retries(0) [ 33.623325] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00fe), lun(0) [ 33.630468] scsi 0:0:230:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 33.639135] scsi 0:0:230:0: SSP: handle(0x00fe), sas_addr(0x5000c500954d4402), phy(46), device_name(0x5000c500954d4400) [ 33.649912] scsi 0:0:230:0: enclosure logical id(0x500163600190c8fd), slot(46) [ 33.657218] scsi 0:0:230:0: enclosure level(0x0000), connector name( C2 ) [ 33.664110] scsi 0:0:230:0: serial_number(ZA1AHBRF0000R8318PP8) [ 33.670030] scsi 0:0:230:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 33.693222] mpt3sas_cm0: detecting: handle(0x00ff), sas_address(0x5000c500957eb4c6), phy(47) [ 33.701659] mpt3sas_cm0: REPORT_LUNS: handle(0x00ff), retries(0) [ 33.715050] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00ff), lun(0) [ 33.722217] scsi 0:0:231:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 33.730878] scsi 0:0:231:0: SSP: handle(0x00ff), sas_addr(0x5000c500957eb4c6), phy(47), device_name(0x5000c500957eb4c4) [ 33.741650] scsi 0:0:231:0: enclosure logical id(0x500163600190c8fd), slot(47) [ 33.748955] scsi 0:0:231:0: enclosure level(0x0000), connector name( C2 ) [ 33.755851] scsi 0:0:231:0: serial_number(ZA1B6AXY0000R8332SL8) [ 33.761775] scsi 0:0:231:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 33.787226] mpt3sas_cm0: detecting: handle(0x0100), sas_address(0x5000c500954328f6), phy(48) [ 33.795684] mpt3sas_cm0: REPORT_LUNS: handle(0x0100), retries(0) [ 33.809275] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0100), lun(0) [ 33.816445] scsi 0:0:232:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 33.825106] scsi 0:0:232:0: SSP: handle(0x0100), sas_addr(0x5000c500954328f6), phy(48), device_name(0x5000c500954328f4) [ 33.835883] scsi 0:0:232:0: enclosure logical id(0x500163600190c8fd), slot(48) [ 33.843188] scsi 0:0:232:0: enclosure level(0x0000), connector name( C2 ) [ 33.850096] scsi 0:0:232:0: serial_number(ZA1AGMWA0000C8316H64) [ 33.856019] scsi 0:0:232:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 33.879222] mpt3sas_cm0: detecting: handle(0x0101), sas_address(0x5000c50095432166), phy(49) [ 33.887665] mpt3sas_cm0: REPORT_LUNS: handle(0x0101), retries(0) [ 33.910066] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0101), lun(0) [ 33.917245] scsi 0:0:233:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 33.925910] scsi 0:0:233:0: SSP: handle(0x0101), sas_addr(0x5000c50095432166), phy(49), device_name(0x5000c50095432164) [ 33.936687] scsi 0:0:233:0: enclosure logical id(0x500163600190c8fd), slot(49) [ 33.943992] scsi 0:0:233:0: enclosure level(0x0000), connector name( C2 ) [ 33.950884] scsi 0:0:233:0: serial_number(ZA1AGGY80000C724RXCM) [ 33.956805] scsi 0:0:233:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 33.980226] mpt3sas_cm0: detecting: handle(0x0102), sas_address(0x5000c500954313be), phy(50) [ 33.988666] mpt3sas_cm0: REPORT_LUNS: handle(0x0102), retries(0) [ 33.995215] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0102), lun(0) [ 34.002362] scsi 0:0:234:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 34.011023] scsi 0:0:234:0: SSP: handle(0x0102), sas_addr(0x5000c500954313be), phy(50), device_name(0x5000c500954313bc) [ 34.021795] scsi 0:0:234:0: enclosure logical id(0x500163600190c8fd), slot(50) [ 34.029100] scsi 0:0:234:0: enclosure level(0x0000), connector name( C2 ) [ 34.035995] scsi 0:0:234:0: serial_number(ZA1AGHD30000C8316HPY) [ 34.041913] scsi 0:0:234:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 34.068227] mpt3sas_cm0: detecting: handle(0x0103), sas_address(0x5000c50095431582), phy(51) [ 34.076669] mpt3sas_cm0: REPORT_LUNS: handle(0x0103), retries(0) [ 34.089740] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0103), lun(0) [ 34.096888] scsi 0:0:235:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 34.105555] scsi 0:0:235:0: SSP: handle(0x0103), sas_addr(0x5000c50095431582), phy(51), device_name(0x5000c50095431580) [ 34.116331] scsi 0:0:235:0: enclosure logical id(0x500163600190c8fd), slot(51) [ 34.123636] scsi 0:0:235:0: enclosure level(0x0000), connector name( C2 ) [ 34.130531] scsi 0:0:235:0: serial_number(ZA1AGHB90000R7245BUM) [ 34.136449] scsi 0:0:235:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 34.160236] mpt3sas_cm0: detecting: handle(0x0104), sas_address(0x5000c50095430f2a), phy(52) [ 34.168677] mpt3sas_cm0: REPORT_LUNS: handle(0x0104), retries(0) [ 34.175256] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0104), lun(0) [ 34.182426] scsi 0:0:236:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 34.191084] scsi 0:0:236:0: SSP: handle(0x0104), sas_addr(0x5000c50095430f2a), phy(52), device_name(0x5000c50095430f28) [ 34.201855] scsi 0:0:236:0: enclosure logical id(0x500163600190c8fd), slot(52) [ 34.209161] scsi 0:0:236:0: enclosure level(0x0000), connector name( C2 ) [ 34.216053] scsi 0:0:236:0: serial_number(ZA1AGHJF0000C8316HQY) [ 34.221973] scsi 0:0:236:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 34.246234] mpt3sas_cm0: detecting: handle(0x0105), sas_address(0x5000c500954327f2), phy(53) [ 34.254678] mpt3sas_cm0: REPORT_LUNS: handle(0x0105), retries(0) [ 34.272861] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0105), lun(0) [ 34.280028] scsi 0:0:237:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 34.288696] scsi 0:0:237:0: SSP: handle(0x0105), sas_addr(0x5000c500954327f2), phy(53), device_name(0x5000c500954327f0) [ 34.299470] scsi 0:0:237:0: enclosure logical id(0x500163600190c8fd), slot(53) [ 34.306776] scsi 0:0:237:0: enclosure level(0x0000), connector name( C2 ) [ 34.313669] scsi 0:0:237:0: serial_number(ZA1AGGP90000R814TJY2) [ 34.319586] scsi 0:0:237:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 34.342224] mpt3sas_cm0: detecting: handle(0x0106), sas_address(0x5000c500954327fa), phy(54) [ 34.350662] mpt3sas_cm0: REPORT_LUNS: handle(0x0106), retries(0) [ 34.370970] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0106), lun(0) [ 34.378162] scsi 0:0:238:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 34.386823] scsi 0:0:238:0: SSP: handle(0x0106), sas_addr(0x5000c500954327fa), phy(54), device_name(0x5000c500954327f8) [ 34.397594] scsi 0:0:238:0: enclosure logical id(0x500163600190c8fd), slot(54) [ 34.404899] scsi 0:0:238:0: enclosure level(0x0000), connector name( C2 ) [ 34.411795] scsi 0:0:238:0: serial_number(ZA1AGGP70000C8316FPD) [ 34.417720] scsi 0:0:238:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 34.441226] mpt3sas_cm0: detecting: handle(0x0107), sas_address(0x5000c5009543222e), phy(55) [ 34.449663] mpt3sas_cm0: REPORT_LUNS: handle(0x0107), retries(0) [ 34.461579] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0107), lun(0) [ 34.468722] scsi 0:0:239:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 34.477379] scsi 0:0:239:0: SSP: handle(0x0107), sas_addr(0x5000c5009543222e), phy(55), device_name(0x5000c5009543222c) [ 34.488154] scsi 0:0:239:0: enclosure logical id(0x500163600190c8fd), slot(55) [ 34.495459] scsi 0:0:239:0: enclosure level(0x0000), connector name( C2 ) [ 34.502354] scsi 0:0:239:0: serial_number(ZA1AGH6Q0000C8316FPY) [ 34.508270] scsi 0:0:239:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 34.531232] mpt3sas_cm0: detecting: handle(0x0108), sas_address(0x5000c50095372626), phy(56) [ 34.539675] mpt3sas_cm0: REPORT_LUNS: handle(0x0108), retries(0) [ 34.560405] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0108), lun(0) [ 34.567563] scsi 0:0:240:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 34.576227] scsi 0:0:240:0: SSP: handle(0x0108), sas_addr(0x5000c50095372626), phy(56), device_name(0x5000c50095372624) [ 34.586999] scsi 0:0:240:0: enclosure logical id(0x500163600190c8fd), slot(56) [ 34.594303] scsi 0:0:240:0: enclosure level(0x0000), connector name( C2 ) [ 34.601198] scsi 0:0:240:0: serial_number(ZA1ABZ4Y0000R829D6VF) [ 34.607116] scsi 0:0:240:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 34.630232] mpt3sas_cm0: detecting: handle(0x0109), sas_address(0x5000c50095430cb2), phy(57) [ 34.638666] mpt3sas_cm0: REPORT_LUNS: handle(0x0109), retries(0) [ 34.651002] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0109), lun(0) [ 34.658172] scsi 0:0:241:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 34.666831] scsi 0:0:241:0: SSP: handle(0x0109), sas_addr(0x5000c50095430cb2), phy(57), device_name(0x5000c50095430cb0) [ 34.677599] scsi 0:0:241:0: enclosure logical id(0x500163600190c8fd), slot(57) [ 34.684907] scsi 0:0:241:0: enclosure level(0x0000), connector name( C2 ) [ 34.691798] scsi 0:0:241:0: serial_number(ZA1AGHLV0000R823QBK4) [ 34.697718] scsi 0:0:241:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 34.721231] mpt3sas_cm0: detecting: handle(0x010a), sas_address(0x5000c50095430c32), phy(58) [ 34.729668] mpt3sas_cm0: REPORT_LUNS: handle(0x010a), retries(0) [ 34.750959] mpt3sas_cm0: TEST_UNIT_READY: handle(0x010a), lun(0) [ 34.758105] scsi 0:0:242:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 34.766765] scsi 0:0:242:0: SSP: handle(0x010a), sas_addr(0x5000c50095430c32), phy(58), device_name(0x5000c50095430c30) [ 34.777539] scsi 0:0:242:0: enclosure logical id(0x500163600190c8fd), slot(58) [ 34.784842] scsi 0:0:242:0: enclosure level(0x0000), connector name( C2 ) [ 34.791736] scsi 0:0:242:0: serial_number(ZA1AGHMK0000R824E79X) [ 34.797655] scsi 0:0:242:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 34.821232] mpt3sas_cm0: detecting: handle(0x010b), sas_address(0x5000c500954327ce), phy(59) [ 34.829674] mpt3sas_cm0: REPORT_LUNS: handle(0x010b), retries(0) [ 34.851363] mpt3sas_cm0: TEST_UNIT_READY: handle(0x010b), lun(0) [ 34.858505] scsi 0:0:243:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 34.867155] scsi 0:0:243:0: SSP: handle(0x010b), sas_addr(0x5000c500954327ce), phy(59), device_name(0x5000c500954327cc) [ 34.877924] scsi 0:0:243:0: enclosure logical id(0x500163600190c8fd), slot(59) [ 34.885230] scsi 0:0:243:0: enclosure level(0x0000), connector name( C2 ) [ 34.892123] scsi 0:0:243:0: serial_number(ZA1AGGPH0000R829CU4W) [ 34.898042] scsi 0:0:243:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 34.922407] mpt3sas_cm0: detecting: handle(0x010d), sas_address(0x500163600190c8fd), phy(76) [ 34.930865] mpt3sas_cm0: REPORT_LUNS: handle(0x010d), retries(0) [ 34.937063] mpt3sas_cm0: TEST_UNIT_READY: handle(0x010d), lun(0) [ 34.943577] scsi 0:0:244:0: Enclosure QCT JB4602 SIM 1 1500 PQ: 0 ANSI: 6 [ 34.952055] scsi 0:0:244:0: set ignore_delay_remove for handle(0x010d) [ 34.958577] scsi 0:0:244:0: SES: handle(0x010d), sas_addr(0x500163600190c8fd), phy(76), device_name(0x500163600190c8fd) [ 34.969350] scsi 0:0:244:0: enclosure logical id(0x500163600190c8fd), slot(60) [ 34.976657] scsi 0:0:244:0: enclosure level(0x0000), connector name( C2 ) [ 34.983550] scsi 0:0:244:0: serial_number(EO0152000010 ) [ 34.989122] scsi 0:0:244:0: qdepth(1), tagged(0), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 35.009776] mpt3sas_cm0: port enable: SUCCESS [ 35.040436] sd 0:0:2:0: [sdb] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.040791] sd 0:0:1:0: [sda] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.040793] sd 0:0:1:0: [sda] 4096-byte physical blocks [ 35.042734] sd 0:0:9:0: [sdi] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.042736] sd 0:0:9:0: [sdi] 4096-byte physical blocks [ 35.042907] sd 0:0:14:0: [sdo] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.042909] sd 0:0:14:0: [sdo] 4096-byte physical blocks [ 35.043075] sd 0:0:10:0: [sdj] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.043076] sd 0:0:10:0: [sdj] 4096-byte physical blocks [ 35.043172] sd 0:0:1:0: [sda] Write Protect is off [ 35.043174] sd 0:0:1:0: [sda] Mode Sense: db 00 10 08 [ 35.043294] sd 0:0:22:0: [sdy] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.043296] sd 0:0:22:0: [sdy] 4096-byte physical blocks [ 35.043495] sd 0:0:21:0: [sdx] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.043497] sd 0:0:21:0: [sdx] 4096-byte physical blocks [ 35.043708] sd 0:0:25:0: [sdac] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.043709] sd 0:0:25:0: [sdac] 4096-byte physical blocks [ 35.044209] sd 0:0:26:0: [sdad] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.044211] sd 0:0:26:0: [sdad] 4096-byte physical blocks [ 35.044281] sd 0:0:33:0: [sdam] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.044284] sd 0:0:33:0: [sdam] 4096-byte physical blocks [ 35.044298] sd 0:0:32:0: [sdal] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.044300] sd 0:0:32:0: [sdal] 4096-byte physical blocks [ 35.044465] sd 0:0:1:0: [sda] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.044527] sd 0:0:90:0: [sdae] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.044529] sd 0:0:90:0: [sdae] 4096-byte physical blocks [ 35.044583] sd 0:0:91:0: [sdaj] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.044585] sd 0:0:91:0: [sdaj] 4096-byte physical blocks [ 35.044588] sd 0:0:37:0: [sdas] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.044589] sd 0:0:37:0: [sdas] 4096-byte physical blocks [ 35.044731] sd 0:0:38:0: [sdat] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.044733] sd 0:0:38:0: [sdat] 4096-byte physical blocks [ 35.045016] sd 0:0:40:0: [sdav] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.045018] sd 0:0:40:0: [sdav] 4096-byte physical blocks [ 35.045168] sd 0:0:9:0: [sdi] Write Protect is off [ 35.045170] sd 0:0:9:0: [sdi] Mode Sense: db 00 10 08 [ 35.045282] sd 0:0:34:0: [sdao] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.045284] sd 0:0:34:0: [sdao] 4096-byte physical blocks [ 35.045404] sd 0:0:10:0: [sdj] Write Protect is off [ 35.045406] sd 0:0:10:0: [sdj] Mode Sense: db 00 10 08 [ 35.045681] sd 0:0:22:0: [sdy] Write Protect is off [ 35.045682] sd 0:0:22:0: [sdy] Mode Sense: db 00 10 08 [ 35.045727] sd 0:0:14:0: [sdo] Write Protect is off [ 35.045729] sd 0:0:14:0: [sdo] Mode Sense: db 00 10 08 [ 35.045808] sd 0:0:21:0: [sdx] Write Protect is off [ 35.045809] sd 0:0:21:0: [sdx] Mode Sense: db 00 10 08 [ 35.046087] sd 0:0:25:0: [sdac] Write Protect is off [ 35.046088] sd 0:0:25:0: [sdac] Mode Sense: db 00 10 08 [ 35.046352] sd 0:0:4:0: [sdd] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.046355] sd 0:0:4:0: [sdd] 4096-byte physical blocks [ 35.046468] sd 0:0:9:0: [sdi] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.046633] sd 0:0:33:0: [sdam] Write Protect is off [ 35.046636] sd 0:0:33:0: [sdam] Mode Sense: db 00 10 08 [ 35.046646] sd 0:0:32:0: [sdal] Write Protect is off [ 35.046647] sd 0:0:32:0: [sdal] Mode Sense: db 00 10 08 [ 35.046694] sd 0:0:10:0: [sdj] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.046720] sd 0:0:26:0: [sdad] Write Protect is off [ 35.046721] sd 0:0:26:0: [sdad] Mode Sense: db 00 10 08 [ 35.046908] sd 0:0:90:0: [sdae] Write Protect is off [ 35.046910] sd 0:0:90:0: [sdae] Mode Sense: db 00 10 08 [ 35.046920] sd 0:0:91:0: [sdaj] Write Protect is off [ 35.046922] sd 0:0:91:0: [sdaj] Mode Sense: db 00 10 08 [ 35.046979] sd 0:0:37:0: [sdas] Write Protect is off [ 35.046982] sd 0:0:37:0: [sdas] Mode Sense: db 00 10 08 [ 35.047003] sd 0:0:22:0: [sdy] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.047035] sd 0:0:14:0: [sdo] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.047037] sd 0:0:49:0: [sdbi] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.047039] sd 0:0:49:0: [sdbi] 4096-byte physical blocks [ 35.047049] sd 0:0:38:0: [sdat] Write Protect is off [ 35.047050] sd 0:0:38:0: [sdat] Mode Sense: db 00 10 08 [ 35.047122] sd 0:0:45:0: [sdbc] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.047124] sd 0:0:45:0: [sdbc] 4096-byte physical blocks [ 35.047138] sd 0:0:7:0: [sdg] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.047139] sd 0:0:7:0: [sdg] 4096-byte physical blocks [ 35.047254] sd 0:0:21:0: [sdx] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.047272] sd 0:0:50:0: [sdbj] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.047273] sd 0:0:50:0: [sdbj] 4096-byte physical blocks [ 35.047359] sd 0:0:15:0: [sdp] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.047361] sd 0:0:15:0: [sdp] 4096-byte physical blocks [ 35.047374] sd 0:0:40:0: [sdav] Write Protect is off [ 35.047375] sd 0:0:40:0: [sdav] Mode Sense: db 00 10 08 [ 35.047403] sd 0:0:25:0: [sdac] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.047418] sd 0:0:57:0: [sdbt] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.047420] sd 0:0:57:0: [sdbt] 4096-byte physical blocks [ 35.047529] sd 0:0:18:0: [sdt] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.047530] sd 0:0:18:0: [sdt] 4096-byte physical blocks [ 35.047668] sd 0:0:102:0: [sdca] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.047670] sd 0:0:102:0: [sdca] 4096-byte physical blocks [ 35.047811] sd 0:0:34:0: [sdao] Write Protect is off [ 35.047813] sd 0:0:34:0: [sdao] Mode Sense: db 00 10 08 [ 35.047884] sd 0:0:103:0: [sdcf] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.047886] sd 0:0:103:0: [sdcf] 4096-byte physical blocks [ 35.047985] sd 0:0:66:0: [sdcd] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.047987] sd 0:0:66:0: [sdcd] 4096-byte physical blocks [ 35.048007] sd 0:0:26:0: [sdad] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.048067] sd 0:0:67:0: [sdce] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.048070] sd 0:0:67:0: [sdce] 4096-byte physical blocks [ 35.048204] sd 0:0:90:0: [sdae] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.048216] sd 0:0:87:0: [sdr] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.048218] sd 0:0:87:0: [sdr] 4096-byte physical blocks [ 35.048220] sd 0:0:32:0: [sdal] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.048230] sd 0:0:33:0: [sdam] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.048284] sd 0:0:91:0: [sdaj] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.048447] sd 0:0:38:0: [sdat] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.048474] sd 0:0:37:0: [sdas] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.048771] sd 0:0:11:0: [sdk] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.048783] sd 0:0:11:0: [sdk] 4096-byte physical blocks [ 35.048811] sd 0:0:58:0: [sdbu] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.048812] sd 0:0:58:0: [sdbu] 4096-byte physical blocks [ 35.048836] sd 0:0:68:0: [sdcg] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.048838] sd 0:0:68:0: [sdcg] 4096-byte physical blocks [ 35.048893] sd 0:0:40:0: [sdav] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.048960] sd 0:0:8:0: [sdh] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.048961] sd 0:0:8:0: [sdh] 4096-byte physical blocks [ 35.049132] sd 0:0:34:0: [sdao] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.049333] sd 0:0:29:0: [sdah] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.049335] sd 0:0:29:0: [sdah] 4096-byte physical blocks [ 35.049990] sd 0:0:50:0: [sdbj] Write Protect is off [ 35.049992] sd 0:0:50:0: [sdbj] Mode Sense: db 00 10 08 [ 35.049998] sd 0:0:15:0: [sdp] Write Protect is off [ 35.050000] sd 0:0:15:0: [sdp] Mode Sense: db 00 10 08 [ 35.050087] sd 0:0:94:0: [sdaw] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.050089] sd 0:0:94:0: [sdaw] 4096-byte physical blocks [ 35.050157] sd 0:0:4:0: [sdd] Write Protect is off [ 35.050159] sd 0:0:4:0: [sdd] Mode Sense: db 00 10 08 [ 35.050301] sd 0:0:7:0: [sdg] Write Protect is off [ 35.050303] sd 0:0:7:0: [sdg] Mode Sense: db 00 10 08 [ 35.050314] sd 0:0:45:0: [sdbc] Write Protect is off [ 35.050315] sd 0:0:45:0: [sdbc] Mode Sense: db 00 10 08 [ 35.050318] sd 0:0:86:0: [sdm] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.050319] sd 0:0:86:0: [sdm] 4096-byte physical blocks [ 35.050327] sd 0:0:78:0: [sdct] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.050329] sd 0:0:78:0: [sdct] 4096-byte physical blocks [ 35.050346] sd 0:0:18:0: [sdt] Write Protect is off [ 35.050348] sd 0:0:18:0: [sdt] Mode Sense: db 00 10 08 [ 35.050354] sd 0:0:49:0: [sdbi] Write Protect is off [ 35.050356] sd 0:0:49:0: [sdbi] Mode Sense: db 00 10 08 [ 35.050491] sd 0:0:66:0: [sdcd] Write Protect is off [ 35.050493] sd 0:0:66:0: [sdcd] Mode Sense: db 00 10 08 [ 35.050515] sd 0:0:87:0: [sdr] Write Protect is off [ 35.050517] sd 0:0:87:0: [sdr] Mode Sense: db 00 10 08 [ 35.050795] sd 0:0:103:0: [sdcf] Write Protect is off [ 35.050797] sd 0:0:103:0: [sdcf] Mode Sense: db 00 10 08 [ 35.050889] sd 0:0:24:0: [sdab] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.050890] sd 0:0:24:0: [sdab] 4096-byte physical blocks [ 35.050894] sd 0:0:93:0: [sdar] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.050896] sd 0:0:93:0: [sdar] 4096-byte physical blocks [ 35.050944] sd 0:0:35:0: [sdap] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.050946] sd 0:0:35:0: [sdap] 4096-byte physical blocks [ 35.051184] sd 0:0:39:0: [sdau] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.051187] sd 0:0:39:0: [sdau] 4096-byte physical blocks [ 35.051342] sd 0:0:50:0: [sdbj] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.051359] sd 0:0:15:0: [sdp] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.051467] sd 0:0:57:0: [sdbt] Write Protect is off [ 35.051469] sd 0:0:57:0: [sdbt] Mode Sense: db 00 10 08 [ 35.051503] sd 0:0:102:0: [sdca] Write Protect is off [ 35.051505] sd 0:0:102:0: [sdca] Mode Sense: db 00 10 08 [ 35.051507] sd 0:0:11:0: [sdk] Write Protect is off [ 35.051509] sd 0:0:11:0: [sdk] Mode Sense: db 00 10 08 [ 35.051599] sd 0:0:7:0: [sdg] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.051615] sd 0:0:79:0: [sdcu] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.051617] sd 0:0:79:0: [sdcu] 4096-byte physical blocks [ 35.051622] sd 0:0:45:0: [sdbc] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.051651] sd 0:0:18:0: [sdt] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.051673] sd 0:0:49:0: [sdbi] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.051739] sd 0:0:28:0: [sdag] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.051740] sd 0:0:28:0: [sdag] 4096-byte physical blocks [ 35.051792] sd 0:0:66:0: [sdcd] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.051812] sd 0:0:8:0: [sdh] Write Protect is off [ 35.051813] sd 0:0:8:0: [sdh] Mode Sense: db 00 10 08 [ 35.051835] sd 0:0:23:0: [sdaa] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.051837] sd 0:0:23:0: [sdaa] 4096-byte physical blocks [ 35.051862] sd 0:0:87:0: [sdr] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.051875] sd 0:0:68:0: [sdcg] Write Protect is off [ 35.051876] sd 0:0:68:0: [sdcg] Mode Sense: db 00 10 08 [ 35.051891] sd 0:0:58:0: [sdbu] Write Protect is off [ 35.051892] sd 0:0:58:0: [sdbu] Mode Sense: db 00 10 08 [ 35.052078] sd 0:0:16:0: [sdq] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.052080] sd 0:0:16:0: [sdq] 4096-byte physical blocks [ 35.052150] sd 0:0:103:0: [sdcf] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.052324] sd 0:0:29:0: [sdah] Write Protect is off [ 35.052326] sd 0:0:29:0: [sdah] Mode Sense: db 00 10 08 [ 35.052423] sd 0:0:67:0: [sdce] Write Protect is off [ 35.052424] sd 0:0:67:0: [sdce] Mode Sense: db 00 10 08 [ 35.052453] sd 0:0:94:0: [sdaw] Write Protect is off [ 35.052455] sd 0:0:94:0: [sdaw] Mode Sense: db 00 10 08 [ 35.052735] sd 0:0:78:0: [sdct] Write Protect is off [ 35.052737] sd 0:0:78:0: [sdct] Mode Sense: db 00 10 08 [ 35.052789] sd 0:0:57:0: [sdbt] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.052791] sd 0:0:4:0: [sdd] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.052806] sd 0:0:102:0: [sdca] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.053518] sd 0:0:12:0: [sdl] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.053520] sd 0:0:12:0: [sdl] 4096-byte physical blocks [ 35.053544] sd 0:0:39:0: [sdau] Write Protect is off [ 35.053546] sd 0:0:39:0: [sdau] Mode Sense: db 00 10 08 [ 35.053559] sd 0:0:88:0: [sdv] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.053561] sd 0:0:88:0: [sdv] 4096-byte physical blocks [ 35.053566] sd 0:0:30:0: [sdai] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.053568] sd 0:0:30:0: [sdai] 4096-byte physical blocks [ 35.053593] sd 0:0:41:0: [sdax] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.053594] sd 0:0:41:0: [sdax] 4096-byte physical blocks [ 35.053604] sd 0:0:8:0: [sdh] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.053623] sd 0:0:68:0: [sdcg] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.053628] sd 0:0:11:0: [sdk] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.053633] sd 0:0:58:0: [sdbu] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.053644] sd 0:0:98:0: [sdbm] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.053646] sd 0:0:6:0: [sdf] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.053648] sd 0:0:6:0: [sdf] 4096-byte physical blocks [ 35.053650] sd 0:0:98:0: [sdbm] 4096-byte physical blocks [ 35.053657] sd 0:0:24:0: [sdab] Write Protect is off [ 35.053659] sd 0:0:24:0: [sdab] Mode Sense: db 00 10 08 [ 35.053667] sd 0:0:35:0: [sdap] Write Protect is off [ 35.053668] sd 0:0:35:0: [sdap] Mode Sense: db 00 10 08 [ 35.053758] sd 0:0:44:0: [sdbb] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.053760] sd 0:0:44:0: [sdbb] 4096-byte physical blocks [ 35.053848] sd 0:0:86:0: [sdm] Write Protect is off [ 35.053850] sd 0:0:86:0: [sdm] Mode Sense: db 00 10 08 [ 35.053901] sd 0:0:29:0: [sdah] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.054003] sd 0:0:79:0: [sdcu] Write Protect is off [ 35.054005] sd 0:0:27:0: [sdaf] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.054007] sd 0:0:79:0: [sdcu] Mode Sense: db 00 10 08 [ 35.054010] sd 0:0:27:0: [sdaf] 4096-byte physical blocks [ 35.054054] sd 0:0:78:0: [sdct] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.054076] sd 0:0:94:0: [sdaw] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.054117] sd 0:0:67:0: [sdce] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.054240] sd 0:0:93:0: [sdar] Write Protect is off [ 35.054243] sd 0:0:93:0: [sdar] Mode Sense: db 00 10 08 [ 35.054646] sd 0:0:105:0: [sdcn] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.054649] sd 0:0:105:0: [sdcn] 4096-byte physical blocks [ 35.054898] sd 0:0:23:0: [sdaa] Write Protect is off [ 35.054899] sd 0:0:23:0: [sdaa] Mode Sense: db 00 10 08 [ 35.054909] sd 0:0:28:0: [sdag] Write Protect is off [ 35.054911] sd 0:0:28:0: [sdag] Mode Sense: db 00 10 08 [ 35.054927] sd 0:0:39:0: [sdau] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.055024] sd 0:0:24:0: [sdab] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.055045] sd 0:0:42:0: [sday] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.055047] sd 0:0:42:0: [sday] 4096-byte physical blocks [ 35.055065] sd 0:0:35:0: [sdap] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.055085] sd 0:0:46:0: [sdbe] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.055087] sd 0:0:46:0: [sdbe] 4096-byte physical blocks [ 35.055217] sd 0:0:86:0: [sdm] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.055384] sd 0:0:19:0: [sdu] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.055385] sd 0:0:19:0: [sdu] 4096-byte physical blocks [ 35.055468] sd 0:0:17:0: [sds] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.055470] sd 0:0:17:0: [sds] 4096-byte physical blocks [ 35.055484] sd 0:0:55:0: [sdbp] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.055485] sd 0:0:55:0: [sdbp] 4096-byte physical blocks [ 35.055582] sd 0:0:79:0: [sdcu] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.055636] sd 0:0:93:0: [sdar] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.055756] sd 0:0:92:0: [sdan] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.055758] sd 0:0:92:0: [sdan] 4096-byte physical blocks [ 35.055779] sd 0:0:16:0: [sdq] Write Protect is off [ 35.055780] sd 0:0:16:0: [sdq] Mode Sense: db 00 10 08 [ 35.055791] sd 0:0:101:0: [sdbw] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.055793] sd 0:0:101:0: [sdbw] 4096-byte physical blocks [ 35.055974] sd 0:0:98:0: [sdbm] Write Protect is off [ 35.055976] sd 0:0:98:0: [sdbm] Mode Sense: db 00 10 08 [ 35.056163] sd 0:0:12:0: [sdl] Write Protect is off [ 35.056165] sd 0:0:12:0: [sdl] Mode Sense: db 00 10 08 [ 35.056264] sd 0:0:43:0: [sdba] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.056266] sd 0:0:43:0: [sdba] 4096-byte physical blocks [ 35.056283] sd 0:0:76:0: [sdcq] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.056285] sd 0:0:76:0: [sdcq] 4096-byte physical blocks [ 35.056291] sd 0:0:88:0: [sdv] Write Protect is off [ 35.056292] sd 0:0:88:0: [sdv] Mode Sense: db 00 10 08 [ 35.056407] sd 0:0:28:0: [sdag] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.056428] sd 0:0:23:0: [sdaa] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.056493] sd 0:0:20:0: [sdw] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.056494] sd 0:0:41:0: [sdax] Write Protect is off [ 35.056495] sd 0:0:20:0: [sdw] 4096-byte physical blocks [ 35.056496] sd 0:0:41:0: [sdax] Mode Sense: db 00 10 08 [ 35.056509] sd 0:0:56:0: [sdbr] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.056512] sd 0:0:56:0: [sdbr] 4096-byte physical blocks [ 35.056522] sd 0:0:6:0: [sdf] Write Protect is off [ 35.056524] sd 0:0:6:0: [sdf] Mode Sense: db 00 10 08 [ 35.056555] sd 0:0:27:0: [sdaf] Write Protect is off [ 35.056556] sd 0:0:27:0: [sdaf] Mode Sense: db 00 10 08 [ 35.056670] sd 0:0:3:0: [sdc] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.056672] sd 0:0:3:0: [sdc] 4096-byte physical blocks [ 35.056683] sd 0:0:44:0: [sdbb] Write Protect is off [ 35.056685] sd 0:0:44:0: [sdbb] Mode Sense: db 00 10 08 [ 35.056799] sd 0:0:47:0: [sdbf] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.056800] sd 0:0:47:0: [sdbf] 4096-byte physical blocks [ 35.057047] sd 0:0:54:0: [sdbo] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.057049] sd 0:0:54:0: [sdbo] 4096-byte physical blocks [ 35.057067] sd 0:0:30:0: [sdai] Write Protect is off [ 35.057068] sd 0:0:30:0: [sdai] Mode Sense: db 00 10 08 [ 35.057102] sd 0:0:16:0: [sdq] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.057233] sd 0:0:104:0: [sdcj] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.057235] sd 0:0:104:0: [sdcj] 4096-byte physical blocks [ 35.057280] sd 0:0:98:0: [sdbm] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.057341] sd 0:0:89:0: [sdz] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.057343] sd 0:0:89:0: [sdz] 4096-byte physical blocks [ 35.057473] sd 0:0:46:0: [sdbe] Write Protect is off [ 35.057475] sd 0:0:46:0: [sdbe] Mode Sense: db 00 10 08 [ 35.057513] sd 0:0:12:0: [sdl] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.057551] sd 0:0:105:0: [sdcn] Write Protect is off [ 35.057553] sd 0:0:105:0: [sdcn] Mode Sense: db 00 10 08 [ 35.057595] sd 0:0:88:0: [sdv] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.057618] sd 0:0:97:0: [sdbh] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.057620] sd 0:0:97:0: [sdbh] 4096-byte physical blocks [ 35.057783] sd 0:0:19:0: [sdu] Write Protect is off [ 35.057785] sd 0:0:19:0: [sdu] Mode Sense: db 00 10 08 [ 35.057857] sd 0:0:27:0: [sdaf] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.058016] sd 0:0:44:0: [sdbb] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.058022] sd 0:0:92:0: [sdan] Write Protect is off [ 35.058034] sd 0:0:92:0: [sdan] Mode Sense: db 00 10 08 [ 35.058086] sd 0:0:36:0: [sdaq] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.058088] sd 0:0:36:0: [sdaq] 4096-byte physical blocks [ 35.058091] sd 0:0:96:0: [sdbd] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.058093] sd 0:0:96:0: [sdbd] 4096-byte physical blocks [ 35.058151] sd 0:0:6:0: [sdf] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.058180] sd 0:0:41:0: [sdax] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.058419] sd 0:0:71:0: [sdck] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.058420] sd 0:0:71:0: [sdck] 4096-byte physical blocks [ 35.058438] sd 0:0:48:0: [sdbg] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.058439] sd 0:0:48:0: [sdbg] 4096-byte physical blocks [ 35.058464] sd 0:0:5:0: [sde] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.058465] sd 0:0:5:0: [sde] 4096-byte physical blocks [ 35.058955] sd 0:0:43:0: [sdba] Write Protect is off [ 35.058957] sd 0:0:43:0: [sdba] Mode Sense: db 00 10 08 [ 35.059044] sd 0:0:101:0: [sdbw] Write Protect is off [ 35.059045] sd 0:0:101:0: [sdbw] Mode Sense: db 00 10 08 [ 35.059077] sd 0:0:31:0: [sdak] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.059079] sd 0:0:31:0: [sdak] 4096-byte physical blocks [ 35.059090] sd 0:0:17:0: [sds] Write Protect is off [ 35.059091] sd 0:0:17:0: [sds] Mode Sense: db 00 10 08 [ 35.059101] sd 0:0:42:0: [sday] Write Protect is off [ 35.059102] sd 0:0:42:0: [sday] Mode Sense: db 00 10 08 [ 35.059111] sd 0:0:30:0: [sdai] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.059131] sd 0:0:105:0: [sdcn] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.059155] sd 0:0:46:0: [sdbe] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.059160] sd 0:0:55:0: [sdbp] Write Protect is off [ 35.059161] sd 0:0:55:0: [sdbp] Mode Sense: db 00 10 08 [ 35.059177] sd 0:0:20:0: [sdw] Write Protect is off [ 35.059179] sd 0:0:20:0: [sdw] Mode Sense: db 00 10 08 [ 35.059189] sd 0:0:19:0: [sdu] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.059379] sd 0:0:95:0: [sdaz] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.059380] sd 0:0:95:0: [sdaz] 4096-byte physical blocks [ 35.059431] sd 0:0:81:0: [sdcw] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.059432] sd 0:0:81:0: [sdcw] 4096-byte physical blocks [ 35.059449] sd 0:0:109:0: [sddd] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.059451] sd 0:0:109:0: [sddd] 4096-byte physical blocks [ 35.059509] sd 0:0:59:0: [sdbv] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.059511] sd 0:0:59:0: [sdbv] 4096-byte physical blocks [ 35.059521] sd 0:0:3:0: [sdc] Write Protect is off [ 35.059524] sd 0:0:3:0: [sdc] Mode Sense: db 00 10 08 [ 35.059561] sd 0:0:47:0: [sdbf] Write Protect is off [ 35.059563] sd 0:0:47:0: [sdbf] Mode Sense: db 00 10 08 [ 35.059605] sd 0:0:74:0: [sdco] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.059607] sd 0:0:74:0: [sdco] 4096-byte physical blocks [ 35.059739] sd 0:0:104:0: [sdcj] Write Protect is off [ 35.059741] sd 0:0:104:0: [sdcj] Mode Sense: db 00 10 08 [ 35.059794] sd 0:0:106:0: [sdcs] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.059796] sd 0:0:106:0: [sdcs] 4096-byte physical blocks [ 35.059959] sd 0:0:75:0: [sdcp] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.059960] sd 0:0:75:0: [sdcp] 4096-byte physical blocks [ 35.059985] sd 0:0:76:0: [sdcq] Write Protect is off [ 35.059987] sd 0:0:76:0: [sdcq] Mode Sense: db 00 10 08 [ 35.060075] sd 0:0:62:0: [sdby] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.060076] sd 0:0:62:0: [sdby] 4096-byte physical blocks [ 35.060118] sd 0:0:69:0: [sdch] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.060120] sd 0:0:69:0: [sdch] 4096-byte physical blocks [ 35.060249] sd 0:0:43:0: [sdba] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.060363] sd 0:0:54:0: [sdbo] Write Protect is off [ 35.060365] sd 0:0:54:0: [sdbo] Mode Sense: db 00 10 08 [ 35.060416] sd 0:0:56:0: [sdbr] Write Protect is off [ 35.060417] sd 0:0:56:0: [sdbr] Mode Sense: db 00 10 08 [ 35.060564] sd 0:0:92:0: [sdan] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.060591] sd 0:0:107:0: [sddb] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.060627] sd 0:0:101:0: [sdbw] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.060640] sd 0:0:70:0: [sdci] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.060641] sd 0:0:70:0: [sdci] 4096-byte physical blocks [ 35.060648] sd 0:0:107:0: [sddb] 4096-byte physical blocks [ 35.060653] sd 0:0:96:0: [sdbd] Write Protect is off [ 35.060655] sd 0:0:96:0: [sdbd] Mode Sense: db 00 10 08 [ 35.060795] sd 0:0:65:0: [sdcc] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.060797] sd 0:0:65:0: [sdcc] 4096-byte physical blocks [ 35.060807] sd 0:0:17:0: [sds] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.060820] sd 0:0:3:0: [sdc] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.060826] sd 0:0:42:0: [sday] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.060847] sd 0:0:55:0: [sdbp] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.060850] sd 0:0:20:0: [sdw] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.060875] sd 0:0:47:0: [sdbf] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.060921] sd 0:0:97:0: [sdbh] Write Protect is off [ 35.060923] sd 0:0:97:0: [sdbh] Mode Sense: db 00 10 08 [ 35.060971] sd 0:0:73:0: [sdcm] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.060973] sd 0:0:73:0: [sdcm] 4096-byte physical blocks [ 35.060983] sd 0:0:63:0: [sdbz] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.060985] sd 0:0:63:0: [sdbz] 4096-byte physical blocks [ 35.061129] sd 0:0:1:0: [sda] Attached SCSI disk [ 35.061133] sd 0:0:36:0: [sdaq] Write Protect is off [ 35.061135] sd 0:0:36:0: [sdaq] Mode Sense: db 00 10 08 [ 35.061259] sd 0:0:89:0: [sdz] Write Protect is off [ 35.061260] sd 0:0:89:0: [sdz] Mode Sense: db 00 10 08 [ 35.061509] sd 0:0:60:0: [sdbx] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.061511] sd 0:0:60:0: [sdbx] 4096-byte physical blocks [ 35.061517] sd 0:0:76:0: [sdcq] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.061562] sd 0:0:48:0: [sdbg] Write Protect is off [ 35.061564] sd 0:0:48:0: [sdbg] Mode Sense: db 00 10 08 [ 35.061728] sd 0:0:95:0: [sdaz] Write Protect is off [ 35.061731] sd 0:0:95:0: [sdaz] Mode Sense: db 00 10 08 [ 35.061800] sd 0:0:56:0: [sdbr] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.061823] sd 0:0:104:0: [sdcj] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.061926] sd 0:0:84:0: [sdcz] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.061928] sd 0:0:84:0: [sdcz] 4096-byte physical blocks [ 35.061938] sd 0:0:110:0: [sdde] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.061940] sd 0:0:110:0: [sdde] 4096-byte physical blocks [ 35.061988] sd 0:0:5:0: [sde] Write Protect is off [ 35.061990] sd 0:0:5:0: [sde] Mode Sense: db 00 10 08 [ 35.061999] sd 0:0:71:0: [sdck] Write Protect is off [ 35.062001] sd 0:0:71:0: [sdck] Mode Sense: db 00 10 08 [ 35.062018] sd 0:0:31:0: [sdak] Write Protect is off [ 35.062019] sd 0:0:31:0: [sdak] Mode Sense: db 00 10 08 [ 35.062029] sd 0:0:54:0: [sdbo] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.062110] sd 0:0:96:0: [sdbd] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.062397] sd 0:0:59:0: [sdbv] Write Protect is off [ 35.062398] sd 0:0:59:0: [sdbv] Mode Sense: db 00 10 08 [ 35.062552] sd 0:0:100:0: [sdbs] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.062554] sd 0:0:100:0: [sdbs] 4096-byte physical blocks [ 35.062561] sd 0:0:99:0: [sdbq] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.062569] sd 0:0:99:0: [sdbq] 4096-byte physical blocks [ 35.062591] sd 0:0:69:0: [sdch] Write Protect is off [ 35.062593] sd 0:0:69:0: [sdch] Mode Sense: db 00 10 08 [ 35.062645] sd 0:0:53:0: [sdbn] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.062646] sd 0:0:53:0: [sdbn] 4096-byte physical blocks [ 35.062686] sd 0:0:75:0: [sdcp] Write Protect is off [ 35.062689] sd 0:0:75:0: [sdcp] Mode Sense: db 00 10 08 [ 35.062700] sd 0:0:74:0: [sdco] Write Protect is off [ 35.062701] sd 0:0:74:0: [sdco] Mode Sense: db 00 10 08 [ 35.062720] sd 0:0:36:0: [sdaq] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.062745] sd 0:0:64:0: [sdcb] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.062746] sd 0:0:64:0: [sdcb] 4096-byte physical blocks [ 35.062876] sd 0:0:97:0: [sdbh] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.062891] sd 0:0:89:0: [sdz] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.063061] sd 0:0:52:0: [sdbl] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.063064] sd 0:0:52:0: [sdbl] 4096-byte physical blocks [ 35.063270] sd 0:0:109:0: [sddd] Write Protect is off [ 35.063272] sd 0:0:109:0: [sddd] Mode Sense: db 00 10 08 [ 35.063331] sd 0:0:95:0: [sdaz] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.063418] sd 0:0:106:0: [sdcs] Write Protect is off [ 35.063420] sd 0:0:106:0: [sdcs] Mode Sense: db 00 10 08 [ 35.063478] sd 0:0:51:0: [sdbk] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.063482] sd 0:0:51:0: [sdbk] 4096-byte physical blocks [ 35.063499] sd 0:0:70:0: [sdci] Write Protect is off [ 35.063501] sd 0:0:70:0: [sdci] Mode Sense: db 00 10 08 [ 35.063511] sd 0:0:62:0: [sdby] Write Protect is off [ 35.063513] sd 0:0:62:0: [sdby] Mode Sense: db 00 10 08 [ 35.063536] sd 0:0:73:0: [sdcm] Write Protect is off [ 35.063538] sd 0:0:73:0: [sdcm] Mode Sense: db 00 10 08 [ 35.063546] sd 0:0:63:0: [sdbz] Write Protect is off [ 35.063548] sd 0:0:63:0: [sdbz] Mode Sense: db 00 10 08 [ 35.063556] sd 0:0:65:0: [sdcc] Write Protect is off [ 35.063557] sd 0:0:65:0: [sdcc] Mode Sense: db 00 10 08 [ 35.063573] sd 0:0:5:0: [sde] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.063582] sd 0:0:71:0: [sdck] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.063591] sd 0:0:31:0: [sdak] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.063622] sd 0:0:48:0: [sdbg] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.063731] sd 0:0:59:0: [sdbv] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.064054] sd 0:0:10:0: [sdj] Attached SCSI disk [ 35.064105] sd 0:0:77:0: [sdcr] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.064107] sd 0:0:77:0: [sdcr] 4096-byte physical blocks [ 35.064124] sd 0:0:60:0: [sdbx] Write Protect is off [ 35.064126] sd 0:0:60:0: [sdbx] Mode Sense: db 00 10 08 [ 35.064206] sd 0:0:74:0: [sdco] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.064443] sd 0:0:75:0: [sdcp] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.064556] sd 0:0:69:0: [sdch] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.064631] sd 0:0:109:0: [sddd] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.064726] sd 0:0:106:0: [sdcs] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.064837] sd 0:0:114:0: [sddi] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.064838] sd 0:0:70:0: [sdci] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.064840] sd 0:0:114:0: [sddi] 4096-byte physical blocks [ 35.064866] sd 0:0:62:0: [sdby] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.064927] sd 0:0:82:0: [sdcx] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.064928] sd 0:0:82:0: [sdcx] 4096-byte physical blocks [ 35.064989] sd 0:0:72:0: [sdcl] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.064990] sd 0:0:72:0: [sdcl] 4096-byte physical blocks [ 35.065011] sd 0:0:73:0: [sdcm] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.065020] sd 0:0:63:0: [sdbz] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.065039] sd 0:0:65:0: [sdcc] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.065049] sd 0:0:84:0: [sdcz] Write Protect is off [ 35.065051] sd 0:0:84:0: [sdcz] Mode Sense: db 00 10 08 [ 35.065095] sd 0:0:108:0: [sddc] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.065096] sd 0:0:108:0: [sddc] 4096-byte physical blocks [ 35.065416] sd 0:0:110:0: [sdde] Write Protect is off [ 35.065419] sd 0:0:110:0: [sdde] Mode Sense: db 00 10 08 [ 35.065494] sd 0:0:34:0: [sdao] Attached SCSI disk [ 35.065514] sd 0:0:53:0: [sdbn] Write Protect is off [ 35.065516] sd 0:0:53:0: [sdbn] Mode Sense: db 00 10 08 [ 35.065704] sd 0:0:107:0: [sddb] Write Protect is off [ 35.065706] sd 0:0:107:0: [sddb] Mode Sense: db 00 10 08 [ 35.065765] sd 0:0:52:0: [sdbl] Write Protect is off [ 35.065766] sd 0:0:52:0: [sdbl] Mode Sense: db 00 10 08 [ 35.065781] sd 0:0:64:0: [sdcb] Write Protect is off [ 35.065783] sd 0:0:64:0: [sdcb] Mode Sense: db 00 10 08 [ 35.065802] sd 0:0:51:0: [sdbk] Write Protect is off [ 35.065804] sd 0:0:51:0: [sdbk] Mode Sense: db 00 10 08 [ 35.065815] sd 0:0:60:0: [sdbx] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.065981] sd 0:0:85:0: [sdda] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.065983] sd 0:0:85:0: [sdda] 4096-byte physical blocks [ 35.066082] sd 0:0:100:0: [sdbs] Write Protect is off [ 35.066084] sd 0:0:100:0: [sdbs] Mode Sense: db 00 10 08 [ 35.066463] sd 0:0:99:0: [sdbq] Write Protect is off [ 35.066465] sd 0:0:99:0: [sdbq] Mode Sense: db 00 10 08 [ 35.066478] sd 0:0:84:0: [sdcz] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.066732] sd 0:0:110:0: [sdde] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.067004] sd 0:0:107:0: [sddb] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.067076] sd 0:0:53:0: [sdbn] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.067113] sd 0:0:111:0: [sddf] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.067115] sd 0:0:111:0: [sddf] 4096-byte physical blocks [ 35.067159] sd 0:0:52:0: [sdbl] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.067173] sd 0:0:114:0: [sddi] Write Protect is off [ 35.067175] sd 0:0:114:0: [sddi] Mode Sense: db 00 10 08 [ 35.067250] sd 0:0:82:0: [sdcx] Write Protect is off [ 35.067252] sd 0:0:82:0: [sdcx] Mode Sense: db 00 10 08 [ 35.067277] sd 0:0:77:0: [sdcr] Write Protect is off [ 35.067278] sd 0:0:77:0: [sdcr] Mode Sense: db 00 10 08 [ 35.067296] sd 0:0:64:0: [sdcb] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.067335] sd 0:0:80:0: [sdcv] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.067337] sd 0:0:80:0: [sdcv] 4096-byte physical blocks [ 35.067338] sd 0:0:14:0: [sdo] Attached SCSI disk [ 35.067368] sd 0:0:33:0: [sdam] Attached SCSI disk [ 35.067396] sd 0:0:100:0: [sdbs] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.067411] sd 0:0:108:0: [sddc] Write Protect is off [ 35.067412] sd 0:0:108:0: [sddc] Mode Sense: db 00 10 08 [ 35.067448] sd 0:0:51:0: [sdbk] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.067551] sd 0:0:25:0: [sdac] Attached SCSI disk [ 35.067569] sd 0:0:49:0: [sdbi] Attached SCSI disk [ 35.068035] sd 0:0:72:0: [sdcl] Write Protect is off [ 35.068037] sd 0:0:72:0: [sdcl] Mode Sense: db 00 10 08 [ 35.068124] sd 0:0:99:0: [sdbq] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.068399] sd 0:0:90:0: [sdae] Attached SCSI disk [ 35.068467] sd 0:0:114:0: [sddi] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.068557] sd 0:0:82:0: [sdcx] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.068685] sd 0:0:77:0: [sdcr] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.068765] sd 0:0:37:0: [sdas] Attached SCSI disk [ 35.068880] sd 0:0:108:0: [sddc] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.069438] sd 0:0:111:0: [sddf] Write Protect is off [ 35.069441] sd 0:0:111:0: [sddf] Mode Sense: db 00 10 08 [ 35.069449] sd 0:0:72:0: [sdcl] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.069551] sd 0:0:103:0: [sdcf] Attached SCSI disk [ 35.069634] sd 0:0:83:0: [sdcy] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.069636] sd 0:0:83:0: [sdcy] 4096-byte physical blocks [ 35.069696] sd 0:0:80:0: [sdcv] Write Protect is off [ 35.069698] sd 0:0:80:0: [sdcv] Mode Sense: db 00 10 08 [ 35.069786] sd 0:0:85:0: [sdda] Write Protect is off [ 35.069788] sd 0:0:85:0: [sdda] Mode Sense: db 00 10 08 [ 35.070071] sd 0:0:78:0: [sdct] Attached SCSI disk [ 35.070500] sd 0:0:21:0: [sdx] Attached SCSI disk [ 35.070529] sd 0:0:26:0: [sdad] Attached SCSI disk [ 35.070663] sd 0:0:81:0: [sdcw] Write Protect is off [ 35.070665] sd 0:0:81:0: [sdcw] Mode Sense: db 00 10 08 [ 35.070755] sd 0:0:111:0: [sddf] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.071240] sd 0:0:85:0: [sdda] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.071257] sd 0:0:80:0: [sdcv] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.071979] sd 0:0:81:0: [sdcw] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.072048] sd 0:0:45:0: [sdbc] Attached SCSI disk [ 35.072640] sd 0:0:9:0: [sdi] Attached SCSI disk [ 35.072898] sd 0:0:83:0: [sdcy] Write Protect is off [ 35.072899] sd 0:0:83:0: [sdcy] Mode Sense: db 00 10 08 [ 35.073320] sd 0:0:79:0: [sdcu] Attached SCSI disk [ 35.074198] sd 0:0:83:0: [sdcy] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.074383] sd 0:0:22:0: [sdy] Attached SCSI disk [ 35.074680] sd 0:0:38:0: [sdat] Attached SCSI disk [ 35.074940] sd 0:0:13:0: [sdn] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.074941] sd 0:0:13:0: [sdn] 4096-byte physical blocks [ 35.076320] sd 0:0:102:0: [sdca] Attached SCSI disk [ 35.076379] sd 0:0:112:0: [sddg] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.076381] sd 0:0:112:0: [sddg] 4096-byte physical blocks [ 35.077248] sd 0:0:87:0: [sdr] Attached SCSI disk [ 35.077306] sd 0:0:66:0: [sdcd] Attached SCSI disk [ 35.077380] sd 0:0:113:0: [sddh] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.077381] sd 0:0:113:0: [sddh] 4096-byte physical blocks [ 35.077972] sd 0:0:13:0: [sdn] Write Protect is off [ 35.077975] sd 0:0:13:0: [sdn] Mode Sense: db 00 10 08 [ 35.078057] sd 0:0:68:0: [sdcg] Attached SCSI disk [ 35.079262] sd 0:0:13:0: [sdn] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.079264] sd 0:0:112:0: [sddg] Write Protect is off [ 35.079266] sd 0:0:112:0: [sddg] Mode Sense: db 00 10 08 [ 35.079631] sd 0:0:113:0: [sddh] Write Protect is off [ 35.079633] sd 0:0:113:0: [sddh] Mode Sense: db 00 10 08 [ 35.079876] sd 0:0:115:0: [sddj] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.079879] sd 0:0:115:0: [sddj] 4096-byte physical blocks [ 35.080030] sd 0:0:50:0: [sdbj] Attached SCSI disk [ 35.080312] sd 0:0:7:0: [sdg] Attached SCSI disk [ 35.080565] sd 0:0:112:0: [sddg] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.080860] sd 0:0:91:0: [sdaj] Attached SCSI disk [ 35.081005] sd 0:0:113:0: [sddh] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.081338] sd 0:0:18:0: [sdt] Attached SCSI disk [ 35.081471] sd 0:0:67:0: [sdce] Attached SCSI disk [ 35.081891] sd 0:0:32:0: [sdal] Attached SCSI disk [ 35.082004] sd 0:0:29:0: [sdah] Attached SCSI disk [ 35.082095] sd 0:0:57:0: [sdbt] Attached SCSI disk [ 35.082198] sd 0:0:115:0: [sddj] Write Protect is off [ 35.082200] sd 0:0:115:0: [sddj] Mode Sense: db 00 10 08 [ 35.082418] sd 0:0:44:0: [sdbb] Attached SCSI disk [ 35.082891] sd 0:0:58:0: [sdbu] Attached SCSI disk [ 35.082967] sd 0:0:24:0: [sdab] Attached SCSI disk [ 35.083512] sd 0:0:39:0: [sdau] Attached SCSI disk [ 35.083584] sd 0:0:115:0: [sddj] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.083641] sd 0:0:40:0: [sdav] Attached SCSI disk [ 35.083671] sd 0:0:117:0: [sddl] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.083673] sd 0:0:117:0: [sddl] 4096-byte physical blocks [ 35.083789] sd 0:0:19:0: [sdu] Attached SCSI disk [ 35.083913] sd 0:0:94:0: [sdaw] Attached SCSI disk [ 35.084061] sd 0:0:4:0: [sdd] Attached SCSI disk [ 35.084149] sd 0:0:92:0: [sdan] Attached SCSI disk [ 35.085611] sd 0:0:86:0: [sdm] Attached SCSI disk [ 35.085919] sd 0:0:117:0: [sddl] Write Protect is off [ 35.085921] sd 0:0:117:0: [sddl] Mode Sense: db 00 10 08 [ 35.086617] sd 0:0:98:0: [sdbm] Attached SCSI disk [ 35.086622] sd 0:0:119:0: [sddn] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.086624] sd 0:0:119:0: [sddn] 4096-byte physical blocks [ 35.087074] sd 0:0:118:0: [sddm] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.087077] sd 0:0:118:0: [sddm] 4096-byte physical blocks [ 35.087198] sd 0:0:117:0: [sddl] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.087395] sd 0:0:30:0: [sdai] Attached SCSI disk [ 35.087526] sd 0:0:116:0: [sddk] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.087528] sd 0:0:116:0: [sddk] 4096-byte physical blocks [ 35.087669] sd 0:0:123:0: [sddq] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.087671] sd 0:0:123:0: [sddq] 4096-byte physical blocks [ 35.088114] sd 0:0:124:0: [sddr] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.088115] sd 0:0:124:0: [sddr] 4096-byte physical blocks [ 35.088422] sd 0:0:15:0: [sdp] Attached SCSI disk [ 35.088805] sd 0:0:126:0: [sddt] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.088807] sd 0:0:126:0: [sddt] 4096-byte physical blocks [ 35.089373] sd 0:0:118:0: [sddm] Write Protect is off [ 35.089383] sd 0:0:118:0: [sddm] Mode Sense: db 00 10 08 [ 35.089398] sd 0:0:88:0: [sdv] Attached SCSI disk [ 35.089645] sd 0:0:60:0: [sdbx] Attached SCSI disk [ 35.089711] sd 0:0:12:0: [sdl] Attached SCSI disk [ 35.089825] sd 0:0:119:0: [sddn] Write Protect is off [ 35.089827] sd 0:0:119:0: [sddn] Mode Sense: db 00 10 08 [ 35.089863] sd 0:0:116:0: [sddk] Write Protect is off [ 35.089865] sd 0:0:116:0: [sddk] Mode Sense: db 00 10 08 [ 35.090097] sd 0:0:106:0: [sdcs] Attached SCSI disk [ 35.090390] sd 0:0:55:0: [sdbp] Attached SCSI disk [ 35.090425] sd 0:0:100:0: [sdbs] Attached SCSI disk [ 35.090554] sd 0:0:124:0: [sddr] Write Protect is off [ 35.090556] sd 0:0:124:0: [sddr] Mode Sense: db 00 10 08 [ 35.090567] sd 0:0:52:0: [sdbl] Attached SCSI disk [ 35.090584] sd 0:0:20:0: [sdw] Attached SCSI disk [ 35.090589] sd 0:0:123:0: [sddq] Write Protect is off [ 35.090591] sd 0:0:123:0: [sddq] Mode Sense: db 00 10 08 [ 35.090632] sd 0:0:127:0: [sddu] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.090682] sd 0:0:127:0: [sddu] 4096-byte physical blocks [ 35.090812] sd 0:0:118:0: [sddm] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.090935] sd 0:0:46:0: [sdbe] Attached SCSI disk [ 35.091029] sd 0:0:129:0: [sddw] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.091031] sd 0:0:129:0: [sddw] 4096-byte physical blocks [ 35.091046] sd 0:0:42:0: [sday] Attached SCSI disk [ 35.091085] sd 0:0:126:0: [sddt] Write Protect is off [ 35.091087] sd 0:0:126:0: [sddt] Mode Sense: db 00 10 08 [ 35.091128] sd 0:0:119:0: [sddn] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.091134] sd 0:0:63:0: [sdbz] Attached SCSI disk [ 35.091175] sd 0:0:116:0: [sddk] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.091285] sd 0:0:128:0: [sddv] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.091286] sd 0:0:128:0: [sddv] 4096-byte physical blocks [ 35.091439] sd 0:0:27:0: [sdaf] Attached SCSI disk [ 35.091527] sd 0:0:96:0: [sdbd] Attached SCSI disk [ 35.091838] sd 0:0:124:0: [sddr] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.091895] sd 0:0:123:0: [sddq] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.091907] sd 0:0:93:0: [sdar] Attached SCSI disk [ 35.091960] sd 0:0:17:0: [sds] Attached SCSI disk [ 35.092005] sd 0:0:56:0: [sdbr] Attached SCSI disk [ 35.092021] sd 0:0:54:0: [sdbo] Attached SCSI disk [ 35.092121] sd 0:0:75:0: [sdcp] Attached SCSI disk [ 35.092127] sd 0:0:131:0: [sddy] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.092129] sd 0:0:131:0: [sddy] 4096-byte physical blocks [ 35.092183] sd 0:0:121:0: [sddp] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.092185] sd 0:0:121:0: [sddp] 4096-byte physical blocks [ 35.092197] sd 0:0:130:0: [sddx] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.092198] sd 0:0:130:0: [sddx] 4096-byte physical blocks [ 35.092343] sd 0:0:6:0: [sdf] Attached SCSI disk [ 35.092401] sd 0:0:132:0: [sddz] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.092403] sd 0:0:132:0: [sddz] 4096-byte physical blocks [ 35.092424] sd 0:0:126:0: [sddt] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.092699] sd 0:0:35:0: [sdap] Attached SCSI disk [ 35.093319] sd 0:0:129:0: [sddw] Write Protect is off [ 35.093321] sd 0:0:129:0: [sddw] Mode Sense: db 00 10 08 [ 35.093450] sd 0:0:8:0: [sdh] Attached SCSI disk [ 35.094221] sd 0:0:97:0: [sdbh] Attached SCSI disk [ 35.094264] sd 0:0:128:0: [sddv] Write Protect is off [ 35.094266] sd 0:0:128:0: [sddv] Mode Sense: db 00 10 08 [ 35.094308] sd 0:0:133:0: [sdea] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.094310] sd 0:0:133:0: [sdea] 4096-byte physical blocks [ 35.094374] sd 0:0:114:0: [sddi] Attached SCSI disk [ 35.094384] sd 0:0:120:0: [sddo] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.094387] sd 0:0:120:0: [sddo] 4096-byte physical blocks [ 35.094406] sd 0:0:104:0: [sdcj] Attached SCSI disk [ 35.094455] sd 0:0:121:0: [sddp] Write Protect is off [ 35.094465] sd 0:0:121:0: [sddp] Mode Sense: db 00 10 08 [ 35.094539] sd 0:0:48:0: [sdbg] Attached SCSI disk [ 35.094666] sd 0:0:129:0: [sddw] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.094697] sd 0:0:62:0: [sdby] Attached SCSI disk [ 35.094720] sd 0:0:131:0: [sddy] Write Protect is off [ 35.094721] sd 0:0:131:0: [sddy] Mode Sense: db 00 10 08 [ 35.094722] sd 0:0:132:0: [sddz] Write Protect is off [ 35.094724] sd 0:0:132:0: [sddz] Mode Sense: db 00 10 08 [ 35.094789] sd 0:0:82:0: [sdcx] Attached SCSI disk [ 35.094804] sd 0:0:134:0: [sdeb] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.094807] sd 0:0:134:0: [sdeb] 4096-byte physical blocks [ 35.094854] sd 0:0:127:0: [sddu] Write Protect is off [ 35.094855] sd 0:0:127:0: [sddu] Mode Sense: db 00 10 08 [ 35.095181] sd 0:0:101:0: [sdbw] Attached SCSI disk [ 35.095257] sd 0:0:95:0: [sdaz] Attached SCSI disk [ 35.095326] sd 0:0:51:0: [sdbk] Attached SCSI disk [ 35.095431] sd 0:0:130:0: [sddx] Write Protect is off [ 35.095433] sd 0:0:130:0: [sddx] Mode Sense: db 00 10 08 [ 35.095487] sd 0:0:70:0: [sdci] Attached SCSI disk [ 35.095523] sd 0:0:53:0: [sdbn] Attached SCSI disk [ 35.095543] sd 0:0:128:0: [sddv] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.095630] sd 0:0:43:0: [sdba] Attached SCSI disk [ 35.095797] sd 0:0:121:0: [sddp] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.095873] sd 0:0:107:0: [sddb] Attached SCSI disk [ 35.095934] sd 0:0:71:0: [sdck] Attached SCSI disk [ 35.096078] sd 0:0:131:0: [sddy] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.096152] sd 0:0:132:0: [sddz] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.096420] sd 0:0:73:0: [sdcm] Attached SCSI disk [ 35.096540] sd 0:0:47:0: [sdbf] Attached SCSI disk [ 35.096560] sd 0:0:125:0: [sdds] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.096561] sd 0:0:125:0: [sdds] 4096-byte physical blocks [ 35.096563] sd 0:0:28:0: [sdag] Attached SCSI disk [ 35.096740] sd 0:0:136:0: [sded] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.096741] sd 0:0:136:0: [sded] 4096-byte physical blocks [ 35.096789] sd 0:0:130:0: [sddx] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.097000] sd 0:0:120:0: [sddo] Write Protect is off [ 35.097002] sd 0:0:120:0: [sddo] Mode Sense: db 00 10 08 [ 35.097095] sd 0:0:31:0: [sdak] Attached SCSI disk [ 35.097651] sd 0:0:105:0: [sdcn] Attached SCSI disk [ 35.097714] sd 0:0:134:0: [sdeb] Write Protect is off [ 35.097715] sd 0:0:134:0: [sdeb] Mode Sense: db 00 10 08 [ 35.097822] sd 0:0:23:0: [sdaa] Attached SCSI disk [ 35.097988] sd 0:0:127:0: [sddu] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.098182] sd 0:0:5:0: [sde] Attached SCSI disk [ 35.098205] sd 0:0:99:0: [sdbq] Attached SCSI disk [ 35.098288] sd 0:0:120:0: [sddo] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.098338] sd 0:0:137:0: [sdee] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.098340] sd 0:0:137:0: [sdee] 4096-byte physical blocks [ 35.098632] sd 0:0:76:0: [sdcq] Attached SCSI disk [ 35.098653] sd 0:0:69:0: [sdch] Attached SCSI disk [ 35.098903] sd 0:0:133:0: [sdea] Write Protect is off [ 35.098905] sd 0:0:133:0: [sdea] Mode Sense: db 00 10 08 [ 35.098975] sd 0:0:136:0: [sded] Write Protect is off [ 35.098976] sd 0:0:136:0: [sded] Mode Sense: db 00 10 08 [ 35.098986] sd 0:0:134:0: [sdeb] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.099011] sd 0:0:64:0: [sdcb] Attached SCSI disk [ 35.099556] sd 0:0:65:0: [sdcc] Attached SCSI disk [ 35.099633] sd 0:0:36:0: [sdaq] Attached SCSI disk [ 35.099780] sd 0:0:59:0: [sdbv] Attached SCSI disk [ 35.100023] sd 0:0:109:0: [sddd] Attached SCSI disk [ 35.100043] sd 0:0:74:0: [sdco] Attached SCSI disk [ 35.100267] sd 0:0:138:0: [sdef] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.100269] sd 0:0:138:0: [sdef] 4096-byte physical blocks [ 35.100535] sd 0:0:136:0: [sded] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.100648] sd 0:0:16:0: [sdq] Attached SCSI disk [ 35.100709] sd 0:0:125:0: [sdds] Write Protect is off [ 35.100711] sd 0:0:125:0: [sdds] Mode Sense: db 00 10 08 [ 35.100861] sd 0:0:84:0: [sdcz] Attached SCSI disk [ 35.100916] sd 0:0:137:0: [sdee] Write Protect is off [ 35.100918] sd 0:0:137:0: [sdee] Mode Sense: db 00 10 08 [ 35.101018] sd 0:0:41:0: [sdax] Attached SCSI disk [ 35.101029] sd 0:0:89:0: [sdz] Attached SCSI disk [ 35.101152] sd 0:0:133:0: [sdea] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.101678] sd 0:0:139:0: [sdeg] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.101680] sd 0:0:139:0: [sdeg] 4096-byte physical blocks [ 35.102215] sd 0:0:11:0: [sdk] Attached SCSI disk [ 35.102228] sd 0:0:137:0: [sdee] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.102440] sd 0:0:85:0: [sdda] Attached SCSI disk [ 35.102822] sd 0:0:108:0: [sddc] Attached SCSI disk [ 35.102824] sd 0:0:138:0: [sdef] Write Protect is off [ 35.102826] sd 0:0:138:0: [sdef] Mode Sense: db 00 10 08 [ 35.102844] sd 0:0:140:0: [sdeh] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.102847] sd 0:0:140:0: [sdeh] 4096-byte physical blocks [ 35.103467] sd 0:0:77:0: [sdcr] Attached SCSI disk [ 35.103470] sd 0:0:125:0: [sdds] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.103574] sd 0:0:141:0: [sdei] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.103576] sd 0:0:141:0: [sdei] 4096-byte physical blocks [ 35.104156] sd 0:0:138:0: [sdef] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.104384] sd 0:0:110:0: [sdde] Attached SCSI disk [ 35.104551] sd 0:0:139:0: [sdeg] Write Protect is off [ 35.104553] sd 0:0:139:0: [sdeg] Mode Sense: db 00 10 08 [ 35.104753] sd 0:0:142:0: [sdej] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.104755] sd 0:0:142:0: [sdej] 4096-byte physical blocks [ 35.104977] sd 0:0:80:0: [sdcv] Attached SCSI disk [ 35.104992] sd 0:0:83:0: [sdcy] Attached SCSI disk [ 35.105120] sd 0:0:140:0: [sdeh] Write Protect is off [ 35.105121] sd 0:0:140:0: [sdeh] Mode Sense: db 00 10 08 [ 35.105819] sd 0:0:141:0: [sdei] Write Protect is off [ 35.105821] sd 0:0:141:0: [sdei] Mode Sense: db 00 10 08 [ 35.105852] sd 0:0:139:0: [sdeg] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.105924] sd 0:0:3:0: [sdc] Attached SCSI disk [ 35.106146] sd 0:0:111:0: [sddf] Attached SCSI disk [ 35.106274] sd 0:0:143:0: [sdek] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.106275] sd 0:0:143:0: [sdek] 4096-byte physical blocks [ 35.106324] sd 0:0:113:0: [sddh] Attached SCSI disk [ 35.106434] sd 0:0:140:0: [sdeh] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.106467] sd 0:0:135:0: [sdec] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.106469] sd 0:0:135:0: [sdec] 4096-byte physical blocks [ 35.106585] sd 0:0:112:0: [sddg] Attached SCSI disk [ 35.106998] sd 0:0:142:0: [sdej] Write Protect is off [ 35.107000] sd 0:0:142:0: [sdej] Mode Sense: db 00 10 08 [ 35.107094] sd 0:0:141:0: [sdei] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.107189] sd 0:0:144:0: [sdel] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.107191] sd 0:0:144:0: [sdel] 4096-byte physical blocks [ 35.107561] sd 0:0:81:0: [sdcw] Attached SCSI disk [ 35.107791] sd 0:0:72:0: [sdcl] Attached SCSI disk [ 35.108318] sd 0:0:142:0: [sdej] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.108786] sd 0:0:143:0: [sdek] Write Protect is off [ 35.108788] sd 0:0:143:0: [sdek] Mode Sense: db 00 10 08 [ 35.109209] sd 0:0:145:0: [sdem] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.109211] sd 0:0:145:0: [sdem] 4096-byte physical blocks [ 35.109819] sd 0:0:144:0: [sdel] Write Protect is off [ 35.109821] sd 0:0:144:0: [sdel] Mode Sense: db 00 10 08 [ 35.109891] sd 0:0:118:0: [sddm] Attached SCSI disk [ 35.109976] sd 0:0:126:0: [sddt] Attached SCSI disk [ 35.110069] sd 0:0:143:0: [sdek] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.110120] sd 0:0:123:0: [sddq] Attached SCSI disk [ 35.110978] sd 0:0:135:0: [sdec] Write Protect is off [ 35.110979] sd 0:0:135:0: [sdec] Mode Sense: db 00 10 08 [ 35.111110] sd 0:0:144:0: [sdel] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.111477] sd 0:0:116:0: [sddk] Attached SCSI disk [ 35.111488] sd 0:0:145:0: [sdem] Write Protect is off [ 35.111489] sd 0:0:145:0: [sdem] Mode Sense: db 00 10 08 [ 35.112116] sd 0:0:146:0: [sden] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.112118] sd 0:0:146:0: [sden] 4096-byte physical blocks [ 35.112762] sd 0:0:145:0: [sdem] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.112990] sd 0:0:135:0: [sdec] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.113209] sd 0:0:129:0: [sddw] Attached SCSI disk [ 35.113511] sd 0:0:115:0: [sddj] Attached SCSI disk [ 35.114101] sd 0:0:147:0: [sdeo] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.114103] sd 0:0:147:0: [sdeo] 4096-byte physical blocks [ 35.114343] sd 0:0:146:0: [sden] Write Protect is off [ 35.114345] sd 0:0:146:0: [sden] Mode Sense: db 00 10 08 [ 35.114392] sd 0:0:131:0: [sddy] Attached SCSI disk [ 35.114869] sd 0:0:132:0: [sddz] Attached SCSI disk [ 35.115452] sd 0:0:148:0: [sdep] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.115454] sd 0:0:148:0: [sdep] 4096-byte physical blocks [ 35.115468] sd 0:0:136:0: [sded] Attached SCSI disk [ 35.115671] sd 0:0:146:0: [sden] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.115811] sd 0:0:149:0: [sdeq] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.115813] sd 0:0:149:0: [sdeq] 4096-byte physical blocks [ 35.115846] sd 0:0:124:0: [sddr] Attached SCSI disk [ 35.115945] sd 0:0:150:0: [sder] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.115946] sd 0:0:150:0: [sder] 4096-byte physical blocks [ 35.116263] sd 0:0:117:0: [sddl] Attached SCSI disk [ 35.116285] sd 0:0:147:0: [sdeo] Write Protect is off [ 35.116286] sd 0:0:147:0: [sdeo] Mode Sense: db 00 10 08 [ 35.116621] sd 0:0:128:0: [sddv] Attached SCSI disk [ 35.116846] sd 0:0:151:0: [sdes] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.116848] sd 0:0:151:0: [sdes] 4096-byte physical blocks [ 35.117354] sd 0:0:130:0: [sddx] Attached SCSI disk [ 35.117377] sd 0:0:152:0: [sdet] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.117382] sd 0:0:152:0: [sdet] 4096-byte physical blocks [ 35.117543] sd 0:0:147:0: [sdeo] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.117826] sd 0:0:153:0: [sdeu] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.117827] sd 0:0:153:0: [sdeu] 4096-byte physical blocks [ 35.117988] sd 0:0:125:0: [sdds] Attached SCSI disk [ 35.118048] sd 0:0:149:0: [sdeq] Write Protect is off [ 35.118050] sd 0:0:149:0: [sdeq] Mode Sense: db 00 10 08 [ 35.118055] sd 0:0:148:0: [sdep] Write Protect is off [ 35.118057] sd 0:0:148:0: [sdep] Mode Sense: db 00 10 08 [ 35.118155] sd 0:0:13:0: [sdn] Attached SCSI disk [ 35.118177] sd 0:0:150:0: [sder] Write Protect is off [ 35.118178] sd 0:0:150:0: [sder] Mode Sense: db 00 10 08 [ 35.118426] sd 0:0:155:0: [sdew] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.118427] sd 0:0:155:0: [sdew] 4096-byte physical blocks [ 35.118535] sd 0:0:154:0: [sdev] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.118537] sd 0:0:154:0: [sdev] 4096-byte physical blocks [ 35.119127] sd 0:0:137:0: [sdee] Attached SCSI disk [ 35.119201] sd 0:0:151:0: [sdes] Write Protect is off [ 35.119202] sd 0:0:151:0: [sdes] Mode Sense: db 00 10 08 [ 35.119338] sd 0:0:148:0: [sdep] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.119374] sd 0:0:149:0: [sdeq] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.119690] sd 0:0:156:0: [sdex] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.119715] sd 0:0:156:0: [sdex] 4096-byte physical blocks [ 35.119731] sd 0:0:127:0: [sddu] Attached SCSI disk [ 35.119767] sd 0:0:150:0: [sder] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.119989] sd 0:0:152:0: [sdet] Write Protect is off [ 35.119991] sd 0:0:152:0: [sdet] Mode Sense: db 00 10 08 [ 35.120195] sd 0:0:153:0: [sdeu] Write Protect is off [ 35.120196] sd 0:0:153:0: [sdeu] Mode Sense: db 00 10 08 [ 35.120407] sd 0:0:157:0: [sdey] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.120418] sd 0:0:157:0: [sdey] 4096-byte physical blocks [ 35.120478] sd 0:0:151:0: [sdes] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.120745] sd 0:0:154:0: [sdev] Write Protect is off [ 35.120746] sd 0:0:154:0: [sdev] Mode Sense: db 00 10 08 [ 35.120901] sd 0:0:155:0: [sdew] Write Protect is off [ 35.120902] sd 0:0:155:0: [sdew] Mode Sense: db 00 10 08 [ 35.121423] sd 0:0:152:0: [sdet] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.121453] sd 0:0:121:0: [sddp] Attached SCSI disk [ 35.122081] sd 0:0:154:0: [sdev] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.122102] sd 0:0:156:0: [sdex] Write Protect is off [ 35.122104] sd 0:0:156:0: [sdex] Mode Sense: db 00 10 08 [ 35.122278] sd 0:0:134:0: [sdeb] Attached SCSI disk [ 35.122393] sd 0:0:153:0: [sdeu] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.122470] sd 0:0:155:0: [sdew] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.122717] sd 0:0:158:0: [sdez] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.122719] sd 0:0:158:0: [sdez] 4096-byte physical blocks [ 35.122944] sd 0:0:157:0: [sdey] Write Protect is off [ 35.122946] sd 0:0:157:0: [sdey] Mode Sense: db 00 10 08 [ 35.123228] sd 0:0:140:0: [sdeh] Attached SCSI disk [ 35.123368] sd 0:0:142:0: [sdej] Attached SCSI disk [ 35.123421] sd 0:0:156:0: [sdex] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.123498] sd 0:0:120:0: [sddo] Attached SCSI disk [ 35.123874] sd 0:0:133:0: [sdea] Attached SCSI disk [ 35.124205] sd 0:0:157:0: [sdey] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.124487] sd 0:0:141:0: [sdei] Attached SCSI disk [ 35.125040] sd 0:0:119:0: [sddn] Attached SCSI disk [ 35.125275] sd 0:0:158:0: [sdez] Write Protect is off [ 35.125277] sd 0:0:158:0: [sdez] Mode Sense: db 00 10 08 [ 35.125562] sd 0:0:139:0: [sdeg] Attached SCSI disk [ 35.126406] sd 0:0:138:0: [sdef] Attached SCSI disk [ 35.126613] sd 0:0:158:0: [sdez] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.127635] sd 0:0:144:0: [sdel] Attached SCSI disk [ 35.127649] sd 0:0:159:0: [sdfa] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.127651] sd 0:0:159:0: [sdfa] 4096-byte physical blocks [ 35.127832] sd 0:0:160:0: [sdfb] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.127834] sd 0:0:160:0: [sdfb] 4096-byte physical blocks [ 35.128089] sd 0:0:161:0: [sdfc] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.128091] sd 0:0:161:0: [sdfc] 4096-byte physical blocks [ 35.128256] sd 0:0:162:0: [sdfd] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.128258] sd 0:0:162:0: [sdfd] 4096-byte physical blocks [ 35.128443] sd 0:0:163:0: [sdfe] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.128445] sd 0:0:163:0: [sdfe] 4096-byte physical blocks [ 35.128873] sd 0:0:164:0: [sdff] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.128875] sd 0:0:164:0: [sdff] 4096-byte physical blocks [ 35.128891] sd 0:0:135:0: [sdec] Attached SCSI disk [ 35.128906] sd 0:0:165:0: [sdfg] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.128907] sd 0:0:165:0: [sdfg] 4096-byte physical blocks [ 35.129126] sd 0:0:166:0: [sdfh] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.129128] sd 0:0:166:0: [sdfh] 4096-byte physical blocks [ 35.129452] sd 0:0:167:0: [sdfi] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.129453] sd 0:0:167:0: [sdfi] 4096-byte physical blocks [ 35.129525] sd 0:0:143:0: [sdek] Attached SCSI disk [ 35.129853] sd 0:0:168:0: [sdfj] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.129855] sd 0:0:168:0: [sdfj] 4096-byte physical blocks [ 35.129883] sd 0:0:169:0: [sdfk] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.129885] sd 0:0:169:0: [sdfk] 4096-byte physical blocks [ 35.129998] sd 0:0:159:0: [sdfa] Write Protect is off [ 35.129999] sd 0:0:159:0: [sdfa] Mode Sense: db 00 10 08 [ 35.130064] sd 0:0:170:0: [sdfl] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.130066] sd 0:0:170:0: [sdfl] 4096-byte physical blocks [ 35.130073] sd 0:0:160:0: [sdfb] Write Protect is off [ 35.130075] sd 0:0:160:0: [sdfb] Mode Sense: db 00 10 08 [ 35.130237] sd 0:0:171:0: [sdfm] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.130238] sd 0:0:171:0: [sdfm] 4096-byte physical blocks [ 35.130380] sd 0:0:161:0: [sdfc] Write Protect is off [ 35.130381] sd 0:0:161:0: [sdfc] Mode Sense: db 00 10 08 [ 35.130573] sd 0:0:162:0: [sdfd] Write Protect is off [ 35.130575] sd 0:0:162:0: [sdfd] Mode Sense: db 00 10 08 [ 35.130665] sd 0:0:172:0: [sdfn] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.130667] sd 0:0:172:0: [sdfn] 4096-byte physical blocks [ 35.130695] sd 0:0:163:0: [sdfe] Write Protect is off [ 35.130696] sd 0:0:163:0: [sdfe] Mode Sense: db 00 10 08 [ 35.130704] sd 0:0:173:0: [sdfo] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.130707] sd 0:0:173:0: [sdfo] 4096-byte physical blocks [ 35.131172] sd 0:0:164:0: [sdff] Write Protect is off [ 35.131174] sd 0:0:164:0: [sdff] Mode Sense: db 00 10 08 [ 35.131389] sd 0:0:166:0: [sdfh] Write Protect is off [ 35.131391] sd 0:0:166:0: [sdfh] Mode Sense: db 00 10 08 [ 35.131416] sd 0:0:160:0: [sdfb] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.131429] sd 0:0:165:0: [sdfg] Write Protect is off [ 35.131431] sd 0:0:165:0: [sdfg] Mode Sense: db 00 10 08 [ 35.131433] sd 0:0:159:0: [sdfa] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.131701] sd 0:0:161:0: [sdfc] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.131726] sd 0:0:167:0: [sdfi] Write Protect is off [ 35.131727] sd 0:0:167:0: [sdfi] Mode Sense: db 00 10 08 [ 35.131850] sd 0:0:162:0: [sdfd] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.132021] sd 0:0:163:0: [sdfe] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.132075] sd 0:0:169:0: [sdfk] Write Protect is off [ 35.132077] sd 0:0:169:0: [sdfk] Mode Sense: db 00 10 08 [ 35.132129] sd 0:0:174:0: [sdfp] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.132131] sd 0:0:174:0: [sdfp] 4096-byte physical blocks [ 35.132142] sd 0:0:168:0: [sdfj] Write Protect is off [ 35.132143] sd 0:0:168:0: [sdfj] Mode Sense: db 00 10 08 [ 35.132300] sd 0:0:170:0: [sdfl] Write Protect is off [ 35.132302] sd 0:0:170:0: [sdfl] Mode Sense: db 00 10 08 [ 35.132408] sd 0:0:145:0: [sdem] Attached SCSI disk [ 35.132508] sd 0:0:171:0: [sdfm] Write Protect is off [ 35.132509] sd 0:0:171:0: [sdfm] Mode Sense: db 00 10 08 [ 35.132539] sd 0:0:164:0: [sdff] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.132704] sd 0:0:166:0: [sdfh] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.132793] sd 0:0:165:0: [sdfg] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.132854] sd 0:0:172:0: [sdfn] Write Protect is off [ 35.132856] sd 0:0:172:0: [sdfn] Mode Sense: db 00 10 08 [ 35.133055] sd 0:0:173:0: [sdfo] Write Protect is off [ 35.133057] sd 0:0:173:0: [sdfo] Mode Sense: db 00 10 08 [ 35.133070] sd 0:0:175:0: [sdfq] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.133072] sd 0:0:175:0: [sdfq] 4096-byte physical blocks [ 35.133083] sd 0:0:167:0: [sdfi] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.133220] sd 0:0:176:0: [sdfr] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.133222] sd 0:0:176:0: [sdfr] 4096-byte physical blocks [ 35.133307] sd 0:0:147:0: [sdeo] Attached SCSI disk [ 35.133393] sd 0:0:169:0: [sdfk] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.133432] sd 0:0:168:0: [sdfj] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.133731] sd 0:0:170:0: [sdfl] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.133785] sd 0:0:171:0: [sdfm] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.133810] sd 0:0:177:0: [sdfs] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.133812] sd 0:0:177:0: [sdfs] 4096-byte physical blocks [ 35.134178] sd 0:0:172:0: [sdfn] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.134850] sd 0:0:174:0: [sdfp] Write Protect is off [ 35.134857] sd 0:0:174:0: [sdfp] Mode Sense: db 00 10 08 [ 35.135252] sd 0:0:178:0: [sdft] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.135254] sd 0:0:178:0: [sdft] 4096-byte physical blocks [ 35.135328] sd 0:0:173:0: [sdfo] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.135448] sd 0:0:175:0: [sdfq] Write Protect is off [ 35.135450] sd 0:0:176:0: [sdfr] Write Protect is off [ 35.135451] sd 0:0:175:0: [sdfq] Mode Sense: db 00 10 08 [ 35.135452] sd 0:0:176:0: [sdfr] Mode Sense: db 00 10 08 [ 35.136041] sd 0:0:152:0: [sdet] Attached SCSI disk [ 35.136386] sd 0:0:174:0: [sdfp] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.136433] sd 0:0:177:0: [sdfs] Write Protect is off [ 35.136434] sd 0:0:177:0: [sdfs] Mode Sense: db 00 10 08 [ 35.136719] sd 0:0:175:0: [sdfq] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.136783] sd 0:0:176:0: [sdfr] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.137117] sd 0:0:179:0: [sdfu] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.137118] sd 0:0:179:0: [sdfu] 4096-byte physical blocks [ 35.137579] sd 0:0:178:0: [sdft] Write Protect is off [ 35.137581] sd 0:0:178:0: [sdft] Mode Sense: db 00 10 08 [ 35.137697] sd 0:0:177:0: [sdfs] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.137870] sd 0:0:180:0: [sdfv] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.137872] sd 0:0:180:0: [sdfv] 4096-byte physical blocks [ 35.137888] sd 0:0:150:0: [sder] Attached SCSI disk [ 35.138416] sd 0:0:154:0: [sdev] Attached SCSI disk [ 35.138596] sd 0:0:146:0: [sden] Attached SCSI disk [ 35.138855] sd 0:0:178:0: [sdft] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.138929] sd 0:0:153:0: [sdeu] Attached SCSI disk [ 35.139306] sd 0:0:179:0: [sdfu] Write Protect is off [ 35.139308] sd 0:0:179:0: [sdfu] Mode Sense: db 00 10 08 [ 35.139353] sd 0:0:151:0: [sdes] Attached SCSI disk [ 35.140347] sd 0:0:180:0: [sdfv] Write Protect is off [ 35.140356] sd 0:0:180:0: [sdfv] Mode Sense: db 00 10 08 [ 35.140573] sd 0:0:156:0: [sdex] Attached SCSI disk [ 35.140604] sd 0:0:181:0: [sdfw] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.140606] sd 0:0:181:0: [sdfw] 4096-byte physical blocks [ 35.140655] sd 0:0:179:0: [sdfu] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.141011] sd 0:0:155:0: [sdew] Attached SCSI disk [ 35.141396] sd 0:0:149:0: [sdeq] Attached SCSI disk [ 35.141630] sd 0:0:180:0: [sdfv] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.142790] sd 0:0:182:0: [sdfx] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.142792] sd 0:0:182:0: [sdfx] 4096-byte physical blocks [ 35.142803] sd 0:0:157:0: [sdey] Attached SCSI disk [ 35.142837] sd 0:0:181:0: [sdfw] Write Protect is off [ 35.142839] sd 0:0:181:0: [sdfw] Mode Sense: db 00 10 08 [ 35.143063] sd 0:0:148:0: [sdep] Attached SCSI disk [ 35.144268] sd 0:0:181:0: [sdfw] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.144994] sd 0:0:182:0: [sdfx] Write Protect is off [ 35.144997] sd 0:0:182:0: [sdfx] Mode Sense: db 00 10 08 [ 35.146313] sd 0:0:182:0: [sdfx] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.147507] sd 0:0:184:0: [sdfy] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.147510] sd 0:0:184:0: [sdfy] 4096-byte physical blocks [ 35.149340] sd 0:0:158:0: [sdez] Attached SCSI disk [ 35.149509] sd 0:0:166:0: [sdfh] Attached SCSI disk [ 35.149801] sd 0:0:184:0: [sdfy] Write Protect is off [ 35.149803] sd 0:0:184:0: [sdfy] Mode Sense: db 00 10 08 [ 35.149980] sd 0:0:162:0: [sdfd] Attached SCSI disk [ 35.150229] sd 0:0:161:0: [sdfc] Attached SCSI disk [ 35.150528] sd 0:0:164:0: [sdff] Attached SCSI disk [ 35.150562] sd 0:0:168:0: [sdfj] Attached SCSI disk [ 35.151019] sd 0:0:163:0: [sdfe] Attached SCSI disk [ 35.151397] sd 0:0:185:0: [sdfz] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.151399] sd 0:0:185:0: [sdfz] 4096-byte physical blocks [ 35.151421] sd 0:0:184:0: [sdfy] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.151960] sd 0:0:171:0: [sdfm] Attached SCSI disk [ 35.152834] sd 0:0:159:0: [sdfa] Attached SCSI disk [ 35.152872] sd 0:0:160:0: [sdfb] Attached SCSI disk [ 35.153283] sd 0:0:173:0: [sdfo] Attached SCSI disk [ 35.153640] sd 0:0:167:0: [sdfi] Attached SCSI disk [ 35.153677] sd 0:0:185:0: [sdfz] Write Protect is off [ 35.153679] sd 0:0:185:0: [sdfz] Mode Sense: db 00 10 08 [ 35.153852] sd 0:0:170:0: [sdfl] Attached SCSI disk [ 35.154464] sd 0:0:186:0: [sdga] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.154466] sd 0:0:186:0: [sdga] 4096-byte physical blocks [ 35.154753] sd 0:0:187:0: [sdgb] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.154755] sd 0:0:187:0: [sdgb] 4096-byte physical blocks [ 35.154932] sd 0:0:175:0: [sdfq] Attached SCSI disk [ 35.155008] sd 0:0:185:0: [sdfz] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.155415] sd 0:0:169:0: [sdfk] Attached SCSI disk [ 35.155965] sd 0:0:165:0: [sdfg] Attached SCSI disk [ 35.156466] sd 0:0:177:0: [sdfs] Attached SCSI disk [ 35.156676] sd 0:0:180:0: [sdfv] Attached SCSI disk [ 35.156686] sd 0:0:174:0: [sdfp] Attached SCSI disk [ 35.156699] sd 0:0:186:0: [sdga] Write Protect is off [ 35.156700] sd 0:0:186:0: [sdga] Mode Sense: db 00 10 08 [ 35.156830] sd 0:0:172:0: [sdfn] Attached SCSI disk [ 35.157092] sd 0:0:187:0: [sdgb] Write Protect is off [ 35.157094] sd 0:0:187:0: [sdgb] Mode Sense: db 00 10 08 [ 35.157957] sd 0:0:186:0: [sdga] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.158371] sd 0:0:187:0: [sdgb] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.159619] sd 0:0:179:0: [sdfu] Attached SCSI disk [ 35.159836] sd 0:0:188:0: [sdgc] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.159838] sd 0:0:188:0: [sdgc] 4096-byte physical blocks [ 35.159952] sd 0:0:178:0: [sdft] Attached SCSI disk [ 35.160233] sd 0:0:189:0: [sdgd] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.160235] sd 0:0:189:0: [sdgd] 4096-byte physical blocks [ 35.160832] sd 0:0:176:0: [sdfr] Attached SCSI disk [ 35.162136] sd 0:0:188:0: [sdgc] Write Protect is off [ 35.162138] sd 0:0:188:0: [sdgc] Mode Sense: db 00 10 08 [ 35.162587] sd 0:0:189:0: [sdgd] Write Protect is off [ 35.162588] sd 0:0:189:0: [sdgd] Mode Sense: db 00 10 08 [ 35.163413] sd 0:0:188:0: [sdgc] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.163864] sd 0:0:189:0: [sdgd] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.164688] sd 0:0:182:0: [sdfx] Attached SCSI disk [ 35.168173] sd 0:0:181:0: [sdfw] Attached SCSI disk [ 35.168863] sd 0:0:190:0: [sdge] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.168865] sd 0:0:190:0: [sdge] 4096-byte physical blocks [ 35.168867] sd 0:0:191:0: [sdgf] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.168869] sd 0:0:191:0: [sdgf] 4096-byte physical blocks [ 35.169624] sd 0:0:192:0: [sdgg] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.169626] sd 0:0:192:0: [sdgg] 4096-byte physical blocks [ 35.171046] sd 0:0:190:0: [sdge] Write Protect is off [ 35.171053] sd 0:0:190:0: [sdge] Mode Sense: db 00 10 08 [ 35.171149] sd 0:0:191:0: [sdgf] Write Protect is off [ 35.171150] sd 0:0:191:0: [sdgf] Mode Sense: db 00 10 08 [ 35.171872] sd 0:0:192:0: [sdgg] Write Protect is off [ 35.171874] sd 0:0:192:0: [sdgg] Mode Sense: db 00 10 08 [ 35.172098] sd 0:0:184:0: [sdfy] Attached SCSI disk [ 35.172358] sd 0:0:190:0: [sdge] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.172413] sd 0:0:191:0: [sdgf] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.173162] sd 0:0:192:0: [sdgg] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.173789] sd 0:0:185:0: [sdfz] Attached SCSI disk [ 35.173947] sd 0:0:187:0: [sdgb] Attached SCSI disk [ 35.176451] sd 0:0:186:0: [sdga] Attached SCSI disk [ 35.179158] sd 0:0:193:0: [sdgh] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.179160] sd 0:0:193:0: [sdgh] 4096-byte physical blocks [ 35.181821] sd 0:0:193:0: [sdgh] Write Protect is off [ 35.181822] sd 0:0:193:0: [sdgh] Mode Sense: db 00 10 08 [ 35.182231] sd 0:0:194:0: [sdgi] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.182232] sd 0:0:194:0: [sdgi] 4096-byte physical blocks [ 35.183078] sd 0:0:193:0: [sdgh] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.183224] sd 0:0:188:0: [sdgc] Attached SCSI disk [ 35.184438] sd 0:0:194:0: [sdgi] Write Protect is off [ 35.184440] sd 0:0:194:0: [sdgi] Mode Sense: db 00 10 08 [ 35.186224] sd 0:0:194:0: [sdgi] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.188229] sd 0:0:189:0: [sdgd] Attached SCSI disk [ 35.190358] sd 0:0:191:0: [sdgf] Attached SCSI disk [ 35.192142] sd 0:0:195:0: [sdgj] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.192145] sd 0:0:195:0: [sdgj] 4096-byte physical blocks [ 35.194397] sd 0:0:195:0: [sdgj] Write Protect is off [ 35.194399] sd 0:0:195:0: [sdgj] Mode Sense: db 00 10 08 [ 35.194788] sd 0:0:190:0: [sdge] Attached SCSI disk [ 35.195715] sd 0:0:195:0: [sdgj] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.196523] sd 0:0:192:0: [sdgg] Attached SCSI disk [ 35.199899] sd 0:0:196:0: [sdgk] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.199900] sd 0:0:196:0: [sdgk] 4096-byte physical blocks [ 35.202128] sd 0:0:196:0: [sdgk] Write Protect is off [ 35.202129] sd 0:0:196:0: [sdgk] Mode Sense: db 00 10 08 [ 35.203384] sd 0:0:196:0: [sdgk] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.203438] sd 0:0:193:0: [sdgh] Attached SCSI disk [ 35.203754] sd 0:0:197:0: [sdgl] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.203755] sd 0:0:197:0: [sdgl] 4096-byte physical blocks [ 35.206115] sd 0:0:197:0: [sdgl] Write Protect is off [ 35.206117] sd 0:0:197:0: [sdgl] Mode Sense: db 00 10 08 [ 35.206390] sd 0:0:198:0: [sdgm] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.206392] sd 0:0:198:0: [sdgm] 4096-byte physical blocks [ 35.207070] sd 0:0:194:0: [sdgi] Attached SCSI disk [ 35.207373] sd 0:0:197:0: [sdgl] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.208623] sd 0:0:198:0: [sdgm] Write Protect is off [ 35.208625] sd 0:0:198:0: [sdgm] Mode Sense: db 00 10 08 [ 35.209891] sd 0:0:198:0: [sdgm] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.211584] sd 0:0:199:0: [sdgn] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.211586] sd 0:0:199:0: [sdgn] 4096-byte physical blocks [ 35.213923] sd 0:0:199:0: [sdgn] Write Protect is off [ 35.213925] sd 0:0:199:0: [sdgn] Mode Sense: db 00 10 08 [ 35.214379] sd 0:0:195:0: [sdgj] Attached SCSI disk [ 35.215221] sd 0:0:199:0: [sdgn] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.216230] sd 0:0:200:0: [sdgo] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.216232] sd 0:0:200:0: [sdgo] 4096-byte physical blocks [ 35.218517] sd 0:0:200:0: [sdgo] Write Protect is off [ 35.218518] sd 0:0:200:0: [sdgo] Mode Sense: db 00 10 08 [ 35.219855] sd 0:0:200:0: [sdgo] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.225141] sd 0:0:196:0: [sdgk] Attached SCSI disk [ 35.232108] sd 0:0:204:0: [sdgs] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.232110] sd 0:0:204:0: [sdgs] 4096-byte physical blocks [ 35.233235] sd 0:0:198:0: [sdgm] Attached SCSI disk [ 35.234898] sd 0:0:202:0: [sdgq] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.234900] sd 0:0:202:0: [sdgq] 4096-byte physical blocks [ 35.236664] sd 0:0:199:0: [sdgn] Attached SCSI disk [ 35.236675] sd 0:0:200:0: [sdgo] Attached SCSI disk [ 35.237147] sd 0:0:202:0: [sdgq] Write Protect is off [ 35.237149] sd 0:0:202:0: [sdgq] Mode Sense: db 00 10 08 [ 35.238504] sd 0:0:202:0: [sdgq] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.239301] sd 0:0:203:0: [sdgr] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.239303] sd 0:0:203:0: [sdgr] 4096-byte physical blocks [ 35.241561] sd 0:0:203:0: [sdgr] Write Protect is off [ 35.241562] sd 0:0:203:0: [sdgr] Mode Sense: db 00 10 08 [ 35.242857] sd 0:0:212:0: [sdha] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.242859] sd 0:0:212:0: [sdha] 4096-byte physical blocks [ 35.242913] sd 0:0:203:0: [sdgr] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.244078] sd 0:0:213:0: [sdhb] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.244080] sd 0:0:213:0: [sdhb] 4096-byte physical blocks [ 35.245181] sd 0:0:212:0: [sdha] Write Protect is off [ 35.245183] sd 0:0:212:0: [sdha] Mode Sense: db 00 10 08 [ 35.245578] sd 0:0:206:0: [sdgu] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.245579] sd 0:0:206:0: [sdgu] 4096-byte physical blocks [ 35.245595] sd 0:0:214:0: [sdhc] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.245597] sd 0:0:214:0: [sdhc] 4096-byte physical blocks [ 35.245631] sd 0:0:207:0: [sdgv] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.245633] sd 0:0:207:0: [sdgv] 4096-byte physical blocks [ 35.246423] sd 0:0:205:0: [sdgt] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.246425] sd 0:0:205:0: [sdgt] 4096-byte physical blocks [ 35.246443] sd 0:0:213:0: [sdhb] Write Protect is off [ 35.246446] sd 0:0:213:0: [sdhb] Mode Sense: db 00 10 08 [ 35.246460] sd 0:0:212:0: [sdha] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.247730] sd 0:0:213:0: [sdhb] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.247819] sd 0:0:206:0: [sdgu] Write Protect is off [ 35.247821] sd 0:0:206:0: [sdgu] Mode Sense: db 00 10 08 [ 35.247838] sd 0:0:214:0: [sdhc] Write Protect is off [ 35.247839] sd 0:0:214:0: [sdhc] Mode Sense: db 00 10 08 [ 35.247962] sd 0:0:207:0: [sdgv] Write Protect is off [ 35.247963] sd 0:0:207:0: [sdgv] Mode Sense: db 00 10 08 [ 35.248700] sd 0:0:205:0: [sdgt] Write Protect is off [ 35.248702] sd 0:0:205:0: [sdgt] Mode Sense: db 00 10 08 [ 35.249114] sd 0:0:214:0: [sdhc] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.249152] sd 0:0:206:0: [sdgu] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.249259] sd 0:0:207:0: [sdgv] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.249996] sd 0:0:205:0: [sdgt] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.250245] sd 0:0:201:0: [sdgp] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.250246] sd 0:0:201:0: [sdgp] 4096-byte physical blocks [ 35.253455] sd 0:0:216:0: [sdhe] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.253457] sd 0:0:216:0: [sdhe] 4096-byte physical blocks [ 35.253491] sd 0:0:219:0: [sdhh] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.253493] sd 0:0:219:0: [sdhh] 4096-byte physical blocks [ 35.253877] sd 0:0:211:0: [sdgz] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.253879] sd 0:0:211:0: [sdgz] 4096-byte physical blocks [ 35.254732] sd 0:0:208:0: [sdgw] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.254734] sd 0:0:208:0: [sdgw] 4096-byte physical blocks [ 35.254929] sd 0:0:220:0: [sdhi] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.254930] sd 0:0:220:0: [sdhi] 4096-byte physical blocks [ 35.255102] sd 0:0:209:0: [sdgx] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.255104] sd 0:0:209:0: [sdgx] 4096-byte physical blocks [ 35.255735] sd 0:0:219:0: [sdhh] Write Protect is off [ 35.255737] sd 0:0:219:0: [sdhh] Mode Sense: db 00 10 08 [ 35.256192] sd 0:0:216:0: [sdhe] Write Protect is off [ 35.256194] sd 0:0:216:0: [sdhe] Mode Sense: db 00 10 08 [ 35.256280] sd 0:0:210:0: [sdgy] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.256282] sd 0:0:210:0: [sdgy] 4096-byte physical blocks [ 35.256492] sd 0:0:211:0: [sdgz] Write Protect is off [ 35.256494] sd 0:0:211:0: [sdgz] Mode Sense: db 00 10 08 [ 35.256600] sd 0:0:215:0: [sdhd] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.256601] sd 0:0:215:0: [sdhd] 4096-byte physical blocks [ 35.257079] sd 0:0:219:0: [sdhh] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.257105] sd 0:0:208:0: [sdgw] Write Protect is off [ 35.257107] sd 0:0:208:0: [sdgw] Mode Sense: db 00 10 08 [ 35.257213] sd 0:0:220:0: [sdhi] Write Protect is off [ 35.257215] sd 0:0:220:0: [sdhi] Mode Sense: db 00 10 08 [ 35.257507] sd 0:0:216:0: [sdhe] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.257580] sd 0:0:209:0: [sdgx] Write Protect is off [ 35.257582] sd 0:0:209:0: [sdgx] Mode Sense: db 00 10 08 [ 35.258410] sd 0:0:222:0: [sdhk] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.258412] sd 0:0:222:0: [sdhk] 4096-byte physical blocks [ 35.258437] sd 0:0:208:0: [sdgw] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.258469] sd 0:0:211:0: [sdgz] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.258545] sd 0:0:220:0: [sdhi] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.258883] sd 0:0:209:0: [sdgx] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.261482] sd 0:0:222:0: [sdhk] Write Protect is off [ 35.261484] sd 0:0:222:0: [sdhk] Mode Sense: db 00 10 08 [ 35.262795] sd 0:0:222:0: [sdhk] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.263147] sd 0:0:224:0: [sdhm] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.263149] sd 0:0:224:0: [sdhm] 4096-byte physical blocks [ 35.263157] sd 0:0:213:0: [sdhb] Attached SCSI disk [ 35.264021] sd 0:0:202:0: [sdgq] Attached SCSI disk [ 35.264302] sd 0:0:217:0: [sdhf] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.264303] sd 0:0:217:0: [sdhf] 4096-byte physical blocks [ 35.265206] sd 0:0:225:0: [sdhn] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.265208] sd 0:0:225:0: [sdhn] 4096-byte physical blocks [ 35.265211] sd 0:0:204:0: [sdgs] Write Protect is off [ 35.265212] sd 0:0:204:0: [sdgs] Mode Sense: db 00 10 08 [ 35.265447] sd 0:0:224:0: [sdhm] Write Protect is off [ 35.265448] sd 0:0:224:0: [sdhm] Mode Sense: db 00 10 08 [ 35.266687] sd 0:0:217:0: [sdhf] Write Protect is off [ 35.266690] sd 0:0:217:0: [sdhf] Mode Sense: db 00 10 08 [ 35.267359] sd 0:0:224:0: [sdhm] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.267529] sd 0:0:225:0: [sdhn] Write Protect is off [ 35.267531] sd 0:0:225:0: [sdhn] Mode Sense: db 00 10 08 [ 35.268026] sd 0:0:217:0: [sdhf] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.268285] sd 0:0:212:0: [sdha] Attached SCSI disk [ 35.268364] sd 0:0:218:0: [sdhg] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.268366] sd 0:0:218:0: [sdhg] 4096-byte physical blocks [ 35.268860] sd 0:0:225:0: [sdhn] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.269353] sd 0:0:214:0: [sdhc] Attached SCSI disk [ 35.269442] sd 0:0:201:0: [sdgp] Write Protect is off [ 35.269443] sd 0:0:201:0: [sdgp] Mode Sense: db 00 10 08 [ 35.269905] sd 0:0:197:0: [sdgl] Attached SCSI disk [ 35.270721] sd 0:0:201:0: [sdgp] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.270781] sd 0:0:218:0: [sdhg] Write Protect is off [ 35.270782] sd 0:0:218:0: [sdhg] Mode Sense: db 00 10 08 [ 35.271756] sd 0:0:216:0: [sdhe] Attached SCSI disk [ 35.272237] sd 0:0:226:0: [sdho] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.272239] sd 0:0:226:0: [sdho] 4096-byte physical blocks [ 35.272495] sd 0:0:218:0: [sdhg] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.272568] sd 0:0:223:0: [sdhl] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.272570] sd 0:0:223:0: [sdhl] 4096-byte physical blocks [ 35.272960] sd 0:0:203:0: [sdgr] Attached SCSI disk [ 35.273720] sd 0:0:208:0: [sdgw] Attached SCSI disk [ 35.273967] sd 0:0:221:0: [sdhj] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.273969] sd 0:0:221:0: [sdhj] 4096-byte physical blocks [ 35.274857] sd 0:0:226:0: [sdho] Write Protect is off [ 35.274860] sd 0:0:226:0: [sdho] Mode Sense: db 00 10 08 [ 35.274952] sd 0:0:223:0: [sdhl] Write Protect is off [ 35.274954] sd 0:0:223:0: [sdhl] Mode Sense: db 00 10 08 [ 35.275614] sd 0:0:228:0: [sdhq] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.275616] sd 0:0:228:0: [sdhq] 4096-byte physical blocks [ 35.275763] sd 0:0:227:0: [sdhp] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.275764] sd 0:0:227:0: [sdhp] 4096-byte physical blocks [ 35.275978] sd 0:0:209:0: [sdgx] Attached SCSI disk [ 35.276146] sd 0:0:226:0: [sdho] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.276295] sd 0:0:223:0: [sdhl] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.276594] sd 0:0:210:0: [sdgy] Write Protect is off [ 35.276596] sd 0:0:210:0: [sdgy] Mode Sense: db 00 10 08 [ 35.276884] sd 0:0:229:0: [sdhr] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.276886] sd 0:0:229:0: [sdhr] 4096-byte physical blocks [ 35.277898] sd 0:0:228:0: [sdhq] Write Protect is off [ 35.277900] sd 0:0:228:0: [sdhq] Mode Sense: db 00 10 08 [ 35.277940] sd 0:0:220:0: [sdhi] Attached SCSI disk [ 35.277956] sd 0:0:210:0: [sdgy] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.277968] sd 0:0:219:0: [sdhh] Attached SCSI disk [ 35.278503] sd 0:0:227:0: [sdhp] Write Protect is off [ 35.278510] sd 0:0:227:0: [sdhp] Mode Sense: db 00 10 08 [ 35.279280] sd 0:0:229:0: [sdhr] Write Protect is off [ 35.279282] sd 0:0:229:0: [sdhr] Mode Sense: db 00 10 08 [ 35.279629] sd 0:0:228:0: [sdhq] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.279820] sd 0:0:227:0: [sdhp] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.280586] sd 0:0:229:0: [sdhr] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.281390] sd 0:0:215:0: [sdhd] Write Protect is off [ 35.281392] sd 0:0:215:0: [sdhd] Mode Sense: db 00 10 08 [ 35.281764] sd 0:0:204:0: [sdgs] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.281854] sd 0:0:222:0: [sdhk] Attached SCSI disk [ 35.282314] sd 0:0:205:0: [sdgt] Attached SCSI disk [ 35.282674] sd 0:0:215:0: [sdhd] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.282860] sd 0:0:217:0: [sdhf] Attached SCSI disk [ 35.283006] sd 0:0:231:0: [sdht] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.283008] sd 0:0:231:0: [sdht] 4096-byte physical blocks [ 35.284561] sd 0:0:224:0: [sdhm] Attached SCSI disk [ 35.284881] sd 0:0:201:0: [sdgp] Attached SCSI disk [ 35.285341] sd 0:0:231:0: [sdht] Write Protect is off [ 35.285343] sd 0:0:231:0: [sdht] Mode Sense: db 00 10 08 [ 35.286671] sd 0:0:231:0: [sdht] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.287522] sd 0:0:218:0: [sdhg] Attached SCSI disk [ 35.287540] sd 0:0:225:0: [sdhn] Attached SCSI disk [ 35.290939] sd 0:0:223:0: [sdhl] Attached SCSI disk [ 35.291374] sd 0:0:226:0: [sdho] Attached SCSI disk [ 35.293285] sd 0:0:210:0: [sdgy] Attached SCSI disk [ 35.293438] sd 0:0:221:0: [sdhj] Write Protect is off [ 35.293439] sd 0:0:221:0: [sdhj] Mode Sense: db 00 10 08 [ 35.293654] sd 0:0:234:0: [sdhw] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.293655] sd 0:0:234:0: [sdhw] 4096-byte physical blocks [ 35.294744] sd 0:0:221:0: [sdhj] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.295136] sd 0:0:227:0: [sdhp] Attached SCSI disk [ 35.295846] sd 0:0:234:0: [sdhw] Write Protect is off [ 35.295848] sd 0:0:234:0: [sdhw] Mode Sense: db 00 10 08 [ 35.297046] sd 0:0:204:0: [sdgs] Attached SCSI disk [ 35.297180] sd 0:0:234:0: [sdhw] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.298103] sd 0:0:228:0: [sdhq] Attached SCSI disk [ 35.299657] sd 0:0:215:0: [sdhd] Attached SCSI disk [ 35.299994] sd 0:0:236:0: [sdhy] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.299995] sd 0:0:236:0: [sdhy] 4096-byte physical blocks [ 35.300324] sd 0:0:230:0: [sdhs] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.300326] sd 0:0:230:0: [sdhs] 4096-byte physical blocks [ 35.302335] sd 0:0:237:0: [sdhz] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.302337] sd 0:0:237:0: [sdhz] 4096-byte physical blocks [ 35.302993] sd 0:0:236:0: [sdhy] Write Protect is off [ 35.302995] sd 0:0:236:0: [sdhy] Mode Sense: db 00 10 08 [ 35.303684] sd 0:0:229:0: [sdhr] Attached SCSI disk [ 35.304340] sd 0:0:236:0: [sdhy] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.304592] sd 0:0:237:0: [sdhz] Write Protect is off [ 35.304595] sd 0:0:237:0: [sdhz] Mode Sense: db 00 10 08 [ 35.305356] sd 0:0:232:0: [sdhu] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.305358] sd 0:0:232:0: [sdhu] 4096-byte physical blocks [ 35.305937] sd 0:0:237:0: [sdhz] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.307789] sd 0:0:206:0: [sdgu] Attached SCSI disk [ 35.307953] sd 0:0:221:0: [sdhj] Attached SCSI disk [ 35.308183] sd 0:0:238:0: [sdia] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.308185] sd 0:0:238:0: [sdia] 4096-byte physical blocks [ 35.308460] sd 0:0:232:0: [sdhu] Write Protect is off [ 35.308462] sd 0:0:232:0: [sdhu] Mode Sense: db 00 10 08 [ 35.309732] sd 0:0:232:0: [sdhu] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.310145] sd 0:0:231:0: [sdht] Attached SCSI disk [ 35.310810] sd 0:0:239:0: [sdib] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.310812] sd 0:0:239:0: [sdib] 4096-byte physical blocks [ 35.311178] sd 0:0:233:0: [sdhv] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.311180] sd 0:0:233:0: [sdhv] 4096-byte physical blocks [ 35.313965] sd 0:0:239:0: [sdib] Write Protect is off [ 35.313967] sd 0:0:239:0: [sdib] Mode Sense: db 00 10 08 [ 35.317058] sd 0:0:211:0: [sdgz] Attached SCSI disk [ 35.317477] sd 0:0:207:0: [sdgv] Attached SCSI disk [ 35.317588] sd 0:0:235:0: [sdhx] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.317590] sd 0:0:235:0: [sdhx] 4096-byte physical blocks [ 35.323621] sd 0:0:232:0: [sdhu] Attached SCSI disk [ 35.323812] sd 1:2:0:0: [sdig] 233308160 512-byte logical blocks: (119 GB/111 GiB) [ 35.323943] sd 0:0:242:0: [sdie] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.323945] sd 0:0:242:0: [sdie] 4096-byte physical blocks [ 35.323999] sd 1:2:0:0: [sdig] Write Protect is off [ 35.324002] sd 1:2:0:0: [sdig] Mode Sense: 1f 00 10 08 [ 35.324056] sd 1:2:0:0: [sdig] Write cache: disabled, read cache: disabled, supports DPO and FUA [ 35.324515] sd 0:0:230:0: [sdhs] Write Protect is off [ 35.324517] sd 0:0:230:0: [sdhs] Mode Sense: db 00 10 08 [ 35.325875] sd 0:0:230:0: [sdhs] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.326522] sdig: sdig1 sdig2 sdig3 [ 35.326819] sd 0:0:241:0: [sdid] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.326822] sd 0:0:241:0: [sdid] 4096-byte physical blocks [ 35.326829] sd 0:0:242:0: [sdie] Write Protect is off [ 35.326831] sd 0:0:242:0: [sdie] Mode Sense: db 00 10 08 [ 35.327922] sd 0:0:239:0: [sdib] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.328161] sd 0:0:242:0: [sdie] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.329923] sd 0:0:240:0: [sdic] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.329925] sd 0:0:240:0: [sdic] 4096-byte physical blocks [ 35.331342] sd 1:2:0:0: [sdig] Attached SCSI disk [ 35.331753] sd 0:0:243:0: [sdif] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 35.331755] sd 0:0:243:0: [sdif] 4096-byte physical blocks [ 35.334422] sd 0:0:238:0: [sdia] Write Protect is off [ 35.334424] sd 0:0:238:0: [sdia] Mode Sense: db 00 10 08 [ 35.334678] sd 0:0:243:0: [sdif] Write Protect is off [ 35.334680] sd 0:0:243:0: [sdif] Mode Sense: db 00 10 08 [ 35.335044] sd 0:0:233:0: [sdhv] Write Protect is off [ 35.335046] sd 0:0:233:0: [sdhv] Mode Sense: db 00 10 08 [ 35.335752] sd 0:0:235:0: [sdhx] Write Protect is off [ 35.335754] sd 0:0:235:0: [sdhx] Mode Sense: db 00 10 08 [ 35.336026] sd 0:0:243:0: [sdif] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.336345] sd 0:0:233:0: [sdhv] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.336807] sd 0:0:236:0: [sdhy] Attached SCSI disk [ 35.337113] sd 0:0:235:0: [sdhx] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.339970] sd 0:0:230:0: [sdhs] Attached SCSI disk [ 35.351614] sd 0:0:233:0: [sdhv] Attached SCSI disk [ 35.352599] sd 0:0:241:0: [sdid] Write Protect is off [ 35.352601] sd 0:0:241:0: [sdid] Mode Sense: db 00 10 08 [ 35.353335] sd 0:0:235:0: [sdhx] Attached SCSI disk [ 35.354711] sd 0:0:237:0: [sdhz] Attached SCSI disk [ 35.356464] sd 0:0:234:0: [sdhw] Attached SCSI disk [ 35.357099] sd 0:0:238:0: [sdia] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.365361] sd 0:0:239:0: [sdib] Attached SCSI disk [ 35.371204] sd 0:0:238:0: [sdia] Attached SCSI disk [ 35.378948] sd 0:0:240:0: [sdic] Write Protect is off [ 35.378950] sd 0:0:240:0: [sdic] Mode Sense: db 00 10 08 [ 35.380272] sd 0:0:240:0: [sdic] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.382237] sd 0:0:241:0: [sdid] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.384349] sd 0:0:243:0: [sdif] Attached SCSI disk [ 35.401538] sd 0:0:240:0: [sdic] Attached SCSI disk [ 35.405792] sd 0:0:242:0: [sdie] Attached SCSI disk [ 35.433815] sd 0:0:241:0: [sdid] Attached SCSI disk [ 35.591123] sd 0:0:2:0: [sdb] 4096-byte physical blocks [ 35.593635] sd 0:0:2:0: [sdb] Write Protect is off [ 35.593637] sd 0:0:2:0: [sdb] Mode Sense: db 00 10 08 [ 35.594929] sd 0:0:2:0: [sdb] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.615299] sd 0:0:2:0: [sdb] Attached SCSI disk [ 42.850953] EXT4-fs (sdig2): mounted filesystem with ordered data mode. Opts: (null) [ 43.150471] systemd-journald[356]: Received SIGTERM from PID 1 (systemd). [ 43.186298] SELinux: Disabled at runtime. [ 43.190989] SELinux: Unregistering netfilter hooks [ 43.234848] type=1404 audit(1555944878.739:2): selinux=0 auid=4294967295 ses=4294967295 [ 43.258885] ip_tables: (C) 2000-2006 Netfilter Core Team [ 43.264800] systemd[1]: Inserted module 'ip_tables' [ 43.369851] EXT4-fs (sdig2): re-mounted. Opts: (null) [ 43.373605] Request for unknown module key 'Mellanox Technologies signing key: 61feb074fc7292f958419386ffdd9d5ca999e403' err -11 [ 43.389513] knem 1.1.3.90mlnx1: initialized [ 43.401386] systemd-journald[14863]: Received request to flush runtime journal from PID 1 [ 43.540305] ACPI Error: No handler for Region [SYSI] (ffff981e69e82b40) [IPMI] (20130517/evregion-162) [ 43.553864] ACPI Error: Region IPMI (ID=7) has no handler (20130517/exfldio-305) [ 43.565501] ACPI Error: Method parse/execution failed [\_SB_.PMI0._GHL] (Node ffff97fe69e7b5a0), AE_NOT_EXIST (20130517/psparse-536) [ 43.584374] ACPI Error: Method parse/execution failed [\_SB_.PMI0._PMC] (Node ffff97fe69e7b500), AE_NOT_EXIST (20130517/psparse-536) [ 43.603314] ACPI Exception: AE_NOT_EXIST, Evaluating _PMC (20130517/power_meter-753) [ 43.616712] ipmi message handler version 39.2 [ 43.625265] scsi 0:0:0:0: Attached scsi generic sg0 type 13 [ 43.632475] sd 0:0:1:0: Attached scsi generic sg1 type 0 [ 43.633983] ipmi device interface [ 43.645124] sd 0:0:2:0: Attached scsi generic sg2 type 0 [ 43.652458] sd 0:0:3:0: Attached scsi generic sg3 type 0 [ 43.652967] IPMI System Interface driver. [ 43.653045] ipmi_si ipmi_si.0: ipmi_platform: probing via SMBIOS [ 43.653048] ipmi_si: SMBIOS: io 0xca8 regsize 1 spacing 4 irq 10 [ 43.653049] ipmi_si: Adding SMBIOS-specified kcs state machine [ 43.653126] ipmi_si IPI0001:00: ipmi_platform: probing via ACPI [ 43.653154] ipmi_si IPI0001:00: [io 0x0ca8] regsize 1 spacing 4 irq 10 [ 43.653156] ipmi_si ipmi_si.0: Removing SMBIOS-specified kcs state machine in favor of ACPI [ 43.653157] ipmi_si: Adding ACPI-specified kcs state machine [ 43.653404] ipmi_si: Trying ACPI-specified kcs state machine at i/o address 0xca8, slave address 0x20, irq 10 [ 43.660883] ipmi_si IPI0001:00: The BMC does not support setting the recv irq bit, compensating, but the BMC needs to be fixed. [ 43.662084] ipmi_si IPI0001:00: Using irq 10 [ 43.671063] ipmi_si IPI0001:00: Found new BMC (man_id: 0x0002a2, prod_id: 0x0100, dev_id: 0x20) [ 43.728759] ipmi_si IPI0001:00: IPMI kcs interface initialized [ 43.764303] sd 0:0:4:0: Attached scsi generic sg4 type 0 [ 43.770822] sd 0:0:5:0: Attached scsi generic sg5 type 0 [ 43.777763] sd 0:0:6:0: Attached scsi generic sg6 type 0 [ 43.784336] sd 0:0:7:0: Attached scsi generic sg7 type 0 [ 43.791909] sd 0:0:8:0: Attached scsi generic sg8 type 0 [ 43.799360] sd 0:0:9:0: Attached scsi generic sg9 type 0 [ 43.807684] sd 0:0:10:0: Attached scsi generic sg10 type 0 [ 43.808958] device-mapper: uevent: version 1.0.3 [ 43.809648] device-mapper: ioctl: 4.37.1-ioctl (2018-04-03) initialised: dm-devel@redhat.com [ 43.829834] sd 0:0:11:0: Attached scsi generic sg11 type 0 [ 43.837977] sd 0:0:12:0: Attached scsi generic sg12 type 0 [ 43.845262] sd 0:0:13:0: Attached scsi generic sg13 type 0 [ 43.851482] sd 0:0:14:0: Attached scsi generic sg14 type 0 [ 43.859883] sd 0:0:15:0: Attached scsi generic sg15 type 0 [ 43.867285] sd 0:0:16:0: Attached scsi generic sg16 type 0 [ 43.873806] sd 0:0:17:0: Attached scsi generic sg17 type 0 [ 43.881695] sd 0:0:18:0: Attached scsi generic sg18 type 0 [ 43.888870] sd 0:0:19:0: Attached scsi generic sg19 type 0 [ 43.895681] sd 0:0:20:0: Attached scsi generic sg20 type 0 [ 43.904638] sd 0:0:21:0: Attached scsi generic sg21 type 0 [ 43.911038] sd 0:0:22:0: Attached scsi generic sg22 type 0 [ 43.917734] sd 0:0:23:0: Attached scsi generic sg23 type 0 [ 43.924782] sd 0:0:24:0: Attached scsi generic sg24 type 0 [ 43.933177] sd 0:0:25:0: Attached scsi generic sg25 type 0 [ 43.939879] sd 0:0:26:0: Attached scsi generic sg26 type 0 [ 43.946327] sd 0:0:27:0: Attached scsi generic sg27 type 0 [ 43.956234] sd 0:0:28:0: Attached scsi generic sg28 type 0 [ 43.963104] sd 0:0:29:0: Attached scsi generic sg29 type 0 [ 43.970911] sd 0:0:30:0: Attached scsi generic sg30 type 0 [ 43.977037] sd 0:0:31:0: Attached scsi generic sg31 type 0 [ 43.983685] sd 0:0:32:0: Attached scsi generic sg32 type 0 [ 43.991255] sd 0:0:33:0: Attached scsi generic sg33 type 0 [ 43.997463] sd 0:0:34:0: Attached scsi generic sg34 type 0 [ 44.005238] sd 0:0:35:0: Attached scsi generic sg35 type 0 [ 44.011274] sd 0:0:36:0: Attached scsi generic sg36 type 0 [ 44.018174] sd 0:0:37:0: Attached scsi generic sg37 type 0 [ 44.025135] sd 0:0:38:0: Attached scsi generic sg38 type 0 [ 44.032068] sd 0:0:39:0: Attached scsi generic sg39 type 0 [ 44.038528] sd 0:0:40:0: Attached scsi generic sg40 type 0 [ 44.046992] sd 0:0:41:0: Attached scsi generic sg41 type 0 [ 44.054073] sd 0:0:42:0: Attached scsi generic sg42 type 0 [ 44.061773] sd 0:0:43:0: Attached scsi generic sg43 type 0 [ 44.067695] sd 0:0:44:0: Attached scsi generic sg44 type 0 [ 44.074884] sd 0:0:45:0: Attached scsi generic sg45 type 0 [ 44.080990] sd 0:0:46:0: Attached scsi generic sg46 type 0 [ 44.088428] sd 0:0:47:0: Attached scsi generic sg47 type 0 [ 44.095510] sd 0:0:48:0: Attached scsi generic sg48 type 0 [ 44.104228] sd 0:0:49:0: Attached scsi generic sg49 type 0 [ 44.111214] sd 0:0:50:0: Attached scsi generic sg50 type 0 [ 44.117170] sd 0:0:51:0: Attached scsi generic sg51 type 0 [ 44.123230] sd 0:0:52:0: Attached scsi generic sg52 type 0 [ 44.129111] sd 0:0:53:0: Attached scsi generic sg53 type 0 [ 44.137021] sd 0:0:54:0: Attached scsi generic sg54 type 0 [ 44.143682] sd 0:0:55:0: Attached scsi generic sg55 type 0 [ 44.150762] sd 0:0:56:0: Attached scsi generic sg56 type 0 [ 44.156618] sd 0:0:57:0: Attached scsi generic sg57 type 0 [ 44.162504] sd 0:0:58:0: Attached scsi generic sg58 type 0 [ 44.168665] sd 0:0:59:0: Attached scsi generic sg59 type 0 [ 44.175317] sd 0:0:60:0: Attached scsi generic sg60 type 0 [ 44.181226] scsi 0:0:61:0: Attached scsi generic sg61 type 13 [ 44.187331] sd 0:0:62:0: Attached scsi generic sg62 type 0 [ 44.194046] sd 0:0:63:0: Attached scsi generic sg63 type 0 [ 44.199768] sd 0:0:64:0: Attached scsi generic sg64 type 0 [ 44.205780] sd 0:0:65:0: Attached scsi generic sg65 type 0 [ 44.211802] sd 0:0:66:0: Attached scsi generic sg66 type 0 [ 44.217691] sd 0:0:67:0: Attached scsi generic sg67 type 0 [ 44.223390] sd 0:0:68:0: Attached scsi generic sg68 type 0 [ 44.229144] sd 0:0:69:0: Attached scsi generic sg69 type 0 [ 44.235366] sd 0:0:70:0: Attached scsi generic sg70 type 0 [ 44.240983] sd 0:0:71:0: Attached scsi generic sg71 type 0 [ 44.246822] sd 0:0:72:0: Attached scsi generic sg72 type 0 [ 44.252434] sd 0:0:73:0: Attached scsi generic sg73 type 0 [ 44.258004] sd 0:0:74:0: Attached scsi generic sg74 type 0 [ 44.263619] sd 0:0:75:0: Attached scsi generic sg75 type 0 [ 44.269185] sd 0:0:76:0: Attached scsi generic sg76 type 0 [ 44.274745] sd 0:0:77:0: Attached scsi generic sg77 type 0 [ 44.281659] sd 0:0:78:0: Attached scsi generic sg78 type 0 [ 44.288524] sd 0:0:79:0: Attached scsi generic sg79 type 0 [ 44.295556] sd 0:0:80:0: Attached scsi generic sg80 type 0 [ 44.302284] sd 0:0:81:0: Attached scsi generic sg81 type 0 [ 44.309153] sd 0:0:82:0: Attached scsi generic sg82 type 0 [ 44.316034] sd 0:0:83:0: Attached scsi generic sg83 type 0 [ 44.322969] sd 0:0:84:0: Attached scsi generic sg84 type 0 [ 44.329067] sd 0:0:85:0: Attached scsi generic sg85 type 0 [ 44.335956] sd 0:0:86:0: Attached scsi generic sg86 type 0 [ 44.342823] sd 0:0:87:0: Attached scsi generic sg87 type 0 [ 44.349691] sd 0:0:88:0: Attached scsi generic sg88 type 0 [ 44.356566] sd 0:0:89:0: Attached scsi generic sg89 type 0 [ 44.362653] sd 0:0:90:0: Attached scsi generic sg90 type 0 [ 44.368195] sd 0:0:91:0: Attached scsi generic sg91 type 0 [ 44.373723] sd 0:0:92:0: Attached scsi generic sg92 type 0 [ 44.379258] sd 0:0:93:0: Attached scsi generic sg93 type 0 [ 44.384801] sd 0:0:94:0: Attached scsi generic sg94 type 0 [ 44.390334] sd 0:0:95:0: Attached scsi generic sg95 type 0 [ 44.395881] sd 0:0:96:0: Attached scsi generic sg96 type 0 [ 44.401426] sd 0:0:97:0: Attached scsi generic sg97 type 0 [ 44.406974] sd 0:0:98:0: Attached scsi generic sg98 type 0 [ 44.412509] sd 0:0:99:0: Attached scsi generic sg99 type 0 [ 44.418039] sd 0:0:100:0: Attached scsi generic sg100 type 0 [ 44.423743] sd 0:0:101:0: Attached scsi generic sg101 type 0 [ 44.429456] sd 0:0:102:0: Attached scsi generic sg102 type 0 [ 44.435162] sd 0:0:103:0: Attached scsi generic sg103 type 0 [ 44.440872] sd 0:0:104:0: Attached scsi generic sg104 type 0 [ 44.446576] sd 0:0:105:0: Attached scsi generic sg105 type 0 [ 44.452282] sd 0:0:106:0: Attached scsi generic sg106 type 0 [ 44.457979] sd 0:0:107:0: Attached scsi generic sg107 type 0 [ 44.463687] sd 0:0:108:0: Attached scsi generic sg108 type 0 [ 44.469385] sd 0:0:109:0: Attached scsi generic sg109 type 0 [ 44.475095] sd 0:0:110:0: Attached scsi generic sg110 type 0 [ 44.480800] sd 0:0:111:0: Attached scsi generic sg111 type 0 [ 44.486510] sd 0:0:112:0: Attached scsi generic sg112 type 0 [ 44.492215] sd 0:0:113:0: Attached scsi generic sg113 type 0 [ 44.497926] sd 0:0:114:0: Attached scsi generic sg114 type 0 [ 44.503629] sd 0:0:115:0: Attached scsi generic sg115 type 0 [ 44.509339] sd 0:0:116:0: Attached scsi generic sg116 type 0 [ 44.515234] sd 0:0:117:0: Attached scsi generic sg117 type 0 [ 44.520947] sd 0:0:118:0: Attached scsi generic sg118 type 0 [ 44.526659] sd 0:0:119:0: Attached scsi generic sg119 type 0 [ 44.532369] sd 0:0:120:0: Attached scsi generic sg120 type 0 [ 44.538075] sd 0:0:121:0: Attached scsi generic sg121 type 0 [ 44.543793] scsi 0:0:122:0: Attached scsi generic sg122 type 13 [ 44.549765] sd 0:0:123:0: Attached scsi generic sg123 type 0 [ 44.555477] sd 0:0:124:0: Attached scsi generic sg124 type 0 [ 44.561185] sd 0:0:125:0: Attached scsi generic sg125 type 0 [ 44.566911] sd 0:0:126:0: Attached scsi generic sg126 type 0 [ 44.572628] sd 0:0:127:0: Attached scsi generic sg127 type 0 [ 44.578340] sd 0:0:128:0: Attached scsi generic sg128 type 0 [ 44.584045] sd 0:0:129:0: Attached scsi generic sg129 type 0 [ 44.589765] sd 0:0:130:0: Attached scsi generic sg130 type 0 [ 44.595479] sd 0:0:131:0: Attached scsi generic sg131 type 0 [ 44.601190] sd 0:0:132:0: Attached scsi generic sg132 type 0 [ 44.606901] sd 0:0:133:0: Attached scsi generic sg133 type 0 [ 44.612614] sd 0:0:134:0: Attached scsi generic sg134 type 0 [ 44.618321] sd 0:0:135:0: Attached scsi generic sg135 type 0 [ 44.624033] sd 0:0:136:0: Attached scsi generic sg136 type 0 [ 44.629741] sd 0:0:137:0: Attached scsi generic sg137 type 0 [ 44.635445] sd 0:0:138:0: Attached scsi generic sg138 type 0 [ 44.641145] sd 0:0:139:0: Attached scsi generic sg139 type 0 [ 44.646855] sd 0:0:140:0: Attached scsi generic sg140 type 0 [ 44.652558] sd 0:0:141:0: Attached scsi generic sg141 type 0 [ 44.658264] sd 0:0:142:0: Attached scsi generic sg142 type 0 [ 44.663966] sd 0:0:143:0: Attached scsi generic sg143 type 0 [ 44.669671] sd 0:0:144:0: Attached scsi generic sg144 type 0 [ 44.675380] sd 0:0:145:0: Attached scsi generic sg145 type 0 [ 44.681084] sd 0:0:146:0: Attached scsi generic sg146 type 0 [ 44.686780] sd 0:0:147:0: Attached scsi generic sg147 type 0 [ 44.692491] sd 0:0:148:0: Attached scsi generic sg148 type 0 [ 44.698197] sd 0:0:149:0: Attached scsi generic sg149 type 0 [ 44.703905] sd 0:0:150:0: Attached scsi generic sg150 type 0 [ 44.709613] sd 0:0:151:0: Attached scsi generic sg151 type 0 [ 44.715316] sd 0:0:152:0: Attached scsi generic sg152 type 0 [ 44.721020] sd 0:0:153:0: Attached scsi generic sg153 type 0 [ 44.726723] sd 0:0:154:0: Attached scsi generic sg154 type 0 [ 44.732429] sd 0:0:155:0: Attached scsi generic sg155 type 0 [ 44.738138] sd 0:0:156:0: Attached scsi generic sg156 type 0 [ 44.743835] sd 0:0:157:0: Attached scsi generic sg157 type 0 [ 44.749545] sd 0:0:158:0: Attached scsi generic sg158 type 0 [ 44.755249] sd 0:0:159:0: Attached scsi generic sg159 type 0 [ 44.760955] sd 0:0:160:0: Attached scsi generic sg160 type 0 [ 44.766656] sd 0:0:161:0: Attached scsi generic sg161 type 0 [ 44.772364] sd 0:0:162:0: Attached scsi generic sg162 type 0 [ 44.778073] sd 0:0:163:0: Attached scsi generic sg163 type 0 [ 44.783776] sd 0:0:164:0: Attached scsi generic sg164 type 0 [ 44.789480] sd 0:0:165:0: Attached scsi generic sg165 type 0 [ 44.795185] sd 0:0:166:0: Attached scsi generic sg166 type 0 [ 44.800894] sd 0:0:167:0: Attached scsi generic sg167 type 0 [ 44.806598] sd 0:0:168:0: Attached scsi generic sg168 type 0 [ 44.812311] sd 0:0:169:0: Attached scsi generic sg169 type 0 [ 44.818021] sd 0:0:170:0: Attached scsi generic sg170 type 0 [ 44.823730] sd 0:0:171:0: Attached scsi generic sg171 type 0 [ 44.829439] sd 0:0:172:0: Attached scsi generic sg172 type 0 [ 44.835149] sd 0:0:173:0: Attached scsi generic sg173 type 0 [ 44.840863] sd 0:0:174:0: Attached scsi generic sg174 type 0 [ 44.846568] sd 0:0:175:0: Attached scsi generic sg175 type 0 [ 44.852276] sd 0:0:176:0: Attached scsi generic sg176 type 0 [ 44.857989] sd 0:0:177:0: Attached scsi generic sg177 type 0 [ 44.863696] sd 0:0:178:0: Attached scsi generic sg178 type 0 [ 44.869409] sd 0:0:179:0: Attached scsi generic sg179 type 0 [ 44.875119] sd 0:0:180:0: Attached scsi generic sg180 type 0 [ 44.880834] sd 0:0:181:0: Attached scsi generic sg181 type 0 [ 44.886547] sd 0:0:182:0: Attached scsi generic sg182 type 0 [ 44.892254] scsi 0:0:183:0: Attached scsi generic sg183 type 13 [ 44.898230] sd 0:0:184:0: Attached scsi generic sg184 type 0 [ 44.903935] sd 0:0:185:0: Attached scsi generic sg185 type 0 [ 44.909646] sd 0:0:186:0: Attached scsi generic sg186 type 0 [ 44.915360] sd 0:0:187:0: Attached scsi generic sg187 type 0 [ 44.921068] sd 0:0:188:0: Attached scsi generic sg188 type 0 [ 44.926776] sd 0:0:189:0: Attached scsi generic sg189 type 0 [ 44.932483] sd 0:0:190:0: Attached scsi generic sg190 type 0 [ 44.938189] sd 0:0:191:0: Attached scsi generic sg191 type 0 [ 44.943900] sd 0:0:192:0: Attached scsi generic sg192 type 0 [ 44.949603] sd 0:0:193:0: Attached scsi generic sg193 type 0 [ 44.955311] sd 0:0:194:0: Attached scsi generic sg194 type 0 [ 44.961019] sd 0:0:195:0: Attached scsi generic sg195 type 0 [ 44.966721] sd 0:0:196:0: Attached scsi generic sg196 type 0 [ 44.972429] sd 0:0:197:0: Attached scsi generic sg197 type 0 [ 44.978139] sd 0:0:198:0: Attached scsi generic sg198 type 0 [ 44.983847] sd 0:0:199:0: Attached scsi generic sg199 type 0 [ 44.989555] sd 0:0:200:0: Attached scsi generic sg200 type 0 [ 44.995259] sd 0:0:201:0: Attached scsi generic sg201 type 0 [ 45.000967] sd 0:0:202:0: Attached scsi generic sg202 type 0 [ 45.006664] sd 0:0:203:0: Attached scsi generic sg203 type 0 [ 45.012372] sd 0:0:204:0: Attached scsi generic sg204 type 0 [ 45.018074] sd 0:0:205:0: Attached scsi generic sg205 type 0 [ 45.023776] sd 0:0:206:0: Attached scsi generic sg206 type 0 [ 45.029479] sd 0:0:207:0: Attached scsi generic sg207 type 0 [ 45.035181] sd 0:0:208:0: Attached scsi generic sg208 type 0 [ 45.040889] sd 0:0:209:0: Attached scsi generic sg209 type 0 [ 45.046591] sd 0:0:210:0: Attached scsi generic sg210 type 0 [ 45.052299] sd 0:0:211:0: Attached scsi generic sg211 type 0 [ 45.057998] sd 0:0:212:0: Attached scsi generic sg212 type 0 [ 45.063707] sd 0:0:213:0: Attached scsi generic sg213 type 0 [ 45.069415] sd 0:0:214:0: Attached scsi generic sg214 type 0 [ 45.075119] sd 0:0:215:0: Attached scsi generic sg215 type 0 [ 45.080819] sd 0:0:216:0: Attached scsi generic sg216 type 0 [ 45.086524] sd 0:0:217:0: Attached scsi generic sg217 type 0 [ 45.092225] sd 0:0:218:0: Attached scsi generic sg218 type 0 [ 45.097934] sd 0:0:219:0: Attached scsi generic sg219 type 0 [ 45.103644] sd 0:0:220:0: Attached scsi generic sg220 type 0 [ 45.109357] sd 0:0:221:0: Attached scsi generic sg221 type 0 [ 45.115068] sd 0:0:222:0: Attached scsi generic sg222 type 0 [ 45.120780] sd 0:0:223:0: Attached scsi generic sg223 type 0 [ 45.126491] sd 0:0:224:0: Attached scsi generic sg224 type 0 [ 45.132201] sd 0:0:225:0: Attached scsi generic sg225 type 0 [ 45.137910] sd 0:0:226:0: Attached scsi generic sg226 type 0 [ 45.143618] sd 0:0:227:0: Attached scsi generic sg227 type 0 [ 45.149326] sd 0:0:228:0: Attached scsi generic sg228 type 0 [ 45.155038] sd 0:0:229:0: Attached scsi generic sg229 type 0 [ 45.160750] sd 0:0:230:0: Attached scsi generic sg230 type 0 [ 45.166464] sd 0:0:231:0: Attached scsi generic sg231 type 0 [ 45.172173] sd 0:0:232:0: Attached scsi generic sg232 type 0 [ 45.177883] sd 0:0:233:0: Attached scsi generic sg233 type 0 [ 45.183603] sd 0:0:234:0: Attached scsi generic sg234 type 0 [ 45.189317] sd 0:0:235:0: Attached scsi generic sg235 type 0 [ 45.195023] sd 0:0:236:0: Attached scsi generic sg236 type 0 [ 45.200731] sd 0:0:237:0: Attached scsi generic sg237 type 0 [ 45.206439] sd 0:0:238:0: Attached scsi generic sg238 type 0 [ 45.212139] sd 0:0:239:0: Attached scsi generic sg239 type 0 [ 45.217844] sd 0:0:240:0: Attached scsi generic sg240 type 0 [ 45.223551] sd 0:0:241:0: Attached scsi generic sg241 type 0 [ 45.229256] sd 0:0:242:0: Attached scsi generic sg242 type 0 [ 45.234960] sd 0:0:243:0: Attached scsi generic sg243 type 0 [ 45.240663] scsi 0:0:244:0: Attached scsi generic sg244 type 13 [ 45.246628] sd 1:2:0:0: Attached scsi generic sg245 type 0 [ 45.252368] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.260969] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.269365] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.277758] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.286165] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.294560] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.302951] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.311343] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.319735] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.328126] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.336513] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.344902] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.353296] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.361682] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.370079] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.378471] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.386861] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.395247] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.403638] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.412030] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.420427] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.428817] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.437213] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.445603] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.453994] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.462385] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.470773] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.479161] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.487551] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.495939] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.504343] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.512748] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.521146] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.529538] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.537939] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.546334] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.554731] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.563130] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.571536] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.579932] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.588332] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.596729] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.605130] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.613523] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.621918] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.630319] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.638718] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.647112] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.655512] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.663904] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.672304] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.680692] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.689091] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.697481] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.705879] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.714271] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.722673] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.731067] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.739464] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.747858] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.756255] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.764647] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.773042] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.781437] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.789843] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.798234] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.806633] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.815025] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.823424] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.831815] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.840215] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.848612] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.857010] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.865399] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.873795] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.882185] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.890584] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.898974] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.907369] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.915766] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.924166] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.932555] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.940956] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.949344] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.957743] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.966131] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.974537] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.982932] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.991335] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 45.999727] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.008126] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.016521] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.024918] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.033309] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.041709] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.050107] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.058511] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.066904] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.075307] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.083700] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.092103] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.100497] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.108907] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.117301] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.125706] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.134097] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.142501] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.150890] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.159289] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.167679] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.176075] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.184465] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.192853] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.201245] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.209641] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.218038] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.226439] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.234827] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.243228] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.251624] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.260016] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.268414] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.276819] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.285214] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.293613] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.302002] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.310401] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.318791] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.327193] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.335589] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.343991] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.352387] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.360789] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.369184] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.377586] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.385982] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.394379] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.402778] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.411172] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.419560] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.427962] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.436357] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.444748] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.453139] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.461540] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.469933] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.478327] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.486720] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.495112] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.503510] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.511918] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.520315] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.528717] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.537107] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.545496] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.553887] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.562278] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.570669] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.579075] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.587478] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.595876] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.604264] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.612664] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.621053] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.629448] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.637843] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.646242] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.654637] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.663032] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.671431] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.679831] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.688219] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.696621] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.705009] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.713398] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.721790] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.730188] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.738581] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.746982] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.755376] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.763775] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.772168] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.780563] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.788955] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.797351] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.805749] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.814147] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.822538] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.830937] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.839331] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.847737] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.856145] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.864548] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.872952] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.881357] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.889766] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.898176] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.906578] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.914992] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.923397] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.931799] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.940194] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.948623] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.957022] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.965417] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.973816] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.982224] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.990618] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 46.999021] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.007418] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.015813] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.024216] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.032689] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.041105] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.049510] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.057925] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.066346] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.074750] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.083153] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.091579] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.100001] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.108417] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.116849] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.125268] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.133704] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.142118] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.150553] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.158963] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.167379] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.175781] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.184181] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.192590] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.201007] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.209412] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.217844] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.226255] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.234687] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.243105] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.251531] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.259951] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.268364] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.276769] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.285182] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.293585] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.302000] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.310402] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.318837] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.327281] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.335719] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.344145] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.352592] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.361021] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.369484] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.377947] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.386411] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.394871] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.403382] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.411955] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.420508] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.429064] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.437617] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.446166] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.454624] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.463073] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.471623] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.480177] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.488643] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.497134] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.505611] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.514107] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.522602] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.531158] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.539672] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.548161] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.556651] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.565183] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.573673] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.582163] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.590662] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.599150] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.607650] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.616139] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.624625] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.633127] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.641622] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.650116] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.658614] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.667096] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.675576] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.684059] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.692550] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.701042] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.709536] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.718025] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.726513] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.735003] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.743485] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.751987] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.760513] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.769021] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 47.777505] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 48.217891] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 48.228152] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 48.238767] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 48.249664] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 48.259869] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 48.269995] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 48.280476] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 48.290684] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 48.300827] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 48.310978] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 48.321357] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 48.332028] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 48.342501] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 48.353012] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 48.363175] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 48.373801] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 48.383948] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 48.394454] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 48.404637] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 48.414834] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 48.425408] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 48.435971] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 48.446247] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 48.456951] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 48.467127] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 48.477294] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 48.487510] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 48.498212] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 48.511442] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 48.521677] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 48.532729] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 48.542991] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 48.553279] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 48.563882] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 48.572689] device-mapper: multipath service-time: version 0.3.0 loaded [ 48.574392] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 48.576247] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 48.578211] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 48.580708] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 48.582605] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 48.584569] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 48.586436] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 48.588222] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 48.589993] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 48.591833] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 48.593614] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 48.595456] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 48.597346] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 48.599331] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 48.601130] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 48.602982] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 48.604840] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 48.606677] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 48.608565] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 48.610351] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 48.612218] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 48.614363] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 48.616249] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 48.618045] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 48.619821] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 48.621577] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 49.048426] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 49.060261] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 49.072132] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 49.083936] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 49.095779] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 49.107670] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 49.119652] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 49.131849] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 49.143834] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 49.155698] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 49.167768] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 49.179693] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 49.191552] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 49.203474] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 49.215337] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 49.227264] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 49.239142] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 49.251060] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 49.262961] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 49.274922] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 49.286854] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 49.299552] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 49.311779] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 49.323747] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 49.335671] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 49.347594] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 49.359477] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 49.371415] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 49.383469] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 49.395364] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 49.407255] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 49.419169] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 49.431063] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 49.442955] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 49.454801] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 49.466794] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 49.478765] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 49.490767] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 49.502693] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 49.514825] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 49.527277] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 49.539233] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 49.551160] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 49.563179] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 49.575371] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 49.587356] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 49.599299] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 49.611435] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 49.623965] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 49.635984] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 49.647984] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 49.659943] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 49.671956] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 49.684033] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 49.695973] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 49.707996] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 49.720286] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 49.732216] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 49.744090] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 49.755982] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 50.201350] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 50.215067] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 50.228750] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 50.242468] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 50.256087] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 50.269784] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 50.283720] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 50.297362] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 50.311040] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 50.324625] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 50.338211] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 50.351845] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 50.365517] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 50.379256] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 50.392899] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 50.406584] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 50.420303] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 50.433990] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 50.448130] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 50.461781] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 50.475510] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 50.489254] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 50.502969] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 50.516911] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 50.531102] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 50.544727] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 50.558350] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 50.571972] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 50.585984] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 50.599781] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 50.613762] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 50.627493] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 50.641393] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 50.655193] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 50.668948] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 50.683268] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 50.697003] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 50.710871] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 50.724496] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 50.738509] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 50.752266] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 50.766026] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 50.779803] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 50.794612] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 50.808346] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 50.822199] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 50.835961] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 50.849809] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 50.863564] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 50.877289] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 50.891096] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 50.905228] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 50.919010] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 50.932948] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 50.947426] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 50.961404] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 50.975164] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 50.988850] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 51.002572] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 51.016245] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 51.484464] ses 0:0:0:0: Attached Enclosure device [ 51.489354] ses 0:0:61:0: Attached Enclosure device [ 51.494328] ses 0:0:122:0: Attached Enclosure device [ 51.499415] ses 0:0:183:0: Attached Enclosure device [ 51.504495] ses 0:0:244:0: Attached Enclosure device [ 52.358849] piix4_smbus 0000:00:14.0: SMBus Host Controller at 0xb00, revision 0 [ 52.366328] piix4_smbus 0000:00:14.0: Using register 0x2e for SMBus port selection [ 52.382694] ccp 0000:02:00.2: 3 command queues available [ 52.388174] ccp 0000:02:00.2: irq 238 for MSI/MSI-X [ 52.388192] ccp 0000:02:00.2: irq 239 for MSI/MSI-X [ 52.388290] ccp 0000:02:00.2: Queue 2 can access 4 LSB regions [ 52.394154] ccp 0000:02:00.2: Queue 3 can access 4 LSB regions [ 52.400032] ccp 0000:02:00.2: Queue 4 can access 4 LSB regions [ 52.405931] ccp 0000:02:00.2: Queue 0 gets LSB 4 [ 52.410591] ccp 0000:02:00.2: Queue 1 gets LSB 5 [ 52.415242] ccp 0000:02:00.2: Queue 2 gets LSB 6 [ 52.431353] ccp 0000:02:00.2: enabled [ 52.435476] ccp 0000:03:00.1: 5 command queues available [ 52.440941] ccp 0000:03:00.1: irq 241 for MSI/MSI-X [ 52.441001] ccp 0000:03:00.1: Queue 0 can access 7 LSB regions [ 52.446929] ccp 0000:03:00.1: Queue 1 can access 7 LSB regions [ 52.452862] ccp 0000:03:00.1: Queue 2 can access 7 LSB regions [ 52.458774] ccp 0000:03:00.1: Queue 3 can access 7 LSB regions [ 52.464678] ccp 0000:03:00.1: Queue 4 can access 7 LSB regions [ 52.470569] ccp 0000:03:00.1: Queue 0 gets LSB 1 [ 52.475235] ccp 0000:03:00.1: Queue 1 gets LSB 2 [ 52.479873] ccp 0000:03:00.1: Queue 2 gets LSB 3 [ 52.484500] ccp 0000:03:00.1: Queue 3 gets LSB 4 [ 52.489146] ccp 0000:03:00.1: Queue 4 gets LSB 5 [ 52.505291] ccp 0000:03:00.1: enabled [ 52.510760] ccp 0000:41:00.2: 3 command queues available [ 52.516190] ccp 0000:41:00.2: irq 243 for MSI/MSI-X [ 52.516202] ccp 0000:41:00.2: irq 244 for MSI/MSI-X [ 52.516269] ccp 0000:41:00.2: Queue 2 can access 4 LSB regions [ 52.522116] ccp 0000:41:00.2: Queue 3 can access 4 LSB regions [ 52.527952] ccp 0000:41:00.2: Queue 4 can access 4 LSB regions [ 52.533803] ccp 0000:41:00.2: Queue 0 gets LSB 4 [ 52.538433] ccp 0000:41:00.2: Queue 1 gets LSB 5 [ 52.543061] ccp 0000:41:00.2: Queue 2 gets LSB 6 [ 52.548758] ccp 0000:41:00.2: enabled [ 52.552764] ccp 0000:42:00.1: 5 command queues available [ 52.558162] ccp 0000:42:00.1: irq 246 for MSI/MSI-X [ 52.558225] ccp 0000:42:00.1: Queue 0 can access 7 LSB regions [ 52.564068] ccp 0000:42:00.1: Queue 1 can access 7 LSB regions [ 52.569910] ccp 0000:42:00.1: Queue 2 can access 7 LSB regions [ 52.575757] ccp 0000:42:00.1: Queue 3 can access 7 LSB regions [ 52.581605] ccp 0000:42:00.1: Queue 4 can access 7 LSB regions [ 52.587460] ccp 0000:42:00.1: Queue 0 gets LSB 1 [ 52.592097] ccp 0000:42:00.1: Queue 1 gets LSB 2 [ 52.596730] ccp 0000:42:00.1: Queue 2 gets LSB 3 [ 52.601364] ccp 0000:42:00.1: Queue 3 gets LSB 4 [ 52.605993] ccp 0000:42:00.1: Queue 4 gets LSB 5 [ 52.612464] ccp 0000:42:00.1: enabled [ 52.616424] ccp 0000:85:00.2: 3 command queues available [ 52.621826] ccp 0000:85:00.2: irq 248 for MSI/MSI-X [ 52.621844] ccp 0000:85:00.2: irq 249 for MSI/MSI-X [ 52.621913] ccp 0000:85:00.2: Queue 2 can access 4 LSB regions [ 52.627766] ccp 0000:85:00.2: Queue 3 can access 4 LSB regions [ 52.633620] ccp 0000:85:00.2: Queue 4 can access 4 LSB regions [ 52.639460] ccp 0000:85:00.2: Queue 0 gets LSB 4 [ 52.644084] ccp 0000:85:00.2: Queue 1 gets LSB 5 [ 52.648710] ccp 0000:85:00.2: Queue 2 gets LSB 6 [ 52.654498] ccp 0000:85:00.2: enabled [ 52.658463] ccp 0000:86:00.1: 5 command queues available [ 52.663866] ccp 0000:86:00.1: irq 251 for MSI/MSI-X [ 52.663972] ccp 0000:86:00.1: Queue 0 can access 7 LSB regions [ 52.669812] ccp 0000:86:00.1: Queue 1 can access 7 LSB regions [ 52.675653] ccp 0000:86:00.1: Queue 2 can access 7 LSB regions [ 52.681497] ccp 0000:86:00.1: Queue 3 can access 7 LSB regions [ 52.687343] ccp 0000:86:00.1: Queue 4 can access 7 LSB regions [ 52.693192] ccp 0000:86:00.1: Queue 0 gets LSB 1 [ 52.697824] ccp 0000:86:00.1: Queue 1 gets LSB 2 [ 52.702450] ccp 0000:86:00.1: Queue 2 gets LSB 3 [ 52.707084] ccp 0000:86:00.1: Queue 3 gets LSB 4 [ 52.711718] ccp 0000:86:00.1: Queue 4 gets LSB 5 [ 52.721407] ccp 0000:86:00.1: enabled [ 52.725324] ccp 0000:c2:00.2: 3 command queues available [ 52.730720] ccp 0000:c2:00.2: irq 253 for MSI/MSI-X [ 52.730736] ccp 0000:c2:00.2: irq 254 for MSI/MSI-X [ 52.730844] ccp 0000:c2:00.2: Queue 2 can access 4 LSB regions [ 52.736693] ccp 0000:c2:00.2: Queue 3 can access 4 LSB regions [ 52.742544] ccp 0000:c2:00.2: Queue 4 can access 4 LSB regions [ 52.748394] ccp 0000:c2:00.2: Queue 0 gets LSB 4 [ 52.753022] ccp 0000:c2:00.2: Queue 1 gets LSB 5 [ 52.757646] ccp 0000:c2:00.2: Queue 2 gets LSB 6 [ 52.763833] ccp 0000:c2:00.2: enabled [ 52.767840] ccp 0000:c3:00.1: 5 command queues available [ 52.773251] ccp 0000:c3:00.1: irq 256 for MSI/MSI-X [ 52.773350] ccp 0000:c3:00.1: Queue 0 can access 7 LSB regions [ 52.779197] ccp 0000:c3:00.1: Queue 1 can access 7 LSB regions [ 52.785041] ccp 0000:c3:00.1: Queue 2 can access 7 LSB regions [ 52.790892] ccp 0000:c3:00.1: Queue 3 can access 7 LSB regions [ 52.796741] ccp 0000:c3:00.1: Queue 4 can access 7 LSB regions [ 52.802589] ccp 0000:c3:00.1: Queue 0 gets LSB 1 [ 52.807232] ccp 0000:c3:00.1: Queue 1 gets LSB 2 [ 52.807235] ccp 0000:c3:00.1: Queue 2 gets LSB 3 [ 52.807241] ccp 0000:c3:00.1: Queue 3 gets LSB 4 [ 52.807242] ccp 0000:c3:00.1: Queue 4 gets LSB 5 [ 52.818651] ccp 0000:c3:00.1: enabled [ 52.834103] input: PC Speaker as /devices/platform/pcspkr/input/input2 [ 52.940377] cryptd: max_cpu_qlen set to 1000 [ 52.967866] AVX2 version of gcm_enc/dec engaged. [ 52.972507] AES CTR mode by8 optimization enabled [ 52.981424] alg: No test for __gcm-aes-aesni (__driver-gcm-aes-aesni) [ 52.988045] alg: No test for __generic-gcm-aes-aesni (__driver-generic-gcm-aes-aesni) [ 53.071969] kvm: Nested Paging enabled [ 53.081658] MCE: In-kernel MCE decoding enabled. [ 53.093465] AMD64 EDAC driver v3.4.0 [ 53.097097] EDAC amd64: DRAM ECC enabled. [ 53.101121] EDAC amd64: F17h detected (node 0). [ 53.105706] EDAC MC: UMC0 chip selects: [ 53.105709] EDAC amd64: MC: 0: 0MB 1: 0MB [ 53.110435] EDAC amd64: MC: 2: 32767MB 3: 32767MB [ 53.115152] EDAC amd64: MC: 4: 0MB 5: 0MB [ 53.119867] EDAC amd64: MC: 6: 0MB 7: 0MB [ 53.124596] EDAC MC: UMC1 chip selects: [ 53.124599] EDAC amd64: MC: 0: 0MB 1: 0MB [ 53.129322] EDAC amd64: MC: 2: 32767MB 3: 32767MB [ 53.134045] EDAC amd64: MC: 4: 0MB 5: 0MB [ 53.138762] EDAC amd64: MC: 6: 0MB 7: 0MB [ 53.143479] EDAC amd64: using x8 syndromes. [ 53.147670] EDAC amd64: MCT channel count: 2 [ 53.157372] EDAC MC0: Giving out device to 'amd64_edac' 'F17h': DEV 0000:00:18.3 [ 53.164818] EDAC amd64: DRAM ECC enabled. [ 53.168857] EDAC amd64: F17h detected (node 1). [ 53.173468] EDAC MC: UMC0 chip selects: [ 53.173472] EDAC amd64: MC: 0: 0MB 1: 0MB [ 53.178197] EDAC amd64: MC: 2: 32767MB 3: 32767MB [ 53.182910] EDAC amd64: MC: 4: 0MB 5: 0MB [ 53.187623] EDAC amd64: MC: 6: 0MB 7: 0MB [ 53.192342] EDAC MC: UMC1 chip selects: [ 53.192344] EDAC amd64: MC: 0: 0MB 1: 0MB [ 53.197052] EDAC amd64: MC: 2: 32767MB 3: 32767MB [ 53.201765] EDAC amd64: MC: 4: 0MB 5: 0MB [ 53.206474] EDAC amd64: MC: 6: 0MB 7: 0MB [ 53.211190] EDAC amd64: using x8 syndromes. [ 53.215385] EDAC amd64: MCT channel count: 2 [ 53.223293] EDAC MC1: Giving out device to 'amd64_edac' 'F17h': DEV 0000:00:19.3 [ 53.230710] EDAC amd64: DRAM ECC enabled. [ 53.234733] EDAC amd64: F17h detected (node 2). [ 53.239319] EDAC MC: UMC0 chip selects: [ 53.239322] EDAC amd64: MC: 0: 0MB 1: 0MB [ 53.244038] EDAC amd64: MC: 2: 32767MB 3: 32767MB [ 53.248752] EDAC amd64: MC: 4: 0MB 5: 0MB [ 53.253467] EDAC amd64: MC: 6: 0MB 7: 0MB [ 53.258186] EDAC MC: UMC1 chip selects: [ 53.258190] EDAC amd64: MC: 0: 0MB 1: 0MB [ 53.262908] EDAC amd64: MC: 2: 32767MB 3: 32767MB [ 53.267618] EDAC amd64: MC: 4: 0MB 5: 0MB [ 53.272332] EDAC amd64: MC: 6: 0MB 7: 0MB [ 53.277046] EDAC amd64: using x8 syndromes. [ 53.281242] EDAC amd64: MCT channel count: 2 [ 53.289552] EDAC MC2: Giving out device to 'amd64_edac' 'F17h': DEV 0000:00:1a.3 [ 53.296963] EDAC amd64: DRAM ECC enabled. [ 53.300986] EDAC amd64: F17h detected (node 3). [ 53.305594] EDAC MC: UMC0 chip selects: [ 53.305599] EDAC amd64: MC: 0: 0MB 1: 0MB [ 53.310313] EDAC amd64: MC: 2: 32767MB 3: 32767MB [ 53.315030] EDAC amd64: MC: 4: 0MB 5: 0MB [ 53.319752] EDAC amd64: MC: 6: 0MB 7: 0MB [ 53.324477] EDAC MC: UMC1 chip selects: [ 53.324480] EDAC amd64: MC: 0: 0MB 1: 0MB [ 53.329201] EDAC amd64: MC: 2: 32767MB 3: 32767MB [ 53.333925] EDAC amd64: MC: 4: 0MB 5: 0MB [ 53.338647] EDAC amd64: MC: 6: 0MB 7: 0MB [ 53.343362] EDAC amd64: using x8 syndromes. [ 53.347553] EDAC amd64: MCT channel count: 2 [ 53.354312] EDAC MC3: Giving out device to 'amd64_edac' 'F17h': DEV 0000:00:1b.3 [ 53.361867] EDAC PCI0: Giving out device to module 'amd64_edac' controller 'EDAC PCI controller': DEV '0000:00:18.0' (POLLED) [ 53.878644] dcdbas dcdbas: Dell Systems Management Base Driver (version 5.6.0-3.3) [ 105.345256] Adding 4194300k swap on /dev/sdig3. Priority:-2 extents:1 across:4194300k FS [ 105.360300] FAT-fs (sdig1): Volume was not properly unmounted. Some data may be corrupt. Please run fsck. [ 105.398760] type=1305 audit(1555944940.902:3): audit_pid=71810 old=0 auid=4294967295 ses=4294967295 res=1 [ 105.421415] RPC: Registered named UNIX socket transport module. [ 105.427607] RPC: Registered udp transport module. [ 105.433698] RPC: Registered tcp transport module. [ 105.439789] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 105.742927] Request for unknown module key 'Mellanox Technologies signing key: 61feb074fc7292f958419386ffdd9d5ca999e403' err -11 [ 105.823113] Request for unknown module key 'Mellanox Technologies signing key: 61feb074fc7292f958419386ffdd9d5ca999e403' err -11 [ 105.877824] Request for unknown module key 'Mellanox Technologies signing key: 61feb074fc7292f958419386ffdd9d5ca999e403' err -11 [ 106.007317] Request for unknown module key 'Mellanox Technologies signing key: 61feb074fc7292f958419386ffdd9d5ca999e403' err -11 [ 106.055103] Request for unknown module key 'Mellanox Technologies signing key: 61feb074fc7292f958419386ffdd9d5ca999e403' err -11 [ 106.138448] Request for unknown module key 'Mellanox Technologies signing key: 61feb074fc7292f958419386ffdd9d5ca999e403' err -11 [ 106.152538] Request for unknown module key 'Mellanox Technologies signing key: 61feb074fc7292f958419386ffdd9d5ca999e403' err -11 [ 106.168962] mlx5_core 0000:84:00.0: slow_pci_heuristic:5202:(pid 72115): Max link speed = 100000, PCI BW = 126016 [ 106.179314] mlx5_core 0000:84:00.0: MLX5E: StrdRq(0) RqSz(1024) StrdSz(64) RxCqeCmprss(0) [ 106.187499] mlx5_core 0000:84:00.0: MLX5E: StrdRq(0) RqSz(1024) StrdSz(64) RxCqeCmprss(0) [ 106.322982] Request for unknown module key 'Mellanox Technologies signing key: 61feb074fc7292f958419386ffdd9d5ca999e403' err -11 [ 106.335951] Request for unknown module key 'Mellanox Technologies signing key: 61feb074fc7292f958419386ffdd9d5ca999e403' err -11 [ 106.385126] Request for unknown module key 'Mellanox Technologies signing key: 61feb074fc7292f958419386ffdd9d5ca999e403' err -11 [ 106.433549] Request for unknown module key 'Mellanox Technologies signing key: 61feb074fc7292f958419386ffdd9d5ca999e403' err -11 [ 106.724693] tg3 0000:81:00.0: irq 257 for MSI/MSI-X [ 106.724707] tg3 0000:81:00.0: irq 258 for MSI/MSI-X [ 106.724718] tg3 0000:81:00.0: irq 259 for MSI/MSI-X [ 106.724728] tg3 0000:81:00.0: irq 260 for MSI/MSI-X [ 106.724737] tg3 0000:81:00.0: irq 261 for MSI/MSI-X [ 106.850902] IPv6: ADDRCONF(NETDEV_UP): em1: link is not ready [ 110.337530] tg3 0000:81:00.0 em1: Link is up at 1000 Mbps, full duplex [ 110.344065] tg3 0000:81:00.0 em1: Flow control is on for TX and on for RX [ 110.350859] tg3 0000:81:00.0 em1: EEE is enabled [ 110.355493] IPv6: ADDRCONF(NETDEV_CHANGE): em1: link becomes ready [ 111.087621] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready [ 111.199778] IPv6: ADDRCONF(NETDEV_CHANGE): ib0: link becomes ready [ 115.336900] FS-Cache: Loaded [ 115.366707] FS-Cache: Netfs 'nfs' registered for caching [ 115.376810] Key type dns_resolver registered [ 115.405044] NFS: Registering the id_resolver key type [ 115.410109] Key type id_resolver registered [ 115.414301] Key type id_legacy registered [ 128.373756] LNet: HW NUMA nodes: 4, HW CPU cores: 48, npartitions: 4 [ 128.381431] alg: No test for adler32 (adler32-zlib) [ 129.190319] Lustre: Lustre: Build Version: 2.12.0.pl7 [ 129.322936] LNet: Using FastReg for registration [ 129.337906] LNet: Added LNI 10.0.10.106@o2ib7 [8/256/0/180] [ 136.254819] md: md1 stopped. [ 136.286223] async_tx: api initialized (async) [ 136.292619] xor: automatically using best checksumming function: [ 136.307685] avx : 9580.000 MB/sec [ 136.340686] raid6: sse2x1 gen() 6093 MB/s [ 136.361685] raid6: sse2x2 gen() 11261 MB/s [ 136.382686] raid6: sse2x4 gen() 12890 MB/s [ 136.403687] raid6: avx2x1 gen() 14164 MB/s [ 136.424688] raid6: avx2x2 gen() 18742 MB/s [ 136.445687] raid6: avx2x4 gen() 18761 MB/s [ 136.449965] raid6: using algorithm avx2x4 gen() (18761 MB/s) [ 136.455625] raid6: using avx2x2 recovery algorithm [ 136.477185] md/raid:md1: not clean -- starting background reconstruction [ 136.483989] md/raid:md1: device dm-13 operational as raid disk 0 [ 136.490012] md/raid:md1: device dm-19 operational as raid disk 9 [ 136.496026] md/raid:md1: device dm-49 operational as raid disk 8 [ 136.502039] md/raid:md1: device dm-78 operational as raid disk 7 [ 136.508054] md/raid:md1: device dm-68 operational as raid disk 6 [ 136.514068] md/raid:md1: device dm-11 operational as raid disk 5 [ 136.520081] md/raid:md1: device dm-100 operational as raid disk 4 [ 136.526175] md/raid:md1: device dm-29 operational as raid disk 3 [ 136.532188] md/raid:md1: device dm-116 operational as raid disk 2 [ 136.538285] md/raid:md1: device dm-59 operational as raid disk 1 [ 136.545315] md/raid:md1: raid level 6 active with 10 out of 10 devices, algorithm 2 [ 136.597189] md1: detected capacity change from 0 to 64011422924800 [ 136.603453] md: resync of RAID array md1 [ 136.613787] md: md11 stopped. [ 136.634563] md/raid:md11: not clean -- starting background reconstruction [ 136.641513] md/raid:md11: device dm-97 operational as raid disk 0 [ 136.647621] md/raid:md11: device dm-44 operational as raid disk 9 [ 136.653753] md/raid:md11: device dm-40 operational as raid disk 8 [ 136.659853] md/raid:md11: device dm-88 operational as raid disk 7 [ 136.665964] md/raid:md11: device dm-113 operational as raid disk 6 [ 136.672170] md/raid:md11: device dm-107 operational as raid disk 5 [ 136.678381] md/raid:md11: device dm-83 operational as raid disk 4 [ 136.684508] md/raid:md11: device dm-98 operational as raid disk 3 [ 136.690626] md/raid:md11: device dm-62 operational as raid disk 2 [ 136.696727] md/raid:md11: device dm-91 operational as raid disk 1 [ 136.703514] md/raid:md11: raid level 6 active with 10 out of 10 devices, algorithm 2 [ 136.740683] md11: detected capacity change from 0 to 64011422924800 [ 136.747116] md: resync of RAID array md11 [ 136.749666] md: md5 stopped. [ 136.773724] md/raid:md5: not clean -- starting background reconstruction [ 136.780560] md/raid:md5: device dm-30 operational as raid disk 0 [ 136.786573] md/raid:md5: device dm-47 operational as raid disk 9 [ 136.792611] md/raid:md5: device dm-21 operational as raid disk 8 [ 136.798628] md/raid:md5: device dm-63 operational as raid disk 7 [ 136.804645] md/raid:md5: device dm-85 operational as raid disk 6 [ 136.810662] md/raid:md5: device dm-14 operational as raid disk 5 [ 136.816703] md/raid:md5: device dm-12 operational as raid disk 4 [ 136.822719] md/raid:md5: device dm-9 operational as raid disk 3 [ 136.828648] md/raid:md5: device dm-57 operational as raid disk 2 [ 136.834666] md/raid:md5: device dm-69 operational as raid disk 1 [ 136.841481] md/raid:md5: raid level 6 active with 10 out of 10 devices, algorithm 2 [ 136.876416] md5: detected capacity change from 0 to 64011422924800 [ 136.882747] md: resync of RAID array md5 [ 136.893221] md: md7 stopped. [ 136.921713] md/raid:md7: not clean -- starting background reconstruction [ 136.928598] md/raid:md7: device dm-79 operational as raid disk 0 [ 136.934654] md/raid:md7: device dm-28 operational as raid disk 9 [ 136.940668] md/raid:md7: device dm-34 operational as raid disk 8 [ 136.946680] md/raid:md7: device dm-103 operational as raid disk 7 [ 136.952790] md/raid:md7: device dm-117 operational as raid disk 6 [ 136.958894] md/raid:md7: device dm-108 operational as raid disk 5 [ 136.964994] md/raid:md7: device dm-70 operational as raid disk 4 [ 136.971009] md/raid:md7: device dm-82 operational as raid disk 3 [ 136.977025] md/raid:md7: device dm-102 operational as raid disk 2 [ 136.983128] md/raid:md7: device dm-51 operational as raid disk 1 [ 136.990040] md/raid:md7: raid level 6 active with 10 out of 10 devices, algorithm 2 [ 137.026354] md7: detected capacity change from 0 to 64011422924800 [ 137.033505] md: resync of RAID array md7 [ 137.041776] md: md3 stopped. [ 137.073293] md/raid:md3: not clean -- starting background reconstruction [ 137.080130] md/raid:md3: device dm-86 operational as raid disk 0 [ 137.086148] md/raid:md3: device dm-23 operational as raid disk 9 [ 137.092158] md/raid:md3: device dm-22 operational as raid disk 8 [ 137.098180] md/raid:md3: device dm-71 operational as raid disk 7 [ 137.104200] md/raid:md3: device dm-17 operational as raid disk 6 [ 137.110211] md/raid:md3: device dm-6 operational as raid disk 5 [ 137.116145] md/raid:md3: device dm-7 operational as raid disk 4 [ 137.122077] md/raid:md3: device dm-64 operational as raid disk 3 [ 137.128091] md/raid:md3: device dm-25 operational as raid disk 2 [ 137.134112] md/raid:md3: device dm-75 operational as raid disk 1 [ 137.140815] md/raid:md3: raid level 6 active with 10 out of 10 devices, algorithm 2 [ 137.186758] md3: detected capacity change from 0 to 64011422924800 [ 137.193082] md: resync of RAID array md3 [ 137.211229] md: md9 stopped. [ 137.236571] md/raid:md9: not clean -- starting background reconstruction [ 137.243393] md/raid:md9: device dm-50 operational as raid disk 0 [ 137.249417] md/raid:md9: device dm-43 operational as raid disk 9 [ 137.255439] md/raid:md9: device dm-31 operational as raid disk 8 [ 137.261450] md/raid:md9: device dm-65 operational as raid disk 7 [ 137.267462] md/raid:md9: device dm-56 operational as raid disk 6 [ 137.273476] md/raid:md9: device dm-27 operational as raid disk 5 [ 137.279495] md/raid:md9: device dm-106 operational as raid disk 4 [ 137.285596] md/raid:md9: device dm-101 operational as raid disk 3 [ 137.291705] md/raid:md9: device dm-89 operational as raid disk 2 [ 137.297723] md/raid:md9: device dm-38 operational as raid disk 1 [ 137.304851] md/raid:md9: raid level 6 active with 10 out of 10 devices, algorithm 2 [ 137.342376] md9: detected capacity change from 0 to 64011422924800 [ 137.348664] md: resync of RAID array md9 [ 137.470094] LDISKFS-fs warning (device md1): ldiskfs_multi_mount_protect:321: MMP interval 42 higher than expected, please wait. [ 137.686285] LDISKFS-fs warning (device md11): ldiskfs_multi_mount_protect:321: MMP interval 42 higher than expected, please wait. [ 137.944835] LDISKFS-fs warning (device md5): ldiskfs_multi_mount_protect:321: MMP interval 42 higher than expected, please wait. [ 138.044656] LDISKFS-fs warning (device md7): ldiskfs_multi_mount_protect:321: MMP interval 42 higher than expected, please wait. [ 138.352238] LDISKFS-fs warning (device md3): ldiskfs_multi_mount_protect:321: MMP interval 42 higher than expected, please wait. [ 138.662701] LDISKFS-fs warning (device md9): ldiskfs_multi_mount_protect:321: MMP interval 42 higher than expected, please wait. [ 161.126717] md: md7: resync done. [ 161.972942] md: md11: resync done. [ 168.432094] md: md5: resync done. [ 175.638814] md: md3: resync done. [ 180.305917] LDISKFS-fs (md1): file extents enabled, maximum tree depth=5 [ 180.547071] LDISKFS-fs (md11): file extents enabled, maximum tree depth=5 [ 180.742720] LDISKFS-fs (md5): file extents enabled, maximum tree depth=5 [ 180.852695] LDISKFS-fs (md7): file extents enabled, maximum tree depth=5 [ 181.129703] LDISKFS-fs (md3): file extents enabled, maximum tree depth=5 [ 181.423968] LDISKFS-fs (md9): file extents enabled, maximum tree depth=5 [ 183.438482] LDISKFS-fs (md5): recovery complete [ 183.463955] LDISKFS-fs (md5): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 183.899279] LDISKFS-fs (md7): recovery complete [ 183.923184] LDISKFS-fs (md7): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 183.979121] LDISKFS-fs (md3): recovery complete [ 184.025066] LDISKFS-fs (md3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 184.341707] LDISKFS-fs (md11): recovery complete [ 184.360404] LDISKFS-fs (md11): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 184.503045] LDISKFS-fs (md9): recovery complete [ 184.835671] LDISKFS-fs (md9): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 184.901866] LDISKFS-fs (md1): recovery complete [ 184.918605] LDISKFS-fs (md1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 188.054521] LNet: 74195:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 10.0.10.52@o2ib7: 0 seconds [ 188.073443] LustreError: 137-5: fir-OST0019_UUID: not available for connect from 10.8.25.6@o2ib6 (no target). If you are running an HA pair check that the target is mounted on the other server. [ 188.090641] LustreError: Skipped 3 previous similar messages [ 188.445807] Lustre: fir-OST001d: Not available for connect from 10.8.2.24@o2ib6 (not set up) [ 188.576945] LustreError: 137-5: fir-OST0019_UUID: not available for connect from 10.8.8.28@o2ib6 (no target). If you are running an HA pair check that the target is mounted on the other server. [ 188.594185] LustreError: Skipped 41 previous similar messages [ 189.085855] Lustre: fir-OST001d: Not available for connect from 10.8.26.29@o2ib6 (not set up) [ 189.094412] Lustre: Skipped 14 previous similar messages [ 189.581053] LustreError: 137-5: fir-OST001f_UUID: not available for connect from 10.8.17.12@o2ib6 (no target). If you are running an HA pair check that the target is mounted on the other server. [ 189.598366] LustreError: Skipped 79 previous similar messages [ 191.636665] LustreError: 137-5: fir-OST0019_UUID: not available for connect from 10.9.104.56@o2ib4 (no target). If you are running an HA pair check that the target is mounted on the other server. [ 191.654070] LustreError: Skipped 191 previous similar messages [ 196.054620] LNet: 74195:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 10.0.10.52@o2ib7: 1 seconds [ 197.054622] LNet: 74195:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 10.0.10.52@o2ib7: 2 seconds [ 198.944719] LustreError: 137-5: fir-OST0019_UUID: not available for connect from 10.9.106.3@o2ib4 (no target). If you are running an HA pair check that the target is mounted on the other server. [ 198.962042] LustreError: Skipped 95 previous similar messages [ 199.054647] LNet: 74195:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 10.0.10.52@o2ib7: 4 seconds [ 199.064731] LNet: 74195:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Skipped 1 previous similar message [ 199.076547] Lustre: fir-OST001d: Imperative Recovery enabled, recovery window shrunk from 300-900 down to 150-900 [ 199.104417] Lustre: fir-OST001d: Will be in recovery for at least 2:30, or until 1325 clients reconnect [ 199.113912] Lustre: fir-OST001d: Connection restored to (at 10.8.9.9@o2ib6) [ 199.634800] md: md9: resync done. [ 200.295193] Lustre: fir-OST001d: Connection restored to (at 10.9.112.4@o2ib4) [ 203.054690] LNet: 74195:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 10.0.10.52@o2ib7: 8 seconds [ 203.064776] LNet: 74195:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Skipped 2 previous similar messages [ 204.057006] Lustre: fir-OST001b: Imperative Recovery enabled, recovery window shrunk from 300-900 down to 150-900 [ 204.086374] Lustre: fir-OST001d: Connection restored to 11299474-a416-1dfd-8689-a40297f465a7 (at 10.8.24.2@o2ib6) [ 204.086424] Lustre: fir-OST001b: Will be in recovery for at least 2:30, or until 1325 clients reconnect [ 204.106051] Lustre: Skipped 10 previous similar messages [ 206.090363] Lustre: fir-OST001d: Connection restored to d3da365a-e12b-dd95-2805-14a34f48c77c (at 10.9.102.70@o2ib4) [ 206.100797] Lustre: Skipped 968 previous similar messages [ 206.828492] md: md1: resync done. [ 207.027069] LustreError: 137-5: fir-OST0019_UUID: not available for connect from 10.9.102.47@o2ib4 (no target). If you are running an HA pair check that the target is mounted on the other server. [ 207.044435] LustreError: Skipped 31 previous similar messages [ 209.057778] Lustre: fir-OST001f: Imperative Recovery enabled, recovery window shrunk from 300-900 down to 150-900 [ 209.074429] Lustre: fir-OST001f: Will be in recovery for at least 2:30, or until 1325 clients reconnect [ 209.466678] Lustre: fir-OST0023: Not available for connect from 10.9.104.61@o2ib4 (not set up) [ 209.475293] Lustre: Skipped 5 previous similar messages [ 210.267382] Lustre: fir-OST001b: Connection restored to b31dbaa4-9781-3e55-1a6f-63d7b5b1ec5b (at 10.9.107.63@o2ib4) [ 210.277816] Lustre: Skipped 1626 previous similar messages [ 215.054793] LNet: 74195:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 10.0.10.52@o2ib7: 0 seconds [ 215.064877] LNet: 74195:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Skipped 5 previous similar messages [ 218.266821] Lustre: fir-OST001f: Connection restored to 5f4e0d07-90a4-264a-e1e1-ca0322e29d90 (at 10.8.20.17@o2ib6) [ 218.277176] Lustre: Skipped 1086 previous similar messages [ 223.058001] Lustre: fir-OST0023: Imperative Recovery enabled, recovery window shrunk from 300-900 down to 150-900 [ 223.579975] Lustre: fir-OST0023: Will be in recovery for at least 2:30, or until 1325 clients reconnect [ 223.580031] LustreError: 137-5: fir-OST0021_UUID: not available for connect from 10.9.106.70@o2ib4 (no target). If you are running an HA pair check that the target is mounted on the other server. [ 223.580033] LustreError: Skipped 208 previous similar messages [ 228.057221] Lustre: fir-OST0019: Imperative Recovery enabled, recovery window shrunk from 300-900 down to 150-900 [ 228.070424] Lustre: fir-OST0019: Will be in recovery for at least 2:30, or until 1325 clients reconnect [ 228.406267] Lustre: fir-OST0021: Not available for connect from 10.8.27.3@o2ib6 (not set up) [ 228.414712] Lustre: Skipped 1 previous similar message [ 231.054974] LNet: 74195:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 10.0.10.52@o2ib7: 8 seconds [ 231.065061] LNet: 74195:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Skipped 8 previous similar messages [ 239.057378] Lustre: fir-OST0021: Imperative Recovery enabled, recovery window shrunk from 300-900 down to 150-900 [ 239.099998] Lustre: fir-OST0021: Will be in recovery for at least 2:30, or until 1325 clients reconnect [ 239.109436] Lustre: fir-OST0021: Connection restored to b794c6d6-0e55-241b-2244-f3d71f34f2a7 (at 10.9.108.14@o2ib4) [ 239.119874] Lustre: Skipped 2872 previous similar messages [ 257.380976] Lustre: fir-OST0019: Recovery over after 0:30, of 1325 clients 1325 recovered and 0 were evicted. [ 258.074693] Lustre: fir-OST001b: Recovery over after 0:54, of 1325 clients 1325 recovered and 0 were evicted. [ 259.230280] Lustre: fir-OST0021: Recovery over after 0:21, of 1325 clients 1325 recovered and 0 were evicted. [ 259.240279] Lustre: Skipped 1 previous similar message [ 260.903046] LustreError: 78780:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0021: cli 9fc17c7e-3130-75f2-ae5f-e5dcb9408e38 claims 1097728 GRANT, real grant 1077248 [ 263.458047] Lustre: fir-OST0023: Recovery over after 0:40, of 1325 clients 1325 recovered and 0 were evicted. [ 263.467965] Lustre: Skipped 1 previous similar message [ 264.188940] LustreError: 11-0: fir-MDT0000-lwp-OST001f: operation quota_acquire to node 10.0.10.51@o2ib7 failed: rc = -11 [ 264.886166] LustreError: 11-0: fir-MDT0000-lwp-OST001b: operation quota_acquire to node 10.0.10.51@o2ib7 failed: rc = -11 [ 264.897120] LustreError: Skipped 5 previous similar messages [ 266.067586] LustreError: 11-0: fir-MDT0000-lwp-OST001b: operation quota_acquire to node 10.0.10.51@o2ib7 failed: rc = -11 [ 266.078566] LustreError: Skipped 4 previous similar messages [ 268.306301] LustreError: 11-0: fir-MDT0000-lwp-OST001b: operation quota_acquire to node 10.0.10.51@o2ib7 failed: rc = -11 [ 268.317257] LustreError: Skipped 17 previous similar messages [ 272.530006] LustreError: 11-0: fir-MDT0000-lwp-OST001b: operation quota_acquire to node 10.0.10.51@o2ib7 failed: rc = -11 [ 272.540965] LustreError: Skipped 30 previous similar messages [ 288.196954] LustreError: 11-0: fir-MDT0000-lwp-OST001b: operation quota_acquire to node 10.0.10.51@o2ib7 failed: rc = -11 [ 288.207916] LustreError: Skipped 27 previous similar messages [ 306.679895] Lustre: fir-OST0023: deleting orphan objects from 0x0:2783401 to 0x0:2783425 [ 306.679984] Lustre: fir-OST001b: deleting orphan objects from 0x0:2783708 to 0x0:2783713 [ 306.679987] Lustre: fir-OST001f: deleting orphan objects from 0x0:2782334 to 0x0:2782337 [ 306.849782] Lustre: fir-OST0023: deleting orphan objects from 0xd40000402:5704103 to 0xd40000402:5704385 [ 306.849788] Lustre: fir-OST0019: deleting orphan objects from 0x640000400:5703435 to 0x640000400:5703873 [ 306.849789] Lustre: fir-OST001d: deleting orphan objects from 0xcc0000402:5703731 to 0xcc0000402:5704001 [ 306.849801] Lustre: fir-OST001b: deleting orphan objects from 0xd00000402:5705478 to 0xd00000402:5705697 [ 306.849820] Lustre: fir-OST0021: deleting orphan objects from 0x980000402:5702965 to 0x980000402:5703169 [ 307.570232] Lustre: fir-OST001b: deleting orphan objects from 0xd00000401:9580832 to 0xd00000401:9580865 [ 307.570235] Lustre: fir-OST001d: deleting orphan objects from 0xcc0000401:9581062 to 0xcc0000401:9581089 [ 307.570235] Lustre: fir-OST001f: deleting orphan objects from 0x480000402:9584736 to 0x480000402:9584737 [ 307.585932] Lustre: fir-OST0019: deleting orphan objects from 0x640000402:9586527 to 0x640000402:9586529 [ 307.851608] Lustre: fir-OST001f: deleting orphan objects from 0x480000401:4149862 to 0x480000401:4149953 [ 307.853153] Lustre: fir-OST0019: deleting orphan objects from 0x640000401:4149413 to 0x640000401:4149505 [ 307.853483] Lustre: fir-OST0023: deleting orphan objects from 0xd40000400:4150251 to 0xd40000400:4150337 [ 307.853863] Lustre: fir-OST001d: deleting orphan objects from 0xcc0000400:4150409 to 0xcc0000400:4150497 [ 307.857401] Lustre: fir-OST0021: deleting orphan objects from 0x980000400:4150239 to 0x980000400:4150337 [ 307.869527] Lustre: fir-OST001b: deleting orphan objects from 0xd00000400:4149840 to 0xd00000400:4150049 [ 603.233969] Lustre: fir-OST0023: haven't heard from client 424c499c-bcf2-3c1f-c771-0484a4bdadc1 (at 10.8.27.23@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff97fd691fdc00, cur 1555945438 expire 1555945288 last 1555945211 [ 634.888102] Lustre: fir-OST0019: Connection restored to 424c499c-bcf2-3c1f-c771-0484a4bdadc1 (at 10.8.27.23@o2ib6) [ 634.898453] Lustre: Skipped 1349 previous similar messages [ 1656.248259] Lustre: fir-OST001b: haven't heard from client e0a71a15-121d-f0fe-7a3d-01a132335f67 (at 10.8.10.18@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff97fd6c2f1400, cur 1555946491 expire 1555946341 last 1555946264 [ 1656.269962] Lustre: Skipped 5 previous similar messages [ 2624.295511] Lustre: fir-OST0019: haven't heard from client 95d6e4a8-82c9-53d2-fff7-caed987a7512 (at 10.9.0.81@o2ib4) in 227 seconds. I think it's dead, and I am evicting it. exp ffff97fd67272000, cur 1555947459 expire 1555947309 last 1555947232 [ 2624.317131] Lustre: Skipped 5 previous similar messages [ 3133.264632] Lustre: fir-OST0019: haven't heard from client c459868e-2089-c4e4-35da-c3939eecca53 (at 10.9.115.12@o2ib4) in 227 seconds. I think it's dead, and I am evicting it. exp ffff97fd6729c000, cur 1555947968 expire 1555947818 last 1555947741 [ 3133.286429] Lustre: Skipped 5 previous similar messages [ 3394.268033] Lustre: fir-OST0021: haven't heard from client b1d17f8c-938d-7724-d5e1-3470a16d1bf6 (at 10.8.26.27@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff97fd65de6c00, cur 1555948229 expire 1555948079 last 1555948002 [ 3394.289763] Lustre: Skipped 23 previous similar messages [ 3521.210036] Lustre: fir-OST0019: Connection restored to e0a71a15-121d-f0fe-7a3d-01a132335f67 (at 10.8.10.18@o2ib6) [ 3521.220389] Lustre: Skipped 5 previous similar messages [ 3734.269969] Lustre: fir-OST001b: haven't heard from client 5c61912b-a2ea-8630-61c3-b600ac7cde6f (at 10.8.17.13@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff97fd6c24f400, cur 1555948569 expire 1555948419 last 1555948342 [ 3734.291726] Lustre: Skipped 5 previous similar messages [ 3874.803195] Lustre: fir-OST0019: Connection restored to b52d586b-60d8-dbcc-24fa-d88402eda757 (at 10.8.15.6@o2ib6) [ 3874.813465] Lustre: Skipped 5 previous similar messages [ 4050.769806] Lustre: fir-OST0019: Connection restored to 271592ba-f4e9-884a-94fc-decef6463b8a (at 10.8.14.4@o2ib6) [ 4050.780072] Lustre: Skipped 11 previous similar messages [ 4209.137222] Lustre: fir-OST0019: Connection restored to 95d6e4a8-82c9-53d2-fff7-caed987a7512 (at 10.9.0.81@o2ib4) [ 4209.147500] Lustre: Skipped 5 previous similar messages [ 4235.278705] Lustre: fir-OST001f: haven't heard from client 546dfefc-b028-0a42-4016-3d3d5820ed29 (at 10.9.112.8@o2ib4) in 227 seconds. I think it's dead, and I am evicting it. exp ffff980d2753c400, cur 1555949070 expire 1555948920 last 1555948843 [ 4235.300426] Lustre: Skipped 179 previous similar messages [ 4328.979524] Lustre: fir-OST0019: Connection restored to 220c5a2f-2274-34f0-c226-fa1f26d20160 (at 10.8.1.29@o2ib6) [ 4328.989795] Lustre: Skipped 5 previous similar messages [ 4519.662186] Lustre: fir-OST0019: Connection restored to a5220d8b-8270-82ff-94f4-284231bc9047 (at 10.8.15.5@o2ib6) [ 4519.672453] Lustre: Skipped 5 previous similar messages [ 4602.290235] Lustre: fir-OST001b: haven't heard from client d0b6551b-d67c-6b45-6084-d98d36826f26 (at 10.8.10.18@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff981dbbe3a400, cur 1555949437 expire 1555949287 last 1555949210 [ 4602.311971] Lustre: Skipped 17 previous similar messages [ 4880.908240] Lustre: fir-OST0019: Connection restored to 1dc95ac0-5804-8c3c-705f-9847acfb900b (at 10.9.102.17@o2ib4) [ 4880.918680] Lustre: Skipped 41 previous similar messages [ 5427.485376] Lustre: fir-OST0019: Connection restored to c78c87b0-3e83-8b60-f9be-1a89f999bb9f (at 10.8.9.1@o2ib6) [ 5427.495549] Lustre: Skipped 89 previous similar messages [ 5790.306669] Lustre: fir-OST0023: haven't heard from client 504d24a7-cb31-6425-64a8-6e735d4a011a (at 10.9.105.42@o2ib4) in 227 seconds. I think it's dead, and I am evicting it. exp ffff981ce5508400, cur 1555950625 expire 1555950475 last 1555950398 [ 5790.328468] Lustre: Skipped 5 previous similar messages [ 5872.480140] Lustre: 78334:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1555950700/real 1555950700] req@ffff9818ad5f5700 x1631526599472832/t0(0) o106->fir-OST0023@10.9.107.34@o2ib4:15/16 lens 296/280 e 0 to 1 dl 1555950707 ref 1 fl Rpc:X/0/ffffffff rc 0/-1 [ 5872.480142] Lustre: 78708:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1555950700/real 1555950700] req@ffff98154bd48000 x1631526599472816/t0(0) o106->fir-OST001b@10.9.107.34@o2ib4:15/16 lens 296/280 e 0 to 1 dl 1555950707 ref 1 fl Rpc:X/0/ffffffff rc 0/-1 [ 5872.534865] Lustre: 78334:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 2 previous similar messages [ 5879.480213] Lustre: 78708:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1555950707/real 1555950707] req@ffff98154bd48000 x1631526599472816/t0(0) o106->fir-OST001b@10.9.107.34@o2ib4:15/16 lens 296/280 e 0 to 1 dl 1555950714 ref 1 fl Rpc:X/2/ffffffff rc 0/-1 [ 5879.507555] Lustre: 78708:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 2 previous similar messages [ 5886.480296] Lustre: 77371:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1555950714/real 1555950714] req@ffff9818dc4a5400 x1631526599472800/t0(0) o106->fir-OST001d@10.9.107.34@o2ib4:15/16 lens 296/280 e 0 to 1 dl 1555950721 ref 1 fl Rpc:X/2/ffffffff rc 0/-1 [ 5886.507638] Lustre: 77371:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 2 previous similar messages [ 5893.481366] Lustre: 77066:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1555950721/real 1555950721] req@ffff98185493ad00 x1631526599472848/t0(0) o106->fir-OST001f@10.9.107.34@o2ib4:15/16 lens 296/280 e 0 to 1 dl 1555950728 ref 1 fl Rpc:X/2/ffffffff rc 0/-1 [ 5893.508741] Lustre: 77066:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 1 previous similar message [ 5900.517440] Lustre: 78708:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1555950728/real 1555950728] req@ffff98154bd48000 x1631526599472816/t0(0) o106->fir-OST001b@10.9.107.34@o2ib4:15/16 lens 296/280 e 0 to 1 dl 1555950735 ref 1 fl Rpc:X/2/ffffffff rc 0/-1 [ 5900.517443] Lustre: 77371:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1555950728/real 1555950728] req@ffff9818dc4a5400 x1631526599472800/t0(0) o106->fir-OST001d@10.9.107.34@o2ib4:15/16 lens 296/280 e 0 to 1 dl 1555950735 ref 1 fl Rpc:X/2/ffffffff rc 0/-1 [ 5900.517448] Lustre: 77371:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 1 previous similar message [ 5900.581844] Lustre: 78708:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 2 previous similar messages [ 5921.517663] Lustre: 77371:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1555950749/real 1555950749] req@ffff9818dc4a5400 x1631526599472800/t0(0) o106->fir-OST001d@10.9.107.34@o2ib4:15/16 lens 296/280 e 0 to 1 dl 1555950756 ref 1 fl Rpc:X/2/ffffffff rc 0/-1 [ 5921.545017] Lustre: 77371:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 10 previous similar messages [ 5956.519045] Lustre: 77066:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1555950784/real 1555950784] req@ffff98185493ad00 x1631526599472848/t0(0) o106->fir-OST001f@10.9.107.34@o2ib4:15/16 lens 296/280 e 0 to 1 dl 1555950791 ref 1 fl Rpc:X/2/ffffffff rc 0/-1 [ 5956.546406] Lustre: 77066:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 18 previous similar messages [ 6023.308255] Lustre: fir-OST001b: haven't heard from client 5604ae60-1785-6fb4-2172-d4e03846a918 (at 10.9.103.24@o2ib4) in 227 seconds. I think it's dead, and I am evicting it. exp ffff97fd6be89400, cur 1555950858 expire 1555950708 last 1555950631 [ 6023.330041] Lustre: Skipped 143 previous similar messages [ 6026.545794] Lustre: 78334:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1555950854/real 1555950854] req@ffff9818ad5f5700 x1631526599472832/t0(0) o106->fir-OST0023@10.9.107.34@o2ib4:15/16 lens 296/280 e 0 to 1 dl 1555950861 ref 1 fl Rpc:X/2/ffffffff rc 0/-1 [ 6026.573171] Lustre: 78334:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 39 previous similar messages [ 6030.344265] Lustre: fir-OST001f: haven't heard from client c06454c8-2573-c268-4ac4-3d68dc979d1a (at 10.8.2.18@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff980d2749f000, cur 1555950865 expire 1555950715 last 1555950638 [ 6030.365911] Lustre: Skipped 337 previous similar messages [ 6099.295268] Lustre: fir-OST001b: haven't heard from client e6c47303-ed85-d34d-4062-9831456dbdb7 (at 10.9.106.24@o2ib4) in 152 seconds. I think it's dead, and I am evicting it. exp ffff97fd6bd4c000, cur 1555950934 expire 1555950784 last 1555950782 [ 6099.317086] Lustre: Skipped 675 previous similar messages [ 6112.542336] Lustre: fir-OST0019: Connection restored to 01fefea8-43c5-f114-cf69-e9c5be19a5dd (at 10.8.2.15@o2ib6) [ 6112.552596] Lustre: Skipped 292 previous similar messages [ 6174.295830] Lustre: fir-OST0021: haven't heard from client e6c47303-ed85-d34d-4062-9831456dbdb7 (at 10.9.106.24@o2ib4) in 227 seconds. I think it's dead, and I am evicting it. exp ffff97fd6592cc00, cur 1555951009 expire 1555950859 last 1555950782 [ 6174.317648] Lustre: Skipped 1 previous similar message [ 6607.748328] Lustre: 78734:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1555951435/real 1555951435] req@ffff98140207ad00 x1631526609305552/t0(0) o104->fir-OST0021@10.8.27.20@o2ib6:15/16 lens 296/224 e 0 to 1 dl 1555951442 ref 1 fl Rpc:X/0/ffffffff rc 0/-1 [ 6607.775600] Lustre: 78734:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 6 previous similar messages [ 6754.754083] LustreError: 78361:0:(ldlm_lockd.c:682:ldlm_handle_ast_error()) ### client (nid 10.8.27.20@o2ib6) failed to reply to blocking AST (req@ffff981d18babf00 x1631526609305648 status 0 rc -110), evict it ns: filter-fir-OST001f_UUID lock: ffff981b0f7a1680/0xd801483000950001 lrc: 4/0,0 mode: PR/PR res: [0x480000400:0x57067c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 17179869184->18446744073709551615) flags: 0x60000400010020 nid: 10.8.27.20@o2ib6 remote: 0x6eb21414cea40240 expref: 1032 pid: 78734 timeout: 6896 lvb_type: 1 [ 6754.801752] LustreError: 138-a: fir-OST001f: A client on nid 10.8.27.20@o2ib6 was evicted due to a lock blocking callback time out: rc -110 [ 6754.801791] LustreError: 77026:0:(ldlm_lockd.c:256:expired_lock_main()) ### lock callback timer expired after 154s: evicting client at 10.8.27.20@o2ib6 ns: filter-fir-OST0021_UUID lock: ffff981b2018f500/0xd80148300095002b lrc: 3/0,0 mode: PR/PR res: [0x980000402:0x570668:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 131072->16777215) flags: 0x60000400010020 nid: 10.8.27.20@o2ib6 remote: 0x6eb21414cea4029b expref: 1072 pid: 78362 timeout: 0 lvb_type: 1 [ 6754.855257] LustreError: Skipped 1 previous similar message [ 6820.772881] LustreError: 78708:0:(ldlm_lockd.c:682:ldlm_handle_ast_error()) ### client (nid 10.8.27.20@o2ib6) failed to reply to blocking AST (req@ffff981ce8c30f00 x1631526613093856 status 0 rc -110), evict it ns: filter-fir-OST0023_UUID lock: ffff980abe887500/0xd8014830009448c6 lrc: 4/0,0 mode: PR/PR res: [0xd40000402:0x570856:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 268435456->8589934591) flags: 0x60000400010020 nid: 10.8.27.20@o2ib6 remote: 0x6eb21414ce9f18e0 expref: 1012 pid: 78297 timeout: 6912 lvb_type: 1 [ 6820.819467] LustreError: 78708:0:(ldlm_lockd.c:682:ldlm_handle_ast_error()) Skipped 1 previous similar message [ 6820.829507] LustreError: 138-a: fir-OST0023: A client on nid 10.8.27.20@o2ib6 was evicted due to a lock blocking callback time out: rc -110 [ 6820.842093] LustreError: 77026:0:(ldlm_lockd.c:256:expired_lock_main()) ### lock callback timer expired after 105s: evicting client at 10.8.27.20@o2ib6 ns: filter-fir-OST0023_UUID lock: ffff980abe887500/0xd8014830009448c6 lrc: 3/0,0 mode: PR/PR res: [0xd40000402:0x570856:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 268435456->8589934591) flags: 0x60000400010020 nid: 10.8.27.20@o2ib6 remote: 0x6eb21414ce9f18e0 expref: 1013 pid: 78297 timeout: 0 lvb_type: 1 [ 6820.883555] LustreError: 77026:0:(ldlm_lockd.c:256:expired_lock_main()) Skipped 1 previous similar message [ 6822.325557] Lustre: fir-OST0019: haven't heard from client 28d2f949-4af3-2d92-725e-36514fb8ee56 (at 10.8.27.20@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff97fd677a9c00, cur 1555951657 expire 1555951507 last 1555951430 [ 6822.347263] Lustre: Skipped 9 previous similar messages [ 6822.353288] LustreError: 78898:0:(client.c:1175:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff982d24c4bc00 x1631526616507712/t0(0) o106->fir-OST001b@10.8.27.20@o2ib6:15/16 lens 296/280 e 0 to 0 dl 0 ref 1 fl Rpc:/0/ffffffff rc 0/-1 [ 6822.374376] LustreError: 78898:0:(client.c:1175:ptlrpc_import_delay_req()) Skipped 1 previous similar message [ 7064.309336] Lustre: fir-OST001f: haven't heard from client 27e2224f-5a36-bc4e-56ae-436ddca2761d (at 10.9.101.63@o2ib4) in 227 seconds. I think it's dead, and I am evicting it. exp ffff980d277c4c00, cur 1555951899 expire 1555951749 last 1555951672 [ 7064.331172] Lustre: Skipped 2 previous similar messages [ 7261.037082] Lustre: fir-OST0019: Connection restored to 3a3472aa-1f93-3376-3172-e1f39b5cdfe5 (at 10.8.15.9@o2ib6) [ 7261.047348] Lustre: Skipped 11 previous similar messages [ 7347.310898] Lustre: fir-OST0023: haven't heard from client c2cd895c-9d0b-d033-ac08-1e9399478d9a (at 10.9.107.7@o2ib4) in 227 seconds. I think it's dead, and I am evicting it. exp ffff97fd6973c400, cur 1555952182 expire 1555952032 last 1555951955 [ 7347.332634] Lustre: Skipped 11 previous similar messages [ 7531.312754] Lustre: fir-OST0023: haven't heard from client df29e42a-a729-6714-795b-eb26a2f890a0 (at 10.8.15.7@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff981dbbe3a800, cur 1555952366 expire 1555952216 last 1555952139 [ 7531.334388] Lustre: Skipped 5 previous similar messages [ 7738.336543] Lustre: fir-OST0019: haven't heard from client 848e66da-14a3-0c49-9824-18e704ef8ca7 (at 10.9.102.39@o2ib4) in 227 seconds. I think it's dead, and I am evicting it. exp ffff97fd670d4800, cur 1555952573 expire 1555952423 last 1555952346 [ 7738.358356] Lustre: Skipped 11 previous similar messages [ 7864.667534] Lustre: fir-OST0019: Connection restored to (at 10.9.105.41@o2ib4) [ 7864.674854] Lustre: Skipped 896 previous similar messages [ 8031.318415] Lustre: fir-OST001b: haven't heard from client ef8cda5d-b256-27e3-6a8e-6b6c0bec4be8 (at 10.9.106.29@o2ib4) in 227 seconds. I think it's dead, and I am evicting it. exp ffff97fd6c132c00, cur 1555952866 expire 1555952716 last 1555952639 [ 8031.340240] Lustre: Skipped 5 previous similar messages [ 8187.320097] Lustre: fir-OST0021: haven't heard from client 25dee247-4fea-c8b1-49fa-5418a2c6d44e (at 10.8.0.68@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff97fd65c3bc00, cur 1555953022 expire 1555952872 last 1555952795 [ 8187.341742] Lustre: Skipped 24 previous similar messages [ 8521.617574] Lustre: fir-OST0019: Connection restored to 28d2f949-4af3-2d92-725e-36514fb8ee56 (at 10.8.27.20@o2ib6) [ 8521.627940] Lustre: Skipped 113 previous similar messages [ 8613.325819] Lustre: fir-OST0023: haven't heard from client b6e934be-8e18-b288-41c2-46ed1a43d9b0 (at 10.9.113.11@o2ib4) in 227 seconds. I think it's dead, and I am evicting it. exp ffff97fd69079000, cur 1555953448 expire 1555953298 last 1555953221 [ 8613.347619] Lustre: Skipped 16 previous similar messages [ 8953.673861] LustreError: 77026:0:(ldlm_lockd.c:256:expired_lock_main()) ### lock callback timer expired after 100s: evicting client at 10.9.104.30@o2ib4 ns: filter-fir-OST0021_UUID lock: ffff9825eedfd580/0xd801483004430054 lrc: 3/0,0 mode: PW/PW res: [0x2a8dd8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 131072->16777215) flags: 0x60000400020020 nid: 10.9.104.30@o2ib4 remote: 0xf5f965c70d25b652 expref: 43 pid: 78699 timeout: 8952 lvb_type: 0 [ 9074.675241] LustreError: 77026:0:(ldlm_lockd.c:256:expired_lock_main()) ### lock callback timer expired after 100s: evicting client at 10.9.107.21@o2ib4 ns: filter-fir-OST0019_UUID lock: ffff98253c228480/0xd8014830044302e6 lrc: 3/0,0 mode: PW/PW res: [0x2a775d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 131072->16777215) flags: 0x60000400020020 nid: 10.9.107.21@o2ib4 remote: 0xf948baf51d14facd expref: 49 pid: 78849 timeout: 9073 lvb_type: 0 [ 9191.333378] Lustre: fir-OST0021: haven't heard from client 8744cdfa-58ed-088e-3ed1-dc6a4502ac32 (at 10.9.104.30@o2ib4) in 227 seconds. I think it's dead, and I am evicting it. exp ffff981cf058c400, cur 1555954026 expire 1555953876 last 1555953799 [ 9191.355190] Lustre: Skipped 5 previous similar messages [ 9254.677334] LustreError: 77026:0:(ldlm_lockd.c:256:expired_lock_main()) ### lock callback timer expired after 100s: evicting client at 10.9.108.33@o2ib4 ns: filter-fir-OST001b_UUID lock: ffff980227f62f40/0xd8014830044302c3 lrc: 3/0,0 mode: PW/PW res: [0x2a8f14:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8388608->536870911) flags: 0x60000400020020 nid: 10.9.108.33@o2ib4 remote: 0xfb8040c554b115db expref: 86 pid: 77068 timeout: 9253 lvb_type: 0 [ 9268.842725] Lustre: fir-OST001b: Connection restored to c85cd35f-67e0-b8cd-26db-c715bed53cea (at 10.9.108.33@o2ib4) [ 9268.853165] Lustre: Skipped 8 previous similar messages [ 9303.677922] LustreError: 77026:0:(ldlm_lockd.c:256:expired_lock_main()) ### lock callback timer expired after 100s: evicting client at 10.9.107.11@o2ib4 ns: filter-fir-OST001f_UUID lock: ffff980224cd98c0/0xd8014830044302bc lrc: 3/0,0 mode: PW/PW res: [0x2a89eb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 268435456->8589934591) flags: 0x60000400020020 nid: 10.9.107.11@o2ib4 remote: 0x2ce6781122d918fe expref: 56 pid: 77068 timeout: 9302 lvb_type: 0 [ 9403.679092] LustreError: 77026:0:(ldlm_lockd.c:256:expired_lock_main()) ### lock callback timer expired after 150s: evicting client at 10.9.105.40@o2ib4 ns: filter-fir-OST001f_UUID lock: ffff9810859f3180/0xd801483004430379 lrc: 3/0,0 mode: PW/PW res: [0x2a8a1f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8388608->536870911) flags: 0x60000400020020 nid: 10.9.105.40@o2ib4 remote: 0x4164b94a1e8a3024 expref: 63 pid: 77068 timeout: 9402 lvb_type: 0 [ 9424.679342] LustreError: 77026:0:(ldlm_lockd.c:256:expired_lock_main()) ### lock callback timer expired after 100s: evicting client at 10.9.108.21@o2ib4 ns: filter-fir-OST001f_UUID lock: ffff97f2c07c7740/0xd801483004430325 lrc: 3/0,0 mode: PW/PW res: [0x2a8ac7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 268435456->8589934591) flags: 0x60000400020020 nid: 10.9.108.21@o2ib4 remote: 0x4b7102c88fc43c65 expref: 32 pid: 78291 timeout: 9423 lvb_type: 0 [ 9574.681068] LustreError: 77026:0:(ldlm_lockd.c:256:expired_lock_main()) ### lock callback timer expired after 150s: evicting client at 10.9.104.47@o2ib4 ns: filter-fir-OST0023_UUID lock: ffff980138ceaf40/0xd8014830044312bb lrc: 3/0,0 mode: PW/PW res: [0x2a7a22:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 268435456->8589934591) flags: 0x60000400020020 nid: 10.9.104.47@o2ib4 remote: 0x247b2aa75fae2cd1 expref: 53 pid: 78509 timeout: 9573 lvb_type: 0 [ 9674.682237] LustreError: 77026:0:(ldlm_lockd.c:256:expired_lock_main()) ### lock callback timer expired after 150s: evicting client at 10.9.106.62@o2ib4 ns: filter-fir-OST001b_UUID lock: ffff98253c229d40/0xd80148300443031e lrc: 3/0,0 mode: PW/PW res: [0x2a8f60:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 268435456->8589934591) flags: 0x60000400020020 nid: 10.9.106.62@o2ib4 remote: 0xcb178147c56806db expref: 63 pid: 78849 timeout: 9673 lvb_type: 0 [ 9798.377480] Lustre: fir-OST001d: haven't heard from client b214bbaa-dfa8-5550-6c23-a4a7f34b2d1a (at 10.9.114.5@o2ib4) in 227 seconds. I think it's dead, and I am evicting it. exp ffff980d287bc000, cur 1555954633 expire 1555954483 last 1555954406 [ 9798.399208] Lustre: Skipped 23 previous similar messages [ 9884.766545] Lustre: fir-OST0019: Connection restored to ea37ce80-e1ed-f5a8-5b21-946c74653f26 (at 10.9.107.21@o2ib4) [ 9884.776989] Lustre: Skipped 23 previous similar messages [10026.171288] Lustre: 78622:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1555954853/real 1555954853] req@ffff980d2783fb00 x1631526685455760/t0(0) o106->fir-OST0023@10.8.15.6@o2ib6:15/16 lens 296/280 e 0 to 1 dl 1555954860 ref 1 fl Rpc:X/0/ffffffff rc 0/-1 [10026.198492] Lustre: 78622:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 121 previous similar messages [10061.171648] Lustre: 78527:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1555954888/real 1555954888] req@ffff980d1dc72a00 x1631526685455744/t0(0) o106->fir-OST001b@10.8.15.6@o2ib6:15/16 lens 296/280 e 0 to 1 dl 1555954895 ref 1 fl Rpc:X/2/ffffffff rc 0/-1 [10061.171650] Lustre: 78523:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1555954888/real 1555954888] req@ffff980d1dc73900 x1631526685455776/t0(0) o106->fir-OST001f@10.8.15.6@o2ib6:15/16 lens 296/280 e 0 to 1 dl 1555954895 ref 1 fl Rpc:X/2/ffffffff rc 0/-1 [10061.171655] Lustre: 78523:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 17 previous similar messages [10061.235835] Lustre: 78527:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 1 previous similar message [10119.374700] LustreError: 78527:0:(client.c:1175:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff980d27ff5700 x1631526689059568/t0(0) o106->fir-OST001d@10.8.15.6@o2ib6:15/16 lens 296/280 e 0 to 0 dl 0 ref 1 fl Rpc:/0/ffffffff rc 0/-1 [10358.906955] Lustre: 78613:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1555955186/real 1555955186] req@ffff98004f226000 x1631526697420352/t0(0) o106->fir-OST001b@10.9.101.28@o2ib4:15/16 lens 296/280 e 0 to 1 dl 1555955193 ref 1 fl Rpc:X/0/ffffffff rc 0/-1 [10358.934330] Lustre: 78613:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 35 previous similar messages [10487.007372] Lustre: 78566:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1555955314/real 1555955314] req@ffff97fd6747f800 x1631526697481408/t0(0) o106->fir-OST001b@10.9.101.28@o2ib4:15/16 lens 296/280 e 0 to 1 dl 1555955321 ref 1 fl Rpc:X/2/ffffffff rc 0/-1 [10487.007374] Lustre: 78291:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1555955314/real 1555955314] req@ffff97eebc990f00 x1631526697481440/t0(0) o106->fir-OST001f@10.9.101.28@o2ib4:15/16 lens 296/280 e 0 to 1 dl 1555955321 ref 1 fl Rpc:X/2/ffffffff rc 0/-1 [10487.007378] Lustre: 78291:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 960 previous similar messages [10494.292474] LustreError: 78496:0:(ldlm_lockd.c:682:ldlm_handle_ast_error()) ### client (nid 10.9.101.28@o2ib4) failed to reply to blocking AST (req@ffff981d18ba8c00 x1631526698598368 status 0 rc -110), evict it ns: filter-fir-OST0023_UUID lock: ffff98016d218b40/0xd80148300515f99f lrc: 4/0,0 mode: PR/PR res: [0xd40000401:0x91d5ad:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 131072->16777215) flags: 0x60000400000020 nid: 10.9.101.28@o2ib4 remote: 0x2af8f6a2d8d26caa expref: 585 pid: 78481 timeout: 10585 lvb_type: 1 [10494.293470] LustreError: 138-a: fir-OST001b: A client on nid 10.9.101.28@o2ib4 was evicted due to a lock blocking callback time out: rc -110 [10494.293495] LustreError: 77026:0:(ldlm_lockd.c:256:expired_lock_main()) ### lock callback timer expired after 105s: evicting client at 10.9.101.28@o2ib4 ns: filter-fir-OST001b_UUID lock: ffff97f619e7af40/0xd80148300516127a lrc: 3/0,0 mode: PR/PR res: [0xd00000401:0x91e8cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8388608->536870911) flags: 0x60000400000020 nid: 10.9.101.28@o2ib4 remote: 0x2af8f6a2d8d2a7a5 expref: 568 pid: 78314 timeout: 0 lvb_type: 1 [10494.392679] LustreError: 78496:0:(ldlm_lockd.c:682:ldlm_handle_ast_error()) Skipped 1 previous similar message [10554.491107] LNet: Service thread pid 77058 was inactive for 200.48s. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes: [10554.508095] Pid: 77058, comm: ll_ost00_000 3.10.0-957.1.3.el7_lustre.x86_64 #1 SMP Fri Dec 7 14:50:35 PST 2018 [10554.518134] Call Trace: [10554.520601] [<ffffffffc0f9b640>] ptlrpc_set_wait+0x500/0x8d0 [ptlrpc] [10554.527247] [<ffffffffc0f58fe5>] ldlm_run_ast_work+0xd5/0x3a0 [ptlrpc] [10554.533972] [<ffffffffc0f7a69b>] ldlm_glimpse_locks+0x3b/0x100 [ptlrpc] [10554.540784] [<ffffffffc162910b>] ofd_intent_policy+0x69b/0x920 [ofd] [10554.547284] [<ffffffffc0f59d26>] ldlm_lock_enqueue+0x366/0xa60 [ptlrpc] [10554.554060] [<ffffffffc0f826d7>] ldlm_handle_enqueue0+0xa47/0x15a0 [ptlrpc] [10554.561187] [<ffffffffc10090b2>] tgt_enqueue+0x62/0x210 [ptlrpc] [10554.567400] [<ffffffffc101010a>] tgt_request_handle+0xaea/0x1580 [ptlrpc] [10554.574346] [<ffffffffc0fb46db>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc] [10554.582080] [<ffffffffc0fb800c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc] [10554.588424] [<ffffffff8b8c1c31>] kthread+0xd1/0xe0 [10554.593328] [<ffffffff8bf74c24>] ret_from_fork_nospec_begin+0xe/0x21 [10554.599832] [<ffffffffffffffff>] 0xffffffffffffffff [10554.604859] LustreError: dumping log to /tmp/lustre-log.1555955389.77058 [10554.730504] Pid: 78291, comm: ll_ost00_019 3.10.0-957.1.3.el7_lustre.x86_64 #1 SMP Fri Dec 7 14:50:35 PST 2018 [10554.740528] Call Trace: [10554.743007] [<ffffffffc0f9b640>] ptlrpc_set_wait+0x500/0x8d0 [ptlrpc] [10554.749626] [<ffffffffc0f58fe5>] ldlm_run_ast_work+0xd5/0x3a0 [ptlrpc] [10554.756340] [<ffffffffc0f7a69b>] ldlm_glimpse_locks+0x3b/0x100 [ptlrpc] [10554.763110] [<ffffffffc162910b>] ofd_intent_policy+0x69b/0x920 [ofd] [10554.769614] [<ffffffffc0f59d26>] ldlm_lock_enqueue+0x366/0xa60 [ptlrpc] [10554.776378] [<ffffffffc0f826d7>] ldlm_handle_enqueue0+0xa47/0x15a0 [ptlrpc] [10554.783513] [<ffffffffc10090b2>] tgt_enqueue+0x62/0x210 [ptlrpc] [10554.789717] [<ffffffffc101010a>] tgt_request_handle+0xaea/0x1580 [ptlrpc] [10554.796689] [<ffffffffc0fb46db>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc] [10554.804416] [<ffffffffc0fb800c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc] [10554.810774] [<ffffffff8b8c1c31>] kthread+0xd1/0xe0 [10554.815693] [<ffffffff8bf74c24>] ret_from_fork_nospec_begin+0xe/0x21 [10554.822182] [<ffffffffffffffff>] 0xffffffffffffffff [10555.156926] Lustre: fir-OST0019: Connection restored to 708f469b-f504-7275-d236-e90aa8bcec67 (at 10.9.0.64@o2ib4) [10555.167189] Lustre: Skipped 24 previous similar messages [10561.147186] LNet: Service thread pid 78318 was inactive for 200.37s. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes: [10561.164144] LNet: Skipped 1 previous similar message [10561.169118] Pid: 78318, comm: ll_ost02_032 3.10.0-957.1.3.el7_lustre.x86_64 #1 SMP Fri Dec 7 14:50:35 PST 2018 [10561.179119] Call Trace: [10561.181592] [<ffffffffc0f9b640>] ptlrpc_set_wait+0x500/0x8d0 [ptlrpc] [10561.188253] [<ffffffffc0f58fe5>] ldlm_run_ast_work+0xd5/0x3a0 [ptlrpc] [10561.194943] [<ffffffffc0f7a69b>] ldlm_glimpse_locks+0x3b/0x100 [ptlrpc] [10561.201734] [<ffffffffc162910b>] ofd_intent_policy+0x69b/0x920 [ofd] [10561.208234] [<ffffffffc0f59d26>] ldlm_lock_enqueue+0x366/0xa60 [ptlrpc] [10561.214999] [<ffffffffc0f826d7>] ldlm_handle_enqueue0+0xa47/0x15a0 [ptlrpc] [10561.222140] [<ffffffffc10090b2>] tgt_enqueue+0x62/0x210 [ptlrpc] [10561.228310] [<ffffffffc101010a>] tgt_request_handle+0xaea/0x1580 [ptlrpc] [10561.235289] [<ffffffffc0fb46db>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc] [10561.243009] [<ffffffffc0fb800c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc] [10561.249358] [<ffffffff8b8c1c31>] kthread+0xd1/0xe0 [10561.254277] [<ffffffff8bf74c24>] ret_from_fork_nospec_begin+0xe/0x21 [10561.260787] [<ffffffffffffffff>] 0xffffffffffffffff [10561.265814] LustreError: dumping log to /tmp/lustre-log.1555955395.78318 [10561.273233] Pid: 78868, comm: ll_ost03_105 3.10.0-957.1.3.el7_lustre.x86_64 #1 SMP Fri Dec 7 14:50:35 PST 2018 [10561.283270] Call Trace: [10561.285734] [<ffffffffc0f9b640>] ptlrpc_set_wait+0x500/0x8d0 [ptlrpc] [10561.292331] [<ffffffffc0f58fe5>] ldlm_run_ast_work+0xd5/0x3a0 [ptlrpc] [10561.299048] [<ffffffffc0f7a69b>] ldlm_glimpse_locks+0x3b/0x100 [ptlrpc] [10561.305815] [<ffffffffc162910b>] ofd_intent_policy+0x69b/0x920 [ofd] [10561.312291] [<ffffffffc0f59d26>] ldlm_lock_enqueue+0x366/0xa60 [ptlrpc] [10561.319051] [<ffffffffc0f826d7>] ldlm_handle_enqueue0+0xa47/0x15a0 [ptlrpc] [10561.326207] [<ffffffffc10090b2>] tgt_enqueue+0x62/0x210 [ptlrpc] [10561.332389] [<ffffffffc101010a>] tgt_request_handle+0xaea/0x1580 [ptlrpc] [10561.339338] [<ffffffffc0fb46db>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc] [10561.347072] [<ffffffffc0fb800c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc] [10561.353420] [<ffffffff8b8c1c31>] kthread+0xd1/0xe0 [10561.358355] [<ffffffff8bf74c24>] ret_from_fork_nospec_begin+0xe/0x21 [10561.364828] [<ffffffffffffffff>] 0xffffffffffffffff [10577.348218] Lustre: fir-OST0021: haven't heard from client 83316b44-aad9-bbe2-1580-9c149ecd135e (at 10.9.101.28@o2ib4) in 227 seconds. I think it's dead, and I am evicting it. exp ffff97fd659af000, cur 1555955412 expire 1555955262 last 1555955185 [10577.370014] Lustre: Skipped 19 previous similar messages [10577.375591] LNet: Service thread pid 77058 completed after 223.36s. This indicates the system was overloaded (too many service threads, or there were not enough hardware resources). [10577.376797] LustreError: 78624:0:(client.c:1175:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff981b3d9bad00 x1631526704122896/t0(0) o104->fir-OST0021@10.9.101.28@o2ib4:15/16 lens 296/224 e 0 to 0 dl 0 ref 1 fl Rpc:/0/ffffffff rc 0/-1 [10577.412904] LNet: Skipped 1 previous similar message [10578.349461] LNet: Service thread pid 78291 completed after 224.34s. This indicates the system was overloaded (too many service threads, or there were not enough hardware resources). [10578.365639] LNet: Skipped 1 previous similar message [11262.482419] Lustre: fir-OST0019: Connection restored to 25dee247-4fea-c8b1-49fa-5418a2c6d44e (at 10.8.0.68@o2ib6) [11262.492688] Lustre: Skipped 29 previous similar messages [11573.105476] Lustre: 78272:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1555956400/real 1555956400] req@ffff981b3d9bbf00 x1631526738669488/t0(0) o106->fir-OST001f@10.9.106.18@o2ib4:15/16 lens 296/280 e 0 to 1 dl 1555956407 ref 1 fl Rpc:X/0/ffffffff rc 0/-1 [11573.132822] Lustre: 78272:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 686 previous similar messages [11601.391265] Lustre: fir-OST001b: haven't heard from client 51b66fa9-7b77-6d0b-8555-d8afd8ba18b1 (at 10.9.106.18@o2ib4) in 227 seconds. I think it's dead, and I am evicting it. exp ffff97fd6c05ac00, cur 1555956436 expire 1555956286 last 1555956209 [11601.413072] Lustre: Skipped 3 previous similar messages [12103.514643] Lustre: fir-OST0019: Connection restored to e0ec656b-144b-be41-2e9d-c55aae647e6a (at 10.8.0.82@o2ib6) [12103.524910] Lustre: Skipped 23 previous similar messages [12271.644477] LustreError: 137-5: fir-OST001c_UUID: not available for connect from 10.9.101.28@o2ib4 (no target). If you are running an HA pair check that the target is mounted on the other server. [12271.661848] LustreError: Skipped 216 previous similar messages [12296.668711] Lustre: fir-OST0019: Client 0a211124-9830-8b00-47a8-038ae143349e (at 10.9.101.28@o2ib4) reconnecting [12296.678902] Lustre: Skipped 2 previous similar messages [12779.371028] Lustre: fir-OST0019: haven't heard from client d3ebab73-3b69-626b-f29e-a39109481e62 (at 10.9.112.12@o2ib4) in 227 seconds. I think it's dead, and I am evicting it. exp ffff97fd67755000, cur 1555957614 expire 1555957464 last 1555957387 [12779.392843] Lustre: Skipped 23 previous similar messages [13173.998254] Lustre: fir-OST0019: Connection restored to (at 10.9.115.11@o2ib4) [13174.005601] Lustre: Skipped 14 previous similar messages [13688.386363] Lustre: fir-OST001d: haven't heard from client 221b3157-6a16-0bbf-1748-82fdf38b233d (at 10.9.108.7@o2ib4) in 227 seconds. I think it's dead, and I am evicting it. exp ffff980d280d3400, cur 1555958523 expire 1555958373 last 1555958296 [13688.408091] Lustre: Skipped 593 previous similar messages [13814.579910] Lustre: fir-OST0019: Connection restored to d1d9889b-d4ae-16af-c2f4-19fea3daefdf (at 10.8.14.9@o2ib6) [13814.590177] Lustre: Skipped 17 previous similar messages [14502.393462] Lustre: fir-OST001f: haven't heard from client 7cb13f35-80e5-68c2-4748-b4ec91440fb6 (at 10.8.13.23@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff980d27675000, cur 1555959337 expire 1555959187 last 1555959110 [14502.415230] Lustre: Skipped 17 previous similar messages [14608.451978] Lustre: fir-OST0019: Connection restored to a899bccc-149c-355c-2101-f0d3cd0562c6 (at 10.9.115.7@o2ib4) [14608.462335] Lustre: Skipped 29 previous similar messages [15211.595156] Lustre: fir-OST0019: Connection restored to b27253cc-2866-e7a6-e704-0d220d5bb192 (at 10.9.115.2@o2ib4) [15211.605509] Lustre: Skipped 508 previous similar messages [15291.396725] Lustre: fir-OST0021: haven't heard from client ab3f6fa5-09f7-2c63-0eb3-8d2465d14ffc (at 10.9.113.12@o2ib4) in 227 seconds. I think it's dead, and I am evicting it. exp ffff97fd663e7c00, cur 1555960126 expire 1555959976 last 1555959899 [15291.418522] Lustre: Skipped 5 previous similar messages [15850.545737] Lustre: fir-OST0019: Connection restored to 1c286be2-48a0-8ae1-757c-7af17cdc6764 (at 10.8.25.23@o2ib6) [15850.556083] Lustre: Skipped 89 previous similar messages [15958.406246] Lustre: fir-OST0019: haven't heard from client ae22c01c-5307-0e7f-d2e3-ee46df32a51b (at 10.9.106.70@o2ib4) in 227 seconds. I think it's dead, and I am evicting it. exp ffff97fd6721d800, cur 1555960793 expire 1555960643 last 1555960566 [15958.428044] Lustre: Skipped 29 previous similar messages [16530.845646] Lustre: fir-OST0019: Connection restored to 424c499c-bcf2-3c1f-c771-0484a4bdadc1 (at 10.8.27.23@o2ib6) [16530.856021] Lustre: Skipped 11 previous similar messages [16689.412243] Lustre: fir-OST001f: haven't heard from client 7ad94ae9-55e4-6edb-02da-db8e3dd8e9e6 (at 10.8.26.32@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff980d2703b800, cur 1555961524 expire 1555961374 last 1555961297 [16689.433944] Lustre: Skipped 11 previous similar messages [17211.669640] Lustre: fir-OST001b: Connection restored to dbfb2c0c-fb25-e804-4d23-c99ffe872df5 (at 10.9.101.5@o2ib4) [17211.679998] Lustre: Skipped 16 previous similar messages [17458.420055] Lustre: fir-OST001b: haven't heard from client a7d05076-3477-66ef-4a9a-33b7adeabef4 (at 10.8.25.23@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff980d1f1ee800, cur 1555962293 expire 1555962143 last 1555962066 [17458.441807] Lustre: Skipped 419 previous similar messages [18089.004672] Lustre: fir-OST0019: Connection restored to (at 10.9.107.5@o2ib4) [18089.011899] Lustre: Skipped 23 previous similar messages [18691.508495] Lustre: fir-OST0019: Connection restored to 92370bd6-9a15-6556-d9c9-7bdf5c971973 (at 10.8.8.5@o2ib6) [18691.518676] Lustre: Skipped 382 previous similar messages [19159.435749] Lustre: fir-OST001b: haven't heard from client b794c6d6-0e55-241b-2244-f3d71f34f2a7 (at 10.9.108.14@o2ib4) in 227 seconds. I think it's dead, and I am evicting it. exp ffff97fd6c044400, cur 1555963994 expire 1555963844 last 1555963767 [19159.457586] Lustre: Skipped 5 previous similar messages [19170.801211] Lustre: 78500:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1555963998/real 1555963998] req@ffff980d27e0bf00 x1631526869565024/t0(0) o106->fir-OST0023@10.9.103.44@o2ib4:15/16 lens 296/280 e 0 to 1 dl 1555964005 ref 1 fl Rpc:X/0/ffffffff rc 0/-1 [19170.828552] Lustre: 78500:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 37 previous similar messages [19235.435924] Lustre: fir-OST001b: haven't heard from client dcccbe1e-b9b2-41c7-f075-2b715ce06f97 (at 10.9.103.41@o2ib4) in 157 seconds. I think it's dead, and I am evicting it. exp ffff97fd6c31f400, cur 1555964070 expire 1555963920 last 1555963913 [19235.457743] Lustre: Skipped 5 previous similar messages [19247.801924] Lustre: 78310:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1555964075/real 1555964075] req@ffff980ae6737800 x1631526869565072/t0(0) o106->fir-OST0021@10.9.103.44@o2ib4:15/16 lens 296/280 e 0 to 1 dl 1555964082 ref 1 fl Rpc:X/2/ffffffff rc 0/-1 [19247.829273] Lustre: 78310:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 39 previous similar messages [19387.437261] Lustre: fir-OST0023: haven't heard from client bed3dcb4-6b79-eea3-91ef-5bd03e618d10 (at 10.9.104.39@o2ib4) in 223 seconds. I think it's dead, and I am evicting it. exp ffff97fd69369800, cur 1555964222 expire 1555964072 last 1555963999 [19387.459160] Lustre: Skipped 18 previous similar messages [19785.439712] Lustre: fir-OST001b: haven't heard from client 20e661c8-c8e2-b6c4-623d-647dca788394 (at 10.9.102.44@o2ib4) in 227 seconds. I think it's dead, and I am evicting it. exp ffff97fd6c274c00, cur 1555964620 expire 1555964470 last 1555964393 [19785.461514] Lustre: Skipped 22 previous similar messages [20385.079080] Lustre: fir-OST0019: Connection restored to 1c286be2-48a0-8ae1-757c-7af17cdc6764 (at 10.8.25.23@o2ib6) [20385.089445] Lustre: Skipped 35 previous similar messages [20469.519809] Lustre: fir-OST0019: Connection restored to b794c6d6-0e55-241b-2244-f3d71f34f2a7 (at 10.9.108.14@o2ib4) [20469.530249] Lustre: Skipped 5 previous similar messages [20623.969480] Lustre: fir-OST0019: Connection restored to dcccbe1e-b9b2-41c7-f075-2b715ce06f97 (at 10.9.103.41@o2ib4) [20623.979950] Lustre: Skipped 5 previous similar messages [21092.714588] Lustre: fir-OST0019: Connection restored to 4b227bec-2316-88f0-b12b-2427cb1b8b1a (at 10.9.104.38@o2ib4) [21092.725029] Lustre: Skipped 11 previous similar messages [21723.387974] Lustre: fir-OST0019: Connection restored to 1cc04f06-e9b7-d7f1-14b8-2f78988553e1 (at 10.9.104.42@o2ib4) [21723.398404] Lustre: Skipped 71 previous similar messages [22374.258327] perf: interrupt took too long (2509 > 2500), lowering kernel.perf_event_max_sample_rate to 79000 [22652.466153] Lustre: fir-OST001b: haven't heard from client 69c8ae07-587a-673d-c37e-a0e8475b6250 (at 10.9.113.9@o2ib4) in 227 seconds. I think it's dead, and I am evicting it. exp ffff97fd6bdc5c00, cur 1555967487 expire 1555967337 last 1555967260 [22652.487861] Lustre: Skipped 59 previous similar messages [23649.475514] Lustre: fir-OST0023: haven't heard from client 4fbfbfdc-7b63-6336-5b21-278dc6207214 (at 10.9.102.40@o2ib4) in 227 seconds. I think it's dead, and I am evicting it. exp ffff97fd696e9800, cur 1555968484 expire 1555968334 last 1555968257 [23649.497324] Lustre: Skipped 5 previous similar messages [23725.474602] Lustre: fir-OST0023: haven't heard from client 94392743-5295-c36e-4d8f-919c947455bb (at 10.9.113.15@o2ib4) in 188 seconds. I think it's dead, and I am evicting it. exp ffff982d2a99c000, cur 1555968560 expire 1555968410 last 1555968372 [23725.496393] Lustre: Skipped 5 previous similar messages [23764.474684] Lustre: fir-OST001b: haven't heard from client 94392743-5295-c36e-4d8f-919c947455bb (at 10.9.113.15@o2ib4) in 227 seconds. I think it's dead, and I am evicting it. exp ffff982d2a99b000, cur 1555968599 expire 1555968449 last 1555968372 [23840.475693] Lustre: fir-OST001b: haven't heard from client a2655d6e-74b3-b766-cb45-bcc5ac62a7cb (at 10.8.27.23@o2ib6) in 203 seconds. I think it's dead, and I am evicting it. exp ffff981cf0590000, cur 1555968675 expire 1555968525 last 1555968472 [23840.497417] Lustre: Skipped 5 previous similar messages [23860.895448] Lustre: fir-OST0019: Connection restored to (at 10.9.113.15@o2ib4) [23860.902765] Lustre: Skipped 17 previous similar messages [24253.971740] Lustre: fir-OST0019: Connection restored to (at 10.9.113.15@o2ib4) [24253.979057] Lustre: Skipped 11 previous similar messages [24414.481645] Lustre: fir-OST001b: haven't heard from client 5b076351-495f-a8a8-c0f1-4b59b0820491 (at 10.9.114.5@o2ib4) in 227 seconds. I think it's dead, and I am evicting it. exp ffff97fdb272cc00, cur 1555969249 expire 1555969099 last 1555969022 [24414.503365] Lustre: Skipped 4 previous similar messages [24543.655813] Lustre: fir-OST0019: Connection restored to b214bbaa-dfa8-5550-6c23-a4a7f34b2d1a (at 10.9.114.5@o2ib4) [24543.666161] Lustre: Skipped 11 previous similar messages [24790.485976] Lustre: fir-OST0023: haven't heard from client 09f25ba8-edaf-0ce5-fe02-9f684c28ed62 (at 10.9.106.22@o2ib4) in 227 seconds. I think it's dead, and I am evicting it. exp ffff97fd69640c00, cur 1555969625 expire 1555969475 last 1555969398 [24790.507768] Lustre: Skipped 5 previous similar messages [25112.502145] Lustre: 78667:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1555969936/real 1555969936] req@ffff97f888cc4800 x1631526983528288/t0(0) o106->fir-OST001d@10.9.114.5@o2ib4:15/16 lens 296/280 e 0 to 1 dl 1555969947 ref 1 fl Rpc:X/0/ffffffff rc 0/-1 [25112.529498] Lustre: 78667:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 41 previous similar messages [25134.539342] Lustre: 78667:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1555969958/real 1555969958] req@ffff97f888cc4800 x1631526983528288/t0(0) o106->fir-OST001d@10.9.114.5@o2ib4:15/16 lens 296/280 e 0 to 1 dl 1555969969 ref 1 fl Rpc:X/2/ffffffff rc 0/-1 [25134.566667] Lustre: 78667:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 1 previous similar message [25138.488165] Lustre: fir-OST0019: haven't heard from client b3231067-7d3e-8a24-2e53-f149e71096fa (at 10.9.114.5@o2ib4) in 227 seconds. I think it's dead, and I am evicting it. exp ffff97fd6522e800, cur 1555969973 expire 1555969823 last 1555969746 [25138.509887] Lustre: Skipped 11 previous similar messages [25334.157375] Lustre: fir-OST0019: Connection restored to ab8a2e37-fc9b-d635-b8d2-0e88a2ad27c8 (at 10.8.12.23@o2ib6) [25334.167747] Lustre: Skipped 4 previous similar messages [25816.492936] Lustre: fir-OST0019: haven't heard from client e4665438-ee77-1f94-ac2f-cc792b4d50aa (at 10.9.107.31@o2ib4) in 227 seconds. I think it's dead, and I am evicting it. exp ffff97fd670fc400, cur 1555970651 expire 1555970501 last 1555970424 [25816.514730] Lustre: Skipped 11 previous similar messages [26175.437202] Lustre: fir-OST0019: Connection restored to b214bbaa-dfa8-5550-6c23-a4a7f34b2d1a (at 10.9.114.5@o2ib4) [26175.447555] Lustre: Skipped 18 previous similar messages [26850.508279] Lustre: fir-OST0021: haven't heard from client 18c04ebe-e917-efa8-9354-e1c7d23c7722 (at 10.9.114.5@o2ib4) in 227 seconds. I think it's dead, and I am evicting it. exp ffff980d1d5f1c00, cur 1555971685 expire 1555971535 last 1555971458 [26850.530004] Lustre: Skipped 17 previous similar messages [26909.586845] Lustre: fir-OST0019: Connection restored to 424c499c-bcf2-3c1f-c771-0484a4bdadc1 (at 10.8.27.23@o2ib6) [26909.597195] Lustre: Skipped 17 previous similar messages [27501.505680] Lustre: fir-OST0019: haven't heard from client 58b75192-b975-3fa8-f93d-47a68dd1093f (at 10.9.103.14@o2ib4) in 227 seconds. I think it's dead, and I am evicting it. exp ffff97fd67153800, cur 1555972336 expire 1555972186 last 1555972109 [27501.527496] Lustre: Skipped 17 previous similar messages [27719.696186] perf: interrupt took too long (3220 > 3136), lowering kernel.perf_event_max_sample_rate to 62000 [27890.536005] Lustre: fir-OST0019: Connection restored to 424c499c-bcf2-3c1f-c771-0484a4bdadc1 (at 10.8.27.23@o2ib6) [27890.546364] Lustre: Skipped 41 previous similar messages [28297.512175] Lustre: fir-OST0021: haven't heard from client d90baed8-33b5-89c7-950d-ef0a302811ee (at 10.8.26.33@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff980d1bcfa400, cur 1555973132 expire 1555972982 last 1555972905 [28297.533889] Lustre: Skipped 23 previous similar messages [28474.541153] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [28474.554010] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [28474.566076] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [28495.891594] Lustre: 78288:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1555973323/real 1555973323] req@ffff981b1e52b000 x1631527053977968/t0(0) o104->fir-OST001d@10.9.103.6@o2ib4:15/16 lens 296/224 e 0 to 1 dl 1555973330 ref 1 fl Rpc:X/0/ffffffff rc 0/-1 [28495.918875] Lustre: 78288:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 8 previous similar messages [28502.893661] Lustre: 78751:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1555973330/real 1555973330] req@ffff981b621b6300 x1631527053977952/t0(0) o104->fir-OST0021@10.9.103.6@o2ib4:15/16 lens 296/224 e 0 to 1 dl 1555973337 ref 1 fl Rpc:X/2/ffffffff rc 0/-1 [28502.920924] Lustre: 78751:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 3 previous similar messages [28516.920746] Lustre: 78685:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1555973344/real 1555973344] req@ffff98154b9aec00 x1631527053978752/t0(0) o104->fir-OST0019@10.9.103.6@o2ib4:15/16 lens 296/224 e 0 to 1 dl 1555973351 ref 1 fl Rpc:X/2/ffffffff rc 0/-1 [28516.948040] Lustre: 78685:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 19 previous similar messages [28534.425518] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [28534.438306] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [28534.449965] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [28594.417499] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [28594.430479] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [28594.442353] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [28654.325056] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [28654.338990] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [28654.351309] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [28661.436838] Lustre: 78255:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1555973488/real 1555973488] req@ffff97f5c3de4200 x1631527059056240/t0(0) o106->fir-OST0021@10.9.106.41@o2ib4:15/16 lens 296/280 e 0 to 1 dl 1555973495 ref 1 fl Rpc:X/0/ffffffff rc 0/-1 [28661.436840] Lustre: 78681:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1555973488/real 1555973488] req@ffff97f85a905d00 x1631527059056192/t0(0) o106->fir-OST0019@10.9.106.41@o2ib4:15/16 lens 296/280 e 0 to 1 dl 1555973495 ref 1 fl Rpc:X/0/ffffffff rc 0/-1 [28661.436842] Lustre: 78260:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1555973488/real 1555973488] req@ffff97f70aad4e00 x1631527059056208/t0(0) o106->fir-OST001d@10.9.106.41@o2ib4:15/16 lens 296/280 e 0 to 1 dl 1555973495 ref 1 fl Rpc:X/0/ffffffff rc 0/-1 [28661.436843] Lustre: 78681:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 4 previous similar messages [28661.436847] Lustre: 78260:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 4 previous similar messages [28661.538427] Lustre: 78255:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 10 previous similar messages [28714.337465] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [28714.349704] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [28714.362242] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [28774.416521] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [28774.429049] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [28774.440795] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [28780.913770] Lustre: 77110:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1555973608/real 1555973608] req@ffff981b85866f00 x1631527062754640/t0(0) o104->fir-OST0023@10.8.17.8@o2ib6:15/16 lens 296/224 e 0 to 1 dl 1555973615 ref 1 fl Rpc:X/0/ffffffff rc 0/-1 [28780.941704] Lustre: 77110:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 543 previous similar messages [28834.388909] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [28834.401276] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [28834.412776] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [28894.405436] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [28894.417904] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [28894.429942] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [28900.516777] Lustre: fir-OST0021: haven't heard from client 31085c4b-3451-1e3d-2ceb-cc5e638ed7de (at 10.8.18.18@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff97fd65f65000, cur 1555973735 expire 1555973585 last 1555973508 [28900.538515] Lustre: Skipped 639 previous similar messages [28954.305690] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [28954.318746] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [28954.330958] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [29014.338616] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [29014.350976] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [29014.362592] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [29074.400882] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [29074.413483] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [29074.425619] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [29134.409110] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [29134.422373] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [29134.434441] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [29194.636595] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [29194.648901] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [29194.660308] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [29195.315520] Lustre: fir-OST0019: Connection restored to 8c15148e-5549-e9e0-0fc2-96fa2b620bad (at 10.8.10.29@o2ib6) [29195.325917] Lustre: Skipped 11 previous similar messages [29254.474539] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [29254.488372] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [29254.500448] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [29314.399605] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [29314.411267] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [29314.422633] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [29348.176454] Lustre: fir-OST0019: Connection restored to (at 10.8.27.18@o2ib6) [29348.183691] Lustre: Skipped 17 previous similar messages [29374.374099] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [29374.385976] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [29374.398289] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [29434.349567] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [29434.361660] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [29434.373441] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [29494.383207] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [29494.396052] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [29494.407831] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [29554.433594] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [29554.446409] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [29554.458729] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [29597.175239] Lustre: fir-OST0019: Connection restored to 62a61082-1a30-1753-8919-cf51bd0b2eb6 (at 10.9.103.3@o2ib4) [29597.185587] Lustre: Skipped 4 previous similar messages [29614.463877] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [29614.476915] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [29614.488783] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [29649.522945] Lustre: fir-OST0019: haven't heard from client 7989cc9b-eadd-c756-d57c-ba56e5cb1993 (at 10.8.8.4@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff97fd67219400, cur 1555974484 expire 1555974334 last 1555974257 [29649.544491] Lustre: Skipped 109 previous similar messages [29674.478396] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [29674.490599] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [29674.502802] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [29734.463685] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [29734.476473] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [29734.488761] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [29794.383246] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [29794.395479] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [29794.408290] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [29799.259167] LustreError: 78698:0:(ldlm_lockd.c:682:ldlm_handle_ast_error()) ### client (nid 10.9.102.17@o2ib4) returned error from blocking AST (req@ffff9809ca114e00 x1631527086210768 status -107 rc -107), evict it ns: filter-fir-OST0021_UUID lock: ffff97febf7bad00/0xd8014830188b9932 lrc: 4/0,0 mode: PR/PR res: [0x980000401:0x91ffca:0x0].0x0 rrc: 34 type: EXT [0->18446744073709551615] (req 268435456->8589934591) flags: 0x60000400000020 nid: 10.9.102.17@o2ib4 remote: 0x194b66c2bfeaf91e expref: 1666 pid: 78532 timeout: 29947 lvb_type: 1 [29799.267483] LustreError: 138-a: fir-OST0021: A client on nid 10.9.102.17@o2ib4 was evicted due to a lock blocking callback time out: rc -107 [29799.267485] LustreError: Skipped 1 previous similar message [29799.267505] LustreError: 77026:0:(ldlm_lockd.c:256:expired_lock_main()) ### lock callback timer expired after 0s: evicting client at 10.9.102.17@o2ib4 ns: filter-fir-OST0021_UUID lock: ffff97f906ac4140/0xd8014830188b46e4 lrc: 3/0,0 mode: PR/PR res: [0x980000401:0x920106:0x0].0x0 rrc: 35 type: EXT [0->18446744073709551615] (req 268435456->8589934591) flags: 0x60000400000020 nid: 10.9.102.17@o2ib4 remote: 0x194b66c2bfeaefc4 expref: 1667 pid: 78634 timeout: 0 lvb_type: 1 [29799.267508] LustreError: 77026:0:(ldlm_lockd.c:256:expired_lock_main()) Skipped 1 previous similar message [29799.375729] LustreError: 78698:0:(ldlm_lockd.c:682:ldlm_handle_ast_error()) Skipped 2 previous similar messages [29799.514822] LustreError: 78448:0:(client.c:1175:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff98048632d700 x1631527086216096/t0(0) o104->fir-OST001d@10.9.102.17@o2ib4:15/16 lens 296/224 e 0 to 0 dl 0 ref 1 fl Rpc:/0/ffffffff rc 0/-1 [29799.535921] LustreError: 78448:0:(client.c:1175:ptlrpc_import_delay_req()) Skipped 22 previous similar messages [29799.779189] LustreError: 78260:0:(ldlm_lockd.c:682:ldlm_handle_ast_error()) ### client (nid 10.9.102.17@o2ib4) returned error from blocking AST (req@ffff97ef8c5da400 x1631527086220976 status -107 rc -107), evict it ns: filter-fir-OST001b_UUID lock: ffff9805f1873f00/0xd8014830188b9971 lrc: 4/0,0 mode: PR/PR res: [0xd00000401:0x92026d:0x0].0x0 rrc: 39 type: EXT [0->18446744073709551615] (req 17179869184->18446744073709551615) flags: 0x60000400000020 nid: 10.9.102.17@o2ib4 remote: 0x194b66c2bfeaf9e9 expref: 1685 pid: 78569 timeout: 29897 lvb_type: 1 [29799.780792] LustreError: 138-a: fir-OST001b: A client on nid 10.9.102.17@o2ib4 was evicted due to a lock blocking callback time out: rc -107 [29799.780794] LustreError: Skipped 4 previous similar messages [29799.845780] LustreError: 78260:0:(ldlm_lockd.c:682:ldlm_handle_ast_error()) Skipped 3 previous similar messages [29855.742055] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [29855.754813] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [29855.766468] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [29914.408599] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [29914.420893] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [29914.433191] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [29974.465722] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [29974.478294] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [29974.490310] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [30035.309189] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [30035.321473] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [30035.333131] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [30074.053686] Lustre: fir-OST0019: Connection restored to 7b132c53-d4cd-2af2-1021-d3b19184bca3 (at 10.9.107.44@o2ib4) [30074.064133] Lustre: Skipped 12 previous similar messages [30094.451793] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [30094.464755] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [30094.476370] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [30154.486302] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [30154.498787] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [30154.510791] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [30215.347545] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [30215.361113] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [30215.373224] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [30274.400798] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [30274.413535] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [30274.425532] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [30334.380423] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [30334.392768] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [30334.404862] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [30357.528552] Lustre: fir-OST0023: haven't heard from client 40d986bb-d0cb-5129-5479-0320c32ae8b9 (at 10.8.18.7@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff97fd69368800, cur 1555975192 expire 1555975042 last 1555974965 [30357.550200] Lustre: Skipped 35 previous similar messages [30394.402488] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [30394.415041] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [30394.426680] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [30454.363625] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [30454.376863] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [30454.388469] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [30514.421152] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [30514.434217] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [30514.446201] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [30574.341170] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [30574.353549] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [30574.365591] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [30681.684791] Lustre: fir-OST0019: Connection restored to 7a34bb1c-15d9-cfde-630c-bbc1c42ca763 (at 10.8.27.33@o2ib6) [30681.695153] Lustre: Skipped 604 previous similar messages [31412.379986] Lustre: fir-OST0019: Connection restored to 70ef6e44-4b1c-8255-8845-5cc3a5ab05ff (at 10.9.107.64@o2ib4) [31412.390420] Lustre: Skipped 130 previous similar messages [31618.539891] Lustre: fir-OST0021: haven't heard from client 587ea0b9-e7ff-8058-1bc0-a978b603fc9d (at 10.8.27.5@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff97fd65f0d400, cur 1555976453 expire 1555976303 last 1555976226 [31618.561534] Lustre: Skipped 29 previous similar messages [31835.574901] Lustre: fir-OST0019: Client e71be1be-a191-6969-1824-6fbb914cebbd (at 10.8.1.5@o2ib6) reconnecting [31835.584818] Lustre: Skipped 1 previous similar message [31836.605796] Lustre: fir-OST0019: Client d3013375-2e90-b76e-c4d8-76867f2b4a32 (at 10.8.2.20@o2ib6) reconnecting [31836.615799] Lustre: Skipped 7 previous similar messages [31843.737560] Lustre: fir-OST001f: Client 9a46a636-d807-725a-1806-a4c05a6a1620 (at 10.8.18.24@o2ib6) reconnecting [31843.747646] Lustre: Skipped 1 previous similar message [31846.148990] Lustre: fir-OST0023: Client 53d4904c-4740-d2bc-cd49-48ac828aa2e4 (at 10.8.1.10@o2ib6) reconnecting [31846.158993] Lustre: Skipped 1 previous similar message [31850.238730] Lustre: fir-OST001d: Client a3eb51f2-1e25-4a80-9ff9-dc67fc518935 (at 10.8.20.16@o2ib6) reconnecting [31850.248820] Lustre: Skipped 5 previous similar messages [31850.569606] LustreError: 137-5: fir-OST001e_UUID: not available for connect from 10.8.16.2@o2ib6 (no target). If you are running an HA pair check that the target is mounted on the other server. [31850.906743] Lustre: 78236:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1555976678/real 0] req@ffff980d2d608300 x1631527138084160/t0(0) o106->fir-OST001d@10.8.17.6@o2ib6:15/16 lens 296/280 e 0 to 1 dl 1555976685 ref 2 fl Rpc:X/0/ffffffff rc 0/-1 [31850.906745] Lustre: 78277:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1555976678/real 0] req@ffff9809ca110c00 x1631527138084144/t0(0) o106->fir-OST0023@10.8.17.6@o2ib6:15/16 lens 296/280 e 0 to 1 dl 1555976685 ref 2 fl Rpc:X/0/ffffffff rc 0/-1 [31850.906749] Lustre: 78277:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 73 previous similar messages [31859.665314] LustreError: 137-5: fir-OST001c_UUID: not available for connect from 10.8.1.11@o2ib6 (no target). If you are running an HA pair check that the target is mounted on the other server. [31859.682534] LustreError: Skipped 2 previous similar messages [31860.595932] Lustre: fir-OST0023: Client 5483b434-bcd6-aaf1-da57-b35b3900df09 (at 10.8.17.6@o2ib6) reconnecting [31860.605972] Lustre: Skipped 47 previous similar messages [31860.813080] LustreError: 137-5: fir-OST001a_UUID: not available for connect from 10.8.28.8@o2ib6 (no target). If you are running an HA pair check that the target is mounted on the other server. [31860.830300] LustreError: Skipped 27 previous similar messages [31862.824702] LustreError: 137-5: fir-OST0018_UUID: not available for connect from 10.8.12.16@o2ib6 (no target). If you are running an HA pair check that the target is mounted on the other server. [31862.841989] LustreError: Skipped 117 previous similar messages [31864.605822] LustreError: 78745:0:(ldlm_lib.c:3258:target_bulk_io()) @@@ Reconnect on bulk WRITE req@ffff980d286f4450 x1631388866339984/t0(0) o4->63d5b964-3268-0813-20ce-ce2c87bbd1d8@10.8.29.2@o2ib6:252/0 lens 488/448 e 0 to 0 dl 1555976732 ref 1 fl Interpret:/0/0 rc 0/0 [31865.365829] LustreError: 78955:0:(ldlm_lib.c:3258:target_bulk_io()) @@@ Reconnect on bulk WRITE req@ffff980d22e7b850 x1631388866339728/t0(0) o4->63d5b964-3268-0813-20ce-ce2c87bbd1d8@10.8.29.2@o2ib6:251/0 lens 488/448 e 0 to 0 dl 1555976731 ref 1 fl Interpret:/0/0 rc 0/0 [31865.389785] LustreError: 78955:0:(ldlm_lib.c:3258:target_bulk_io()) Skipped 2 previous similar messages [31865.653119] LNetError: 74204:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (-125, 0) [31865.653126] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9818ab8a5c00 [31865.653134] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9818ab8a5c00 [31865.687210] LNetError: 74204:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 2 previous similar messages [31865.696816] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9818ab8a5c00 [31865.707969] Lustre: fir-OST0023: Bulk IO write error with 63d5b964-3268-0813-20ce-ce2c87bbd1d8 (at 10.8.29.2@o2ib6), client will retry: rc = -110 [31865.926066] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9815bf761200 [31865.936870] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9815bf761200 [31865.947681] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9815bf761200 [31866.364641] LNetError: 74204:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (-125, 0) [31866.377157] LNetError: 74204:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 3 previous similar messages [31866.386742] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9813c7768200 [31866.542604] Lustre: fir-OST001f: haven't heard from client f3323a92-51ab-836f-42e3-c1fd4bff7b2d (at 10.9.102.45@o2ib4) in 227 seconds. I think it's dead, and I am evicting it. exp ffff980d271e8000, cur 1555976701 expire 1555976551 last 1555976474 [31866.564418] Lustre: Skipped 11 previous similar messages [31866.827996] LustreError: 137-5: fir-OST001a_UUID: not available for connect from 10.8.17.9@o2ib6 (no target). If you are running an HA pair check that the target is mounted on the other server. [31866.845205] LustreError: Skipped 333 previous similar messages [31867.540599] LNetError: 74203:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (-125, 0) [31867.540601] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981c9acba000 [31867.540607] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981c9acba000 [31867.540612] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981c9acba000 [31867.585473] LNetError: 74203:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 3 previous similar messages [31867.595056] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981c9acba000 [31867.606081] Lustre: fir-OST0023: Bulk IO write error with 63d5b964-3268-0813-20ce-ce2c87bbd1d8 (at 10.8.29.2@o2ib6), client will retry: rc = -110 [31868.562364] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9812e0a31800 [31868.573166] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9812e0a31800 [31869.128871] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9815bf761200 [31869.139999] Lustre: fir-OST0023: Bulk IO write error with 63d5b964-3268-0813-20ce-ce2c87bbd1d8 (at 10.8.29.2@o2ib6), client will retry: rc = -110 [31869.153056] Lustre: Skipped 1 previous similar message [31869.423647] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9813c7768200 [31869.434431] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9813c7768200 [31869.445217] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9813c7768200 [31870.109549] LNetError: 74207:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (-125, 0) [31870.109570] LustreError: 74206:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9813c776cc00 [31870.132852] LNetError: 74207:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 7 previous similar messages [31870.142428] LustreError: 74207:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9813c776cc00 [31872.326888] LustreError: 78806:0:(ldlm_lib.c:3258:target_bulk_io()) @@@ Reconnect on bulk WRITE req@ffff97fd6c3db050 x1631354477947488/t0(0) o4->334d5bc3-122f-b515-8402-3988f1cde106@10.8.21.11@o2ib6:245/0 lens 488/448 e 1 to 0 dl 1555976725 ref 1 fl Interpret:/0/0 rc 0/0 [31872.350943] LustreError: 78806:0:(ldlm_lib.c:3258:target_bulk_io()) Skipped 2 previous similar messages [31873.346893] Lustre: 78526:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1555976700/real 0] req@ffff97f2b3668900 x1631527138303872/t0(0) o106->fir-OST001f@10.8.24.4@o2ib6:15/16 lens 296/280 e 0 to 1 dl 1555976707 ref 2 fl Rpc:X/0/ffffffff rc 0/-1 [31873.373350] Lustre: 78526:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 19 previous similar messages [31875.044910] LustreError: 78203:0:(ldlm_lib.c:3258:target_bulk_io()) @@@ Reconnect on bulk WRITE req@ffff980d283e1850 x1631297517482128/t0(0) o4->130fb955-2b99-d619-6270-f89e88668cb4@10.8.1.14@o2ib6:253/0 lens 488/448 e 1 to 0 dl 1555976733 ref 1 fl Interpret:/0/0 rc 0/0 [31875.049233] LustreError: 137-5: fir-OST0018_UUID: not available for connect from 10.8.8.26@o2ib6 (no target). If you are running an HA pair check that the target is mounted on the other server. [31875.049235] LustreError: Skipped 489 previous similar messages [31875.337669] LNetError: 74204:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (-125, 0) [31875.337735] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9818ab8a3800 [31875.337746] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9818ab8a3800 [31875.371758] LNetError: 74204:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 2 previous similar messages [31875.381330] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981406865200 [31875.789135] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981bb3245000 [31875.799921] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981bb3245000 [31875.810707] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981bb3245000 [31876.602315] Lustre: fir-OST0021: Client 130fb955-2b99-d619-6270-f89e88668cb4 (at 10.8.1.14@o2ib6) reconnecting [31876.612341] Lustre: Skipped 76 previous similar messages [31876.767286] LustreError: 74197:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f7019eee00 [31876.778179] Lustre: fir-OST001b: Bulk IO write error with 334d5bc3-122f-b515-8402-3988f1cde106 (at 10.8.21.11@o2ib6), client will retry: rc = -110 [31876.791320] Lustre: Skipped 2 previous similar messages [31879.350731] LustreError: 74199:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98193bcca200 [31879.361521] LustreError: 74200:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98193bcca200 [31880.234955] LustreError: 78545:0:(ldlm_lib.c:3258:target_bulk_io()) @@@ Reconnect on bulk WRITE req@ffff981d055cd450 x1631532779065728/t0(0) o4->506318f6-b5b6-ef99-7965-ae594cbcc62c@10.8.8.15@o2ib6:274/0 lens 488/448 e 0 to 0 dl 1555976754 ref 1 fl Interpret:/0/0 rc 0/0 [31880.258947] LustreError: 78545:0:(ldlm_lib.c:3258:target_bulk_io()) Skipped 4 previous similar messages [31881.973014] LustreError: 74207:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981406865200 [31881.973031] LustreError: 74206:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98193bcca200 [31881.973038] LustreError: 74206:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98193bcca200 [31881.973283] Lustre: fir-OST001f: Bulk IO write error with 130fb955-2b99-d619-6270-f89e88668cb4 (at 10.8.1.14@o2ib6), client will retry: rc = -110 [31882.018410] LustreError: 74205:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981406865200 [31883.119086] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981406865200 [31883.119598] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9818ab8a3800 [31883.119603] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9818ab8a3800 [31883.740777] LNetError: 74202:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (-125, 0) [31883.753296] LNetError: 74202:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 12 previous similar messages [31883.762956] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981bb3245000 [31884.004505] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9813b790c600 [31889.006704] LustreError: 74206:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9818d7083a00 [31891.443172] LustreError: 137-5: fir-OST001e_UUID: not available for connect from 10.8.27.18@o2ib6 (no target). If you are running an HA pair check that the target is mounted on the other server. [31891.460453] LustreError: Skipped 42 previous similar messages [31908.810776] Lustre: fir-OST0023: Client 1135836c-5fb6-92af-ade3-8ef6cf526018 (at 10.8.27.9@o2ib6) reconnecting [31908.820776] Lustre: Skipped 96 previous similar messages [31912.249214] Lustre: 78605:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1555976739/real 0] req@ffff982c32c98600 x1631527138757728/t0(0) o104->fir-OST0021@10.8.0.67@o2ib6:15/16 lens 296/224 e 0 to 1 dl 1555976746 ref 2 fl Rpc:X/0/ffffffff rc 0/-1 [31912.275603] Lustre: 78605:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 26 previous similar messages [31923.494704] LustreError: 137-5: fir-OST001c_UUID: not available for connect from 10.8.23.13@o2ib6 (no target). If you are running an HA pair check that the target is mounted on the other server. [31923.512018] LustreError: Skipped 640 previous similar messages [31992.500211] Lustre: fir-OST0019: Client da84e749-aae7-e201-4af5-a27465c5b762 (at 10.8.0.65@o2ib6) reconnecting [31992.510229] Lustre: Skipped 50 previous similar messages [32014.669340] Lustre: fir-OST0019: Connection restored to 39b21bb1-06bc-8c69-c9c3-5986c42b070c (at 10.8.0.65@o2ib6) [32014.679607] Lustre: Skipped 321 previous similar messages [32045.436313] Lustre: 78748:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1555976872/real 0] req@ffff981bc75ba100 x1631527140376336/t0(0) o104->fir-OST001d@10.8.8.32@o2ib6:15/16 lens 296/224 e 0 to 1 dl 1555976879 ref 2 fl Rpc:X/0/ffffffff rc 0/-1 [32045.462744] Lustre: 78748:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 17 previous similar messages [32054.776258] LustreError: 137-5: fir-OST0020_UUID: not available for connect from 10.8.0.65@o2ib6 (no target). If you are running an HA pair check that the target is mounted on the other server. [32054.793468] LustreError: Skipped 102 previous similar messages [32298.545751] Lustre: fir-OST001b: haven't heard from client a6c677eb-4ace-e7b4-4376-24acf7debcee (at 10.9.108.51@o2ib4) in 227 seconds. I think it's dead, and I am evicting it. exp ffff97fd6c2f2800, cur 1555977133 expire 1555976983 last 1555976906 [32298.567581] Lustre: Skipped 5 previous similar messages [32672.116784] LustreError: 137-5: fir-OST0020_UUID: not available for connect from 10.8.0.65@o2ib6 (no target). If you are running an HA pair check that the target is mounted on the other server. [32672.133986] LustreError: Skipped 2 previous similar messages [32672.577159] Lustre: fir-OST001b: Client da84e749-aae7-e201-4af5-a27465c5b762 (at 10.8.0.65@o2ib6) reconnecting [32672.587171] Lustre: Skipped 9 previous similar messages [32672.592473] Lustre: fir-OST001b: Connection restored to 39b21bb1-06bc-8c69-c9c3-5986c42b070c (at 10.8.0.65@o2ib6) [32672.602757] Lustre: Skipped 26 previous similar messages [32716.556905] Lustre: fir-OST001d: haven't heard from client 24a34926-dd8c-21dc-b1ff-31d591ccefa0 (at 10.9.102.61@o2ib4) in 171 seconds. I think it's dead, and I am evicting it. exp ffff980d280fdc00, cur 1555977551 expire 1555977401 last 1555977380 [32716.578752] Lustre: Skipped 17 previous similar messages [33106.260364] Lustre: 78337:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1555977933/real 0] req@ffff9806ec285400 x1631527154727296/t0(0) o104->fir-OST001b@10.8.22.12@o2ib6:15/16 lens 296/224 e 0 to 1 dl 1555977940 ref 2 fl Rpc:X/0/ffffffff rc 0/-1 [33106.286854] Lustre: 78337:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 79 previous similar messages [33108.222698] Lustre: fir-OST0021: Client b56a1ec8-0b0a-d175-8a94-cceee8d14724 (at 10.8.12.2@o2ib6) reconnecting [33108.232726] Lustre: Skipped 12 previous similar messages [33122.162669] LustreError: 137-5: fir-OST001e_UUID: not available for connect from 10.8.16.3@o2ib6 (no target). If you are running an HA pair check that the target is mounted on the other server. [33137.205619] LustreError: 78980:0:(ldlm_lib.c:3258:target_bulk_io()) @@@ Reconnect on bulk READ req@ffff981d81edbc50 x1631542358454240/t0(0) o3->f2a4d35e-05ff-fe02-d6c7-6c183d27b8a1@10.8.8.29@o2ib6:13/0 lens 488/440 e 0 to 0 dl 1555978003 ref 1 fl Interpret:/0/0 rc 0/0 [33141.060647] LustreError: 78659:0:(ldlm_lib.c:3258:target_bulk_io()) @@@ Reconnect on bulk WRITE req@ffff980d4423c850 x1631534848236304/t0(0) o4->13458280-a046-3a7f-2bec-0301aba013a1@10.8.28.12@o2ib6:20/0 lens 488/448 e 0 to 0 dl 1555978010 ref 1 fl Interpret:/0/0 rc 0/0 [33141.084614] LustreError: 78659:0:(ldlm_lib.c:3258:target_bulk_io()) Skipped 2 previous similar messages [33145.107850] LNetError: 74205:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (-125, 0) [33145.120391] LNetError: 74205:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 2 previous similar messages [33145.129966] LustreError: 74205:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98216e2e0c00 [33145.140796] Lustre: fir-OST0019: Bulk IO read error with f2a4d35e-05ff-fe02-d6c7-6c183d27b8a1 (at 10.8.8.29@o2ib6), client will retry: rc -110 [33145.229384] LustreError: 74199:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981a69dcd800 [33145.240211] Lustre: fir-OST0019: Bulk IO write error with f2a4d35e-05ff-fe02-d6c7-6c183d27b8a1 (at 10.8.8.29@o2ib6), client will retry: rc = -110 [33145.240504] LustreError: 74198:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981769f47000 [33145.264048] Lustre: Skipped 6 previous similar messages [33145.959691] Lustre: 78328:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1555977973/real 0] req@ffff97fd5315ce00 x1631527155281680/t0(0) o104->fir-OST001b@10.8.27.35@o2ib6:15/16 lens 296/224 e 0 to 1 dl 1555977980 ref 2 fl Rpc:X/0/ffffffff rc 0/-1 [33145.986207] Lustre: 78328:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 22 previous similar messages [33147.200697] LustreError: 78801:0:(ldlm_lib.c:3258:target_bulk_io()) @@@ Reconnect on bulk READ req@ffff980d1cec6450 x1631530955512192/t0(0) o3->220c5a2f-2274-34f0-c226-fa1f26d20160@10.8.1.29@o2ib6:23/0 lens 488/440 e 0 to 0 dl 1555978013 ref 1 fl Interpret:/0/0 rc 0/0 [33152.035558] LNetError: 74197:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (-125, 0) [33152.048085] LNetError: 74197:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 2 previous similar messages [33152.057698] LustreError: 74197:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98188d6ce600 [33152.068533] Lustre: fir-OST001b: Bulk IO write error with 13458280-a046-3a7f-2bec-0301aba013a1 (at 10.8.28.12@o2ib6), client will retry: rc = -110 [33152.768777] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980f6cf14e00 [33152.779584] Lustre: fir-OST0023: Bulk IO read error with 220c5a2f-2274-34f0-c226-fa1f26d20160 (at 10.8.1.29@o2ib6), client will retry: rc -110 [33186.115996] Lustre: 78269:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1555978013/real 0] req@ffff982bc3947b00 x1631527155577120/t0(0) o106->fir-OST0023@10.8.16.8@o2ib6:15/16 lens 296/280 e 0 to 1 dl 1555978020 ref 2 fl Rpc:X/0/ffffffff rc 0/-1 [33186.142404] Lustre: 78269:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 5 previous similar messages [33218.916265] LustreError: 78944:0:(ldlm_lib.c:3258:target_bulk_io()) @@@ Reconnect on bulk READ req@ffff980d28699c50 x1628574201068112/t0(0) o3->48ad4899-3290-6782-9ecf-45ee04445b6e@10.8.1.27@o2ib6:74/0 lens 488/440 e 0 to 0 dl 1555978064 ref 1 fl Interpret:/0/0 rc 0/0 [33227.326038] LNetError: 74203:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (-125, 0) [33227.335955] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981950905200 [33227.335961] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981950905200 [33227.360161] LNetError: 74203:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 3 previous similar messages [33227.369760] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981950905200 [33227.380708] Lustre: fir-OST001b: Bulk IO write error with 48ad4899-3290-6782-9ecf-45ee04445b6e (at 10.8.1.27@o2ib6), client will retry: rc = -110 [33228.918342] LustreError: 78855:0:(ldlm_lib.c:3258:target_bulk_io()) @@@ Reconnect on bulk WRITE req@ffff980d26dbfc50 x1631531243316656/t0(0) o4->f3bba4e8-9568-4001-6257-88537741a8c9@10.8.29.3@o2ib6:111/0 lens 488/448 e 0 to 0 dl 1555978101 ref 1 fl Interpret:/0/0 rc 0/0 [33228.942311] LustreError: 78855:0:(ldlm_lib.c:3258:target_bulk_io()) Skipped 3 previous similar messages [33232.024998] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9810f8319600 [33232.035925] Lustre: fir-OST0023: Bulk IO read error with 48ad4899-3290-6782-9ecf-45ee04445b6e (at 10.8.1.27@o2ib6), client will retry: rc -110 [33235.967108] LNetError: 74204:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (-125, 0) [33235.979622] LNetError: 74204:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 1 previous similar message [33235.989108] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9819b0a02600 [33235.999947] Lustre: fir-OST0019: Bulk IO read error with e71be1be-a191-6969-1824-6fbb914cebbd (at 10.8.1.5@o2ib6), client will retry: rc -110 [33242.278452] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97faf1d20200 [33242.289260] Lustre: fir-OST0019: Bulk IO read error with e71be1be-a191-6969-1824-6fbb914cebbd (at 10.8.1.5@o2ib6), client will retry: rc -110 [33242.751874] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9828c5b7d000 [33245.079455] LustreError: 78971:0:(ldlm_lib.c:3258:target_bulk_io()) @@@ Reconnect on bulk READ req@ffff981ce913e850 x1631545977947152/t0(0) o3->10947b9b-0f5a-c39c-5999-172515a96889@10.8.8.10@o2ib6:96/0 lens 488/440 e 0 to 0 dl 1555978086 ref 1 fl Interpret:/0/0 rc 0/0 [33245.103267] LustreError: 78971:0:(ldlm_lib.c:3258:target_bulk_io()) Skipped 15 previous similar messages [33248.706974] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98121cd82400 [33248.717761] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98121cd82400 [33248.728562] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98121cd82400 [33250.959731] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980f92cea600 [33250.970547] Lustre: fir-OST001b: Bulk IO read error with 10947b9b-0f5a-c39c-5999-172515a96889 (at 10.8.8.10@o2ib6), client will retry: rc -110 [33250.983353] Lustre: Skipped 1 previous similar message [33255.431146] LNetError: 74206:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (-125, 0) [33255.443659] LNetError: 74206:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 6 previous similar messages [33255.453234] LustreError: 74206:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98121cd82400 [33255.464024] LustreError: 74205:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98121cd82400 [33255.957012] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980d271b1800 [33255.967809] LustreError: 78597:0:(ldlm_lib.c:3264:target_bulk_io()) @@@ network error on bulk READ req@ffff980dba673850 x1631343916533200/t0(0) o3->7bd3af25-bee7-c5ba-c622-d03b941d9a42@10.8.29.6@o2ib6:120/0 lens 488/440 e 1 to 0 dl 1555978110 ref 1 fl Interpret:/0/0 rc 0/0 [33256.120259] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9801be9c2000 [33256.308392] LustreError: 74200:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98131fba9200 [33256.994113] LustreError: 74200:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f9b03d2000 [33257.004960] LustreError: 78538:0:(ldlm_lib.c:3264:target_bulk_io()) @@@ network error on bulk READ req@ffff981ce5060450 x1631534629900080/t0(0) o3->6a18ff26-2f90-35f3-8dc0-c084882f2a83@10.8.18.15@o2ib6:114/0 lens 488/440 e 1 to 0 dl 1555978104 ref 1 fl Interpret:/0/0 rc 0/0 [33258.197630] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980e42991e00 [33258.833998] LustreError: 74198:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98121cd82400 [33258.844852] LustreError: 74199:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98121cd82400 [33258.855650] LustreError: 74200:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98121cd82400 [33258.866837] Lustre: fir-OST0023: Bulk IO write error with d8d6f8e7-a2cd-08f2-c263-fa8b0dbeef3c (at 10.8.8.2@o2ib6), client will retry: rc = -110 [33259.395142] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9809d25fda00 [33259.982452] LustreError: 74197:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f17b72c600 [33260.481327] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981911775800 [33264.708525] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981060dbf400 [33264.719314] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981060dbf400 [33265.105141] LustreError: 74200:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98162d00b600 [33265.116810] LustreError: 78557:0:(ldlm_lib.c:3264:target_bulk_io()) @@@ network error on bulk READ req@ffff981d812f6850 x1631343916533216/t0(0) o3->7bd3af25-bee7-c5ba-c622-d03b941d9a42@10.8.29.6@o2ib6:119/0 lens 488/440 e 1 to 0 dl 1555978109 ref 1 fl Interpret:/0/0 rc 0/0 [33266.147645] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980f2e530000 [33271.170662] Lustre: 78233:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1555978098/real 0] req@ffff9814f2811e00 x1631527156614864/t0(0) o104->fir-OST001d@10.8.11.26@o2ib6:15/16 lens 296/224 e 0 to 1 dl 1555978105 ref 2 fl Rpc:X/0/ffffffff rc 0/-1 [33271.197154] Lustre: 78233:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 57 previous similar messages [33271.408991] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981701acc400 [33271.419795] Lustre: fir-OST001b: Bulk IO read error with 0999e316-ce2c-a6bc-71b8-0d9ed833e65c (at 10.8.8.19@o2ib6), client will retry: rc -110 [33271.432579] Lustre: Skipped 10 previous similar messages [33272.016468] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981b6e228a00 [33272.925346] Lustre: fir-OST001d: Connection restored to 7c2082f9-ca3e-a283-6a5a-57008e95037a (at 10.8.16.5@o2ib6) [33272.935615] Lustre: Skipped 237 previous similar messages [33273.343478] LustreError: 74208:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981389034800 [33273.532632] LustreError: 74197:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981060dbf400 [33273.543581] Lustre: fir-OST0019: Bulk IO write error with f3bba4e8-9568-4001-6257-88537741a8c9 (at 10.8.29.3@o2ib6), client will retry: rc = -110 [33277.227878] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f8e5961000 [33277.238667] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f8e5961000 [33280.682543] LustreError: 74198:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97fb8288e200 [33282.243076] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff982c435dd200 [33283.728254] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9810861ad200 [33283.877066] LustreError: 74205:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981696320400 [33283.964498] LustreError: 74206:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98172d2a5c00 [33283.975290] LustreError: 74208:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98172d2a5c00 [33283.986105] LustreError: 74206:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98172d2a5c00 [33285.777833] LustreError: 74200:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97fb65348a00 [33287.296082] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9816ec813e00 [33287.306871] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9816ec813e00 [33287.317648] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9816ec813e00 [33288.662913] LNetError: 74203:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (-125, 0) [33288.675431] LNetError: 74203:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 33 previous similar messages [33288.685085] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980e3fd39a00 [33293.369216] LustreError: 74206:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981a13353800 [33297.163895] LustreError: 74200:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f0d97fae00 [33297.174725] LustreError: 74200:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f0d97fae00 [33298.765062] LustreError: 74208:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f0d97fae00 [33298.775860] LustreError: 77081:0:(ldlm_lib.c:3264:target_bulk_io()) @@@ network error on bulk WRITE req@ffff97fd6bdc5c50 x1631542627712288/t0(0) o4->be42b497-ab1b-8d58-3101-014aad577cfc@10.8.27.35@o2ib6:169/0 lens 488/448 e 2 to 0 dl 1555978159 ref 1 fl Interpret:/0/0 rc 0/0 [33298.800462] Lustre: fir-OST0021: Bulk IO write error with be42b497-ab1b-8d58-3101-014aad577cfc (at 10.8.27.35@o2ib6), client will retry: rc = -110 [33298.813595] Lustre: Skipped 3 previous similar messages [33299.725890] LustreError: 78759:0:(ldlm_lib.c:3258:target_bulk_io()) @@@ Reconnect on bulk WRITE req@ffff980d2719c850 x1631385738854320/t0(0) o4->ef5f6b7b-5844-0e36-bcbe-e166ef8ee02e@10.8.25.30@o2ib6:159/0 lens 488/448 e 0 to 0 dl 1555978149 ref 1 fl Interpret:/0/0 rc 0/0 [33299.749936] LustreError: 78759:0:(ldlm_lib.c:3258:target_bulk_io()) Skipped 9 previous similar messages [33300.715581] LustreError: 74208:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97fb438f0a00 [33309.080340] LustreError: 74205:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98129ff48200 [33309.091170] Lustre: fir-OST0023: Bulk IO read error with 40b4489c-e33b-9953-2721-000829105f18 (at 10.8.11.17@o2ib6), client will retry: rc -110 [33309.104100] Lustre: Skipped 10 previous similar messages [33324.529377] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980b1ac97200 [33324.540173] LustreError: 78935:0:(ldlm_lib.c:3264:target_bulk_io()) @@@ network error on bulk WRITE req@ffff980d28699c50 x1631313732732992/t0(0) o4->24f54b66-220b-e07b-5df6-a50a2f3914f4@10.8.24.5@o2ib6:195/0 lens 488/448 e 1 to 0 dl 1555978185 ref 1 fl Interpret:/0/0 rc 0/0 [33335.594438] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff982a0e79fa00 [33335.605241] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff982a0e79fa00 [33335.616021] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff982a0e79fa00 [33336.245233] LustreError: 74198:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff982a0e79fa00 [33336.256120] LustreError: 79031:0:(ldlm_lib.c:3264:target_bulk_io()) @@@ network error on bulk WRITE req@ffff981ce5067050 x1631542370230352/t0(0) o4->69e867f7-2c34-9281-0411-6ff880d43ef5@10.8.28.11@o2ib6:194/0 lens 488/448 e 1 to 0 dl 1555978184 ref 1 fl Interpret:/0/0 rc 0/0 [33336.280693] Lustre: fir-OST001d: Bulk IO write error with 69e867f7-2c34-9281-0411-6ff880d43ef5 (at 10.8.28.11@o2ib6), client will retry: rc = -110 [33336.293818] Lustre: Skipped 1 previous similar message [33336.936364] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98138e13ca00 [33357.910198] LNetError: 74203:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (-125, 0) [33357.922715] LNetError: 74203:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 12 previous similar messages [33357.932371] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f55da32e00 [33357.943201] LustreError: 78766:0:(ldlm_lib.c:3264:target_bulk_io()) @@@ network error on bulk WRITE req@ffff97fd6c24f450 x1631314993964096/t0(0) o4->dde3f93f-7c4d-1b05-310b-76ee9ba5edc9@10.8.13.3@o2ib6:228/0 lens 488/448 e 1 to 0 dl 1555978218 ref 1 fl Interpret:/0/0 rc 0/0 [33360.847160] LustreError: 74200:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981a615f8800 [33360.847162] LustreError: 74197:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9817850c7200 [33360.847166] LustreError: 74198:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9817850c7200 [33360.847169] LustreError: 74197:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9817850c7200 [33363.781213] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9817850c7200 [33413.640831] LustreError: 77081:0:(ldlm_lib.c:3258:target_bulk_io()) @@@ Reconnect on bulk WRITE req@ffff97fd6702c850 x1631534688481520/t0(0) o4->820961b3-2494-2624-1872-4e954309f717@10.8.7.23@o2ib6:282/0 lens 488/448 e 1 to 0 dl 1555978272 ref 1 fl Interpret:/0/0 rc 0/0 [33413.664849] LustreError: 77081:0:(ldlm_lib.c:3258:target_bulk_io()) Skipped 2 previous similar messages [33422.119918] Lustre: 78547:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1555978249/real 0] req@ffff98059cfda100 x1631527158372816/t0(0) o106->fir-OST001d@10.8.10.4@o2ib6:15/16 lens 296/280 e 0 to 1 dl 1555978256 ref 2 fl Rpc:X/0/ffffffff rc 0/-1 [33422.146360] Lustre: 78547:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 44 previous similar messages [33423.899939] LustreError: 77026:0:(ldlm_lockd.c:256:expired_lock_main()) ### lock callback timer expired after 99s: evicting client at 10.8.12.6@o2ib6 ns: filter-fir-OST0023_UUID lock: ffff9810e0c70d80/0xd80148300fecdcc7 lrc: 4/0,0 mode: PR/PR res: [0xd40000402:0x5749d4:0x0].0x0 rrc: 17 type: EXT [0->18446744073709551615] (req 131072->16777215) flags: 0x60000400000020 nid: 10.8.12.6@o2ib6 remote: 0x8c4435f66fb11489 expref: 877 pid: 78692 timeout: 33422 lvb_type: 1 [33423.940986] LustreError: 77026:0:(ldlm_lockd.c:256:expired_lock_main()) Skipped 5 previous similar messages [33442.216746] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f5a434b200 [33442.227532] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f5a434b200 [33442.238310] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f5a434b200 [33443.073840] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98017967fe00 [33443.084637] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98017967fe00 [33443.095461] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98017967fe00 [33443.310515] LustreError: 74208:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98017967fe00 [33443.321309] LustreError: 74205:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98017967fe00 [33443.332109] LustreError: 74208:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98017967fe00 [33443.342926] LustreError: 74205:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98017967fe00 [33445.380117] LNetError: 74195:0:(o2iblnd_cb.c:3324:kiblnd_check_txs_locked()) Timed out tx: tx_queue, 0 seconds [33445.390114] LNetError: 74195:0:(o2iblnd_cb.c:3399:kiblnd_check_conns()) Timed out RDMA with 10.0.10.202@o2ib7 (0): c: 0, oc: 1, rc: 8 [33452.380174] LNetError: 74195:0:(o2iblnd_cb.c:3324:kiblnd_check_txs_locked()) Timed out tx: tx_queue, 1 seconds [33452.390174] LNetError: 74195:0:(o2iblnd_cb.c:3324:kiblnd_check_txs_locked()) Skipped 1 previous similar message [33452.400256] LNetError: 74195:0:(o2iblnd_cb.c:3399:kiblnd_check_conns()) Timed out RDMA with 10.0.10.202@o2ib7 (0): c: 0, oc: 2, rc: 8 [33452.412239] LNetError: 74195:0:(o2iblnd_cb.c:3399:kiblnd_check_conns()) Skipped 1 previous similar message [33455.546696] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981701acbe00 [33455.557524] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981701acbe00 [33455.568321] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981701acbe00 [33456.380204] LNetError: 74195:0:(o2iblnd_cb.c:3324:kiblnd_check_txs_locked()) Timed out tx: tx_queue, 0 seconds [33456.390213] LNetError: 74195:0:(o2iblnd_cb.c:3399:kiblnd_check_conns()) Timed out RDMA with 10.0.10.204@o2ib7 (0): c: 0, oc: 2, rc: 8 [33457.362357] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f5a434b200 [33457.373141] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f5a434b200 [33457.383931] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f5a434b200 [33457.394723] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f5a434b200 [33457.405511] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f5a434b200 [33457.417593] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98017967fe00 [33457.428408] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98017967fe00 [33457.439196] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98017967fe00 [33457.449978] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98017967fe00 [33457.482568] LustreError: 74197:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f5a434b200 [33457.493359] LustreError: 74200:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f5a434b200 [33457.504188] LustreError: 74199:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f5a434b200 [33457.514981] LustreError: 74197:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f5a434b200 [33457.525812] LustreError: 74200:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f5a434b200 [33457.536605] LustreError: 74198:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f5a434b200 [33457.547390] LustreError: 74199:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f5a434b200 [33457.558210] LustreError: 74197:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f5a434b200 [33457.569533] LustreError: 74197:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98017967fe00 [33457.569557] Lustre: fir-OST001d: Bulk IO write error with 69e867f7-2c34-9281-0411-6ff880d43ef5 (at 10.8.28.11@o2ib6), client will retry: rc = -110 [33457.569559] Lustre: Skipped 4 previous similar messages [33457.598690] LustreError: 74198:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98017967fe00 [33457.609472] LustreError: 74199:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98017967fe00 [33457.620281] LustreError: 74197:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98017967fe00 [33457.631107] LustreError: 74198:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98017967fe00 [33457.650833] LustreError: 74198:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981701acbe00 [33457.661659] LustreError: 74200:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981701acbe00 [33457.714628] LustreError: 74199:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f2ef4d5800 [33457.764310] LustreError: 130457:0:(ldlm_lockd.c:2322:ldlm_cancel_handler()) ldlm_cancel from 10.8.12.6@o2ib6 arrived at 1555978292 with bad export cookie 15564801158135060764 [33457.771053] LustreError: 74200:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9815bc287000 [33457.771058] LustreError: 74198:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9815bc287000 [33457.802572] LustreError: 130457:0:(ldlm_lockd.c:2322:ldlm_cancel_handler()) Skipped 1 previous similar message [33458.771722] LustreError: 74207:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981701acbe00 [33458.782512] LustreError: 74207:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981701acbe00 [33462.998257] LustreError: 78730:0:(ldlm_lib.c:3248:target_bulk_io()) @@@ timeout on bulk READ after 100+0s req@ffff97edd7026450 x1628739435219504/t0(0) o3->d22641c5-00df-8cff-00b3-7a4f6484bd1f@10.8.2.16@o2ib6:330/0 lens 488/440 e 2 to 0 dl 1555978320 ref 1 fl Interpret:/0/0 rc 0/0 [33463.380267] LNetError: 74195:0:(o2iblnd_cb.c:3324:kiblnd_check_txs_locked()) Timed out tx: tx_queue, 0 seconds [33463.390266] LNetError: 74195:0:(o2iblnd_cb.c:3399:kiblnd_check_conns()) Timed out RDMA with 10.0.10.202@o2ib7 (0): c: 0, oc: 0, rc: 8 [33469.380315] LNetError: 74195:0:(o2iblnd_cb.c:3324:kiblnd_check_txs_locked()) Timed out tx: tx_queue, 0 seconds [33469.390311] LNetError: 74195:0:(o2iblnd_cb.c:3324:kiblnd_check_txs_locked()) Skipped 1 previous similar message [33469.400392] LNetError: 74195:0:(o2iblnd_cb.c:3399:kiblnd_check_conns()) Timed out RDMA with 10.0.10.202@o2ib7 (0): c: 0, oc: 1, rc: 8 [33469.412374] LNetError: 74195:0:(o2iblnd_cb.c:3399:kiblnd_check_conns()) Skipped 1 previous similar message [33475.555224] Lustre: fir-OST001f: haven't heard from client 469d3c01-0ba5-8df1-fade-b379f197d2fe (at 10.8.27.33@o2ib6) in 176 seconds. I think it's dead, and I am evicting it. exp ffff981ce7cd4800, cur 1555978310 expire 1555978160 last 1555978134 [33475.576952] Lustre: Skipped 53 previous similar messages [33500.227569] LustreError: 78801:0:(ldlm_lib.c:3248:target_bulk_io()) @@@ timeout on bulk WRITE after 100+0s req@ffff980d26dbe050 x1631316145361184/t0(0) o4->78f9401d-53ab-f909-d2db-c4b85cdb93e0@10.8.10.16@o2ib6:365/0 lens 488/448 e 1 to 0 dl 1555978355 ref 1 fl Interpret:/0/0 rc 0/0 [33510.900664] LustreError: 77026:0:(ldlm_lockd.c:256:expired_lock_main()) ### lock callback timer expired after 186s: evicting client at 10.8.7.23@o2ib6 ns: filter-fir-OST0023_UUID lock: ffff980307915580/0xd801483028eebfae lrc: 4/0,0 mode: PR/PR res: [0xd40000402:0x5749d4:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 131072->16777215) flags: 0x60000400000020 nid: 10.8.7.23@o2ib6 remote: 0x528db62d89c24cf0 expref: 892 pid: 78712 timeout: 33509 lvb_type: 1 [33510.941822] LustreError: 77026:0:(ldlm_lockd.c:256:expired_lock_main()) Skipped 6 previous similar messages [33513.620218] LustreError: 80752:0:(ldlm_lockd.c:2322:ldlm_cancel_handler()) ldlm_cancel from 10.8.17.24@o2ib6 arrived at 1555978348 with bad export cookie 15564801158135055794 [33513.620219] LustreError: 77016:0:(ldlm_lockd.c:2322:ldlm_cancel_handler()) ldlm_cancel from 10.8.17.24@o2ib6 arrived at 1555978348 with bad export cookie 15564801158135055794 [33513.620223] LustreError: 77016:0:(ldlm_lockd.c:2322:ldlm_cancel_handler()) Skipped 1 previous similar message [33513.661290] LustreError: 80752:0:(ldlm_lockd.c:2322:ldlm_cancel_handler()) Skipped 71 previous similar messages [33530.957829] LustreError: 78793:0:(ldlm_lib.c:3248:target_bulk_io()) @@@ timeout on bulk WRITE after 100+0s req@ffff97fd6be88c50 x1631316145364192/t0(0) o4->78f9401d-53ab-f909-d2db-c4b85cdb93e0@10.8.10.16@o2ib6:423/0 lens 488/448 e 1 to 0 dl 1555978413 ref 1 fl Interpret:/0/0 rc 0/0 [33531.392666] LNetError: 74202:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (-125, 0) [33531.405181] LNetError: 74202:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 51 previous similar messages [33531.414853] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f2ef4d5800 [33533.071259] LustreError: 74208:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f2ef4d5800 [33533.082211] Lustre: fir-OST001d: Bulk IO read error with d22641c5-00df-8cff-00b3-7a4f6484bd1f (at 10.8.2.16@o2ib6), client will retry: rc -110 [33542.235926] LustreError: 78538:0:(ldlm_lib.c:3258:target_bulk_io()) @@@ Reconnect on bulk WRITE req@ffff981ce4035850 x1631538360037840/t0(0) o4->2e220de5-7b5b-3874-45ea-64c959a50d0b@10.8.0.67@o2ib6:565/0 lens 488/448 e 0 to 0 dl 1555978555 ref 1 fl Interpret:/0/0 rc 0/0 [33542.259890] LustreError: 78538:0:(ldlm_lib.c:3258:target_bulk_io()) Skipped 1 previous similar message [33560.081202] LustreError: 74198:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98037ae7a600 [33560.092019] LustreError: 74199:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98037ae7a600 [33560.102811] LustreError: 74200:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98037ae7a600 [33560.113610] LustreError: 74198:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98037ae7a600 [33560.124460] LustreError: 74197:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98037ae7a600 [33560.135242] LustreError: 74199:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98037ae7a600 [33560.146029] LustreError: 74200:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98037ae7a600 [33560.156811] LustreError: 74198:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98037ae7a600 [33567.088351] LustreError: 74206:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9815bc287000 [33567.099147] LustreError: 74206:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9815bc287000 [33575.481842] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97ffb4d4d800 [33583.901289] LustreError: 77026:0:(ldlm_lockd.c:256:expired_lock_main()) ### lock callback timer expired after 150s: evicting client at 10.8.1.22@o2ib6 ns: filter-fir-OST001f_UUID lock: ffff97fadf86b3c0/0xd80148302fbcf91c lrc: 4/0,0 mode: PR/PR res: [0x480000400:0x570531:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 131072->16777215) flags: 0x60000400010020 nid: 10.8.1.22@o2ib6 remote: 0x3385d1117b1e4eb5 expref: 2113 pid: 78301 timeout: 33582 lvb_type: 1 [33583.942465] LustreError: 77026:0:(ldlm_lockd.c:256:expired_lock_main()) Skipped 1 previous similar message [33584.905121] LustreError: 130587:0:(ldlm_lockd.c:2322:ldlm_cancel_handler()) ldlm_cancel from 10.8.1.18@o2ib6 arrived at 1555978419 with bad export cookie 15564801158135048150 [33585.687662] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f0a03fb800 [33586.411494] LustreError: 74208:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f0a03fb800 [33586.422293] LustreError: 74207:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f0a03fb800 [33586.433114] LustreError: 74208:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f0a03fb800 [33586.444122] Lustre: fir-OST001f: Bulk IO write error with 78f9401d-53ab-f909-d2db-c4b85cdb93e0 (at 10.8.10.16@o2ib6), client will retry: rc = -110 [33586.457255] Lustre: Skipped 4 previous similar messages [33587.002743] LustreError: 130590:0:(ldlm_lockd.c:2322:ldlm_cancel_handler()) ldlm_cancel from 10.8.1.18@o2ib6 arrived at 1555978421 with bad export cookie 15564801158135048150 [33587.018297] LustreError: 130590:0:(ldlm_lockd.c:2322:ldlm_cancel_handler()) Skipped 3 previous similar messages [33589.947848] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981820b5c800 [33589.958657] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981820b5c800 [33589.969469] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981820b5c800 [33589.980251] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981820b5c800 [33589.991031] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981820b5c800 [33590.001843] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981820b5c800 [33590.012624] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981820b5c800 [33590.023405] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981820b5c800 [33590.034196] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981820b5c800 [33590.045020] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981820b5c800 [33590.341098] LustreError: 78836:0:(ldlm_lockd.c:682:ldlm_handle_ast_error()) ### client (nid 10.8.12.13@o2ib6) failed to reply to blocking AST (req@ffff982ba6f9fb00 x1631527158801232 status 0 rc -110), evict it ns: filter-fir-OST0021_UUID lock: ffff980b41000d80/0xd80148302fcf666d lrc: 4/0,0 mode: PR/PR res: [0x980000402:0x57459f:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 131072->16777215) flags: 0x60000400010020 nid: 10.8.12.13@o2ib6 remote: 0x8c517e1b19c14b9e expref: 1904 pid: 78510 timeout: 33539 lvb_type: 1 [33590.387432] LustreError: 77026:0:(ldlm_lockd.c:256:expired_lock_main()) ### lock callback timer expired after 148s: evicting client at 10.8.12.13@o2ib6 ns: filter-fir-OST0021_UUID lock: ffff980b41000d80/0xd80148302fcf666d lrc: 4/0,0 mode: PR/PR res: [0x980000402:0x57459f:0x0].0x0 rrc: 11 type: EXT [0->18446744073709551615] (req 131072->16777215) flags: 0x60000400010020 nid: 10.8.12.13@o2ib6 remote: 0x8c517e1b19c14b9e expref: 1905 pid: 78510 timeout: 33539 lvb_type: 1 [33590.387434] LustreError: 77026:0:(ldlm_lockd.c:256:expired_lock_main()) Skipped 9 previous similar messages [33590.438600] LustreError: 78836:0:(ldlm_lockd.c:682:ldlm_handle_ast_error()) Skipped 3 previous similar messages [33590.448704] LustreError: 138-a: fir-OST0021: A client on nid 10.8.12.13@o2ib6 was evicted due to a lock blocking callback time out: rc -110 [33590.461247] LustreError: Skipped 4 previous similar messages [33591.426632] LustreError: 80752:0:(ldlm_lockd.c:2322:ldlm_cancel_handler()) ldlm_cancel from 10.8.12.17@o2ib6 arrived at 1555978425 with bad export cookie 15564801158135081414 [33591.442195] LustreError: 80752:0:(ldlm_lockd.c:2322:ldlm_cancel_handler()) Skipped 7 previous similar messages [33591.593402] LustreError: 78282:0:(ldlm_lockd.c:682:ldlm_handle_ast_error()) ### client (nid 10.8.27.20@o2ib6) failed to reply to blocking AST (req@ffff97fd6c708c00 x1631527158807296 status 0 rc -110), evict it ns: filter-fir-OST0021_UUID lock: ffff981305154ec0/0xd8014830297df5cc lrc: 4/0,0 mode: PR/PR res: [0x980000402:0x573b10:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 131072->16777215) flags: 0x60000400010020 nid: 10.8.27.20@o2ib6 remote: 0x94fed81763136fc4 expref: 2782 pid: 78271 timeout: 33540 lvb_type: 1 [33591.639750] LustreError: 78282:0:(ldlm_lockd.c:682:ldlm_handle_ast_error()) Skipped 1 previous similar message [33591.649769] LustreError: 138-a: fir-OST0021: A client on nid 10.8.27.20@o2ib6 was evicted due to a lock blocking callback time out: rc -110 [33591.662313] LustreError: Skipped 1 previous similar message [33596.381638] LustreError: 74198:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981820b5c800 [33596.392422] LustreError: 74197:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981820b5c800 [33596.403237] LustreError: 74199:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981820b5c800 [33596.414019] LustreError: 74198:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981820b5c800 [33596.424798] LustreError: 74197:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981820b5c800 [33596.435600] LustreError: 74200:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981820b5c800 [33598.528811] LustreError: 77026:0:(ldlm_lockd.c:256:expired_lock_main()) ### lock callback timer expired after 140s: evicting client at 10.8.7.35@o2ib6 ns: filter-fir-OST001d_UUID lock: ffff97f51ba2ca40/0xd80148302e48cedf lrc: 3/0,0 mode: PR/PR res: [0xcc0000401:0x91fc39:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 268435456->8589934591) flags: 0x60000400000020 nid: 10.8.7.35@o2ib6 remote: 0xf7bdc79e22c14e29 expref: 1533 pid: 78379 timeout: 33555 lvb_type: 1 [33598.570420] LustreError: 77026:0:(ldlm_lockd.c:256:expired_lock_main()) Skipped 7 previous similar messages [33599.716456] LustreError: 74197:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97fcbcf8d400 [33599.727260] LustreError: 74197:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97fcbcf8d400 [33599.738072] LustreError: 74197:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97fcbcf8d400 [33599.748877] LustreError: 74197:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97fcbcf8d400 [33599.759685] LustreError: 74199:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97fcbcf8d400 [33599.770506] LustreError: 74197:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97fcbcf8d400 [33599.781289] LustreError: 74200:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97fcbcf8d400 [33599.792089] LustreError: 74199:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97fcbcf8d400 [33599.802877] LustreError: 74197:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97fcbcf8d400 [33599.813667] LustreError: 74200:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97fcbcf8d400 [33599.824453] LustreError: 74199:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97fcbcf8d400 [33599.835239] LustreError: 74197:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97fcbcf8d400 [33603.058867] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9810d3bf3200 [33607.733497] LustreError: 74205:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f7833c1600 [33607.975174] LustreError: 74200:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981625a5fc00 [33607.975176] LustreError: 74198:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f0efb1f400 [33607.975191] LustreError: 78877:0:(ldlm_lib.c:3264:target_bulk_io()) @@@ network error on bulk READ req@ffff97fd6c132050 x1631477202543856/t0(0) o3->40b4489c-e33b-9953-2721-000829105f18@10.8.11.17@o2ib6:586/0 lens 488/440 e 1 to 0 dl 1555978576 ref 1 fl Interpret:/0/0 rc 0/0 [33607.975194] LustreError: 78877:0:(ldlm_lib.c:3264:target_bulk_io()) Skipped 2 previous similar messages [33608.444085] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9810d3bf3200 [33608.444086] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f7833c1600 [33612.194589] LustreError: 77017:0:(ldlm_lockd.c:2322:ldlm_cancel_handler()) ldlm_cancel from 10.8.1.22@o2ib6 arrived at 1555978446 with bad export cookie 15564801158135047303 [33612.210054] LustreError: 77017:0:(ldlm_lockd.c:2322:ldlm_cancel_handler()) Skipped 4 previous similar messages [33613.173988] LustreError: 74200:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9810d3bf3200 [33621.159692] Lustre: fir-OST0023: Client 8e85fe12-2e5e-4480-4627-7fcbd9886355 (at 10.8.23.23@o2ib6) reconnecting [33621.169781] Lustre: Skipped 3140 previous similar messages [33631.500077] LustreError: 79196:0:(ldlm_lockd.c:2322:ldlm_cancel_handler()) ldlm_cancel from 10.8.1.10@o2ib6 arrived at 1555978465 with bad export cookie 15564801158135078719 [33631.515540] LustreError: 79196:0:(ldlm_lockd.c:2322:ldlm_cancel_handler()) Skipped 9 previous similar messages [33631.760873] LustreError: 74200:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981131833800 [33631.766218] LustreError: 74197:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9812d7a44a00 [33634.283025] LustreError: 137-5: fir-OST0018_UUID: not available for connect from 10.8.11.6@o2ib6 (no target). If you are running an HA pair check that the target is mounted on the other server. [33634.300215] LustreError: Skipped 5894 previous similar messages [33654.739552] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980f59369800 [33654.750361] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980f59369800 [33654.761160] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980f59369800 [33654.771976] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980f59369800 [33654.782795] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980f59369800 [33654.793988] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9810c9d4b200 [33654.804802] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98128adc8400 [33654.815610] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98128adc8400 [33654.826416] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98128adc8400 [33654.837214] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98128adc8400 [33654.848114] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97fa0c46a000 [33654.858905] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97fa0c46a000 [33654.869692] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97fa0c46a000 [33654.880525] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97fa0c46a000 [33654.891319] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f2057fb800 [33654.902101] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f2057fb800 [33654.912922] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f2057fb800 [33654.923715] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98093c315800 [33654.934500] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f2057fb800 [33654.945317] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f2057fb800 [33654.956099] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f2057fb800 [33654.966889] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f2057fb800 [33654.977674] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98093c315800 [33656.816268] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980c75bea800 [33659.195150] LustreError: 74207:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981b99aa9400 [33659.713595] LustreError: 74208:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981a3eb0ae00 [33659.724376] LustreError: 74206:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981a3eb0ae00 [33659.735183] LustreError: 74208:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981a3eb0ae00 [33659.745965] LustreError: 74205:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981a3eb0ae00 [33659.756753] LustreError: 74206:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981a3eb0ae00 [33659.767571] LustreError: 74208:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981a3eb0ae00 [33659.778376] LustreError: 74205:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981a3eb0ae00 [33659.789164] LustreError: 74207:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981a3eb0ae00 [33659.799948] LustreError: 74206:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981a3eb0ae00 [33659.810764] LustreError: 74208:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981a3eb0ae00 [33659.821547] LustreError: 74205:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981a3eb0ae00 [33659.832333] LustreError: 74207:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981a3eb0ae00 [33659.843118] LustreError: 74206:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981a3eb0ae00 [33659.853943] LustreError: 74205:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980f59369800 [33659.864733] LustreError: 74207:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981a23fbca00 [33659.875512] LustreError: 74206:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980f59369800 [33659.886311] LustreError: 74208:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981a23fbca00 [33659.897113] LustreError: 74205:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981a23fbca00 [33659.907902] LustreError: 74207:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981a23fbca00 [33659.918684] LustreError: 74206:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981a23fbca00 [33659.918687] LustreError: 74207:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9810c9d4b200 [33659.918692] LustreError: 74207:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9810c9d4b200 [33659.918697] LustreError: 74207:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9810c9d4b200 [33659.918701] LustreError: 74207:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9810c9d4b200 [33659.918708] LustreError: 74207:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98128adc8400 [33659.918713] LustreError: 74207:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98128adc8400 [33659.918718] LustreError: 74207:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98128adc8400 [33659.918723] LustreError: 74207:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98128adc8400 [33659.918730] LustreError: 74207:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97fa0c46a000 [33659.918739] LustreError: 74207:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f2057fb800 [33659.918744] LustreError: 74207:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f2057fb800 [33659.918749] LustreError: 74207:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98093c315800 [33659.918755] LustreError: 74207:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98093c315800 [33659.918760] LustreError: 74207:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98093c315800 [33659.918764] LustreError: 74207:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f2057fb800 [33659.918769] LustreError: 74207:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f2057fb800 [33659.918774] LustreError: 74207:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f2057fb800 [33659.918780] LustreError: 74207:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98093c315800 [33660.123429] LustreError: 74208:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981a23fbca00 [33660.134238] LustreError: 74205:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981a23fbca00 [33689.902164] LustreError: 77026:0:(ldlm_lockd.c:256:expired_lock_main()) ### lock callback timer expired after 248s: evicting client at 10.8.17.24@o2ib6 ns: filter-fir-OST0021_UUID lock: ffff98045ad106c0/0xd80148302fd868d8 lrc: 3/0,0 mode: PR/PR res: [0x980000402:0x573b10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 131072->16777215) flags: 0x60000400010020 nid: 10.8.17.24@o2ib6 remote: 0xa0384b38e041e9cb expref: 874 pid: 78317 timeout: 33688 lvb_type: 1 [33694.911874] LustreError: 74205:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981048b8ca00 [33705.826410] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981b751c2c00 [33706.293041] LustreError: 74206:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981b751c2c00 [33706.303866] LustreError: 78789:0:(ldlm_lib.c:3264:target_bulk_io()) @@@ network error on bulk READ req@ffff980d28745850 x1628739435219504/t0(0) o3->d22641c5-00df-8cff-00b3-7a4f6484bd1f@10.8.2.16@o2ib6:691/0 lens 488/440 e 0 to 0 dl 1555978681 ref 1 fl Interpret:/2/0 rc 0/0 [33706.328089] LustreError: 78789:0:(ldlm_lib.c:3264:target_bulk_io()) Skipped 14 previous similar messages [33706.337730] Lustre: fir-OST001d: Bulk IO read error with d22641c5-00df-8cff-00b3-7a4f6484bd1f (at 10.8.2.16@o2ib6), client will retry: rc -110 [33706.350516] Lustre: Skipped 8 previous similar messages [33728.330481] Lustre: 78377:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1555978551/real 0] req@ffff981b627a3900 x1631527161958304/t0(0) o104->fir-OST001b@10.8.26.9@o2ib6:15/16 lens 296/224 e 0 to 1 dl 1555978562 ref 2 fl Rpc:X/0/ffffffff rc 0/-1 [33728.356870] Lustre: 78377:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 168 previous similar messages [33731.012559] LustreError: 74207:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980fdc44e800 [33733.715320] LustreError: 74198:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f91e99dc00 [33737.154553] LustreError: 74205:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9800773c3600 [33737.940756] LustreError: 74199:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9814e3621a00 [33741.381188] LustreError: 74205:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9808ffca0000 [33745.791972] LustreError: 74197:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97fd0ebbb800 [33746.639873] LustreError: 74197:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97ef09176e00 [33746.650679] LustreError: 74199:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97ef09176e00 [33746.661476] LustreError: 74197:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97ef09176e00 [33746.672273] LustreError: 74199:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97ef09176e00 [33747.735437] LustreError: 74200:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f9cbf50a00 [33752.551133] LustreError: 74200:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981ce7117a00 [33754.495815] LustreError: 74206:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9809ca672c00 [33757.371915] LustreError: 74200:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981169e46600 [33757.382734] LustreError: 74197:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981169e46600 [33757.393530] LustreError: 74199:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981169e46600 [33757.404332] LustreError: 74200:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981169e46600 [33757.415109] LustreError: 74198:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981169e46600 [33760.706139] LustreError: 74200:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98194d45a800 [33763.043187] LustreError: 74208:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981169e46600 [33763.053975] LustreError: 74206:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981169e46600 [33765.119275] LustreError: 74206:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98194d45a800 [33768.934840] LustreError: 74200:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981c692da600 [33768.945656] LustreError: 74197:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981c692da600 [33768.956516] LustreError: 74200:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981c692da600 [33776.893228] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981c692da600 [33776.904040] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981c692da600 [33776.914859] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981c692da600 [33776.925683] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981c692da600 [33787.888566] LNetError: 74204:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (-125, 0) [33787.901082] LNetError: 74204:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 158 previous similar messages [33787.910862] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98058df83200 [33795.162476] LustreError: 74207:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981227ac3400 [33795.182371] LustreError: 74207:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981c692da600 [33795.193158] LustreError: 74208:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981c692da600 [33795.203958] LustreError: 74207:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981c692da600 [33803.029904] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980a0d4e5800 [33811.698862] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981c692da600 [33811.709683] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981c692da600 [33811.720466] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981c692da600 [33811.731249] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981c692da600 [33811.742037] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981c692da600 [33811.752822] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981c692da600 [33815.939002] LustreError: 74199:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98076a124c00 [33827.770333] LustreError: 78388:0:(ldlm_lib.c:3258:target_bulk_io()) @@@ Reconnect on bulk READ req@ffff981ce5e27450 x1631346036650880/t0(0) o3->bd49a221-b9b3-c4d6-c057-a5a69a0093b0@10.8.10.9@o2ib6:52/0 lens 488/440 e 0 to 0 dl 1555978797 ref 1 fl Interpret:/2/0 rc 0/0 [33827.794147] LustreError: 78388:0:(ldlm_lib.c:3258:target_bulk_io()) Skipped 13 previous similar messages [33832.130443] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980544653a00 [33833.027051] LustreError: 74206:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981a08f1ec00 [33836.903415] LustreError: 77026:0:(ldlm_lockd.c:256:expired_lock_main()) ### lock callback timer expired after 148s: evicting client at 10.8.28.11@o2ib6 ns: filter-fir-OST001d_UUID lock: ffff98014c1c6300/0xd80148301be2b0de lrc: 3/0,0 mode: PR/PR res: [0xcc0000402:0x5753e3:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 17179869184->18446744073709551615) flags: 0x60000400010020 nid: 10.8.28.11@o2ib6 remote: 0xfc47ba201b7b4a42 expref: 712 pid: 77126 timeout: 33835 lvb_type: 1 [33838.239539] LustreError: 74197:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981288464200 [33838.250333] LustreError: 74199:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981288464200 [33838.261142] LustreError: 74198:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980e63437a00 [33838.261146] LustreError: 74197:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981288464200 [33838.261159] LustreError: 74199:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981288464200 [33838.261180] LustreError: 78203:0:(ldlm_lib.c:3264:target_bulk_io()) @@@ network error on bulk WRITE req@ffff980d2714dc50 x1631316145364192/t0(0) o4->78f9401d-53ab-f909-d2db-c4b85cdb93e0@10.8.10.16@o2ib6:51/0 lens 488/448 e 0 to 0 dl 1555978796 ref 1 fl Interpret:/2/0 rc 0/0 [33838.261184] LustreError: 78203:0:(ldlm_lib.c:3264:target_bulk_io()) Skipped 11 previous similar messages [33838.327336] LustreError: 74197:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980e63437a00 [33838.338116] LustreError: 74200:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980e63437a00 [33838.348895] LustreError: 74199:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980e63437a00 [33842.675421] LustreError: 74205:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff982be1e88e00 [33842.874056] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff982be1e88e00 [33842.884843] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff982be1e88e00 [33842.895622] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff982be1e88e00 [33842.906659] Lustre: fir-OST001f: Bulk IO write error with 115a2222-e1b7-dfee-ffb1-27088b50273f (at 10.8.13.4@o2ib6), client will retry: rc = -110 [33842.919706] Lustre: Skipped 23 previous similar messages [33843.891508] LustreError: 74198:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9802ac104000 [33846.320099] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f467f6c800 [33848.072111] LustreError: 74200:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97fb16ab0a00 [33848.082914] LustreError: 74197:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97fb16ab0a00 [33848.093697] LustreError: 74198:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97fb16ab0a00 [33851.543686] LustreError: 74199:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f885273c00 [33851.554508] LustreError: 74199:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f885273c00 [33858.063434] LustreError: 74199:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f286a06200 [33858.074228] LustreError: 74199:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981a98ec1200 [33859.806510] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980e66fd4400 [33859.806539] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980d27665600 [33874.043084] Lustre: fir-OST0021: Connection restored to 1c06f372-dead-1042-58da-264d882a9ae5 (at 10.8.17.20@o2ib6) [33874.053435] Lustre: Skipped 3335 previous similar messages [33891.036230] LustreError: 74206:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f93381d200 [33891.047033] LustreError: 74206:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f93381d200 [33891.057845] LustreError: 74207:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f93381d200 [33891.068629] LustreError: 74208:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f93381d200 [33891.242925] LustreError: 74197:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f93381d200 [33891.253757] LustreError: 74197:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f93381d200 [33891.264579] LustreError: 74197:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f93381d200 [33891.275422] LustreError: 74197:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f93381d200 [33891.286284] LustreError: 74197:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f93381d200 [33891.297096] LustreError: 74197:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f93381d200 [33891.307946] LustreError: 74197:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f93381d200 [33891.464262] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f93381d200 [33891.475065] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f93381d200 [33892.441603] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f93381d200 [33892.452407] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f93381d200 [33892.463210] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f93381d200 [33893.903903] LustreError: 77026:0:(ldlm_lockd.c:256:expired_lock_main()) ### lock callback timer expired after 150s: evicting client at 10.8.16.8@o2ib6 ns: filter-fir-OST001d_UUID lock: ffff97ff77544380/0xd80148302ff5e682 lrc: 3/0,0 mode: PR/PR res: [0xcc0000402:0x5753e2:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4294967296->34359738367) flags: 0x60000400010020 nid: 10.8.16.8@o2ib6 remote: 0x855c8d9c5cca4f79 expref: 928 pid: 78599 timeout: 33892 lvb_type: 1 [33905.538701] LustreError: 74207:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f6ff478c00 [33906.907636] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f6ff478c00 [33907.867263] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f6ff478c00 [33907.874430] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9813f124f000 [33909.750307] LustreError: 74199:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f6ff478c00 [33909.761094] LustreError: 74199:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9813f124f000 [33934.326224] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9813ad484e00 [33934.326225] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98023c224600 [33934.326240] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98023c224600 [33934.326245] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98023c224600 [33934.326249] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98023c224600 [33934.380104] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9813ad484e00 [33961.865249] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981a20051800 [33986.136160] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9808369a9e00 [34001.083957] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9816ee8e1a00 [34001.459393] LustreError: 74199:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9816ee8e1a00 [34001.470393] Lustre: fir-OST0019: Bulk IO read error with 220c5a2f-2274-34f0-c226-fa1f26d20160 (at 10.8.1.29@o2ib6), client will retry: rc -110 [34001.483168] Lustre: Skipped 19 previous similar messages [34006.653522] LustreError: 74205:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981019c73400 [34008.609173] LustreError: 74199:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9805ab1c8a00 [34008.609174] LustreError: 74200:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981ecb124000 [34014.545358] LustreError: 74199:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981019c73400 [34021.840528] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9821e8169400 [34021.840530] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980eaf481200 [34023.355033] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981166a72c00 [34023.365850] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980d20cbc600 [34023.376643] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff982699a91800 [34028.397235] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981019c73400 [34032.665435] LustreError: 74197:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981028c2f800 [34035.424107] LustreError: 74198:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f7a5e46c00 [34035.434877] LustreError: 74197:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9819918b9000 [34055.954544] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9813fd7a7400 [34055.965331] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981475ab7200 [34060.744552] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f996ac6a00 [34060.744554] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981ccf00a000 [34060.766148] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9815444f3e00 [34065.706032] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981927356600 [34066.717125] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98246d141e00 [34067.768239] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9829c4568000 [34069.802630] LustreError: 74199:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff982b8bd12000 [34069.802632] LustreError: 74197:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97fee073da00 [34069.824195] LustreError: 74197:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981f2c6bfa00 [34069.824197] LustreError: 74199:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff982628abc600 [34069.845804] LustreError: 74198:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f0e1b87e00 [34070.180315] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9821c7c5dc00 [34071.939466] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9811d5dce400 [34071.950254] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9811d5dce400 [34083.164383] LustreError: 74199:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9815ab6a4200 [34086.844093] LustreError: 74198:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9819d35ba600 [34086.854950] LustreError: 74197:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9819d35ba600 [34086.866557] LustreError: 74197:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9819d35ba600 [34086.877423] LustreError: 74198:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981b8fcc8000 [34105.376171] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98243a54c600 [34105.386965] LustreError: 78941:0:(ldlm_lib.c:3264:target_bulk_io()) @@@ network error on bulk WRITE req@ffff980da772d050 x1631301491710592/t0(0) o4->1b540135-ca45-f45a-a248-eb5cb55b2913@10.8.29.4@o2ib6:327/0 lens 488/448 e 1 to 0 dl 1555979072 ref 1 fl Interpret:/0/0 rc 0/0 [34105.411293] LustreError: 78941:0:(ldlm_lib.c:3264:target_bulk_io()) Skipped 41 previous similar messages [34109.597947] LustreError: 74197:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9815ad090a00 [34110.647822] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97fc71902a00 [34111.205737] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f093e5f000 [34114.918254] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9816546f0c00 [34114.929049] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9816546f0c00 [34114.939838] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9816546f0c00 [34114.950624] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9812d4222600 [34114.961428] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9812d4222600 [34130.304512] LustreError: 74197:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9820ae88e800 [34137.328834] LustreError: 78290:0:(ldlm_lockd.c:682:ldlm_handle_ast_error()) ### client (nid 10.8.27.25@o2ib6) failed to reply to blocking AST (req@ffff98154b987500 x1631527164734688 status 0 rc -110), evict it ns: filter-fir-OST001f_UUID lock: ffff9806f2ee2d00/0xd801483030a7e740 lrc: 4/0,0 mode: PR/PR res: [0x480000402:0x928e00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 131072->16777215) flags: 0x60000400000020 nid: 10.8.27.25@o2ib6 remote: 0xca2cb7566c72ef71 expref: 354794 pid: 78328 timeout: 34233 lvb_type: 1 [34137.375274] LustreError: 138-a: fir-OST001f: A client on nid 10.8.27.25@o2ib6 was evicted due to a lock blocking callback time out: rc -110 [34137.387819] LustreError: 77026:0:(ldlm_lockd.c:256:expired_lock_main()) ### lock callback timer expired after 192s: evicting client at 10.8.27.25@o2ib6 ns: filter-fir-OST001f_UUID lock: ffff9806f2ee2d00/0xd801483030a7e740 lrc: 3/0,0 mode: PR/PR res: [0x480000402:0x928e00:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 131072->16777215) flags: 0x60000400000020 nid: 10.8.27.25@o2ib6 remote: 0xca2cb7566c72ef71 expref: 354781 pid: 78328 timeout: 0 lvb_type: 1 [34137.428938] LustreError: 77026:0:(ldlm_lockd.c:256:expired_lock_main()) Skipped 2 previous similar messages [34137.440068] LustreError: 6724:0:(ldlm_lockd.c:2322:ldlm_cancel_handler()) ldlm_cancel from 10.8.27.25@o2ib6 arrived at 1555978971 with bad export cookie 15564801158336006194 [34137.455582] LustreError: 6724:0:(ldlm_lockd.c:2322:ldlm_cancel_handler()) Skipped 3 previous similar messages [34141.105570] LustreError: 74206:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f375072000 [34141.346411] LustreError: 74207:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980593146600 [34149.562045] Lustre: fir-OST001f: haven't heard from client ec39a795-a9eb-9d3c-988a-f7f6267b0627 (at 10.9.102.64@o2ib4) in 166 seconds. I think it's dead, and I am evicting it. exp ffff980d270ab400, cur 1555978984 expire 1555978834 last 1555978818 [34149.583842] Lustre: Skipped 107 previous similar messages [34222.382592] Lustre: fir-OST001b: Client f3bba4e8-9568-4001-6257-88537741a8c9 (at 10.8.29.3@o2ib6) reconnecting [34222.392593] Lustre: Skipped 484 previous similar messages [34257.377110] LustreError: 137-5: fir-OST0018_UUID: not available for connect from 10.8.20.8@o2ib6 (no target). If you are running an HA pair check that the target is mounted on the other server. [34257.394302] LustreError: Skipped 1454 previous similar messages [34440.908525] LustreError: 77026:0:(ldlm_lockd.c:256:expired_lock_main()) ### lock callback timer expired after 99s: evicting client at 10.9.108.57@o2ib4 ns: filter-fir-OST0019_UUID lock: ffff97f986a53cc0/0xd801483033611169 lrc: 3/0,0 mode: PW/PW res: [0x2a8b70:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 131072->16777215) flags: 0x60000400020020 nid: 10.9.108.57@o2ib4 remote: 0xd0cbc03593f2af41 expref: 28 pid: 78836 timeout: 34439 lvb_type: 0 [34487.822191] Lustre: fir-OST001b: Connection restored to (at 10.8.8.33@o2ib6) [34487.829332] Lustre: Skipped 255 previous similar messages [34693.733774] LustreError: 78950:0:(ldlm_lib.c:3258:target_bulk_io()) @@@ Reconnect on bulk WRITE req@ffff980d1ef82c50 x1631397388401296/t0(0) o4->c41887d8-667a-fcc3-3801-53e405eea2a0@10.8.30.34@o2ib6:67/0 lens 488/448 e 0 to 0 dl 1555979567 ref 1 fl Interpret:/0/0 rc 0/0 [34693.757759] LustreError: 78950:0:(ldlm_lib.c:3258:target_bulk_io()) Skipped 9 previous similar messages [34693.767410] Lustre: fir-OST0019: Bulk IO write error with c41887d8-667a-fcc3-3801-53e405eea2a0 (at 10.8.30.34@o2ib6), client will retry: rc = -110 [34693.780562] Lustre: Skipped 18 previous similar messages [34782.567221] Lustre: fir-OST001b: haven't heard from client 1699114c-d7be-fde3-c1c0-12a75a1676f5 (at 10.8.27.24@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff97fd6c3dfc00, cur 1555979617 expire 1555979467 last 1555979390 [34782.588922] Lustre: Skipped 46 previous similar messages [34858.316181] LustreError: 137-5: fir-OST0020_UUID: not available for connect from 10.8.19.8@o2ib6 (no target). If you are running an HA pair check that the target is mounted on the other server. [34858.333386] LustreError: Skipped 23 previous similar messages [34923.454342] Lustre: fir-OST001f: Client 298803cf-e753-941c-6112-fbcd4a68f381 (at 10.8.27.25@o2ib6) reconnecting [34923.464458] Lustre: Skipped 156 previous similar messages [35091.977514] Lustre: fir-OST0019: Connection restored to 0bf182e7-6c5b-fcc1-e5ec-1d3fd3c2b659 (at 10.8.17.10@o2ib6) [35091.987869] Lustre: Skipped 177 previous similar messages [35169.562684] Lustre: DEBUG MARKER: Mon Apr 22 17:40:03 2019 [35447.577212] Lustre: fir-OST001b: haven't heard from client 21eb1043-77e2-ccc0-0725-7be9fa6337bc (at 10.9.106.17@o2ib4) in 227 seconds. I think it's dead, and I am evicting it. exp ffff97fd6c1d2c00, cur 1555980282 expire 1555980132 last 1555980055 [35447.599004] Lustre: Skipped 15 previous similar messages [35687.672976] Lustre: fir-OST001f: Client 298803cf-e753-941c-6112-fbcd4a68f381 (at 10.8.27.25@o2ib6) reconnecting [35922.921824] LustreError: 77026:0:(ldlm_lockd.c:256:expired_lock_main()) ### lock callback timer expired after 100s: evicting client at 10.9.104.2@o2ib4 ns: filter-fir-OST001f_UUID lock: ffff97ede648ec00/0xd80148303361ad84 lrc: 3/0,0 mode: PW/PW res: [0x2a8ac7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 268435456->8589934591) flags: 0x60000400020020 nid: 10.9.104.2@o2ib4 remote: 0x85bbe72d55ff10f4 expref: 9 pid: 78453 timeout: 35921 lvb_type: 0 [35929.242243] Lustre: fir-OST001f: Connection restored to ecb61c7e-149c-ebab-ac6d-49791d9f901b (at 10.9.104.2@o2ib4) [35929.252590] Lustre: Skipped 26 previous similar messages [36022.922730] LustreError: 77026:0:(ldlm_lockd.c:256:expired_lock_main()) ### lock callback timer expired after 112s: evicting client at 10.8.11.26@o2ib6 ns: filter-fir-OST0019_UUID lock: ffff9825abfb5100/0xd80148303361d810 lrc: 3/0,0 mode: PW/PW res: [0x640000400:0x56e8a6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 268435456->8589934591) flags: 0x60000400020020 nid: 10.8.11.26@o2ib6 remote: 0xa234b98ee14e971a expref: 6 pid: 78290 timeout: 36011 lvb_type: 0 [36155.594174] Lustre: fir-OST001f: haven't heard from client efe78663-94f1-74d7-2a31-a7f3a5a9cd60 (at 10.9.104.2@o2ib4) in 227 seconds. I think it's dead, and I am evicting it. exp ffff980d27420000, cur 1555980990 expire 1555980840 last 1555980763 [36155.615900] Lustre: Skipped 11 previous similar messages [36798.597038] Lustre: fir-OST0019: Connection restored to (at 10.9.106.17@o2ib4) [36798.604353] Lustre: Skipped 70 previous similar messages [36808.929766] LustreError: 77026:0:(ldlm_lockd.c:256:expired_lock_main()) ### lock callback timer expired after 149s: evicting client at 10.9.108.57@o2ib4 ns: filter-fir-OST0019_UUID lock: ffff9827ffe68900/0xd801483033623b7c lrc: 3/0,0 mode: PW/PW res: [0x2a8b70:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 131072->16777215) flags: 0x60000400020020 nid: 10.9.108.57@o2ib4 remote: 0xd0cbc0359410f9ab expref: 9 pid: 78346 timeout: 36807 lvb_type: 0 [36808.970307] LustreError: 77026:0:(ldlm_lockd.c:256:expired_lock_main()) Skipped 2 previous similar messages [36940.930876] LustreError: 77026:0:(ldlm_lockd.c:256:expired_lock_main()) ### lock callback timer expired after 100s: evicting client at 10.9.104.2@o2ib4 ns: filter-fir-OST0019_UUID lock: ffff982005b09f80/0xd801483033622a57 lrc: 3/0,0 mode: PW/PW res: [0x2a8b9f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4294967296->34359738367) flags: 0x60000400020020 nid: 10.9.104.2@o2ib4 remote: 0x85bbe72d55ff1905 expref: 8 pid: 78290 timeout: 36939 lvb_type: 0 [37190.589049] Lustre: fir-OST0023: haven't heard from client feb98fcf-e5cd-05d5-3c3f-508f3fbfb9c4 (at 10.8.26.4@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff97fd691b6800, cur 1555982025 expire 1555981875 last 1555981798 [37190.610663] Lustre: Skipped 21 previous similar messages [37562.633676] Lustre: fir-OST0019: Connection restored to 424c499c-bcf2-3c1f-c771-0484a4bdadc1 (at 10.8.27.23@o2ib6) [37562.644025] Lustre: Skipped 21 previous similar messages [37864.593664] Lustre: fir-OST001b: haven't heard from client 9773eb26-ebf6-6918-5851-ee91be7eff02 (at 10.9.104.58@o2ib4) in 227 seconds. I think it's dead, and I am evicting it. exp ffff97fd6c3df800, cur 1555982699 expire 1555982549 last 1555982472 [37864.615473] Lustre: Skipped 23 previous similar messages [38049.084671] Lustre: fir-OST0023: Client da84e749-aae7-e201-4af5-a27465c5b762 (at 10.8.0.65@o2ib6) reconnecting [38049.094672] Lustre: Skipped 5 previous similar messages [38049.566915] LustreError: 137-5: fir-OST0018_UUID: not available for connect from 10.8.0.65@o2ib6 (no target). If you are running an HA pair check that the target is mounted on the other server. [38049.584130] LustreError: Skipped 31 previous similar messages [38284.768928] Lustre: fir-OST0019: Connection restored to c366c373-7a23-824e-f63d-44affd1c5112 (at 10.9.104.35@o2ib4) [38284.779370] Lustre: Skipped 24 previous similar messages [38525.896878] Lustre: 78524:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1555983353/real 0] req@ffff980f208d6900 x1631527195621376/t0(0) o104->fir-OST001f@10.8.7.30@o2ib6:15/16 lens 296/224 e 0 to 1 dl 1555983360 ref 2 fl Rpc:X/0/ffffffff rc 0/-1 [38525.923293] Lustre: 78524:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 139 previous similar messages [38528.965240] Lustre: fir-OST0023: Client 170d6268-ca7a-a7d0-0083-35fb42e90690 (at 10.8.7.33@o2ib6) reconnecting [38528.975243] Lustre: Skipped 1 previous similar message [38529.164906] LustreError: 78958:0:(ldlm_lib.c:3258:target_bulk_io()) @@@ Reconnect on bulk READ req@ffff980d283e0850 x1631542186308800/t0(0) o3->170d6268-ca7a-a7d0-0083-35fb42e90690@10.8.7.33@o2ib6:114/0 lens 488/440 e 1 to 0 dl 1555983389 ref 1 fl Interpret:/0/0 rc 0/0 [38529.188913] LustreError: 78958:0:(ldlm_lib.c:3258:target_bulk_io()) Skipped 2 previous similar messages [38529.342911] Lustre: fir-OST0023: Bulk IO read error with 170d6268-ca7a-a7d0-0083-35fb42e90690 (at 10.8.7.33@o2ib6), client will retry: rc -110 [38529.355737] Lustre: Skipped 26 previous similar messages [38530.497320] LNetError: 74204:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (-125, 0) [38530.509834] LNetError: 74204:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 125 previous similar messages [38530.519581] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980bbc848800 [38531.552547] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98049b08bc00 [38533.084043] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f3bb322600 [38533.301632] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97fc09fd3800 [38533.350780] LustreError: 74207:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f192631800 [38533.386846] LustreError: 74200:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98141f9ef200 [38533.927951] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f9655bf800 [38534.894044] LustreError: 74207:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980a474c9400 [38534.904858] LustreError: 74208:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980a474c9400 [38535.264169] LustreError: 74208:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97ff00016400 [38535.274955] LustreError: 74205:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97ff00016400 [38535.679815] LustreError: 74197:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97fe56c91200 [38536.143586] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980408d83200 [38536.278223] LustreError: 74199:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9810ffb1ee00 [38536.512320] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f149af4e00 [38536.725060] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f92b71fc00 [38536.735932] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97fbf41bd800 [38536.966603] LustreError: 74198:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9817a2a2b400 [38537.035396] LustreError: 74198:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f39fc57800 [38537.226755] LustreError: 74200:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980443d68a00 [38537.488886] LustreError: 74197:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98060a892e00 [38537.499706] LustreError: 74198:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98060a892e00 [38537.510544] LustreError: 74200:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98060a892e00 [38537.521392] LustreError: 74198:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98060a892e00 [38537.532343] Lustre: fir-OST0021: Bulk IO write error with 1b540135-ca45-f45a-a248-eb5cb55b2913 (at 10.8.29.4@o2ib6), client will retry: rc = -110 [38537.545379] Lustre: Skipped 1 previous similar message [38537.666538] LustreError: 74208:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98175709b000 [38537.677822] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f8eb2cc400 [38537.688915] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98013869b000 [38537.885864] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980cfc57a200 [38538.276489] LustreError: 74197:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9803a922d600 [38538.358932] LustreError: 74207:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97fe641d8c00 [38538.523459] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97ff00016400 [38538.724600] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98096e372a00 [38538.828935] LustreError: 74200:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98097c008600 [38538.937993] LustreError: 74198:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9803a922c600 [38538.948779] LustreError: 74197:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9803a922c600 [38538.959587] LustreError: 74200:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9803a922c600 [38538.960026] LustreError: 74199:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff982c5f7fac00 [38538.960037] LustreError: 74199:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff982c5f7fac00 [38539.082038] LustreError: 74206:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9804ad3ad000 [38539.169166] LustreError: 74208:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980fae8f2800 [38539.397674] LustreError: 74198:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980a474c9400 [38539.408511] LustreError: 74198:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980a474c9400 [38539.423292] LustreError: 74198:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981ce4305200 [38539.871329] LustreError: 74197:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97fcaaf32e00 [38540.023874] LustreError: 74208:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980cfc57a000 [38540.181912] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980183e83400 [38540.201979] LustreError: 74200:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980635c97400 [38540.276651] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff982c5f7fac00 [38540.279696] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980007a74800 [38540.279704] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980007a74800 [38540.279710] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980007a74800 [38540.595145] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9806da438200 [38540.735277] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97ff00016400 [38541.103861] LustreError: 74206:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9810453dac00 [38541.363195] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9805acba4200 [38541.402328] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981cc72fde00 [38541.443987] LustreError: 74208:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981750b5ec00 [38541.559803] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980d19bdd800 [38541.627204] LustreError: 74206:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f33d196a00 [38542.058878] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980a1d0fd200 [38542.166618] LustreError: 74197:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980ab805cc00 [38542.400092] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f7989c4a00 [38542.453685] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980ce5848200 [38542.643883] LustreError: 74205:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980ecf1df200 [38542.750178] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9814075d6e00 [38543.059706] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f66772e600 [38543.140512] LustreError: 74199:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980d19bdfa00 [38545.832947] LustreError: 74199:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9818a08e4600 [38546.202452] LustreError: 74205:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9814c0283200 [38546.372095] LustreError: 74205:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981529878400 [38548.090185] LustreError: 137-5: fir-OST0022_UUID: not available for connect from 10.8.12.27@o2ib6 (no target). If you are running an HA pair check that the target is mounted on the other server. [38548.107475] LustreError: Skipped 2 previous similar messages [38548.816182] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98011ad51000 [38553.392384] LustreError: 74200:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980c59ee0800 [38556.917558] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981c191e6e00 [38557.852637] LustreError: 74206:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97fb77607600 [38557.852643] LustreError: 74208:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981c191f7400 [38560.557566] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97fb77607600 [38560.559534] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981c191f7400 [38571.407341] LustreError: 74199:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f0e3b14c00 [38608.905564] Lustre: 78648:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1555983436/real 0] req@ffff981b85867200 x1631527196992256/t0(0) o104->fir-OST0023@10.8.29.1@o2ib6:15/16 lens 296/224 e 0 to 1 dl 1555983443 ref 2 fl Rpc:X/0/ffffffff rc 0/-1 [38608.931951] Lustre: 78648:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 8 previous similar messages [38617.283627] LustreError: 78989:0:(ldlm_lib.c:3258:target_bulk_io()) @@@ Reconnect on bulk READ req@ffff980d283e7050 x1631299244076928/t0(0) o3->80baa864-a94b-b9d7-922d-b4a03eea54a2@10.8.11.33@o2ib6:193/0 lens 488/440 e 1 to 0 dl 1555983468 ref 1 fl Interpret:/2/0 rc 0/0 [38617.307587] LustreError: 78989:0:(ldlm_lib.c:3258:target_bulk_io()) Skipped 63 previous similar messages [38620.273735] LNetError: 74197:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (-125, 0) [38620.278805] LustreError: 74198:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980479e03400 [38620.278833] Lustre: fir-OST001f: Bulk IO read error with 80baa864-a94b-b9d7-922d-b4a03eea54a2 (at 10.8.11.33@o2ib6), client will retry: rc -110 [38620.278835] Lustre: Skipped 54 previous similar messages [38620.315268] LNetError: 74197:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 78 previous similar messages [38620.324948] LustreError: 74197:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f827e60800 [38620.373457] LustreError: 74200:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f35c657800 [38624.491340] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97fe41b59600 [38624.502166] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98138a721600 [38624.502185] Lustre: fir-OST0023: Bulk IO write error with 9f83e13f-6dc4-9163-be6d-ae55a9f62b03 (at 10.8.27.2@o2ib6), client will retry: rc = -110 [38624.502187] Lustre: Skipped 7 previous similar messages [38624.536498] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98090e7cc000 [38624.547294] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981316378800 [38624.558091] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97fb00676600 [38624.752097] LustreError: 74206:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981accb35000 [38624.840933] LustreError: 74206:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981573a11a00 [38625.443568] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980edcacb600 [38625.454375] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980edcacb600 [38625.465201] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980edcacb600 [38625.476010] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980edcacb600 [38625.476157] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980b29761c00 [38625.476167] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980b29761c00 [38625.476176] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980b29761c00 [38625.476186] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980b29761c00 [38625.584488] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98004bf00c00 [38625.595274] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980472fb7e00 [38625.606073] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980472fb7e00 [38625.616871] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980472fb7e00 [38625.627657] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980472fb7e00 [38628.472730] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9802e6bea000 [38629.402733] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9811636c2c00 [38629.445099] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f2753f5000 [38629.475004] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f6bab1ea00 [38629.479083] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9800477af800 [38629.479091] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98169f031c00 [38629.479099] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981a0689b200 [38629.518123] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980e66435400 [38629.528915] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98010d62ca00 [38629.539733] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9803d8f47800 [38629.550525] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9805f1bf5200 [38631.079529] LustreError: 74205:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97fee4af5200 [38631.418393] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9802a2b06200 [38633.106758] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980443d69c00 [38633.106760] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980d08f4ec00 [38633.803867] LustreError: 74198:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97efbf412400 [38634.548635] LustreError: 74197:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9812b31f6800 [38636.465713] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f0d4605000 [38636.476502] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f0d4605000 [38636.476505] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980b6af30c00 [38636.476510] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980b6af30c00 [38636.476515] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980b6af30c00 [38636.476519] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980b6af30c00 [38636.530381] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f0d4605000 [38636.530382] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981aef9c0200 [38636.551936] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f0d4605000 [38636.551938] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981aef9c0200 [38636.573494] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981aef9c0200 [38636.573523] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97fc69aa7e00 [38636.573534] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97fc69aa7e00 [38636.573538] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97fc69aa7e00 [38636.573572] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97fc69aa7e00 [38636.627371] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981aef9c0200 [38636.638155] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9800d5e14c00 [38636.638158] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981327d10600 [38636.659709] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9800d5e14c00 [38636.670487] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981327d10600 [38636.670522] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9800d5e14c00 [38636.670528] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9800d5e14c00 [38636.670533] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9801865bba00 [38636.670544] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9801865bba00 [38636.670548] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9801865bba00 [38636.670554] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9801865bba00 [38636.670561] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9808b0cc1000 [38636.670565] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9808b0cc1000 [38636.670570] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9808b0cc1000 [38636.670576] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9808b0cc1000 [38636.789008] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981327d10600 [38636.799799] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981327d10600 [38636.810588] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98189fad7e00 [38636.821377] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98189fad7e00 [38636.832170] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98189fad7e00 [38636.842962] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98189fad7e00 [38636.859271] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98042ab7fc00 [38636.870053] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980c42ffa600 [38636.870056] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97ffba31a800 [38638.439856] LustreError: 74198:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97fa3784e600 [38638.439863] LustreError: 74197:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f914b82a00 [38638.439903] LustreError: 74199:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9802fe7c4800 [38638.472294] LustreError: 74197:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98152987c600 [38639.065939] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9809c4938c00 [38640.285718] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9813121d2200 [38640.292958] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98063dbe3a00 [38640.292966] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97fc1367a400 [38640.707620] LustreError: 74200:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980c9c56fc00 [38641.218555] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9806f9329400 [38641.229367] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9806f9329400 [38642.138417] LustreError: 74205:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9809a5629c00 [38642.138445] LustreError: 74207:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9803ad5dc200 [38644.575161] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980808dad600 [38644.575163] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9811544bb200 [38644.575169] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9811544bb200 [38644.607532] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980808dad600 [38645.114450] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980808dad600 [38645.114452] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9811544bb200 [38645.114456] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9811544bb200 [38645.146781] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980808dad600 [38647.353390] LustreError: 74200:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981b129c6400 [38647.364187] LustreError: 74197:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981b129c6400 [38647.374976] LustreError: 74198:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981b129c6400 [38647.385816] LustreError: 74199:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981b129c6400 [38647.396601] LustreError: 74200:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981b129c6400 [38647.407384] LustreError: 74197:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981b129c6400 [38647.418169] LustreError: 74198:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981b129c6400 [38647.428985] LustreError: 74199:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981b129c6400 [38647.439764] LustreError: 74200:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981b129c6400 [38649.100407] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981b129c6400 [38649.111202] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981b129c6400 [38649.122002] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981b129c6400 [38649.132783] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981b129c6400 [38649.143562] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981b129c6400 [38649.154343] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981b129c6400 [38649.165149] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981b129c6400 [38679.398487] Lustre: fir-OST001f: Client 4fd3697b-8ac3-d03c-d547-c2a2aae5b292 (at 10.8.28.8@o2ib6) reconnecting [38679.408490] Lustre: Skipped 221 previous similar messages [38698.599335] Lustre: fir-OST0019: haven't heard from client 8abac2b4-4ab8-a3ac-d5a6-c3490c0dd72f (at 10.9.106.26@o2ib4) in 227 seconds. I think it's dead, and I am evicting it. exp ffff97fd67756800, cur 1555983533 expire 1555983383 last 1555983306 [38698.621133] Lustre: Skipped 53 previous similar messages [38698.680239] LustreError: 137-5: fir-OST001a_UUID: not available for connect from 10.8.12.8@o2ib6 (no target). If you are running an HA pair check that the target is mounted on the other server. [38698.697454] LustreError: Skipped 327 previous similar messages [38803.932200] Lustre: 78318:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1555983631/real 0] req@ffff981b3d8e0300 x1631527199263968/t0(0) o104->fir-OST0023@10.8.29.4@o2ib6:15/16 lens 296/224 e 0 to 1 dl 1555983638 ref 2 fl Rpc:X/0/ffffffff rc 0/-1 [38803.958598] Lustre: 78318:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 26 previous similar messages [38866.688730] LustreError: 78630:0:(ldlm_lib.c:3258:target_bulk_io()) @@@ Reconnect on bulk READ req@ffff980d27741850 x1631542327901312/t0(0) o3->a39122b2-c137-de73-d5e9-b923182c1e8e@10.8.18.13@o2ib6:438/0 lens 488/440 e 1 to 0 dl 1555983713 ref 1 fl Interpret:/0/0 rc 0/0 [38866.712708] LustreError: 78630:0:(ldlm_lib.c:3258:target_bulk_io()) Skipped 57 previous similar messages [38874.635799] LNetError: 74197:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (-125, 0) [38874.648362] LNetError: 74197:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 113 previous similar messages [38874.658135] LustreError: 74197:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f37c728400 [38875.821542] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f37c728400 [38875.832350] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f37c728400 [38875.843265] Lustre: fir-OST001b: Bulk IO write error with 5f4de2dc-b7ee-6a11-fd38-d7fb031e5c4e (at 10.8.23.34@o2ib6), client will retry: rc = -110 [38875.856387] Lustre: Skipped 25 previous similar messages [38880.158500] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f8014ad000 [38880.169366] LustreError: 79021:0:(ldlm_lib.c:3264:target_bulk_io()) @@@ network error on bulk WRITE req@ffff97fd698dd850 x1631542359472736/t0(0) o4->f2a4d35e-05ff-fe02-d6c7-6c183d27b8a1@10.8.8.29@o2ib6:451/0 lens 488/448 e 0 to 0 dl 1555983726 ref 1 fl Interpret:/0/0 rc 0/0 [38880.193679] LustreError: 79021:0:(ldlm_lib.c:3264:target_bulk_io()) Skipped 3 previous similar messages [38880.838844] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980d28368a00 [38880.849663] Lustre: fir-OST001f: Bulk IO read error with f2a69869-02b0-7522-b419-5cd488a596b0 (at 10.8.18.12@o2ib6), client will retry: rc -110 [38880.862543] Lustre: Skipped 33 previous similar messages [38881.013049] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97fb3eab4800 [38881.157046] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980ae6f3a200 [38883.977303] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98002bd9d000 [38888.225996] Lustre: fir-OST0019: Connection restored to 969d9ccb-e18d-fe21-6ff7-1558592a2ce9 (at 10.8.2.28@o2ib6) [38888.236275] Lustre: Skipped 301 previous similar messages [38889.864746] LustreError: 74208:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9809ef0c3c00 [38892.557372] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98133e0e9800 [38894.022513] LustreError: 74205:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981467d00400 [38900.021326] LustreError: 74208:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9809d90c9200 [38904.190405] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9806cfc58e00 [38918.144933] LustreError: 79089:0:(ldlm_lib.c:3207:target_bulk_io()) @@@ bulk READ failed: rc -107 req@ffff97fd6717d450 x1631313508345312/t0(0) o3->43cb1da0-978b-23c3-f6df-30b731cae227@10.8.20.26@o2ib6:531/0 lens 488/440 e 1 to 0 dl 1555983806 ref 1 fl Interpret:/0/0 rc 0/0 [38920.403280] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980ffb7d6600 [38920.543842] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97fb9e5aa400 [38920.847613] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9813121d6800 [38920.858825] LustreError: 78755:0:(ldlm_lib.c:3207:target_bulk_io()) @@@ bulk READ failed: rc -107 req@ffff981dbaaccc50 x1631313508345184/t0(0) o3->43cb1da0-978b-23c3-f6df-30b731cae227@10.8.20.26@o2ib6:520/0 lens 488/440 e 1 to 0 dl 1555983795 ref 1 fl Interpret:/0/0 rc 0/0 [38926.805819] LustreError: 74206:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9811442cf400 [38927.398456] LustreError: 74197:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97fe96795800 [38928.687458] LustreError: 74199:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980b37a10800 [38929.450669] LustreError: 79052:0:(ldlm_lib.c:3207:target_bulk_io()) @@@ bulk READ failed: rc -107 req@ffff981d84386850 x1631385984158528/t0(0) o3->f7048266-5906-58a2-8096-4da5c7fabc85@10.8.12.19@o2ib6:585/0 lens 488/440 e 0 to 0 dl 1555983860 ref 1 fl Interpret:/0/0 rc 0/0 [38929.474896] LustreError: 79052:0:(ldlm_lib.c:3207:target_bulk_io()) Skipped 1 previous similar message [38930.870385] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97ffb5a83c00 [38931.089516] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97fed6517a00 [38931.113809] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980cec367400 [38931.238431] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97ffc742aa00 [38933.299317] LustreError: 74198:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9806ed6db000 [38937.483744] LustreError: 74205:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980b6af30600 [38939.132263] LustreError: 74207:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98113026ac00 [38939.204800] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98190f039a00 [38942.106420] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981a869b7800 [38944.678996] LustreError: 74205:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9803c640f000 [38976.240626] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9814fc69a800 [38976.517540] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98157d8b0e00 [38976.528357] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9810f9e37a00 [38978.051218] LustreError: 74205:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98157d8b0e00 [38979.109924] LustreError: 74205:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98006ce75200 [38979.642674] Lustre: fir-OST001d: Client 9d21700a-8b98-c7af-b3fd-bc1cec65d723 (at 10.8.8.37@o2ib6) reconnecting [38979.652697] Lustre: Skipped 110 previous similar messages [38981.516338] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980ae6f2d000 [38983.553765] LustreError: 74205:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980484975200 [38997.919400] LustreError: 78625:0:(ldlm_lib.c:3207:target_bulk_io()) @@@ bulk READ failed: rc -107 req@ffff981d80bb5850 x1631545958504352/t0(0) o3->01860b76-2131-457f-7606-2b4f7a3f28cc@10.8.7.22@o2ib6:582/0 lens 488/440 e 3 to 0 dl 1555983857 ref 1 fl Interpret:/0/0 rc 0/0 [38997.943537] LustreError: 78625:0:(ldlm_lib.c:3207:target_bulk_io()) Skipped 2 previous similar messages [39000.319913] LustreError: 74198:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981498a2fc00 [39006.633534] LustreError: 74207:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981d66465e00 [39006.644364] LustreError: 78875:0:(ldlm_lib.c:3264:target_bulk_io()) @@@ network error on bulk READ req@ffff980ef91b1050 x1631303908699104/t0(0) o3->057a35ee-7eb3-cd47-7142-9e6ee9c8aa59@10.8.13.7@o2ib6:638/0 lens 488/440 e 0 to 0 dl 1555983913 ref 1 fl Interpret:/0/0 rc 0/0 [39006.668610] LustreError: 78875:0:(ldlm_lib.c:3264:target_bulk_io()) Skipped 3 previous similar messages [39007.512052] LustreError: 74207:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980fdf791600 [39015.766190] LustreError: 137-5: fir-OST0020_UUID: not available for connect from 10.8.28.11@o2ib6 (no target). If you are running an HA pair check that the target is mounted on the other server. [39015.783499] LustreError: Skipped 28 previous similar messages [39030.980148] LustreError: 74208:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980911fc1800 [39031.198980] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97fc1367d400 [39031.497347] LustreError: 74205:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9810c8e4b400 [39031.508220] LustreError: 78896:0:(ldlm_lib.c:3207:target_bulk_io()) @@@ bulk READ failed: rc -107 req@ffff981cf058a050 x1631293786450672/t0(0) o3->0e67076d-60aa-e5e0-e644-3ce6336fd067@10.8.1.24@o2ib6:607/0 lens 488/440 e 4 to 0 dl 1555983882 ref 1 fl Interpret:/0/0 rc 0/0 [39031.971881] LustreError: 74205:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9816e49eac00 [39034.085928] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f815586000 [39037.502664] LustreError: 74206:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980c25816000 [39038.064258] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f90994e800 [39040.415032] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980ac6b9c800 [39040.425977] LustreError: 78805:0:(ldlm_lib.c:3207:target_bulk_io()) @@@ bulk READ failed: rc -107 req@ffff980d28743050 x1631545958504288/t0(0) o3->01860b76-2131-457f-7606-2b4f7a3f28cc@10.8.7.22@o2ib6:615/0 lens 488/440 e 5 to 0 dl 1555983890 ref 1 fl Interpret:/0/0 rc 0/0 [39043.440293] LustreError: 74206:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98100a92d800 [39043.579885] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9810ab567a00 [39047.713176] LustreError: 74207:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981434835200 [39050.448070] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980640676800 [39050.687389] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981a7ba0c600 [39055.580666] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f8da6d5800 [39056.860504] LustreError: 74206:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9804e6cf4e00 [39056.871405] LustreError: 79027:0:(ldlm_lib.c:3207:target_bulk_io()) @@@ bulk READ failed: rc -107 req@ffff97fd6bd9a450 x1631545958504192/t0(0) o3->01860b76-2131-457f-7606-2b4f7a3f28cc@10.8.7.22@o2ib6:631/0 lens 488/440 e 5 to 0 dl 1555983906 ref 1 fl Interpret:/0/0 rc 0/0 [39056.895640] LustreError: 79027:0:(ldlm_lib.c:3207:target_bulk_io()) Skipped 1 previous similar message [39057.002075] LustreError: 74206:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9807225eda00 [39057.012863] LustreError: 74207:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98032eab1600 [39059.764350] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9819068b3200 [39060.291734] LustreError: 74205:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980555795c00 [39061.847148] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9819068b3200 [39062.027190] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f01aec7200 [39062.934966] LustreError: 74198:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980d274c8c00 [39063.934730] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9812f016cc00 [39064.504770] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9801218ce200 [39064.587901] LustreError: 74198:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f5a5fa3000 [39064.763701] LustreError: 74199:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980cfc57ca00 [39064.799075] LustreError: 74200:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980aebb7e000 [39065.364497] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97fe312af000 [39066.733235] LustreError: 74200:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9819068b3e00 [39066.843926] LustreError: 74198:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97ef404d5800 [39066.961525] LustreError: 74200:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981656644600 [39067.007238] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981c619bcc00 [39067.405958] LustreError: 74198:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97fcf8dd3000 [39067.721971] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97fac37e4400 [39067.721976] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9812f016cc00 [39067.805842] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980fda5ce000 [39068.089499] LustreError: 74197:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f31d775000 [39068.973904] LustreError: 74199:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97fec4b27000 [39068.984713] LustreError: 74199:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980c25816000 [39069.087533] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980638b15000 [39069.282687] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981656644600 [39070.120571] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97ff32185c00 [39071.101201] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980ae2405400 [39071.202450] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f63c665e00 [39071.352443] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f95501be00 [39071.360624] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9803f817b400 [39071.360635] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980c25816000 [39071.384629] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98055cf44600 [39071.415595] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97fc804f8800 [39071.415598] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981cb4d58e00 [39072.861581] LustreError: 74198:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98026a1e5c00 [39078.782472] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f49f2b7a00 [39079.323567] LustreError: 74197:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980f79362800 [39079.778440] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981546002400 [39080.485509] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98072d4fb800 [39081.951497] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9801865bc800 [39084.010590] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981357971400 [39085.453246] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9800873cee00 [39088.982257] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9800b4bff400 [39091.291352] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981c619b9e00 [39094.730295] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97fadf3dc600 [39096.370141] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981656644600 [39097.117964] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff982ccfd5b400 [39097.342386] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980c25816000 [39098.391581] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f4f37c0000 [39098.479065] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981e9aabfc00 [39098.489864] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981e9aabfc00 [39098.500669] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981e9aabfc00 [39098.511449] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981e9aabfc00 [39098.522231] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981e9aabfc00 [39098.533013] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981e9aabfc00 [39098.543824] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981e9aabfc00 [39108.832612] LustreError: 132-0: fir-OST0023: BAD READ CHECKSUM: should have changed on the client or in transit: from 10.8.21.23@o2ib6 inode [0x240012eaa:0x1785:0x0] object 0xd40000401:8173936 extent [9490432-10728703], client returned csum 0 (type 4), server csum ac73dee (type 4) [39132.267886] LustreError: 132-0: fir-OST0023: BAD READ CHECKSUM: should have changed on the client or in transit: from 10.8.1.24@o2ib6 inode [0x240012eaa:0x1223:0x0] object 0xd40000401:8173603 extent [63094784-63160319], client returned csum 0 (type 4), server csum b0054f48 (type 4) [39509.758693] Lustre: fir-OST0019: Connection restored to feb98fcf-e5cd-05d5-3c3f-508f3fbfb9c4 (at 10.8.26.4@o2ib6) [39509.768954] Lustre: Skipped 310 previous similar messages [39632.618925] Lustre: fir-OST001f: haven't heard from client 95d140f9-df98-0fce-448c-5b0fa3c607d4 (at 10.9.106.28@o2ib4) in 227 seconds. I think it's dead, and I am evicting it. exp ffff980d27471000, cur 1555984467 expire 1555984317 last 1555984240 [39632.640736] Lustre: Skipped 23 previous similar messages [40162.083334] Lustre: fir-OST0019: Connection restored to aa56d82e-1fa4-4f0f-cfd1-23bc8e0c4b25 (at 10.9.107.62@o2ib4) [40162.093771] Lustre: Skipped 28 previous similar messages [40583.620124] Lustre: fir-OST001d: haven't heard from client e0d09136-0a0d-4d3c-a8ef-7cfcd4b2ff05 (at 10.8.2.24@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff980d28059400, cur 1555985418 expire 1555985268 last 1555985191 [40583.641747] Lustre: Skipped 5 previous similar messages [41504.853787] Lustre: fir-OST0021: Connection restored to 95d140f9-df98-0fce-448c-5b0fa3c607d4 (at 10.9.106.28@o2ib4) [41504.864225] Lustre: Skipped 8 previous similar messages [41515.028435] bash (54803): drop_caches: 1 [42105.666998] bash (62197): drop_caches: 1 [42476.028569] Lustre: fir-OST0019: Connection restored to (at 10.8.2.24@o2ib6) [42476.035708] Lustre: Skipped 7 previous similar messages [42776.442428] bash (69931): drop_caches: 1 [42907.795825] Lustre: 78509:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1555987735/real 1555987735] req@ffff98059cfd8900 x1631527214833440/t0(0) o104->fir-OST0019@10.8.27.23@o2ib6:15/16 lens 296/224 e 0 to 1 dl 1555987742 ref 1 fl Rpc:X/0/ffffffff rc 0/-1 [42907.823213] Lustre: 78509:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 116 previous similar messages [42946.640831] Lustre: fir-OST0021: haven't heard from client 1fa84db0-d985-dfd7-29ca-9d6147bd41a7 (at 10.8.27.23@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff980d195e5400, cur 1555987781 expire 1555987631 last 1555987554 [42946.662548] Lustre: Skipped 5 previous similar messages [42951.766253] Lustre: 78586:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1555987779/real 1555987779] req@ffff97f1e17be900 x1631527214858112/t0(0) o104->fir-OST001b@10.8.27.23@o2ib6:15/16 lens 296/224 e 0 to 1 dl 1555987786 ref 1 fl Rpc:X/2/ffffffff rc 0/-1 [42951.793510] Lustre: 78586:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 11 previous similar messages [42965.967451] bash (72330): drop_caches: 1 [42975.944925] Lustre: fir-OST0019: Connection restored to 424c499c-bcf2-3c1f-c771-0484a4bdadc1 (at 10.8.27.23@o2ib6) [42975.955298] Lustre: Skipped 5 previous similar messages [43022.639977] Lustre: fir-OST0021: haven't heard from client 0f9d5551-73e2-8d2d-8339-b8d135099fdc (at 10.9.108.12@o2ib4) in 203 seconds. I think it's dead, and I am evicting it. exp ffff97fd65d93c00, cur 1555987857 expire 1555987707 last 1555987654 [43022.661882] Lustre: Skipped 5 previous similar messages [43155.632299] bash (74691): drop_caches: 1 [43233.643114] Lustre: fir-OST0021: haven't heard from client 981b485e-c8a5-5d22-c1f8-24c836e353d6 (at 10.9.104.60@o2ib4) in 227 seconds. I think it's dead, and I am evicting it. exp ffff97fd65e8c400, cur 1555988068 expire 1555987918 last 1555987841 [43233.664952] Lustre: Skipped 11 previous similar messages [43299.853650] Lustre: 78344:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1555988127/real 1555988127] req@ffff981f4051aa00 x1631527220251248/t0(0) o106->fir-OST0021@10.9.102.38@o2ib4:15/16 lens 296/280 e 0 to 1 dl 1555988134 ref 1 fl Rpc:X/0/ffffffff rc 0/-1 [43299.881027] Lustre: 78344:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 5 previous similar messages [43344.238025] bash (76960): drop_caches: 1 [43531.702296] bash (80175): drop_caches: 1 [43720.770370] bash (82406): drop_caches: 1 [43879.649324] Lustre: fir-OST0019: haven't heard from client 4ae4dd3c-af0f-e4dc-b47c-da1f96867925 (at 10.9.109.10@o2ib4) in 227 seconds. I think it's dead, and I am evicting it. exp ffff97fd67435400, cur 1555988714 expire 1555988564 last 1555988487 [43879.671158] Lustre: Skipped 23 previous similar messages [43908.400212] bash (84657): drop_caches: 1 [44097.623875] bash (86888): drop_caches: 1 [44285.356640] bash (89114): drop_caches: 1 [44291.665782] Lustre: fir-OST0019: Connection restored to 0f9d5551-73e2-8d2d-8339-b8d135099fdc (at 10.9.108.12@o2ib4) [44291.676255] Lustre: Skipped 5 previous similar messages [44353.923157] Lustre: fir-OST0019: Connection restored to 424c499c-bcf2-3c1f-c771-0484a4bdadc1 (at 10.8.27.23@o2ib6) [44353.933602] Lustre: Skipped 5 previous similar messages [44392.812690] Lustre: fir-OST0019: Connection restored to (at 10.9.107.70@o2ib4) [44392.820012] Lustre: Skipped 5 previous similar messages [44472.574955] bash (91375): drop_caches: 1 [44660.910148] bash (93590): drop_caches: 1 [44849.397261] bash (95827): drop_caches: 1 [44861.658862] Lustre: fir-OST001f: haven't heard from client 49cf3d37-e2ff-ae77-424f-6a2eef196d6e (at 10.9.104.69@o2ib4) in 227 seconds. I think it's dead, and I am evicting it. exp ffff980d271c2400, cur 1555989696 expire 1555989546 last 1555989469 [44861.680654] Lustre: Skipped 41 previous similar messages [44972.561946] Lustre: fir-OST0019: Connection restored to 981b485e-c8a5-5d22-c1f8-24c836e353d6 (at 10.9.104.60@o2ib4) [44972.572389] Lustre: Skipped 5 previous similar messages [45037.228268] bash (98056): drop_caches: 1 [45043.296019] Lustre: fir-OST0019: Connection restored to e0e0943d-af8d-6a4a-22ed-ff2042f2b73c (at 10.9.102.38@o2ib4) [45043.306539] Lustre: Skipped 5 previous similar messages [45181.298122] Lustre: fir-OST0019: Connection restored to 4ae4dd3c-af0f-e4dc-b47c-da1f96867925 (at 10.9.109.10@o2ib4) [45181.308645] Lustre: Skipped 5 previous similar messages [45227.717516] bash (100268): drop_caches: 1 [45335.516793] Lustre: fir-OST0023: Client 69e867f7-2c34-9281-0411-6ff880d43ef5 (at 10.8.28.11@o2ib6) reconnecting [45335.526887] Lustre: Skipped 226 previous similar messages [45335.532329] Lustre: fir-OST0023: Connection restored to 8e7541d0-0fc3-808f-491c-d2d84f4a1345 (at 10.8.28.11@o2ib6) [45335.542691] Lustre: Skipped 6 previous similar messages [45336.443056] Lustre: 78321:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1555990163/real 0] req@ffff981af0aa0900 x1631527251887824/t0(0) o104->fir-OST0019@10.8.16.4@o2ib6:15/16 lens 296/224 e 0 to 1 dl 1555990170 ref 2 fl Rpc:X/0/ffffffff rc 0/-1 [45336.469485] Lustre: 78321:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 8 previous similar messages [45354.019243] LustreError: 78494:0:(ldlm_lib.c:3258:target_bulk_io()) @@@ Reconnect on bulk READ req@ffff97fd6973cc50 x1631313929508768/t0(0) o3->db58df27-551e-acbf-8944-575be218e3f1@10.8.20.3@o2ib6:167/0 lens 488/440 e 0 to 0 dl 1555990237 ref 1 fl Interpret:/0/0 rc 0/0 [45354.043121] LustreError: 78494:0:(ldlm_lib.c:3258:target_bulk_io()) Skipped 51 previous similar messages [45356.822463] LNetError: 74202:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (-125, 0) [45356.834975] LNetError: 74202:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 113 previous similar messages [45356.844743] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f084cdcc00 [45356.855590] Lustre: fir-OST001b: Bulk IO read error with db58df27-551e-acbf-8944-575be218e3f1 (at 10.8.20.3@o2ib6), client will retry: rc -110 [45356.868404] Lustre: Skipped 121 previous similar messages [45363.935453] LustreError: 137-5: fir-OST0018_UUID: not available for connect from 10.8.27.24@o2ib6 (no target). If you are running an HA pair check that the target is mounted on the other server. [45363.952759] LustreError: Skipped 56 previous similar messages [45367.410391] Lustre: 78577:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1555990194/real 0] req@ffff980a64802700 x1631527252204384/t0(0) o104->fir-OST001f@10.8.2.28@o2ib6:15/16 lens 296/224 e 0 to 1 dl 1555990201 ref 2 fl Rpc:X/0/ffffffff rc 0/-1 [45367.436798] Lustre: 78577:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 2 previous similar messages [45374.364741] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97ff4ae26e00 [45374.375553] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97ff4ae26e00 [45374.386362] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97ff4ae26e00 [45374.397238] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97ff4ae26e00 [45374.408203] Lustre: fir-OST001b: Bulk IO write error with ac30e7a3-0c2a-d332-2695-2869a8e06f55 (at 10.8.29.7@o2ib6), client will retry: rc = -110 [45374.421266] Lustre: Skipped 6 previous similar messages [45378.175941] LustreError: 74198:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980ae2012600 [45378.186732] LustreError: 74200:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980ae2012600 [45378.530708] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980082d88400 [45381.391903] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f5277a8800 [45381.417276] LustreError: 74200:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980bf504c200 [45381.428129] LustreError: 74198:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980bf504c200 [45381.438985] LustreError: 74197:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980bf504c200 [45381.449764] LustreError: 74200:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980bf504c200 [45381.460596] LustreError: 74199:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980bf504c200 [45381.471412] LustreError: 74198:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980bf504c200 [45381.482210] LustreError: 74197:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980bf504c200 [45381.492994] LustreError: 74200:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980bf504c200 [45381.503815] LustreError: 74199:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980bf504c200 [45381.514620] LustreError: 74198:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980bf504c200 [45381.525415] LustreError: 74197:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980bf504c200 [45381.536199] LustreError: 74200:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980bf504c200 [45381.547006] LustreError: 74199:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980bf504c200 [45381.557831] LustreError: 74198:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980bf504c200 [45381.568629] LustreError: 74197:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980bf504c200 [45381.579410] LustreError: 74200:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980bf504c200 [45383.012480] LustreError: 74199:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9803afe36800 [45383.024999] LustreError: 74208:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f89585e800 [45383.035802] LustreError: 74207:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f89585e800 [45383.046608] LustreError: 74208:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f89585e800 [45383.057397] LustreError: 74206:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f89585e800 [45383.068182] LustreError: 74205:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f89585e800 [45383.078971] LustreError: 74207:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f89585e800 [45383.089792] LustreError: 74208:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f89585e800 [45383.100579] LustreError: 74206:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f89585e800 [45383.814201] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97fbcbafac00 [45384.661083] LustreError: 74198:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97ff277b0600 [45384.671876] LustreError: 74199:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97ff277b0600 [45384.682692] LustreError: 74197:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97ff277b0600 [45384.693495] LustreError: 74200:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97ff277b0600 [45387.678200] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f2d7a1b800 [45411.133707] Lustre: fir-OST0019: Client f49e329b-b3be-1bd2-3b50-8f9f387b3091 (at 10.8.9.8@o2ib6) reconnecting [45411.143624] Lustre: Skipped 167 previous similar messages [45414.873545] bash (102546): drop_caches: 1 [45417.362952] Lustre: 78751:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1555990244/real 0] req@ffff980f208d2d00 x1631527252976576/t0(0) o106->fir-OST001d@10.8.29.6@o2ib6:15/16 lens 296/280 e 0 to 1 dl 1555990251 ref 2 fl Rpc:X/0/ffffffff rc 0/-1 [45417.389365] Lustre: 78751:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 54 previous similar messages [45439.023800] LustreError: 137-5: fir-OST001c_UUID: not available for connect from 10.8.8.15@o2ib6 (no target). If you are running an HA pair check that the target is mounted on the other server. [45439.041022] LustreError: Skipped 213 previous similar messages [45445.536266] LustreError: 78878:0:(ldlm_lib.c:3258:target_bulk_io()) @@@ Reconnect on bulk WRITE req@ffff980da0f11050 x1631542363775792/t0(0) o4->f2a4d35e-05ff-fe02-d6c7-6c183d27b8a1@10.8.8.29@o2ib6:221/0 lens 488/448 e 1 to 0 dl 1555990291 ref 1 fl Interpret:/2/0 rc 0/0 [45445.560255] LustreError: 78878:0:(ldlm_lib.c:3258:target_bulk_io()) Skipped 10 previous similar messages [45448.077704] LNetError: 74202:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (-125, 0) [45448.090220] LNetError: 74202:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 39 previous similar messages [45448.098803] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980ca737dc00 [45448.098808] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980ca737dc00 [45448.098812] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980ca737dc00 [45448.132274] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980ca737dc00 [45448.143262] Lustre: fir-OST0021: Bulk IO write error with f2a4d35e-05ff-fe02-d6c7-6c183d27b8a1 (at 10.8.8.29@o2ib6), client will retry: rc = -110 [45448.156333] Lustre: Skipped 7 previous similar messages [45454.491376] LNetError: 74195:0:(o2iblnd_cb.c:3324:kiblnd_check_txs_locked()) Timed out tx: tx_queue, 0 seconds [45454.501379] LNetError: 74195:0:(o2iblnd_cb.c:3324:kiblnd_check_txs_locked()) Skipped 1 previous similar message [45454.511468] LNetError: 74195:0:(o2iblnd_cb.c:3399:kiblnd_check_conns()) Timed out RDMA with 10.0.10.201@o2ib7 (0): c: 0, oc: 1, rc: 8 [45454.523459] LNetError: 74195:0:(o2iblnd_cb.c:3399:kiblnd_check_conns()) Skipped 1 previous similar message [45456.388373] LustreError: 74206:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980f85032400 [45456.399167] LustreError: 74207:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980f85032400 [45456.409965] LustreError: 74206:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980f85032400 [45456.420759] LustreError: 74207:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980f85032400 [45456.431557] LustreError: 74206:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980f85032400 [45474.656237] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f359835800 [45474.667040] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f359835800 [45474.677854] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f359835800 [45474.688668] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f359835800 [45476.405595] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97ff8f612200 [45476.416411] Lustre: fir-OST001b: Bulk IO read error with db58df27-551e-acbf-8944-575be218e3f1 (at 10.8.20.3@o2ib6), client will retry: rc -110 [45476.429208] Lustre: Skipped 2 previous similar messages [45479.048021] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9807eab34a00 [45479.536049] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9803dda63200 [45480.752574] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98018aecc600 [45480.763369] LustreError: 78941:0:(ldlm_lib.c:3264:target_bulk_io()) @@@ network error on bulk READ req@ffff980d281a6050 x1631319729681968/t0(0) o3->5eac609f-93d2-6221-fd42-f7bef4a2d6f6@10.8.23.36@o2ib6:270/0 lens 488/440 e 1 to 0 dl 1555990340 ref 1 fl Interpret:/0/0 rc 0/0 [45480.787703] LustreError: 78941:0:(ldlm_lib.c:3264:target_bulk_io()) Skipped 39 previous similar messages [45481.116891] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980082d8d000 [45481.127719] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980082d8d000 [45481.138495] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980082d8d000 [45481.142431] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f359835800 [45481.142437] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f359835800 [45481.685428] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980e41876a00 [45482.798518] LustreError: 74208:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981ac45fdc00 [45483.529630] LustreError: 74199:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97fe9faff000 [45483.591595] LustreError: 74200:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f359835800 [45483.602408] LustreError: 74200:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f359835800 [45483.613223] LustreError: 74200:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f359835800 [45483.624044] LustreError: 74200:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f359835800 [45483.634872] LustreError: 74200:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f359835800 [45483.645729] LustreError: 74199:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f359835800 [45483.716426] LustreError: 74198:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97ef14eb7200 [45483.833402] LustreError: 74197:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980abc7a9c00 [45484.975451] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f24f1bee00 [45485.009047] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980b0c166200 [45485.512102] Lustre: fir-OST0023: Connection restored to c1daa3b1-7187-6a73-5669-96e0808785d7 (at 10.8.8.29@o2ib6) [45485.522368] Lustre: Skipped 596 previous similar messages [45486.351971] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981048df2e00 [45487.420646] LustreError: 74206:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980a87d69e00 [45487.775181] LustreError: 74199:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f0926b6a00 [45488.163211] LustreError: 74206:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981443daee00 [45488.285057] LustreError: 74207:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f1080d8400 [45488.483455] LustreError: 74207:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97ff7ffb9e00 [45488.531269] LustreError: 74199:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980082d89e00 [45488.924226] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9804c64e1a00 [45488.935039] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9804c64e1a00 [45489.052166] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9808bbb62800 [45489.062953] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9808bbb62800 [45489.645475] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981087abee00 [45490.218438] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f2369b2800 [45490.575010] LustreError: 74199:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980f1e2f8200 [45490.683291] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981730520000 [45491.288529] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980ae34be200 [45491.299330] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980ae34be200 [45491.310187] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98120bce7800 [45491.320965] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98120bce7800 [45491.419308] LustreError: 74200:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980c967d4c00 [45491.430094] LustreError: 74199:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980c967d4c00 [45491.440946] LustreError: 74200:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980c967d4c00 [45491.451768] LustreError: 74197:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980c967d4c00 [45491.541256] LustreError: 74198:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f5341de000 [45491.552093] LustreError: 74200:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f5341de000 [45491.562882] LustreError: 74198:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f5341de000 [45491.573680] LustreError: 74200:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f5341de000 [45491.584501] LustreError: 74199:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f7200c4a00 [45491.957236] LustreError: 74198:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980bb4d53400 [45491.968251] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98075cc35200 [45492.137164] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980f1e2fee00 [45492.261246] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980b887e0e00 [45492.376910] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98005068f200 [45492.387728] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98005068f200 [45492.398546] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98005068f200 [45492.409410] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98005068f200 [45492.521650] LustreError: 74208:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9800321a1000 [45493.054486] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9811b6a9ee00 [45493.259325] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97fc06255a00 [45494.053345] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980153430000 [45494.086624] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97ff77f4d000 [45494.097405] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97ff77f4d000 [45494.108183] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97ff77f4d000 [45494.118963] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97ff77f4d000 [45494.129752] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97ff77f4d000 [45494.140536] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97ff77f4d000 [45494.151325] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97ff77f4d000 [45494.162117] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97ff77f4d000 [45494.172896] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97ff77f4d000 [45494.183685] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97ff77f4d000 [45494.194470] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97ff77f4d000 [45494.205265] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97ff77f4d000 [45494.216039] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97ff77f4d000 [45494.226831] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97ff77f4d000 [45494.237620] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97ff77f4d000 [45494.248408] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97ff77f4d000 [45494.761879] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980910e10e00 [45496.130456] LustreError: 74206:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981a5459ac00 [45496.888882] Lustre: 78639:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1555990324/real 0] req@ffff97f2f732ce00 x1631527253914560/t0(0) o104->fir-OST001b@10.8.30.25@o2ib6:15/16 lens 296/224 e 0 to 1 dl 1555990331 ref 2 fl Rpc:X/0/ffffffff rc 0/-1 [45496.915375] Lustre: 78639:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 16 previous similar messages [45497.553978] LustreError: 74198:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980741855c00 [45497.971296] LustreError: 74200:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98063b923a00 [45498.066614] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98093535f400 [45498.228127] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f151e88600 [45498.291552] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98033cdb5400 [45498.302355] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98033cdb5400 [45498.313151] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98033cdb5400 [45498.501055] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980a6e1d9200 [45498.511837] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980a6e1d9200 [45498.522618] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980a6e1d9200 [45498.606016] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980488497400 [45498.616839] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980488497400 [45498.627647] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980488497400 [45498.638443] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980488497400 [45499.218077] LustreError: 74208:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980a6e1d9200 [45499.384237] LustreError: 74205:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980488493400 [45499.520930] LustreError: 74206:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980abc7af000 [45500.355348] LustreError: 74207:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97feb6aba400 [45500.418367] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97febd2d0000 [45500.837107] LustreError: 74199:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9800935f3000 [45500.847890] LustreError: 74200:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9800935f3000 [45500.858682] LustreError: 74197:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9800935f3000 [45500.869467] LustreError: 74198:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9800935f3000 [45503.324110] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981206012800 [45503.474907] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f1727b5e00 [45503.716908] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f0926b3a00 [45503.727738] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9806384a3e00 [45504.841150] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980ae1b58200 [45504.972097] LustreError: 74198:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9806dd8b2400 [45505.270664] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980082d88a00 [45505.540360] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9802953ab600 [45505.945282] LustreError: 74199:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98157f26d800 [45505.946812] LustreError: 74200:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9801061e1000 [45505.966871] LustreError: 74197:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98157f26d800 [45505.977668] LustreError: 78826:0:(ldlm_lib.c:3264:target_bulk_io()) @@@ network error on bulk WRITE req@ffff981d81ed9c50 x1631541886301264/t0(0) o4->61a62562-ad73-dc2c-c4dd-497b185dd54e@10.8.16.5@o2ib6:298/0 lens 488/448 e 1 to 0 dl 1555990368 ref 1 fl Interpret:/0/0 rc 0/0 [45506.002029] LustreError: 78826:0:(ldlm_lib.c:3264:target_bulk_io()) Skipped 10 previous similar messages [45506.383829] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98033cdb5400 [45506.519767] LustreError: 74198:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9800786c8c00 [45506.572201] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97ff881eda00 [45506.583004] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97ff881eda00 [45506.593793] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97ff881eda00 [45506.604583] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97ff881eda00 [45506.741895] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97ff3c5c6800 [45506.752709] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97ff3c5c6800 [45506.763531] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97ff3c5c6800 [45506.774339] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97ff3c5c6800 [45506.836070] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980488493400 [45506.846851] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980488493400 [45506.857650] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980488493400 [45506.929813] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98046d1bf200 [45506.940612] LustreError: 74198:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f1ae6a4200 [45506.940625] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98046d1bf200 [45506.940647] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98046d1bf200 [45508.400480] LustreError: 74207:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98036b9e0200 [45508.897974] LustreError: 74207:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98081ff9a800 [45509.257425] LustreError: 74200:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980488496400 [45509.268232] LustreError: 74199:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980488496400 [45509.279049] LustreError: 74200:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980488496400 [45509.289922] LustreError: 74197:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980488496400 [45509.396241] LustreError: 74198:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98046d1bf200 [45510.703511] LustreError: 74199:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980d23c83000 [45513.596412] LNetError: 74206:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (-125, 0) [45513.608927] LNetError: 74206:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 148 previous similar messages [45513.618692] LustreError: 74206:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981135b7a800 [45514.433468] LustreError: 74198:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980a1b566600 [45515.000594] LustreError: 74197:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f08de38e00 [45523.097404] LustreError: 74198:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980af20a7200 [45526.950952] LustreError: 74200:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f01018bc00 [45527.533966] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98036b9e4000 [45530.476257] LustreError: 78572:0:(ldlm_lib.c:3258:target_bulk_io()) @@@ Reconnect on bulk READ req@ffff980d20a21850 x1631319729694624/t0(0) o3->5eac609f-93d2-6221-fd42-f7bef4a2d6f6@10.8.23.36@o2ib6:369/0 lens 488/440 e 0 to 0 dl 1555990439 ref 1 fl Interpret:/0/0 rc 0/0 [45530.500246] LustreError: 78572:0:(ldlm_lib.c:3258:target_bulk_io()) Skipped 69 previous similar messages [45539.038430] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98071e942400 [45542.012393] LustreError: 77026:0:(ldlm_lockd.c:256:expired_lock_main()) ### lock callback timer expired after 144s: evicting client at 10.8.30.25@o2ib6 ns: filter-fir-OST001d_UUID lock: ffff97f343375e80/0xd80148303fa40a5c lrc: 3/0,0 mode: PR/PR res: [0xcc0000401:0x8fac20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8388608->536870911) flags: 0x60000400000020 nid: 10.8.30.25@o2ib6 remote: 0xbe556e1b655d7b77 expref: 1456 pid: 78590 timeout: 45496 lvb_type: 1 [45561.146164] Lustre: fir-OST001f: Client 766c6e9e-6589-78e8-fb69-8836dc850825 (at 10.8.28.2@o2ib6) reconnecting [45561.156258] Lustre: Skipped 1318 previous similar messages [45589.038343] LustreError: 137-5: fir-OST0018_UUID: not available for connect from 10.8.18.24@o2ib6 (no target). If you are running an HA pair check that the target is mounted on the other server. [45589.055652] LustreError: Skipped 1731 previous similar messages [45601.677048] bash (104819): drop_caches: 1 [45606.609613] LustreError: 74198:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981133440800 [45606.620553] Lustre: fir-OST001b: Bulk IO read error with ebb81670-151c-6f45-4a7e-a2c58a6ba974 (at 10.8.1.1@o2ib6), client will retry: rc -110 [45606.633259] Lustre: Skipped 55 previous similar messages [45628.552402] LustreError: 78976:0:(ldlm_lib.c:3248:target_bulk_io()) @@@ timeout on bulk WRITE after 100+0s req@ffff980d27511c50 x1631532255029376/t0(0) o4->5ecdf8a1-adb3-71c6-2488-cfd77c1490e9@10.8.7.10@o2ib6:422/0 lens 488/448 e 3 to 0 dl 1555990492 ref 1 fl Interpret:/0/0 rc 0/0 [45634.754475] LustreError: 78385:0:(ldlm_lib.c:3248:target_bulk_io()) @@@ timeout on bulk WRITE after 100+0s req@ffff980d2876fc50 x1631365223613712/t0(0) o4->6205f8e0-8454-d734-d73d-8497c81b2877@10.8.13.27@o2ib6:404/0 lens 488/448 e 0 to 0 dl 1555990474 ref 1 fl Interpret:/0/0 rc 0/0 [45637.013502] LustreError: 77026:0:(ldlm_lockd.c:256:expired_lock_main()) ### lock callback timer expired after 166s: evicting client at 10.8.30.25@o2ib6 ns: filter-fir-OST0021_UUID lock: ffff9800ddb5c140/0xd80148303f9eca6a lrc: 3/0,0 mode: PR/PR res: [0x980000401:0x91f8a4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 131072->16777215) flags: 0x60000400000020 nid: 10.8.30.25@o2ib6 remote: 0xbe556e1b655b4477 expref: 1439 pid: 78375 timeout: 45591 lvb_type: 1 [45637.054822] LustreError: 77026:0:(ldlm_lockd.c:256:expired_lock_main()) Skipped 1 previous similar message [45639.376428] LustreError: 74205:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97fa09b36200 [45639.759673] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9816ca3a9800 [45639.770479] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9800a1334a00 [45639.773704] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98140437dc00 [45639.792048] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980c9b74e000 [45639.802844] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980ae82fb000 [45639.813652] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980c9b74e000 [45639.824471] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9803cd12b400 [45639.835277] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98081d62fc00 [45639.846091] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980ae82fb000 [45642.334422] LNetError: 74202:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (-125, 0) [45642.334423] LNetError: 74203:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (-125, 0) [45642.334427] LNetError: 74203:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 17 previous similar messages [45642.334431] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f518cc0400 [45642.379982] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980015775400 [45648.076664] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f070b76400 [45648.087490] Lustre: fir-OST001f: Bulk IO write error with f2a4d35e-05ff-fe02-d6c7-6c183d27b8a1 (at 10.8.8.29@o2ib6), client will retry: rc = -110 [45648.100549] Lustre: Skipped 26 previous similar messages [45648.404389] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9809d404aa00 [45649.116640] Lustre: 78332:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1555990471/real 0] req@ffff97ef0033fb00 x1631527255587824/t0(0) o104->fir-OST001f@10.8.15.3@o2ib6:15/16 lens 296/224 e 0 to 1 dl 1555990483 ref 2 fl Rpc:X/0/ffffffff rc 0/-1 [45649.143092] Lustre: 78332:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 51 previous similar messages [45653.013689] LustreError: 77026:0:(ldlm_lockd.c:256:expired_lock_main()) ### lock callback timer expired after 198s: evicting client at 10.8.15.3@o2ib6 ns: filter-fir-OST0021_UUID lock: ffff980c3b2e5e80/0xd801483040533995 lrc: 3/0,0 mode: PR/PR res: [0x980000402:0x577a70:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4294967296->34359738367) flags: 0x60000400010020 nid: 10.8.15.3@o2ib6 remote: 0x8f5d091c2818578f expref: 1293 pid: 78669 timeout: 45651 lvb_type: 1 [45653.055456] LustreError: 77026:0:(ldlm_lockd.c:256:expired_lock_main()) Skipped 1 previous similar message [45654.972703] LNet: Service thread pid 78496 was inactive for 200.06s. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes: [45654.989834] LNet: Skipped 1 previous similar message [45654.994824] Pid: 78496, comm: ll_ost02_063 3.10.0-957.1.3.el7_lustre.x86_64 #1 SMP Fri Dec 7 14:50:35 PST 2018 [45655.004895] Call Trace: [45655.007389] [<ffffffffc0f9b640>] ptlrpc_set_wait+0x500/0x8d0 [ptlrpc] [45655.014038] [<ffffffffc0f58fe5>] ldlm_run_ast_work+0xd5/0x3a0 [ptlrpc] [45655.020820] [<ffffffffc0f59710>] ldlm_handle_conflict_lock+0x70/0x320 [ptlrpc] [45655.028289] [<ffffffffc0f59ca3>] ldlm_lock_enqueue+0x2e3/0xa60 [ptlrpc] [45655.035091] [<ffffffffc0f73dbf>] ldlm_cli_enqueue_local+0x36f/0x870 [ptlrpc] [45655.042315] [<ffffffffc16176ad>] ofd_destroy_by_fid+0x1dd/0x4a0 [ofd] [45655.048884] [<ffffffffc160c4f7>] ofd_destroy_hdl+0x267/0x970 [ofd] [45655.055198] [<ffffffffc101010a>] tgt_request_handle+0xaea/0x1580 [ptlrpc] [45655.062171] [<ffffffffc0fb46db>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc] [45655.069909] [<ffffffffc0fb800c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc] [45655.076280] [<ffffffff8b8c1c31>] kthread+0xd1/0xe0 [45655.081203] [<ffffffff8bf74c24>] ret_from_fork_nospec_begin+0xe/0x21 [45655.087682] [<ffffffffffffffff>] 0xffffffffffffffff [45655.092724] LustreError: dumping log to /tmp/lustre-log.1555990489.78496 [45659.627765] LustreError: 78951:0:(ldlm_lib.c:3248:target_bulk_io()) @@@ timeout on bulk READ after 100+0s req@ffff980d20a27450 x1631531303265168/t0(0) o3->f3bba4e8-9568-4001-6257-88537741a8c9@10.8.29.3@o2ib6:478/0 lens 488/440 e 1 to 0 dl 1555990548 ref 1 fl Interpret:/0/0 rc 0/0 [45667.731326] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97eeba714600 [45667.742142] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97eeba714600 [45667.752946] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97eeba714600 [45674.198045] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f1b407fc00 [45676.575949] LustreError: 78993:0:(ldlm_lib.c:3248:target_bulk_io()) @@@ timeout on bulk WRITE after 100+0s req@ffff97fd697ff850 x1631301597535952/t0(0) o4->ac385b68-0e9f-e187-164e-1e323b3f7cf6@10.8.23.21@o2ib6:520/0 lens 488/448 e 1 to 0 dl 1555990590 ref 1 fl Interpret:/0/0 rc 0/0 [45689.014100] LustreError: 77026:0:(ldlm_lockd.c:256:expired_lock_main()) ### lock callback timer expired after 131s: evicting client at 10.8.12.34@o2ib6 ns: filter-fir-OST001f_UUID lock: ffff97fec2e5ee40/0xd8014830405e29db lrc: 4/0,0 mode: PR/PR res: [0x480000400:0x57705a:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 268435456->8589934591) flags: 0x60000400010020 nid: 10.8.12.34@o2ib6 remote: 0xb9eee23f5a4925f2 expref: 993 pid: 78510 timeout: 45658 lvb_type: 1 [45689.055924] LustreError: 77026:0:(ldlm_lockd.c:256:expired_lock_main()) Skipped 4 previous similar messages [45690.301103] LNet: Service thread pid 78639 was inactive for 200.41s. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes: [45690.318046] Pid: 78639, comm: ll_ost00_089 3.10.0-957.1.3.el7_lustre.x86_64 #1 SMP Fri Dec 7 14:50:35 PST 2018 [45690.328073] Call Trace: [45690.330544] [<ffffffffc0f9b640>] ptlrpc_set_wait+0x500/0x8d0 [ptlrpc] [45690.337152] [<ffffffffc0f58fe5>] ldlm_run_ast_work+0xd5/0x3a0 [ptlrpc] [45690.343858] [<ffffffffc0f59710>] ldlm_handle_conflict_lock+0x70/0x320 [ptlrpc] [45690.351246] [<ffffffffc0f59ca3>] ldlm_lock_enqueue+0x2e3/0xa60 [ptlrpc] [45690.358052] [<ffffffffc0f826d7>] ldlm_handle_enqueue0+0xa47/0x15a0 [ptlrpc] [45690.365172] [<ffffffffc10090b2>] tgt_enqueue+0x62/0x210 [ptlrpc] [45690.371358] [<ffffffffc101010a>] tgt_request_handle+0xaea/0x1580 [ptlrpc] [45690.378327] [<ffffffffc0fb46db>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc] [45690.386042] [<ffffffffc0fb800c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc] [45690.392385] [<ffffffff8b8c1c31>] kthread+0xd1/0xe0 [45690.397298] [<ffffffff8bf74c24>] ret_from_fork_nospec_begin+0xe/0x21 [45690.403800] [<ffffffffffffffff>] 0xffffffffffffffff [45690.408835] LustreError: dumping log to /tmp/lustre-log.1555990524.78639 [45691.669172] Lustre: fir-OST0019: haven't heard from client 2f0572a5-2973-80b0-f334-47bd2ec60bfe (at 10.8.27.23@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff980d281f1800, cur 1555990526 expire 1555990376 last 1555990299 [45691.690927] Lustre: Skipped 11 previous similar messages [45692.409272] LustreError: 74200:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981c3a947a00 [45694.909159] LNet: Service thread pid 78606 was inactive for 200.58s. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes: [45694.926099] Pid: 78606, comm: ll_ost01_088 3.10.0-957.1.3.el7_lustre.x86_64 #1 SMP Fri Dec 7 14:50:35 PST 2018 [45694.936098] Call Trace: [45694.938569] [<ffffffffc0f9b640>] ptlrpc_set_wait+0x500/0x8d0 [ptlrpc] [45694.945192] [<ffffffffc0f58fe5>] ldlm_run_ast_work+0xd5/0x3a0 [ptlrpc] [45694.951884] [<ffffffffc0f59710>] ldlm_handle_conflict_lock+0x70/0x320 [ptlrpc] [45694.959274] [<ffffffffc0f59ca3>] ldlm_lock_enqueue+0x2e3/0xa60 [ptlrpc] [45694.966026] [<ffffffffc0f826d7>] ldlm_handle_enqueue0+0xa47/0x15a0 [ptlrpc] [45694.973155] [<ffffffffc10090b2>] tgt_enqueue+0x62/0x210 [ptlrpc] [45694.979322] [<ffffffffc101010a>] tgt_request_handle+0xaea/0x1580 [ptlrpc] [45694.986263] [<ffffffffc0fb46db>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc] [45694.993993] [<ffffffffc0fb800c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc] [45695.000342] [<ffffffff8b8c1c31>] kthread+0xd1/0xe0 [45695.005262] [<ffffffff8bf74c24>] ret_from_fork_nospec_begin+0xe/0x21 [45695.011757] [<ffffffffffffffff>] 0xffffffffffffffff [45695.016798] LustreError: dumping log to /tmp/lustre-log.1555990529.78606 [45697.981190] LNet: Service thread pid 78365 was inactive for 200.07s. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes: [45697.998149] Pid: 78365, comm: ll_ost03_030 3.10.0-957.1.3.el7_lustre.x86_64 #1 SMP Fri Dec 7 14:50:35 PST 2018 [45698.008150] Call Trace: [45698.010638] [<ffffffffc0f9b640>] ptlrpc_set_wait+0x500/0x8d0 [ptlrpc] [45698.017245] [<ffffffffc0f58fe5>] ldlm_run_ast_work+0xd5/0x3a0 [ptlrpc] [45698.023954] [<ffffffffc0f59710>] ldlm_handle_conflict_lock+0x70/0x320 [ptlrpc] [45698.031321] [<ffffffffc0f59ca3>] ldlm_lock_enqueue+0x2e3/0xa60 [ptlrpc] [45698.038097] [<ffffffffc0f826d7>] ldlm_handle_enqueue0+0xa47/0x15a0 [ptlrpc] [45698.045203] [<ffffffffc10090b2>] tgt_enqueue+0x62/0x210 [ptlrpc] [45698.051390] [<ffffffffc101010a>] tgt_request_handle+0xaea/0x1580 [ptlrpc] [45698.058371] [<ffffffffc0fb46db>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc] [45698.066106] [<ffffffffc0fb800c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc] [45698.072454] [<ffffffff8b8c1c31>] kthread+0xd1/0xe0 [45698.077381] [<ffffffff8bf74c24>] ret_from_fork_nospec_begin+0xe/0x21 [45698.083875] [<ffffffffffffffff>] 0xffffffffffffffff [45698.088909] LustreError: dumping log to /tmp/lustre-log.1555990532.78365 [45698.545203] LustreError: 78641:0:(ldlm_lib.c:3248:target_bulk_io()) @@@ timeout on bulk WRITE after 100+0s req@ffff980d271e9450 x1631300487818688/t0(0) o4->ac30e7a3-0c2a-d332-2695-2869a8e06f55@10.8.29.7@o2ib6:514/0 lens 488/448 e 1 to 0 dl 1555990584 ref 1 fl Interpret:/0/0 rc 0/0 [45698.570145] LustreError: 78641:0:(ldlm_lib.c:3248:target_bulk_io()) Skipped 1 previous similar message [45708.014315] LustreError: 77026:0:(ldlm_lockd.c:256:expired_lock_main()) ### lock callback timer expired after 150s: evicting client at 10.8.8.35@o2ib6 ns: filter-fir-OST0019_UUID lock: ffff98039f3a7bc0/0xd80148303c1f78ec lrc: 4/0,0 mode: PR/PR res: [0x640000400:0x577213:0x0].0x0 rrc: 12 type: EXT [0->18446744073709551615] (req 4294967296->34359738367) flags: 0x60000400010020 nid: 10.8.8.35@o2ib6 remote: 0xe6a2cb5e1671be12 expref: 861 pid: 78267 timeout: 45656 lvb_type: 1 [45708.056073] LustreError: 77026:0:(ldlm_lockd.c:256:expired_lock_main()) Skipped 20 previous similar messages [45708.733309] LNet: Service thread pid 78346 was inactive for 200.42s. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes: [45708.750242] Pid: 78346, comm: ll_ost01_038 3.10.0-957.1.3.el7_lustre.x86_64 #1 SMP Fri Dec 7 14:50:35 PST 2018 [45708.760268] Call Trace: [45708.762743] [<ffffffffc0f9b640>] ptlrpc_set_wait+0x500/0x8d0 [ptlrpc] [45708.769339] [<ffffffffc0f58fe5>] ldlm_run_ast_work+0xd5/0x3a0 [ptlrpc] [45708.776040] [<ffffffffc0f7a69b>] ldlm_glimpse_locks+0x3b/0x100 [ptlrpc] [45708.782799] [<ffffffffc162910b>] ofd_intent_policy+0x69b/0x920 [ofd] [45708.789288] [<ffffffffc0f59d26>] ldlm_lock_enqueue+0x366/0xa60 [ptlrpc] [45708.796068] [<ffffffffc0f826d7>] ldlm_handle_enqueue0+0xa47/0x15a0 [ptlrpc] [45708.803174] [<ffffffffc10090b2>] tgt_enqueue+0x62/0x210 [ptlrpc] [45708.809335] [<ffffffffc101010a>] tgt_request_handle+0xaea/0x1580 [ptlrpc] [45708.816296] [<ffffffffc0fb46db>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc] [45708.824050] [<ffffffffc0fb800c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc] [45708.830380] [<ffffffff8b8c1c31>] kthread+0xd1/0xe0 [45708.835294] [<ffffffff8bf74c24>] ret_from_fork_nospec_begin+0xe/0x21 [45708.841766] [<ffffffffffffffff>] 0xffffffffffffffff [45708.846823] LustreError: dumping log to /tmp/lustre-log.1555990543.78346 [45713.853376] LNet: Service thread pid 78262 was inactive for 200.41s. Watchdog stack traces are limited to 3 per 300 seconds, skipping this one. [45713.866243] LustreError: dumping log to /tmp/lustre-log.1555990548.78262 [45716.413400] LNet: Service thread pid 78559 was inactive for 200.31s. Watchdog stack traces are limited to 3 per 300 seconds, skipping this one. [45716.426269] LustreError: dumping log to /tmp/lustre-log.1555990550.78559 [45721.533461] LNet: Service thread pid 78739 was inactive for 200.58s. Watchdog stack traces are limited to 3 per 300 seconds, skipping this one. [45721.546327] LustreError: dumping log to /tmp/lustre-log.1555990555.78739 [45722.557482] LustreError: dumping log to /tmp/lustre-log.1555990556.78775 [45723.061691] INFO: task ll_ost_io01_004:78374 blocked for more than 120 seconds. [45723.069009] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [45723.076863] ll_ost_io01_004 D ffff982d23020000 0 78374 2 0x00000080 [45723.083974] Call Trace: [45723.086433] [<ffffffff8bf65d60>] ? bit_wait+0x50/0x50 [45723.091594] [<ffffffff8bf67c49>] schedule+0x29/0x70 [45723.096570] [<ffffffff8bf65721>] schedule_timeout+0x221/0x2d0 [45723.102432] [<ffffffff8bf65d60>] ? bit_wait+0x50/0x50 [45723.107593] [<ffffffff8bf672ed>] io_schedule_timeout+0xad/0x130 [45723.113626] [<ffffffff8bf67388>] io_schedule+0x18/0x20 [45723.118875] [<ffffffff8bf65d71>] bit_wait_io+0x11/0x50 [45723.124122] [<ffffffff8bf65921>] __wait_on_bit_lock+0x61/0xc0 [45723.129966] [<ffffffff8b9b5b44>] __lock_page+0x74/0x90 [45723.135215] [<ffffffff8b8c2dc0>] ? wake_bit_function+0x40/0x40 [45723.141145] [<ffffffff8b9b6844>] __find_lock_page+0x54/0x70 [45723.146835] [<ffffffff8b9b74b4>] find_or_create_page+0x34/0xa0 [45723.152784] [<ffffffffc14d7ea7>] osd_bufs_get+0x3a7/0x800 [osd_ldiskfs] [45723.159525] [<ffffffffc1624e67>] ofd_preprw+0x6b7/0x1160 [ofd] [45723.165523] [<ffffffffc0fcdb4f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc] [45723.172475] [<ffffffffc101157b>] tgt_brw_read+0x9db/0x1e50 [ptlrpc] [45723.178853] [<ffffffff8bb82a14>] ? vsnprintf+0x234/0x6a0 [45723.184308] [<ffffffffc0d4e929>] ? lprocfs_counter_add+0xf9/0x160 [obdclass] [45723.191484] [<ffffffffc0fdff86>] ? null_alloc_rs+0x186/0x340 [ptlrpc] [45723.198094] [<ffffffffc0fa880f>] ? lustre_pack_reply_v2+0x14f/0x280 [ptlrpc] [45723.205266] [<ffffffffc0fa89af>] ? lustre_pack_reply_flags+0x6f/0x1e0 [ptlrpc] [45723.212635] [<ffffffffc0fa8b31>] ? lustre_pack_reply+0x11/0x20 [ptlrpc] [45723.219395] [<ffffffffc101010a>] tgt_request_handle+0xaea/0x1580 [ptlrpc] [45723.226286] [<ffffffffc0bf1f07>] ? libcfs_debug_msg+0x57/0x80 [libcfs] [45723.232973] [<ffffffffc0fb46db>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc] [45723.240633] [<ffffffff8b8d67c2>] ? default_wake_function+0x12/0x20 [45723.246921] [<ffffffff8b8cba9b>] ? __wake_up_common+0x5b/0x90 [45723.252809] [<ffffffffc0fb800c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc] [45723.259129] [<ffffffffc0fb7510>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc] [45723.266540] [<ffffffff8b8c1c31>] kthread+0xd1/0xe0 [45723.271438] [<ffffffff8b8c1b60>] ? insert_kthread_work+0x40/0x40 [45723.277559] [<ffffffff8bf74c24>] ret_from_fork_nospec_begin+0xe/0x21 [45723.284026] [<ffffffff8b8c1b60>] ? insert_kthread_work+0x40/0x40 [45723.290143] INFO: task ll_ost_io03_007:78434 blocked for more than 120 seconds. [45723.297457] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [45723.305307] ll_ost_io03_007 D ffff982d234dc100 0 78434 2 0x00000080 [45723.312404] Call Trace: [45723.314861] [<ffffffff8bf65d60>] ? bit_wait+0x50/0x50 [45723.320028] [<ffffffff8bf67c49>] schedule+0x29/0x70 [45723.325015] [<ffffffff8bf65721>] schedule_timeout+0x221/0x2d0 [45723.330851] [<ffffffff8bf65d60>] ? bit_wait+0x50/0x50 [45723.336014] [<ffffffff8bf672ed>] io_schedule_timeout+0xad/0x130 [45723.342030] [<ffffffff8bf67388>] io_schedule+0x18/0x20 [45723.347265] [<ffffffff8bf65d71>] bit_wait_io+0x11/0x50 [45723.352516] [<ffffffff8bf65921>] __wait_on_bit_lock+0x61/0xc0 [45723.358361] [<ffffffff8b9b5b44>] __lock_page+0x74/0x90 [45723.363618] [<ffffffff8b8c2dc0>] ? wake_bit_function+0x40/0x40 [45723.369547] [<ffffffff8b9b6844>] __find_lock_page+0x54/0x70 [45723.375235] [<ffffffff8b9b74b4>] find_or_create_page+0x34/0xa0 [45723.381188] [<ffffffffc14d7ea7>] osd_bufs_get+0x3a7/0x800 [osd_ldiskfs] [45723.387919] [<ffffffffc1624e67>] ofd_preprw+0x6b7/0x1160 [ofd] [45723.393904] [<ffffffffc0fcdb4f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc] [45723.400842] [<ffffffffc101157b>] tgt_brw_read+0x9db/0x1e50 [ptlrpc] [45723.407224] [<ffffffff8bb82a14>] ? vsnprintf+0x234/0x6a0 [45723.412676] [<ffffffffc0d4e929>] ? lprocfs_counter_add+0xf9/0x160 [obdclass] [45723.419848] [<ffffffffc0fdff86>] ? null_alloc_rs+0x186/0x340 [ptlrpc] [45723.426433] [<ffffffffc0fa880f>] ? lustre_pack_reply_v2+0x14f/0x280 [ptlrpc] [45723.433615] [<ffffffffc0fa89af>] ? lustre_pack_reply_flags+0x6f/0x1e0 [ptlrpc] [45723.440979] [<ffffffffc0fa8b31>] ? lustre_pack_reply+0x11/0x20 [ptlrpc] [45723.447741] [<ffffffffc101010a>] tgt_request_handle+0xaea/0x1580 [ptlrpc] [45723.454628] [<ffffffffc0bf1f07>] ? libcfs_debug_msg+0x57/0x80 [libcfs] [45723.461316] [<ffffffffc0fb46db>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc] [45723.469006] [<ffffffffc0fb1565>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc] [45723.475821] [<ffffffff8b8d67c2>] ? default_wake_function+0x12/0x20 [45723.482110] [<ffffffff8b8cba9b>] ? __wake_up_common+0x5b/0x90 [45723.487982] [<ffffffffc0fb800c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc] [45723.494299] [<ffffffffc0fb7510>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc] [45723.501716] [<ffffffff8b8c1c31>] kthread+0xd1/0xe0 [45723.506607] [<ffffffff8b8c1b60>] ? insert_kthread_work+0x40/0x40 [45723.512739] [<ffffffff8bf74c24>] ret_from_fork_nospec_begin+0xe/0x21 [45723.519187] [<ffffffff8b8c1b60>] ? insert_kthread_work+0x40/0x40 [45723.525294] INFO: task ll_ost_io00_011:78458 blocked for more than 120 seconds. [45723.532631] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [45723.540463] ll_ost_io00_011 D ffff982d214a8000 0 78458 2 0x00000080 [45723.547602] Call Trace: [45723.550060] [<ffffffff8bb82a14>] ? vsnprintf+0x234/0x6a0 [45723.555495] [<ffffffff8bf65d60>] ? bit_wait+0x50/0x50 [45723.560658] [<ffffffff8bf67c49>] schedule+0x29/0x70 [45723.565652] [<ffffffff8bf65721>] schedule_timeout+0x221/0x2d0 [45723.571500] [<ffffffffc0bf1a58>] ? libcfs_debug_vmsg2+0x6d8/0xb30 [libcfs] [45723.578529] [<ffffffffc052bb30>] ? _mlx5_ib_post_send+0x3a0/0x13c0 [mlx5_ib] [45723.581483] LNet: Service thread pid 78885 was inactive for 200.14s. Watchdog stack traces are limited to 3 per 300 seconds, skipping this one. [45723.581485] LNet: Skipped 11 previous similar messages [45723.581486] LustreError: dumping log to /tmp/lustre-log.1555990557.78885 [45723.610417] [<ffffffff8bf65d60>] ? bit_wait+0x50/0x50 [45723.615562] [<ffffffff8bf672ed>] io_schedule_timeout+0xad/0x130 [45723.621598] [<ffffffff8bf67388>] io_schedule+0x18/0x20 [45723.626829] [<ffffffff8bf65d71>] bit_wait_io+0x11/0x50 [45723.632067] [<ffffffff8bf65921>] __wait_on_bit_lock+0x61/0xc0 [45723.637942] [<ffffffff8b9b5b44>] __lock_page+0x74/0x90 [45723.643200] [<ffffffff8b8c2dc0>] ? wake_bit_function+0x40/0x40 [45723.649150] [<ffffffff8b9b6844>] __find_lock_page+0x54/0x70 [45723.654831] [<ffffffff8b9b74b4>] find_or_create_page+0x34/0xa0 [45723.660794] [<ffffffffc14d7ea7>] osd_bufs_get+0x3a7/0x800 [osd_ldiskfs] [45723.667509] [<ffffffffc1624e67>] ofd_preprw+0x6b7/0x1160 [ofd] [45723.673511] [<ffffffffc0fcdb4f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc] [45723.680491] [<ffffffffc101157b>] tgt_brw_read+0x9db/0x1e50 [ptlrpc] [45723.686856] [<ffffffff8bb82a14>] ? vsnprintf+0x234/0x6a0 [45723.692323] [<ffffffffc0d4e929>] ? lprocfs_counter_add+0xf9/0x160 [obdclass] [45723.699528] [<ffffffffc0fdff86>] ? null_alloc_rs+0x186/0x340 [ptlrpc] [45723.706105] [<ffffffffc0fa880f>] ? lustre_pack_reply_v2+0x14f/0x280 [ptlrpc] [45723.713295] [<ffffffffc0fa89af>] ? lustre_pack_reply_flags+0x6f/0x1e0 [ptlrpc] [45723.720648] [<ffffffffc0fa8b31>] ? lustre_pack_reply+0x11/0x20 [ptlrpc] [45723.727413] [<ffffffffc101010a>] tgt_request_handle+0xaea/0x1580 [ptlrpc] [45723.734311] [<ffffffffc0bf1f07>] ? libcfs_debug_msg+0x57/0x80 [libcfs] [45723.740958] [<ffffffffc0fb46db>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc] [45723.748660] [<ffffffffc0fb1565>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc] [45723.755478] [<ffffffff8b8d67c2>] ? default_wake_function+0x12/0x20 [45723.761757] [<ffffffff8b8cba9b>] ? __wake_up_common+0x5b/0x90 [45723.767648] [<ffffffffc0fb800c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc] [45723.773952] [<ffffffffc0fb7510>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc] [45723.781373] [<ffffffff8b8c1c31>] kthread+0xd1/0xe0 [45723.786256] [<ffffffff8b8c1b60>] ? insert_kthread_work+0x40/0x40 [45723.792378] [<ffffffff8bf74c24>] ret_from_fork_nospec_begin+0xe/0x21 [45723.798850] [<ffffffff8b8c1b60>] ? insert_kthread_work+0x40/0x40 [45723.804974] INFO: task ll_ost_io03_016:78561 blocked for more than 120 seconds. [45723.812305] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [45723.820152] ll_ost_io03_016 D ffff982d20bc5140 0 78561 2 0x00000080 [45723.827272] Call Trace: [45723.829731] [<ffffffff8bb82a14>] ? vsnprintf+0x234/0x6a0 [45723.835159] [<ffffffff8bf65d60>] ? bit_wait+0x50/0x50 [45723.840317] [<ffffffff8bf67c49>] schedule+0x29/0x70 [45723.845295] [<ffffffff8bf65721>] schedule_timeout+0x221/0x2d0 [45723.851156] [<ffffffffc0bf1a58>] ? libcfs_debug_vmsg2+0x6d8/0xb30 [libcfs] [45723.858167] [<ffffffffc052bb30>] ? _mlx5_ib_post_send+0x3a0/0x13c0 [mlx5_ib] [45723.865306] [<ffffffff8bf65d60>] ? bit_wait+0x50/0x50 [45723.870489] [<ffffffff8bf672ed>] io_schedule_timeout+0xad/0x130 [45723.876503] [<ffffffff8bf67388>] io_schedule+0x18/0x20 [45723.881738] [<ffffffff8bf65d71>] bit_wait_io+0x11/0x50 [45723.887003] [<ffffffff8bf65921>] __wait_on_bit_lock+0x61/0xc0 [45723.892841] [<ffffffff8b9b5b44>] __lock_page+0x74/0x90 [45723.898089] [<ffffffff8b8c2dc0>] ? wake_bit_function+0x40/0x40 [45723.904020] [<ffffffff8b9b6844>] __find_lock_page+0x54/0x70 [45723.909688] [<ffffffff8b9b74b4>] find_or_create_page+0x34/0xa0 [45723.915657] [<ffffffffc14d7ea7>] osd_bufs_get+0x3a7/0x800 [osd_ldiskfs] [45723.922391] [<ffffffffc1624e67>] ofd_preprw+0x6b7/0x1160 [ofd] [45723.928365] [<ffffffffc0fcdb4f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc] [45723.935316] [<ffffffffc101157b>] tgt_brw_read+0x9db/0x1e50 [ptlrpc] [45723.941690] [<ffffffff8bb82a14>] ? vsnprintf+0x234/0x6a0 [45723.947138] [<ffffffffc0d4e929>] ? lprocfs_counter_add+0xf9/0x160 [obdclass] [45723.954350] [<ffffffffc0fdff86>] ? null_alloc_rs+0x186/0x340 [ptlrpc] [45723.960934] [<ffffffffc0fa880f>] ? lustre_pack_reply_v2+0x14f/0x280 [ptlrpc] [45723.968106] [<ffffffffc0fa89af>] ? lustre_pack_reply_flags+0x6f/0x1e0 [ptlrpc] [45723.975465] [<ffffffffc0fa8b31>] ? lustre_pack_reply+0x11/0x20 [ptlrpc] [45723.982219] [<ffffffffc101010a>] tgt_request_handle+0xaea/0x1580 [ptlrpc] [45723.989130] [<ffffffffc0bf1f07>] ? libcfs_debug_msg+0x57/0x80 [libcfs] [45723.995797] [<ffffffffc0fb46db>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc] [45724.003514] [<ffffffffc0fb1565>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc] [45724.010312] [<ffffffff8b8d67c2>] ? default_wake_function+0x12/0x20 [45724.016606] [<ffffffff8b8cba9b>] ? __wake_up_common+0x5b/0x90 [45724.022492] [<ffffffffc0fb800c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc] [45724.028813] [<ffffffffc0fb7510>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc] [45724.036229] [<ffffffff8b8c1c31>] kthread+0xd1/0xe0 [45724.041140] [<ffffffff8b8c1b60>] ? insert_kthread_work+0x40/0x40 [45724.047272] [<ffffffff8bf74c24>] ret_from_fork_nospec_begin+0xe/0x21 [45724.053741] [<ffffffff8b8c1b60>] ? insert_kthread_work+0x40/0x40 [45724.059869] INFO: task ll_ost_io00_037:78754 blocked for more than 120 seconds. [45724.067180] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [45724.075031] ll_ost_io00_037 D ffff982d22eed140 0 78754 2 0x00000080 [45724.082163] Call Trace: [45724.084630] [<ffffffff8bb82a14>] ? vsnprintf+0x234/0x6a0 [45724.090055] [<ffffffff8bf65d60>] ? bit_wait+0x50/0x50 [45724.093492] LustreError: dumping log to /tmp/lustre-log.1555990558.78799 [45724.101930] [<ffffffff8bf67c49>] schedule+0x29/0x70 [45724.106939] [<ffffffff8bf65721>] schedule_timeout+0x221/0x2d0 [45724.112803] [<ffffffffc0bf1a58>] ? libcfs_debug_vmsg2+0x6d8/0xb30 [libcfs] [45724.119820] [<ffffffffc052bb30>] ? _mlx5_ib_post_send+0x3a0/0x13c0 [mlx5_ib] [45724.126981] [<ffffffff8bf65d60>] ? bit_wait+0x50/0x50 [45724.132161] [<ffffffff8bf672ed>] io_schedule_timeout+0xad/0x130 [45724.138189] [<ffffffff8bf67388>] io_schedule+0x18/0x20 [45724.143444] [<ffffffff8bf65d71>] bit_wait_io+0x11/0x50 [45724.148693] [<ffffffff8bf65921>] __wait_on_bit_lock+0x61/0xc0 [45724.154536] [<ffffffff8b9b5b44>] __lock_page+0x74/0x90 [45724.159798] [<ffffffff8b8c2dc0>] ? wake_bit_function+0x40/0x40 [45724.165722] [<ffffffff8b9b6844>] __find_lock_page+0x54/0x70 [45724.171407] [<ffffffff8b9b74b4>] find_or_create_page+0x34/0xa0 [45724.177368] [<ffffffffc14d7ea7>] osd_bufs_get+0x3a7/0x800 [osd_ldiskfs] [45724.184104] [<ffffffffc1624e67>] ofd_preprw+0x6b7/0x1160 [ofd] [45724.190090] [<ffffffffc0fcdb4f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc] [45724.197014] [<ffffffffc101157b>] tgt_brw_read+0x9db/0x1e50 [ptlrpc] [45724.203415] [<ffffffff8bb82a14>] ? vsnprintf+0x234/0x6a0 [45724.208850] [<ffffffffc0d4e929>] ? lprocfs_counter_add+0xf9/0x160 [obdclass] [45724.216036] [<ffffffffc0fdff86>] ? null_alloc_rs+0x186/0x340 [ptlrpc] [45724.222614] [<ffffffffc0fa880f>] ? lustre_pack_reply_v2+0x14f/0x280 [ptlrpc] [45724.229797] [<ffffffffc0fa89af>] ? lustre_pack_reply_flags+0x6f/0x1e0 [ptlrpc] [45724.237155] [<ffffffffc0fa8b31>] ? lustre_pack_reply+0x11/0x20 [ptlrpc] [45724.243895] [<ffffffffc101010a>] tgt_request_handle+0xaea/0x1580 [ptlrpc] [45724.250819] [<ffffffffc0bf1f07>] ? libcfs_debug_msg+0x57/0x80 [libcfs] [45724.257475] [<ffffffffc0fb46db>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc] [45724.265183] [<ffffffffc0fb1565>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc] [45724.271979] [<ffffffff8b8d67c2>] ? default_wake_function+0x12/0x20 [45724.278275] [<ffffffff8b8cba9b>] ? __wake_up_common+0x5b/0x90 [45724.284165] [<ffffffffc0fb800c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc] [45724.290489] [<ffffffffc0fb7510>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc] [45724.297890] [<ffffffff8b8c1c31>] kthread+0xd1/0xe0 [45724.302779] [<ffffffff8b8c1b60>] ? insert_kthread_work+0x40/0x40 [45724.308881] [<ffffffff8bf74c24>] ret_from_fork_nospec_begin+0xe/0x21 [45724.315349] [<ffffffff8b8c1b60>] ? insert_kthread_work+0x40/0x40 [45724.321451] INFO: task ll_ost_io03_035:78788 blocked for more than 120 seconds. [45724.328779] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [45724.336629] ll_ost_io03_035 D ffff982d1cea4100 0 78788 2 0x00000080 [45724.343769] Call Trace: [45724.346227] [<ffffffff8bb82a14>] ? vsnprintf+0x234/0x6a0 [45724.351671] [<ffffffff8bf65d60>] ? bit_wait+0x50/0x50 [45724.356815] [<ffffffff8bf67c49>] schedule+0x29/0x70 [45724.361808] [<ffffffff8bf65721>] schedule_timeout+0x221/0x2d0 [45724.367671] [<ffffffffc0bf1a58>] ? libcfs_debug_vmsg2+0x6d8/0xb30 [libcfs] [45724.374670] [<ffffffffc052bb30>] ? _mlx5_ib_post_send+0x3a0/0x13c0 [mlx5_ib] [45724.381828] [<ffffffff8bf65d60>] ? bit_wait+0x50/0x50 [45724.387007] [<ffffffff8bf672ed>] io_schedule_timeout+0xad/0x130 [45724.393032] [<ffffffff8bf67388>] io_schedule+0x18/0x20 [45724.398287] [<ffffffff8bf65d71>] bit_wait_io+0x11/0x50 [45724.403537] [<ffffffff8bf65921>] __wait_on_bit_lock+0x61/0xc0 [45724.409399] [<ffffffff8b9b5b44>] __lock_page+0x74/0x90 [45724.414662] [<ffffffff8b8c2dc0>] ? wake_bit_function+0x40/0x40 [45724.420603] [<ffffffff8b9b6844>] __find_lock_page+0x54/0x70 [45724.426284] [<ffffffff8b9b74b4>] find_or_create_page+0x34/0xa0 [45724.432235] [<ffffffffc14d7ea7>] osd_bufs_get+0x3a7/0x800 [osd_ldiskfs] [45724.438963] [<ffffffffc1624e67>] ofd_preprw+0x6b7/0x1160 [ofd] [45724.444954] [<ffffffffc0fcdb4f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc] [45724.451893] [<ffffffffc101157b>] tgt_brw_read+0x9db/0x1e50 [ptlrpc] [45724.458274] [<ffffffff8bb82a14>] ? vsnprintf+0x234/0x6a0 [45724.463704] [<ffffffffc0d4e929>] ? lprocfs_counter_add+0xf9/0x160 [obdclass] [45724.470894] [<ffffffffc0fdff86>] ? null_alloc_rs+0x186/0x340 [ptlrpc] [45724.477498] [<ffffffffc0fa880f>] ? lustre_pack_reply_v2+0x14f/0x280 [ptlrpc] [45724.484689] [<ffffffffc0fa89af>] ? lustre_pack_reply_flags+0x6f/0x1e0 [ptlrpc] [45724.492030] [<ffffffffc0fa8b31>] ? lustre_pack_reply+0x11/0x20 [ptlrpc] [45724.498785] [<ffffffffc101010a>] tgt_request_handle+0xaea/0x1580 [ptlrpc] [45724.505691] [<ffffffffc0bf1f07>] ? libcfs_debug_msg+0x57/0x80 [libcfs] [45724.512365] [<ffffffffc0fb46db>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc] [45724.520057] [<ffffffffc0fb1565>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc] [45724.526868] [<ffffffff8b8d67c2>] ? default_wake_function+0x12/0x20 [45724.533157] [<ffffffff8b8cba9b>] ? __wake_up_common+0x5b/0x90 [45724.539052] [<ffffffffc0fb800c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc] [45724.545388] [<ffffffffc0fb7510>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc] [45724.552788] [<ffffffff8b8c1c31>] kthread+0xd1/0xe0 [45724.557676] [<ffffffff8b8c1b60>] ? insert_kthread_work+0x40/0x40 [45724.563802] [<ffffffff8bf74c24>] ret_from_fork_nospec_begin+0xe/0x21 [45724.570267] [<ffffffff8b8c1b60>] ? insert_kthread_work+0x40/0x40 [45724.576373] INFO: task ll_ost_io02_044:78799 blocked for more than 120 seconds. [45724.583684] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [45724.591539] ll_ost_io02_044 D ffff982d1cab9040 0 78799 2 0x00000080 [45724.598659] Call Trace: [45724.601116] [<ffffffff8bb82a14>] ? vsnprintf+0x234/0x6a0 [45724.606545] [<ffffffff8bf65d60>] ? bit_wait+0x50/0x50 [45724.611703] [<ffffffff8bf67c49>] schedule+0x29/0x70 [45724.616698] [<ffffffff8bf65721>] schedule_timeout+0x221/0x2d0 [45724.622564] [<ffffffffc0bf1a58>] ? libcfs_debug_vmsg2+0x6d8/0xb30 [libcfs] [45724.629572] [<ffffffffc052bb30>] ? _mlx5_ib_post_send+0x3a0/0x13c0 [mlx5_ib] [45724.636726] [<ffffffff8bf65d60>] ? bit_wait+0x50/0x50 [45724.641892] [<ffffffff8bf672ed>] io_schedule_timeout+0xad/0x130 [45724.647907] [<ffffffff8bf67388>] io_schedule+0x18/0x20 [45724.653141] [<ffffffff8bf65d71>] bit_wait_io+0x11/0x50 [45724.658410] [<ffffffff8bf65921>] __wait_on_bit_lock+0x61/0xc0 [45724.664269] [<ffffffff8b9b5b44>] __lock_page+0x74/0x90 [45724.669505] [<ffffffff8b8c2dc0>] ? wake_bit_function+0x40/0x40 [45724.675465] [<ffffffff8b9b6844>] __find_lock_page+0x54/0x70 [45724.681135] [<ffffffff8b9b74b4>] find_or_create_page+0x34/0xa0 [45724.687074] [<ffffffffc14d7ea7>] osd_bufs_get+0x3a7/0x800 [osd_ldiskfs] [45724.693787] [<ffffffffc1624e67>] ofd_preprw+0x6b7/0x1160 [ofd] [45724.699771] [<ffffffffc0fcdb4f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc] [45724.706722] [<ffffffffc101157b>] tgt_brw_read+0x9db/0x1e50 [ptlrpc] [45724.713084] [<ffffffff8bb82a14>] ? vsnprintf+0x234/0x6a0 [45724.718534] [<ffffffffc0d4e929>] ? lprocfs_counter_add+0xf9/0x160 [obdclass] [45724.725722] [<ffffffffc0fdff86>] ? null_alloc_rs+0x186/0x340 [ptlrpc] [45724.732309] [<ffffffffc0fa880f>] ? lustre_pack_reply_v2+0x14f/0x280 [ptlrpc] [45724.739475] [<ffffffffc0fa89af>] ? lustre_pack_reply_flags+0x6f/0x1e0 [ptlrpc] [45724.746815] [<ffffffffc0fa8b31>] ? lustre_pack_reply+0x11/0x20 [ptlrpc] [45724.753571] [<ffffffffc101010a>] tgt_request_handle+0xaea/0x1580 [ptlrpc] [45724.760463] [<ffffffffc0bf1f07>] ? libcfs_debug_msg+0x57/0x80 [libcfs] [45724.767113] [<ffffffffc0fb46db>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc] [45724.774816] [<ffffffffc0fb1565>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc] [45724.781637] [<ffffffff8b8d67c2>] ? default_wake_function+0x12/0x20 [45724.787911] [<ffffffff8b8cba9b>] ? __wake_up_common+0x5b/0x90 [45724.793819] [<ffffffffc0fb800c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc] [45724.800125] [<ffffffffc0fb7510>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc] [45724.807525] [<ffffffff8b8c1c31>] kthread+0xd1/0xe0 [45724.812410] [<ffffffff8b8c1b60>] ? insert_kthread_work+0x40/0x40 [45724.818517] [<ffffffff8bf74c24>] ret_from_fork_nospec_begin+0xe/0x21 [45724.824967] [<ffffffff8b8c1b60>] ? insert_kthread_work+0x40/0x40 [45724.831074] INFO: task ll_ost_io01_064:78805 blocked for more than 120 seconds. [45724.838384] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [45724.846243] ll_ost_io01_064 D ffff982d23720000 0 78805 2 0x00000080 [45724.853356] Call Trace: [45724.855816] [<ffffffff8bb82a14>] ? vsnprintf+0x234/0x6a0 [45724.861243] [<ffffffff8bf65d60>] ? bit_wait+0x50/0x50 [45724.866402] [<ffffffff8bf67c49>] schedule+0x29/0x70 [45724.871383] [<ffffffff8bf65721>] schedule_timeout+0x221/0x2d0 [45724.877245] [<ffffffffc0bf1a58>] ? libcfs_debug_vmsg2+0x6d8/0xb30 [libcfs] [45724.884251] [<ffffffffc052bb30>] ? _mlx5_ib_post_send+0x3a0/0x13c0 [mlx5_ib] [45724.891405] [<ffffffff8bf65d60>] ? bit_wait+0x50/0x50 [45724.896565] [<ffffffff8bf672ed>] io_schedule_timeout+0xad/0x130 [45724.902580] [<ffffffff8bf67388>] io_schedule+0x18/0x20 [45724.907832] [<ffffffff8bf65d71>] bit_wait_io+0x11/0x50 [45724.913094] [<ffffffff8bf65921>] __wait_on_bit_lock+0x61/0xc0 [45724.918936] [<ffffffff8b9b5b44>] __lock_page+0x74/0x90 [45724.924170] [<ffffffff8b8c2dc0>] ? wake_bit_function+0x40/0x40 [45724.930116] [<ffffffff8b9b6844>] __find_lock_page+0x54/0x70 [45724.935797] [<ffffffff8b9b74b4>] find_or_create_page+0x34/0xa0 [45724.941744] [<ffffffffc14d7ea7>] osd_bufs_get+0x3a7/0x800 [osd_ldiskfs] [45724.948476] [<ffffffffc1624e67>] ofd_preprw+0x6b7/0x1160 [ofd] [45724.954446] [<ffffffffc0fcdb4f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc] [45724.961396] [<ffffffffc101157b>] tgt_brw_read+0x9db/0x1e50 [ptlrpc] [45724.967756] [<ffffffff8bb82a14>] ? vsnprintf+0x234/0x6a0 [45724.973190] [<ffffffffc0d4e929>] ? lprocfs_counter_add+0xf9/0x160 [obdclass] [45724.980379] [<ffffffffc0fdff86>] ? null_alloc_rs+0x186/0x340 [ptlrpc] [45724.986945] [<ffffffffc0fa880f>] ? lustre_pack_reply_v2+0x14f/0x280 [ptlrpc] [45724.994113] [<ffffffffc0fa89af>] ? lustre_pack_reply_flags+0x6f/0x1e0 [ptlrpc] [45725.001470] [<ffffffffc0fa8b31>] ? lustre_pack_reply+0x11/0x20 [ptlrpc] [45725.008243] [<ffffffffc101010a>] tgt_request_handle+0xaea/0x1580 [ptlrpc] [45725.015135] [<ffffffffc0bf1f07>] ? libcfs_debug_msg+0x57/0x80 [libcfs] [45725.021826] [<ffffffffc0fb46db>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc] [45725.029524] [<ffffffffc0fb1565>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc] [45725.036321] [<ffffffff8b8d67c2>] ? default_wake_function+0x12/0x20 [45725.042617] [<ffffffff8b8cba9b>] ? __wake_up_common+0x5b/0x90 [45725.048509] [<ffffffffc0fb800c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc] [45725.054815] [<ffffffffc0fb7510>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc] [45725.062231] [<ffffffff8b8c1c31>] kthread+0xd1/0xe0 [45725.067120] [<ffffffff8b8c1b60>] ? insert_kthread_work+0x40/0x40 [45725.073258] [<ffffffff8bf74c24>] ret_from_fork_nospec_begin+0xe/0x21 [45725.079703] [<ffffffff8b8c1b60>] ? insert_kthread_work+0x40/0x40 [45725.085807] INFO: task ll_ost_io03_040:78828 blocked for more than 120 seconds. [45725.093134] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [45725.100981] ll_ost_io03_040 D ffff982d25302080 0 78828 2 0x00000080 [45725.108100] Call Trace: [45725.110561] [<ffffffff8bb82a14>] ? vsnprintf+0x234/0x6a0 [45725.115971] [<ffffffff8bf65d60>] ? bit_wait+0x50/0x50 [45725.121113] [<ffffffff8bf67c49>] schedule+0x29/0x70 [45725.126087] [<ffffffff8bf65721>] schedule_timeout+0x221/0x2d0 [45725.131959] [<ffffffffc0bf1a58>] ? libcfs_debug_vmsg2+0x6d8/0xb30 [libcfs] [45725.138954] [<ffffffffc052bb30>] ? _mlx5_ib_post_send+0x3a0/0x13c0 [mlx5_ib] [45725.146090] [<ffffffff8bf65d60>] ? bit_wait+0x50/0x50 [45725.151240] [<ffffffff8bf672ed>] io_schedule_timeout+0xad/0x130 [45725.157270] [<ffffffff8bf67388>] io_schedule+0x18/0x20 [45725.162518] [<ffffffff8bf65d71>] bit_wait_io+0x11/0x50 [45725.167768] [<ffffffff8bf65921>] __wait_on_bit_lock+0x61/0xc0 [45725.173609] [<ffffffff8b9b5b44>] __lock_page+0x74/0x90 [45725.178863] [<ffffffff8b8c2dc0>] ? wake_bit_function+0x40/0x40 [45725.184788] [<ffffffff8b9b6844>] __find_lock_page+0x54/0x70 [45725.190455] [<ffffffff8b9b74b4>] find_or_create_page+0x34/0xa0 [45725.196393] [<ffffffffc14d7ea7>] osd_bufs_get+0x3a7/0x800 [osd_ldiskfs] [45725.203109] [<ffffffffc1624e67>] ofd_preprw+0x6b7/0x1160 [ofd] [45725.209102] [<ffffffffc0fcdb4f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc] [45725.216040] [<ffffffffc101157b>] tgt_brw_read+0x9db/0x1e50 [ptlrpc] [45725.222405] [<ffffffff8bb82a14>] ? vsnprintf+0x234/0x6a0 [45725.227882] [<ffffffffc0d4e929>] ? lprocfs_counter_add+0xf9/0x160 [obdclass] [45725.235054] [<ffffffffc0fdff86>] ? null_alloc_rs+0x186/0x340 [ptlrpc] [45725.241638] [<ffffffffc0fa880f>] ? lustre_pack_reply_v2+0x14f/0x280 [ptlrpc] [45725.248819] [<ffffffffc0fa89af>] ? lustre_pack_reply_flags+0x6f/0x1e0 [ptlrpc] [45725.256162] [<ffffffffc0fa8b31>] ? lustre_pack_reply+0x11/0x20 [ptlrpc] [45725.262948] [<ffffffffc101010a>] tgt_request_handle+0xaea/0x1580 [ptlrpc] [45725.269834] [<ffffffffc0bf1f07>] ? libcfs_debug_msg+0x57/0x80 [libcfs] [45725.276491] [<ffffffffc0fb46db>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc] [45725.284197] [<ffffffffc0fb1565>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc] [45725.291026] [<ffffffff8b8d67c2>] ? default_wake_function+0x12/0x20 [45725.297302] [<ffffffff8b8cba9b>] ? __wake_up_common+0x5b/0x90 [45725.303191] [<ffffffffc0fb800c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc] [45725.309501] [<ffffffffc0fb7510>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc] [45725.316921] [<ffffffff8b8c1c31>] kthread+0xd1/0xe0 [45725.321825] [<ffffffff8b8c1b60>] ? insert_kthread_work+0x40/0x40 [45725.327931] [<ffffffff8bf74c24>] ret_from_fork_nospec_begin+0xe/0x21 [45725.334377] [<ffffffff8b8c1b60>] ? insert_kthread_work+0x40/0x40 [45725.340506] INFO: task ll_ost_io03_041:78830 blocked for more than 120 seconds. [45725.347834] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [45725.355689] ll_ost_io03_041 D ffff982d25304100 0 78830 2 0x00000080 [45725.362809] Call Trace: [45725.365267] [<ffffffff8bb82a14>] ? vsnprintf+0x234/0x6a0 [45725.370694] [<ffffffff8bf65d60>] ? bit_wait+0x50/0x50 [45725.375854] [<ffffffff8bf67c49>] schedule+0x29/0x70 [45725.380830] [<ffffffff8bf65721>] schedule_timeout+0x221/0x2d0 [45725.386712] [<ffffffffc0bf1a58>] ? libcfs_debug_vmsg2+0x6d8/0xb30 [libcfs] [45725.393701] [<ffffffffc052bb30>] ? _mlx5_ib_post_send+0x3a0/0x13c0 [mlx5_ib] [45725.400842] [<ffffffff8bf65d60>] ? bit_wait+0x50/0x50 [45725.405990] [<ffffffff8bf672ed>] io_schedule_timeout+0xad/0x130 [45725.412041] [<ffffffff8bf67388>] io_schedule+0x18/0x20 [45725.417287] [<ffffffff8bf65d71>] bit_wait_io+0x11/0x50 [45725.422536] [<ffffffff8bf65921>] __wait_on_bit_lock+0x61/0xc0 [45725.428390] [<ffffffff8b9b5b44>] __lock_page+0x74/0x90 [45725.433641] [<ffffffff8b8c2dc0>] ? wake_bit_function+0x40/0x40 [45725.439581] [<ffffffff8b9b6844>] __find_lock_page+0x54/0x70 [45725.445270] [<ffffffff8b9b74b4>] find_or_create_page+0x34/0xa0 [45725.451220] [<ffffffffc14d7ea7>] osd_bufs_get+0x3a7/0x800 [osd_ldiskfs] [45725.457936] [<ffffffffc1624e67>] ofd_preprw+0x6b7/0x1160 [ofd] [45725.463928] [<ffffffffc0fcdb4f>] ? __req_capsule_get+0x15f/0x740 [ptlrpc] [45725.470864] [<ffffffffc101157b>] tgt_brw_read+0x9db/0x1e50 [ptlrpc] [45725.477246] [<ffffffff8bb82a14>] ? vsnprintf+0x234/0x6a0 [45725.482699] [<ffffffffc0d4e929>] ? lprocfs_counter_add+0xf9/0x160 [obdclass] [45725.489899] [<ffffffffc0fdff86>] ? null_alloc_rs+0x186/0x340 [ptlrpc] [45725.496484] [<ffffffffc0fa880f>] ? lustre_pack_reply_v2+0x14f/0x280 [ptlrpc] [45725.503673] [<ffffffffc0fa89af>] ? lustre_pack_reply_flags+0x6f/0x1e0 [ptlrpc] [45725.511034] [<ffffffffc0fa8b31>] ? lustre_pack_reply+0x11/0x20 [ptlrpc] [45725.517777] [<ffffffffc101010a>] tgt_request_handle+0xaea/0x1580 [ptlrpc] [45725.524679] [<ffffffffc0bf1f07>] ? libcfs_debug_msg+0x57/0x80 [libcfs] [45725.531342] [<ffffffffc0fb46db>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc] [45725.539037] [<ffffffffc0fb1565>] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc] [45725.545865] [<ffffffff8b8d67c2>] ? default_wake_function+0x12/0x20 [45725.552139] [<ffffffff8b8cba9b>] ? __wake_up_common+0x5b/0x90 [45725.558010] [<ffffffffc0fb800c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc] [45725.564335] [<ffffffffc0fb7510>] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc] [45725.571754] [<ffffffff8b8c1c31>] kthread+0xd1/0xe0 [45725.576639] [<ffffffff8b8c1b60>] ? insert_kthread_work+0x40/0x40 [45725.582745] [<ffffffff8bf74c24>] ret_from_fork_nospec_begin+0xe/0x21 [45725.589188] [<ffffffff8b8c1b60>] ? insert_kthread_work+0x40/0x40 [45725.629501] LustreError: dumping log to /tmp/lustre-log.1555990559.78540 [45726.141510] LustreError: dumping log to /tmp/lustre-log.1555990560.78735 [45727.677530] LNet: Service thread pid 78691 was inactive for 200.63s. Watchdog stack traces are limited to 3 per 300 seconds, skipping this one. [45727.690400] LNet: Skipped 4 previous similar messages [45727.695462] LustreError: dumping log to /tmp/lustre-log.1555990562.78691 [45728.701541] LustreError: dumping log to /tmp/lustre-log.1555990563.78976 [45729.725550] LustreError: dumping log to /tmp/lustre-log.1555990564.78598 [45730.749568] LustreError: dumping log to /tmp/lustre-log.1555990565.78742 [45733.821595] LustreError: dumping log to /tmp/lustre-log.1555990568.78795 [45734.845614] LustreError: dumping log to /tmp/lustre-log.1555990569.78385 [45736.381628] LNet: Service thread pid 78901 was inactive for 200.27s. Watchdog stack traces are limited to 3 per 300 seconds, skipping this one. [45736.394490] LNet: Skipped 28 previous similar messages [45736.399655] LustreError: dumping log to /tmp/lustre-log.1555990570.78901 [45736.893633] LustreError: dumping log to /tmp/lustre-log.1555990571.78374 [45737.917643] LustreError: dumping log to /tmp/lustre-log.1555990572.78462 [45740.477671] LustreError: dumping log to /tmp/lustre-log.1555990574.78924 [45740.989683] LustreError: dumping log to /tmp/lustre-log.1555990575.78943 [45742.013697] LustreError: dumping log to /tmp/lustre-log.1555990576.78625 [45744.061716] LustreError: dumping log to /tmp/lustre-log.1555990578.78758 [45745.597734] LustreError: dumping log to /tmp/lustre-log.1555990579.78666 [45746.109737] LustreError: dumping log to /tmp/lustre-log.1555990580.78787 [45747.133754] LustreError: dumping log to /tmp/lustre-log.1555990581.78431 [45748.157761] LustreError: dumping log to /tmp/lustre-log.1555990582.78805 [45753.014825] LustreError: 77026:0:(ldlm_lockd.c:256:expired_lock_main()) ### lock callback timer expired after 100s: evicting client at 10.8.30.25@o2ib6 ns: filter-fir-OST001b_UUID lock: ffff98202ef1fbc0/0xd80148303f9f5720 lrc: 4/0,0 mode: PR/PR res: [0xd00000401:0x91fb75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 131072->16777215) flags: 0x60000400000020 nid: 10.8.30.25@o2ib6 remote: 0xbe556e1b655ba78f expref: 1480 pid: 78583 timeout: 45751 lvb_type: 1 [45753.056123] LustreError: 77026:0:(ldlm_lockd.c:256:expired_lock_main()) Skipped 21 previous similar messages [45758.835841] LNet: Service thread pid 78365 completed after 260.92s. This indicates the system was overloaded (too many service threads, or there were not enough hardware resources). [45759.933900] LNet: Service thread pid 78951 was inactive for 200.33s. Watchdog stack traces are limited to 3 per 300 seconds, skipping this one. [45759.946785] LNet: Skipped 24 previous similar messages [45759.951971] LustreError: dumping log to /tmp/lustre-log.1555990594.78951 [45761.981920] LustreError: dumping log to /tmp/lustre-log.1555990596.78909 [45763.517937] LustreError: dumping log to /tmp/lustre-log.1555990597.78857 [45764.109221] LustreError: 74207:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98067c119200 [45764.120028] LustreError: 74206:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98067c119200 [45764.130818] LustreError: 74207:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98067c119200 [45764.141626] LustreError: 74206:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98067c119200 [45764.152415] LustreError: 74207:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98067c119200 [45765.664902] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98067c119200 [45765.675707] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98067c119200 [45765.690433] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98067c119200 [45765.701220] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98067c119200 [45767.101976] LustreError: dumping log to /tmp/lustre-log.1555990601.78754 [45769.602422] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f9ecc51000 [45771.710032] LustreError: dumping log to /tmp/lustre-log.1555990606.78371 [45773.549612] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f23fdf4c00 [45773.560420] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f23fdf4c00 [45773.575036] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f23fdf4c00 [45773.588816] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f23fdf4c00 [45773.599786] LNet: Service thread pid 78494 completed after 244.74s. This indicates the system was overloaded (too many service threads, or there were not enough hardware resources). [45773.782364] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98108105a800 [45773.793145] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98108105a800 [45773.803927] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98108105a800 [45773.814724] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98108105a800 [45773.825503] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98108105a800 [45773.836308] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98108105a800 [45773.847085] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98108105a800 [45773.857889] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98108105a800 [45773.869003] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f5a67e9400 [45773.869010] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98024d2bea00 [45773.869025] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98024d2bea00 [45773.901329] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f5a67e9400 [45773.901332] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98024d2bea00 [45773.922882] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f5a67e9400 [45773.922885] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98024d2bea00 [45773.944440] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f5a67e9400 [45773.944443] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98024d2bea00 [45773.965994] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98024d2bea00 [45773.966029] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f5a67e9400 [45773.966035] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f5a67e9400 [45773.966039] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f5a67e9400 [45773.966073] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f5a67e9400 [45773.966082] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f5a67e9400 [45773.966091] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f5a67e9400 [45774.041413] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98024d2bea00 [45774.041416] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f5a67e9400 [45774.062968] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f5a67e9400 [45774.062972] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98024d2bea00 [45774.062979] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98024d2bea00 [45774.063010] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98024d2bea00 [45774.063014] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98024d2bea00 [45774.063022] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98024d2bea00 [45774.127618] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f5a67e9400 [45774.127621] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98024d2bea00 [45774.149173] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f5a67e9400 [45774.149176] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98024d2bea00 [45774.149182] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98024d2bea00 [45774.149186] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98024d2bea00 [45774.192287] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f5a67e9400 [45774.203084] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f5a67e9400 [45775.806083] LustreError: dumping log to /tmp/lustre-log.1555990610.78560 [45776.830095] LustreError: dumping log to /tmp/lustre-log.1555990611.78993 [45781.950162] LustreError: dumping log to /tmp/lustre-log.1555990616.78509 [45784.510196] LustreError: dumping log to /tmp/lustre-log.1555990618.79110 [45785.544734] Lustre: fir-OST0019: Connection restored to b6a552ba-1fee-0f01-ca1b-817a066e5bf8 (at 10.8.26.22@o2ib6) [45785.555077] Lustre: Skipped 6607 previous similar messages [45787.987403] LustreError: 74198:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98067c119200 [45787.998339] LustreError: 74200:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98067c119200 [45788.009576] LNet: Service thread pid 78739 completed after 267.06s. This indicates the system was overloaded (too many service threads, or there were not enough hardware resources). [45788.025729] LNet: Skipped 3 previous similar messages [45788.182177] bash (107114): drop_caches: 1 [45791.972216] LNet: Service thread pid 78386 completed after 269.96s. This indicates the system was overloaded (too many service threads, or there were not enough hardware resources). [45793.038323] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97fc7621fe00 [45793.049140] Lustre: fir-OST001b: Bulk IO read error with 7e3c5430-7a1b-8856-90e5-f5a371be84d4 (at 10.8.12.31@o2ib6), client will retry: rc -110 [45793.062001] Lustre: Skipped 5 previous similar messages [45795.598727] LustreError: 74206:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97fe86c17000 [45801.456769] LustreError: 74208:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97fa8f8e7000 [45801.467553] LustreError: 74207:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97fa8f8e7000 [45801.467556] LustreError: 74208:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9816ca3a9800 [45801.467562] LustreError: 74208:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9800a1334a00 [45801.467569] LustreError: 74208:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9800a1334a00 [45801.467574] LustreError: 74208:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98140437dc00 [45801.477758] LustreError: 74206:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98081d62fc00 [45801.477766] LustreError: 74206:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980ae82fb000 [45801.477772] LustreError: 74206:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980c9b74e000 [45801.477778] LustreError: 74206:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9803cd12b400 [45801.477783] LustreError: 74206:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9803cd12b400 [45801.575329] LustreError: 74208:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f36d240200 [45801.918420] LNet: Service thread pid 78908 was inactive for 210.41s. Watchdog stack traces are limited to 3 per 300 seconds, skipping this one. [45801.931289] LNet: Skipped 11 previous similar messages [45801.936460] LustreError: dumping log to /tmp/lustre-log.1555990636.78908 [45804.663002] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97fa8f8e7000 [45804.667194] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9816ca3a9800 [45804.667201] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9816ca3a9800 [45804.667210] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9800a1334a00 [45804.667217] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98140437dc00 [45804.667225] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98140437dc00 [45804.667622] Lustre: fir-OST0021: Bulk IO write error with 1b540135-ca45-f45a-a248-eb5cb55b2913 (at 10.8.29.4@o2ib6), client will retry: rc = -110 [45804.667625] Lustre: Skipped 6 previous similar messages [45804.667634] LNet: Service thread pid 78797 completed after 282.11s. This indicates the system was overloaded (too many service threads, or there were not enough hardware resources). [45804.667635] LNet: Skipped 5 previous similar messages [45804.767123] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97fa8f8e7000 [45804.777906] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f36d240200 [45804.777909] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98081d62fc00 [45804.799462] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9803cd12b400 [45804.799501] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f36d240200 [45804.799512] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f36d240200 [45804.831796] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98081d62fc00 [45804.842577] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980ae82fb000 [45804.853360] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980c9b74e000 [45808.574507] LustreError: dumping log to /tmp/lustre-log.1555990642.78641 [45810.622536] LustreError: dumping log to /tmp/lustre-log.1555990644.78800 [45814.206581] LustreError: dumping log to /tmp/lustre-log.1555990648.78660 [45814.431282] LustreError: 74208:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97eeba714600 [45814.442072] LustreError: 74207:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97eeba714600 [45814.452860] LustreError: 74208:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97eeba714600 [45814.463639] LustreError: 74205:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97eeba714600 [45814.474428] LustreError: 74207:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97eeba714600 [45815.742600] LustreError: dumping log to /tmp/lustre-log.1555990650.78979 [45816.432111] LustreError: 74199:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9818fb58e600 [45816.442941] LNet: Service thread pid 79053 completed after 293.92s. This indicates the system was overloaded (too many service threads, or there were not enough hardware resources). [45816.459099] LNet: Skipped 8 previous similar messages [45818.237791] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980b9f55de00 [45818.583847] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97eeba714600 [45818.594657] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97eeba714600 [45819.838650] LustreError: dumping log to /tmp/lustre-log.1555990654.78914 [45820.450831] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981806fd3e00 [45820.487402] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980a3265e400 [45820.862657] LustreError: dumping log to /tmp/lustre-log.1555990655.78520 [45822.398673] LustreError: dumping log to /tmp/lustre-log.1555990656.78789 [45823.026266] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98071a052400 [45827.050355] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980621589400 [45828.370692] LustreError: 74199:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97eeba714600 [45828.381497] LustreError: 74199:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97eeba714600 [45829.837939] LustreError: 74197:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97fe3165a200 [45829.848727] LustreError: 74200:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97fe3165a200 [45829.859505] LustreError: 74198:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97fe3165a200 [45839.916885] LNet: Service thread pid 78462 completed after 302.21s. This indicates the system was overloaded (too many service threads, or there were not enough hardware resources). [45839.933039] LNet: Skipped 9 previous similar messages [45841.502451] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9817be9d2a00 [45847.171751] LustreError: 74208:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98073f027a00 [45851.391537] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981256af7200 [45853.012300] LustreError: 74206:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f9ecc51000 [45856.505478] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97fede39c600 [45857.016099] LustreError: 77026:0:(ldlm_lockd.c:256:expired_lock_main()) ### lock callback timer expired after 99s: evicting client at 10.8.12.28@o2ib6 ns: filter-fir-OST0023_UUID lock: ffff980a51aada00/0xd80148303f52cbb8 lrc: 4/0,0 mode: PR/PR res: [0xd40000402:0x577419:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 17179869184->18446744073709551615) flags: 0x60000400010020 nid: 10.8.12.28@o2ib6 remote: 0x5e5e910839e59fd8 expref: 1062 pid: 78684 timeout: 45855 lvb_type: 1 [45857.058914] LustreError: 77026:0:(ldlm_lockd.c:256:expired_lock_main()) Skipped 1 previous similar message [45860.233978] LustreError: 74205:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980950c98e00 [45860.244790] LustreError: 74208:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980950c98e00 [45860.255579] LustreError: 74206:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980950c98e00 [45860.266370] LustreError: 74207:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980950c98e00 [45861.177118] Lustre: fir-OST001b: Client d4c8ea87-faa9-4d91-6ec5-165f42a6411f (at 10.8.23.28@o2ib6) reconnecting [45861.187207] Lustre: Skipped 9097 previous similar messages [45861.816394] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97efda983e00 [45863.825500] LustreError: 74197:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97fc2df40200 [45865.372880] LustreError: 74208:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9815731fbe00 [45866.981474] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f2731c7c00 [45866.998244] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97edca0d8000 [45867.431950] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9811d776e200 [45867.442770] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9811d776e200 [45867.453581] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9811d776e200 [45867.464357] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9811d776e200 [45867.475140] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9811d776e200 [45867.485947] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9811d776e200 [45871.284275] LustreError: 74197:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f9ecc51000 [45871.295145] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9801dba64400 [45872.063251] LNet: Service thread pid 78759 was inactive for 254.47s. Watchdog stack traces are limited to 3 per 300 seconds, skipping this one. [45872.076117] LNet: Skipped 14 previous similar messages [45872.081266] LustreError: dumping log to /tmp/lustre-log.1555990706.78759 [45872.639763] LustreError: 74207:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f027282c00 [45872.650627] LNet: Service thread pid 78999 completed after 342.29s. This indicates the system was overloaded (too many service threads, or there were not enough hardware resources). [45872.666812] LNet: Skipped 23 previous similar messages [45873.114194] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9807079f5600 [45875.372874] LustreError: 74198:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9815731fbe00 [45876.159304] LustreError: dumping log to /tmp/lustre-log.1555990710.78628 [45877.339315] Lustre: 78598:0:(niobuf.c:303:ptlrpc_abort_bulk()) Unexpectedly long timeout: desc ffff9815731fbe00 [45881.231197] LustreError: 74200:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9801dc811200 [45882.303375] LustreError: dumping log to /tmp/lustre-log.1555990716.78878 [45884.387231] LustreError: 74206:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981cc5024400 [45884.916647] LustreError: 74207:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980682a5d600 [45885.961695] LustreError: 74206:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98020fd4fc00 [45886.000448] LustreError: 74208:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97fca7d12800 [45888.777676] LustreError: 74205:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9801518af000 [45889.004451] Lustre: 78943:0:(niobuf.c:303:ptlrpc_abort_bulk()) Unexpectedly long timeout: desc ffff97f5297f5c00 [45894.754225] LustreError: 74199:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981764f51a00 [45895.585452] LustreError: 74197:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97efe70ebe00 [45895.585454] LustreError: 74198:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9805cdc97400 [45896.492535] Lustre: 78909:0:(niobuf.c:303:ptlrpc_abort_bulk()) Unexpectedly long timeout: desc ffff980a9f553a00 [45896.714268] LustreError: 74198:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981615727800 [45898.465206] LustreError: 137-5: fir-OST0018_UUID: not available for connect from 10.8.0.68@o2ib6 (no target). If you are running an HA pair check that the target is mounted on the other server. [45898.482396] LustreError: Skipped 4836 previous similar messages [45898.817852] LNetError: 74206:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (-125, 0) [45898.830400] LNetError: 74206:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 145 previous similar messages [45898.840147] LustreError: 74206:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f5297f5c00 [45903.920101] LustreError: 74200:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f1a018b800 [45908.723009] LustreError: 74198:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98038369de00 [45908.813062] LustreError: 74198:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980a9f553a00 [45910.230117] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98022bb9c200 [45910.240939] Lustre: 78800:0:(service.c:2165:ptlrpc_server_handle_request()) @@@ Request took longer than estimated (306:4s); client may timeout. req@ffff980d2726f850 x1631558513452832/t0(0) o4->e1078c61-4992-3c32-d70a-6b69c77060d8@10.8.17.5@o2ib6:670/0 lens 488/448 e 3 to 0 dl 1555990740 ref 1 fl Complete:/0/ffffffff rc -110/-1 [45910.646576] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97ef0d15d200 [45910.646578] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981ae08fa400 [45910.646582] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97fc13f07c00 [45911.015362] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f79bb1e400 [45911.019769] LustreError: 74203:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980d058ab800 [45911.019773] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980d058ab800 [45911.897271] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9802d1efc000 [45911.908056] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9802d1efc000 [45911.999718] LustreError: dumping log to /tmp/lustre-log.1555990746.78322 [45913.296732] Lustre: 79047:0:(niobuf.c:303:ptlrpc_abort_bulk()) Unexpectedly long timeout: desc ffff981ba5a81200 [45915.329631] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980950c98e00 [45916.095769] LustreError: dumping log to /tmp/lustre-log.1555990750.78274 [45917.589401] LustreError: 74199:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980ec9d2f000 [45917.596789] LustreError: 74198:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980042d9a800 [45918.111504] LustreError: 74199:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981ae08fa400 [45918.111506] LustreError: 74197:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97ef0d15d200 [45918.111513] LustreError: 74200:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97fc13f07c00 [45918.371666] LustreError: 74198:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f79bb1e400 [45918.382444] LustreError: 74200:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f79bb1e400 [45918.382448] LustreError: 74198:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980d058ab800 [45918.382453] LustreError: 74198:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff980d058ab800 [45918.414772] LustreError: 74199:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f79bb1e400 [45918.879145] LustreError: 74206:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981ae08fa400 [45918.879150] LustreError: 74207:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97ef0d15d200 [45918.879156] LustreError: 74207:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f118a8be00 [45918.879162] LustreError: 74207:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97fc13f07c00 [45919.465920] LustreError: 74199:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f19d475200 [45919.465925] LustreError: 74198:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9802d1efc000 [45919.465930] LustreError: 74198:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9802d1efc000 [45921.215825] LustreError: dumping log to /tmp/lustre-log.1555990755.78258 [45922.865526] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9815731fbe00 [45922.876310] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff9815731fbe00 [45926.375884] Lustre: 78876:0:(niobuf.c:303:ptlrpc_abort_bulk()) Unexpectedly long timeout: desc ffff98078af67400 [45926.385971] Lustre: 78876:0:(niobuf.c:303:ptlrpc_abort_bulk()) Skipped 1 previous similar message [45931.677823] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff98078af67400 [45937.600017] LustreError: dumping log to /tmp/lustre-log.1555990771.78366 [45957.596251] Lustre: 78759:0:(niobuf.c:303:ptlrpc_abort_bulk()) Unexpectedly long timeout: desc ffff9802cf105000 [45957.606358] Lustre: 78759:0:(niobuf.c:303:ptlrpc_abort_bulk()) Skipped 1 previous similar message [45959.156202] LustreError: 74201:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f359830400 [45959.167046] LNet: Service thread pid 78859 completed after 425.23s. This indicates the system was overloaded (too many service threads, or there were not enough hardware resources). [45959.183234] LNet: Skipped 38 previous similar messages [45961.957036] LustreError: 74202:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff981ba5a81200 [45965.533057] LustreError: 74204:0:(events.c:450:server_bulk_callback()) event type 5, status -125, desc ffff97f88d60e000 [45969.592193] LustreError: 132-0: fir-OST0023: BAD READ CHECKSUM: should have changed on the client or in transit: from 10.8.18.9@o2ib6 inode [0x240012eaa:0x17c3:0x0] object 0xd40000401:8173955 extent [156717056-156782591], client returned csum 0 (type 4), server csum d23451aa (type 4) [45976.610469] Lustre: 78993:0:(niobuf.c:303:ptlrpc_abort_bulk()) Unexpectedly long timeout: desc ffff97fc2a75fe00 [45976.620563] Lustre: 78993:0:(niobuf.c:303:ptlrpc_abort_bulk()) Skipped 4 previous similar messages [45980.535516] bash (109476): drop_caches: 1 [45988.800614] LNet: Service thread pid 78499 was inactive for 363.36s. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes: [45988.817552] Pid: 78499, comm: ll_ost02_065 3.10.0-957.1.3.el7_lustre.x86_64 #1 SMP Fri Dec 7 14:50:35 PST 2018 [45988.827556] Call Trace: [45988.830030] [<ffffffffc0f9b640>] ptlrpc_set_wait+0x500/0x8d0 [ptlrpc] [45988.836635] [<ffffffffc0f58fe5>] ldlm_run_ast_work+0xd5/0x3a0 [ptlrpc] [45988.843326] [<ffffffffc0f59710>] ldlm_handle_conflict_lock+0x70/0x320 [ptlrpc] [45988.850692] [<ffffffffc0f59ca3>] ldlm_lock_enqueue+0x2e3/0xa60 [ptlrpc] [45988.857469] [<ffffffffc0f73dbf>] ldlm_cli_enqueue_local+0x36f/0x870 [ptlrpc] [45988.864662] [<ffffffffc16176ad>] ofd_destroy_by_fid+0x1dd/0x4a0 [ofd] [45988.871239] [<ffffffffc160c4f7>] ofd_destroy_hdl+0x267/0x970 [ofd] [45988.877542] [<ffffffffc101010a>] tgt_request_handle+0xaea/0x1580 [ptlrpc] [45988.884508] [<ffffffffc0fb46db>] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc] [45988.892247] [<ffffffffc0fb800c>] ptlrpc_main+0xafc/0x1fc0 [ptlrpc] [45988.898605] [<ffffffff8b8c1c31>] kthread+0xd1/0xe0 [45988.903524] [<ffffffff8bf74c24>] ret_from_fork_nospec_begin+0xe/0x21 [45988.910012] [<ffffffffffffffff>] 0xffffffffffffffff [45988.915039] LustreError: dumping log to /tmp/lustre-log.1555990823.78499 [45993.714674] Lustre: 78261:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for sent delay: [sent 1555990821/real 0] req@ffff97ef8c5d8c00 x1631527257408256/t0(0) o106->fir-OST0021@10.8.16.2@o2ib6:15/16 lens 296/280 e 0 to 1 dl 1555990828 ref 2 fl Rpc:X/0/ffffffff rc 0/-1 [45993.741077] Lustre: 78261:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 98 previous similar messages [46008.417781] SysRq : Trigger a crash [46008.421345] BUG: unable to handle kernel NULL pointer dereference at (null) [46008.429221] IP: [<ffffffff8bc61e66>] sysrq_handle_crash+0x16/0x20 [46008.435350] PGD 27b83f067 PUD 38ccec067 PMD 0 [46008.439874] Oops: 0002 [#1] SMP [46008.443161] Modules linked in: osp(OE) ofd(OE) lfsck(OE) ost(OE) mgc(OE) osd_ldiskfs(OE) lquota(OE) raid456 async_raid6_recov async_memcpy async_pq raid6_pq libcrc32c async_xor xor async_tx ldiskfs(OE) lustre(OE) lmv(OE) mdc(OE) osc(OE) lov(OE) fid(OE) fld(OE) ko2iblnd(OE) ptlrpc(OE) obdclass(OE) lnet(OE) libcfs(OE) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache rdma_ucm(OE) ib_ucm(OE) rdma_cm(OE) iw_cm(OE) ib_ipoib(OE) ib_cm(OE) ib_umad(OE) mlx5_fpga_tools(OE) mlx4_en(OE) mlx4_ib(OE) mlx4_core(OE) sunrpc vfat fat dcdbas amd64_edac_mod edac_mce_amd kvm_amd kvm irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd pcspkr k10temp ccp i2c_piix4 dm_service_time dm_multipath ses enclosure dm_mod ipmi_si ipmi_devintf sg ipmi_msghandler [46008.515500] acpi_power_meter knem(OE) ip_tables ext4 mbcache jbd2 sd_mod crc_t10dif crct10dif_generic mlx5_ib(OE) ib_uverbs(OE) ib_core(OE) i2c_algo_bit drm_kms_helper ahci mlx5_core(OE) syscopyarea sysfillrect sysimgblt fb_sys_fops libahci ttm mlxfw(OE) crct10dif_pclmul devlink drm megaraid_sas tg3 crct10dif_common mlx_compat(OE) ptp libata crc32c_intel drm_panel_orientation_quirks pps_core mpt3sas(OE) raid_class scsi_transport_sas [46008.553524] CPU: 5 PID: 109753 Comm: bash Kdump: loaded Tainted: G OE ------------ 3.10.0-957.1.3.el7_lustre.x86_64 #1 [46008.565335] Hardware name: Dell Inc. PowerEdge R6415/065PKD, BIOS 1.6.7 10/29/2018 [46008.572902] task: ffff981d90374100 ti: ffff9812817fc000 task.ti: ffff9812817fc000 [46008.580380] RIP: 0010:[<ffffffff8bc61e66>] [<ffffffff8bc61e66>] sysrq_handle_crash+0x16/0x20 [46008.588925] RSP: 0018:ffff9812817ffe58 EFLAGS: 00010246 [46008.594238] RAX: ffffffff8bc61e50 RBX: ffffffff8c4e4c60 RCX: 0000000000000000 [46008.601372] RDX: 0000000000000000 RSI: ffff980dbf653898 RDI: 0000000000000063 [46008.608503] RBP: ffff9812817ffe58 R08: ffffffff8c7e38bc R09: ffffffff8c8d84fb [46008.615637] R10: 00000000000024be R11: 00000000000024bd R12: 0000000000000063 [46008.622770] R13: 0000000000000000 R14: 0000000000000007 R15: 0000000000000000 [46008.629903] FS: 00007f601798c740(0000) GS:ffff980dbf640000(0000) knlGS:0000000000000000 [46008.637989] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [46008.643735] CR2: 0000000000000000 CR3: 0000000e04534000 CR4: 00000000003407e0 [46008.650868] Call Trace: [46008.653325] [<ffffffff8bc6268d>] __handle_sysrq+0x10d/0x170 [46008.658992] [<ffffffff8bc62af8>] write_sysrq_trigger+0x28/0x40 [46008.664919] [<ffffffff8bab81a0>] proc_reg_write+0x40/0x80 [46008.670406] [<ffffffff8ba41310>] vfs_write+0xc0/0x1f0 [46008.675543] [<ffffffff8ba4212f>] SyS_write+0x7f/0xf0 [46008.680599] [<ffffffff8bf74ddb>] system_call_fastpath+0x22/0x27 [46008.686609] Code: eb 9b 45 01 f4 45 39 65 34 75 e5 4c 89 ef e8 e2 f7 ff ff eb db 66 66 66 66 90 55 48 89 e5 c7 05 b1 54 7e 00 01 00 00 00 0f ae f8 <c6> 04 25 00 00 00 00 01 5d c3 66 66 66 66 90 55 31 c0 c7 05 2e [46008.707132] RIP [<ffffffff8bc61e66>] sysrq_handle_crash+0x16/0x20 [46008.713337] RSP <ffff9812817ffe58> [46008.716829] CR2: 0000000000000000