[ 0.000000] Initializing cgroup subsys cpuset [ 0.000000] Initializing cgroup subsys cpu [ 0.000000] Initializing cgroup subsys cpuacct [ 0.000000] Linux version 3.10.0-957.1.3.el7_lustre.x86_64 (sthiell@fir-io1-s1) (gcc version 4.8.5 20150623 (Red Hat 4.8.5-36) (GCC) ) #1 SMP Fri Dec 7 14:50:35 PST 2018 [ 0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-3.10.0-957.1.3.el7_lustre.x86_64 root=UUID=72101a50-b839-4605-96ff-e9b0ad37370c ro crashkernel=auto nomodeset console=ttyS0,115200 LANG=en_US.UTF-8 [ 0.000000] e820: BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008efff] usable [ 0.000000] BIOS-e820: [mem 0x000000000008f000-0x000000000008ffff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000000090000-0x000000000009ffff] usable [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005c3dffff] usable [ 0.000000] BIOS-e820: [mem 0x000000005c3e0000-0x00000000643e7fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000643e8000-0x000000006cacefff] usable [ 0.000000] BIOS-e820: [mem 0x000000006cacf000-0x000000006efcefff] reserved [ 0.000000] BIOS-e820: [mem 0x000000006efcf000-0x000000006fdfefff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x000000006fdff000-0x000000006fffefff] ACPI data [ 0.000000] BIOS-e820: [mem 0x000000006ffff000-0x000000006fffffff] usable [ 0.000000] BIOS-e820: [mem 0x0000000070000000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fec10000-0x00000000fec10fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed80000-0x00000000fed80fff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000107f37ffff] usable [ 0.000000] BIOS-e820: [mem 0x000000107f380000-0x000000107fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000001080000000-0x000000207ff7ffff] usable [ 0.000000] BIOS-e820: [mem 0x000000207ff80000-0x000000207fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000002080000000-0x000000307ff7ffff] usable [ 0.000000] BIOS-e820: [mem 0x000000307ff80000-0x000000307fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000003080000000-0x000000407ff7ffff] usable [ 0.000000] BIOS-e820: [mem 0x000000407ff80000-0x000000407fffffff] reserved [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] e820: update [mem 0x446da020-0x4470b25f] usable ==> usable [ 0.000000] e820: update [mem 0x446a8020-0x446d925f] usable ==> usable [ 0.000000] e820: update [mem 0x5b488020-0x5b49005f] usable ==> usable [ 0.000000] e820: update [mem 0x4468f020-0x446a765f] usable ==> usable [ 0.000000] extended physical RAM map: [ 0.000000] reserve setup_data: [mem 0x0000000000000000-0x000000000008efff] usable [ 0.000000] reserve setup_data: [mem 0x000000000008f000-0x000000000008ffff] ACPI NVS [ 0.000000] reserve setup_data: [mem 0x0000000000090000-0x000000000009ffff] usable [ 0.000000] reserve setup_data: [mem 0x0000000000100000-0x000000004468f01f] usable [ 0.000000] reserve setup_data: [mem 0x000000004468f020-0x00000000446a765f] usable [ 0.000000] reserve setup_data: [mem 0x00000000446a7660-0x00000000446a801f] usable [ 0.000000] reserve setup_data: [mem 0x00000000446a8020-0x00000000446d925f] usable [ 0.000000] reserve setup_data: [mem 0x00000000446d9260-0x00000000446da01f] usable [ 0.000000] reserve setup_data: [mem 0x00000000446da020-0x000000004470b25f] usable [ 0.000000] reserve setup_data: [mem 0x000000004470b260-0x000000005b48801f] usable [ 0.000000] reserve setup_data: [mem 0x000000005b488020-0x000000005b49005f] usable [ 0.000000] reserve setup_data: [mem 0x000000005b490060-0x000000005c3dffff] usable [ 0.000000] reserve setup_data: [mem 0x000000005c3e0000-0x00000000643e7fff] reserved [ 0.000000] reserve setup_data: [mem 0x00000000643e8000-0x000000006cacefff] usable [ 0.000000] reserve setup_data: [mem 0x000000006cacf000-0x000000006efcefff] reserved [ 0.000000] reserve setup_data: [mem 0x000000006efcf000-0x000000006fdfefff] ACPI NVS [ 0.000000] reserve setup_data: [mem 0x000000006fdff000-0x000000006fffefff] ACPI data [ 0.000000] reserve setup_data: [mem 0x000000006ffff000-0x000000006fffffff] usable [ 0.000000] reserve setup_data: [mem 0x0000000070000000-0x000000008fffffff] reserved [ 0.000000] reserve setup_data: [mem 0x00000000fec10000-0x00000000fec10fff] reserved [ 0.000000] reserve setup_data: [mem 0x00000000fed80000-0x00000000fed80fff] reserved [ 0.000000] reserve setup_data: [mem 0x0000000100000000-0x000000107f37ffff] usable [ 0.000000] reserve setup_data: [mem 0x000000107f380000-0x000000107fffffff] reserved [ 0.000000] reserve setup_data: [mem 0x0000001080000000-0x000000207ff7ffff] usable [ 0.000000] reserve setup_data: [mem 0x000000207ff80000-0x000000207fffffff] reserved [ 0.000000] reserve setup_data: [mem 0x0000002080000000-0x000000307ff7ffff] usable [ 0.000000] reserve setup_data: [mem 0x000000307ff80000-0x000000307fffffff] reserved [ 0.000000] reserve setup_data: [mem 0x0000003080000000-0x000000407ff7ffff] usable [ 0.000000] reserve setup_data: [mem 0x000000407ff80000-0x000000407fffffff] reserved [ 0.000000] efi: EFI v2.50 by Dell Inc. [ 0.000000] efi: ACPI=0x6fffe000 ACPI 2.0=0x6fffe014 SMBIOS=0x6eab5000 SMBIOS 3.0=0x6eab3000 [ 0.000000] efi: mem00: type=3, attr=0xf, range=[0x0000000000000000-0x0000000000001000) (0MB) [ 0.000000] efi: mem01: type=2, attr=0xf, range=[0x0000000000001000-0x0000000000002000) (0MB) [ 0.000000] efi: mem02: type=7, attr=0xf, range=[0x0000000000002000-0x0000000000010000) (0MB) [ 0.000000] efi: mem03: type=3, attr=0xf, range=[0x0000000000010000-0x0000000000014000) (0MB) [ 0.000000] efi: mem04: type=7, attr=0xf, range=[0x0000000000014000-0x0000000000063000) (0MB) [ 0.000000] efi: mem05: type=3, attr=0xf, range=[0x0000000000063000-0x000000000008f000) (0MB) [ 0.000000] efi: mem06: type=10, attr=0xf, range=[0x000000000008f000-0x0000000000090000) (0MB) [ 0.000000] efi: mem07: type=3, attr=0xf, range=[0x0000000000090000-0x00000000000a0000) (0MB) [ 0.000000] efi: mem08: type=4, attr=0xf, range=[0x0000000000100000-0x0000000000120000) (0MB) [ 0.000000] efi: mem09: type=7, attr=0xf, range=[0x0000000000120000-0x0000000000c00000) (10MB) [ 0.000000] efi: mem10: type=3, attr=0xf, range=[0x0000000000c00000-0x0000000001000000) (4MB) [ 0.000000] efi: mem11: type=2, attr=0xf, range=[0x0000000001000000-0x000000000267a000) (22MB) [ 0.000000] efi: mem12: type=7, attr=0xf, range=[0x000000000267a000-0x0000000004000000) (25MB) [ 0.000000] efi: mem13: type=4, attr=0xf, range=[0x0000000004000000-0x000000000403b000) (0MB) [ 0.000000] efi: mem14: type=7, attr=0xf, range=[0x000000000403b000-0x000000003e89c000) (936MB) [ 0.000000] efi: mem15: type=2, attr=0xf, range=[0x000000003e89c000-0x0000000040000000) (23MB) [ 0.000000] efi: mem16: type=7, attr=0xf, range=[0x0000000040000000-0x000000004468f000) (70MB) [ 0.000000] efi: mem17: type=2, attr=0xf, range=[0x000000004468f000-0x000000005b25c000) (363MB) [ 0.000000] efi: mem18: type=1, attr=0xf, range=[0x000000005b25c000-0x000000005b475000) (2MB) [ 0.000000] efi: mem19: type=7, attr=0xf, range=[0x000000005b475000-0x000000005b488000) (0MB) [ 0.000000] efi: mem20: type=2, attr=0xf, range=[0x000000005b488000-0x000000005b59c000) (1MB) [ 0.000000] efi: mem21: type=4, attr=0xf, range=[0x000000005b59c000-0x000000005b6bf000) (1MB) [ 0.000000] efi: mem22: type=3, attr=0xf, range=[0x000000005b6bf000-0x000000005b70d000) (0MB) [ 0.000000] efi: mem23: type=4, attr=0xf, range=[0x000000005b70d000-0x000000005b75b000) (0MB) [ 0.000000] efi: mem24: type=3, attr=0xf, range=[0x000000005b75b000-0x000000005b7bd000) (0MB) [ 0.000000] efi: mem25: type=4, attr=0xf, range=[0x000000005b7bd000-0x000000005b7c7000) (0MB) [ 0.000000] efi: mem26: type=3, attr=0xf, range=[0x000000005b7c7000-0x000000005b8b2000) (0MB) [ 0.000000] efi: mem27: type=4, attr=0xf, range=[0x000000005b8b2000-0x000000005b8c1000) (0MB) [ 0.000000] efi: mem28: type=7, attr=0xf, range=[0x000000005b8c1000-0x000000005b8c4000) (0MB) [ 0.000000] efi: mem29: type=4, attr=0xf, range=[0x000000005b8c4000-0x000000005b8cc000) (0MB) [ 0.000000] efi: mem30: type=3, attr=0xf, range=[0x000000005b8cc000-0x000000005b927000) (0MB) [ 0.000000] efi: mem31: type=4, attr=0xf, range=[0x000000005b927000-0x000000005b931000) (0MB) [ 0.000000] efi: mem32: type=3, attr=0xf, range=[0x000000005b931000-0x000000005b960000) (0MB) [ 0.000000] efi: mem33: type=4, attr=0xf, range=[0x000000005b960000-0x000000005bc2f000) (2MB) [ 0.000000] efi: mem34: type=3, attr=0xf, range=[0x000000005bc2f000-0x000000005bc3c000) (0MB) [ 0.000000] efi: mem35: type=4, attr=0xf, range=[0x000000005bc3c000-0x000000005be3a000) (1MB) [ 0.000000] efi: mem36: type=7, attr=0xf, range=[0x000000005be3a000-0x000000005be3b000) (0MB) [ 0.000000] efi: mem37: type=4, attr=0xf, range=[0x000000005be3b000-0x000000005be4f000) (0MB) [ 0.000000] efi: mem38: type=7, attr=0xf, range=[0x000000005be4f000-0x000000005be50000) (0MB) [ 0.000000] efi: mem39: type=4, attr=0xf, range=[0x000000005be50000-0x000000005be5a000) (0MB) [ 0.000000] efi: mem40: type=7, attr=0xf, range=[0x000000005be5a000-0x000000005be5b000) (0MB) [ 0.000000] efi: mem41: type=4, attr=0xf, range=[0x000000005be5b000-0x000000005be61000) (0MB) [ 0.000000] efi: mem42: type=2, attr=0xf, range=[0x000000005be61000-0x000000005be63000) (0MB) [ 0.000000] efi: mem43: type=4, attr=0xf, range=[0x000000005be63000-0x000000005be64000) (0MB) [ 0.000000] efi: mem44: type=7, attr=0xf, range=[0x000000005be64000-0x000000005be65000) (0MB) [ 0.000000] efi: mem45: type=4, attr=0xf, range=[0x000000005be65000-0x000000005be77000) (0MB) [ 0.000000] efi: mem46: type=7, attr=0xf, range=[0x000000005be77000-0x000000005be78000) (0MB) [ 0.000000] efi: mem47: type=4, attr=0xf, range=[0x000000005be78000-0x000000005be79000) (0MB) [ 0.000000] efi: mem48: type=7, attr=0xf, range=[0x000000005be79000-0x000000005be7a000) (0MB) [ 0.000000] efi: mem49: type=2, attr=0xf, range=[0x000000005be7a000-0x000000005be7b000) (0MB) [ 0.000000] efi: mem50: type=4, attr=0xf, range=[0x000000005be7b000-0x000000005be7f000) (0MB) [ 0.000000] efi: mem51: type=3, attr=0xf, range=[0x000000005be7f000-0x000000005bea2000) (0MB) [ 0.000000] efi: mem52: type=4, attr=0xf, range=[0x000000005bea2000-0x000000005c003000) (1MB) [ 0.000000] efi: mem53: type=3, attr=0xf, range=[0x000000005c003000-0x000000005c3e0000) (3MB) [ 0.000000] efi: mem54: type=0, attr=0xf, range=[0x000000005c3e0000-0x00000000643e8000) (128MB) [ 0.000000] efi: mem55: type=3, attr=0xf, range=[0x00000000643e8000-0x0000000064fae000) (11MB) [ 0.000000] efi: mem56: type=4, attr=0xf, range=[0x0000000064fae000-0x0000000068acf000) (59MB) [ 0.000000] efi: mem57: type=3, attr=0xf, range=[0x0000000068acf000-0x0000000068ecf000) (4MB) [ 0.000000] efi: mem58: type=7, attr=0xf, range=[0x0000000068ecf000-0x0000000068ed1000) (0MB) [ 0.000000] efi: mem59: type=4, attr=0xf, range=[0x0000000068ed1000-0x0000000069066000) (1MB) [ 0.000000] efi: mem60: type=7, attr=0xf, range=[0x0000000069066000-0x0000000069067000) (0MB) [ 0.000000] efi: mem61: type=4, attr=0xf, range=[0x0000000069067000-0x000000006907a000) (0MB) [ 0.000000] efi: mem62: type=7, attr=0xf, range=[0x000000006907a000-0x000000006907b000) (0MB) [ 0.000000] efi: mem63: type=4, attr=0xf, range=[0x000000006907b000-0x0000000069087000) (0MB) [ 0.000000] efi: mem64: type=7, attr=0xf, range=[0x0000000069087000-0x0000000069088000) (0MB) [ 0.000000] efi: mem65: type=4, attr=0xf, range=[0x0000000069088000-0x0000000069089000) (0MB) [ 0.000000] efi: mem66: type=7, attr=0xf, range=[0x0000000069089000-0x000000006908a000) (0MB) [ 0.000000] efi: mem67: type=4, attr=0xf, range=[0x000000006908a000-0x0000000069097000) (0MB) [ 0.000000] efi: mem68: type=7, attr=0xf, range=[0x0000000069097000-0x0000000069098000) (0MB) [ 0.000000] efi: mem69: type=4, attr=0xf, range=[0x0000000069098000-0x000000006909b000) (0MB) [ 0.000000] efi: mem70: type=7, attr=0xf, range=[0x000000006909b000-0x000000006909c000) (0MB) [ 0.000000] efi: mem71: type=4, attr=0xf, range=[0x000000006909c000-0x00000000690dc000) (0MB) [ 0.000000] efi: mem72: type=7, attr=0xf, range=[0x00000000690dc000-0x00000000690dd000) (0MB) [ 0.000000] efi: mem73: type=4, attr=0xf, range=[0x00000000690dd000-0x000000006911a000) (0MB) [ 0.000000] efi: mem74: type=7, attr=0xf, range=[0x000000006911a000-0x000000006911b000) (0MB) [ 0.000000] efi: mem75: type=4, attr=0xf, range=[0x000000006911b000-0x000000006911f000) (0MB) [ 0.000000] efi: mem76: type=7, attr=0xf, range=[0x000000006911f000-0x0000000069120000) (0MB) [ 0.000000] efi: mem77: type=4, attr=0xf, range=[0x0000000069120000-0x000000006914c000) (0MB) [ 0.000000] efi: mem78: type=7, attr=0xf, range=[0x000000006914c000-0x000000006914d000) (0MB) [ 0.000000] efi: mem79: type=4, attr=0xf, range=[0x000000006914d000-0x0000000069152000) (0MB) [ 0.000000] efi: mem80: type=7, attr=0xf, range=[0x0000000069152000-0x0000000069153000) (0MB) [ 0.000000] efi: mem81: type=4, attr=0xf, range=[0x0000000069153000-0x0000000069164000) (0MB) [ 0.000000] efi: mem82: type=7, attr=0xf, range=[0x0000000069164000-0x0000000069165000) (0MB) [ 0.000000] efi: mem83: type=4, attr=0xf, range=[0x0000000069165000-0x000000006917a000) (0MB) [ 0.000000] efi: mem84: type=7, attr=0xf, range=[0x000000006917a000-0x000000006917b000) (0MB) [ 0.000000] efi: mem85: type=4, attr=0xf, range=[0x000000006917b000-0x000000006918b000) (0MB) [ 0.000000] efi: mem86: type=7, attr=0xf, range=[0x000000006918b000-0x000000006918c000) (0MB) [ 0.000000] efi: mem87: type=4, attr=0xf, range=[0x000000006918c000-0x00000000691ff000) (0MB) [ 0.000000] efi: mem88: type=7, attr=0xf, range=[0x00000000691ff000-0x0000000069200000) (0MB) [ 0.000000] efi: mem89: type=4, attr=0xf, range=[0x0000000069200000-0x0000000069204000) (0MB) [ 0.000000] efi: mem90: type=7, attr=0xf, range=[0x0000000069204000-0x0000000069205000) (0MB) [ 0.000000] efi: mem91: type=4, attr=0xf, range=[0x0000000069205000-0x000000006920e000) (0MB) [ 0.000000] efi: mem92: type=7, attr=0xf, range=[0x000000006920e000-0x000000006920f000) (0MB) [ 0.000000] efi: mem93: type=4, attr=0xf, range=[0x000000006920f000-0x0000000069216000) (0MB) [ 0.000000] efi: mem94: type=7, attr=0xf, range=[0x0000000069216000-0x0000000069217000) (0MB) [ 0.000000] efi: mem95: type=4, attr=0xf, range=[0x0000000069217000-0x0000000069218000) (0MB) [ 0.000000] efi: mem96: type=7, attr=0xf, range=[0x0000000069218000-0x0000000069219000) (0MB) [ 0.000000] efi: mem97: type=4, attr=0xf, range=[0x0000000069219000-0x000000006921c000) (0MB) [ 0.000000] efi: mem98: type=7, attr=0xf, range=[0x000000006921c000-0x000000006921e000) (0MB) [ 0.000000] efi: mem99: type=4, attr=0xf, range=[0x000000006921e000-0x0000000069223000) (0MB) [ 0.000000] efi: mem100: type=7, attr=0xf, range=[0x0000000069223000-0x0000000069224000) (0MB) [ 0.000000] efi: mem101: type=4, attr=0xf, range=[0x0000000069224000-0x0000000069226000) (0MB) [ 0.000000] efi: mem102: type=7, attr=0xf, range=[0x0000000069226000-0x0000000069227000) (0MB) [ 0.000000] efi: mem103: type=4, attr=0xf, range=[0x0000000069227000-0x000000006922f000) (0MB) [ 0.000000] efi: mem104: type=7, attr=0xf, range=[0x000000006922f000-0x0000000069230000) (0MB) [ 0.000000] efi: mem105: type=4, attr=0xf, range=[0x0000000069230000-0x000000006925a000) (0MB) [ 0.000000] efi: mem106: type=7, attr=0xf, range=[0x000000006925a000-0x000000006925b000) (0MB) [ 0.000000] efi: mem107: type=4, attr=0xf, range=[0x000000006925b000-0x000000006a2d3000) (16MB) [ 0.000000] efi: mem108: type=7, attr=0xf, range=[0x000000006a2d3000-0x000000006a2d5000) (0MB) [ 0.000000] efi: mem109: type=4, attr=0xf, range=[0x000000006a2d5000-0x000000006c3cf000) (32MB) [ 0.000000] efi: mem110: type=7, attr=0xf, range=[0x000000006c3cf000-0x000000006c3d1000) (0MB) [ 0.000000] efi: mem111: type=3, attr=0xf, range=[0x000000006c3d1000-0x000000006cacf000) (6MB) [ 0.000000] efi: mem112: type=6, attr=0x800000000000000f, range=[0x000000006cacf000-0x000000006cbcf000) (1MB) [ 0.000000] efi: mem113: type=5, attr=0x800000000000000f, range=[0x000000006cbcf000-0x000000006cdcf000) (2MB) [ 0.000000] efi: mem114: type=0, attr=0xf, range=[0x000000006cdcf000-0x000000006efcf000) (34MB) [ 0.000000] efi: mem115: type=10, attr=0xf, range=[0x000000006efcf000-0x000000006fdff000) (14MB) [ 0.000000] efi: mem116: type=9, attr=0xf, range=[0x000000006fdff000-0x000000006ffff000) (2MB) [ 0.000000] efi: mem117: type=4, attr=0xf, range=[0x000000006ffff000-0x0000000070000000) (0MB) [ 0.000000] efi: mem118: type=7, attr=0xf, range=[0x0000000100000000-0x000000107f380000) (63475MB) [ 0.000000] efi: mem119: type=7, attr=0xf, range=[0x0000001080000000-0x000000207ff80000) (65535MB) [ 0.000000] efi: mem120: type=7, attr=0xf, range=[0x0000002080000000-0x000000307ff80000) (65535MB) [ 0.000000] efi: mem121: type=7, attr=0xf, range=[0x0000003080000000-0x000000407ff80000) (65535MB) [ 0.000000] efi: mem122: type=0, attr=0x9, range=[0x0000000070000000-0x0000000080000000) (256MB) [ 0.000000] efi: mem123: type=11, attr=0x800000000000000f, range=[0x0000000080000000-0x0000000090000000) (256MB) [ 0.000000] efi: mem124: type=11, attr=0x800000000000000f, range=[0x00000000fec10000-0x00000000fec11000) (0MB) [ 0.000000] efi: mem125: type=11, attr=0x800000000000000f, range=[0x00000000fed80000-0x00000000fed81000) (0MB) [ 0.000000] efi: mem126: type=0, attr=0x0, range=[0x000000107f380000-0x0000001080000000) (12MB) [ 0.000000] efi: mem127: type=0, attr=0x0, range=[0x000000207ff80000-0x0000002080000000) (0MB) [ 0.000000] efi: mem128: type=0, attr=0x0, range=[0x000000307ff80000-0x0000003080000000) (0MB) [ 0.000000] efi: mem129: type=0, attr=0x0, range=[0x000000407ff80000-0x0000004080000000) (0MB) [ 0.000000] SMBIOS 3.0.0 present. [ 0.000000] DMI: Dell Inc. PowerEdge R6415/065PKD, BIOS 1.6.7 10/29/2018 [ 0.000000] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved [ 0.000000] e820: remove [mem 0x000a0000-0x000fffff] usable [ 0.000000] e820: last_pfn = 0x407ff80 max_arch_pfn = 0x400000000 [ 0.000000] MTRR default type: uncachable [ 0.000000] MTRR fixed ranges enabled: [ 0.000000] 00000-9FFFF write-back [ 0.000000] A0000-FFFFF uncachable [ 0.000000] MTRR variable ranges enabled: [ 0.000000] 0 base 0000FF000000 mask FFFFFF000000 write-protect [ 0.000000] 1 base 000000000000 mask FFFF80000000 write-back [ 0.000000] 2 base 000070000000 mask FFFFF0000000 uncachable [ 0.000000] 3 disabled [ 0.000000] 4 disabled [ 0.000000] 5 disabled [ 0.000000] 6 disabled [ 0.000000] 7 disabled [ 0.000000] TOM2: 0000004080000000 aka 264192M [ 0.000000] PAT configuration [0-7]: WB WC UC- UC WB WP UC- UC [ 0.000000] e820: last_pfn = 0x70000 max_arch_pfn = 0x400000000 [ 0.000000] Base memory trampoline at [ffff9e5ac0099000] 99000 size 24576 [ 0.000000] Using GB pages for direct mapping [ 0.000000] BRK [0x393d252000, 0x393d252fff] PGTABLE [ 0.000000] BRK [0x393d253000, 0x393d253fff] PGTABLE [ 0.000000] BRK [0x393d254000, 0x393d254fff] PGTABLE [ 0.000000] BRK [0x393d255000, 0x393d255fff] PGTABLE [ 0.000000] BRK [0x393d256000, 0x393d256fff] PGTABLE [ 0.000000] BRK [0x393d257000, 0x393d257fff] PGTABLE [ 0.000000] BRK [0x393d258000, 0x393d258fff] PGTABLE [ 0.000000] BRK [0x393d259000, 0x393d259fff] PGTABLE [ 0.000000] BRK [0x393d25a000, 0x393d25afff] PGTABLE [ 0.000000] BRK [0x393d25b000, 0x393d25bfff] PGTABLE [ 0.000000] BRK [0x393d25c000, 0x393d25cfff] PGTABLE [ 0.000000] BRK [0x393d25d000, 0x393d25dfff] PGTABLE [ 0.000000] RAMDISK: [mem 0x3e89c000-0x3fffdfff] [ 0.000000] Early table checksum verification disabled [ 0.000000] ACPI: RSDP 000000006fffe014 00024 (v02 DELL ) [ 0.000000] ACPI: XSDT 000000006fffd0e8 000B4 (v01 DELL PE_SC3 00000002 DELL 00000001) [ 0.000000] ACPI: FACP 000000006ffef000 00114 (v06 DELL PE_SC3 00000002 DELL 00000001) [ 0.000000] ACPI: DSDT 000000006ffe2000 0950B (v02 DELL PE_SC3 00000002 DELL 00000001) [ 0.000000] ACPI: FACS 000000006fdd4000 00040 [ 0.000000] ACPI: SSDT 000000006fffc000 000D2 (v02 DELL PE_SC3 00000002 MSFT 04000000) [ 0.000000] ACPI: BERT 000000006fffb000 00030 (v01 DELL BERT 00000001 DELL 00000001) [ 0.000000] ACPI: HEST 000000006fffa000 006DC (v01 DELL HEST 00000001 DELL 00000001) [ 0.000000] ACPI: SSDT 000000006fff9000 00294 (v01 DELL PE_SC3 00000001 AMD 00000001) [ 0.000000] ACPI: SRAT 000000006fff8000 00420 (v03 DELL PE_SC3 00000001 AMD 00000001) [ 0.000000] ACPI: MSCT 000000006fff7000 0004E (v01 DELL PE_SC3 00000000 AMD 00000001) [ 0.000000] ACPI: SLIT 000000006fff6000 0003C (v01 DELL PE_SC3 00000001 AMD 00000001) [ 0.000000] ACPI: CRAT 000000006fff3000 02DC0 (v01 DELL PE_SC3 00000001 AMD 00000001) [ 0.000000] ACPI: CDIT 000000006fff2000 00038 (v01 DELL PE_SC3 00000001 AMD 00000001) [ 0.000000] ACPI: EINJ 000000006fff1000 00150 (v01 DELL PE_SC3 00000001 AMD 00000001) [ 0.000000] ACPI: SLIC 000000006fff0000 00024 (v01 DELL PE_SC3 00000002 DELL 00000001) [ 0.000000] ACPI: HPET 000000006ffee000 00038 (v01 DELL PE_SC3 00000002 DELL 00000001) [ 0.000000] ACPI: APIC 000000006ffed000 004B2 (v03 DELL PE_SC3 00000002 DELL 00000001) [ 0.000000] ACPI: MCFG 000000006ffec000 0003C (v01 DELL PE_SC3 00000002 DELL 00000001) [ 0.000000] ACPI: SSDT 000000006ffe1000 00629 (v02 DELL xhc_port 00000001 INTL 20170119) [ 0.000000] ACPI: IVRS 000000006ffe0000 00210 (v02 DELL PE_SC3 00000001 AMD 00000000) [ 0.000000] ACPI: SSDT 000000006ffde000 01658 (v01 AMD CPMCMN 00000001 INTL 20170119) [ 0.000000] ACPI: Local APIC address 0xfee00000 [ 0.000000] SRAT: PXM 0 -> APIC 0x00 -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x01 -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x02 -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x03 -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x04 -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x05 -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x08 -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x09 -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x0a -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x0b -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x0c -> Node 0 [ 0.000000] SRAT: PXM 0 -> APIC 0x0d -> Node 0 [ 0.000000] SRAT: PXM 1 -> APIC 0x10 -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x11 -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x12 -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x13 -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x14 -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x15 -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x18 -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x19 -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x1a -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x1b -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x1c -> Node 1 [ 0.000000] SRAT: PXM 1 -> APIC 0x1d -> Node 1 [ 0.000000] SRAT: PXM 2 -> APIC 0x20 -> Node 2 [ 0.000000] SRAT: PXM 2 -> APIC 0x21 -> Node 2 [ 0.000000] SRAT: PXM 2 -> APIC 0x22 -> Node 2 [ 0.000000] SRAT: PXM 2 -> APIC 0x23 -> Node 2 [ 0.000000] SRAT: PXM 2 -> APIC 0x24 -> Node 2 [ 0.000000] SRAT: PXM 2 -> APIC 0x25 -> Node 2 [ 0.000000] SRAT: PXM 2 -> APIC 0x28 -> Node 2 [ 0.000000] SRAT: PXM 2 -> APIC 0x29 -> Node 2 [ 0.000000] SRAT: PXM 2 -> APIC 0x2a -> Node 2 [ 0.000000] SRAT: PXM 2 -> APIC 0x2b -> Node 2 [ 0.000000] SRAT: PXM 2 -> APIC 0x2c -> Node 2 [ 0.000000] SRAT: PXM 2 -> APIC 0x2d -> Node 2 [ 0.000000] SRAT: PXM 3 -> APIC 0x30 -> Node 3 [ 0.000000] SRAT: PXM 3 -> APIC 0x31 -> Node 3 [ 0.000000] SRAT: PXM 3 -> APIC 0x32 -> Node 3 [ 0.000000] SRAT: PXM 3 -> APIC 0x33 -> Node 3 [ 0.000000] SRAT: PXM 3 -> APIC 0x34 -> Node 3 [ 0.000000] SRAT: PXM 3 -> APIC 0x35 -> Node 3 [ 0.000000] SRAT: PXM 3 -> APIC 0x38 -> Node 3 [ 0.000000] SRAT: PXM 3 -> APIC 0x39 -> Node 3 [ 0.000000] SRAT: PXM 3 -> APIC 0x3a -> Node 3 [ 0.000000] SRAT: PXM 3 -> APIC 0x3b -> Node 3 [ 0.000000] SRAT: PXM 3 -> APIC 0x3c -> Node 3 [ 0.000000] SRAT: PXM 3 -> APIC 0x3d -> Node 3 [ 0.000000] SRAT: Node 0 PXM 0 [mem 0x00000000-0x0009ffff] [ 0.000000] SRAT: Node 0 PXM 0 [mem 0x00100000-0x7fffffff] [ 0.000000] SRAT: Node 0 PXM 0 [mem 0x100000000-0x107fffffff] [ 0.000000] SRAT: Node 1 PXM 1 [mem 0x1080000000-0x207fffffff] [ 0.000000] SRAT: Node 2 PXM 2 [mem 0x2080000000-0x307fffffff] [ 0.000000] SRAT: Node 3 PXM 3 [mem 0x3080000000-0x407fffffff] [ 0.000000] NUMA: Initialized distance table, cnt=4 [ 0.000000] NUMA: Node 0 [mem 0x00000000-0x0009ffff] + [mem 0x00100000-0x7fffffff] -> [mem 0x00000000-0x7fffffff] [ 0.000000] NUMA: Node 0 [mem 0x00000000-0x7fffffff] + [mem 0x100000000-0x107fffffff] -> [mem 0x00000000-0x107fffffff] [ 0.000000] NODE_DATA(0) allocated [mem 0x107f359000-0x107f37ffff] [ 0.000000] NODE_DATA(1) allocated [mem 0x207ff59000-0x207ff7ffff] [ 0.000000] NODE_DATA(2) allocated [mem 0x307ff59000-0x307ff7ffff] [ 0.000000] NODE_DATA(3) allocated [mem 0x407ff58000-0x407ff7efff] [ 0.000000] Reserving 176MB of memory at 720MB for crashkernel (System RAM: 261692MB) [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x00001000-0x00ffffff] [ 0.000000] DMA32 [mem 0x01000000-0xffffffff] [ 0.000000] Normal [mem 0x100000000-0x407ff7ffff] [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x00001000-0x0008efff] [ 0.000000] node 0: [mem 0x00090000-0x0009ffff] [ 0.000000] node 0: [mem 0x00100000-0x5c3dffff] [ 0.000000] node 0: [mem 0x643e8000-0x6cacefff] [ 0.000000] node 0: [mem 0x6ffff000-0x6fffffff] [ 0.000000] node 0: [mem 0x100000000-0x107f37ffff] [ 0.000000] node 1: [mem 0x1080000000-0x207ff7ffff] [ 0.000000] node 2: [mem 0x2080000000-0x307ff7ffff] [ 0.000000] node 3: [mem 0x3080000000-0x407ff7ffff] [ 0.000000] Initmem setup node 0 [mem 0x00001000-0x107f37ffff] [ 0.000000] On node 0 totalpages: 16661990 [ 0.000000] DMA zone: 64 pages used for memmap [ 0.000000] DMA zone: 1126 pages reserved [ 0.000000] DMA zone: 3998 pages, LIFO batch:0 [ 0.000000] DMA32 zone: 6380 pages used for memmap [ 0.000000] DMA32 zone: 408264 pages, LIFO batch:31 [ 0.000000] Normal zone: 253902 pages used for memmap [ 0.000000] Normal zone: 16249728 pages, LIFO batch:31 [ 0.000000] Initmem setup node 1 [mem 0x1080000000-0x207ff7ffff] [ 0.000000] On node 1 totalpages: 16777088 [ 0.000000] Normal zone: 262142 pages used for memmap [ 0.000000] Normal zone: 16777088 pages, LIFO batch:31 [ 0.000000] Initmem setup node 2 [mem 0x2080000000-0x307ff7ffff] [ 0.000000] On node 2 totalpages: 16777088 [ 0.000000] Normal zone: 262142 pages used for memmap [ 0.000000] Normal zone: 16777088 pages, LIFO batch:31 [ 0.000000] Initmem setup node 3 [mem 0x3080000000-0x407ff7ffff] [ 0.000000] On node 3 totalpages: 16777088 [ 0.000000] Normal zone: 262142 pages used for memmap [ 0.000000] Normal zone: 16777088 pages, LIFO batch:31 [ 0.000000] ACPI: PM-Timer IO Port: 0x408 [ 0.000000] ACPI: Local APIC address 0xfee00000 [ 0.000000] ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x01] lapic_id[0x10] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x02] lapic_id[0x20] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x03] lapic_id[0x30] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x04] lapic_id[0x08] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x05] lapic_id[0x18] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x06] lapic_id[0x28] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x07] lapic_id[0x38] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x08] lapic_id[0x02] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x09] lapic_id[0x12] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x22] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x32] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x0c] lapic_id[0x0a] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x0d] lapic_id[0x1a] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x0e] lapic_id[0x2a] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x0f] lapic_id[0x3a] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x10] lapic_id[0x04] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x11] lapic_id[0x14] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x12] lapic_id[0x24] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x13] lapic_id[0x34] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x14] lapic_id[0x0c] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x15] lapic_id[0x1c] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x16] lapic_id[0x2c] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x17] lapic_id[0x3c] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x18] lapic_id[0x01] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x19] lapic_id[0x11] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x1a] lapic_id[0x21] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x1b] lapic_id[0x31] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x1c] lapic_id[0x09] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x1d] lapic_id[0x19] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x1e] lapic_id[0x29] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x1f] lapic_id[0x39] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x20] lapic_id[0x03] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x21] lapic_id[0x13] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x22] lapic_id[0x23] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x23] lapic_id[0x33] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x24] lapic_id[0x0b] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x25] lapic_id[0x1b] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x26] lapic_id[0x2b] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x27] lapic_id[0x3b] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x28] lapic_id[0x05] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x29] lapic_id[0x15] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x2a] lapic_id[0x25] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x2b] lapic_id[0x35] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x2c] lapic_id[0x0d] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x2d] lapic_id[0x1d] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x2e] lapic_id[0x2d] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x2f] lapic_id[0x3d] enabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x30] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x31] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x32] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x33] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x34] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x35] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x36] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x37] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x38] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x39] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x3a] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x3b] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x3c] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x3d] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x3e] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x3f] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x40] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x41] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x42] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x43] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x44] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x45] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x46] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x47] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x48] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x49] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x4a] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x4b] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x4c] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x4d] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x4e] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x4f] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x50] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x51] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x52] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x53] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x54] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x55] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x56] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x57] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x58] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x59] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x5a] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x5b] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x5c] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x5d] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x5e] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x5f] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x60] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x61] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x62] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x63] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x64] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x65] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x66] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x67] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x68] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x69] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x6a] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x6b] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x6c] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x6d] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x6e] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x6f] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x70] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x71] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x72] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x73] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x74] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x75] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x76] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x77] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x78] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x79] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x7a] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x7b] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x7c] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x7d] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x7e] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC (acpi_id[0x7f] lapic_id[0x00] disabled) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] high edge lint[0x1]) [ 0.000000] ACPI: IOAPIC (id[0x80] address[0xfec00000] gsi_base[0]) [ 0.000000] IOAPIC[0]: apic_id 128, version 33, address 0xfec00000, GSI 0-23 [ 0.000000] ACPI: IOAPIC (id[0x81] address[0xfd880000] gsi_base[24]) [ 0.000000] IOAPIC[1]: apic_id 129, version 33, address 0xfd880000, GSI 24-55 [ 0.000000] ACPI: IOAPIC (id[0x82] address[0xe0900000] gsi_base[56]) [ 0.000000] IOAPIC[2]: apic_id 130, version 33, address 0xe0900000, GSI 56-87 [ 0.000000] ACPI: IOAPIC (id[0x83] address[0xc5900000] gsi_base[88]) [ 0.000000] IOAPIC[3]: apic_id 131, version 33, address 0xc5900000, GSI 88-119 [ 0.000000] ACPI: IOAPIC (id[0x84] address[0xaa900000] gsi_base[120]) [ 0.000000] IOAPIC[4]: apic_id 132, version 33, address 0xaa900000, GSI 120-151 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 low level) [ 0.000000] ACPI: IRQ0 used by override. [ 0.000000] ACPI: IRQ9 used by override. [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] ACPI: HPET id: 0x10228201 base: 0xfed00000 [ 0.000000] smpboot: Allowing 128 CPUs, 80 hotplug CPUs [ 0.000000] PM: Registered nosave memory: [mem 0x0008f000-0x0008ffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000fffff] [ 0.000000] PM: Registered nosave memory: [mem 0x4468f000-0x4468ffff] [ 0.000000] PM: Registered nosave memory: [mem 0x446a7000-0x446a7fff] [ 0.000000] PM: Registered nosave memory: [mem 0x446a8000-0x446a8fff] [ 0.000000] PM: Registered nosave memory: [mem 0x446d9000-0x446d9fff] [ 0.000000] PM: Registered nosave memory: [mem 0x446da000-0x446dafff] [ 0.000000] PM: Registered nosave memory: [mem 0x4470b000-0x4470bfff] [ 0.000000] PM: Registered nosave memory: [mem 0x5b488000-0x5b488fff] [ 0.000000] PM: Registered nosave memory: [mem 0x5b490000-0x5b490fff] [ 0.000000] PM: Registered nosave memory: [mem 0x5c3e0000-0x643e7fff] [ 0.000000] PM: Registered nosave memory: [mem 0x6cacf000-0x6efcefff] [ 0.000000] PM: Registered nosave memory: [mem 0x6efcf000-0x6fdfefff] [ 0.000000] PM: Registered nosave memory: [mem 0x6fdff000-0x6fffefff] [ 0.000000] PM: Registered nosave memory: [mem 0x70000000-0x8fffffff] [ 0.000000] PM: Registered nosave memory: [mem 0x90000000-0xfec0ffff] [ 0.000000] PM: Registered nosave memory: [mem 0xfec10000-0xfec10fff] [ 0.000000] PM: Registered nosave memory: [mem 0xfec11000-0xfed7ffff] [ 0.000000] PM: Registered nosave memory: [mem 0xfed80000-0xfed80fff] [ 0.000000] PM: Registered nosave memory: [mem 0xfed81000-0xffffffff] [ 0.000000] PM: Registered nosave memory: [mem 0x107f380000-0x107fffffff] [ 0.000000] PM: Registered nosave memory: [mem 0x207ff80000-0x207fffffff] [ 0.000000] PM: Registered nosave memory: [mem 0x307ff80000-0x307fffffff] [ 0.000000] e820: [mem 0x90000000-0xfec0ffff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on bare hardware [ 0.000000] setup_percpu: NR_CPUS:5120 nr_cpumask_bits:128 nr_cpu_ids:128 nr_node_ids:4 [ 0.000000] PERCPU: Embedded 38 pages/cpu @ffff9e6afee00000 s118784 r8192 d28672 u262144 [ 0.000000] pcpu-alloc: s118784 r8192 d28672 u262144 alloc=1*2097152 [ 0.000000] pcpu-alloc: [0] 000 004 008 012 016 020 024 028 [ 0.000000] pcpu-alloc: [0] 032 036 040 044 048 052 056 060 [ 0.000000] pcpu-alloc: [0] 064 068 072 076 080 084 088 092 [ 0.000000] pcpu-alloc: [0] 096 100 104 108 112 116 120 124 [ 0.000000] pcpu-alloc: [1] 001 005 009 013 017 021 025 029 [ 0.000000] pcpu-alloc: [1] 033 037 041 045 049 053 057 061 [ 0.000000] pcpu-alloc: [1] 065 069 073 077 081 085 089 093 [ 0.000000] pcpu-alloc: [1] 097 101 105 109 113 117 121 125 [ 0.000000] pcpu-alloc: [2] 002 006 010 014 018 022 026 030 [ 0.000000] pcpu-alloc: [2] 034 038 042 046 050 054 058 062 [ 0.000000] pcpu-alloc: [2] 066 070 074 078 082 086 090 094 [ 0.000000] pcpu-alloc: [2] 098 102 106 110 114 118 122 126 [ 0.000000] pcpu-alloc: [3] 003 007 011 015 019 023 027 031 [ 0.000000] pcpu-alloc: [3] 035 039 043 047 051 055 059 063 [ 0.000000] pcpu-alloc: [3] 067 071 075 079 083 087 091 095 [ 0.000000] pcpu-alloc: [3] 099 103 107 111 115 119 123 127 [ 0.000000] Built 4 zonelists in Zone order, mobility grouping on. Total pages: 65945356 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-3.10.0-957.1.3.el7_lustre.x86_64 root=UUID=72101a50-b839-4605-96ff-e9b0ad37370c ro crashkernel=auto nomodeset console=ttyS0,115200 LANG=en_US.UTF-8 [ 0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes) [ 0.000000] x86/fpu: xstate_offset[2]: 0240, xstate_sizes[2]: 0100 [ 0.000000] xsave: enabled xstate_bv 0x7, cntxt size 0x340 using standard form [ 0.000000] Memory: 9610056k/270532096k available (7664k kernel code, 2559080k absent, 4657904k reserved, 6055k data, 1876k init) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=128, Nodes=4 [ 0.000000] Hierarchical RCU implementation. [ 0.000000] RCU restricting CPUs from NR_CPUS=5120 to nr_cpu_ids=128. [ 0.000000] NR_IRQS:327936 nr_irqs:3624 0 [ 0.000000] Console: colour dummy device 80x25 [ 0.000000] console [ttyS0] enabled [ 0.000000] allocated 1072693248 bytes of page_cgroup [ 0.000000] please try 'cgroup_disable=memory' option if you don't want memory cgroups [ 0.000000] Enabling automatic NUMA balancing. Configure with numa_balancing= or the kernel.numa_balancing sysctl [ 0.000000] hpet clockevent registered [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 1996.237 MHz processor [ 0.000057] Calibrating delay loop (skipped), value calculated using timer frequency.. 3992.47 BogoMIPS (lpj=1996237) [ 0.010704] pid_max: default: 131072 minimum: 1024 [ 0.016236] Security Framework initialized [ 0.020356] SELinux: Initializing. [ 0.023919] SELinux: Starting in permissive mode [ 0.023920] Yama: becoming mindful. [ 0.043772] Dentry cache hash table entries: 33554432 (order: 16, 268435456 bytes) [ 0.099197] Inode-cache hash table entries: 16777216 (order: 15, 134217728 bytes) [ 0.126815] Mount-cache hash table entries: 524288 (order: 10, 4194304 bytes) [ 0.134213] Mountpoint-cache hash table entries: 524288 (order: 10, 4194304 bytes) [ 0.143370] Initializing cgroup subsys memory [ 0.147769] Initializing cgroup subsys devices [ 0.152223] Initializing cgroup subsys freezer [ 0.156679] Initializing cgroup subsys net_cls [ 0.161133] Initializing cgroup subsys blkio [ 0.165414] Initializing cgroup subsys perf_event [ 0.170138] Initializing cgroup subsys hugetlb [ 0.174591] Initializing cgroup subsys pids [ 0.178785] Initializing cgroup subsys net_prio [ 0.183397] tseg: 0070000000 [ 0.188978] mce: CPU supports 23 MCE banks [ 0.193118] LVT offset 2 assigned for vector 0xf4 [ 0.197849] Last level iTLB entries: 4KB 1024, 2MB 1024, 4MB 512 [ 0.203866] Last level dTLB entries: 4KB 1536, 2MB 1536, 4MB 768 [ 0.209881] tlb_flushall_shift: 6 [ 0.213229] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl and seccomp [ 0.222796] FEATURE SPEC_CTRL Not Present [ 0.226815] FEATURE IBPB_SUPPORT Present [ 0.230840] Spectre V2 : Mitigation: Full retpoline [ 0.236988] Freeing SMP alternatives: 28k freed [ 0.243427] ACPI: Core revision 20130517 [ 0.251559] ACPI: All ACPI Tables successfully acquired [ 0.262162] ftrace: allocating 29188 entries in 115 pages [ 0.602727] Switched APIC routing to physical flat. [ 0.609639] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.625650] smpboot: CPU0: AMD EPYC 7401P 24-Core Processor (fam: 17, model: 01, stepping: 02) [ 0.710602] random: fast init done [ 0.737602] APIC calibration not consistent with PM-Timer: 101ms instead of 100ms [ 0.745084] APIC delta adjusted to PM-Timer: 623828 (636296) [ 0.750776] Performance Events: Fam17h core perfctr, AMD PMU driver. [ 0.757213] ... version: 0 [ 0.761223] ... bit width: 48 [ 0.765323] ... generic registers: 6 [ 0.769335] ... value mask: 0000ffffffffffff [ 0.774647] ... max period: 00007fffffffffff [ 0.779961] ... fixed-purpose events: 0 [ 0.783972] ... event mask: 000000000000003f [ 0.792321] NMI watchdog: enabled on all CPUs, permanently consumes one hw-PMU counter. [ 0.800404] smpboot: Booting Node 1, Processors #1 OK [ 0.813611] smpboot: Booting Node 2, Processors #2 OK [ 0.826823] smpboot: Booting Node 3, Processors #3 OK [ 0.840032] smpboot: Booting Node 0, Processors #4 OK [ 0.853214] smpboot: Booting Node 1, Processors #5 OK [ 0.866394] smpboot: Booting Node 2, Processors #6 OK [ 0.879575] smpboot: Booting Node 3, Processors #7 OK [ 0.892748] smpboot: Booting Node 0, Processors #8 OK [ 0.906142] smpboot: Booting Node 1, Processors #9 OK [ 0.919338] smpboot: Booting Node 2, Processors #10 OK [ 0.932624] smpboot: Booting Node 3, Processors #11 OK [ 0.945895] smpboot: Booting Node 0, Processors #12 OK [ 0.959165] smpboot: Booting Node 1, Processors #13 OK [ 0.972430] smpboot: Booting Node 2, Processors #14 OK [ 0.985699] smpboot: Booting Node 3, Processors #15 OK [ 0.998970] smpboot: Booting Node 0, Processors #16 OK [ 1.012350] smpboot: Booting Node 1, Processors #17 OK [ 1.025628] smpboot: Booting Node 2, Processors #18 OK [ 1.038906] smpboot: Booting Node 3, Processors #19 OK [ 1.052176] smpboot: Booting Node 0, Processors #20 OK [ 1.065441] smpboot: Booting Node 1, Processors #21 OK [ 1.078711] smpboot: Booting Node 2, Processors #22 OK [ 1.091992] smpboot: Booting Node 3, Processors #23 OK [ 1.105265] smpboot: Booting Node 0, Processors #24 OK [ 1.118586] smpboot: Booting Node 1, Processors #25 OK [ 1.131831] smpboot: Booting Node 2, Processors #26 OK [ 1.145066] smpboot: Booting Node 3, Processors #27 OK [ 1.158297] smpboot: Booting Node 0, Processors #28 OK [ 1.171523] smpboot: Booting Node 1, Processors #29 OK [ 1.184756] smpboot: Booting Node 2, Processors #30 OK [ 1.197993] smpboot: Booting Node 3, Processors #31 OK [ 1.211226] smpboot: Booting Node 0, Processors #32 OK [ 1.224562] smpboot: Booting Node 1, Processors #33 OK [ 1.237801] smpboot: Booting Node 2, Processors #34 OK [ 1.251042] smpboot: Booting Node 3, Processors #35 OK [ 1.264283] smpboot: Booting Node 0, Processors #36 OK [ 1.277518] smpboot: Booting Node 1, Processors #37 OK [ 1.290752] smpboot: Booting Node 2, Processors #38 OK [ 1.303995] smpboot: Booting Node 3, Processors #39 OK [ 1.317221] smpboot: Booting Node 0, Processors #40 OK [ 1.330556] smpboot: Booting Node 1, Processors #41 OK [ 1.343802] smpboot: Booting Node 2, Processors #42 OK [ 1.357045] smpboot: Booting Node 3, Processors #43 OK [ 1.370285] smpboot: Booting Node 0, Processors #44 OK [ 1.383510] smpboot: Booting Node 1, Processors #45 OK [ 1.396745] smpboot: Booting Node 2, Processors #46 OK [ 1.409983] smpboot: Booting Node 3, Processors #47 [ 1.422692] Brought up 48 CPUs [ 1.425954] smpboot: Max logical packages: 3 [ 1.430231] smpboot: Total of 48 processors activated (191638.75 BogoMIPS) [ 1.728965] node 0 initialised, 15462980 pages in 285ms [ 1.737380] node 3 initialised, 15984548 pages in 289ms [ 1.737785] node 1 initialised, 15989367 pages in 289ms [ 1.737817] node 2 initialised, 15989367 pages in 289ms [ 1.753616] devtmpfs: initialized [ 1.778933] EVM: security.selinux [ 1.782253] EVM: security.ima [ 1.785226] EVM: security.capability [ 1.788899] PM: Registering ACPI NVS region [mem 0x0008f000-0x0008ffff] (4096 bytes) [ 1.796641] PM: Registering ACPI NVS region [mem 0x6efcf000-0x6fdfefff] (14876672 bytes) [ 1.806280] atomic64 test passed for x86-64 platform with CX8 and with SSE [ 1.813159] pinctrl core: initialized pinctrl subsystem [ 1.818487] RTC time: 0:40:19, date: 05/25/19 [ 1.823085] NET: Registered protocol family 16 [ 1.827888] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 1.835459] ACPI: bus type PCI registered [ 1.839470] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 1.846063] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000) [ 1.855368] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in E820 [ 1.862157] PCI: Using configuration type 1 for base access [ 1.867742] PCI: Dell System detected, enabling pci=bfsort. [ 1.882237] ACPI: Added _OSI(Module Device) [ 1.886427] ACPI: Added _OSI(Processor Device) [ 1.890872] ACPI: Added _OSI(3.0 _SCP Extensions) [ 1.895578] ACPI: Added _OSI(Processor Aggregator Device) [ 1.900978] ACPI: Added _OSI(Linux-Dell-Video) [ 1.906153] ACPI: EC: Look up EC in DSDT [ 1.907049] ACPI: Executed 2 blocks of module-level executable AML code [ 1.919057] ACPI: Interpreter enabled [ 1.922731] ACPI: (supports S0 S5) [ 1.926137] ACPI: Using IOAPIC for interrupt routing [ 1.931298] HEST: Table parsing has been initialized. [ 1.936358] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 1.945504] ACPI: Enabled 1 GPEs in block 00 to 1F [ 1.957194] ACPI: PCI Interrupt Link [LNKA] (IRQs 4 5 7 10 11 14 15) *0 [ 1.964108] ACPI: PCI Interrupt Link [LNKB] (IRQs 4 5 7 10 11 14 15) *0 [ 1.971015] ACPI: PCI Interrupt Link [LNKC] (IRQs 4 5 7 10 11 14 15) *0 [ 1.977921] ACPI: PCI Interrupt Link [LNKD] (IRQs 4 5 7 10 11 14 15) *0 [ 1.984829] ACPI: PCI Interrupt Link [LNKE] (IRQs 4 5 7 10 11 14 15) *0 [ 1.991735] ACPI: PCI Interrupt Link [LNKF] (IRQs 4 5 7 10 11 14 15) *0 [ 1.998640] ACPI: PCI Interrupt Link [LNKG] (IRQs 4 5 7 10 11 14 15) *0 [ 2.005548] ACPI: PCI Interrupt Link [LNKH] (IRQs 4 5 7 10 11 14 15) *0 [ 2.012602] ACPI: PCI Root Bridge [PC00] (domain 0000 [bus 00-3f]) [ 2.018789] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI] [ 2.027009] acpi PNP0A08:00: PCIe AER handled by firmware [ 2.032449] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug] [ 2.039395] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 2.047047] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 2.055487] PCI host bridge to bus 0000:00 [ 2.059588] pci_bus 0000:00: root bus resource [io 0x0000-0x03af window] [ 2.066372] pci_bus 0000:00: root bus resource [io 0x03e0-0x0cf7 window] [ 2.073161] pci_bus 0000:00: root bus resource [mem 0x000c0000-0x000c3fff window] [ 2.080639] pci_bus 0000:00: root bus resource [mem 0x000c4000-0x000c7fff window] [ 2.088118] pci_bus 0000:00: root bus resource [mem 0x000c8000-0x000cbfff window] [ 2.095598] pci_bus 0000:00: root bus resource [mem 0x000cc000-0x000cffff window] [ 2.103076] pci_bus 0000:00: root bus resource [mem 0x000d0000-0x000d3fff window] [ 2.110556] pci_bus 0000:00: root bus resource [mem 0x000d4000-0x000d7fff window] [ 2.118037] pci_bus 0000:00: root bus resource [mem 0x000d8000-0x000dbfff window] [ 2.125517] pci_bus 0000:00: root bus resource [mem 0x000dc000-0x000dffff window] [ 2.132997] pci_bus 0000:00: root bus resource [mem 0x000e0000-0x000e3fff window] [ 2.140473] pci_bus 0000:00: root bus resource [mem 0x000e4000-0x000e7fff window] [ 2.147955] pci_bus 0000:00: root bus resource [mem 0x000e8000-0x000ebfff window] [ 2.155433] pci_bus 0000:00: root bus resource [mem 0x000ec000-0x000effff window] [ 2.162912] pci_bus 0000:00: root bus resource [mem 0x000f0000-0x000fffff window] [ 2.170392] pci_bus 0000:00: root bus resource [io 0x0d00-0x3fff window] [ 2.177178] pci_bus 0000:00: root bus resource [mem 0xe1000000-0xfebfffff window] [ 2.184657] pci_bus 0000:00: root bus resource [mem 0x10000000000-0x2bf3fffffff window] [ 2.192657] pci_bus 0000:00: root bus resource [bus 00-3f] [ 2.198150] pci 0000:00:00.0: [1022:1450] type 00 class 0x060000 [ 2.198259] pci 0000:00:00.2: [1022:1451] type 00 class 0x080600 [ 2.198370] pci 0000:00:01.0: [1022:1452] type 00 class 0x060000 [ 2.198471] pci 0000:00:02.0: [1022:1452] type 00 class 0x060000 [ 2.198567] pci 0000:00:03.0: [1022:1452] type 00 class 0x060000 [ 2.198652] pci 0000:00:03.1: [1022:1453] type 01 class 0x060400 [ 2.198795] pci 0000:00:03.1: PME# supported from D0 D3hot D3cold [ 2.198895] pci 0000:00:04.0: [1022:1452] type 00 class 0x060000 [ 2.198998] pci 0000:00:07.0: [1022:1452] type 00 class 0x060000 [ 2.199083] pci 0000:00:07.1: [1022:1454] type 01 class 0x060400 [ 2.199721] pci 0000:00:07.1: PME# supported from D0 D3hot D3cold [ 2.199797] pci 0000:00:08.0: [1022:1452] type 00 class 0x060000 [ 2.199884] pci 0000:00:08.1: [1022:1454] type 01 class 0x060400 [ 2.200720] pci 0000:00:08.1: PME# supported from D0 D3hot D3cold [ 2.200833] pci 0000:00:14.0: [1022:790b] type 00 class 0x0c0500 [ 2.201066] pci 0000:00:14.3: [1022:790e] type 00 class 0x060100 [ 2.201299] pci 0000:00:18.0: [1022:1460] type 00 class 0x060000 [ 2.201373] pci 0000:00:18.1: [1022:1461] type 00 class 0x060000 [ 2.201444] pci 0000:00:18.2: [1022:1462] type 00 class 0x060000 [ 2.201515] pci 0000:00:18.3: [1022:1463] type 00 class 0x060000 [ 2.201588] pci 0000:00:18.4: [1022:1464] type 00 class 0x060000 [ 2.201660] pci 0000:00:18.5: [1022:1465] type 00 class 0x060000 [ 2.201731] pci 0000:00:18.6: [1022:1466] type 00 class 0x060000 [ 2.201802] pci 0000:00:18.7: [1022:1467] type 00 class 0x060000 [ 2.201876] pci 0000:00:19.0: [1022:1460] type 00 class 0x060000 [ 2.201951] pci 0000:00:19.1: [1022:1461] type 00 class 0x060000 [ 2.202025] pci 0000:00:19.2: [1022:1462] type 00 class 0x060000 [ 2.202102] pci 0000:00:19.3: [1022:1463] type 00 class 0x060000 [ 2.202177] pci 0000:00:19.4: [1022:1464] type 00 class 0x060000 [ 2.202254] pci 0000:00:19.5: [1022:1465] type 00 class 0x060000 [ 2.202332] pci 0000:00:19.6: [1022:1466] type 00 class 0x060000 [ 2.202408] pci 0000:00:19.7: [1022:1467] type 00 class 0x060000 [ 2.202482] pci 0000:00:1a.0: [1022:1460] type 00 class 0x060000 [ 2.202558] pci 0000:00:1a.1: [1022:1461] type 00 class 0x060000 [ 2.202632] pci 0000:00:1a.2: [1022:1462] type 00 class 0x060000 [ 2.202708] pci 0000:00:1a.3: [1022:1463] type 00 class 0x060000 [ 2.202782] pci 0000:00:1a.4: [1022:1464] type 00 class 0x060000 [ 2.202862] pci 0000:00:1a.5: [1022:1465] type 00 class 0x060000 [ 2.202937] pci 0000:00:1a.6: [1022:1466] type 00 class 0x060000 [ 2.203013] pci 0000:00:1a.7: [1022:1467] type 00 class 0x060000 [ 2.203089] pci 0000:00:1b.0: [1022:1460] type 00 class 0x060000 [ 2.203166] pci 0000:00:1b.1: [1022:1461] type 00 class 0x060000 [ 2.203240] pci 0000:00:1b.2: [1022:1462] type 00 class 0x060000 [ 2.203316] pci 0000:00:1b.3: [1022:1463] type 00 class 0x060000 [ 2.203391] pci 0000:00:1b.4: [1022:1464] type 00 class 0x060000 [ 2.203468] pci 0000:00:1b.5: [1022:1465] type 00 class 0x060000 [ 2.203543] pci 0000:00:1b.6: [1022:1466] type 00 class 0x060000 [ 2.203619] pci 0000:00:1b.7: [1022:1467] type 00 class 0x060000 [ 2.203774] pci 0000:01:00.0: [1000:00d1] type 00 class 0x010700 [ 2.203797] pci 0000:01:00.0: reg 0x10: [mem 0xe1000000-0xe10fffff 64bit pref] [ 2.203807] pci 0000:01:00.0: reg 0x18: [mem 0xe1100000-0xe11fffff 64bit pref] [ 2.203814] pci 0000:01:00.0: reg 0x20: [mem 0xf7500000-0xf75fffff] [ 2.203824] pci 0000:01:00.0: reg 0x24: [io 0x1000-0x10ff] [ 2.203831] pci 0000:01:00.0: reg 0x30: [mem 0xfffc0000-0xffffffff pref] [ 2.203913] pci 0000:01:00.0: supports D1 D2 [ 2.206826] pci 0000:00:03.1: PCI bridge to [bus 01] [ 2.211796] pci 0000:00:03.1: bridge window [io 0x1000-0x1fff] [ 2.211799] pci 0000:00:03.1: bridge window [mem 0xf7500000-0xf75fffff] [ 2.211803] pci 0000:00:03.1: bridge window [mem 0xe1000000-0xe11fffff 64bit pref] [ 2.211883] pci 0000:02:00.0: [1022:145a] type 00 class 0x130000 [ 2.212009] pci 0000:02:00.2: [1022:1456] type 00 class 0x108000 [ 2.212026] pci 0000:02:00.2: reg 0x18: [mem 0xf7300000-0xf73fffff] [ 2.212038] pci 0000:02:00.2: reg 0x24: [mem 0xf7400000-0xf7401fff] [ 2.212144] pci 0000:02:00.3: [1022:145f] type 00 class 0x0c0330 [ 2.212156] pci 0000:02:00.3: reg 0x10: [mem 0xf7200000-0xf72fffff 64bit] [ 2.212231] pci 0000:02:00.3: PME# supported from D0 D3hot D3cold [ 2.212287] pci 0000:00:07.1: PCI bridge to [bus 02] [ 2.217257] pci 0000:00:07.1: bridge window [mem 0xf7200000-0xf74fffff] [ 2.217708] pci 0000:03:00.0: [1022:1455] type 00 class 0x130000 [ 2.217846] pci 0000:03:00.1: [1022:1468] type 00 class 0x108000 [ 2.217865] pci 0000:03:00.1: reg 0x18: [mem 0xf7000000-0xf70fffff] [ 2.217877] pci 0000:03:00.1: reg 0x24: [mem 0xf7100000-0xf7101fff] [ 2.217996] pci 0000:00:08.1: PCI bridge to [bus 03] [ 2.222970] pci 0000:00:08.1: bridge window [mem 0xf7000000-0xf71fffff] [ 2.222985] pci_bus 0000:00: on NUMA node 0 [ 2.223356] ACPI: PCI Root Bridge [PC01] (domain 0000 [bus 40-7f]) [ 2.229535] acpi PNP0A08:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI] [ 2.237743] acpi PNP0A08:01: PCIe AER handled by firmware [ 2.243180] acpi PNP0A08:01: _OSC: platform does not support [SHPCHotplug] [ 2.250126] acpi PNP0A08:01: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 2.257778] acpi PNP0A08:01: FADT indicates ASPM is unsupported, using BIOS configuration [ 2.266186] PCI host bridge to bus 0000:40 [ 2.270286] pci_bus 0000:40: root bus resource [io 0x4000-0x7fff window] [ 2.277071] pci_bus 0000:40: root bus resource [mem 0xc6000000-0xe0ffffff window] [ 2.284550] pci_bus 0000:40: root bus resource [mem 0x2bf40000000-0x47e7fffffff window] [ 2.292548] pci_bus 0000:40: root bus resource [bus 40-7f] [ 2.298040] pci 0000:40:00.0: [1022:1450] type 00 class 0x060000 [ 2.298135] pci 0000:40:00.2: [1022:1451] type 00 class 0x080600 [ 2.298250] pci 0000:40:01.0: [1022:1452] type 00 class 0x060000 [ 2.298346] pci 0000:40:02.0: [1022:1452] type 00 class 0x060000 [ 2.298444] pci 0000:40:03.0: [1022:1452] type 00 class 0x060000 [ 2.298541] pci 0000:40:04.0: [1022:1452] type 00 class 0x060000 [ 2.298642] pci 0000:40:07.0: [1022:1452] type 00 class 0x060000 [ 2.298725] pci 0000:40:07.1: [1022:1454] type 01 class 0x060400 [ 2.299019] pci 0000:40:07.1: PME# supported from D0 D3hot D3cold [ 2.299100] pci 0000:40:08.0: [1022:1452] type 00 class 0x060000 [ 2.299186] pci 0000:40:08.1: [1022:1454] type 01 class 0x060400 [ 2.299328] pci 0000:40:08.1: PME# supported from D0 D3hot D3cold [ 2.299972] pci 0000:41:00.0: [1022:145a] type 00 class 0x130000 [ 2.300107] pci 0000:41:00.2: [1022:1456] type 00 class 0x108000 [ 2.300125] pci 0000:41:00.2: reg 0x18: [mem 0xdb300000-0xdb3fffff] [ 2.300139] pci 0000:41:00.2: reg 0x24: [mem 0xdb400000-0xdb401fff] [ 2.300251] pci 0000:41:00.3: [1022:145f] type 00 class 0x0c0330 [ 2.300264] pci 0000:41:00.3: reg 0x10: [mem 0xdb200000-0xdb2fffff 64bit] [ 2.300347] pci 0000:41:00.3: PME# supported from D0 D3hot D3cold [ 2.300405] pci 0000:40:07.1: PCI bridge to [bus 41] [ 2.305372] pci 0000:40:07.1: bridge window [mem 0xdb200000-0xdb4fffff] [ 2.305472] pci 0000:42:00.0: [1022:1455] type 00 class 0x130000 [ 2.305615] pci 0000:42:00.1: [1022:1468] type 00 class 0x108000 [ 2.305635] pci 0000:42:00.1: reg 0x18: [mem 0xdb000000-0xdb0fffff] [ 2.305649] pci 0000:42:00.1: reg 0x24: [mem 0xdb100000-0xdb101fff] [ 2.305776] pci 0000:40:08.1: PCI bridge to [bus 42] [ 2.310746] pci 0000:40:08.1: bridge window [mem 0xdb000000-0xdb1fffff] [ 2.310759] pci_bus 0000:40: on NUMA node 1 [ 2.310935] ACPI: PCI Root Bridge [PC02] (domain 0000 [bus 80-bf]) [ 2.317113] acpi PNP0A08:02: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI] [ 2.325320] acpi PNP0A08:02: PCIe AER handled by firmware [ 2.330758] acpi PNP0A08:02: _OSC: platform does not support [SHPCHotplug] [ 2.337706] acpi PNP0A08:02: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 2.345356] acpi PNP0A08:02: FADT indicates ASPM is unsupported, using BIOS configuration [ 2.353788] PCI host bridge to bus 0000:80 [ 2.357888] pci_bus 0000:80: root bus resource [io 0x03b0-0x03df window] [ 2.364675] pci_bus 0000:80: root bus resource [mem 0x000a0000-0x000bffff window] [ 2.372154] pci_bus 0000:80: root bus resource [io 0x8000-0xbfff window] [ 2.378940] pci_bus 0000:80: root bus resource [mem 0xab000000-0xc5ffffff window] [ 2.386419] pci_bus 0000:80: root bus resource [mem 0x47e80000000-0x63dbfffffff window] [ 2.394418] pci_bus 0000:80: root bus resource [bus 80-bf] [ 2.399909] pci 0000:80:00.0: [1022:1450] type 00 class 0x060000 [ 2.400007] pci 0000:80:00.2: [1022:1451] type 00 class 0x080600 [ 2.400118] pci 0000:80:01.0: [1022:1452] type 00 class 0x060000 [ 2.400205] pci 0000:80:01.1: [1022:1453] type 01 class 0x060400 [ 2.400736] pci 0000:80:01.1: PME# supported from D0 D3hot D3cold [ 2.400809] pci 0000:80:01.2: [1022:1453] type 01 class 0x060400 [ 2.400973] pci 0000:80:01.2: PME# supported from D0 D3hot D3cold [ 2.401054] pci 0000:80:02.0: [1022:1452] type 00 class 0x060000 [ 2.401155] pci 0000:80:03.0: [1022:1452] type 00 class 0x060000 [ 2.401239] pci 0000:80:03.1: [1022:1453] type 01 class 0x060400 [ 2.401732] pci 0000:80:03.1: PME# supported from D0 D3hot D3cold [ 2.401827] pci 0000:80:04.0: [1022:1452] type 00 class 0x060000 [ 2.401936] pci 0000:80:07.0: [1022:1452] type 00 class 0x060000 [ 2.402020] pci 0000:80:07.1: [1022:1454] type 01 class 0x060400 [ 2.402629] pci 0000:80:07.1: PME# supported from D0 D3hot D3cold [ 2.402707] pci 0000:80:08.0: [1022:1452] type 00 class 0x060000 [ 2.402791] pci 0000:80:08.1: [1022:1454] type 01 class 0x060400 [ 2.402933] pci 0000:80:08.1: PME# supported from D0 D3hot D3cold [ 2.403143] pci 0000:81:00.0: [14e4:165f] type 00 class 0x020000 [ 2.403169] pci 0000:81:00.0: reg 0x10: [mem 0xaf030000-0xaf03ffff 64bit pref] [ 2.403184] pci 0000:81:00.0: reg 0x18: [mem 0xaf040000-0xaf04ffff 64bit pref] [ 2.403199] pci 0000:81:00.0: reg 0x20: [mem 0xaf050000-0xaf05ffff 64bit pref] [ 2.403209] pci 0000:81:00.0: reg 0x30: [mem 0xfffc0000-0xffffffff pref] [ 2.403326] pci 0000:81:00.0: PME# supported from D0 D3hot D3cold [ 2.403421] pci 0000:81:00.1: [14e4:165f] type 00 class 0x020000 [ 2.403446] pci 0000:81:00.1: reg 0x10: [mem 0xaf000000-0xaf00ffff 64bit pref] [ 2.403461] pci 0000:81:00.1: reg 0x18: [mem 0xaf010000-0xaf01ffff 64bit pref] [ 2.403475] pci 0000:81:00.1: reg 0x20: [mem 0xaf020000-0xaf02ffff 64bit pref] [ 2.403485] pci 0000:81:00.1: reg 0x30: [mem 0xfffc0000-0xffffffff pref] [ 2.403601] pci 0000:81:00.1: PME# supported from D0 D3hot D3cold [ 2.403686] pci 0000:80:01.1: PCI bridge to [bus 81] [ 2.408656] pci 0000:80:01.1: bridge window [mem 0xaf000000-0xaf0fffff 64bit pref] [ 2.408742] pci 0000:82:00.0: [1556:be00] type 01 class 0x060400 [ 2.411844] pci 0000:80:01.2: PCI bridge to [bus 82-83] [ 2.417078] pci 0000:80:01.2: bridge window [mem 0xc0000000-0xc08fffff] [ 2.417082] pci 0000:80:01.2: bridge window [mem 0xae000000-0xaeffffff 64bit pref] [ 2.417129] pci 0000:83:00.0: [102b:0536] type 00 class 0x030000 [ 2.417148] pci 0000:83:00.0: reg 0x10: [mem 0xae000000-0xaeffffff pref] [ 2.417159] pci 0000:83:00.0: reg 0x14: [mem 0xc0808000-0xc080bfff] [ 2.417170] pci 0000:83:00.0: reg 0x18: [mem 0xc0000000-0xc07fffff] [ 2.417339] pci 0000:82:00.0: PCI bridge to [bus 83] [ 2.422315] pci 0000:82:00.0: bridge window [mem 0xc0000000-0xc08fffff] [ 2.422321] pci 0000:82:00.0: bridge window [mem 0xae000000-0xaeffffff 64bit pref] [ 2.422766] pci 0000:84:00.0: [15b3:1013] type 00 class 0x020700 [ 2.422897] pci 0000:84:00.0: reg 0x10: [mem 0xac000000-0xadffffff 64bit pref] [ 2.423144] pci 0000:84:00.0: reg 0x30: [mem 0xfff00000-0xffffffff pref] [ 2.423695] pci 0000:84:00.0: PME# supported from D3cold [ 2.423926] pci 0000:80:03.1: PCI bridge to [bus 84] [ 2.428899] pci 0000:80:03.1: bridge window [mem 0xac000000-0xadffffff 64bit pref] [ 2.428987] pci 0000:85:00.0: [1022:145a] type 00 class 0x130000 [ 2.429123] pci 0000:85:00.2: [1022:1456] type 00 class 0x108000 [ 2.429141] pci 0000:85:00.2: reg 0x18: [mem 0xc0b00000-0xc0bfffff] [ 2.429155] pci 0000:85:00.2: reg 0x24: [mem 0xc0c00000-0xc0c01fff] [ 2.429271] pci 0000:80:07.1: PCI bridge to [bus 85] [ 2.434245] pci 0000:80:07.1: bridge window [mem 0xc0b00000-0xc0cfffff] [ 2.434758] pci 0000:86:00.0: [1022:1455] type 00 class 0x130000 [ 2.434905] pci 0000:86:00.1: [1022:1468] type 00 class 0x108000 [ 2.434925] pci 0000:86:00.1: reg 0x18: [mem 0xc0900000-0xc09fffff] [ 2.434939] pci 0000:86:00.1: reg 0x24: [mem 0xc0a00000-0xc0a01fff] [ 2.435053] pci 0000:86:00.2: [1022:7901] type 00 class 0x010601 [ 2.435086] pci 0000:86:00.2: reg 0x24: [mem 0xc0a02000-0xc0a02fff] [ 2.435154] pci 0000:86:00.2: PME# supported from D3hot D3cold [ 2.435219] pci 0000:80:08.1: PCI bridge to [bus 86] [ 2.440191] pci 0000:80:08.1: bridge window [mem 0xc0900000-0xc0afffff] [ 2.440216] pci_bus 0000:80: on NUMA node 2 [ 2.440384] ACPI: PCI Root Bridge [PC03] (domain 0000 [bus c0-ff]) [ 2.446569] acpi PNP0A08:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI] [ 2.454777] acpi PNP0A08:03: PCIe AER handled by firmware [ 2.460221] acpi PNP0A08:03: _OSC: platform does not support [SHPCHotplug] [ 2.467169] acpi PNP0A08:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 2.474819] acpi PNP0A08:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 2.483139] acpi PNP0A08:03: host bridge window [mem 0x63dc0000000-0xffffffffffff window] ([0x80000000000-0xffffffffffff] ignored, not CPU addressable) [ 2.496775] PCI host bridge to bus 0000:c0 [ 2.500872] pci_bus 0000:c0: root bus resource [io 0xc000-0xffff window] [ 2.507659] pci_bus 0000:c0: root bus resource [mem 0x90000000-0xaaffffff window] [ 2.515138] pci_bus 0000:c0: root bus resource [mem 0x63dc0000000-0x7ffffffffff window] [ 2.523138] pci_bus 0000:c0: root bus resource [bus c0-ff] [ 2.528628] pci 0000:c0:00.0: [1022:1450] type 00 class 0x060000 [ 2.528722] pci 0000:c0:00.2: [1022:1451] type 00 class 0x080600 [ 2.528835] pci 0000:c0:01.0: [1022:1452] type 00 class 0x060000 [ 2.528922] pci 0000:c0:01.1: [1022:1453] type 01 class 0x060400 [ 2.529074] pci 0000:c0:01.1: PME# supported from D0 D3hot D3cold [ 2.529184] pci 0000:c0:02.0: [1022:1452] type 00 class 0x060000 [ 2.529282] pci 0000:c0:03.0: [1022:1452] type 00 class 0x060000 [ 2.529380] pci 0000:c0:04.0: [1022:1452] type 00 class 0x060000 [ 2.529481] pci 0000:c0:07.0: [1022:1452] type 00 class 0x060000 [ 2.529565] pci 0000:c0:07.1: [1022:1454] type 01 class 0x060400 [ 2.530031] pci 0000:c0:07.1: PME# supported from D0 D3hot D3cold [ 2.530111] pci 0000:c0:08.0: [1022:1452] type 00 class 0x060000 [ 2.530197] pci 0000:c0:08.1: [1022:1454] type 01 class 0x060400 [ 2.530340] pci 0000:c0:08.1: PME# supported from D0 D3hot D3cold [ 2.530992] pci 0000:c1:00.0: [1000:005f] type 00 class 0x010400 [ 2.531006] pci 0000:c1:00.0: reg 0x10: [io 0xc000-0xc0ff] [ 2.531016] pci 0000:c1:00.0: reg 0x14: [mem 0xa5500000-0xa550ffff 64bit] [ 2.531026] pci 0000:c1:00.0: reg 0x1c: [mem 0xa5400000-0xa54fffff 64bit] [ 2.531038] pci 0000:c1:00.0: reg 0x30: [mem 0xfff00000-0xffffffff pref] [ 2.531125] pci 0000:c1:00.0: supports D1 D2 [ 2.531178] pci 0000:c0:01.1: PCI bridge to [bus c1] [ 2.536146] pci 0000:c0:01.1: bridge window [io 0xc000-0xcfff] [ 2.536149] pci 0000:c0:01.1: bridge window [mem 0xa5400000-0xa55fffff] [ 2.536229] pci 0000:c2:00.0: [1022:145a] type 00 class 0x130000 [ 2.536362] pci 0000:c2:00.2: [1022:1456] type 00 class 0x108000 [ 2.536381] pci 0000:c2:00.2: reg 0x18: [mem 0xa5200000-0xa52fffff] [ 2.536395] pci 0000:c2:00.2: reg 0x24: [mem 0xa5300000-0xa5301fff] [ 2.536514] pci 0000:c0:07.1: PCI bridge to [bus c2] [ 2.541489] pci 0000:c0:07.1: bridge window [mem 0xa5200000-0xa53fffff] [ 2.542007] pci 0000:c3:00.0: [1022:1455] type 00 class 0x130000 [ 2.542157] pci 0000:c3:00.1: [1022:1468] type 00 class 0x108000 [ 2.542177] pci 0000:c3:00.1: reg 0x18: [mem 0xa5000000-0xa50fffff] [ 2.542191] pci 0000:c3:00.1: reg 0x24: [mem 0xa5100000-0xa5101fff] [ 2.542316] pci 0000:c0:08.1: PCI bridge to [bus c3] [ 2.547287] pci 0000:c0:08.1: bridge window [mem 0xa5000000-0xa51fffff] [ 2.547304] pci_bus 0000:c0: on NUMA node 3 [ 2.549413] vgaarb: device added: PCI:0000:83:00.0,decodes=io+mem,owns=io+mem,locks=none [ 2.557502] vgaarb: loaded [ 2.560211] vgaarb: bridge control possible 0000:83:00.0 [ 2.565642] SCSI subsystem initialized [ 2.569425] ACPI: bus type USB registered [ 2.573452] usbcore: registered new interface driver usbfs [ 2.578948] usbcore: registered new interface driver hub [ 2.584474] usbcore: registered new device driver usb [ 2.589840] EDAC MC: Ver: 3.0.0 [ 2.593242] PCI: Using ACPI for IRQ routing [ 2.616400] PCI: pci_cache_line_size set to 64 bytes [ 2.616548] e820: reserve RAM buffer [mem 0x0008f000-0x0008ffff] [ 2.616550] e820: reserve RAM buffer [mem 0x4468f020-0x47ffffff] [ 2.616552] e820: reserve RAM buffer [mem 0x446a8020-0x47ffffff] [ 2.616553] e820: reserve RAM buffer [mem 0x446da020-0x47ffffff] [ 2.616554] e820: reserve RAM buffer [mem 0x5b488020-0x5bffffff] [ 2.616555] e820: reserve RAM buffer [mem 0x5c3e0000-0x5fffffff] [ 2.616556] e820: reserve RAM buffer [mem 0x6cacf000-0x6fffffff] [ 2.616558] e820: reserve RAM buffer [mem 0x107f380000-0x107fffffff] [ 2.616559] e820: reserve RAM buffer [mem 0x207ff80000-0x207fffffff] [ 2.616560] e820: reserve RAM buffer [mem 0x307ff80000-0x307fffffff] [ 2.616562] e820: reserve RAM buffer [mem 0x407ff80000-0x407fffffff] [ 2.616811] NetLabel: Initializing [ 2.620221] NetLabel: domain hash size = 128 [ 2.624580] NetLabel: protocols = UNLABELED CIPSOv4 [ 2.629560] NetLabel: unlabeled traffic allowed by default [ 2.635329] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 [ 2.640310] hpet0: 3 comparators, 32-bit 14.318180 MHz counter [ 2.648331] Switched to clocksource hpet [ 2.657080] pnp: PnP ACPI init [ 2.660166] ACPI: bus type PNP registered [ 2.664414] system 00:00: [mem 0x80000000-0x8fffffff] has been reserved [ 2.671037] system 00:00: Plug and Play ACPI device, IDs PNP0c01 (active) [ 2.671096] pnp 00:01: Plug and Play ACPI device, IDs PNP0b00 (active) [ 2.671316] pnp 00:02: Plug and Play ACPI device, IDs PNP0501 (active) [ 2.671497] pnp 00:03: Plug and Play ACPI device, IDs PNP0501 (active) [ 2.671673] pnp: PnP ACPI: found 4 devices [ 2.675783] ACPI: bus type PNP unregistered [ 2.687167] pci 0000:01:00.0: can't claim BAR 6 [mem 0xfffc0000-0xffffffff pref]: no compatible bridge window [ 2.697089] pci 0000:81:00.0: can't claim BAR 6 [mem 0xfffc0000-0xffffffff pref]: no compatible bridge window [ 2.707001] pci 0000:81:00.1: can't claim BAR 6 [mem 0xfffc0000-0xffffffff pref]: no compatible bridge window [ 2.716918] pci 0000:84:00.0: can't claim BAR 6 [mem 0xfff00000-0xffffffff pref]: no compatible bridge window [ 2.726832] pci 0000:c1:00.0: can't claim BAR 6 [mem 0xfff00000-0xffffffff pref]: no compatible bridge window [ 2.736770] pci 0000:01:00.0: BAR 6: no space for [mem size 0x00040000 pref] [ 2.743828] pci 0000:01:00.0: BAR 6: failed to assign [mem size 0x00040000 pref] [ 2.751228] pci 0000:00:03.1: PCI bridge to [bus 01] [ 2.756202] pci 0000:00:03.1: bridge window [io 0x1000-0x1fff] [ 2.762305] pci 0000:00:03.1: bridge window [mem 0xf7500000-0xf75fffff] [ 2.769100] pci 0000:00:03.1: bridge window [mem 0xe1000000-0xe11fffff 64bit pref] [ 2.776850] pci 0000:00:07.1: PCI bridge to [bus 02] [ 2.781822] pci 0000:00:07.1: bridge window [mem 0xf7200000-0xf74fffff] [ 2.788619] pci 0000:00:08.1: PCI bridge to [bus 03] [ 2.793591] pci 0000:00:08.1: bridge window [mem 0xf7000000-0xf71fffff] [ 2.800390] pci_bus 0000:00: resource 4 [io 0x0000-0x03af window] [ 2.800392] pci_bus 0000:00: resource 5 [io 0x03e0-0x0cf7 window] [ 2.800394] pci_bus 0000:00: resource 6 [mem 0x000c0000-0x000c3fff window] [ 2.800395] pci_bus 0000:00: resource 7 [mem 0x000c4000-0x000c7fff window] [ 2.800397] pci_bus 0000:00: resource 8 [mem 0x000c8000-0x000cbfff window] [ 2.800399] pci_bus 0000:00: resource 9 [mem 0x000cc000-0x000cffff window] [ 2.800400] pci_bus 0000:00: resource 10 [mem 0x000d0000-0x000d3fff window] [ 2.800402] pci_bus 0000:00: resource 11 [mem 0x000d4000-0x000d7fff window] [ 2.800404] pci_bus 0000:00: resource 12 [mem 0x000d8000-0x000dbfff window] [ 2.800405] pci_bus 0000:00: resource 13 [mem 0x000dc000-0x000dffff window] [ 2.800407] pci_bus 0000:00: resource 14 [mem 0x000e0000-0x000e3fff window] [ 2.800409] pci_bus 0000:00: resource 15 [mem 0x000e4000-0x000e7fff window] [ 2.800410] pci_bus 0000:00: resource 16 [mem 0x000e8000-0x000ebfff window] [ 2.800412] pci_bus 0000:00: resource 17 [mem 0x000ec000-0x000effff window] [ 2.800414] pci_bus 0000:00: resource 18 [mem 0x000f0000-0x000fffff window] [ 2.800415] pci_bus 0000:00: resource 19 [io 0x0d00-0x3fff window] [ 2.800417] pci_bus 0000:00: resource 20 [mem 0xe1000000-0xfebfffff window] [ 2.800419] pci_bus 0000:00: resource 21 [mem 0x10000000000-0x2bf3fffffff window] [ 2.800421] pci_bus 0000:01: resource 0 [io 0x1000-0x1fff] [ 2.800423] pci_bus 0000:01: resource 1 [mem 0xf7500000-0xf75fffff] [ 2.800424] pci_bus 0000:01: resource 2 [mem 0xe1000000-0xe11fffff 64bit pref] [ 2.800426] pci_bus 0000:02: resource 1 [mem 0xf7200000-0xf74fffff] [ 2.800428] pci_bus 0000:03: resource 1 [mem 0xf7000000-0xf71fffff] [ 2.800439] pci 0000:40:07.1: PCI bridge to [bus 41] [ 2.805413] pci 0000:40:07.1: bridge window [mem 0xdb200000-0xdb4fffff] [ 2.812209] pci 0000:40:08.1: PCI bridge to [bus 42] [ 2.817184] pci 0000:40:08.1: bridge window [mem 0xdb000000-0xdb1fffff] [ 2.823980] pci_bus 0000:40: resource 4 [io 0x4000-0x7fff window] [ 2.823982] pci_bus 0000:40: resource 5 [mem 0xc6000000-0xe0ffffff window] [ 2.823983] pci_bus 0000:40: resource 6 [mem 0x2bf40000000-0x47e7fffffff window] [ 2.823985] pci_bus 0000:41: resource 1 [mem 0xdb200000-0xdb4fffff] [ 2.823987] pci_bus 0000:42: resource 1 [mem 0xdb000000-0xdb1fffff] [ 2.824021] pci 0000:80:01.1: BAR 14: assigned [mem 0xab000000-0xab0fffff] [ 2.830901] pci 0000:80:03.1: BAR 14: assigned [mem 0xab100000-0xab1fffff] [ 2.837784] pci 0000:81:00.0: BAR 6: assigned [mem 0xab000000-0xab03ffff pref] [ 2.845011] pci 0000:81:00.1: BAR 6: assigned [mem 0xab040000-0xab07ffff pref] [ 2.852239] pci 0000:80:01.1: PCI bridge to [bus 81] [ 2.857215] pci 0000:80:01.1: bridge window [mem 0xab000000-0xab0fffff] [ 2.864010] pci 0000:80:01.1: bridge window [mem 0xaf000000-0xaf0fffff 64bit pref] [ 2.871759] pci 0000:82:00.0: PCI bridge to [bus 83] [ 2.876734] pci 0000:82:00.0: bridge window [mem 0xc0000000-0xc08fffff] [ 2.883526] pci 0000:82:00.0: bridge window [mem 0xae000000-0xaeffffff 64bit pref] [ 2.891277] pci 0000:80:01.2: PCI bridge to [bus 82-83] [ 2.896509] pci 0000:80:01.2: bridge window [mem 0xc0000000-0xc08fffff] [ 2.903303] pci 0000:80:01.2: bridge window [mem 0xae000000-0xaeffffff 64bit pref] [ 2.911056] pci 0000:84:00.0: BAR 6: assigned [mem 0xab100000-0xab1fffff pref] [ 2.918287] pci 0000:80:03.1: PCI bridge to [bus 84] [ 2.923264] pci 0000:80:03.1: bridge window [mem 0xab100000-0xab1fffff] [ 2.930058] pci 0000:80:03.1: bridge window [mem 0xac000000-0xadffffff 64bit pref] [ 2.937808] pci 0000:80:07.1: PCI bridge to [bus 85] [ 2.942780] pci 0000:80:07.1: bridge window [mem 0xc0b00000-0xc0cfffff] [ 2.949579] pci 0000:80:08.1: PCI bridge to [bus 86] [ 2.954560] pci 0000:80:08.1: bridge window [mem 0xc0900000-0xc0afffff] [ 2.961355] pci_bus 0000:80: resource 4 [io 0x03b0-0x03df window] [ 2.961357] pci_bus 0000:80: resource 5 [mem 0x000a0000-0x000bffff window] [ 2.961359] pci_bus 0000:80: resource 6 [io 0x8000-0xbfff window] [ 2.961360] pci_bus 0000:80: resource 7 [mem 0xab000000-0xc5ffffff window] [ 2.961362] pci_bus 0000:80: resource 8 [mem 0x47e80000000-0x63dbfffffff window] [ 2.961364] pci_bus 0000:81: resource 1 [mem 0xab000000-0xab0fffff] [ 2.961366] pci_bus 0000:81: resource 2 [mem 0xaf000000-0xaf0fffff 64bit pref] [ 2.961367] pci_bus 0000:82: resource 1 [mem 0xc0000000-0xc08fffff] [ 2.961369] pci_bus 0000:82: resource 2 [mem 0xae000000-0xaeffffff 64bit pref] [ 2.961371] pci_bus 0000:83: resource 1 [mem 0xc0000000-0xc08fffff] [ 2.961372] pci_bus 0000:83: resource 2 [mem 0xae000000-0xaeffffff 64bit pref] [ 2.961374] pci_bus 0000:84: resource 1 [mem 0xab100000-0xab1fffff] [ 2.961376] pci_bus 0000:84: resource 2 [mem 0xac000000-0xadffffff 64bit pref] [ 2.961378] pci_bus 0000:85: resource 1 [mem 0xc0b00000-0xc0cfffff] [ 2.961379] pci_bus 0000:86: resource 1 [mem 0xc0900000-0xc0afffff] [ 2.961395] pci 0000:c1:00.0: BAR 6: no space for [mem size 0x00100000 pref] [ 2.968451] pci 0000:c1:00.0: BAR 6: failed to assign [mem size 0x00100000 pref] [ 2.975853] pci 0000:c0:01.1: PCI bridge to [bus c1] [ 2.980826] pci 0000:c0:01.1: bridge window [io 0xc000-0xcfff] [ 2.986929] pci 0000:c0:01.1: bridge window [mem 0xa5400000-0xa55fffff] [ 2.993726] pci 0000:c0:07.1: PCI bridge to [bus c2] [ 2.998700] pci 0000:c0:07.1: bridge window [mem 0xa5200000-0xa53fffff] [ 3.005497] pci 0000:c0:08.1: PCI bridge to [bus c3] [ 3.010477] pci 0000:c0:08.1: bridge window [mem 0xa5000000-0xa51fffff] [ 3.017273] pci_bus 0000:c0: resource 4 [io 0xc000-0xffff window] [ 3.017275] pci_bus 0000:c0: resource 5 [mem 0x90000000-0xaaffffff window] [ 3.017276] pci_bus 0000:c0: resource 6 [mem 0x63dc0000000-0x7ffffffffff window] [ 3.017278] pci_bus 0000:c1: resource 0 [io 0xc000-0xcfff] [ 3.017280] pci_bus 0000:c1: resource 1 [mem 0xa5400000-0xa55fffff] [ 3.017282] pci_bus 0000:c2: resource 1 [mem 0xa5200000-0xa53fffff] [ 3.017283] pci_bus 0000:c3: resource 1 [mem 0xa5000000-0xa51fffff] [ 3.017382] NET: Registered protocol family 2 [ 3.022472] TCP established hash table entries: 524288 (order: 10, 4194304 bytes) [ 3.030614] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes) [ 3.037442] TCP: Hash tables configured (established 524288 bind 65536) [ 3.044094] TCP: reno registered [ 3.047447] UDP hash table entries: 65536 (order: 9, 2097152 bytes) [ 3.054051] UDP-Lite hash table entries: 65536 (order: 9, 2097152 bytes) [ 3.061253] NET: Registered protocol family 1 [ 3.066063] pci 0000:83:00.0: Boot video device [ 3.066223] PCI: CLS 32 bytes, default 64 [ 3.066283] Unpacking initramfs... [ 3.407740] Freeing initrd memory: 23944k freed [ 3.415813] AMD-Vi: IOMMU performance counters supported [ 3.421205] AMD-Vi: IOMMU performance counters supported [ 3.426565] AMD-Vi: IOMMU performance counters supported [ 3.431922] AMD-Vi: IOMMU performance counters supported [ 3.438560] iommu: Adding device 0000:00:01.0 to group 0 [ 3.444550] iommu: Adding device 0000:00:02.0 to group 1 [ 3.450585] iommu: Adding device 0000:00:03.0 to group 2 [ 3.455932] iommu: Adding device 0000:00:03.1 to group 2 [ 3.462050] iommu: Adding device 0000:00:04.0 to group 3 [ 3.468048] iommu: Adding device 0000:00:07.0 to group 4 [ 3.473390] iommu: Adding device 0000:00:07.1 to group 4 [ 3.479370] iommu: Adding device 0000:00:08.0 to group 5 [ 3.484714] iommu: Adding device 0000:00:08.1 to group 5 [ 3.490737] iommu: Adding device 0000:00:14.0 to group 6 [ 3.496074] iommu: Adding device 0000:00:14.3 to group 6 [ 3.502158] iommu: Adding device 0000:00:18.0 to group 7 [ 3.507498] iommu: Adding device 0000:00:18.1 to group 7 [ 3.512833] iommu: Adding device 0000:00:18.2 to group 7 [ 3.518174] iommu: Adding device 0000:00:18.3 to group 7 [ 3.523512] iommu: Adding device 0000:00:18.4 to group 7 [ 3.528851] iommu: Adding device 0000:00:18.5 to group 7 [ 3.534188] iommu: Adding device 0000:00:18.6 to group 7 [ 3.539525] iommu: Adding device 0000:00:18.7 to group 7 [ 3.545619] iommu: Adding device 0000:00:19.0 to group 8 [ 3.550960] iommu: Adding device 0000:00:19.1 to group 8 [ 3.556310] iommu: Adding device 0000:00:19.2 to group 8 [ 3.561647] iommu: Adding device 0000:00:19.3 to group 8 [ 3.566983] iommu: Adding device 0000:00:19.4 to group 8 [ 3.572325] iommu: Adding device 0000:00:19.5 to group 8 [ 3.577663] iommu: Adding device 0000:00:19.6 to group 8 [ 3.583001] iommu: Adding device 0000:00:19.7 to group 8 [ 3.589031] iommu: Adding device 0000:00:1a.0 to group 9 [ 3.594373] iommu: Adding device 0000:00:1a.1 to group 9 [ 3.599709] iommu: Adding device 0000:00:1a.2 to group 9 [ 3.605050] iommu: Adding device 0000:00:1a.3 to group 9 [ 3.610389] iommu: Adding device 0000:00:1a.4 to group 9 [ 3.615728] iommu: Adding device 0000:00:1a.5 to group 9 [ 3.621064] iommu: Adding device 0000:00:1a.6 to group 9 [ 3.626403] iommu: Adding device 0000:00:1a.7 to group 9 [ 3.632456] iommu: Adding device 0000:00:1b.0 to group 10 [ 3.637881] iommu: Adding device 0000:00:1b.1 to group 10 [ 3.643317] iommu: Adding device 0000:00:1b.2 to group 10 [ 3.648748] iommu: Adding device 0000:00:1b.3 to group 10 [ 3.654171] iommu: Adding device 0000:00:1b.4 to group 10 [ 3.659596] iommu: Adding device 0000:00:1b.5 to group 10 [ 3.665025] iommu: Adding device 0000:00:1b.6 to group 10 [ 3.670451] iommu: Adding device 0000:00:1b.7 to group 10 [ 3.675873] iommu: Adding device 0000:01:00.0 to group 2 [ 3.681202] iommu: Adding device 0000:02:00.0 to group 4 [ 3.686530] iommu: Adding device 0000:02:00.2 to group 4 [ 3.691863] iommu: Adding device 0000:02:00.3 to group 4 [ 3.697195] iommu: Adding device 0000:03:00.0 to group 5 [ 3.702524] iommu: Adding device 0000:03:00.1 to group 5 [ 3.708526] iommu: Adding device 0000:40:01.0 to group 11 [ 3.714620] iommu: Adding device 0000:40:02.0 to group 12 [ 3.720727] iommu: Adding device 0000:40:03.0 to group 13 [ 3.726795] iommu: Adding device 0000:40:04.0 to group 14 [ 3.732934] iommu: Adding device 0000:40:07.0 to group 15 [ 3.738369] iommu: Adding device 0000:40:07.1 to group 15 [ 3.744467] iommu: Adding device 0000:40:08.0 to group 16 [ 3.749902] iommu: Adding device 0000:40:08.1 to group 16 [ 3.755318] iommu: Adding device 0000:41:00.0 to group 15 [ 3.760738] iommu: Adding device 0000:41:00.2 to group 15 [ 3.766153] iommu: Adding device 0000:41:00.3 to group 15 [ 3.771570] iommu: Adding device 0000:42:00.0 to group 16 [ 3.776985] iommu: Adding device 0000:42:00.1 to group 16 [ 3.783074] iommu: Adding device 0000:80:01.0 to group 17 [ 3.788506] iommu: Adding device 0000:80:01.1 to group 17 [ 3.793944] iommu: Adding device 0000:80:01.2 to group 17 [ 3.800039] iommu: Adding device 0000:80:02.0 to group 18 [ 3.806159] iommu: Adding device 0000:80:03.0 to group 19 [ 3.811600] iommu: Adding device 0000:80:03.1 to group 19 [ 3.817665] iommu: Adding device 0000:80:04.0 to group 20 [ 3.823775] iommu: Adding device 0000:80:07.0 to group 21 [ 3.829215] iommu: Adding device 0000:80:07.1 to group 21 [ 3.835306] iommu: Adding device 0000:80:08.0 to group 22 [ 3.840743] iommu: Adding device 0000:80:08.1 to group 22 [ 3.846162] iommu: Adding device 0000:81:00.0 to group 17 [ 3.851587] iommu: Adding device 0000:81:00.1 to group 17 [ 3.857013] iommu: Adding device 0000:82:00.0 to group 17 [ 3.862432] iommu: Adding device 0000:83:00.0 to group 17 [ 3.867874] iommu: Adding device 0000:84:00.0 to group 19 [ 3.873292] iommu: Adding device 0000:85:00.0 to group 21 [ 3.878706] iommu: Adding device 0000:85:00.2 to group 21 [ 3.884126] iommu: Adding device 0000:86:00.0 to group 22 [ 3.889544] iommu: Adding device 0000:86:00.1 to group 22 [ 3.894961] iommu: Adding device 0000:86:00.2 to group 22 [ 3.901061] iommu: Adding device 0000:c0:01.0 to group 23 [ 3.906500] iommu: Adding device 0000:c0:01.1 to group 23 [ 3.912595] iommu: Adding device 0000:c0:02.0 to group 24 [ 3.918626] iommu: Adding device 0000:c0:03.0 to group 25 [ 3.924660] iommu: Adding device 0000:c0:04.0 to group 26 [ 3.930701] iommu: Adding device 0000:c0:07.0 to group 27 [ 3.936135] iommu: Adding device 0000:c0:07.1 to group 27 [ 3.942190] iommu: Adding device 0000:c0:08.0 to group 28 [ 3.947630] iommu: Adding device 0000:c0:08.1 to group 28 [ 3.953048] iommu: Adding device 0000:c1:00.0 to group 23 [ 3.958469] iommu: Adding device 0000:c2:00.0 to group 27 [ 3.963885] iommu: Adding device 0000:c2:00.2 to group 27 [ 3.969312] iommu: Adding device 0000:c3:00.0 to group 28 [ 3.974727] iommu: Adding device 0000:c3:00.1 to group 28 [ 3.980413] AMD-Vi: Found IOMMU at 0000:00:00.2 cap 0x40 [ 3.985734] AMD-Vi: Extended features (0xf77ef22294ada): [ 3.991056] PPR NX GT IA GA PC GA_vAPIC [ 3.995189] AMD-Vi: Found IOMMU at 0000:40:00.2 cap 0x40 [ 4.000512] AMD-Vi: Extended features (0xf77ef22294ada): [ 4.005832] PPR NX GT IA GA PC GA_vAPIC [ 4.009965] AMD-Vi: Found IOMMU at 0000:80:00.2 cap 0x40 [ 4.015289] AMD-Vi: Extended features (0xf77ef22294ada): [ 4.020610] PPR NX GT IA GA PC GA_vAPIC [ 4.024752] AMD-Vi: Found IOMMU at 0000:c0:00.2 cap 0x40 [ 4.030073] AMD-Vi: Extended features (0xf77ef22294ada): [ 4.035395] PPR NX GT IA GA PC GA_vAPIC [ 4.039537] AMD-Vi: Interrupt remapping enabled [ 4.044076] AMD-Vi: virtual APIC enabled [ 4.048069] pci 0000:00:00.2: irq 26 for MSI/MSI-X [ 4.048164] pci 0000:40:00.2: irq 27 for MSI/MSI-X [ 4.048248] pci 0000:80:00.2: irq 28 for MSI/MSI-X [ 4.048345] pci 0000:c0:00.2: irq 29 for MSI/MSI-X [ 4.048401] AMD-Vi: Lazy IO/TLB flushing enabled [ 4.054738] perf: AMD NB counters detected [ 4.058873] perf: AMD LLC counters detected [ 4.068749] sha1_ssse3: Using SHA-NI optimized SHA-1 implementation [ 4.075109] sha256_ssse3: Using SHA-256-NI optimized SHA-256 implementation [ 4.083659] futex hash table entries: 32768 (order: 9, 2097152 bytes) [ 4.090294] Initialise system trusted keyring [ 4.094697] audit: initializing netlink socket (disabled) [ 4.100112] type=2000 audit(1558744817.254:1): initialized [ 4.130735] HugeTLB registered 1 GB page size, pre-allocated 0 pages [ 4.137099] HugeTLB registered 2 MB page size, pre-allocated 0 pages [ 4.144708] zpool: loaded [ 4.147341] zbud: loaded [ 4.150238] VFS: Disk quotas dquot_6.5.2 [ 4.154259] Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 4.161025] msgmni has been set to 32768 [ 4.165045] Key type big_key registered [ 4.168898] SELinux: Registering netfilter hooks [ 4.171261] NET: Registered protocol family 38 [ 4.175721] Key type asymmetric registered [ 4.179826] Asymmetric key parser 'x509' registered [ 4.184757] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) [ 4.192315] io scheduler noop registered [ 4.196250] io scheduler deadline registered (default) [ 4.201432] io scheduler cfq registered [ 4.205281] io scheduler mq-deadline registered [ 4.209820] io scheduler kyber registered [ 4.214543] pcieport 0000:00:03.1: irq 30 for MSI/MSI-X [ 4.215500] pcieport 0000:00:07.1: irq 31 for MSI/MSI-X [ 4.216490] pcieport 0000:00:08.1: irq 33 for MSI/MSI-X [ 4.216694] pcieport 0000:40:07.1: irq 34 for MSI/MSI-X [ 4.216946] pcieport 0000:40:08.1: irq 36 for MSI/MSI-X [ 4.217226] pcieport 0000:80:01.1: irq 37 for MSI/MSI-X [ 4.217485] pcieport 0000:80:01.2: irq 38 for MSI/MSI-X [ 4.218145] pcieport 0000:80:03.1: irq 39 for MSI/MSI-X [ 4.218442] pcieport 0000:80:07.1: irq 41 for MSI/MSI-X [ 4.219132] pcieport 0000:80:08.1: irq 43 for MSI/MSI-X [ 4.219472] pcieport 0000:c0:01.1: irq 44 for MSI/MSI-X [ 4.220207] pcieport 0000:c0:07.1: irq 46 for MSI/MSI-X [ 4.220442] pcieport 0000:c0:08.1: irq 48 for MSI/MSI-X [ 4.220556] pcieport 0000:00:03.1: Signaling PME through PCIe PME interrupt [ 4.227527] pci 0000:01:00.0: Signaling PME through PCIe PME interrupt [ 4.234062] pcie_pme 0000:00:03.1:pcie001: service driver pcie_pme loaded [ 4.234076] pcieport 0000:00:07.1: Signaling PME through PCIe PME interrupt [ 4.241046] pci 0000:02:00.0: Signaling PME through PCIe PME interrupt [ 4.247580] pci 0000:02:00.2: Signaling PME through PCIe PME interrupt [ 4.254116] pci 0000:02:00.3: Signaling PME through PCIe PME interrupt [ 4.260651] pcie_pme 0000:00:07.1:pcie001: service driver pcie_pme loaded [ 4.260664] pcieport 0000:00:08.1: Signaling PME through PCIe PME interrupt [ 4.267626] pci 0000:03:00.0: Signaling PME through PCIe PME interrupt [ 4.274162] pci 0000:03:00.1: Signaling PME through PCIe PME interrupt [ 4.280697] pcie_pme 0000:00:08.1:pcie001: service driver pcie_pme loaded [ 4.280716] pcieport 0000:40:07.1: Signaling PME through PCIe PME interrupt [ 4.287682] pci 0000:41:00.0: Signaling PME through PCIe PME interrupt [ 4.294217] pci 0000:41:00.2: Signaling PME through PCIe PME interrupt [ 4.300750] pci 0000:41:00.3: Signaling PME through PCIe PME interrupt [ 4.307287] pcie_pme 0000:40:07.1:pcie001: service driver pcie_pme loaded [ 4.307310] pcieport 0000:40:08.1: Signaling PME through PCIe PME interrupt [ 4.314278] pci 0000:42:00.0: Signaling PME through PCIe PME interrupt [ 4.320814] pci 0000:42:00.1: Signaling PME through PCIe PME interrupt [ 4.327350] pcie_pme 0000:40:08.1:pcie001: service driver pcie_pme loaded [ 4.327367] pcieport 0000:80:01.1: Signaling PME through PCIe PME interrupt [ 4.334333] pci 0000:81:00.0: Signaling PME through PCIe PME interrupt [ 4.340869] pci 0000:81:00.1: Signaling PME through PCIe PME interrupt [ 4.347408] pcie_pme 0000:80:01.1:pcie001: service driver pcie_pme loaded [ 4.347423] pcieport 0000:80:01.2: Signaling PME through PCIe PME interrupt [ 4.354390] pci 0000:82:00.0: Signaling PME through PCIe PME interrupt [ 4.360924] pci 0000:83:00.0: Signaling PME through PCIe PME interrupt [ 4.367460] pcie_pme 0000:80:01.2:pcie001: service driver pcie_pme loaded [ 4.367477] pcieport 0000:80:03.1: Signaling PME through PCIe PME interrupt [ 4.374444] pci 0000:84:00.0: Signaling PME through PCIe PME interrupt [ 4.380980] pcie_pme 0000:80:03.1:pcie001: service driver pcie_pme loaded [ 4.380996] pcieport 0000:80:07.1: Signaling PME through PCIe PME interrupt [ 4.387966] pci 0000:85:00.0: Signaling PME through PCIe PME interrupt [ 4.394498] pci 0000:85:00.2: Signaling PME through PCIe PME interrupt [ 4.401034] pcie_pme 0000:80:07.1:pcie001: service driver pcie_pme loaded [ 4.401050] pcieport 0000:80:08.1: Signaling PME through PCIe PME interrupt [ 4.408020] pci 0000:86:00.0: Signaling PME through PCIe PME interrupt [ 4.414554] pci 0000:86:00.1: Signaling PME through PCIe PME interrupt [ 4.421088] pci 0000:86:00.2: Signaling PME through PCIe PME interrupt [ 4.427625] pcie_pme 0000:80:08.1:pcie001: service driver pcie_pme loaded [ 4.427641] pcieport 0000:c0:01.1: Signaling PME through PCIe PME interrupt [ 4.434609] pci 0000:c1:00.0: Signaling PME through PCIe PME interrupt [ 4.441145] pcie_pme 0000:c0:01.1:pcie001: service driver pcie_pme loaded [ 4.441160] pcieport 0000:c0:07.1: Signaling PME through PCIe PME interrupt [ 4.448129] pci 0000:c2:00.0: Signaling PME through PCIe PME interrupt [ 4.454664] pci 0000:c2:00.2: Signaling PME through PCIe PME interrupt [ 4.461200] pcie_pme 0000:c0:07.1:pcie001: service driver pcie_pme loaded [ 4.461214] pcieport 0000:c0:08.1: Signaling PME through PCIe PME interrupt [ 4.468183] pci 0000:c3:00.0: Signaling PME through PCIe PME interrupt [ 4.474719] pci 0000:c3:00.1: Signaling PME through PCIe PME interrupt [ 4.481256] pcie_pme 0000:c0:08.1:pcie001: service driver pcie_pme loaded [ 4.481277] pci_hotplug: PCI Hot Plug PCI Core version: 0.5 [ 4.486856] pciehp: PCI Express Hot Plug Controller Driver version: 0.4 [ 4.493506] shpchp 0000:82:00.0: Cannot get control of SHPC hotplug [ 4.499814] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 4.506621] efifb: probing for efifb [ 4.510226] efifb: framebuffer at 0xae000000, mapped to 0xffffb52559800000, using 3072k, total 3072k [ 4.519363] efifb: mode is 1024x768x32, linelength=4096, pages=1 [ 4.525376] efifb: scrolling: redraw [ 4.528965] efifb: Truecolor: size=8:8:8:8, shift=24:16:8:0 [ 4.550270] Console: switching to colour frame buffer device 128x48 [ 4.571988] fb0: EFI VGA frame buffer device [ 4.576379] input: Power Button as /devices/LNXSYSTM:00/device:00/PNP0C0C:00/input/input0 [ 4.584565] ACPI: Power Button [PWRB] [ 4.588289] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 4.595691] ACPI: Power Button [PWRF] [ 4.600553] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 4.608031] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 4.635231] 00:02: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A [ 4.661770] 00:03: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A [ 4.667819] Non-volatile memory driver v1.3 [ 4.672046] Linux agpgart interface v0.103 [ 4.678755] crash memory driver: version 1.1 [ 4.683251] rdac: device handler registered [ 4.687499] hp_sw: device handler registered [ 4.691781] emc: device handler registered [ 4.696037] alua: device handler registered [ 4.700260] libphy: Fixed MDIO Bus: probed [ 4.704434] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver [ 4.710970] ehci-pci: EHCI PCI platform driver [ 4.715436] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver [ 4.721631] ohci-pci: OHCI PCI platform driver [ 4.726094] uhci_hcd: USB Universal Host Controller Interface driver [ 4.732599] xhci_hcd 0000:02:00.3: xHCI Host Controller [ 4.737896] xhci_hcd 0000:02:00.3: new USB bus registered, assigned bus number 1 [ 4.745412] xhci_hcd 0000:02:00.3: hcc params 0x0270f665 hci version 0x100 quirks 0x00000410 [ 4.753888] xhci_hcd 0000:02:00.3: irq 50 for MSI/MSI-X [ 4.753908] xhci_hcd 0000:02:00.3: irq 51 for MSI/MSI-X [ 4.753927] xhci_hcd 0000:02:00.3: irq 52 for MSI/MSI-X [ 4.753945] xhci_hcd 0000:02:00.3: irq 53 for MSI/MSI-X [ 4.753963] xhci_hcd 0000:02:00.3: irq 54 for MSI/MSI-X [ 4.753981] xhci_hcd 0000:02:00.3: irq 55 for MSI/MSI-X [ 4.754000] xhci_hcd 0000:02:00.3: irq 56 for MSI/MSI-X [ 4.754020] xhci_hcd 0000:02:00.3: irq 57 for MSI/MSI-X [ 4.754157] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002 [ 4.760950] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.768177] usb usb1: Product: xHCI Host Controller [ 4.773065] usb usb1: Manufacturer: Linux 3.10.0-957.1.3.el7_lustre.x86_64 xhci-hcd [ 4.780727] usb usb1: SerialNumber: 0000:02:00.3 [ 4.785462] hub 1-0:1.0: USB hub found [ 4.789233] hub 1-0:1.0: 2 ports detected [ 4.793497] xhci_hcd 0000:02:00.3: xHCI Host Controller [ 4.798804] xhci_hcd 0000:02:00.3: new USB bus registered, assigned bus number 2 [ 4.806233] usb usb2: We don't know the algorithms for LPM for this host, disabling LPM. [ 4.814339] usb usb2: New USB device found, idVendor=1d6b, idProduct=0003 [ 4.821129] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.828357] usb usb2: Product: xHCI Host Controller [ 4.833246] usb usb2: Manufacturer: Linux 3.10.0-957.1.3.el7_lustre.x86_64 xhci-hcd [ 4.840907] usb usb2: SerialNumber: 0000:02:00.3 [ 4.845635] hub 2-0:1.0: USB hub found [ 4.849395] hub 2-0:1.0: 2 ports detected [ 4.853712] xhci_hcd 0000:41:00.3: xHCI Host Controller [ 4.859015] xhci_hcd 0000:41:00.3: new USB bus registered, assigned bus number 3 [ 4.866522] xhci_hcd 0000:41:00.3: hcc params 0x0270f665 hci version 0x100 quirks 0x00000410 [ 4.875001] xhci_hcd 0000:41:00.3: irq 59 for MSI/MSI-X [ 4.875021] xhci_hcd 0000:41:00.3: irq 60 for MSI/MSI-X [ 4.875044] xhci_hcd 0000:41:00.3: irq 61 for MSI/MSI-X [ 4.875062] xhci_hcd 0000:41:00.3: irq 62 for MSI/MSI-X [ 4.875080] xhci_hcd 0000:41:00.3: irq 63 for MSI/MSI-X [ 4.875098] xhci_hcd 0000:41:00.3: irq 64 for MSI/MSI-X [ 4.875117] xhci_hcd 0000:41:00.3: irq 65 for MSI/MSI-X [ 4.875137] xhci_hcd 0000:41:00.3: irq 66 for MSI/MSI-X [ 4.875283] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002 [ 4.882075] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.889314] usb usb3: Product: xHCI Host Controller [ 4.894199] usb usb3: Manufacturer: Linux 3.10.0-957.1.3.el7_lustre.x86_64 xhci-hcd [ 4.901861] usb usb3: SerialNumber: 0000:41:00.3 [ 4.906605] hub 3-0:1.0: USB hub found [ 4.910367] hub 3-0:1.0: 2 ports detected [ 4.914625] xhci_hcd 0000:41:00.3: xHCI Host Controller [ 4.919909] xhci_hcd 0000:41:00.3: new USB bus registered, assigned bus number 4 [ 4.927328] usb usb4: We don't know the algorithms for LPM for this host, disabling LPM. [ 4.935437] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003 [ 4.942230] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.949459] usb usb4: Product: xHCI Host Controller [ 4.954346] usb usb4: Manufacturer: Linux 3.10.0-957.1.3.el7_lustre.x86_64 xhci-hcd [ 4.962008] usb usb4: SerialNumber: 0000:41:00.3 [ 4.966728] hub 4-0:1.0: USB hub found [ 4.970494] hub 4-0:1.0: 2 ports detected [ 4.974743] usbcore: registered new interface driver usbserial_generic [ 4.981279] usbserial: USB Serial support registered for generic [ 4.987337] i8042: PNP: No PS/2 controller found. Probing ports directly. [ 5.105324] usb 1-1: new high-speed USB device number 2 using xhci_hcd [ 5.237233] usb 1-1: New USB device found, idVendor=0424, idProduct=2744 [ 5.243949] usb 1-1: New USB device strings: Mfr=1, Product=2, SerialNumber=0 [ 5.251085] usb 1-1: Product: USB2734 [ 5.254758] usb 1-1: Manufacturer: Microchip Tech [ 5.286381] hub 1-1:1.0: USB hub found [ 5.290359] hub 1-1:1.0: 4 ports detected [ 5.347356] usb 2-1: new SuperSpeed USB device number 2 using xhci_hcd [ 5.368478] usb 2-1: New USB device found, idVendor=0424, idProduct=5744 [ 5.375185] usb 2-1: New USB device strings: Mfr=2, Product=3, SerialNumber=0 [ 5.382324] usb 2-1: Product: USB5734 [ 5.385999] usb 2-1: Manufacturer: Microchip Tech [ 5.398373] hub 2-1:1.0: USB hub found [ 5.402351] hub 2-1:1.0: 4 ports detected [ 5.407271] usb: port power management may be unreliable [ 6.027367] i8042: No controller found [ 6.031165] tsc: Refined TSC clocksource calibration: 1996.248 MHz [ 6.031208] mousedev: PS/2 mouse device common for all mice [ 6.031430] rtc_cmos 00:01: RTC can wake from S4 [ 6.031790] rtc_cmos 00:01: rtc core: registered rtc_cmos as rtc0 [ 6.031891] rtc_cmos 00:01: alarms up to one month, y3k, 114 bytes nvram, hpet irqs [ 6.031946] cpuidle: using governor menu [ 6.032196] EFI Variables Facility v0.08 2004-May-17 [ 6.053111] hidraw: raw HID events driver (C) Jiri Kosina [ 6.053221] usbcore: registered new interface driver usbhid [ 6.053222] usbhid: USB HID core driver [ 6.053343] drop_monitor: Initializing network drop monitor service [ 6.053488] TCP: cubic registered [ 6.053491] Initializing XFRM netlink socket [ 6.053686] NET: Registered protocol family 10 [ 6.054383] NET: Registered protocol family 17 [ 6.054389] mpls_gso: MPLS GSO support [ 6.055489] microcode: CPU0: patch_level=0x08001227 [ 6.055501] microcode: CPU1: patch_level=0x08001227 [ 6.055514] microcode: CPU2: patch_level=0x08001227 [ 6.055527] microcode: CPU3: patch_level=0x08001227 [ 6.055543] microcode: CPU4: patch_level=0x08001227 [ 6.055555] microcode: CPU5: patch_level=0x08001227 [ 6.055571] microcode: CPU6: patch_level=0x08001227 [ 6.055584] microcode: CPU7: patch_level=0x08001227 [ 6.055593] microcode: CPU8: patch_level=0x08001227 [ 6.055604] microcode: CPU9: patch_level=0x08001227 [ 6.055615] microcode: CPU10: patch_level=0x08001227 [ 6.055626] microcode: CPU11: patch_level=0x08001227 [ 6.055637] microcode: CPU12: patch_level=0x08001227 [ 6.061289] microcode: CPU13: patch_level=0x08001227 [ 6.061302] microcode: CPU14: patch_level=0x08001227 [ 6.061317] microcode: CPU15: patch_level=0x08001227 [ 6.061322] microcode: CPU16: patch_level=0x08001227 [ 6.061332] microcode: CPU17: patch_level=0x08001227 [ 6.061343] microcode: CPU18: patch_level=0x08001227 [ 6.061354] microcode: CPU19: patch_level=0x08001227 [ 6.061365] microcode: CPU20: patch_level=0x08001227 [ 6.061376] microcode: CPU21: patch_level=0x08001227 [ 6.061387] microcode: CPU22: patch_level=0x08001227 [ 6.061398] microcode: CPU23: patch_level=0x08001227 [ 6.061407] microcode: CPU24: patch_level=0x08001227 [ 6.061418] microcode: CPU25: patch_level=0x08001227 [ 6.061427] microcode: CPU26: patch_level=0x08001227 [ 6.061437] microcode: CPU27: patch_level=0x08001227 [ 6.061446] microcode: CPU28: patch_level=0x08001227 [ 6.061457] microcode: CPU29: patch_level=0x08001227 [ 6.061467] microcode: CPU30: patch_level=0x08001227 [ 6.061478] microcode: CPU31: patch_level=0x08001227 [ 6.061489] microcode: CPU32: patch_level=0x08001227 [ 6.061497] microcode: CPU33: patch_level=0x08001227 [ 6.061508] microcode: CPU34: patch_level=0x08001227 [ 6.061518] microcode: CPU35: patch_level=0x08001227 [ 6.061529] microcode: CPU36: patch_level=0x08001227 [ 6.061538] microcode: CPU37: patch_level=0x08001227 [ 6.061549] microcode: CPU38: patch_level=0x08001227 [ 6.061559] microcode: CPU39: patch_level=0x08001227 [ 6.061568] microcode: CPU40: patch_level=0x08001227 [ 6.061576] microcode: CPU41: patch_level=0x08001227 [ 6.061584] microcode: CPU42: patch_level=0x08001227 [ 6.061595] microcode: CPU43: patch_level=0x08001227 [ 6.061605] microcode: CPU44: patch_level=0x08001227 [ 6.061614] microcode: CPU45: patch_level=0x08001227 [ 6.061625] microcode: CPU46: patch_level=0x08001227 [ 6.061635] microcode: CPU47: patch_level=0x08001227 [ 6.061685] microcode: Microcode Update Driver: v2.01 , Peter Oruba [ 6.061830] PM: Hibernation image not present or could not be loaded. [ 6.061833] Loading compiled-in X.509 certificates [ 6.062218] Loaded X.509 cert 'Red Hat Enterprise Linux Driver Update Program (key 3): bf57f3e87362bc7229d9f465321773dfd1f77a80' [ 6.062585] Loaded X.509 cert 'Red Hat Enterprise Linux kpatch signing key: 4d38fd864ebe18c5f0b72e3852e2014c3a676fc8' [ 6.062949] Loaded X.509 cert 'Red Hat Enterprise Linux kernel signing key: 26463bf7b35aa6e910b2216d61318fa5ff5b7954' [ 6.062967] registered taskstats version 1 [ 6.065133] Key type trusted registered [ 6.066667] Key type encrypted registered [ 6.066715] IMA: No TPM chip found, activating TPM-bypass! (rc=-19) [ 6.068153] Magic number: 3:3:659 [ 6.068287] memory memory2020: hash matches [ 6.068294] memory memory1865: hash matches [ 6.068975] rtc_cmos 00:01: setting system clock to 2019-05-25 00:40:24 UTC (1558744824) [ 6.441838] Switched to clocksource tsc [ 6.446659] Freeing unused kernel memory: 1876k freed [ 6.451996] Write protecting the kernel read-only data: 12288k [ 6.459271] Freeing unused kernel memory: 516k freed [ 6.465672] Freeing unused kernel memory: 600k freed [ 6.517826] systemd[1]: systemd 219 running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 -SECCOMP +BLKID +ELFUTILS +KMOD +IDN) [ 6.536891] systemd[1]: Detected architecture x86-64. [ 6.541948] systemd[1]: Running in initial RAM disk. [ 6.555462] systemd[1]: Set hostname to . [ 6.557325] usb 3-1: new high-speed USB device number 2 using xhci_hcd [ 6.597634] systemd[1]: Reached target Timers. [ 6.606407] systemd[1]: Reached target Local File Systems. [ 6.617588] systemd[1]: Created slice Root Slice. [ 6.628424] systemd[1]: Listening on udev Control Socket. [ 6.639413] systemd[1]: Listening on Journal Socket. [ 6.650433] systemd[1]: Created slice System Slice. [ 6.661372] systemd[1]: Reached target Slices. [ 6.670859] systemd[1]: Starting Journal Service... [ 6.680798] systemd[1]: Starting Setup Virtual Console... [ 6.681357] usb 3-1: New USB device found, idVendor=1604, idProduct=10c0 [ 6.681359] usb 3-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 6.687501] hub 3-1:1.0: USB hub found [ 6.687853] hub 3-1:1.0: 4 ports detected [ 6.723051] systemd[1]: Starting Create list of required static device nodes for the current kernel... [ 6.744831] systemd[1]: Starting Load Kernel Modules... [ 6.754397] systemd[1]: Listening on udev Kernel Socket. [ 6.765378] systemd[1]: Reached target Sockets. [ 6.774841] systemd[1]: Starting dracut cmdline hook... [ 6.784386] systemd[1]: Reached target Swap. [ 6.793640] systemd[1]: Started Journal Service. [ 6.996584] mpt3sas: loading out-of-tree module taints kernel. [ 7.010238] mpt3sas: module verification failed: signature and/or required key missing - tainting kernel [ 7.031826] mpt3sas version 27.00.00.00 loaded [ 7.031854] pps_core: LinuxPPS API ver. 1 registered [ 7.031855] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 7.052968] PTP clock support registered [ 7.053229] mpt3sas_cm0: 64 BIT PCI BUS DMA ADDRESSING SUPPORTED, total mem (263565260 kB) [ 7.063448] mpt3sas_cm0: IOC Number : 0 [ 7.063450] mpt3sas_cm0: CurrentHostPageSize is 0: Setting default host page size to 4k [ 7.063554] mpt3sas 0000:01:00.0: irq 68 for MSI/MSI-X [ 7.063579] mpt3sas 0000:01:00.0: irq 69 for MSI/MSI-X [ 7.063602] mpt3sas 0000:01:00.0: irq 70 for MSI/MSI-X [ 7.063626] mpt3sas 0000:01:00.0: irq 71 for MSI/MSI-X [ 7.063649] mpt3sas 0000:01:00.0: irq 72 for MSI/MSI-X [ 7.063671] mpt3sas 0000:01:00.0: irq 73 for MSI/MSI-X [ 7.063694] mpt3sas 0000:01:00.0: irq 74 for MSI/MSI-X [ 7.063714] mpt3sas 0000:01:00.0: irq 75 for MSI/MSI-X [ 7.063737] mpt3sas 0000:01:00.0: irq 76 for MSI/MSI-X [ 7.063758] mpt3sas 0000:01:00.0: irq 77 for MSI/MSI-X [ 7.063780] mpt3sas 0000:01:00.0: irq 78 for MSI/MSI-X [ 7.063804] mpt3sas 0000:01:00.0: irq 79 for MSI/MSI-X [ 7.063827] mpt3sas 0000:01:00.0: irq 80 for MSI/MSI-X [ 7.063850] mpt3sas 0000:01:00.0: irq 81 for MSI/MSI-X [ 7.063872] mpt3sas 0000:01:00.0: irq 82 for MSI/MSI-X [ 7.063894] mpt3sas 0000:01:00.0: irq 83 for MSI/MSI-X [ 7.063916] mpt3sas 0000:01:00.0: irq 84 for MSI/MSI-X [ 7.063937] mpt3sas 0000:01:00.0: irq 85 for MSI/MSI-X [ 7.063959] mpt3sas 0000:01:00.0: irq 86 for MSI/MSI-X [ 7.063982] mpt3sas 0000:01:00.0: irq 87 for MSI/MSI-X [ 7.064004] mpt3sas 0000:01:00.0: irq 88 for MSI/MSI-X [ 7.064025] mpt3sas 0000:01:00.0: irq 89 for MSI/MSI-X [ 7.064046] mpt3sas 0000:01:00.0: irq 90 for MSI/MSI-X [ 7.064067] mpt3sas 0000:01:00.0: irq 91 for MSI/MSI-X [ 7.064088] mpt3sas 0000:01:00.0: irq 92 for MSI/MSI-X [ 7.064109] mpt3sas 0000:01:00.0: irq 93 for MSI/MSI-X [ 7.064132] mpt3sas 0000:01:00.0: irq 94 for MSI/MSI-X [ 7.064155] mpt3sas 0000:01:00.0: irq 95 for MSI/MSI-X [ 7.064176] mpt3sas 0000:01:00.0: irq 96 for MSI/MSI-X [ 7.064196] mpt3sas 0000:01:00.0: irq 97 for MSI/MSI-X [ 7.064214] mpt3sas 0000:01:00.0: irq 98 for MSI/MSI-X [ 7.064233] mpt3sas 0000:01:00.0: irq 99 for MSI/MSI-X [ 7.064252] mpt3sas 0000:01:00.0: irq 100 for MSI/MSI-X [ 7.064272] mpt3sas 0000:01:00.0: irq 101 for MSI/MSI-X [ 7.064292] mpt3sas 0000:01:00.0: irq 102 for MSI/MSI-X [ 7.064312] mpt3sas 0000:01:00.0: irq 103 for MSI/MSI-X [ 7.064338] mpt3sas 0000:01:00.0: irq 104 for MSI/MSI-X [ 7.064357] mpt3sas 0000:01:00.0: irq 105 for MSI/MSI-X [ 7.064375] mpt3sas 0000:01:00.0: irq 106 for MSI/MSI-X [ 7.064394] mpt3sas 0000:01:00.0: irq 107 for MSI/MSI-X [ 7.064413] mpt3sas 0000:01:00.0: irq 108 for MSI/MSI-X [ 7.064432] mpt3sas 0000:01:00.0: irq 109 for MSI/MSI-X [ 7.064451] mpt3sas 0000:01:00.0: irq 110 for MSI/MSI-X [ 7.064470] mpt3sas 0000:01:00.0: irq 111 for MSI/MSI-X [ 7.064488] mpt3sas 0000:01:00.0: irq 112 for MSI/MSI-X [ 7.064506] mpt3sas 0000:01:00.0: irq 113 for MSI/MSI-X [ 7.064526] mpt3sas 0000:01:00.0: irq 114 for MSI/MSI-X [ 7.064545] mpt3sas 0000:01:00.0: irq 115 for MSI/MSI-X [ 7.065118] mpt3sas0-msix0: PCI-MSI-X enabled: IRQ 68 [ 7.065119] mpt3sas0-msix1: PCI-MSI-X enabled: IRQ 69 [ 7.065119] mpt3sas0-msix2: PCI-MSI-X enabled: IRQ 70 [ 7.065120] mpt3sas0-msix3: PCI-MSI-X enabled: IRQ 71 [ 7.065121] mpt3sas0-msix4: PCI-MSI-X enabled: IRQ 72 [ 7.065122] mpt3sas0-msix5: PCI-MSI-X enabled: IRQ 73 [ 7.065123] mpt3sas0-msix6: PCI-MSI-X enabled: IRQ 74 [ 7.065123] mpt3sas0-msix7: PCI-MSI-X enabled: IRQ 75 [ 7.065124] mpt3sas0-msix8: PCI-MSI-X enabled: IRQ 76 [ 7.065124] mpt3sas0-msix9: PCI-MSI-X enabled: IRQ 77 [ 7.065125] mpt3sas0-msix10: PCI-MSI-X enabled: IRQ 78 [ 7.065126] mpt3sas0-msix11: PCI-MSI-X enabled: IRQ 79 [ 7.065126] mpt3sas0-msix12: PCI-MSI-X enabled: IRQ 80 [ 7.065127] mpt3sas0-msix13: PCI-MSI-X enabled: IRQ 81 [ 7.065128] mpt3sas0-msix14: PCI-MSI-X enabled: IRQ 82 [ 7.065128] mpt3sas0-msix15: PCI-MSI-X enabled: IRQ 83 [ 7.065129] mpt3sas0-msix16: PCI-MSI-X enabled: IRQ 84 [ 7.065129] mpt3sas0-msix17: PCI-MSI-X enabled: IRQ 85 [ 7.065130] mpt3sas0-msix18: PCI-MSI-X enabled: IRQ 86 [ 7.065130] mpt3sas0-msix19: PCI-MSI-X enabled: IRQ 87 [ 7.065131] mpt3sas0-msix20: PCI-MSI-X enabled: IRQ 88 [ 7.065132] mpt3sas0-msix21: PCI-MSI-X enabled: IRQ 89 [ 7.065132] mpt3sas0-msix22: PCI-MSI-X enabled: IRQ 90 [ 7.065133] mpt3sas0-msix23: PCI-MSI-X enabled: IRQ 91 [ 7.065133] mpt3sas0-msix24: PCI-MSI-X enabled: IRQ 92 [ 7.065134] mpt3sas0-msix25: PCI-MSI-X enabled: IRQ 93 [ 7.065135] mpt3sas0-msix26: PCI-MSI-X enabled: IRQ 94 [ 7.065135] mpt3sas0-msix27: PCI-MSI-X enabled: IRQ 95 [ 7.065136] mpt3sas0-msix28: PCI-MSI-X enabled: IRQ 96 [ 7.065137] mpt3sas0-msix29: PCI-MSI-X enabled: IRQ 97 [ 7.065137] mpt3sas0-msix30: PCI-MSI-X enabled: IRQ 98 [ 7.065138] mpt3sas0-msix31: PCI-MSI-X enabled: IRQ 99 [ 7.065139] mpt3sas0-msix32: PCI-MSI-X enabled: IRQ 100 [ 7.065139] mpt3sas0-msix33: PCI-MSI-X enabled: IRQ 101 [ 7.065140] mpt3sas0-msix34: PCI-MSI-X enabled: IRQ 102 [ 7.065140] mpt3sas0-msix35: PCI-MSI-X enabled: IRQ 103 [ 7.065141] mpt3sas0-msix36: PCI-MSI-X enabled: IRQ 104 [ 7.065141] mpt3sas0-msix37: PCI-MSI-X enabled: IRQ 105 [ 7.065142] mpt3sas0-msix38: PCI-MSI-X enabled: IRQ 106 [ 7.065143] mpt3sas0-msix39: PCI-MSI-X enabled: IRQ 107 [ 7.065143] mpt3sas0-msix40: PCI-MSI-X enabled: IRQ 108 [ 7.065144] mpt3sas0-msix41: PCI-MSI-X enabled: IRQ 109 [ 7.065144] mpt3sas0-msix42: PCI-MSI-X enabled: IRQ 110 [ 7.065145] mpt3sas0-msix43: PCI-MSI-X enabled: IRQ 111 [ 7.065146] mpt3sas0-msix44: PCI-MSI-X enabled: IRQ 112 [ 7.065146] mpt3sas0-msix45: PCI-MSI-X enabled: IRQ 113 [ 7.065147] mpt3sas0-msix46: PCI-MSI-X enabled: IRQ 114 [ 7.065147] mpt3sas0-msix47: PCI-MSI-X enabled: IRQ 115 [ 7.065149] mpt3sas_cm0: iomem(0x00000000e1000000), mapped(0xffffb5255a000000), size(1048576) [ 7.065150] mpt3sas_cm0: ioport(0x0000000000001000), size(256) [ 7.083595] mpt3sas_cm0: IOC Number : 0 [ 7.083597] mpt3sas_cm0: CurrentHostPageSize is 0: Setting default host page size to 4k [ 7.190952] libata version 3.00 loaded. [ 7.191270] megasas: 07.705.02.00-rh1 [ 7.191581] megaraid_sas 0000:c1:00.0: FW now in Ready state [ 7.191585] megaraid_sas 0000:c1:00.0: 64 bit DMA mask and 32 bit consistent mask [ 7.191912] megaraid_sas 0000:c1:00.0: irq 117 for MSI/MSI-X [ 7.191938] megaraid_sas 0000:c1:00.0: irq 118 for MSI/MSI-X [ 7.191963] megaraid_sas 0000:c1:00.0: irq 119 for MSI/MSI-X [ 7.191988] megaraid_sas 0000:c1:00.0: irq 120 for MSI/MSI-X [ 7.192013] megaraid_sas 0000:c1:00.0: irq 121 for MSI/MSI-X [ 7.192037] megaraid_sas 0000:c1:00.0: irq 122 for MSI/MSI-X [ 7.192062] megaraid_sas 0000:c1:00.0: irq 123 for MSI/MSI-X [ 7.192087] megaraid_sas 0000:c1:00.0: irq 124 for MSI/MSI-X [ 7.192113] megaraid_sas 0000:c1:00.0: irq 125 for MSI/MSI-X [ 7.192136] megaraid_sas 0000:c1:00.0: irq 126 for MSI/MSI-X [ 7.192159] megaraid_sas 0000:c1:00.0: irq 127 for MSI/MSI-X [ 7.192183] megaraid_sas 0000:c1:00.0: irq 128 for MSI/MSI-X [ 7.192212] megaraid_sas 0000:c1:00.0: irq 129 for MSI/MSI-X [ 7.192237] megaraid_sas 0000:c1:00.0: irq 130 for MSI/MSI-X [ 7.192262] megaraid_sas 0000:c1:00.0: irq 131 for MSI/MSI-X [ 7.192286] megaraid_sas 0000:c1:00.0: irq 132 for MSI/MSI-X [ 7.192308] megaraid_sas 0000:c1:00.0: irq 133 for MSI/MSI-X [ 7.192335] megaraid_sas 0000:c1:00.0: irq 134 for MSI/MSI-X [ 7.192358] megaraid_sas 0000:c1:00.0: irq 135 for MSI/MSI-X [ 7.192385] megaraid_sas 0000:c1:00.0: irq 136 for MSI/MSI-X [ 7.192408] megaraid_sas 0000:c1:00.0: irq 137 for MSI/MSI-X [ 7.192433] megaraid_sas 0000:c1:00.0: irq 138 for MSI/MSI-X [ 7.192456] megaraid_sas 0000:c1:00.0: irq 139 for MSI/MSI-X [ 7.192479] megaraid_sas 0000:c1:00.0: irq 140 for MSI/MSI-X [ 7.192508] megaraid_sas 0000:c1:00.0: irq 141 for MSI/MSI-X [ 7.192532] megaraid_sas 0000:c1:00.0: irq 142 for MSI/MSI-X [ 7.192557] megaraid_sas 0000:c1:00.0: irq 143 for MSI/MSI-X [ 7.192582] megaraid_sas 0000:c1:00.0: irq 144 for MSI/MSI-X [ 7.192606] megaraid_sas 0000:c1:00.0: irq 145 for MSI/MSI-X [ 7.192630] megaraid_sas 0000:c1:00.0: irq 146 for MSI/MSI-X [ 7.192653] megaraid_sas 0000:c1:00.0: irq 147 for MSI/MSI-X [ 7.192676] megaraid_sas 0000:c1:00.0: irq 148 for MSI/MSI-X [ 7.192702] megaraid_sas 0000:c1:00.0: irq 149 for MSI/MSI-X [ 7.192726] megaraid_sas 0000:c1:00.0: irq 150 for MSI/MSI-X [ 7.192750] megaraid_sas 0000:c1:00.0: irq 151 for MSI/MSI-X [ 7.192773] megaraid_sas 0000:c1:00.0: irq 152 for MSI/MSI-X [ 7.192800] megaraid_sas 0000:c1:00.0: irq 153 for MSI/MSI-X [ 7.192822] megaraid_sas 0000:c1:00.0: irq 154 for MSI/MSI-X [ 7.192848] megaraid_sas 0000:c1:00.0: irq 155 for MSI/MSI-X [ 7.192870] megaraid_sas 0000:c1:00.0: irq 156 for MSI/MSI-X [ 7.192893] megaraid_sas 0000:c1:00.0: irq 157 for MSI/MSI-X [ 7.192915] megaraid_sas 0000:c1:00.0: irq 158 for MSI/MSI-X [ 7.192937] megaraid_sas 0000:c1:00.0: irq 159 for MSI/MSI-X [ 7.192959] megaraid_sas 0000:c1:00.0: irq 160 for MSI/MSI-X [ 7.192981] megaraid_sas 0000:c1:00.0: irq 161 for MSI/MSI-X [ 7.193003] megaraid_sas 0000:c1:00.0: irq 162 for MSI/MSI-X [ 7.193027] megaraid_sas 0000:c1:00.0: irq 163 for MSI/MSI-X [ 7.193049] megaraid_sas 0000:c1:00.0: irq 164 for MSI/MSI-X [ 7.193180] megaraid_sas 0000:c1:00.0: firmware supports msix : (96) [ 7.193182] megaraid_sas 0000:c1:00.0: current msix/online cpus : (48/48) [ 7.193183] megaraid_sas 0000:c1:00.0: RDPQ mode : (disabled) [ 7.193186] megaraid_sas 0000:c1:00.0: Current firmware supports maximum commands: 928 LDIO threshold: 237 [ 7.193544] megaraid_sas 0000:c1:00.0: Configured max firmware commands: 927 [ 7.196269] megaraid_sas 0000:c1:00.0: FW supports sync cache : No [ 7.288635] mpt3sas_cm0: Allocated physical memory: size(38831 kB) [ 7.288637] mpt3sas_cm0: Current Controller Queue Depth(7564), Max Controller Queue Depth(7680) [ 7.288638] mpt3sas_cm0: Scatter Gather Elements per IO(128) [ 7.363349] usb 3-1.1: new high-speed USB device number 3 using xhci_hcd [ 7.408196] mpt3sas_cm0: FW Package Version(08.00.00.00) [ 7.408478] mpt3sas_cm0: SAS3616: FWVersion(08.00.00.00), ChipRevision(0x02), BiosVersion(00.00.00.00) [ 7.408483] mpt3sas_cm0: Protocol=(Initiator,Target,NVMe), Capabilities=(TLR,EEDP,Diag Trace Buffer,Task Set Full,NCQ) [ 7.408564] mpt3sas_cm0: : host protection capabilities enabled DIF1 DIF2 DIF3 [ 7.408577] scsi host0: Fusion MPT SAS Host [ 7.408857] mpt3sas_cm0: sending port enable !! [ 7.437364] usb 3-1.1: New USB device found, idVendor=1604, idProduct=10c0 [ 7.437366] usb 3-1.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 7.438041] Request for unknown module key 'Mellanox Technologies signing key: 61feb074fc7292f958419386ffdd9d5ca999e403' err -11 [ 7.455516] hub 3-1.1:1.0: USB hub found [ 7.455859] hub 3-1.1:1.0: 4 ports detected [ 7.514584] Compat-mlnx-ofed backport release: b4fdfac [ 7.514585] Backport based on mlnx_ofed/mlnx-ofa_kernel-4.0.git b4fdfac [ 7.514585] compat.git: mlnx_ofed/mlnx-ofa_kernel-4.0.git [ 7.519329] usb 3-1.4: new high-speed USB device number 4 using xhci_hcd [ 7.554330] megaraid_sas 0000:c1:00.0: Init cmd return status SUCCESS for SCSI host 1 [ 7.567303] Request for unknown module key 'Mellanox Technologies signing key: 61feb074fc7292f958419386ffdd9d5ca999e403' err -11 [ 7.575329] megaraid_sas 0000:c1:00.0: firmware type : Legacy(64 VD) firmware [ 7.575330] megaraid_sas 0000:c1:00.0: controller type : iMR(0MB) [ 7.575332] megaraid_sas 0000:c1:00.0: Online Controller Reset(OCR) : Enabled [ 7.575332] megaraid_sas 0000:c1:00.0: Secure JBOD support : No [ 7.575334] megaraid_sas 0000:c1:00.0: NVMe passthru support : No [ 7.593363] usb 3-1.4: New USB device found, idVendor=1604, idProduct=10c0 [ 7.593365] usb 3-1.4: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 7.596836] megaraid_sas 0000:c1:00.0: INIT adapter done [ 7.596838] megaraid_sas 0000:c1:00.0: Jbod map is not supported megasas_setup_jbod_map 5146 [ 7.601265] tg3.c:v3.137 (May 11, 2014) [ 7.602224] Request for unknown module key 'Mellanox Technologies signing key: 61feb074fc7292f958419386ffdd9d5ca999e403' err -11 [ 7.602904] ahci 0000:86:00.2: version 3.0 [ 7.603717] ahci 0000:86:00.2: irq 167 for MSI/MSI-X [ 7.603749] ahci 0000:86:00.2: irq 168 for MSI/MSI-X [ 7.603781] ahci 0000:86:00.2: irq 169 for MSI/MSI-X [ 7.603814] ahci 0000:86:00.2: irq 170 for MSI/MSI-X [ 7.603845] ahci 0000:86:00.2: irq 171 for MSI/MSI-X [ 7.603849] ahci 0000:86:00.2: irq 172 for MSI/MSI-X [ 7.603852] ahci 0000:86:00.2: irq 173 for MSI/MSI-X [ 7.603855] ahci 0000:86:00.2: irq 174 for MSI/MSI-X [ 7.603887] ahci 0000:86:00.2: irq 175 for MSI/MSI-X [ 7.603900] ahci 0000:86:00.2: irq 176 for MSI/MSI-X [ 7.603903] ahci 0000:86:00.2: irq 177 for MSI/MSI-X [ 7.603906] ahci 0000:86:00.2: irq 178 for MSI/MSI-X [ 7.603909] ahci 0000:86:00.2: irq 179 for MSI/MSI-X [ 7.603912] ahci 0000:86:00.2: irq 180 for MSI/MSI-X [ 7.603915] ahci 0000:86:00.2: irq 181 for MSI/MSI-X [ 7.603946] ahci 0000:86:00.2: irq 182 for MSI/MSI-X [ 7.604062] ahci 0000:86:00.2: AHCI 0001.0301 32 slots 1 ports 6 Gbps 0x1 impl SATA mode [ 7.604064] ahci 0000:86:00.2: flags: 64bit ncq sntf ilck pm led clo only pmp fbs pio slum part [ 7.605135] scsi host2: ahci [ 7.605223] ata1: SATA max UDMA/133 abar m4096@0xc0a02000 port 0xc0a02100 irq 167 [ 7.615542] hub 3-1.4:1.0: USB hub found [ 7.615863] hub 3-1.4:1.0: 4 ports detected [ 7.620395] tg3 0000:81:00.0 eth0: Tigon3 [partno(BCM95720) rev 5720000] (PCI Express) MAC address d0:94:66:34:4a:dd [ 7.620398] tg3 0000:81:00.0 eth0: attached PHY is 5720C (10/100/1000Base-T Ethernet) (WireSpeed[1], EEE[1]) [ 7.620399] tg3 0000:81:00.0 eth0: RXcsums[1] LinkChgREG[0] MIirq[0] ASF[1] TSOcap[1] [ 7.620401] tg3 0000:81:00.0 eth0: dma_rwctrl[00000001] dma_mask[64-bit] [ 7.622945] megaraid_sas 0000:c1:00.0: pci id : (0x1000)/(0x005f)/(0x1028)/(0x1f4b) [ 7.622947] megaraid_sas 0000:c1:00.0: unevenspan support : yes [ 7.622948] megaraid_sas 0000:c1:00.0: firmware crash dump : no [ 7.622949] megaraid_sas 0000:c1:00.0: jbod sync map : no [ 7.622953] scsi host1: Avago SAS based MegaRAID driver [ 7.639314] tg3 0000:81:00.1 eth1: Tigon3 [partno(BCM95720) rev 5720000] (PCI Express) MAC address d0:94:66:34:4a:de [ 7.639316] tg3 0000:81:00.1 eth1: attached PHY is 5720C (10/100/1000Base-T Ethernet) (WireSpeed[1], EEE[1]) [ 7.639317] tg3 0000:81:00.1 eth1: RXcsums[1] LinkChgREG[0] MIirq[0] ASF[1] TSOcap[1] [ 7.639318] tg3 0000:81:00.1 eth1: dma_rwctrl[00000001] dma_mask[64-bit] [ 7.642300] scsi 1:2:0:0: Direct-Access DELL PERC H330 Mini 4.29 PQ: 0 ANSI: 5 [ 7.645227] mlx5_core 0000:84:00.0: firmware version: 12.24.1000 [ 7.645298] mlx5_core 0000:84:00.0: 126.016 Gb/s available PCIe bandwidth (8 GT/s x16 link) [ 7.912342] ata1: SATA link down (SStatus 0 SControl 300) [ 9.425695] mpt3sas_cm0: hba_port entry: ffff9e8af54030c0, port: 255 is added to hba_port list [ 9.436272] mpt3sas_cm0: host_add: handle(0x0001), sas_addr(0x500605b00db90e60), phys(17) [ 9.444774] mpt3sas_cm0: detecting: handle(0x0011), sas_address(0x510600b00db90e60), phy(16) [ 9.453216] mpt3sas_cm0: REPORT_LUNS: handle(0x0011), retries(0) [ 9.459248] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0011), lun(0) [ 9.465700] scsi 0:0:0:0: Enclosure LSI virtualSES 02 PQ: 0 ANSI: 6 [ 9.473825] scsi 0:0:0:0: set ignore_delay_remove for handle(0x0011) [ 9.480179] scsi 0:0:0:0: SES: handle(0x0011), sas_addr(0x510600b00db90e60), phy(16), device_name(0x510600b00db90e60) [ 9.490778] scsi 0:0:0:0: enclosure logical id(0x500605b00db90e60), slot(16) [ 9.497910] scsi 0:0:0:0: enclosure level(0x0000), connector name( C2 ) [ 9.504629] scsi 0:0:0:0: serial_number(500605B00DB90E60) [ 9.510027] scsi 0:0:0:0: qdepth(1), tagged(0), simple(0), ordered(0), scsi_level(7), cmd_que(0) [ 9.518837] mpt3sas_cm0: log_info(0x31200206): originator(PL), code(0x20), sub_code(0x0206) [ 9.651890] mlx5_core 0000:84:00.0: irq 185 for MSI/MSI-X [ 9.651914] mlx5_core 0000:84:00.0: irq 186 for MSI/MSI-X [ 9.651934] mlx5_core 0000:84:00.0: irq 187 for MSI/MSI-X [ 9.651952] mlx5_core 0000:84:00.0: irq 188 for MSI/MSI-X [ 9.651972] mlx5_core 0000:84:00.0: irq 189 for MSI/MSI-X [ 9.651991] mlx5_core 0000:84:00.0: irq 190 for MSI/MSI-X [ 9.652011] mlx5_core 0000:84:00.0: irq 191 for MSI/MSI-X [ 9.652039] mlx5_core 0000:84:00.0: irq 192 for MSI/MSI-X [ 9.652058] mlx5_core 0000:84:00.0: irq 193 for MSI/MSI-X [ 9.652076] mlx5_core 0000:84:00.0: irq 194 for MSI/MSI-X [ 9.652094] mlx5_core 0000:84:00.0: irq 195 for MSI/MSI-X [ 9.652112] mlx5_core 0000:84:00.0: irq 196 for MSI/MSI-X [ 9.652129] mlx5_core 0000:84:00.0: irq 197 for MSI/MSI-X [ 9.652148] mlx5_core 0000:84:00.0: irq 198 for MSI/MSI-X [ 9.652167] mlx5_core 0000:84:00.0: irq 199 for MSI/MSI-X [ 9.652186] mlx5_core 0000:84:00.0: irq 200 for MSI/MSI-X [ 9.652205] mlx5_core 0000:84:00.0: irq 201 for MSI/MSI-X [ 9.652225] mlx5_core 0000:84:00.0: irq 202 for MSI/MSI-X [ 9.652243] mlx5_core 0000:84:00.0: irq 203 for MSI/MSI-X [ 9.652261] mlx5_core 0000:84:00.0: irq 204 for MSI/MSI-X [ 9.652280] mlx5_core 0000:84:00.0: irq 205 for MSI/MSI-X [ 9.652298] mlx5_core 0000:84:00.0: irq 206 for MSI/MSI-X [ 9.652317] mlx5_core 0000:84:00.0: irq 207 for MSI/MSI-X [ 9.652353] mlx5_core 0000:84:00.0: irq 208 for MSI/MSI-X [ 9.652371] mlx5_core 0000:84:00.0: irq 209 for MSI/MSI-X [ 9.652389] mlx5_core 0000:84:00.0: irq 210 for MSI/MSI-X [ 9.652408] mlx5_core 0000:84:00.0: irq 211 for MSI/MSI-X [ 9.652426] mlx5_core 0000:84:00.0: irq 212 for MSI/MSI-X [ 9.652445] mlx5_core 0000:84:00.0: irq 213 for MSI/MSI-X [ 9.652467] mlx5_core 0000:84:00.0: irq 214 for MSI/MSI-X [ 9.652488] mlx5_core 0000:84:00.0: irq 215 for MSI/MSI-X [ 9.652507] mlx5_core 0000:84:00.0: irq 216 for MSI/MSI-X [ 9.652526] mlx5_core 0000:84:00.0: irq 217 for MSI/MSI-X [ 9.652550] mlx5_core 0000:84:00.0: irq 218 for MSI/MSI-X [ 9.652570] mlx5_core 0000:84:00.0: irq 219 for MSI/MSI-X [ 9.652589] mlx5_core 0000:84:00.0: irq 220 for MSI/MSI-X [ 9.652607] mlx5_core 0000:84:00.0: irq 221 for MSI/MSI-X [ 9.652628] mlx5_core 0000:84:00.0: irq 222 for MSI/MSI-X [ 9.652647] mlx5_core 0000:84:00.0: irq 223 for MSI/MSI-X [ 9.652666] mlx5_core 0000:84:00.0: irq 224 for MSI/MSI-X [ 9.652684] mlx5_core 0000:84:00.0: irq 225 for MSI/MSI-X [ 9.652701] mlx5_core 0000:84:00.0: irq 226 for MSI/MSI-X [ 9.652719] mlx5_core 0000:84:00.0: irq 227 for MSI/MSI-X [ 9.652737] mlx5_core 0000:84:00.0: irq 228 for MSI/MSI-X [ 9.652756] mlx5_core 0000:84:00.0: irq 229 for MSI/MSI-X [ 9.652776] mlx5_core 0000:84:00.0: irq 230 for MSI/MSI-X [ 9.652794] mlx5_core 0000:84:00.0: irq 231 for MSI/MSI-X [ 9.652813] mlx5_core 0000:84:00.0: irq 232 for MSI/MSI-X [ 9.652832] mlx5_core 0000:84:00.0: irq 233 for MSI/MSI-X [ 9.652849] mlx5_core 0000:84:00.0: irq 234 for MSI/MSI-X [ 9.652868] mlx5_core 0000:84:00.0: irq 235 for MSI/MSI-X [ 9.652887] mlx5_core 0000:84:00.0: irq 236 for MSI/MSI-X [ 9.655436] mlx5_core 0000:84:00.0: Port module event: module 0, Cable plugged [ 9.680133] mpt3sas_cm0: expander_add: handle(0x0012), parent(0x0009), sas_addr(0x5001636001a42f3f), phys(79) [ 9.809442] mpt3sas_cm0: detecting: handle(0x0013), sas_address(0x5000c50095431a15), phy(0) [ 9.817851] mpt3sas_cm0: REPORT_LUNS: handle(0x0013), retries(0) [ 9.824200] mlx5_core 0000:84:00.0: FW Tracer Owner [ 9.830298] Request for unknown module key 'Mellanox Technologies signing key: 61feb074fc7292f958419386ffdd9d5ca999e403' err -11 [ 9.831368] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0013), lun(0) [ 9.832667] scsi 0:0:1:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 9.833037] scsi 0:0:1:0: SSP: handle(0x0013), sas_addr(0x5000c50095431a15), phy(0), device_name(0x5000c50095431a14) [ 9.833039] scsi 0:0:1:0: enclosure logical id(0x5001636001a42f3d), slot(0) [ 9.833041] scsi 0:0:1:0: enclosure level(0x0000), connector name( C1 ) [ 9.833042] scsi 0:0:1:0: serial_number(ZA1AGH620000R829D5X1) [ 9.833044] scsi 0:0:1:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 9.901851] Request for unknown module key 'Mellanox Technologies signing key: 61feb074fc7292f958419386ffdd9d5ca999e403' err -11 [ 9.915322] Request for unknown module key 'Mellanox Technologies signing key: 61feb074fc7292f958419386ffdd9d5ca999e403' err -11 [ 9.929919] mlx5_ib: Mellanox Connect-IB Infiniband driver v4.5-1.0.1 [ 9.936373] mlx5_ib: Mellanox Connect-IB Infiniband driver v4.5-1.0.1 [ 9.951810] mpt3sas_cm0: detecting: handle(0x0014), sas_address(0x5000c50095431051), phy(1) [ 9.960182] mpt3sas_cm0: REPORT_LUNS: handle(0x0014), retries(0) [ 9.981768] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0014), lun(0) [ 9.989004] scsi 0:0:2:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 9.997490] scsi 0:0:2:0: SSP: handle(0x0014), sas_addr(0x5000c50095431051), phy(1), device_name(0x5000c50095431050) [ 10.008007] scsi 0:0:2:0: enclosure logical id(0x5001636001a42f3d), slot(1) [ 10.015052] scsi 0:0:2:0: enclosure level(0x0000), connector name( C1 ) [ 10.021773] scsi 0:0:2:0: serial_number(ZA1AGHHR0000R8301TBN) [ 10.027521] scsi 0:0:2:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 10.050791] mpt3sas_cm0: detecting: handle(0x0015), sas_address(0x5000c500954309c1), phy(2) [ 10.059148] mpt3sas_cm0: REPORT_LUNS: handle(0x0015), retries(0) [ 10.065737] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0015), lun(0) [ 10.150300] random: crng init done [ 10.327548] scsi 0:0:3:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 10.336158] scsi 0:0:3:0: SSP: handle(0x0015), sas_addr(0x5000c500954309c1), phy(2), device_name(0x5000c500954309c0) [ 10.346669] scsi 0:0:3:0: enclosure logical id(0x5001636001a42f3d), slot(2) [ 10.353714] scsi 0:0:3:0: enclosure level(0x0000), connector name( C1 ) [ 10.360421] scsi 0:0:3:0: serial_number(ZA1AG3BT0000C83152KW) [ 10.366172] scsi 0:0:3:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 10.388792] mpt3sas_cm0: detecting: handle(0x0016), sas_address(0x5000c500954328a5), phy(3) [ 10.397141] mpt3sas_cm0: REPORT_LUNS: handle(0x0016), retries(0) [ 10.403751] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0016), lun(0) [ 10.664557] scsi 0:0:4:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 10.673147] scsi 0:0:4:0: SSP: handle(0x0016), sas_addr(0x5000c500954328a5), phy(3), device_name(0x5000c500954328a4) [ 10.683657] scsi 0:0:4:0: enclosure logical id(0x5001636001a42f3d), slot(3) [ 10.690705] scsi 0:0:4:0: enclosure level(0x0000), connector name( C1 ) [ 10.697408] scsi 0:0:4:0: serial_number(ZA1AGGN20000C8316FRL) [ 10.703160] scsi 0:0:4:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 10.725790] mpt3sas_cm0: detecting: handle(0x0017), sas_address(0x5000c50095432ab1), phy(4) [ 10.734139] mpt3sas_cm0: REPORT_LUNS: handle(0x0017), retries(0) [ 10.744955] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0017), lun(0) [ 10.752172] scsi 0:0:5:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 10.760665] scsi 0:0:5:0: SSP: handle(0x0017), sas_addr(0x5000c50095432ab1), phy(4), device_name(0x5000c50095432ab0) [ 10.771174] scsi 0:0:5:0: enclosure logical id(0x5001636001a42f3d), slot(4) [ 10.778221] scsi 0:0:5:0: enclosure level(0x0000), connector name( C1 ) [ 10.784940] scsi 0:0:5:0: serial_number(ZA1AGGK30000R82896AK) [ 10.790687] scsi 0:0:5:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 10.813790] mpt3sas_cm0: detecting: handle(0x0018), sas_address(0x5000c50095431cf1), phy(5) [ 10.822139] mpt3sas_cm0: REPORT_LUNS: handle(0x0018), retries(0) [ 10.836120] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0018), lun(0) [ 10.843312] scsi 0:0:6:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 10.851805] scsi 0:0:6:0: SSP: handle(0x0018), sas_addr(0x5000c50095431cf1), phy(5), device_name(0x5000c50095431cf0) [ 10.862322] scsi 0:0:6:0: enclosure logical id(0x5001636001a42f3d), slot(5) [ 10.869368] scsi 0:0:6:0: enclosure level(0x0000), connector name( C1 ) [ 10.876087] scsi 0:0:6:0: serial_number(ZA1AGH2M0000R727YQVD) [ 10.881833] scsi 0:0:6:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 10.908790] mpt3sas_cm0: detecting: handle(0x0019), sas_address(0x5000c5009542ec99), phy(6) [ 10.917148] mpt3sas_cm0: REPORT_LUNS: handle(0x0019), retries(0) [ 10.923705] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0019), lun(0) [ 11.184224] scsi 0:0:7:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 11.192812] scsi 0:0:7:0: SSP: handle(0x0019), sas_addr(0x5000c5009542ec99), phy(6), device_name(0x5000c5009542ec98) [ 11.203323] scsi 0:0:7:0: enclosure logical id(0x5001636001a42f3d), slot(6) [ 11.210370] scsi 0:0:7:0: enclosure level(0x0000), connector name( C1 ) [ 11.217074] scsi 0:0:7:0: serial_number(ZA1AG9AP0000R830X69R) [ 11.222826] scsi 0:0:7:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 11.245794] mpt3sas_cm0: detecting: handle(0x001a), sas_address(0x5000c5009542a9f1), phy(7) [ 11.254142] mpt3sas_cm0: REPORT_LUNS: handle(0x001a), retries(0) [ 11.260724] mpt3sas_cm0: TEST_UNIT_READY: handle(0x001a), lun(0) [ 11.519984] scsi 0:0:8:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 11.528593] scsi 0:0:8:0: SSP: handle(0x001a), sas_addr(0x5000c5009542a9f1), phy(7), device_name(0x5000c5009542a9f0) [ 11.539107] scsi 0:0:8:0: enclosure logical id(0x5001636001a42f3d), slot(7) [ 11.546154] scsi 0:0:8:0: enclosure level(0x0000), connector name( C1 ) [ 11.552858] scsi 0:0:8:0: serial_number(ZA1AG6DJ0000R829CTX7) [ 11.558605] scsi 0:0:8:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 11.584800] mpt3sas_cm0: detecting: handle(0x001b), sas_address(0x5000c50095430c61), phy(8) [ 11.593149] mpt3sas_cm0: REPORT_LUNS: handle(0x001b), retries(0) [ 11.613307] mpt3sas_cm0: TEST_UNIT_READY: handle(0x001b), lun(0) [ 11.620502] scsi 0:0:9:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 11.629019] scsi 0:0:9:0: SSP: handle(0x001b), sas_addr(0x5000c50095430c61), phy(8), device_name(0x5000c50095430c60) [ 11.639528] scsi 0:0:9:0: enclosure logical id(0x5001636001a42f3d), slot(8) [ 11.646575] scsi 0:0:9:0: enclosure level(0x0000), connector name( C1 ) [ 11.653296] scsi 0:0:9:0: serial_number(ZA1AG8D20000R8301QWA) [ 11.659040] scsi 0:0:9:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 11.681799] mpt3sas_cm0: detecting: handle(0x001c), sas_address(0x5000c50095430cf9), phy(9) [ 11.690147] mpt3sas_cm0: REPORT_LUNS: handle(0x001c), retries(0) [ 11.711230] mpt3sas_cm0: TEST_UNIT_READY: handle(0x001c), lun(0) [ 11.721751] scsi 0:0:10:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 11.745774] scsi 0:0:10:0: SSP: handle(0x001c), sas_addr(0x5000c50095430cf9), phy(9), device_name(0x5000c50095430cf8) [ 11.756375] scsi 0:0:10:0: enclosure logical id(0x5001636001a42f3d), slot(9) [ 11.763507] scsi 0:0:10:0: enclosure level(0x0000), connector name( C1 ) [ 11.770312] scsi 0:0:10:0: serial_number(ZA1AG8CX0000R8301BUW) [ 11.776145] scsi 0:0:10:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 11.823418] mpt3sas_cm0: detecting: handle(0x001d), sas_address(0x5000c5009542af15), phy(10) [ 11.831858] mpt3sas_cm0: REPORT_LUNS: handle(0x001d), retries(0) [ 11.838418] mpt3sas_cm0: TEST_UNIT_READY: handle(0x001d), lun(0) [ 12.094063] scsi 0:0:11:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 12.102748] scsi 0:0:11:0: SSP: handle(0x001d), sas_addr(0x5000c5009542af15), phy(10), device_name(0x5000c5009542af14) [ 12.113435] scsi 0:0:11:0: enclosure logical id(0x5001636001a42f3d), slot(10) [ 12.120655] scsi 0:0:11:0: enclosure level(0x0000), connector name( C1 ) [ 12.127444] scsi 0:0:11:0: serial_number(ZA1AGB820000R826HE40) [ 12.133276] scsi 0:0:11:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 12.155800] mpt3sas_cm0: detecting: handle(0x001e), sas_address(0x5000c500954307c1), phy(11) [ 12.164235] mpt3sas_cm0: REPORT_LUNS: handle(0x001e), retries(0) [ 12.170808] mpt3sas_cm0: TEST_UNIT_READY: handle(0x001e), lun(0) [ 12.475400] scsi 0:0:12:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 12.484086] scsi 0:0:12:0: SSP: handle(0x001e), sas_addr(0x5000c500954307c1), phy(11), device_name(0x5000c500954307c0) [ 12.494772] scsi 0:0:12:0: enclosure logical id(0x5001636001a42f3d), slot(11) [ 12.501990] scsi 0:0:12:0: enclosure level(0x0000), connector name( C1 ) [ 12.508781] scsi 0:0:12:0: serial_number(ZA1AG8HP0000R8301BEL) [ 12.514612] scsi 0:0:12:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 12.537804] mpt3sas_cm0: detecting: handle(0x001f), sas_address(0x5000c50095432ab9), phy(12) [ 12.546242] mpt3sas_cm0: REPORT_LUNS: handle(0x001f), retries(0) [ 12.560525] mpt3sas_cm0: TEST_UNIT_READY: handle(0x001f), lun(0) [ 12.567727] scsi 0:0:13:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 12.576301] scsi 0:0:13:0: SSP: handle(0x001f), sas_addr(0x5000c50095432ab9), phy(12), device_name(0x5000c50095432ab8) [ 12.586985] scsi 0:0:13:0: enclosure logical id(0x5001636001a42f3d), slot(12) [ 12.594206] scsi 0:0:13:0: enclosure level(0x0000), connector name( C1 ) [ 12.601010] scsi 0:0:13:0: serial_number(ZA1AGGK10000C831535S) [ 12.606844] scsi 0:0:13:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 12.629801] mpt3sas_cm0: detecting: handle(0x0020), sas_address(0x5000c50095432995), phy(13) [ 12.638236] mpt3sas_cm0: REPORT_LUNS: handle(0x0020), retries(0) [ 12.652649] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0020), lun(0) [ 12.659839] scsi 0:0:14:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 12.668415] scsi 0:0:14:0: SSP: handle(0x0020), sas_addr(0x5000c50095432995), phy(13), device_name(0x5000c50095432994) [ 12.679103] scsi 0:0:14:0: enclosure logical id(0x5001636001a42f3d), slot(13) [ 12.686323] scsi 0:0:14:0: enclosure level(0x0000), connector name( C1 ) [ 12.693131] scsi 0:0:14:0: serial_number(ZA1AGGM70000C831532T) [ 12.698963] scsi 0:0:14:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 12.722808] mpt3sas_cm0: detecting: handle(0x0021), sas_address(0x5000c50095430539), phy(14) [ 12.731249] mpt3sas_cm0: REPORT_LUNS: handle(0x0021), retries(0) [ 12.737821] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0021), lun(0) [ 12.999048] scsi 0:0:15:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 13.007734] scsi 0:0:15:0: SSP: handle(0x0021), sas_addr(0x5000c50095430539), phy(14), device_name(0x5000c50095430538) [ 13.018425] scsi 0:0:15:0: enclosure logical id(0x5001636001a42f3d), slot(14) [ 13.025642] scsi 0:0:15:0: enclosure level(0x0000), connector name( C1 ) [ 13.032435] scsi 0:0:15:0: serial_number(ZA1AG3GS0000R824UT1A) [ 13.038278] scsi 0:0:15:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 13.060804] mpt3sas_cm0: detecting: handle(0x0022), sas_address(0x5000c500954311f5), phy(15) [ 13.069242] mpt3sas_cm0: REPORT_LUNS: handle(0x0022), retries(0) [ 13.075813] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0022), lun(0) [ 13.333151] scsi 0:0:16:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 13.341823] scsi 0:0:16:0: SSP: handle(0x0022), sas_addr(0x5000c500954311f5), phy(15), device_name(0x5000c500954311f4) [ 13.352509] scsi 0:0:16:0: enclosure logical id(0x5001636001a42f3d), slot(15) [ 13.359728] scsi 0:0:16:0: enclosure level(0x0000), connector name( C1 ) [ 13.366518] scsi 0:0:16:0: serial_number(ZA1AGHF80000C8316HCJ) [ 13.372349] scsi 0:0:16:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 13.395806] mpt3sas_cm0: detecting: handle(0x0023), sas_address(0x5000c5009542f249), phy(16) [ 13.404248] mpt3sas_cm0: REPORT_LUNS: handle(0x0023), retries(0) [ 13.410741] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0023), lun(0) [ 13.417922] scsi 0:0:17:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 13.426508] scsi 0:0:17:0: SSP: handle(0x0023), sas_addr(0x5000c5009542f249), phy(16), device_name(0x5000c5009542f248) [ 13.437194] scsi 0:0:17:0: enclosure logical id(0x5001636001a42f3d), slot(16) [ 13.444410] scsi 0:0:17:0: enclosure level(0x0000), connector name( C1 ) [ 13.451218] scsi 0:0:17:0: serial_number(ZA1AGAVT0000R830XCAJ) [ 13.457052] scsi 0:0:17:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 13.480808] mpt3sas_cm0: detecting: handle(0x0024), sas_address(0x5000c50095432695), phy(17) [ 13.489242] mpt3sas_cm0: REPORT_LUNS: handle(0x0024), retries(0) [ 13.512675] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0024), lun(0) [ 13.519862] scsi 0:0:18:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 13.528451] scsi 0:0:18:0: SSP: handle(0x0024), sas_addr(0x5000c50095432695), phy(17), device_name(0x5000c50095432694) [ 13.539140] scsi 0:0:18:0: enclosure logical id(0x5001636001a42f3d), slot(17) [ 13.546358] scsi 0:0:18:0: enclosure level(0x0000), connector name( C1 ) [ 13.553166] scsi 0:0:18:0: serial_number(ZA1AGGVH0000R8300NRT) [ 13.558998] scsi 0:0:18:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 13.589838] mpt3sas_cm0: detecting: handle(0x0025), sas_address(0x5000c500954323f9), phy(18) [ 13.598292] mpt3sas_cm0: REPORT_LUNS: handle(0x0025), retries(0) [ 13.604851] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0025), lun(0) [ 13.861684] scsi 0:0:19:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 13.870371] scsi 0:0:19:0: SSP: handle(0x0025), sas_addr(0x5000c500954323f9), phy(18), device_name(0x5000c500954323f8) [ 13.881059] scsi 0:0:19:0: enclosure logical id(0x5001636001a42f3d), slot(18) [ 13.888279] scsi 0:0:19:0: enclosure level(0x0000), connector name( C1 ) [ 13.895073] scsi 0:0:19:0: serial_number(ZA1AGMYP0000C8316H53) [ 13.900910] scsi 0:0:19:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 13.926805] mpt3sas_cm0: detecting: handle(0x0026), sas_address(0x5000c50095430d7d), phy(19) [ 13.935256] mpt3sas_cm0: REPORT_LUNS: handle(0x0026), retries(0) [ 13.941807] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0026), lun(0) [ 13.948996] scsi 0:0:20:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 13.957571] scsi 0:0:20:0: SSP: handle(0x0026), sas_addr(0x5000c50095430d7d), phy(19), device_name(0x5000c50095430d7c) [ 13.968256] scsi 0:0:20:0: enclosure logical id(0x5001636001a42f3d), slot(19) [ 13.975474] scsi 0:0:20:0: enclosure level(0x0000), connector name( C1 ) [ 13.982283] scsi 0:0:20:0: serial_number(ZA1AGHN70000C83152G5) [ 13.988113] scsi 0:0:20:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 14.243813] mpt3sas_cm0: detecting: handle(0x0027), sas_address(0x5000c500954328d9), phy(20) [ 14.252252] mpt3sas_cm0: REPORT_LUNS: handle(0x0027), retries(0) [ 14.258838] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0027), lun(0) [ 14.266042] scsi 0:0:21:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 14.274623] scsi 0:0:21:0: SSP: handle(0x0027), sas_addr(0x5000c500954328d9), phy(20), device_name(0x5000c500954328d8) [ 14.285311] scsi 0:0:21:0: enclosure logical id(0x5001636001a42f3d), slot(20) [ 14.292531] scsi 0:0:21:0: enclosure level(0x0000), connector name( C1 ) [ 14.299339] scsi 0:0:21:0: serial_number(ZA1AGGMP0000R830XAU1) [ 14.305177] scsi 0:0:21:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 14.330818] mpt3sas_cm0: detecting: handle(0x0028), sas_address(0x5000c50095430e91), phy(21) [ 14.339257] mpt3sas_cm0: REPORT_LUNS: handle(0x0028), retries(0) [ 14.354995] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0028), lun(0) [ 14.362194] scsi 0:0:22:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 14.370770] scsi 0:0:22:0: SSP: handle(0x0028), sas_addr(0x5000c50095430e91), phy(21), device_name(0x5000c50095430e90) [ 14.381460] scsi 0:0:22:0: enclosure logical id(0x5001636001a42f3d), slot(21) [ 14.388678] scsi 0:0:22:0: enclosure level(0x0000), connector name( C1 ) [ 14.395485] scsi 0:0:22:0: serial_number(ZA1AG8LE0000C8316F7Y) [ 14.401317] scsi 0:0:22:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 14.428404] mpt3sas_cm0: detecting: handle(0x0029), sas_address(0x5000c50095431245), phy(22) [ 14.436847] mpt3sas_cm0: REPORT_LUNS: handle(0x0029), retries(0) [ 14.443407] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0029), lun(0) [ 14.697554] scsi 0:0:23:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 14.706229] scsi 0:0:23:0: SSP: handle(0x0029), sas_addr(0x5000c50095431245), phy(22), device_name(0x5000c50095431244) [ 14.716913] scsi 0:0:23:0: enclosure logical id(0x5001636001a42f3d), slot(22) [ 14.724132] scsi 0:0:23:0: enclosure level(0x0000), connector name( C1 ) [ 14.730923] scsi 0:0:23:0: serial_number(ZA1AGHF10000C8316HJ3) [ 14.736756] scsi 0:0:23:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 14.759812] mpt3sas_cm0: detecting: handle(0x002a), sas_address(0x5000c50095431385), phy(23) [ 14.768253] mpt3sas_cm0: REPORT_LUNS: handle(0x002a), retries(0) [ 14.774818] mpt3sas_cm0: TEST_UNIT_READY: handle(0x002a), lun(0) [ 15.028889] scsi 0:0:24:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 15.037572] scsi 0:0:24:0: SSP: handle(0x002a), sas_addr(0x5000c50095431385), phy(23), device_name(0x5000c50095431384) [ 15.048261] scsi 0:0:24:0: enclosure logical id(0x5001636001a42f3d), slot(23) [ 15.055480] scsi 0:0:24:0: enclosure level(0x0000), connector name( C1 ) [ 15.062271] scsi 0:0:24:0: serial_number(ZA1AFE8N0000C8315354) [ 15.068109] scsi 0:0:24:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 15.090818] mpt3sas_cm0: detecting: handle(0x002b), sas_address(0x5000c5009543248d), phy(24) [ 15.099252] mpt3sas_cm0: REPORT_LUNS: handle(0x002b), retries(0) [ 15.117480] mpt3sas_cm0: TEST_UNIT_READY: handle(0x002b), lun(0) [ 15.124682] scsi 0:0:25:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 15.133267] scsi 0:0:25:0: SSP: handle(0x002b), sas_addr(0x5000c5009543248d), phy(24), device_name(0x5000c5009543248c) [ 15.143952] scsi 0:0:25:0: enclosure logical id(0x5001636001a42f3d), slot(24) [ 15.151169] scsi 0:0:25:0: enclosure level(0x0000), connector name( C1 ) [ 15.157974] scsi 0:0:25:0: serial_number(ZA1AGGVC0000C728K7V7) [ 15.163809] scsi 0:0:25:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 15.186816] mpt3sas_cm0: detecting: handle(0x002c), sas_address(0x5000c500954317b5), phy(25) [ 15.195254] mpt3sas_cm0: REPORT_LUNS: handle(0x002c), retries(0) [ 15.213979] mpt3sas_cm0: TEST_UNIT_READY: handle(0x002c), lun(0) [ 15.221201] scsi 0:0:26:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 15.229782] scsi 0:0:26:0: SSP: handle(0x002c), sas_addr(0x5000c500954317b5), phy(25), device_name(0x5000c500954317b4) [ 15.240471] scsi 0:0:26:0: enclosure logical id(0x5001636001a42f3d), slot(25) [ 15.247692] scsi 0:0:26:0: enclosure level(0x0000), connector name( C1 ) [ 15.254496] scsi 0:0:26:0: serial_number(ZA1AGH9T0000R727YGLC) [ 15.260331] scsi 0:0:26:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 15.283818] mpt3sas_cm0: detecting: handle(0x002d), sas_address(0x5000c50095430cbd), phy(26) [ 15.292251] mpt3sas_cm0: REPORT_LUNS: handle(0x002d), retries(0) [ 15.298815] mpt3sas_cm0: TEST_UNIT_READY: handle(0x002d), lun(0) [ 15.554594] scsi 0:0:27:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 15.563282] scsi 0:0:27:0: SSP: handle(0x002d), sas_addr(0x5000c50095430cbd), phy(26), device_name(0x5000c50095430cbc) [ 15.573967] scsi 0:0:27:0: enclosure logical id(0x5001636001a42f3d), slot(26) [ 15.581188] scsi 0:0:27:0: enclosure level(0x0000), connector name( C1 ) [ 15.587985] scsi 0:0:27:0: serial_number(ZA1AGHLW0000R829CXGX) [ 15.593818] scsi 0:0:27:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 15.617822] mpt3sas_cm0: detecting: handle(0x002e), sas_address(0x5000c5009542ec01), phy(27) [ 15.626259] mpt3sas_cm0: REPORT_LUNS: handle(0x002e), retries(0) [ 15.632762] mpt3sas_cm0: TEST_UNIT_READY: handle(0x002e), lun(0) [ 15.639945] scsi 0:0:28:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 15.648533] scsi 0:0:28:0: SSP: handle(0x002e), sas_addr(0x5000c5009542ec01), phy(27), device_name(0x5000c5009542ec00) [ 15.659224] scsi 0:0:28:0: enclosure logical id(0x5001636001a42f3d), slot(27) [ 15.666442] scsi 0:0:28:0: enclosure level(0x0000), connector name( C1 ) [ 15.673250] scsi 0:0:28:0: serial_number(ZA1AG9BF0000R830XB7P) [ 15.679089] scsi 0:0:28:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 15.701821] mpt3sas_cm0: detecting: handle(0x002f), sas_address(0x5000c50095432481), phy(28) [ 15.710258] mpt3sas_cm0: REPORT_LUNS: handle(0x002f), retries(0) [ 15.726902] mpt3sas_cm0: TEST_UNIT_READY: handle(0x002f), lun(0) [ 15.734117] scsi 0:0:29:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 15.742690] scsi 0:0:29:0: SSP: handle(0x002f), sas_addr(0x5000c50095432481), phy(28), device_name(0x5000c50095432480) [ 15.753378] scsi 0:0:29:0: enclosure logical id(0x5001636001a42f3d), slot(28) [ 15.760598] scsi 0:0:29:0: enclosure level(0x0000), connector name( C1 ) [ 15.767405] scsi 0:0:29:0: serial_number(ZA1AGMY80000C8316GN0) [ 15.773235] scsi 0:0:29:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 15.795820] mpt3sas_cm0: detecting: handle(0x0030), sas_address(0x5000c50095432a85), phy(29) [ 15.804257] mpt3sas_cm0: REPORT_LUNS: handle(0x0030), retries(0) [ 15.822974] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0030), lun(0) [ 15.830181] scsi 0:0:30:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 15.838761] scsi 0:0:30:0: SSP: handle(0x0030), sas_addr(0x5000c50095432a85), phy(29), device_name(0x5000c50095432a84) [ 15.849449] scsi 0:0:30:0: enclosure logical id(0x5001636001a42f3d), slot(29) [ 15.856669] scsi 0:0:30:0: enclosure level(0x0000), connector name( C1 ) [ 15.863473] scsi 0:0:30:0: serial_number(ZA1AGGKG0000C831535U) [ 15.869307] scsi 0:0:30:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 15.891816] mpt3sas_cm0: detecting: handle(0x0031), sas_address(0x5000c50095432761), phy(30) [ 15.900257] mpt3sas_cm0: REPORT_LUNS: handle(0x0031), retries(0) [ 15.906822] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0031), lun(0) [ 15.914007] scsi 0:0:31:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 15.922597] scsi 0:0:31:0: SSP: handle(0x0031), sas_addr(0x5000c50095432761), phy(30), device_name(0x5000c50095432760) [ 15.933283] scsi 0:0:31:0: enclosure logical id(0x5001636001a42f3d), slot(30) [ 15.940502] scsi 0:0:31:0: enclosure level(0x0000), connector name( C1 ) [ 15.947308] scsi 0:0:31:0: serial_number(ZA1AGMWD0000C8316H52) [ 15.953142] scsi 0:0:31:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 16.208825] mpt3sas_cm0: detecting: handle(0x0032), sas_address(0x5000c500954327c9), phy(31) [ 16.217261] mpt3sas_cm0: REPORT_LUNS: handle(0x0032), retries(0) [ 16.223826] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0032), lun(0) [ 16.483551] scsi 0:0:32:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 16.492224] scsi 0:0:32:0: SSP: handle(0x0032), sas_addr(0x5000c500954327c9), phy(31), device_name(0x5000c500954327c8) [ 16.502912] scsi 0:0:32:0: enclosure logical id(0x5001636001a42f3d), slot(31) [ 16.510131] scsi 0:0:32:0: enclosure level(0x0000), connector name( C1 ) [ 16.516922] scsi 0:0:32:0: serial_number(ZA1AGGPS0000C8316FQH) [ 16.522752] scsi 0:0:32:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 16.545824] mpt3sas_cm0: detecting: handle(0x0033), sas_address(0x5000c5009543085d), phy(32) [ 16.554273] mpt3sas_cm0: REPORT_LUNS: handle(0x0033), retries(0) [ 16.573284] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0033), lun(0) [ 16.580442] scsi 0:0:33:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 16.589020] scsi 0:0:33:0: SSP: handle(0x0033), sas_addr(0x5000c5009543085d), phy(32), device_name(0x5000c5009543085c) [ 16.599702] scsi 0:0:33:0: enclosure logical id(0x5001636001a42f3d), slot(32) [ 16.606920] scsi 0:0:33:0: enclosure level(0x0000), connector name( C1 ) [ 16.613727] scsi 0:0:33:0: serial_number(ZA1AG3E30000R824EA7K) [ 16.619559] scsi 0:0:33:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 16.643831] mpt3sas_cm0: detecting: handle(0x0034), sas_address(0x5000c50095431de1), phy(33) [ 16.652270] mpt3sas_cm0: REPORT_LUNS: handle(0x0034), retries(0) [ 16.663955] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0034), lun(0) [ 16.671107] scsi 0:0:34:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 16.679687] scsi 0:0:34:0: SSP: handle(0x0034), sas_addr(0x5000c50095431de1), phy(33), device_name(0x5000c50095431de0) [ 16.690373] scsi 0:0:34:0: enclosure logical id(0x5001636001a42f3d), slot(33) [ 16.697594] scsi 0:0:34:0: enclosure level(0x0000), connector name( C1 ) [ 16.704399] scsi 0:0:34:0: serial_number(ZA1AGN4Q0000R8167B5B) [ 16.710231] scsi 0:0:34:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 16.734824] mpt3sas_cm0: detecting: handle(0x0035), sas_address(0x5000c50095432111), phy(34) [ 16.743263] mpt3sas_cm0: REPORT_LUNS: handle(0x0035), retries(0) [ 16.749842] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0035), lun(0) [ 17.007521] scsi 0:0:35:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 17.016210] scsi 0:0:35:0: SSP: handle(0x0035), sas_addr(0x5000c50095432111), phy(34), device_name(0x5000c50095432110) [ 17.026895] scsi 0:0:35:0: enclosure logical id(0x5001636001a42f3d), slot(34) [ 17.034115] scsi 0:0:35:0: enclosure level(0x0000), connector name( C1 ) [ 17.040908] scsi 0:0:35:0: serial_number(ZA1AGGYP0000C8316G0T) [ 17.046746] scsi 0:0:35:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 17.076824] mpt3sas_cm0: detecting: handle(0x0036), sas_address(0x5000c50095432475), phy(35) [ 17.085280] mpt3sas_cm0: REPORT_LUNS: handle(0x0036), retries(0) [ 17.091844] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0036), lun(0) [ 17.350069] scsi 0:0:36:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 17.358758] scsi 0:0:36:0: SSP: handle(0x0036), sas_addr(0x5000c50095432475), phy(35), device_name(0x5000c50095432474) [ 17.369446] scsi 0:0:36:0: enclosure logical id(0x5001636001a42f3d), slot(35) [ 17.376668] scsi 0:0:36:0: enclosure level(0x0000), connector name( C1 ) [ 17.383458] scsi 0:0:36:0: serial_number(ZA1AGMYF0000C8316H9Y) [ 17.389296] scsi 0:0:36:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 17.411830] mpt3sas_cm0: detecting: handle(0x0037), sas_address(0x5000c50095431439), phy(36) [ 17.420265] mpt3sas_cm0: REPORT_LUNS: handle(0x0037), retries(0) [ 17.434047] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0037), lun(0) [ 17.441187] scsi 0:0:37:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 17.449763] scsi 0:0:37:0: SSP: handle(0x0037), sas_addr(0x5000c50095431439), phy(36), device_name(0x5000c50095431438) [ 17.460447] scsi 0:0:37:0: enclosure logical id(0x5001636001a42f3d), slot(36) [ 17.467668] scsi 0:0:37:0: enclosure level(0x0000), connector name( C1 ) [ 17.474473] scsi 0:0:37:0: serial_number(ZA1AFVX60000C83152CW) [ 17.480308] scsi 0:0:37:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 17.506836] mpt3sas_cm0: detecting: handle(0x0038), sas_address(0x5000c5009543086d), phy(37) [ 17.515271] mpt3sas_cm0: REPORT_LUNS: handle(0x0038), retries(0) [ 17.535907] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0038), lun(0) [ 17.543053] scsi 0:0:38:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 17.551638] scsi 0:0:38:0: SSP: handle(0x0038), sas_addr(0x5000c5009543086d), phy(37), device_name(0x5000c5009543086c) [ 17.562326] scsi 0:0:38:0: enclosure logical id(0x5001636001a42f3d), slot(37) [ 17.569544] scsi 0:0:38:0: enclosure level(0x0000), connector name( C1 ) [ 17.576362] scsi 0:0:38:0: serial_number(ZA1AG3DZ0000C83152N4) [ 17.582201] scsi 0:0:38:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 17.606826] mpt3sas_cm0: detecting: handle(0x0039), sas_address(0x5000c50095383ae5), phy(38) [ 17.615267] mpt3sas_cm0: REPORT_LUNS: handle(0x0039), retries(0) [ 17.621814] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0039), lun(0) [ 17.877982] scsi 0:0:39:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 17.925588] scsi 0:0:39:0: SSP: handle(0x0039), sas_addr(0x5000c50095383ae5), phy(38), device_name(0x5000c50095383ae4) [ 17.936277] scsi 0:0:39:0: enclosure logical id(0x5001636001a42f3d), slot(38) [ 17.943497] scsi 0:0:39:0: enclosure level(0x0000), connector name( C1 ) [ 17.950303] scsi 0:0:39:0: serial_number(ZA1ACHFL0000R8289CW4) [ 17.956135] scsi 0:0:39:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 17.979834] mpt3sas_cm0: detecting: handle(0x003a), sas_address(0x5000c50095446311), phy(39) [ 17.988279] mpt3sas_cm0: REPORT_LUNS: handle(0x003a), retries(0) [ 17.994832] mpt3sas_cm0: TEST_UNIT_READY: handle(0x003a), lun(0) [ 18.248795] scsi 0:0:40:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 18.257476] scsi 0:0:40:0: SSP: handle(0x003a), sas_addr(0x5000c50095446311), phy(39), device_name(0x5000c50095446310) [ 18.268161] scsi 0:0:40:0: enclosure logical id(0x5001636001a42f3d), slot(39) [ 18.275382] scsi 0:0:40:0: enclosure level(0x0000), connector name( C1 ) [ 18.282172] scsi 0:0:40:0: serial_number(ZA1AGTG50000R8300NX4) [ 18.288011] scsi 0:0:40:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 18.310833] mpt3sas_cm0: detecting: handle(0x003b), sas_address(0x5000c50095430c79), phy(40) [ 18.319274] mpt3sas_cm0: REPORT_LUNS: handle(0x003b), retries(0) [ 18.325753] mpt3sas_cm0: TEST_UNIT_READY: handle(0x003b), lun(0) [ 18.332903] scsi 0:0:41:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 18.341476] scsi 0:0:41:0: SSP: handle(0x003b), sas_addr(0x5000c50095430c79), phy(40), device_name(0x5000c50095430c78) [ 18.352161] scsi 0:0:41:0: enclosure logical id(0x5001636001a42f3d), slot(40) [ 18.359378] scsi 0:0:41:0: enclosure level(0x0000), connector name( C1 ) [ 18.366187] scsi 0:0:41:0: serial_number(ZA1AG8D70000R8301BUX) [ 18.372017] scsi 0:0:41:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 18.394832] mpt3sas_cm0: detecting: handle(0x003c), sas_address(0x5000c50095431205), phy(41) [ 18.403272] mpt3sas_cm0: REPORT_LUNS: handle(0x003c), retries(0) [ 18.409748] mpt3sas_cm0: TEST_UNIT_READY: handle(0x003c), lun(0) [ 18.416901] scsi 0:0:42:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 18.425472] scsi 0:0:42:0: SSP: handle(0x003c), sas_addr(0x5000c50095431205), phy(41), device_name(0x5000c50095431204) [ 18.436159] scsi 0:0:42:0: enclosure logical id(0x5001636001a42f3d), slot(41) [ 18.443376] scsi 0:0:42:0: enclosure level(0x0000), connector name( C1 ) [ 18.450183] scsi 0:0:42:0: serial_number(ZA1AGHF60000R82898SZ) [ 18.456015] scsi 0:0:42:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 18.479837] mpt3sas_cm0: detecting: handle(0x003d), sas_address(0x5000c500954328e1), phy(42) [ 18.488278] mpt3sas_cm0: REPORT_LUNS: handle(0x003d), retries(0) [ 18.494854] mpt3sas_cm0: TEST_UNIT_READY: handle(0x003d), lun(0) [ 18.753965] scsi 0:0:43:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 18.762641] scsi 0:0:43:0: SSP: handle(0x003d), sas_addr(0x5000c500954328e1), phy(42), device_name(0x5000c500954328e0) [ 18.773329] scsi 0:0:43:0: enclosure logical id(0x5001636001a42f3d), slot(42) [ 18.780548] scsi 0:0:43:0: enclosure level(0x0000), connector name( C1 ) [ 18.787339] scsi 0:0:43:0: serial_number(ZA1AGGMN0000R824DEBJ) [ 18.793179] scsi 0:0:43:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 18.817843] mpt3sas_cm0: detecting: handle(0x003e), sas_address(0x5000c50095432969), phy(43) [ 18.826279] mpt3sas_cm0: REPORT_LUNS: handle(0x003e), retries(0) [ 18.832847] mpt3sas_cm0: TEST_UNIT_READY: handle(0x003e), lun(0) [ 19.088770] scsi 0:0:44:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 19.097442] scsi 0:0:44:0: SSP: handle(0x003e), sas_addr(0x5000c50095432969), phy(43), device_name(0x5000c50095432968) [ 19.108123] scsi 0:0:44:0: enclosure logical id(0x5001636001a42f3d), slot(43) [ 19.115343] scsi 0:0:44:0: enclosure level(0x0000), connector name( C1 ) [ 19.122134] scsi 0:0:44:0: serial_number(ZA1AGGM40000R823P9XN) [ 19.127966] scsi 0:0:44:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 19.151434] mpt3sas_cm0: detecting: handle(0x003f), sas_address(0x5000c5009542bf5d), phy(44) [ 19.159868] mpt3sas_cm0: REPORT_LUNS: handle(0x003f), retries(0) [ 19.174426] mpt3sas_cm0: TEST_UNIT_READY: handle(0x003f), lun(0) [ 19.181557] scsi 0:0:45:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 19.190133] scsi 0:0:45:0: SSP: handle(0x003f), sas_addr(0x5000c5009542bf5d), phy(44), device_name(0x5000c5009542bf5c) [ 19.200815] scsi 0:0:45:0: enclosure logical id(0x5001636001a42f3d), slot(44) [ 19.208034] scsi 0:0:45:0: enclosure level(0x0000), connector name( C1 ) [ 19.214839] scsi 0:0:45:0: serial_number(ZA1AGAHD0000R8301RUN) [ 19.220673] scsi 0:0:45:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 19.245834] mpt3sas_cm0: detecting: handle(0x0040), sas_address(0x5000c50095446b85), phy(45) [ 19.254286] mpt3sas_cm0: REPORT_LUNS: handle(0x0040), retries(0) [ 19.270655] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0040), lun(0) [ 19.277795] scsi 0:0:46:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 19.286362] scsi 0:0:46:0: SSP: handle(0x0040), sas_addr(0x5000c50095446b85), phy(45), device_name(0x5000c50095446b84) [ 19.297049] scsi 0:0:46:0: enclosure logical id(0x5001636001a42f3d), slot(45) [ 19.304271] scsi 0:0:46:0: enclosure level(0x0000), connector name( C1 ) [ 19.311075] scsi 0:0:46:0: serial_number(ZA1AGT4R0000R830XBEB) [ 19.316907] scsi 0:0:46:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 19.341840] mpt3sas_cm0: detecting: handle(0x0041), sas_address(0x5000c5009543284d), phy(46) [ 19.350277] mpt3sas_cm0: REPORT_LUNS: handle(0x0041), retries(0) [ 19.356856] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0041), lun(0) [ 19.616150] scsi 0:0:47:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 19.624821] scsi 0:0:47:0: SSP: handle(0x0041), sas_addr(0x5000c5009543284d), phy(46), device_name(0x5000c5009543284c) [ 19.635504] scsi 0:0:47:0: enclosure logical id(0x5001636001a42f3d), slot(46) [ 19.642722] scsi 0:0:47:0: enclosure level(0x0000), connector name( C1 ) [ 19.649516] scsi 0:0:47:0: serial_number(ZA1AGGNQ0000R824DTSN) [ 19.655355] scsi 0:0:47:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 19.682838] mpt3sas_cm0: detecting: handle(0x0042), sas_address(0x5000c50095430a09), phy(47) [ 19.691293] mpt3sas_cm0: REPORT_LUNS: handle(0x0042), retries(0) [ 19.697850] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0042), lun(0) [ 19.704917] scsi 0:0:48:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 19.713483] scsi 0:0:48:0: SSP: handle(0x0042), sas_addr(0x5000c50095430a09), phy(47), device_name(0x5000c50095430a08) [ 19.724166] scsi 0:0:48:0: enclosure logical id(0x5001636001a42f3d), slot(47) [ 19.731383] scsi 0:0:48:0: enclosure level(0x0000), connector name( C1 ) [ 19.738189] scsi 0:0:48:0: serial_number(ZA1AG3B20000R8288A3W) [ 19.744024] scsi 0:0:48:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 19.767843] mpt3sas_cm0: detecting: handle(0x0043), sas_address(0x5000c5009538d90d), phy(48) [ 19.776282] mpt3sas_cm0: REPORT_LUNS: handle(0x0043), retries(0) [ 19.789954] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0043), lun(0) [ 19.797057] scsi 0:0:49:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 19.805639] scsi 0:0:49:0: SSP: handle(0x0043), sas_addr(0x5000c5009538d90d), phy(48), device_name(0x5000c5009538d90c) [ 19.816327] scsi 0:0:49:0: enclosure logical id(0x5001636001a42f3d), slot(48) [ 19.823547] scsi 0:0:49:0: enclosure level(0x0000), connector name( C1 ) [ 19.830354] scsi 0:0:49:0: serial_number(ZA1ACZX90000R82892A9) [ 19.836185] scsi 0:0:49:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 19.858846] mpt3sas_cm0: detecting: handle(0x0044), sas_address(0x5000c50095430af9), phy(49) [ 19.867284] mpt3sas_cm0: REPORT_LUNS: handle(0x0044), retries(0) [ 19.873778] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0044), lun(0) [ 19.880889] scsi 0:0:50:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 19.889454] scsi 0:0:50:0: SSP: handle(0x0044), sas_addr(0x5000c50095430af9), phy(49), device_name(0x5000c50095430af8) [ 19.900142] scsi 0:0:50:0: enclosure logical id(0x5001636001a42f3d), slot(49) [ 19.907361] scsi 0:0:50:0: enclosure level(0x0000), connector name( C1 ) [ 19.914169] scsi 0:0:50:0: serial_number(ZA1AF6NG0000R8301C0E) [ 19.920001] scsi 0:0:50:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 19.944841] mpt3sas_cm0: detecting: handle(0x0045), sas_address(0x5000c50095432905), phy(50) [ 19.953275] mpt3sas_cm0: REPORT_LUNS: handle(0x0045), retries(0) [ 19.959834] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0045), lun(0) [ 20.215062] scsi 0:0:51:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 20.223739] scsi 0:0:51:0: SSP: handle(0x0045), sas_addr(0x5000c50095432905), phy(50), device_name(0x5000c50095432904) [ 20.234427] scsi 0:0:51:0: enclosure logical id(0x5001636001a42f3d), slot(50) [ 20.241645] scsi 0:0:51:0: enclosure level(0x0000), connector name( C1 ) [ 20.248436] scsi 0:0:51:0: serial_number(ZA1AGGMH0000C8316FV1) [ 20.254268] scsi 0:0:51:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 20.276847] mpt3sas_cm0: detecting: handle(0x0046), sas_address(0x5000c5009543106d), phy(51) [ 20.285293] mpt3sas_cm0: REPORT_LUNS: handle(0x0046), retries(0) [ 20.291868] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0046), lun(0) [ 20.550108] scsi 0:0:52:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 20.598649] scsi 0:0:52:0: SSP: handle(0x0046), sas_addr(0x5000c5009543106d), phy(51), device_name(0x5000c5009543106c) [ 20.609334] scsi 0:0:52:0: enclosure logical id(0x5001636001a42f3d), slot(51) [ 20.616552] scsi 0:0:52:0: enclosure level(0x0000), connector name( C1 ) [ 20.623359] scsi 0:0:52:0: serial_number(ZA1AG3EL0000R8301S70) [ 20.629193] scsi 0:0:52:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 20.651860] mpt3sas_cm0: detecting: handle(0x0047), sas_address(0x5000c500954463b1), phy(52) [ 20.660296] mpt3sas_cm0: REPORT_LUNS: handle(0x0047), retries(0) [ 20.673190] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0047), lun(0) [ 20.680277] scsi 0:0:53:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 20.688848] scsi 0:0:53:0: SSP: handle(0x0047), sas_addr(0x5000c500954463b1), phy(52), device_name(0x5000c500954463b0) [ 20.699538] scsi 0:0:53:0: enclosure logical id(0x5001636001a42f3d), slot(52) [ 20.706756] scsi 0:0:53:0: enclosure level(0x0000), connector name( C1 ) [ 20.713562] scsi 0:0:53:0: serial_number(ZA1AGTF20000R82897TB) [ 20.719394] scsi 0:0:53:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 20.742844] mpt3sas_cm0: detecting: handle(0x0048), sas_address(0x5000c50095431b21), phy(53) [ 20.751281] mpt3sas_cm0: REPORT_LUNS: handle(0x0048), retries(0) [ 20.767993] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0048), lun(0) [ 20.775095] scsi 0:0:54:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 20.783667] scsi 0:0:54:0: SSP: handle(0x0048), sas_addr(0x5000c50095431b21), phy(53), device_name(0x5000c50095431b20) [ 20.794350] scsi 0:0:54:0: enclosure logical id(0x5001636001a42f3d), slot(53) [ 20.801569] scsi 0:0:54:0: enclosure level(0x0000), connector name( C1 ) [ 20.808376] scsi 0:0:54:0: serial_number(ZA1AGH5H0000C8316HU8) [ 20.814209] scsi 0:0:54:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 20.839850] mpt3sas_cm0: detecting: handle(0x0049), sas_address(0x5000c50095430bb9), phy(54) [ 20.848287] mpt3sas_cm0: REPORT_LUNS: handle(0x0049), retries(0) [ 20.854841] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0049), lun(0) [ 21.110903] scsi 0:0:55:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 21.157352] scsi 0:0:55:0: SSP: handle(0x0049), sas_addr(0x5000c50095430bb9), phy(54), device_name(0x5000c50095430bb8) [ 21.168035] scsi 0:0:55:0: enclosure logical id(0x5001636001a42f3d), slot(54) [ 21.175253] scsi 0:0:55:0: enclosure level(0x0000), connector name( C1 ) [ 21.182061] scsi 0:0:55:0: serial_number(ZA1AG8DM0000R8301BSQ) [ 21.187894] scsi 0:0:55:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 21.210852] mpt3sas_cm0: detecting: handle(0x004a), sas_address(0x5000c5009542ebf9), phy(55) [ 21.219286] mpt3sas_cm0: REPORT_LUNS: handle(0x004a), retries(0) [ 21.225872] mpt3sas_cm0: TEST_UNIT_READY: handle(0x004a), lun(0) [ 21.480734] scsi 0:0:56:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 21.489413] scsi 0:0:56:0: SSP: handle(0x004a), sas_addr(0x5000c5009542ebf9), phy(55), device_name(0x5000c5009542ebf8) [ 21.500100] scsi 0:0:56:0: enclosure logical id(0x5001636001a42f3d), slot(55) [ 21.507321] scsi 0:0:56:0: enclosure level(0x0000), connector name( C1 ) [ 21.514114] scsi 0:0:56:0: serial_number(ZA1AG9CF0000R830XD0N) [ 21.519949] scsi 0:0:56:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 21.543861] mpt3sas_cm0: detecting: handle(0x004b), sas_address(0x5000c500954304e5), phy(56) [ 21.552302] mpt3sas_cm0: REPORT_LUNS: handle(0x004b), retries(0) [ 21.558774] mpt3sas_cm0: TEST_UNIT_READY: handle(0x004b), lun(0) [ 21.565898] scsi 0:0:57:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 21.574482] scsi 0:0:57:0: SSP: handle(0x004b), sas_addr(0x5000c500954304e5), phy(56), device_name(0x5000c500954304e4) [ 21.585164] scsi 0:0:57:0: enclosure logical id(0x5001636001a42f3d), slot(56) [ 21.592385] scsi 0:0:57:0: enclosure level(0x0000), connector name( C1 ) [ 21.599190] scsi 0:0:57:0: serial_number(ZA1AG8JZ0000R8301BWV) [ 21.605022] scsi 0:0:57:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 21.627857] mpt3sas_cm0: detecting: handle(0x004c), sas_address(0x5000c50095430665), phy(57) [ 21.636295] mpt3sas_cm0: REPORT_LUNS: handle(0x004c), retries(0) [ 21.642782] mpt3sas_cm0: TEST_UNIT_READY: handle(0x004c), lun(0) [ 21.649897] scsi 0:0:58:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 21.658474] scsi 0:0:58:0: SSP: handle(0x004c), sas_addr(0x5000c50095430665), phy(57), device_name(0x5000c50095430664) [ 21.669161] scsi 0:0:58:0: enclosure logical id(0x5001636001a42f3d), slot(57) [ 21.676381] scsi 0:0:58:0: enclosure level(0x0000), connector name( C1 ) [ 21.683188] scsi 0:0:58:0: serial_number(ZA1AG3G10000C83152GR) [ 21.689021] scsi 0:0:58:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 21.711860] mpt3sas_cm0: detecting: handle(0x004d), sas_address(0x5000c50095430ef1), phy(58) [ 21.720302] mpt3sas_cm0: REPORT_LUNS: handle(0x004d), retries(0) [ 21.726872] mpt3sas_cm0: TEST_UNIT_READY: handle(0x004d), lun(0) [ 21.987596] scsi 0:0:59:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 21.996288] scsi 0:0:59:0: SSP: handle(0x004d), sas_addr(0x5000c50095430ef1), phy(58), device_name(0x5000c50095430ef0) [ 22.006975] scsi 0:0:59:0: enclosure logical id(0x5001636001a42f3d), slot(58) [ 22.014195] scsi 0:0:59:0: enclosure level(0x0000), connector name( C1 ) [ 22.020985] scsi 0:0:59:0: serial_number(ZA1AGHJW0000C8316HR4) [ 22.026816] scsi 0:0:59:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 22.051858] mpt3sas_cm0: detecting: handle(0x004e), sas_address(0x5000c50095431119), phy(59) [ 22.060299] mpt3sas_cm0: REPORT_LUNS: handle(0x004e), retries(0) [ 22.066852] mpt3sas_cm0: TEST_UNIT_READY: handle(0x004e), lun(0) [ 22.326187] scsi 0:0:60:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 22.334858] scsi 0:0:60:0: SSP: handle(0x004e), sas_addr(0x5000c50095431119), phy(59), device_name(0x5000c50095431118) [ 22.345540] scsi 0:0:60:0: enclosure logical id(0x5001636001a42f3d), slot(59) [ 22.352761] scsi 0:0:60:0: enclosure level(0x0000), connector name( C1 ) [ 22.359550] scsi 0:0:60:0: serial_number(ZA1AGHGA0000R824E65Z) [ 22.365381] scsi 0:0:60:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 22.390973] mpt3sas_cm0: detecting: handle(0x0050), sas_address(0x5001636001a42f3d), phy(76) [ 22.399424] mpt3sas_cm0: REPORT_LUNS: handle(0x0050), retries(0) [ 22.405609] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0050), lun(0) [ 22.412073] scsi 0:0:61:0: Enclosure QCT JB4602 SIM 0 1500 PQ: 0 ANSI: 6 [ 22.420453] scsi 0:0:61:0: set ignore_delay_remove for handle(0x0050) [ 22.426895] scsi 0:0:61:0: SES: handle(0x0050), sas_addr(0x5001636001a42f3d), phy(76), device_name(0x5001636001a42f3d) [ 22.437583] scsi 0:0:61:0: enclosure logical id(0x5001636001a42f3d), slot(60) [ 22.444802] scsi 0:0:61:0: enclosure level(0x0000), connector name( C1 ) [ 22.451607] scsi 0:0:61:0: serial_number(EO0153600069 ) [ 22.457092] scsi 0:0:61:0: qdepth(1), tagged(0), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 22.481966] mpt3sas_cm0: expander_add: handle(0x0051), parent(0x0001), sas_addr(0x5001636001a44e7f), phys(79) [ 22.505421] mpt3sas_cm0: detecting: handle(0x0053), sas_address(0x5000c5009538809d), phy(0) [ 22.513786] mpt3sas_cm0: REPORT_LUNS: handle(0x0053), retries(0) [ 22.530602] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0053), lun(0) [ 22.537808] scsi 0:0:62:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 22.546386] scsi 0:0:62:0: SSP: handle(0x0053), sas_addr(0x5000c5009538809d), phy(0), device_name(0x5000c5009538809c) [ 22.556983] scsi 0:0:62:0: enclosure logical id(0x5001636001a44e7d), slot(0) [ 22.564115] scsi 0:0:62:0: enclosure level(0x0000), connector name( C3 ) [ 22.570927] scsi 0:0:62:0: serial_number(ZA1AD1QH0000R829CRXQ) [ 22.576766] scsi 0:0:62:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 22.601864] mpt3sas_cm0: detecting: handle(0x0054), sas_address(0x5000c50095385239), phy(1) [ 22.610220] mpt3sas_cm0: REPORT_LUNS: handle(0x0054), retries(0) [ 22.632253] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0054), lun(0) [ 22.639381] scsi 0:0:63:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 22.647960] scsi 0:0:63:0: SSP: handle(0x0054), sas_addr(0x5000c50095385239), phy(1), device_name(0x5000c50095385238) [ 22.658557] scsi 0:0:63:0: enclosure logical id(0x5001636001a44e7d), slot(1) [ 22.665691] scsi 0:0:63:0: enclosure level(0x0000), connector name( C3 ) [ 22.672496] scsi 0:0:63:0: serial_number(ZA1ACX2W0000R829D5RN) [ 22.678330] scsi 0:0:63:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 22.701861] mpt3sas_cm0: detecting: handle(0x0055), sas_address(0x5000c5009538628d), phy(2) [ 22.710209] mpt3sas_cm0: REPORT_LUNS: handle(0x0055), retries(0) [ 22.716773] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0055), lun(0) [ 22.974974] scsi 0:0:64:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 22.983652] scsi 0:0:64:0: SSP: handle(0x0055), sas_addr(0x5000c5009538628d), phy(2), device_name(0x5000c5009538628c) [ 22.994255] scsi 0:0:64:0: enclosure logical id(0x5001636001a44e7d), slot(2) [ 23.001387] scsi 0:0:64:0: enclosure level(0x0000), connector name( C3 ) [ 23.008179] scsi 0:0:64:0: serial_number(ZA1ACWMY0000R824V9KP) [ 23.014018] scsi 0:0:64:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 23.036864] mpt3sas_cm0: detecting: handle(0x0056), sas_address(0x5000c50095388321), phy(3) [ 23.045211] mpt3sas_cm0: REPORT_LUNS: handle(0x0056), retries(0) [ 23.051776] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0056), lun(0) [ 23.308433] scsi 0:0:65:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 23.317115] scsi 0:0:65:0: SSP: handle(0x0056), sas_addr(0x5000c50095388321), phy(3), device_name(0x5000c50095388320) [ 23.327716] scsi 0:0:65:0: enclosure logical id(0x5001636001a44e7d), slot(3) [ 23.334849] scsi 0:0:65:0: enclosure level(0x0000), connector name( C3 ) [ 23.341639] scsi 0:0:65:0: serial_number(ZA1AD1MM0000R829CX04) [ 23.347471] scsi 0:0:65:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 23.370865] mpt3sas_cm0: detecting: handle(0x0057), sas_address(0x5000c500953852c1), phy(4) [ 23.379221] mpt3sas_cm0: REPORT_LUNS: handle(0x0057), retries(0) [ 23.391104] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0057), lun(0) [ 23.408294] scsi 0:0:66:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 23.416854] scsi 0:0:66:0: SSP: handle(0x0057), sas_addr(0x5000c500953852c1), phy(4), device_name(0x5000c500953852c0) [ 23.427452] scsi 0:0:66:0: enclosure logical id(0x5001636001a44e7d), slot(4) [ 23.434586] scsi 0:0:66:0: enclosure level(0x0000), connector name( C3 ) [ 23.441377] scsi 0:0:66:0: serial_number(ZA1ACX220000R829D6RB) [ 23.447216] scsi 0:0:66:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 23.469869] mpt3sas_cm0: detecting: handle(0x0058), sas_address(0x5000c5009543118d), phy(5) [ 23.478220] mpt3sas_cm0: REPORT_LUNS: handle(0x0058), retries(0) [ 23.484708] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0058), lun(0) [ 23.491812] scsi 0:0:67:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 23.500392] scsi 0:0:67:0: SSP: handle(0x0058), sas_addr(0x5000c5009543118d), phy(5), device_name(0x5000c5009543118c) [ 23.510993] scsi 0:0:67:0: enclosure logical id(0x5001636001a44e7d), slot(5) [ 23.518124] scsi 0:0:67:0: enclosure level(0x0000), connector name( C3 ) [ 23.524930] scsi 0:0:67:0: serial_number(ZA1AGHFV0000C8316HBC) [ 23.530762] scsi 0:0:67:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 23.553868] mpt3sas_cm0: detecting: handle(0x0059), sas_address(0x5000c5009537e5b5), phy(6) [ 23.562218] mpt3sas_cm0: REPORT_LUNS: handle(0x0059), retries(0) [ 23.568786] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0059), lun(0) [ 23.829195] scsi 0:0:68:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 23.837877] scsi 0:0:68:0: SSP: handle(0x0059), sas_addr(0x5000c5009537e5b5), phy(6), device_name(0x5000c5009537e5b4) [ 23.848473] scsi 0:0:68:0: enclosure logical id(0x5001636001a44e7d), slot(6) [ 23.855606] scsi 0:0:68:0: enclosure level(0x0000), connector name( C3 ) [ 23.862397] scsi 0:0:68:0: serial_number(ZA1ACKGZ0000R82897CP) [ 23.868230] scsi 0:0:68:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 23.890867] mpt3sas_cm0: detecting: handle(0x005a), sas_address(0x5000c5009543151d), phy(7) [ 23.899216] mpt3sas_cm0: REPORT_LUNS: handle(0x005a), retries(0) [ 23.905778] mpt3sas_cm0: TEST_UNIT_READY: handle(0x005a), lun(0) [ 24.157970] scsi 0:0:69:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 24.166648] scsi 0:0:69:0: SSP: handle(0x005a), sas_addr(0x5000c5009543151d), phy(7), device_name(0x5000c5009543151c) [ 24.177247] scsi 0:0:69:0: enclosure logical id(0x5001636001a44e7d), slot(7) [ 24.184380] scsi 0:0:69:0: enclosure level(0x0000), connector name( C3 ) [ 24.191171] scsi 0:0:69:0: serial_number(ZA1ACBEB0000C831528B) [ 24.197009] scsi 0:0:69:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 24.219867] mpt3sas_cm0: detecting: handle(0x0063), sas_address(0x5000c5009544634d), phy(8) [ 24.228222] mpt3sas_cm0: REPORT_LUNS: handle(0x0063), retries(0) [ 24.245029] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0063), lun(0) [ 24.252153] scsi 0:0:70:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 24.260729] scsi 0:0:70:0: SSP: handle(0x0063), sas_addr(0x5000c5009544634d), phy(8), device_name(0x5000c5009544634c) [ 24.271323] scsi 0:0:70:0: enclosure logical id(0x5001636001a44e7d), slot(8) [ 24.278456] scsi 0:0:70:0: enclosure level(0x0000), connector name( C3 ) [ 24.285262] scsi 0:0:70:0: serial_number(ZA1AGTFW0000R7245CBC) [ 24.291096] scsi 0:0:70:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 24.314874] mpt3sas_cm0: detecting: handle(0x0064), sas_address(0x5000c500954312e5), phy(9) [ 24.323226] mpt3sas_cm0: REPORT_LUNS: handle(0x0064), retries(0) [ 24.329714] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0064), lun(0) [ 24.336817] scsi 0:0:71:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 24.345393] scsi 0:0:71:0: SSP: handle(0x0064), sas_addr(0x5000c500954312e5), phy(9), device_name(0x5000c500954312e4) [ 24.355991] scsi 0:0:71:0: enclosure logical id(0x5001636001a44e7d), slot(9) [ 24.363122] scsi 0:0:71:0: enclosure level(0x0000), connector name( C3 ) [ 24.369928] scsi 0:0:71:0: serial_number(ZA1AGHDY0000R83026QB) [ 24.375762] scsi 0:0:71:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 24.399873] mpt3sas_cm0: detecting: handle(0x0065), sas_address(0x5000c50095430365), phy(10) [ 24.408306] mpt3sas_cm0: REPORT_LUNS: handle(0x0065), retries(0) [ 24.414866] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0065), lun(0) [ 24.672564] scsi 0:0:72:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 24.716943] scsi 0:0:72:0: SSP: handle(0x0065), sas_addr(0x5000c50095430365), phy(10), device_name(0x5000c50095430364) [ 24.727629] scsi 0:0:72:0: enclosure logical id(0x5001636001a44e7d), slot(10) [ 24.734848] scsi 0:0:72:0: enclosure level(0x0000), connector name( C3 ) [ 24.741653] scsi 0:0:72:0: serial_number(ZA1AG3JB0000R823NNXC) [ 24.747487] scsi 0:0:72:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 24.770871] mpt3sas_cm0: detecting: handle(0x0066), sas_address(0x5000c50095430545), phy(11) [ 24.779311] mpt3sas_cm0: REPORT_LUNS: handle(0x0066), retries(0) [ 24.811818] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0066), lun(0) [ 24.818949] scsi 0:0:73:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 24.827528] scsi 0:0:73:0: SSP: handle(0x0066), sas_addr(0x5000c50095430545), phy(11), device_name(0x5000c50095430544) [ 24.838217] scsi 0:0:73:0: enclosure logical id(0x5001636001a44e7d), slot(11) [ 24.845436] scsi 0:0:73:0: enclosure level(0x0000), connector name( C3 ) [ 24.852241] scsi 0:0:73:0: serial_number(ZA1AG3GT0000R824DF2R) [ 24.858074] scsi 0:0:73:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 24.880875] mpt3sas_cm0: detecting: handle(0x0067), sas_address(0x5000c50095432341), phy(12) [ 24.889310] mpt3sas_cm0: REPORT_LUNS: handle(0x0067), retries(0) [ 24.903741] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0067), lun(0) [ 24.910863] scsi 0:0:74:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 24.919437] scsi 0:0:74:0: SSP: handle(0x0067), sas_addr(0x5000c50095432341), phy(12), device_name(0x5000c50095432340) [ 24.930126] scsi 0:0:74:0: enclosure logical id(0x5001636001a44e7d), slot(12) [ 24.937347] scsi 0:0:74:0: enclosure level(0x0000), connector name( C3 ) [ 24.944151] scsi 0:0:74:0: serial_number(ZA1AGMZ50000R829D65Z) [ 24.949984] scsi 0:0:74:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 24.972868] mpt3sas_cm0: detecting: handle(0x0068), sas_address(0x5000c5009542ede1), phy(13) [ 24.981311] mpt3sas_cm0: REPORT_LUNS: handle(0x0068), retries(0) [ 24.994310] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0068), lun(0) [ 25.001423] scsi 0:0:75:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 25.009996] scsi 0:0:75:0: SSP: handle(0x0068), sas_addr(0x5000c5009542ede1), phy(13), device_name(0x5000c5009542ede0) [ 25.020685] scsi 0:0:75:0: enclosure logical id(0x5001636001a44e7d), slot(13) [ 25.027905] scsi 0:0:75:0: enclosure level(0x0000), connector name( C3 ) [ 25.034710] scsi 0:0:75:0: serial_number(ZA1AG99G0000R8301CER) [ 25.040548] scsi 0:0:75:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 25.063877] mpt3sas_cm0: detecting: handle(0x0069), sas_address(0x5000c50095431c25), phy(14) [ 25.072319] mpt3sas_cm0: REPORT_LUNS: handle(0x0069), retries(0) [ 25.078882] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0069), lun(0) [ 25.334578] scsi 0:0:76:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 25.343255] scsi 0:0:76:0: SSP: handle(0x0069), sas_addr(0x5000c50095431c25), phy(14), device_name(0x5000c50095431c24) [ 25.353939] scsi 0:0:76:0: enclosure logical id(0x5001636001a44e7d), slot(14) [ 25.361158] scsi 0:0:76:0: enclosure level(0x0000), connector name( C3 ) [ 25.367948] scsi 0:0:76:0: serial_number(ZA1AGN560000C8316G37) [ 25.373778] scsi 0:0:76:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 25.399874] mpt3sas_cm0: detecting: handle(0x006a), sas_address(0x5000c50095430f4d), phy(15) [ 25.408325] mpt3sas_cm0: REPORT_LUNS: handle(0x006a), retries(0) [ 25.414870] mpt3sas_cm0: TEST_UNIT_READY: handle(0x006a), lun(0) [ 25.675775] scsi 0:0:77:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 25.684453] scsi 0:0:77:0: SSP: handle(0x006a), sas_addr(0x5000c50095430f4d), phy(15), device_name(0x5000c50095430f4c) [ 25.695140] scsi 0:0:77:0: enclosure logical id(0x5001636001a44e7d), slot(15) [ 25.702358] scsi 0:0:77:0: enclosure level(0x0000), connector name( C3 ) [ 25.709151] scsi 0:0:77:0: serial_number(ZA1AGHJ90000R829CWQ8) [ 25.714990] scsi 0:0:77:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 25.737878] mpt3sas_cm0: detecting: handle(0x0073), sas_address(0x5000c500954d9721), phy(16) [ 25.746315] mpt3sas_cm0: REPORT_LUNS: handle(0x0073), retries(0) [ 25.758494] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0073), lun(0) [ 25.765621] scsi 0:0:78:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 25.774190] scsi 0:0:78:0: SSP: handle(0x0073), sas_addr(0x5000c500954d9721), phy(16), device_name(0x5000c500954d9720) [ 25.784873] scsi 0:0:78:0: enclosure logical id(0x5001636001a44e7d), slot(16) [ 25.792093] scsi 0:0:78:0: enclosure level(0x0000), connector name( C3 ) [ 25.798900] scsi 0:0:78:0: serial_number(ZA1AM3RW0000R8314487) [ 25.804732] scsi 0:0:78:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 25.874377] mpt3sas_cm0: detecting: handle(0x0074), sas_address(0x5000c500954324a5), phy(17) [ 25.882813] mpt3sas_cm0: REPORT_LUNS: handle(0x0074), retries(0) [ 25.889276] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0074), lun(0) [ 25.896375] scsi 0:0:79:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 25.904944] scsi 0:0:79:0: SSP: handle(0x0074), sas_addr(0x5000c500954324a5), phy(17), device_name(0x5000c500954324a4) [ 25.915630] scsi 0:0:79:0: enclosure logical id(0x5001636001a44e7d), slot(17) [ 25.922850] scsi 0:0:79:0: enclosure level(0x0000), connector name( C3 ) [ 25.929654] scsi 0:0:79:0: serial_number(ZA1AGGTT0000C7253ZB4) [ 25.935489] scsi 0:0:79:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 25.962874] mpt3sas_cm0: detecting: handle(0x0075), sas_address(0x5000c500954319d1), phy(18) [ 25.971310] mpt3sas_cm0: REPORT_LUNS: handle(0x0075), retries(0) [ 25.977869] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0075), lun(0) [ 26.229617] scsi 0:0:80:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 26.238304] scsi 0:0:80:0: SSP: handle(0x0075), sas_addr(0x5000c500954319d1), phy(18), device_name(0x5000c500954319d0) [ 26.248988] scsi 0:0:80:0: enclosure logical id(0x5001636001a44e7d), slot(18) [ 26.256206] scsi 0:0:80:0: enclosure level(0x0000), connector name( C3 ) [ 26.262998] scsi 0:0:80:0: serial_number(ZA1ACMBP0000C8316FQW) [ 26.268836] scsi 0:0:80:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 26.291883] mpt3sas_cm0: detecting: handle(0x0076), sas_address(0x5000c50095431259), phy(19) [ 26.300317] mpt3sas_cm0: REPORT_LUNS: handle(0x0076), retries(0) [ 26.306896] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0076), lun(0) [ 26.618960] scsi 0:0:81:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 26.627645] scsi 0:0:81:0: SSP: handle(0x0076), sas_addr(0x5000c50095431259), phy(19), device_name(0x5000c50095431258) [ 26.638331] scsi 0:0:81:0: enclosure logical id(0x5001636001a44e7d), slot(19) [ 26.645550] scsi 0:0:81:0: enclosure level(0x0000), connector name( C3 ) [ 26.652343] scsi 0:0:81:0: serial_number(ZA1AGHEJ0000C8316HJF) [ 26.658180] scsi 0:0:81:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 26.680888] mpt3sas_cm0: detecting: handle(0x0077), sas_address(0x5000c500954322c9), phy(20) [ 26.689325] mpt3sas_cm0: REPORT_LUNS: handle(0x0077), retries(0) [ 26.706822] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0077), lun(0) [ 26.713944] scsi 0:0:82:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 26.722523] scsi 0:0:82:0: SSP: handle(0x0077), sas_addr(0x5000c500954322c9), phy(20), device_name(0x5000c500954322c8) [ 26.733207] scsi 0:0:82:0: enclosure logical id(0x5001636001a44e7d), slot(20) [ 26.740426] scsi 0:0:82:0: enclosure level(0x0000), connector name( C3 ) [ 26.747231] scsi 0:0:82:0: serial_number(ZA1AGGX30000R703TD9K) [ 26.753064] scsi 0:0:82:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 26.775880] mpt3sas_cm0: detecting: handle(0x0078), sas_address(0x5000c50095432555), phy(21) [ 26.784323] mpt3sas_cm0: REPORT_LUNS: handle(0x0078), retries(0) [ 26.797897] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0078), lun(0) [ 26.805019] scsi 0:0:83:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 26.813590] scsi 0:0:83:0: SSP: handle(0x0078), sas_addr(0x5000c50095432555), phy(21), device_name(0x5000c50095432554) [ 26.824278] scsi 0:0:83:0: enclosure logical id(0x5001636001a44e7d), slot(21) [ 26.831497] scsi 0:0:83:0: enclosure level(0x0000), connector name( C3 ) [ 26.838303] scsi 0:0:83:0: serial_number(ZA1AGMX60000C8316HBX) [ 26.844134] scsi 0:0:83:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 26.867482] mpt3sas_cm0: detecting: handle(0x0079), sas_address(0x5000c500954311d5), phy(22) [ 26.875920] mpt3sas_cm0: REPORT_LUNS: handle(0x0079), retries(0) [ 26.882506] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0079), lun(0) [ 27.141968] scsi 0:0:84:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 27.150639] scsi 0:0:84:0: SSP: handle(0x0079), sas_addr(0x5000c500954311d5), phy(22), device_name(0x5000c500954311d4) [ 27.161325] scsi 0:0:84:0: enclosure logical id(0x5001636001a44e7d), slot(22) [ 27.168545] scsi 0:0:84:0: enclosure level(0x0000), connector name( C3 ) [ 27.175337] scsi 0:0:84:0: serial_number(ZA1AGHFG0000C8316HCM) [ 27.181176] scsi 0:0:84:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 27.203887] mpt3sas_cm0: detecting: handle(0x007a), sas_address(0x5000c50095431e61), phy(23) [ 27.212326] mpt3sas_cm0: REPORT_LUNS: handle(0x007a), retries(0) [ 27.218895] mpt3sas_cm0: TEST_UNIT_READY: handle(0x007a), lun(0) [ 27.470766] scsi 0:0:85:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 27.479441] scsi 0:0:85:0: SSP: handle(0x007a), sas_addr(0x5000c50095431e61), phy(23), device_name(0x5000c50095431e60) [ 27.490124] scsi 0:0:85:0: enclosure logical id(0x5001636001a44e7d), slot(23) [ 27.497343] scsi 0:0:85:0: enclosure level(0x0000), connector name( C3 ) [ 27.504134] scsi 0:0:85:0: serial_number(ZA1AGN4D0000R829CUEP) [ 27.509966] scsi 0:0:85:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 27.532889] mpt3sas_cm0: detecting: handle(0x0083), sas_address(0x5000c500954ded89), phy(24) [ 27.541325] mpt3sas_cm0: REPORT_LUNS: handle(0x0083), retries(0) [ 27.561248] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0083), lun(0) [ 27.568381] scsi 0:0:86:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 27.576963] scsi 0:0:86:0: SSP: handle(0x0083), sas_addr(0x5000c500954ded89), phy(24), device_name(0x5000c500954ded88) [ 27.587651] scsi 0:0:86:0: enclosure logical id(0x5001636001a44e7d), slot(24) [ 27.594870] scsi 0:0:86:0: enclosure level(0x0000), connector name( C3 ) [ 27.601675] scsi 0:0:86:0: serial_number(ZA1AM29Z0000R8302WBT) [ 27.607510] scsi 0:0:86:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 27.639889] mpt3sas_cm0: detecting: handle(0x0084), sas_address(0x5000c500954da965), phy(25) [ 27.648324] mpt3sas_cm0: REPORT_LUNS: handle(0x0084), retries(0) [ 27.654814] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0084), lun(0) [ 27.675383] scsi 0:0:87:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 27.683940] scsi 0:0:87:0: SSP: handle(0x0084), sas_addr(0x5000c500954da965), phy(25), device_name(0x5000c500954da964) [ 27.694624] scsi 0:0:87:0: enclosure logical id(0x5001636001a44e7d), slot(25) [ 27.701845] scsi 0:0:87:0: enclosure level(0x0000), connector name( C3 ) [ 27.708634] scsi 0:0:87:0: serial_number(ZA1AM3DD0000R83144S2) [ 27.714464] scsi 0:0:87:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 27.737889] mpt3sas_cm0: detecting: handle(0x0085), sas_address(0x5000c500954de131), phy(26) [ 27.746327] mpt3sas_cm0: REPORT_LUNS: handle(0x0085), retries(0) [ 27.752898] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0085), lun(0) [ 28.005589] scsi 0:0:88:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 28.049354] scsi 0:0:88:0: SSP: handle(0x0085), sas_addr(0x5000c500954de131), phy(26), device_name(0x5000c500954de130) [ 28.060041] scsi 0:0:88:0: enclosure logical id(0x5001636001a44e7d), slot(26) [ 28.067259] scsi 0:0:88:0: enclosure level(0x0000), connector name( C3 ) [ 28.074068] scsi 0:0:88:0: serial_number(ZA1AM5RA0000R8317NVM) [ 28.079908] scsi 0:0:88:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 28.144892] mpt3sas_cm0: detecting: handle(0x0086), sas_address(0x5000c50095431d91), phy(27) [ 28.153326] mpt3sas_cm0: REPORT_LUNS: handle(0x0086), retries(0) [ 28.159887] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0086), lun(0) [ 28.416730] scsi 0:0:89:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 28.425421] scsi 0:0:89:0: SSP: handle(0x0086), sas_addr(0x5000c50095431d91), phy(27), device_name(0x5000c50095431d90) [ 28.436108] scsi 0:0:89:0: enclosure logical id(0x5001636001a44e7d), slot(27) [ 28.443327] scsi 0:0:89:0: enclosure level(0x0000), connector name( C3 ) [ 28.450117] scsi 0:0:89:0: serial_number(ZA1AGH230000C8316HM5) [ 28.455947] scsi 0:0:89:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 28.478891] mpt3sas_cm0: detecting: handle(0x0087), sas_address(0x5000c50095430dfd), phy(28) [ 28.487324] mpt3sas_cm0: REPORT_LUNS: handle(0x0087), retries(0) [ 28.493804] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0087), lun(0) [ 28.500910] scsi 0:0:90:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 28.509485] scsi 0:0:90:0: SSP: handle(0x0087), sas_addr(0x5000c50095430dfd), phy(28), device_name(0x5000c50095430dfc) [ 28.520167] scsi 0:0:90:0: enclosure logical id(0x5001636001a44e7d), slot(28) [ 28.527387] scsi 0:0:90:0: enclosure level(0x0000), connector name( C3 ) [ 28.534192] scsi 0:0:90:0: serial_number(ZA1AG8BL0000C8316F5Y) [ 28.540024] scsi 0:0:90:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 28.562891] mpt3sas_cm0: detecting: handle(0x0088), sas_address(0x5000c50095432335), phy(29) [ 28.571330] mpt3sas_cm0: REPORT_LUNS: handle(0x0088), retries(0) [ 28.578100] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0088), lun(0) [ 28.585226] scsi 0:0:91:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 28.593799] scsi 0:0:91:0: SSP: handle(0x0088), sas_addr(0x5000c50095432335), phy(29), device_name(0x5000c50095432334) [ 28.604485] scsi 0:0:91:0: enclosure logical id(0x5001636001a44e7d), slot(29) [ 28.611703] scsi 0:0:91:0: enclosure level(0x0000), connector name( C3 ) [ 28.618511] scsi 0:0:91:0: serial_number(ZA1AGGWT0000C8316FPB) [ 28.624343] scsi 0:0:91:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 28.646891] mpt3sas_cm0: detecting: handle(0x0089), sas_address(0x5000c50095430729), phy(30) [ 28.655328] mpt3sas_cm0: REPORT_LUNS: handle(0x0089), retries(0) [ 28.691502] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0089), lun(0) [ 28.698638] scsi 0:0:92:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 28.707223] scsi 0:0:92:0: SSP: handle(0x0089), sas_addr(0x5000c50095430729), phy(30), device_name(0x5000c50095430728) [ 28.717906] scsi 0:0:92:0: enclosure logical id(0x5001636001a44e7d), slot(30) [ 28.725125] scsi 0:0:92:0: enclosure level(0x0000), connector name( C3 ) [ 28.731931] scsi 0:0:92:0: serial_number(ZA1AG3FE0000C83152QT) [ 28.737764] scsi 0:0:92:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 28.760893] mpt3sas_cm0: detecting: handle(0x008a), sas_address(0x5000c50095431079), phy(31) [ 28.769331] mpt3sas_cm0: REPORT_LUNS: handle(0x008a), retries(0) [ 28.775900] mpt3sas_cm0: TEST_UNIT_READY: handle(0x008a), lun(0) [ 29.047600] scsi 0:0:93:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 29.056284] scsi 0:0:93:0: SSP: handle(0x008a), sas_addr(0x5000c50095431079), phy(31), device_name(0x5000c50095431078) [ 29.066967] scsi 0:0:93:0: enclosure logical id(0x5001636001a44e7d), slot(31) [ 29.074186] scsi 0:0:93:0: enclosure level(0x0000), connector name( C3 ) [ 29.080978] scsi 0:0:93:0: serial_number(ZA1AGHHF0000R8238R8V) [ 29.086818] scsi 0:0:93:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 29.131897] mpt3sas_cm0: detecting: handle(0x0093), sas_address(0x5000c500954df569), phy(32) [ 29.140337] mpt3sas_cm0: REPORT_LUNS: handle(0x0093), retries(0) [ 29.157320] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0093), lun(0) [ 29.164566] scsi 0:0:94:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 29.173135] scsi 0:0:94:0: SSP: handle(0x0093), sas_addr(0x5000c500954df569), phy(32), device_name(0x5000c500954df568) [ 29.183822] scsi 0:0:94:0: enclosure logical id(0x5001636001a44e7d), slot(32) [ 29.191040] scsi 0:0:94:0: enclosure level(0x0000), connector name( C3 ) [ 29.197847] scsi 0:0:94:0: serial_number(ZA1AM5CY0000R8317LL3) [ 29.203680] scsi 0:0:94:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 29.226897] mpt3sas_cm0: detecting: handle(0x0094), sas_address(0x5000c50095431931), phy(33) [ 29.235334] mpt3sas_cm0: REPORT_LUNS: handle(0x0094), retries(0) [ 29.250007] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0094), lun(0) [ 29.257136] scsi 0:0:95:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 29.265713] scsi 0:0:95:0: SSP: handle(0x0094), sas_addr(0x5000c50095431931), phy(33), device_name(0x5000c50095431930) [ 29.276400] scsi 0:0:95:0: enclosure logical id(0x5001636001a44e7d), slot(33) [ 29.283618] scsi 0:0:95:0: enclosure level(0x0000), connector name( C3 ) [ 29.290424] scsi 0:0:95:0: serial_number(ZA1AGN8V0000C8316GJF) [ 29.296258] scsi 0:0:95:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 29.319898] mpt3sas_cm0: detecting: handle(0x0095), sas_address(0x5000c500954dad25), phy(34) [ 29.328335] mpt3sas_cm0: REPORT_LUNS: handle(0x0095), retries(0) [ 29.334780] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0095), lun(0) [ 29.341872] scsi 0:0:96:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 29.350441] scsi 0:0:96:0: SSP: handle(0x0095), sas_addr(0x5000c500954dad25), phy(34), device_name(0x5000c500954dad24) [ 29.361127] scsi 0:0:96:0: enclosure logical id(0x5001636001a44e7d), slot(34) [ 29.368344] scsi 0:0:96:0: enclosure level(0x0000), connector name( C3 ) [ 29.375151] scsi 0:0:96:0: serial_number(ZA1AM6RJ0000R83180VQ) [ 29.380984] scsi 0:0:96:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 29.404900] mpt3sas_cm0: detecting: handle(0x0096), sas_address(0x5000c500954d1439), phy(35) [ 29.413339] mpt3sas_cm0: REPORT_LUNS: handle(0x0096), retries(0) [ 29.419896] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0096), lun(0) [ 29.673967] scsi 0:0:97:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 29.682643] scsi 0:0:97:0: SSP: handle(0x0096), sas_addr(0x5000c500954d1439), phy(35), device_name(0x5000c500954d1438) [ 29.693331] scsi 0:0:97:0: enclosure logical id(0x5001636001a44e7d), slot(35) [ 29.700550] scsi 0:0:97:0: enclosure level(0x0000), connector name( C3 ) [ 29.707342] scsi 0:0:97:0: serial_number(ZA1AA60J0000R8314VAR) [ 29.713179] scsi 0:0:97:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 29.736904] mpt3sas_cm0: detecting: handle(0x0097), sas_address(0x5000c5009543120d), phy(36) [ 29.745344] mpt3sas_cm0: REPORT_LUNS: handle(0x0097), retries(0) [ 29.761602] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0097), lun(0) [ 29.768714] scsi 0:0:98:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 29.777293] scsi 0:0:98:0: SSP: handle(0x0097), sas_addr(0x5000c5009543120d), phy(36), device_name(0x5000c5009543120c) [ 29.787980] scsi 0:0:98:0: enclosure logical id(0x5001636001a44e7d), slot(36) [ 29.795198] scsi 0:0:98:0: enclosure level(0x0000), connector name( C3 ) [ 29.802006] scsi 0:0:98:0: serial_number(ZA1AGHF40000C8316HJ5) [ 29.807836] scsi 0:0:98:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 29.830900] mpt3sas_cm0: detecting: handle(0x0098), sas_address(0x5000c50095432541), phy(37) [ 29.839334] mpt3sas_cm0: REPORT_LUNS: handle(0x0098), retries(0) [ 29.859025] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0098), lun(0) [ 29.866141] scsi 0:0:99:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 29.874718] scsi 0:0:99:0: SSP: handle(0x0098), sas_addr(0x5000c50095432541), phy(37), device_name(0x5000c50095432540) [ 29.885402] scsi 0:0:99:0: enclosure logical id(0x5001636001a44e7d), slot(37) [ 29.892623] scsi 0:0:99:0: enclosure level(0x0000), connector name( C3 ) [ 29.899430] scsi 0:0:99:0: serial_number(ZA1AGMXL0000C8316HCY) [ 29.905259] scsi 0:0:99:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 29.927903] mpt3sas_cm0: detecting: handle(0x0099), sas_address(0x5000c50095431811), phy(38) [ 29.936342] mpt3sas_cm0: REPORT_LUNS: handle(0x0099), retries(0) [ 29.942916] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0099), lun(0) [ 30.199250] scsi 0:0:100:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 30.208013] scsi 0:0:100:0: SSP: handle(0x0099), sas_addr(0x5000c50095431811), phy(38), device_name(0x5000c50095431810) [ 30.218787] scsi 0:0:100:0: enclosure logical id(0x5001636001a44e7d), slot(38) [ 30.226093] scsi 0:0:100:0: enclosure level(0x0000), connector name( C3 ) [ 30.232970] scsi 0:0:100:0: serial_number(ZA1AGH920000C8316H71) [ 30.238894] scsi 0:0:100:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 30.262898] mpt3sas_cm0: detecting: handle(0x009a), sas_address(0x5000c500954da449), phy(39) [ 30.271335] mpt3sas_cm0: REPORT_LUNS: handle(0x009a), retries(0) [ 30.277904] mpt3sas_cm0: TEST_UNIT_READY: handle(0x009a), lun(0) [ 30.582542] scsi 0:0:101:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 30.591305] scsi 0:0:101:0: SSP: handle(0x009a), sas_addr(0x5000c500954da449), phy(39), device_name(0x5000c500954da448) [ 30.602080] scsi 0:0:101:0: enclosure logical id(0x5001636001a44e7d), slot(39) [ 30.609388] scsi 0:0:101:0: enclosure level(0x0000), connector name( C3 ) [ 30.616264] scsi 0:0:101:0: serial_number(ZA1AM3H20000R8303HLY) [ 30.622182] scsi 0:0:101:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 30.644899] mpt3sas_cm0: detecting: handle(0x00a3), sas_address(0x5000c50095430ae9), phy(40) [ 30.653332] mpt3sas_cm0: REPORT_LUNS: handle(0x00a3), retries(0) [ 30.674258] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00a3), lun(0) [ 30.681415] scsi 0:0:102:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 30.690082] scsi 0:0:102:0: SSP: handle(0x00a3), sas_addr(0x5000c50095430ae9), phy(40), device_name(0x5000c50095430ae8) [ 30.700855] scsi 0:0:102:0: enclosure logical id(0x5001636001a44e7d), slot(40) [ 30.708161] scsi 0:0:102:0: enclosure level(0x0000), connector name( C3 ) [ 30.715055] scsi 0:0:102:0: serial_number(ZA1AG3D90000R825141Y) [ 30.720976] scsi 0:0:102:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 30.747906] mpt3sas_cm0: detecting: handle(0x00a4), sas_address(0x5000c500954313a5), phy(41) [ 30.756349] mpt3sas_cm0: REPORT_LUNS: handle(0x00a4), retries(0) [ 30.778494] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00a4), lun(0) [ 30.785616] scsi 0:0:103:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 30.794282] scsi 0:0:103:0: SSP: handle(0x00a4), sas_addr(0x5000c500954313a5), phy(41), device_name(0x5000c500954313a4) [ 30.805056] scsi 0:0:103:0: enclosure logical id(0x5001636001a44e7d), slot(41) [ 30.812361] scsi 0:0:103:0: enclosure level(0x0000), connector name( C3 ) [ 30.819255] scsi 0:0:103:0: serial_number(ZA1AGHD50000R723LAMH) [ 30.825175] scsi 0:0:103:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 30.847906] mpt3sas_cm0: detecting: handle(0x00a5), sas_address(0x5000c500954dfd1d), phy(42) [ 30.856343] mpt3sas_cm0: REPORT_LUNS: handle(0x00a5), retries(0) [ 30.862911] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00a5), lun(0) [ 31.122055] scsi 0:0:104:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 31.130821] scsi 0:0:104:0: SSP: handle(0x00a5), sas_addr(0x5000c500954dfd1d), phy(42), device_name(0x5000c500954dfd1c) [ 31.141593] scsi 0:0:104:0: enclosure logical id(0x5001636001a44e7d), slot(42) [ 31.148900] scsi 0:0:104:0: enclosure level(0x0000), connector name( C3 ) [ 31.155779] scsi 0:0:104:0: serial_number(ZA1AM58X0000R8314R2L) [ 31.161704] scsi 0:0:104:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 31.185908] mpt3sas_cm0: detecting: handle(0x00a6), sas_address(0x5000c500954d3031), phy(43) [ 31.194346] mpt3sas_cm0: REPORT_LUNS: handle(0x00a6), retries(0) [ 31.200908] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00a6), lun(0) [ 31.457577] scsi 0:0:105:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 31.466334] scsi 0:0:105:0: SSP: handle(0x00a6), sas_addr(0x5000c500954d3031), phy(43), device_name(0x5000c500954d3030) [ 31.477110] scsi 0:0:105:0: enclosure logical id(0x5001636001a44e7d), slot(43) [ 31.484417] scsi 0:0:105:0: enclosure level(0x0000), connector name( C3 ) [ 31.491293] scsi 0:0:105:0: serial_number(ZA1ALV4B0000R8302VPE) [ 31.497211] scsi 0:0:105:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 31.520504] mpt3sas_cm0: detecting: handle(0x00a7), sas_address(0x5000c500954ddf89), phy(44) [ 31.528942] mpt3sas_cm0: REPORT_LUNS: handle(0x00a7), retries(0) [ 31.545151] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00a7), lun(0) [ 31.552290] scsi 0:0:106:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 31.560949] scsi 0:0:106:0: SSP: handle(0x00a7), sas_addr(0x5000c500954ddf89), phy(44), device_name(0x5000c500954ddf88) [ 31.571723] scsi 0:0:106:0: enclosure logical id(0x5001636001a44e7d), slot(44) [ 31.579029] scsi 0:0:106:0: enclosure level(0x0000), connector name( C3 ) [ 31.585926] scsi 0:0:106:0: serial_number(ZA1AM5RJ0000R8317N4L) [ 31.591852] scsi 0:0:106:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 31.614912] mpt3sas_cm0: detecting: handle(0x00a8), sas_address(0x5000c500954cd5b1), phy(45) [ 31.623348] mpt3sas_cm0: REPORT_LUNS: handle(0x00a8), retries(0) [ 31.642783] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00a8), lun(0) [ 31.649911] scsi 0:0:107:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 31.658569] scsi 0:0:107:0: SSP: handle(0x00a8), sas_addr(0x5000c500954cd5b1), phy(45), device_name(0x5000c500954cd5b0) [ 31.669339] scsi 0:0:107:0: enclosure logical id(0x5001636001a44e7d), slot(45) [ 31.676645] scsi 0:0:107:0: enclosure level(0x0000), connector name( C3 ) [ 31.683537] scsi 0:0:107:0: serial_number(ZA1ALGAG0000R8314S6M) [ 31.689455] scsi 0:0:107:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 31.712906] mpt3sas_cm0: detecting: handle(0x00a9), sas_address(0x5000c500954dbcc9), phy(46) [ 31.721343] mpt3sas_cm0: REPORT_LUNS: handle(0x00a9), retries(0) [ 31.758026] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00a9), lun(0) [ 31.765172] scsi 0:0:108:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 31.773844] scsi 0:0:108:0: SSP: handle(0x00a9), sas_addr(0x5000c500954dbcc9), phy(46), device_name(0x5000c500954dbcc8) [ 31.784614] scsi 0:0:108:0: enclosure logical id(0x5001636001a44e7d), slot(46) [ 31.791919] scsi 0:0:108:0: enclosure level(0x0000), connector name( C3 ) [ 31.798812] scsi 0:0:108:0: serial_number(ZA1AM3460000R8314UPK) [ 31.804732] scsi 0:0:108:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 31.827921] mpt3sas_cm0: detecting: handle(0x00aa), sas_address(0x5000c500954e0d69), phy(47) [ 31.836360] mpt3sas_cm0: REPORT_LUNS: handle(0x00aa), retries(0) [ 31.842922] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00aa), lun(0) [ 32.096970] scsi 0:0:109:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 32.105729] scsi 0:0:109:0: SSP: handle(0x00aa), sas_addr(0x5000c500954e0d69), phy(47), device_name(0x5000c500954e0d68) [ 32.116498] scsi 0:0:109:0: enclosure logical id(0x5001636001a44e7d), slot(47) [ 32.123804] scsi 0:0:109:0: enclosure level(0x0000), connector name( C3 ) [ 32.130684] scsi 0:0:109:0: serial_number(ZA1AM51C0000R8317NH2) [ 32.136608] scsi 0:0:109:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 32.159910] mpt3sas_cm0: detecting: handle(0x00b3), sas_address(0x5000c5009544642d), phy(48) [ 32.168349] mpt3sas_cm0: REPORT_LUNS: handle(0x00b3), retries(0) [ 32.189852] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00b3), lun(0) [ 32.196954] scsi 0:0:110:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 32.205619] scsi 0:0:110:0: SSP: handle(0x00b3), sas_addr(0x5000c5009544642d), phy(48), device_name(0x5000c5009544642c) [ 32.216391] scsi 0:0:110:0: enclosure logical id(0x5001636001a44e7d), slot(48) [ 32.223697] scsi 0:0:110:0: enclosure level(0x0000), connector name( C3 ) [ 32.230591] scsi 0:0:110:0: serial_number(ZA1AGTE90000C831BTEF) [ 32.236509] scsi 0:0:110:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 32.262919] mpt3sas_cm0: detecting: handle(0x00b4), sas_address(0x5000c50095430b31), phy(49) [ 32.271362] mpt3sas_cm0: REPORT_LUNS: handle(0x00b4), retries(0) [ 32.286055] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00b4), lun(0) [ 32.293167] scsi 0:0:111:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 32.301834] scsi 0:0:111:0: SSP: handle(0x00b4), sas_addr(0x5000c50095430b31), phy(49), device_name(0x5000c50095430b30) [ 32.312611] scsi 0:0:111:0: enclosure logical id(0x5001636001a44e7d), slot(49) [ 32.319917] scsi 0:0:111:0: enclosure level(0x0000), connector name( C3 ) [ 32.326809] scsi 0:0:111:0: serial_number(ZA1AC2N80000R8301BGB) [ 32.332727] scsi 0:0:111:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 32.355914] mpt3sas_cm0: detecting: handle(0x00b5), sas_address(0x5000c500954311a9), phy(50) [ 32.364358] mpt3sas_cm0: REPORT_LUNS: handle(0x00b5), retries(0) [ 32.370921] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00b5), lun(0) [ 32.630684] scsi 0:0:112:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 32.639447] scsi 0:0:112:0: SSP: handle(0x00b5), sas_addr(0x5000c500954311a9), phy(50), device_name(0x5000c500954311a8) [ 32.650222] scsi 0:0:112:0: enclosure logical id(0x5001636001a44e7d), slot(50) [ 32.657529] scsi 0:0:112:0: enclosure level(0x0000), connector name( C3 ) [ 32.664406] scsi 0:0:112:0: serial_number(ZA1AGHFR0000R8300PAL) [ 32.670331] scsi 0:0:112:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 32.691915] mpt3sas_cm0: detecting: handle(0x00b6), sas_address(0x5000c500954463ad), phy(51) [ 32.700358] mpt3sas_cm0: REPORT_LUNS: handle(0x00b6), retries(0) [ 32.706919] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00b6), lun(0) [ 32.959602] scsi 0:0:113:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 32.968355] scsi 0:0:113:0: SSP: handle(0x00b6), sas_addr(0x5000c500954463ad), phy(51), device_name(0x5000c500954463ac) [ 32.979124] scsi 0:0:113:0: enclosure logical id(0x5001636001a44e7d), slot(51) [ 32.986430] scsi 0:0:113:0: enclosure level(0x0000), connector name( C3 ) [ 32.993306] scsi 0:0:113:0: serial_number(ZA1AGTFF0000R8251WAN) [ 32.999224] scsi 0:0:113:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 33.021916] mpt3sas_cm0: detecting: handle(0x00b7), sas_address(0x5000c500954d92b1), phy(52) [ 33.030353] mpt3sas_cm0: REPORT_LUNS: handle(0x00b7), retries(0) [ 33.041878] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00b7), lun(0) [ 33.049000] scsi 0:0:114:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 33.057666] scsi 0:0:114:0: SSP: handle(0x00b7), sas_addr(0x5000c500954d92b1), phy(52), device_name(0x5000c500954d92b0) [ 33.068435] scsi 0:0:114:0: enclosure logical id(0x5001636001a44e7d), slot(52) [ 33.075741] scsi 0:0:114:0: enclosure level(0x0000), connector name( C3 ) [ 33.082634] scsi 0:0:114:0: serial_number(ZA1AM7GN0000R8317MAH) [ 33.088553] scsi 0:0:114:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 33.114922] mpt3sas_cm0: detecting: handle(0x00b8), sas_address(0x5000c5009537fadd), phy(53) [ 33.123361] mpt3sas_cm0: REPORT_LUNS: handle(0x00b8), retries(0) [ 33.133157] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00b8), lun(0) [ 33.140288] scsi 0:0:115:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 33.148950] scsi 0:0:115:0: SSP: handle(0x00b8), sas_addr(0x5000c5009537fadd), phy(53), device_name(0x5000c5009537fadc) [ 33.159723] scsi 0:0:115:0: enclosure logical id(0x5001636001a44e7d), slot(53) [ 33.167026] scsi 0:0:115:0: enclosure level(0x0000), connector name( C3 ) [ 33.173921] scsi 0:0:115:0: serial_number(ZA1ACJHL0000R829D8BD) [ 33.179841] scsi 0:0:115:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 33.202923] mpt3sas_cm0: detecting: handle(0x00b9), sas_address(0x5000c50095430ce5), phy(54) [ 33.211363] mpt3sas_cm0: REPORT_LUNS: handle(0x00b9), retries(0) [ 33.217925] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00b9), lun(0) [ 33.476743] scsi 0:0:116:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 33.485517] scsi 0:0:116:0: SSP: handle(0x00b9), sas_addr(0x5000c50095430ce5), phy(54), device_name(0x5000c50095430ce4) [ 33.496287] scsi 0:0:116:0: enclosure logical id(0x5001636001a44e7d), slot(54) [ 33.503593] scsi 0:0:116:0: enclosure level(0x0000), connector name( C3 ) [ 33.510487] scsi 0:0:116:0: serial_number(ZA1AGHLP0000C83152MK) [ 33.516403] scsi 0:0:116:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 33.539926] mpt3sas_cm0: detecting: handle(0x00ba), sas_address(0x5000c50095431089), phy(55) [ 33.548363] mpt3sas_cm0: REPORT_LUNS: handle(0x00ba), retries(0) [ 33.554845] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00ba), lun(0) [ 33.561988] scsi 0:0:117:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 33.570654] scsi 0:0:117:0: SSP: handle(0x00ba), sas_addr(0x5000c50095431089), phy(55), device_name(0x5000c50095431088) [ 33.581428] scsi 0:0:117:0: enclosure logical id(0x5001636001a44e7d), slot(55) [ 33.588734] scsi 0:0:117:0: enclosure level(0x0000), connector name( C3 ) [ 33.595629] scsi 0:0:117:0: serial_number(ZA1AGHH90000R8301C59) [ 33.601555] scsi 0:0:117:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 33.624925] mpt3sas_cm0: detecting: handle(0x00c3), sas_address(0x5000c500954da281), phy(56) [ 33.633374] mpt3sas_cm0: REPORT_LUNS: handle(0x00c3), retries(0) [ 33.641003] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00c3), lun(0) [ 33.666334] scsi 0:0:118:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 33.682084] scsi 0:0:118:0: SSP: handle(0x00c3), sas_addr(0x5000c500954da281), phy(56), device_name(0x5000c500954da280) [ 33.692856] scsi 0:0:118:0: enclosure logical id(0x5001636001a44e7d), slot(56) [ 33.700162] scsi 0:0:118:0: enclosure level(0x0000), connector name( C3 ) [ 33.707056] scsi 0:0:118:0: serial_number(ZA1AM3JC0000R830289W) [ 33.712974] scsi 0:0:118:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 33.735925] mpt3sas_cm0: detecting: handle(0x00c4), sas_address(0x5000c500954d9aa1), phy(57) [ 33.744359] mpt3sas_cm0: REPORT_LUNS: handle(0x00c4), retries(0) [ 33.750839] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00c4), lun(0) [ 33.757945] scsi 0:0:119:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 33.766603] scsi 0:0:119:0: SSP: handle(0x00c4), sas_addr(0x5000c500954d9aa1), phy(57), device_name(0x5000c500954d9aa0) [ 33.777375] scsi 0:0:119:0: enclosure logical id(0x5001636001a44e7d), slot(57) [ 33.784681] scsi 0:0:119:0: enclosure level(0x0000), connector name( C3 ) [ 33.791573] scsi 0:0:119:0: serial_number(ZA1A7NPW0000R8301C8L) [ 33.797491] scsi 0:0:119:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 33.820934] mpt3sas_cm0: detecting: handle(0x00c5), sas_address(0x5000c500954dcd85), phy(58) [ 33.829373] mpt3sas_cm0: REPORT_LUNS: handle(0x00c5), retries(0) [ 33.835943] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00c5), lun(0) [ 34.092623] scsi 0:0:120:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 34.101394] scsi 0:0:120:0: SSP: handle(0x00c5), sas_addr(0x5000c500954dcd85), phy(58), device_name(0x5000c500954dcd84) [ 34.112170] scsi 0:0:120:0: enclosure logical id(0x5001636001a44e7d), slot(58) [ 34.119477] scsi 0:0:120:0: enclosure level(0x0000), connector name( C3 ) [ 34.126354] scsi 0:0:120:0: serial_number(ZA1AM65H0000R8314RX2) [ 34.132269] scsi 0:0:120:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 34.160933] mpt3sas_cm0: detecting: handle(0x00c6), sas_address(0x5000c500954dc60d), phy(59) [ 34.169368] mpt3sas_cm0: REPORT_LUNS: handle(0x00c6), retries(0) [ 34.175932] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00c6), lun(0) [ 34.431047] scsi 0:0:121:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 34.439813] scsi 0:0:121:0: SSP: handle(0x00c6), sas_addr(0x5000c500954dc60d), phy(59), device_name(0x5000c500954dc60c) [ 34.450589] scsi 0:0:121:0: enclosure logical id(0x5001636001a44e7d), slot(59) [ 34.457896] scsi 0:0:121:0: enclosure level(0x0000), connector name( C3 ) [ 34.464775] scsi 0:0:121:0: serial_number(ZA1AM3010000R8313J50) [ 34.470700] scsi 0:0:121:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 34.495077] mpt3sas_cm0: detecting: handle(0x00cd), sas_address(0x5001636001a44e7d), phy(76) [ 34.503528] mpt3sas_cm0: REPORT_LUNS: handle(0x00cd), retries(0) [ 34.509725] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00cd), lun(0) [ 34.516214] scsi 0:0:122:0: Enclosure QCT JB4602 SIM 0 1500 PQ: 0 ANSI: 6 [ 34.524687] scsi 0:0:122:0: set ignore_delay_remove for handle(0x00cd) [ 34.531216] scsi 0:0:122:0: SES: handle(0x00cd), sas_addr(0x5001636001a44e7d), phy(76), device_name(0x5001636001a44e7d) [ 34.541989] scsi 0:0:122:0: enclosure logical id(0x5001636001a44e7d), slot(60) [ 34.549295] scsi 0:0:122:0: enclosure level(0x0000), connector name( C3 ) [ 34.556190] scsi 0:0:122:0: serial_number(EO0153600090 ) [ 34.561773] scsi 0:0:122:0: qdepth(1), tagged(0), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 34.582342] mpt3sas_cm0: expander_add: handle(0x0052), parent(0x000a), sas_addr(0x5001636001a44d3f), phys(79) [ 34.606109] mpt3sas_cm0: detecting: handle(0x005b), sas_address(0x5000c50095431a16), phy(0) [ 34.614476] mpt3sas_cm0: REPORT_LUNS: handle(0x005b), retries(0) [ 34.634256] mpt3sas_cm0: TEST_UNIT_READY: handle(0x005b), lun(0) [ 34.641525] scsi 0:0:123:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 34.650205] scsi 0:0:123:0: SSP: handle(0x005b), sas_addr(0x5000c50095431a16), phy(0), device_name(0x5000c50095431a14) [ 34.660889] scsi 0:0:123:0: enclosure logical id(0x5001636001a44d3d), slot(0) [ 34.668107] scsi 0:0:123:0: enclosure level(0x0000), connector name( C0 ) [ 34.674998] scsi 0:0:123:0: serial_number(ZA1AGH620000R829D5X1) [ 34.680918] scsi 0:0:123:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 34.703934] mpt3sas_cm0: detecting: handle(0x005c), sas_address(0x5000c50095431052), phy(1) [ 34.712286] mpt3sas_cm0: REPORT_LUNS: handle(0x005c), retries(0) [ 34.725034] mpt3sas_cm0: TEST_UNIT_READY: handle(0x005c), lun(0) [ 34.732158] scsi 0:0:124:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 34.740818] scsi 0:0:124:0: SSP: handle(0x005c), sas_addr(0x5000c50095431052), phy(1), device_name(0x5000c50095431050) [ 34.751506] scsi 0:0:124:0: enclosure logical id(0x5001636001a44d3d), slot(1) [ 34.758726] scsi 0:0:124:0: enclosure level(0x0000), connector name( C0 ) [ 34.765619] scsi 0:0:124:0: serial_number(ZA1AGHHR0000R8301TBN) [ 34.771539] scsi 0:0:124:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 34.801928] mpt3sas_cm0: detecting: handle(0x005d), sas_address(0x5000c500954309c2), phy(2) [ 34.810298] mpt3sas_cm0: REPORT_LUNS: handle(0x005d), retries(0) [ 34.823691] mpt3sas_cm0: TEST_UNIT_READY: handle(0x005d), lun(0) [ 34.830816] scsi 0:0:125:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 34.839483] scsi 0:0:125:0: SSP: handle(0x005d), sas_addr(0x5000c500954309c2), phy(2), device_name(0x5000c500954309c0) [ 34.850168] scsi 0:0:125:0: enclosure logical id(0x5001636001a44d3d), slot(2) [ 34.857388] scsi 0:0:125:0: enclosure level(0x0000), connector name( C0 ) [ 34.864279] scsi 0:0:125:0: serial_number(ZA1AG3BT0000C83152KW) [ 34.870201] scsi 0:0:125:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 34.892935] mpt3sas_cm0: detecting: handle(0x005e), sas_address(0x5000c500954328a6), phy(3) [ 34.901291] mpt3sas_cm0: REPORT_LUNS: handle(0x005e), retries(0) [ 34.907839] mpt3sas_cm0: TEST_UNIT_READY: handle(0x005e), lun(0) [ 34.914957] scsi 0:0:126:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 34.923621] scsi 0:0:126:0: SSP: handle(0x005e), sas_addr(0x5000c500954328a6), phy(3), device_name(0x5000c500954328a4) [ 34.934307] scsi 0:0:126:0: enclosure logical id(0x5001636001a44d3d), slot(3) [ 34.941524] scsi 0:0:126:0: enclosure level(0x0000), connector name( C0 ) [ 34.948419] scsi 0:0:126:0: serial_number(ZA1AGGN20000C8316FRL) [ 34.954336] scsi 0:0:126:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 34.976933] mpt3sas_cm0: detecting: handle(0x005f), sas_address(0x5000c50095432ab2), phy(4) [ 34.985289] mpt3sas_cm0: REPORT_LUNS: handle(0x005f), retries(0) [ 34.992058] mpt3sas_cm0: TEST_UNIT_READY: handle(0x005f), lun(0) [ 34.999203] scsi 0:0:127:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 35.007870] scsi 0:0:127:0: SSP: handle(0x005f), sas_addr(0x5000c50095432ab2), phy(4), device_name(0x5000c50095432ab0) [ 35.018556] scsi 0:0:127:0: enclosure logical id(0x5001636001a44d3d), slot(4) [ 35.025774] scsi 0:0:127:0: enclosure level(0x0000), connector name( C0 ) [ 35.032668] scsi 0:0:127:0: serial_number(ZA1AGGK30000R82896AK) [ 35.038585] scsi 0:0:127:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 35.102968] mpt3sas_cm0: detecting: handle(0x0060), sas_address(0x5000c50095431cf2), phy(5) [ 35.111334] mpt3sas_cm0: REPORT_LUNS: handle(0x0060), retries(0) [ 35.127042] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0060), lun(0) [ 35.136245] scsi 0:0:128:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 35.152042] scsi 0:0:128:0: SSP: handle(0x0060), sas_addr(0x5000c50095431cf2), phy(5), device_name(0x5000c50095431cf0) [ 35.162727] scsi 0:0:128:0: enclosure logical id(0x5001636001a44d3d), slot(5) [ 35.169946] scsi 0:0:128:0: enclosure level(0x0000), connector name( C0 ) [ 35.176840] scsi 0:0:128:0: serial_number(ZA1AGH2M0000R727YQVD) [ 35.182758] scsi 0:0:128:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 35.206935] mpt3sas_cm0: detecting: handle(0x0061), sas_address(0x5000c5009542ec9a), phy(6) [ 35.215286] mpt3sas_cm0: REPORT_LUNS: handle(0x0061), retries(0) [ 35.229021] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0061), lun(0) [ 35.236124] scsi 0:0:129:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 35.244803] scsi 0:0:129:0: SSP: handle(0x0061), sas_addr(0x5000c5009542ec9a), phy(6), device_name(0x5000c5009542ec98) [ 35.255486] scsi 0:0:129:0: enclosure logical id(0x5001636001a44d3d), slot(6) [ 35.262705] scsi 0:0:129:0: enclosure level(0x0000), connector name( C0 ) [ 35.269597] scsi 0:0:129:0: serial_number(ZA1AG9AP0000R830X69R) [ 35.275516] scsi 0:0:129:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 35.304941] mpt3sas_cm0: detecting: handle(0x0062), sas_address(0x5000c5009542a9f2), phy(7) [ 35.313292] mpt3sas_cm0: REPORT_LUNS: handle(0x0062), retries(0) [ 35.328986] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0062), lun(0) [ 35.336110] scsi 0:0:130:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 35.344774] scsi 0:0:130:0: SSP: handle(0x0062), sas_addr(0x5000c5009542a9f2), phy(7), device_name(0x5000c5009542a9f0) [ 35.355458] scsi 0:0:130:0: enclosure logical id(0x5001636001a44d3d), slot(7) [ 35.362676] scsi 0:0:130:0: enclosure level(0x0000), connector name( C0 ) [ 35.369570] scsi 0:0:130:0: serial_number(ZA1AG6DJ0000R829CTX7) [ 35.375488] scsi 0:0:130:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 35.398934] mpt3sas_cm0: detecting: handle(0x006b), sas_address(0x5000c50095430c62), phy(8) [ 35.407292] mpt3sas_cm0: REPORT_LUNS: handle(0x006b), retries(0) [ 35.413778] mpt3sas_cm0: TEST_UNIT_READY: handle(0x006b), lun(0) [ 35.420900] scsi 0:0:131:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 35.429561] scsi 0:0:131:0: SSP: handle(0x006b), sas_addr(0x5000c50095430c62), phy(8), device_name(0x5000c50095430c60) [ 35.440243] scsi 0:0:131:0: enclosure logical id(0x5001636001a44d3d), slot(8) [ 35.447462] scsi 0:0:131:0: enclosure level(0x0000), connector name( C0 ) [ 35.454355] scsi 0:0:131:0: serial_number(ZA1AG8D20000R8301QWA) [ 35.460275] scsi 0:0:131:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 35.482947] mpt3sas_cm0: detecting: handle(0x006c), sas_address(0x5000c50095430cfa), phy(9) [ 35.491296] mpt3sas_cm0: REPORT_LUNS: handle(0x006c), retries(0) [ 35.498074] mpt3sas_cm0: TEST_UNIT_READY: handle(0x006c), lun(0) [ 35.505215] scsi 0:0:132:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 35.513882] scsi 0:0:132:0: SSP: handle(0x006c), sas_addr(0x5000c50095430cfa), phy(9), device_name(0x5000c50095430cf8) [ 35.524571] scsi 0:0:132:0: enclosure logical id(0x5001636001a44d3d), slot(9) [ 35.531790] scsi 0:0:132:0: enclosure level(0x0000), connector name( C0 ) [ 35.538684] scsi 0:0:132:0: serial_number(ZA1AG8CX0000R8301BUW) [ 35.544602] scsi 0:0:132:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 35.579954] mpt3sas_cm0: detecting: handle(0x006d), sas_address(0x5000c5009542af16), phy(10) [ 35.588391] mpt3sas_cm0: REPORT_LUNS: handle(0x006d), retries(0) [ 35.602907] mpt3sas_cm0: TEST_UNIT_READY: handle(0x006d), lun(0) [ 35.610034] scsi 0:0:133:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 35.618697] scsi 0:0:133:0: SSP: handle(0x006d), sas_addr(0x5000c5009542af16), phy(10), device_name(0x5000c5009542af14) [ 35.629474] scsi 0:0:133:0: enclosure logical id(0x5001636001a44d3d), slot(10) [ 35.636780] scsi 0:0:133:0: enclosure level(0x0000), connector name( C0 ) [ 35.643678] scsi 0:0:133:0: serial_number(ZA1AGB820000R826HE40) [ 35.649601] scsi 0:0:133:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 35.672937] mpt3sas_cm0: detecting: handle(0x006e), sas_address(0x5000c500954307c2), phy(11) [ 35.681374] mpt3sas_cm0: REPORT_LUNS: handle(0x006e), retries(0) [ 35.692256] mpt3sas_cm0: TEST_UNIT_READY: handle(0x006e), lun(0) [ 35.699358] scsi 0:0:134:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 35.708019] scsi 0:0:134:0: SSP: handle(0x006e), sas_addr(0x5000c500954307c2), phy(11), device_name(0x5000c500954307c0) [ 35.718792] scsi 0:0:134:0: enclosure logical id(0x5001636001a44d3d), slot(11) [ 35.726100] scsi 0:0:134:0: enclosure level(0x0000), connector name( C0 ) [ 35.732990] scsi 0:0:134:0: serial_number(ZA1AG8HP0000R8301BEL) [ 35.738910] scsi 0:0:134:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 35.761938] mpt3sas_cm0: detecting: handle(0x006f), sas_address(0x5000c50095432aba), phy(12) [ 35.770373] mpt3sas_cm0: REPORT_LUNS: handle(0x006f), retries(0) [ 35.785497] mpt3sas_cm0: TEST_UNIT_READY: handle(0x006f), lun(0) [ 35.792612] scsi 0:0:135:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 35.801277] scsi 0:0:135:0: SSP: handle(0x006f), sas_addr(0x5000c50095432aba), phy(12), device_name(0x5000c50095432ab8) [ 35.812047] scsi 0:0:135:0: enclosure logical id(0x5001636001a44d3d), slot(12) [ 35.819354] scsi 0:0:135:0: enclosure level(0x0000), connector name( C0 ) [ 35.826246] scsi 0:0:135:0: serial_number(ZA1AGGK10000C831535S) [ 35.832164] scsi 0:0:135:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 35.854936] mpt3sas_cm0: detecting: handle(0x0070), sas_address(0x5000c50095432996), phy(13) [ 35.863377] mpt3sas_cm0: REPORT_LUNS: handle(0x0070), retries(0) [ 35.879885] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0070), lun(0) [ 35.887023] scsi 0:0:136:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 35.895688] scsi 0:0:136:0: SSP: handle(0x0070), sas_addr(0x5000c50095432996), phy(13), device_name(0x5000c50095432994) [ 35.906462] scsi 0:0:136:0: enclosure logical id(0x5001636001a44d3d), slot(13) [ 35.913767] scsi 0:0:136:0: enclosure level(0x0000), connector name( C0 ) [ 35.920662] scsi 0:0:136:0: serial_number(ZA1AGGM70000C831532T) [ 35.926581] scsi 0:0:136:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 35.949936] mpt3sas_cm0: detecting: handle(0x0071), sas_address(0x5000c5009543053a), phy(14) [ 35.958373] mpt3sas_cm0: REPORT_LUNS: handle(0x0071), retries(0) [ 35.969560] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0071), lun(0) [ 35.976658] scsi 0:0:137:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 35.985320] scsi 0:0:137:0: SSP: handle(0x0071), sas_addr(0x5000c5009543053a), phy(14), device_name(0x5000c50095430538) [ 35.996093] scsi 0:0:137:0: enclosure logical id(0x5001636001a44d3d), slot(14) [ 36.003400] scsi 0:0:137:0: enclosure level(0x0000), connector name( C0 ) [ 36.010290] scsi 0:0:137:0: serial_number(ZA1AG3GS0000R824UT1A) [ 36.016210] scsi 0:0:137:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 36.038934] mpt3sas_cm0: detecting: handle(0x0072), sas_address(0x5000c500954311f6), phy(15) [ 36.047369] mpt3sas_cm0: REPORT_LUNS: handle(0x0072), retries(0) [ 36.066440] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0072), lun(0) [ 36.073556] scsi 0:0:138:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 36.082217] scsi 0:0:138:0: SSP: handle(0x0072), sas_addr(0x5000c500954311f6), phy(15), device_name(0x5000c500954311f4) [ 36.092987] scsi 0:0:138:0: enclosure logical id(0x5001636001a44d3d), slot(15) [ 36.100294] scsi 0:0:138:0: enclosure level(0x0000), connector name( C0 ) [ 36.107186] scsi 0:0:138:0: serial_number(ZA1AGHF80000C8316HCJ) [ 36.113105] scsi 0:0:138:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 36.135936] mpt3sas_cm0: detecting: handle(0x007b), sas_address(0x5000c5009542f24a), phy(16) [ 36.144369] mpt3sas_cm0: REPORT_LUNS: handle(0x007b), retries(0) [ 36.159356] mpt3sas_cm0: TEST_UNIT_READY: handle(0x007b), lun(0) [ 36.166493] scsi 0:0:139:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 36.175151] scsi 0:0:139:0: SSP: handle(0x007b), sas_addr(0x5000c5009542f24a), phy(16), device_name(0x5000c5009542f248) [ 36.185923] scsi 0:0:139:0: enclosure logical id(0x5001636001a44d3d), slot(16) [ 36.193226] scsi 0:0:139:0: enclosure level(0x0000), connector name( C0 ) [ 36.200119] scsi 0:0:139:0: serial_number(ZA1AGAVT0000R830XCAJ) [ 36.206039] scsi 0:0:139:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 36.231936] mpt3sas_cm0: detecting: handle(0x007c), sas_address(0x5000c50095432696), phy(17) [ 36.240373] mpt3sas_cm0: REPORT_LUNS: handle(0x007c), retries(0) [ 36.257439] mpt3sas_cm0: TEST_UNIT_READY: handle(0x007c), lun(0) [ 36.274139] scsi 0:0:140:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 36.282808] scsi 0:0:140:0: SSP: handle(0x007c), sas_addr(0x5000c50095432696), phy(17), device_name(0x5000c50095432694) [ 36.293580] scsi 0:0:140:0: enclosure logical id(0x5001636001a44d3d), slot(17) [ 36.300885] scsi 0:0:140:0: enclosure level(0x0000), connector name( C0 ) [ 36.307762] scsi 0:0:140:0: serial_number(ZA1AGGVH0000R8300NRT) [ 36.313680] scsi 0:0:140:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 36.337940] mpt3sas_cm0: detecting: handle(0x007d), sas_address(0x5000c500954323fa), phy(18) [ 36.346374] mpt3sas_cm0: REPORT_LUNS: handle(0x007d), retries(0) [ 36.363776] mpt3sas_cm0: TEST_UNIT_READY: handle(0x007d), lun(0) [ 36.370898] scsi 0:0:141:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 36.379554] scsi 0:0:141:0: SSP: handle(0x007d), sas_addr(0x5000c500954323fa), phy(18), device_name(0x5000c500954323f8) [ 36.390325] scsi 0:0:141:0: enclosure logical id(0x5001636001a44d3d), slot(18) [ 36.397633] scsi 0:0:141:0: enclosure level(0x0000), connector name( C0 ) [ 36.404525] scsi 0:0:141:0: serial_number(ZA1AGMYP0000C8316H53) [ 36.410445] scsi 0:0:141:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 36.439943] mpt3sas_cm0: detecting: handle(0x007e), sas_address(0x5000c50095430d7e), phy(19) [ 36.448380] mpt3sas_cm0: REPORT_LUNS: handle(0x007e), retries(0) [ 36.465923] mpt3sas_cm0: TEST_UNIT_READY: handle(0x007e), lun(0) [ 36.473256] scsi 0:0:142:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 36.481916] scsi 0:0:142:0: SSP: handle(0x007e), sas_addr(0x5000c50095430d7e), phy(19), device_name(0x5000c50095430d7c) [ 36.492689] scsi 0:0:142:0: enclosure logical id(0x5001636001a44d3d), slot(19) [ 36.499996] scsi 0:0:142:0: enclosure level(0x0000), connector name( C0 ) [ 36.506888] scsi 0:0:142:0: serial_number(ZA1AGHN70000C83152G5) [ 36.512807] scsi 0:0:142:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 36.537939] mpt3sas_cm0: detecting: handle(0x007f), sas_address(0x5000c500954328da), phy(20) [ 36.546376] mpt3sas_cm0: REPORT_LUNS: handle(0x007f), retries(0) [ 36.564444] mpt3sas_cm0: TEST_UNIT_READY: handle(0x007f), lun(0) [ 36.571625] scsi 0:0:143:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 36.580289] scsi 0:0:143:0: SSP: handle(0x007f), sas_addr(0x5000c500954328da), phy(20), device_name(0x5000c500954328d8) [ 36.591065] scsi 0:0:143:0: enclosure logical id(0x5001636001a44d3d), slot(20) [ 36.598371] scsi 0:0:143:0: enclosure level(0x0000), connector name( C0 ) [ 36.605262] scsi 0:0:143:0: serial_number(ZA1AGGMP0000R830XAU1) [ 36.611183] scsi 0:0:143:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 36.633941] mpt3sas_cm0: detecting: handle(0x0080), sas_address(0x5000c50095430e92), phy(21) [ 36.642377] mpt3sas_cm0: REPORT_LUNS: handle(0x0080), retries(0) [ 36.656713] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0080), lun(0) [ 36.663867] scsi 0:0:144:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 36.672527] scsi 0:0:144:0: SSP: handle(0x0080), sas_addr(0x5000c50095430e92), phy(21), device_name(0x5000c50095430e90) [ 36.683298] scsi 0:0:144:0: enclosure logical id(0x5001636001a44d3d), slot(21) [ 36.690604] scsi 0:0:144:0: enclosure level(0x0000), connector name( C0 ) [ 36.697498] scsi 0:0:144:0: serial_number(ZA1AG8LE0000C8316F7Y) [ 36.703425] scsi 0:0:144:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 36.727539] mpt3sas_cm0: detecting: handle(0x0081), sas_address(0x5000c50095431246), phy(22) [ 36.735977] mpt3sas_cm0: REPORT_LUNS: handle(0x0081), retries(0) [ 36.742520] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0081), lun(0) [ 36.749638] scsi 0:0:145:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 36.758302] scsi 0:0:145:0: SSP: handle(0x0081), sas_addr(0x5000c50095431246), phy(22), device_name(0x5000c50095431244) [ 36.769070] scsi 0:0:145:0: enclosure logical id(0x5001636001a44d3d), slot(22) [ 36.776377] scsi 0:0:145:0: enclosure level(0x0000), connector name( C0 ) [ 36.783268] scsi 0:0:145:0: serial_number(ZA1AGHF10000C8316HJ3) [ 36.789189] scsi 0:0:145:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 36.811946] mpt3sas_cm0: detecting: handle(0x0082), sas_address(0x5000c50095431386), phy(23) [ 36.820385] mpt3sas_cm0: REPORT_LUNS: handle(0x0082), retries(0) [ 36.840593] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0082), lun(0) [ 36.847711] scsi 0:0:146:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 36.856370] scsi 0:0:146:0: SSP: handle(0x0082), sas_addr(0x5000c50095431386), phy(23), device_name(0x5000c50095431384) [ 36.867144] scsi 0:0:146:0: enclosure logical id(0x5001636001a44d3d), slot(23) [ 36.874451] scsi 0:0:146:0: enclosure level(0x0000), connector name( C0 ) [ 36.881342] scsi 0:0:146:0: serial_number(ZA1AFE8N0000C8315354) [ 36.887262] scsi 0:0:146:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 36.909942] mpt3sas_cm0: detecting: handle(0x008b), sas_address(0x5000c5009543248e), phy(24) [ 36.918376] mpt3sas_cm0: REPORT_LUNS: handle(0x008b), retries(0) [ 36.931174] mpt3sas_cm0: TEST_UNIT_READY: handle(0x008b), lun(0) [ 36.938340] scsi 0:0:147:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 36.947003] scsi 0:0:147:0: SSP: handle(0x008b), sas_addr(0x5000c5009543248e), phy(24), device_name(0x5000c5009543248c) [ 36.957771] scsi 0:0:147:0: enclosure logical id(0x5001636001a44d3d), slot(24) [ 36.965078] scsi 0:0:147:0: enclosure level(0x0000), connector name( C0 ) [ 36.971969] scsi 0:0:147:0: serial_number(ZA1AGGVC0000C728K7V7) [ 36.977891] scsi 0:0:147:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 37.000943] mpt3sas_cm0: detecting: handle(0x008c), sas_address(0x5000c500954317b6), phy(25) [ 37.009378] mpt3sas_cm0: REPORT_LUNS: handle(0x008c), retries(0) [ 37.027703] mpt3sas_cm0: TEST_UNIT_READY: handle(0x008c), lun(0) [ 37.034880] scsi 0:0:148:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 37.043553] scsi 0:0:148:0: SSP: handle(0x008c), sas_addr(0x5000c500954317b6), phy(25), device_name(0x5000c500954317b4) [ 37.054328] scsi 0:0:148:0: enclosure logical id(0x5001636001a44d3d), slot(25) [ 37.061635] scsi 0:0:148:0: enclosure level(0x0000), connector name( C0 ) [ 37.068528] scsi 0:0:148:0: serial_number(ZA1AGH9T0000R727YGLC) [ 37.074446] scsi 0:0:148:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 37.097945] mpt3sas_cm0: detecting: handle(0x008d), sas_address(0x5000c50095430cbe), phy(26) [ 37.106389] mpt3sas_cm0: REPORT_LUNS: handle(0x008d), retries(0) [ 37.121925] mpt3sas_cm0: TEST_UNIT_READY: handle(0x008d), lun(0) [ 37.129058] scsi 0:0:149:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 37.137721] scsi 0:0:149:0: SSP: handle(0x008d), sas_addr(0x5000c50095430cbe), phy(26), device_name(0x5000c50095430cbc) [ 37.148493] scsi 0:0:149:0: enclosure logical id(0x5001636001a44d3d), slot(26) [ 37.155799] scsi 0:0:149:0: enclosure level(0x0000), connector name( C0 ) [ 37.162690] scsi 0:0:149:0: serial_number(ZA1AGHLW0000R829CXGX) [ 37.168610] scsi 0:0:149:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 37.191949] mpt3sas_cm0: detecting: handle(0x008e), sas_address(0x5000c5009542ec02), phy(27) [ 37.200384] mpt3sas_cm0: REPORT_LUNS: handle(0x008e), retries(0) [ 37.206830] mpt3sas_cm0: TEST_UNIT_READY: handle(0x008e), lun(0) [ 37.213956] scsi 0:0:150:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 37.222616] scsi 0:0:150:0: SSP: handle(0x008e), sas_addr(0x5000c5009542ec02), phy(27), device_name(0x5000c5009542ec00) [ 37.233393] scsi 0:0:150:0: enclosure logical id(0x5001636001a44d3d), slot(27) [ 37.240697] scsi 0:0:150:0: enclosure level(0x0000), connector name( C0 ) [ 37.247590] scsi 0:0:150:0: serial_number(ZA1AG9BF0000R830XB7P) [ 37.253509] scsi 0:0:150:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 37.285963] mpt3sas_cm0: detecting: handle(0x008f), sas_address(0x5000c50095432482), phy(28) [ 37.294402] mpt3sas_cm0: REPORT_LUNS: handle(0x008f), retries(0) [ 37.312955] mpt3sas_cm0: TEST_UNIT_READY: handle(0x008f), lun(0) [ 37.320082] scsi 0:0:151:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 37.328745] scsi 0:0:151:0: SSP: handle(0x008f), sas_addr(0x5000c50095432482), phy(28), device_name(0x5000c50095432480) [ 37.339518] scsi 0:0:151:0: enclosure logical id(0x5001636001a44d3d), slot(28) [ 37.346823] scsi 0:0:151:0: enclosure level(0x0000), connector name( C0 ) [ 37.353717] scsi 0:0:151:0: serial_number(ZA1AGMY80000C8316GN0) [ 37.359641] scsi 0:0:151:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 37.382945] mpt3sas_cm0: detecting: handle(0x0090), sas_address(0x5000c50095432a86), phy(29) [ 37.391385] mpt3sas_cm0: REPORT_LUNS: handle(0x0090), retries(0) [ 37.411104] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0090), lun(0) [ 37.418246] scsi 0:0:152:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 37.426904] scsi 0:0:152:0: SSP: handle(0x0090), sas_addr(0x5000c50095432a86), phy(29), device_name(0x5000c50095432a84) [ 37.437676] scsi 0:0:152:0: enclosure logical id(0x5001636001a44d3d), slot(29) [ 37.444982] scsi 0:0:152:0: enclosure level(0x0000), connector name( C0 ) [ 37.451875] scsi 0:0:152:0: serial_number(ZA1AGGKG0000C831535U) [ 37.457794] scsi 0:0:152:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 37.480945] mpt3sas_cm0: detecting: handle(0x0091), sas_address(0x5000c50095432762), phy(30) [ 37.489386] mpt3sas_cm0: REPORT_LUNS: handle(0x0091), retries(0) [ 37.506282] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0091), lun(0) [ 37.513382] scsi 0:0:153:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 37.522040] scsi 0:0:153:0: SSP: handle(0x0091), sas_addr(0x5000c50095432762), phy(30), device_name(0x5000c50095432760) [ 37.532810] scsi 0:0:153:0: enclosure logical id(0x5001636001a44d3d), slot(30) [ 37.540117] scsi 0:0:153:0: enclosure level(0x0000), connector name( C0 ) [ 37.547009] scsi 0:0:153:0: serial_number(ZA1AGMWD0000C8316H52) [ 37.552929] scsi 0:0:153:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 37.575946] mpt3sas_cm0: detecting: handle(0x0092), sas_address(0x5000c500954327ca), phy(31) [ 37.584384] mpt3sas_cm0: REPORT_LUNS: handle(0x0092), retries(0) [ 37.595999] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0092), lun(0) [ 37.603114] scsi 0:0:154:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 37.611781] scsi 0:0:154:0: SSP: handle(0x0092), sas_addr(0x5000c500954327ca), phy(31), device_name(0x5000c500954327c8) [ 37.622555] scsi 0:0:154:0: enclosure logical id(0x5001636001a44d3d), slot(31) [ 37.629861] scsi 0:0:154:0: enclosure level(0x0000), connector name( C0 ) [ 37.636757] scsi 0:0:154:0: serial_number(ZA1AGGPS0000C8316FQH) [ 37.642680] scsi 0:0:154:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 37.665945] mpt3sas_cm0: detecting: handle(0x009b), sas_address(0x5000c5009543085e), phy(32) [ 37.674386] mpt3sas_cm0: REPORT_LUNS: handle(0x009b), retries(0) [ 37.693590] mpt3sas_cm0: TEST_UNIT_READY: handle(0x009b), lun(0) [ 37.700718] scsi 0:0:155:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 37.709379] scsi 0:0:155:0: SSP: handle(0x009b), sas_addr(0x5000c5009543085e), phy(32), device_name(0x5000c5009543085c) [ 37.720152] scsi 0:0:155:0: enclosure logical id(0x5001636001a44d3d), slot(32) [ 37.727456] scsi 0:0:155:0: enclosure level(0x0000), connector name( C0 ) [ 37.734347] scsi 0:0:155:0: serial_number(ZA1AG3E30000R824EA7K) [ 37.740268] scsi 0:0:155:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 37.762945] mpt3sas_cm0: detecting: handle(0x009c), sas_address(0x5000c50095431de2), phy(33) [ 37.771384] mpt3sas_cm0: REPORT_LUNS: handle(0x009c), retries(0) [ 37.784668] mpt3sas_cm0: TEST_UNIT_READY: handle(0x009c), lun(0) [ 37.791781] scsi 0:0:156:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 37.800444] scsi 0:0:156:0: SSP: handle(0x009c), sas_addr(0x5000c50095431de2), phy(33), device_name(0x5000c50095431de0) [ 37.811221] scsi 0:0:156:0: enclosure logical id(0x5001636001a44d3d), slot(33) [ 37.818525] scsi 0:0:156:0: enclosure level(0x0000), connector name( C0 ) [ 37.825418] scsi 0:0:156:0: serial_number(ZA1AGN4Q0000R8167B5B) [ 37.831338] scsi 0:0:156:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 37.855951] mpt3sas_cm0: detecting: handle(0x009d), sas_address(0x5000c50095432112), phy(34) [ 37.864388] mpt3sas_cm0: REPORT_LUNS: handle(0x009d), retries(0) [ 37.884869] mpt3sas_cm0: TEST_UNIT_READY: handle(0x009d), lun(0) [ 37.891994] scsi 0:0:157:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 37.900653] scsi 0:0:157:0: SSP: handle(0x009d), sas_addr(0x5000c50095432112), phy(34), device_name(0x5000c50095432110) [ 37.911425] scsi 0:0:157:0: enclosure logical id(0x5001636001a44d3d), slot(34) [ 37.918732] scsi 0:0:157:0: enclosure level(0x0000), connector name( C0 ) [ 37.925623] scsi 0:0:157:0: serial_number(ZA1AGGYP0000C8316G0T) [ 37.931544] scsi 0:0:157:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 37.954952] mpt3sas_cm0: detecting: handle(0x009e), sas_address(0x5000c50095432476), phy(35) [ 37.963385] mpt3sas_cm0: REPORT_LUNS: handle(0x009e), retries(0) [ 37.969928] mpt3sas_cm0: TEST_UNIT_READY: handle(0x009e), lun(0) [ 37.977036] scsi 0:0:158:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 37.985693] scsi 0:0:158:0: SSP: handle(0x009e), sas_addr(0x5000c50095432476), phy(35), device_name(0x5000c50095432474) [ 37.996464] scsi 0:0:158:0: enclosure logical id(0x5001636001a44d3d), slot(35) [ 38.003769] scsi 0:0:158:0: enclosure level(0x0000), connector name( C0 ) [ 38.010663] scsi 0:0:158:0: serial_number(ZA1AGMYF0000C8316H9Y) [ 38.016580] scsi 0:0:158:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 38.039953] mpt3sas_cm0: detecting: handle(0x009f), sas_address(0x5000c5009543143a), phy(36) [ 38.048390] mpt3sas_cm0: REPORT_LUNS: handle(0x009f), retries(0) [ 38.070284] mpt3sas_cm0: TEST_UNIT_READY: handle(0x009f), lun(0) [ 38.085748] scsi 0:0:159:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 38.094397] scsi 0:0:159:0: SSP: handle(0x009f), sas_addr(0x5000c5009543143a), phy(36), device_name(0x5000c50095431438) [ 38.105171] scsi 0:0:159:0: enclosure logical id(0x5001636001a44d3d), slot(36) [ 38.112475] scsi 0:0:159:0: enclosure level(0x0000), connector name( C0 ) [ 38.119352] scsi 0:0:159:0: serial_number(ZA1AFVX60000C83152CW) [ 38.125271] scsi 0:0:159:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 38.147953] mpt3sas_cm0: detecting: handle(0x00a0), sas_address(0x5000c5009543086e), phy(37) [ 38.156387] mpt3sas_cm0: REPORT_LUNS: handle(0x00a0), retries(0) [ 38.162819] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00a0), lun(0) [ 38.169924] scsi 0:0:160:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 38.178590] scsi 0:0:160:0: SSP: handle(0x00a0), sas_addr(0x5000c5009543086e), phy(37), device_name(0x5000c5009543086c) [ 38.189358] scsi 0:0:160:0: enclosure logical id(0x5001636001a44d3d), slot(37) [ 38.196663] scsi 0:0:160:0: enclosure level(0x0000), connector name( C0 ) [ 38.203558] scsi 0:0:160:0: serial_number(ZA1AG3DZ0000C83152N4) [ 38.209478] scsi 0:0:160:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 38.232949] mpt3sas_cm0: detecting: handle(0x00a1), sas_address(0x5000c50095383ae6), phy(38) [ 38.241390] mpt3sas_cm0: REPORT_LUNS: handle(0x00a1), retries(0) [ 38.257871] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00a1), lun(0) [ 38.265000] scsi 0:0:161:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 38.273664] scsi 0:0:161:0: SSP: handle(0x00a1), sas_addr(0x5000c50095383ae6), phy(38), device_name(0x5000c50095383ae4) [ 38.284434] scsi 0:0:161:0: enclosure logical id(0x5001636001a44d3d), slot(38) [ 38.291738] scsi 0:0:161:0: enclosure level(0x0000), connector name( C0 ) [ 38.298632] scsi 0:0:161:0: serial_number(ZA1ACHFL0000R8289CW4) [ 38.304549] scsi 0:0:161:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 38.327951] mpt3sas_cm0: detecting: handle(0x00a2), sas_address(0x5000c50095446312), phy(39) [ 38.336386] mpt3sas_cm0: REPORT_LUNS: handle(0x00a2), retries(0) [ 38.352118] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00a2), lun(0) [ 38.359250] scsi 0:0:162:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 38.367915] scsi 0:0:162:0: SSP: handle(0x00a2), sas_addr(0x5000c50095446312), phy(39), device_name(0x5000c50095446310) [ 38.378684] scsi 0:0:162:0: enclosure logical id(0x5001636001a44d3d), slot(39) [ 38.385988] scsi 0:0:162:0: enclosure level(0x0000), connector name( C0 ) [ 38.392883] scsi 0:0:162:0: serial_number(ZA1AGTG50000R8300NX4) [ 38.398803] scsi 0:0:162:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 38.421951] mpt3sas_cm0: detecting: handle(0x00ab), sas_address(0x5000c50095430c7a), phy(40) [ 38.430388] mpt3sas_cm0: REPORT_LUNS: handle(0x00ab), retries(0) [ 38.436875] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00ab), lun(0) [ 38.444010] scsi 0:0:163:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 38.466795] scsi 0:0:163:0: SSP: handle(0x00ab), sas_addr(0x5000c50095430c7a), phy(40), device_name(0x5000c50095430c78) [ 38.477571] scsi 0:0:163:0: enclosure logical id(0x5001636001a44d3d), slot(40) [ 38.484878] scsi 0:0:163:0: enclosure level(0x0000), connector name( C0 ) [ 38.491771] scsi 0:0:163:0: serial_number(ZA1AG8D70000R8301BUX) [ 38.497689] scsi 0:0:163:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 38.532957] mpt3sas_cm0: detecting: handle(0x00ac), sas_address(0x5000c50095431206), phy(41) [ 38.541396] mpt3sas_cm0: REPORT_LUNS: handle(0x00ac), retries(0) [ 38.547872] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00ac), lun(0) [ 38.555017] scsi 0:0:164:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 38.563689] scsi 0:0:164:0: SSP: handle(0x00ac), sas_addr(0x5000c50095431206), phy(41), device_name(0x5000c50095431204) [ 38.574466] scsi 0:0:164:0: enclosure logical id(0x5001636001a44d3d), slot(41) [ 38.581771] scsi 0:0:164:0: enclosure level(0x0000), connector name( C0 ) [ 38.588665] scsi 0:0:164:0: serial_number(ZA1AGHF60000R82898SZ) [ 38.594584] scsi 0:0:164:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 38.617956] mpt3sas_cm0: detecting: handle(0x00ad), sas_address(0x5000c500954328e2), phy(42) [ 38.626395] mpt3sas_cm0: REPORT_LUNS: handle(0x00ad), retries(0) [ 38.638929] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00ad), lun(0) [ 38.646063] scsi 0:0:165:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 38.654729] scsi 0:0:165:0: SSP: handle(0x00ad), sas_addr(0x5000c500954328e2), phy(42), device_name(0x5000c500954328e0) [ 38.665502] scsi 0:0:165:0: enclosure logical id(0x5001636001a44d3d), slot(42) [ 38.672807] scsi 0:0:165:0: enclosure level(0x0000), connector name( C0 ) [ 38.679700] scsi 0:0:165:0: serial_number(ZA1AGGMN0000R824DEBJ) [ 38.685617] scsi 0:0:165:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 38.708953] mpt3sas_cm0: detecting: handle(0x00ae), sas_address(0x5000c5009543296a), phy(43) [ 38.717392] mpt3sas_cm0: REPORT_LUNS: handle(0x00ae), retries(0) [ 38.735443] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00ae), lun(0) [ 38.779617] scsi 0:0:166:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 38.788263] scsi 0:0:166:0: SSP: handle(0x00ae), sas_addr(0x5000c5009543296a), phy(43), device_name(0x5000c50095432968) [ 38.799037] scsi 0:0:166:0: enclosure logical id(0x5001636001a44d3d), slot(43) [ 38.806343] scsi 0:0:166:0: enclosure level(0x0000), connector name( C0 ) [ 38.813220] scsi 0:0:166:0: serial_number(ZA1AGGM40000R823P9XN) [ 38.819138] scsi 0:0:166:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 38.842552] mpt3sas_cm0: detecting: handle(0x00af), sas_address(0x5000c5009542bf5e), phy(44) [ 38.850992] mpt3sas_cm0: REPORT_LUNS: handle(0x00af), retries(0) [ 38.871259] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00af), lun(0) [ 38.878411] scsi 0:0:167:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 38.887065] scsi 0:0:167:0: SSP: handle(0x00af), sas_addr(0x5000c5009542bf5e), phy(44), device_name(0x5000c5009542bf5c) [ 38.897838] scsi 0:0:167:0: enclosure logical id(0x5001636001a44d3d), slot(44) [ 38.905145] scsi 0:0:167:0: enclosure level(0x0000), connector name( C0 ) [ 38.912036] scsi 0:0:167:0: serial_number(ZA1AGAHD0000R8301RUN) [ 38.917957] scsi 0:0:167:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 38.940955] mpt3sas_cm0: detecting: handle(0x00b0), sas_address(0x5000c50095446b86), phy(45) [ 38.949395] mpt3sas_cm0: REPORT_LUNS: handle(0x00b0), retries(0) [ 38.963799] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00b0), lun(0) [ 38.970954] scsi 0:0:168:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 38.979610] scsi 0:0:168:0: SSP: handle(0x00b0), sas_addr(0x5000c50095446b86), phy(45), device_name(0x5000c50095446b84) [ 38.990382] scsi 0:0:168:0: enclosure logical id(0x5001636001a44d3d), slot(45) [ 38.997688] scsi 0:0:168:0: enclosure level(0x0000), connector name( C0 ) [ 39.004581] scsi 0:0:168:0: serial_number(ZA1AGT4R0000R830XBEB) [ 39.010501] scsi 0:0:168:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 39.033951] mpt3sas_cm0: detecting: handle(0x00b1), sas_address(0x5000c5009543284e), phy(46) [ 39.042388] mpt3sas_cm0: REPORT_LUNS: handle(0x00b1), retries(0) [ 39.055446] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00b1), lun(0) [ 39.062643] scsi 0:0:169:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 39.071307] scsi 0:0:169:0: SSP: handle(0x00b1), sas_addr(0x5000c5009543284e), phy(46), device_name(0x5000c5009543284c) [ 39.082075] scsi 0:0:169:0: enclosure logical id(0x5001636001a44d3d), slot(46) [ 39.089383] scsi 0:0:169:0: enclosure level(0x0000), connector name( C0 ) [ 39.096274] scsi 0:0:169:0: serial_number(ZA1AGGNQ0000R824DTSN) [ 39.102193] scsi 0:0:169:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 39.124959] mpt3sas_cm0: detecting: handle(0x00b2), sas_address(0x5000c50095430a0a), phy(47) [ 39.133395] mpt3sas_cm0: REPORT_LUNS: handle(0x00b2), retries(0) [ 39.147661] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00b2), lun(0) [ 39.195611] scsi 0:0:170:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 39.204258] scsi 0:0:170:0: SSP: handle(0x00b2), sas_addr(0x5000c50095430a0a), phy(47), device_name(0x5000c50095430a08) [ 39.215032] scsi 0:0:170:0: enclosure logical id(0x5001636001a44d3d), slot(47) [ 39.222337] scsi 0:0:170:0: enclosure level(0x0000), connector name( C0 ) [ 39.229217] scsi 0:0:170:0: serial_number(ZA1AG3B20000R8288A3W) [ 39.235142] scsi 0:0:170:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 39.279957] mpt3sas_cm0: detecting: handle(0x00bb), sas_address(0x5000c5009538d90e), phy(48) [ 39.288391] mpt3sas_cm0: REPORT_LUNS: handle(0x00bb), retries(0) [ 39.305252] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00bb), lun(0) [ 39.312402] scsi 0:0:171:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 39.321061] scsi 0:0:171:0: SSP: handle(0x00bb), sas_addr(0x5000c5009538d90e), phy(48), device_name(0x5000c5009538d90c) [ 39.331835] scsi 0:0:171:0: enclosure logical id(0x5001636001a44d3d), slot(48) [ 39.339139] scsi 0:0:171:0: enclosure level(0x0000), connector name( C0 ) [ 39.346032] scsi 0:0:171:0: serial_number(ZA1ACZX90000R82892A9) [ 39.351953] scsi 0:0:171:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 39.381966] mpt3sas_cm0: detecting: handle(0x00bc), sas_address(0x5000c50095430afa), phy(49) [ 39.390401] mpt3sas_cm0: REPORT_LUNS: handle(0x00bc), retries(0) [ 39.411429] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00bc), lun(0) [ 39.418635] scsi 0:0:172:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 39.427290] scsi 0:0:172:0: SSP: handle(0x00bc), sas_addr(0x5000c50095430afa), phy(49), device_name(0x5000c50095430af8) [ 39.438063] scsi 0:0:172:0: enclosure logical id(0x5001636001a44d3d), slot(49) [ 39.445369] scsi 0:0:172:0: enclosure level(0x0000), connector name( C0 ) [ 39.452260] scsi 0:0:172:0: serial_number(ZA1AF6NG0000R8301C0E) [ 39.458179] scsi 0:0:172:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 39.483963] mpt3sas_cm0: detecting: handle(0x00bd), sas_address(0x5000c50095432906), phy(50) [ 39.492399] mpt3sas_cm0: REPORT_LUNS: handle(0x00bd), retries(0) [ 39.510768] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00bd), lun(0) [ 39.517895] scsi 0:0:173:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 39.526548] scsi 0:0:173:0: SSP: handle(0x00bd), sas_addr(0x5000c50095432906), phy(50), device_name(0x5000c50095432904) [ 39.537322] scsi 0:0:173:0: enclosure logical id(0x5001636001a44d3d), slot(50) [ 39.544629] scsi 0:0:173:0: enclosure level(0x0000), connector name( C0 ) [ 39.551523] scsi 0:0:173:0: serial_number(ZA1AGGMH0000C8316FV1) [ 39.557442] scsi 0:0:173:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 39.583959] mpt3sas_cm0: detecting: handle(0x00be), sas_address(0x5000c5009543106e), phy(51) [ 39.592395] mpt3sas_cm0: REPORT_LUNS: handle(0x00be), retries(0) [ 39.605748] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00be), lun(0) [ 39.612886] scsi 0:0:174:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 39.621548] scsi 0:0:174:0: SSP: handle(0x00be), sas_addr(0x5000c5009543106e), phy(51), device_name(0x5000c5009543106c) [ 39.632319] scsi 0:0:174:0: enclosure logical id(0x5001636001a44d3d), slot(51) [ 39.639624] scsi 0:0:174:0: enclosure level(0x0000), connector name( C0 ) [ 39.646519] scsi 0:0:174:0: serial_number(ZA1AG3EL0000R8301S70) [ 39.652446] scsi 0:0:174:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 39.675953] mpt3sas_cm0: detecting: handle(0x00bf), sas_address(0x5000c500954463b2), phy(52) [ 39.684393] mpt3sas_cm0: REPORT_LUNS: handle(0x00bf), retries(0) [ 39.695525] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00bf), lun(0) [ 39.702660] scsi 0:0:175:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 39.711325] scsi 0:0:175:0: SSP: handle(0x00bf), sas_addr(0x5000c500954463b2), phy(52), device_name(0x5000c500954463b0) [ 39.722098] scsi 0:0:175:0: enclosure logical id(0x5001636001a44d3d), slot(52) [ 39.729404] scsi 0:0:175:0: enclosure level(0x0000), connector name( C0 ) [ 39.736295] scsi 0:0:175:0: serial_number(ZA1AGTF20000R82897TB) [ 39.742215] scsi 0:0:175:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 39.764959] mpt3sas_cm0: detecting: handle(0x00c0), sas_address(0x5000c50095431b22), phy(53) [ 39.773401] mpt3sas_cm0: REPORT_LUNS: handle(0x00c0), retries(0) [ 39.780005] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00c0), lun(0) [ 39.787127] scsi 0:0:176:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 39.795781] scsi 0:0:176:0: SSP: handle(0x00c0), sas_addr(0x5000c50095431b22), phy(53), device_name(0x5000c50095431b20) [ 39.806554] scsi 0:0:176:0: enclosure logical id(0x5001636001a44d3d), slot(53) [ 39.813860] scsi 0:0:176:0: enclosure level(0x0000), connector name( C0 ) [ 39.820752] scsi 0:0:176:0: serial_number(ZA1AGH5H0000C8316HU8) [ 39.826671] scsi 0:0:176:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 39.852963] mpt3sas_cm0: detecting: handle(0x00c1), sas_address(0x5000c50095430bba), phy(54) [ 39.861403] mpt3sas_cm0: REPORT_LUNS: handle(0x00c1), retries(0) [ 39.874693] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00c1), lun(0) [ 39.881804] scsi 0:0:177:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 39.890465] scsi 0:0:177:0: SSP: handle(0x00c1), sas_addr(0x5000c50095430bba), phy(54), device_name(0x5000c50095430bb8) [ 39.901240] scsi 0:0:177:0: enclosure logical id(0x5001636001a44d3d), slot(54) [ 39.908545] scsi 0:0:177:0: enclosure level(0x0000), connector name( C0 ) [ 39.915436] scsi 0:0:177:0: serial_number(ZA1AG8DM0000R8301BSQ) [ 39.921357] scsi 0:0:177:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 39.943962] mpt3sas_cm0: detecting: handle(0x00c2), sas_address(0x5000c5009542ebfa), phy(55) [ 39.952404] mpt3sas_cm0: REPORT_LUNS: handle(0x00c2), retries(0) [ 39.973718] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00c2), lun(0) [ 39.980840] scsi 0:0:178:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 39.989503] scsi 0:0:178:0: SSP: handle(0x00c2), sas_addr(0x5000c5009542ebfa), phy(55), device_name(0x5000c5009542ebf8) [ 40.000273] scsi 0:0:178:0: enclosure logical id(0x5001636001a44d3d), slot(55) [ 40.007580] scsi 0:0:178:0: enclosure level(0x0000), connector name( C0 ) [ 40.014471] scsi 0:0:178:0: serial_number(ZA1AG9CF0000R830XD0N) [ 40.020392] scsi 0:0:178:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 40.043962] mpt3sas_cm0: detecting: handle(0x00c8), sas_address(0x5000c500954304e6), phy(56) [ 40.052399] mpt3sas_cm0: REPORT_LUNS: handle(0x00c8), retries(0) [ 40.058883] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00c8), lun(0) [ 40.066011] scsi 0:0:179:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 40.074678] scsi 0:0:179:0: SSP: handle(0x00c8), sas_addr(0x5000c500954304e6), phy(56), device_name(0x5000c500954304e4) [ 40.085450] scsi 0:0:179:0: enclosure logical id(0x5001636001a44d3d), slot(56) [ 40.092756] scsi 0:0:179:0: enclosure level(0x0000), connector name( C0 ) [ 40.099650] scsi 0:0:179:0: serial_number(ZA1AG8JZ0000R8301BWV) [ 40.105567] scsi 0:0:179:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 40.128966] mpt3sas_cm0: detecting: handle(0x00c9), sas_address(0x5000c50095430666), phy(57) [ 40.137404] mpt3sas_cm0: REPORT_LUNS: handle(0x00c9), retries(0) [ 40.143901] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00c9), lun(0) [ 40.151021] scsi 0:0:180:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 40.159683] scsi 0:0:180:0: SSP: handle(0x00c9), sas_addr(0x5000c50095430666), phy(57), device_name(0x5000c50095430664) [ 40.170452] scsi 0:0:180:0: enclosure logical id(0x5001636001a44d3d), slot(57) [ 40.177760] scsi 0:0:180:0: enclosure level(0x0000), connector name( C0 ) [ 40.184654] scsi 0:0:180:0: serial_number(ZA1AG3G10000C83152GR) [ 40.190571] scsi 0:0:180:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 40.215966] mpt3sas_cm0: detecting: handle(0x00ca), sas_address(0x5000c50095430ef2), phy(58) [ 40.224404] mpt3sas_cm0: REPORT_LUNS: handle(0x00ca), retries(0) [ 40.244551] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00ca), lun(0) [ 40.251674] scsi 0:0:181:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 40.260329] scsi 0:0:181:0: SSP: handle(0x00ca), sas_addr(0x5000c50095430ef2), phy(58), device_name(0x5000c50095430ef0) [ 40.271100] scsi 0:0:181:0: enclosure logical id(0x5001636001a44d3d), slot(58) [ 40.278406] scsi 0:0:181:0: enclosure level(0x0000), connector name( C0 ) [ 40.285298] scsi 0:0:181:0: serial_number(ZA1AGHJW0000C8316HR4) [ 40.291217] scsi 0:0:181:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 40.313959] mpt3sas_cm0: detecting: handle(0x00cb), sas_address(0x5000c5009543111a), phy(59) [ 40.322396] mpt3sas_cm0: REPORT_LUNS: handle(0x00cb), retries(0) [ 40.333679] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00cb), lun(0) [ 40.340787] scsi 0:0:182:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 40.349453] scsi 0:0:182:0: SSP: handle(0x00cb), sas_addr(0x5000c5009543111a), phy(59), device_name(0x5000c50095431118) [ 40.360230] scsi 0:0:182:0: enclosure logical id(0x5001636001a44d3d), slot(59) [ 40.367536] scsi 0:0:182:0: enclosure level(0x0000), connector name( C0 ) [ 40.374428] scsi 0:0:182:0: serial_number(ZA1AGHGA0000R824E65Z) [ 40.380347] scsi 0:0:182:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 40.407134] mpt3sas_cm0: detecting: handle(0x00ce), sas_address(0x5001636001a44d3d), phy(76) [ 40.415586] mpt3sas_cm0: REPORT_LUNS: handle(0x00ce), retries(0) [ 40.421779] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00ce), lun(0) [ 40.428281] scsi 0:0:183:0: Enclosure QCT JB4602 SIM 1 1500 PQ: 0 ANSI: 6 [ 40.436753] scsi 0:0:183:0: set ignore_delay_remove for handle(0x00ce) [ 40.443283] scsi 0:0:183:0: SES: handle(0x00ce), sas_addr(0x5001636001a44d3d), phy(76), device_name(0x5001636001a44d3d) [ 40.454056] scsi 0:0:183:0: enclosure logical id(0x5001636001a44d3d), slot(60) [ 40.461361] scsi 0:0:183:0: enclosure level(0x0000), connector name( C0 ) [ 40.468252] scsi 0:0:183:0: serial_number(EO0153600108 ) [ 40.473825] scsi 0:0:183:0: qdepth(1), tagged(0), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 40.495232] mpt3sas_cm0: expander_add: handle(0x00cf), parent(0x0002), sas_addr(0x5001636001a42d3f), phys(79) [ 40.520999] mpt3sas_cm0: detecting: handle(0x00d0), sas_address(0x5000c5009538809e), phy(0) [ 40.529360] mpt3sas_cm0: REPORT_LUNS: handle(0x00d0), retries(0) [ 40.542270] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00d0), lun(0) [ 40.549572] scsi 0:0:184:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 40.558244] scsi 0:0:184:0: SSP: handle(0x00d0), sas_addr(0x5000c5009538809e), phy(0), device_name(0x5000c5009538809c) [ 40.568932] scsi 0:0:184:0: enclosure logical id(0x5001636001a42d3d), slot(0) [ 40.576152] scsi 0:0:184:0: enclosure level(0x0000), connector name( C2 ) [ 40.583045] scsi 0:0:184:0: serial_number(ZA1AD1QH0000R829CRXQ) [ 40.588963] scsi 0:0:184:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 40.614967] mpt3sas_cm0: detecting: handle(0x00d1), sas_address(0x5000c5009538523a), phy(1) [ 40.623322] mpt3sas_cm0: REPORT_LUNS: handle(0x00d1), retries(0) [ 40.645515] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00d1), lun(0) [ 40.652648] scsi 0:0:185:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 40.661306] scsi 0:0:185:0: SSP: handle(0x00d1), sas_addr(0x5000c5009538523a), phy(1), device_name(0x5000c50095385238) [ 40.671988] scsi 0:0:185:0: enclosure logical id(0x5001636001a42d3d), slot(1) [ 40.679209] scsi 0:0:185:0: enclosure level(0x0000), connector name( C2 ) [ 40.686099] scsi 0:0:185:0: serial_number(ZA1ACX2W0000R829D5RN) [ 40.692019] scsi 0:0:185:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 40.714969] mpt3sas_cm0: detecting: handle(0x00d2), sas_address(0x5000c5009538628e), phy(2) [ 40.723316] mpt3sas_cm0: REPORT_LUNS: handle(0x00d2), retries(0) [ 40.736754] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00d2), lun(0) [ 40.743895] scsi 0:0:186:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 40.752563] scsi 0:0:186:0: SSP: handle(0x00d2), sas_addr(0x5000c5009538628e), phy(2), device_name(0x5000c5009538628c) [ 40.763250] scsi 0:0:186:0: enclosure logical id(0x5001636001a42d3d), slot(2) [ 40.770469] scsi 0:0:186:0: enclosure level(0x0000), connector name( C2 ) [ 40.777363] scsi 0:0:186:0: serial_number(ZA1ACWMY0000R824V9KP) [ 40.783281] scsi 0:0:186:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 40.807966] mpt3sas_cm0: detecting: handle(0x00d3), sas_address(0x5000c50095388322), phy(3) [ 40.816323] mpt3sas_cm0: REPORT_LUNS: handle(0x00d3), retries(0) [ 40.831182] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00d3), lun(0) [ 40.838305] scsi 0:0:187:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 40.846968] scsi 0:0:187:0: SSP: handle(0x00d3), sas_addr(0x5000c50095388322), phy(3), device_name(0x5000c50095388320) [ 40.857656] scsi 0:0:187:0: enclosure logical id(0x5001636001a42d3d), slot(3) [ 40.864874] scsi 0:0:187:0: enclosure level(0x0000), connector name( C2 ) [ 40.871769] scsi 0:0:187:0: serial_number(ZA1AD1MM0000R829CX04) [ 40.877687] scsi 0:0:187:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 40.904974] mpt3sas_cm0: detecting: handle(0x00d4), sas_address(0x5000c500953852c2), phy(4) [ 40.913332] mpt3sas_cm0: REPORT_LUNS: handle(0x00d4), retries(0) [ 40.926840] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00d4), lun(0) [ 40.934001] scsi 0:0:188:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 40.942668] scsi 0:0:188:0: SSP: handle(0x00d4), sas_addr(0x5000c500953852c2), phy(4), device_name(0x5000c500953852c0) [ 40.953354] scsi 0:0:188:0: enclosure logical id(0x5001636001a42d3d), slot(4) [ 40.960573] scsi 0:0:188:0: enclosure level(0x0000), connector name( C2 ) [ 40.967468] scsi 0:0:188:0: serial_number(ZA1ACX220000R829D6RB) [ 40.973386] scsi 0:0:188:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 40.996970] mpt3sas_cm0: detecting: handle(0x00d5), sas_address(0x5000c5009543118e), phy(5) [ 41.005318] mpt3sas_cm0: REPORT_LUNS: handle(0x00d5), retries(0) [ 41.016447] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00d5), lun(0) [ 41.023592] scsi 0:0:189:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 41.032254] scsi 0:0:189:0: SSP: handle(0x00d5), sas_addr(0x5000c5009543118e), phy(5), device_name(0x5000c5009543118c) [ 41.042943] scsi 0:0:189:0: enclosure logical id(0x5001636001a42d3d), slot(5) [ 41.050162] scsi 0:0:189:0: enclosure level(0x0000), connector name( C2 ) [ 41.057057] scsi 0:0:189:0: serial_number(ZA1AGHFV0000C8316HBC) [ 41.062985] scsi 0:0:189:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 41.088978] mpt3sas_cm0: detecting: handle(0x00d6), sas_address(0x5000c5009537e5b6), phy(6) [ 41.097335] mpt3sas_cm0: REPORT_LUNS: handle(0x00d6), retries(0) [ 41.115404] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00d6), lun(0) [ 41.122537] scsi 0:0:190:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 41.131198] scsi 0:0:190:0: SSP: handle(0x00d6), sas_addr(0x5000c5009537e5b6), phy(6), device_name(0x5000c5009537e5b4) [ 41.141881] scsi 0:0:190:0: enclosure logical id(0x5001636001a42d3d), slot(6) [ 41.149102] scsi 0:0:190:0: enclosure level(0x0000), connector name( C2 ) [ 41.155992] scsi 0:0:190:0: serial_number(ZA1ACKGZ0000R82897CP) [ 41.161912] scsi 0:0:190:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 41.184971] mpt3sas_cm0: detecting: handle(0x00d7), sas_address(0x5000c5009543151e), phy(7) [ 41.193326] mpt3sas_cm0: REPORT_LUNS: handle(0x00d7), retries(0) [ 41.199869] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00d7), lun(0) [ 41.207000] scsi 0:0:191:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 41.215658] scsi 0:0:191:0: SSP: handle(0x00d7), sas_addr(0x5000c5009543151e), phy(7), device_name(0x5000c5009543151c) [ 41.226349] scsi 0:0:191:0: enclosure logical id(0x5001636001a42d3d), slot(7) [ 41.233567] scsi 0:0:191:0: enclosure level(0x0000), connector name( C2 ) [ 41.240460] scsi 0:0:191:0: serial_number(ZA1ACBEB0000C831528B) [ 41.246380] scsi 0:0:191:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 41.269978] mpt3sas_cm0: detecting: handle(0x00d8), sas_address(0x5000c5009544634e), phy(8) [ 41.278327] mpt3sas_cm0: REPORT_LUNS: handle(0x00d8), retries(0) [ 41.289869] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00d8), lun(0) [ 41.297043] scsi 0:0:192:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 41.305707] scsi 0:0:192:0: SSP: handle(0x00d8), sas_addr(0x5000c5009544634e), phy(8), device_name(0x5000c5009544634c) [ 41.316394] scsi 0:0:192:0: enclosure logical id(0x5001636001a42d3d), slot(8) [ 41.323616] scsi 0:0:192:0: enclosure level(0x0000), connector name( C2 ) [ 41.330511] scsi 0:0:192:0: serial_number(ZA1AGTFW0000R7245CBC) [ 41.336436] scsi 0:0:192:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 41.362976] mpt3sas_cm0: detecting: handle(0x00d9), sas_address(0x5000c500954312e6), phy(9) [ 41.371330] mpt3sas_cm0: REPORT_LUNS: handle(0x00d9), retries(0) [ 41.403401] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00d9), lun(0) [ 41.410656] scsi 0:0:193:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 41.419322] scsi 0:0:193:0: SSP: handle(0x00d9), sas_addr(0x5000c500954312e6), phy(9), device_name(0x5000c500954312e4) [ 41.430007] scsi 0:0:193:0: enclosure logical id(0x5001636001a42d3d), slot(9) [ 41.437226] scsi 0:0:193:0: enclosure level(0x0000), connector name( C2 ) [ 41.444119] scsi 0:0:193:0: serial_number(ZA1AGHDY0000R83026QB) [ 41.450041] scsi 0:0:193:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 41.473972] mpt3sas_cm0: detecting: handle(0x00da), sas_address(0x5000c50095430366), phy(10) [ 41.482414] mpt3sas_cm0: REPORT_LUNS: handle(0x00da), retries(0) [ 41.499750] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00da), lun(0) [ 41.506885] scsi 0:0:194:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 41.515551] scsi 0:0:194:0: SSP: handle(0x00da), sas_addr(0x5000c50095430366), phy(10), device_name(0x5000c50095430364) [ 41.526322] scsi 0:0:194:0: enclosure logical id(0x5001636001a42d3d), slot(10) [ 41.533626] scsi 0:0:194:0: enclosure level(0x0000), connector name( C2 ) [ 41.540529] scsi 0:0:194:0: serial_number(ZA1AG3JB0000R823NNXC) [ 41.546450] scsi 0:0:194:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 41.570975] mpt3sas_cm0: detecting: handle(0x00db), sas_address(0x5000c50095430546), phy(11) [ 41.579413] mpt3sas_cm0: REPORT_LUNS: handle(0x00db), retries(0) [ 41.585899] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00db), lun(0) [ 41.593022] scsi 0:0:195:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 41.601687] scsi 0:0:195:0: SSP: handle(0x00db), sas_addr(0x5000c50095430546), phy(11), device_name(0x5000c50095430544) [ 41.612460] scsi 0:0:195:0: enclosure logical id(0x5001636001a42d3d), slot(11) [ 41.619766] scsi 0:0:195:0: enclosure level(0x0000), connector name( C2 ) [ 41.626660] scsi 0:0:195:0: serial_number(ZA1AG3GT0000R824DF2R) [ 41.632582] scsi 0:0:195:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 41.657972] mpt3sas_cm0: detecting: handle(0x00dc), sas_address(0x5000c50095432342), phy(12) [ 41.666424] mpt3sas_cm0: REPORT_LUNS: handle(0x00dc), retries(0) [ 41.688366] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00dc), lun(0) [ 41.695496] scsi 0:0:196:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 41.704155] scsi 0:0:196:0: SSP: handle(0x00dc), sas_addr(0x5000c50095432342), phy(12), device_name(0x5000c50095432340) [ 41.714926] scsi 0:0:196:0: enclosure logical id(0x5001636001a42d3d), slot(12) [ 41.722232] scsi 0:0:196:0: enclosure level(0x0000), connector name( C2 ) [ 41.729124] scsi 0:0:196:0: serial_number(ZA1AGMZ50000R829D65Z) [ 41.735044] scsi 0:0:196:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 41.757967] mpt3sas_cm0: detecting: handle(0x00dd), sas_address(0x5000c5009542ede2), phy(13) [ 41.766408] mpt3sas_cm0: REPORT_LUNS: handle(0x00dd), retries(0) [ 41.777838] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00dd), lun(0) [ 41.784960] scsi 0:0:197:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 41.793631] scsi 0:0:197:0: SSP: handle(0x00dd), sas_addr(0x5000c5009542ede2), phy(13), device_name(0x5000c5009542ede0) [ 41.804402] scsi 0:0:197:0: enclosure logical id(0x5001636001a42d3d), slot(13) [ 41.811708] scsi 0:0:197:0: enclosure level(0x0000), connector name( C2 ) [ 41.818601] scsi 0:0:197:0: serial_number(ZA1AG99G0000R8301CER) [ 41.824520] scsi 0:0:197:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 41.848972] mpt3sas_cm0: detecting: handle(0x00de), sas_address(0x5000c50095431c26), phy(14) [ 41.857415] mpt3sas_cm0: REPORT_LUNS: handle(0x00de), retries(0) [ 41.879263] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00de), lun(0) [ 41.886394] scsi 0:0:198:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 41.895058] scsi 0:0:198:0: SSP: handle(0x00de), sas_addr(0x5000c50095431c26), phy(14), device_name(0x5000c50095431c24) [ 41.905828] scsi 0:0:198:0: enclosure logical id(0x5001636001a42d3d), slot(14) [ 41.913134] scsi 0:0:198:0: enclosure level(0x0000), connector name( C2 ) [ 41.920027] scsi 0:0:198:0: serial_number(ZA1AGN560000C8316G37) [ 41.925947] scsi 0:0:198:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 41.948973] mpt3sas_cm0: detecting: handle(0x00df), sas_address(0x5000c50095430f4e), phy(15) [ 41.957409] mpt3sas_cm0: REPORT_LUNS: handle(0x00df), retries(0) [ 41.976408] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00df), lun(0) [ 41.983544] scsi 0:0:199:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 41.992207] scsi 0:0:199:0: SSP: handle(0x00df), sas_addr(0x5000c50095430f4e), phy(15), device_name(0x5000c50095430f4c) [ 42.002983] scsi 0:0:199:0: enclosure logical id(0x5001636001a42d3d), slot(15) [ 42.010289] scsi 0:0:199:0: enclosure level(0x0000), connector name( C2 ) [ 42.017184] scsi 0:0:199:0: serial_number(ZA1AGHJ90000R829CWQ8) [ 42.023101] scsi 0:0:199:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 42.046968] mpt3sas_cm0: detecting: handle(0x00e0), sas_address(0x5000c500954d9722), phy(16) [ 42.055404] mpt3sas_cm0: REPORT_LUNS: handle(0x00e0), retries(0) [ 42.067267] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00e0), lun(0) [ 42.074435] scsi 0:0:200:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 42.083094] scsi 0:0:200:0: SSP: handle(0x00e0), sas_addr(0x5000c500954d9722), phy(16), device_name(0x5000c500954d9720) [ 42.093863] scsi 0:0:200:0: enclosure logical id(0x5001636001a42d3d), slot(16) [ 42.101168] scsi 0:0:200:0: enclosure level(0x0000), connector name( C2 ) [ 42.108060] scsi 0:0:200:0: serial_number(ZA1AM3RW0000R8314487) [ 42.113980] scsi 0:0:200:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 42.182979] mpt3sas_cm0: detecting: handle(0x00e1), sas_address(0x5000c500954324a6), phy(17) [ 42.191419] mpt3sas_cm0: REPORT_LUNS: handle(0x00e1), retries(0) [ 42.197891] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00e1), lun(0) [ 42.205033] scsi 0:0:201:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 42.213689] scsi 0:0:201:0: SSP: handle(0x00e1), sas_addr(0x5000c500954324a6), phy(17), device_name(0x5000c500954324a4) [ 42.224463] scsi 0:0:201:0: enclosure logical id(0x5001636001a42d3d), slot(17) [ 42.231767] scsi 0:0:201:0: enclosure level(0x0000), connector name( C2 ) [ 42.238661] scsi 0:0:201:0: serial_number(ZA1AGGTT0000C7253ZB4) [ 42.244580] scsi 0:0:201:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 42.268978] mpt3sas_cm0: detecting: handle(0x00e2), sas_address(0x5000c500954319d2), phy(18) [ 42.277412] mpt3sas_cm0: REPORT_LUNS: handle(0x00e2), retries(0) [ 42.295841] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00e2), lun(0) [ 42.302970] scsi 0:0:202:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 42.311634] scsi 0:0:202:0: SSP: handle(0x00e2), sas_addr(0x5000c500954319d2), phy(18), device_name(0x5000c500954319d0) [ 42.322405] scsi 0:0:202:0: enclosure logical id(0x5001636001a42d3d), slot(18) [ 42.329709] scsi 0:0:202:0: enclosure level(0x0000), connector name( C2 ) [ 42.336602] scsi 0:0:202:0: serial_number(ZA1ACMBP0000C8316FQW) [ 42.342521] scsi 0:0:202:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 42.365974] mpt3sas_cm0: detecting: handle(0x00e3), sas_address(0x5000c5009543125a), phy(19) [ 42.374410] mpt3sas_cm0: REPORT_LUNS: handle(0x00e3), retries(0) [ 42.392626] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00e3), lun(0) [ 42.399747] scsi 0:0:203:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 42.408408] scsi 0:0:203:0: SSP: handle(0x00e3), sas_addr(0x5000c5009543125a), phy(19), device_name(0x5000c50095431258) [ 42.419176] scsi 0:0:203:0: enclosure logical id(0x5001636001a42d3d), slot(19) [ 42.426482] scsi 0:0:203:0: enclosure level(0x0000), connector name( C2 ) [ 42.433376] scsi 0:0:203:0: serial_number(ZA1AGHEJ0000C8316HJF) [ 42.439296] scsi 0:0:203:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 42.462974] mpt3sas_cm0: detecting: handle(0x00e4), sas_address(0x5000c500954322ca), phy(20) [ 42.471411] mpt3sas_cm0: REPORT_LUNS: handle(0x00e4), retries(0) [ 42.492402] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00e4), lun(0) [ 42.499547] scsi 0:0:204:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 42.508209] scsi 0:0:204:0: SSP: handle(0x00e4), sas_addr(0x5000c500954322ca), phy(20), device_name(0x5000c500954322c8) [ 42.518984] scsi 0:0:204:0: enclosure logical id(0x5001636001a42d3d), slot(20) [ 42.526289] scsi 0:0:204:0: enclosure level(0x0000), connector name( C2 ) [ 42.533181] scsi 0:0:204:0: serial_number(ZA1AGGX30000R703TD9K) [ 42.539102] scsi 0:0:204:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 42.561978] mpt3sas_cm0: detecting: handle(0x00e5), sas_address(0x5000c50095432556), phy(21) [ 42.570418] mpt3sas_cm0: REPORT_LUNS: handle(0x00e5), retries(0) [ 42.590338] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00e5), lun(0) [ 42.597483] scsi 0:0:205:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 42.606149] scsi 0:0:205:0: SSP: handle(0x00e5), sas_addr(0x5000c50095432556), phy(21), device_name(0x5000c50095432554) [ 42.616918] scsi 0:0:205:0: enclosure logical id(0x5001636001a42d3d), slot(21) [ 42.624224] scsi 0:0:205:0: enclosure level(0x0000), connector name( C2 ) [ 42.631120] scsi 0:0:205:0: serial_number(ZA1AGMX60000C8316HBX) [ 42.637046] scsi 0:0:205:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 42.668480] mpt3sas_cm0: detecting: handle(0x00e6), sas_address(0x5000c500954311d6), phy(22) [ 42.676914] mpt3sas_cm0: REPORT_LUNS: handle(0x00e6), retries(0) [ 42.687685] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00e6), lun(0) [ 42.694796] scsi 0:0:206:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 42.703455] scsi 0:0:206:0: SSP: handle(0x00e6), sas_addr(0x5000c500954311d6), phy(22), device_name(0x5000c500954311d4) [ 42.714227] scsi 0:0:206:0: enclosure logical id(0x5001636001a42d3d), slot(22) [ 42.721533] scsi 0:0:206:0: enclosure level(0x0000), connector name( C2 ) [ 42.728424] scsi 0:0:206:0: serial_number(ZA1AGHFG0000C8316HCM) [ 42.734345] scsi 0:0:206:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 42.756981] mpt3sas_cm0: detecting: handle(0x00e7), sas_address(0x5000c50095431e62), phy(23) [ 42.765420] mpt3sas_cm0: REPORT_LUNS: handle(0x00e7), retries(0) [ 42.776837] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00e7), lun(0) [ 42.783966] scsi 0:0:207:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 42.792632] scsi 0:0:207:0: SSP: handle(0x00e7), sas_addr(0x5000c50095431e62), phy(23), device_name(0x5000c50095431e60) [ 42.803408] scsi 0:0:207:0: enclosure logical id(0x5001636001a42d3d), slot(23) [ 42.810715] scsi 0:0:207:0: enclosure level(0x0000), connector name( C2 ) [ 42.817606] scsi 0:0:207:0: serial_number(ZA1AGN4D0000R829CUEP) [ 42.823527] scsi 0:0:207:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 42.846974] mpt3sas_cm0: detecting: handle(0x00e8), sas_address(0x5000c500954ded8a), phy(24) [ 42.855413] mpt3sas_cm0: REPORT_LUNS: handle(0x00e8), retries(0) [ 42.866323] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00e8), lun(0) [ 42.873661] scsi 0:0:208:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 42.882321] scsi 0:0:208:0: SSP: handle(0x00e8), sas_addr(0x5000c500954ded8a), phy(24), device_name(0x5000c500954ded88) [ 42.893092] scsi 0:0:208:0: enclosure logical id(0x5001636001a42d3d), slot(24) [ 42.900398] scsi 0:0:208:0: enclosure level(0x0000), connector name( C2 ) [ 42.907290] scsi 0:0:208:0: serial_number(ZA1AM29Z0000R8302WBT) [ 42.913211] scsi 0:0:208:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 42.935978] mpt3sas_cm0: detecting: handle(0x00e9), sas_address(0x5000c500954da966), phy(25) [ 42.944416] mpt3sas_cm0: REPORT_LUNS: handle(0x00e9), retries(0) [ 42.966266] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00e9), lun(0) [ 42.973420] scsi 0:0:209:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 42.982082] scsi 0:0:209:0: SSP: handle(0x00e9), sas_addr(0x5000c500954da966), phy(25), device_name(0x5000c500954da964) [ 42.992853] scsi 0:0:209:0: enclosure logical id(0x5001636001a42d3d), slot(25) [ 43.000160] scsi 0:0:209:0: enclosure level(0x0000), connector name( C2 ) [ 43.007053] scsi 0:0:209:0: serial_number(ZA1AM3DD0000R83144S2) [ 43.012974] scsi 0:0:209:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 43.035979] mpt3sas_cm0: detecting: handle(0x00ea), sas_address(0x5000c500954de132), phy(26) [ 43.044419] mpt3sas_cm0: REPORT_LUNS: handle(0x00ea), retries(0) [ 43.062033] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00ea), lun(0) [ 43.069174] scsi 0:0:210:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 43.077837] scsi 0:0:210:0: SSP: handle(0x00ea), sas_addr(0x5000c500954de132), phy(26), device_name(0x5000c500954de130) [ 43.088613] scsi 0:0:210:0: enclosure logical id(0x5001636001a42d3d), slot(26) [ 43.095918] scsi 0:0:210:0: enclosure level(0x0000), connector name( C2 ) [ 43.102812] scsi 0:0:210:0: serial_number(ZA1AM5RA0000R8317NVM) [ 43.108731] scsi 0:0:210:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 43.131983] mpt3sas_cm0: detecting: handle(0x00eb), sas_address(0x5000c50095431d92), phy(27) [ 43.140421] mpt3sas_cm0: REPORT_LUNS: handle(0x00eb), retries(0) [ 43.162499] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00eb), lun(0) [ 43.169655] scsi 0:0:211:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 43.178321] scsi 0:0:211:0: SSP: handle(0x00eb), sas_addr(0x5000c50095431d92), phy(27), device_name(0x5000c50095431d90) [ 43.189094] scsi 0:0:211:0: enclosure logical id(0x5001636001a42d3d), slot(27) [ 43.196401] scsi 0:0:211:0: enclosure level(0x0000), connector name( C2 ) [ 43.203292] scsi 0:0:211:0: serial_number(ZA1AGH230000C8316HM5) [ 43.209212] scsi 0:0:211:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 43.234982] mpt3sas_cm0: detecting: handle(0x00ec), sas_address(0x5000c50095430dfe), phy(28) [ 43.243425] mpt3sas_cm0: REPORT_LUNS: handle(0x00ec), retries(0) [ 43.254277] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00ec), lun(0) [ 43.261451] scsi 0:0:212:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 43.270110] scsi 0:0:212:0: SSP: handle(0x00ec), sas_addr(0x5000c50095430dfe), phy(28), device_name(0x5000c50095430dfc) [ 43.280885] scsi 0:0:212:0: enclosure logical id(0x5001636001a42d3d), slot(28) [ 43.288192] scsi 0:0:212:0: enclosure level(0x0000), connector name( C2 ) [ 43.295084] scsi 0:0:212:0: serial_number(ZA1AG8BL0000C8316F5Y) [ 43.301001] scsi 0:0:212:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 43.323984] mpt3sas_cm0: detecting: handle(0x00ed), sas_address(0x5000c50095432336), phy(29) [ 43.332424] mpt3sas_cm0: REPORT_LUNS: handle(0x00ed), retries(0) [ 43.338908] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00ed), lun(0) [ 43.346045] scsi 0:0:213:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 43.354703] scsi 0:0:213:0: SSP: handle(0x00ed), sas_addr(0x5000c50095432336), phy(29), device_name(0x5000c50095432334) [ 43.365471] scsi 0:0:213:0: enclosure logical id(0x5001636001a42d3d), slot(29) [ 43.372777] scsi 0:0:213:0: enclosure level(0x0000), connector name( C2 ) [ 43.379673] scsi 0:0:213:0: serial_number(ZA1AGGWT0000C8316FPB) [ 43.385589] scsi 0:0:213:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 43.408980] mpt3sas_cm0: detecting: handle(0x00ee), sas_address(0x5000c5009543072a), phy(30) [ 43.417417] mpt3sas_cm0: REPORT_LUNS: handle(0x00ee), retries(0) [ 43.447692] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00ee), lun(0) [ 43.454869] scsi 0:0:214:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 43.463546] scsi 0:0:214:0: SSP: handle(0x00ee), sas_addr(0x5000c5009543072a), phy(30), device_name(0x5000c50095430728) [ 43.474320] scsi 0:0:214:0: enclosure logical id(0x5001636001a42d3d), slot(30) [ 43.481623] scsi 0:0:214:0: enclosure level(0x0000), connector name( C2 ) [ 43.488518] scsi 0:0:214:0: serial_number(ZA1AG3FE0000C83152QT) [ 43.494437] scsi 0:0:214:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 43.518986] mpt3sas_cm0: detecting: handle(0x00ef), sas_address(0x5000c5009543107a), phy(31) [ 43.527426] mpt3sas_cm0: REPORT_LUNS: handle(0x00ef), retries(0) [ 43.545857] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00ef), lun(0) [ 43.553006] scsi 0:0:215:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 43.561663] scsi 0:0:215:0: SSP: handle(0x00ef), sas_addr(0x5000c5009543107a), phy(31), device_name(0x5000c50095431078) [ 43.572433] scsi 0:0:215:0: enclosure logical id(0x5001636001a42d3d), slot(31) [ 43.579739] scsi 0:0:215:0: enclosure level(0x0000), connector name( C2 ) [ 43.586636] scsi 0:0:215:0: serial_number(ZA1AGHHF0000R8238R8V) [ 43.592562] scsi 0:0:215:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 43.615986] mpt3sas_cm0: detecting: handle(0x00f0), sas_address(0x5000c500954df56a), phy(32) [ 43.624421] mpt3sas_cm0: REPORT_LUNS: handle(0x00f0), retries(0) [ 43.644024] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00f0), lun(0) [ 43.651185] scsi 0:0:216:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 43.659852] scsi 0:0:216:0: SSP: handle(0x00f0), sas_addr(0x5000c500954df56a), phy(32), device_name(0x5000c500954df568) [ 43.670628] scsi 0:0:216:0: enclosure logical id(0x5001636001a42d3d), slot(32) [ 43.677935] scsi 0:0:216:0: enclosure level(0x0000), connector name( C2 ) [ 43.684828] scsi 0:0:216:0: serial_number(ZA1AM5CY0000R8317LL3) [ 43.690747] scsi 0:0:216:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 43.713983] mpt3sas_cm0: detecting: handle(0x00f1), sas_address(0x5000c50095431932), phy(33) [ 43.722418] mpt3sas_cm0: REPORT_LUNS: handle(0x00f1), retries(0) [ 43.740917] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00f1), lun(0) [ 43.748072] scsi 0:0:217:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 43.756743] scsi 0:0:217:0: SSP: handle(0x00f1), sas_addr(0x5000c50095431932), phy(33), device_name(0x5000c50095431930) [ 43.767512] scsi 0:0:217:0: enclosure logical id(0x5001636001a42d3d), slot(33) [ 43.774820] scsi 0:0:217:0: enclosure level(0x0000), connector name( C2 ) [ 43.781711] scsi 0:0:217:0: serial_number(ZA1AGN8V0000C8316GJF) [ 43.787632] scsi 0:0:217:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 43.810986] mpt3sas_cm0: detecting: handle(0x00f2), sas_address(0x5000c500954dad26), phy(34) [ 43.819422] mpt3sas_cm0: REPORT_LUNS: handle(0x00f2), retries(0) [ 43.825900] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00f2), lun(0) [ 43.833037] scsi 0:0:218:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 43.841702] scsi 0:0:218:0: SSP: handle(0x00f2), sas_addr(0x5000c500954dad26), phy(34), device_name(0x5000c500954dad24) [ 43.852474] scsi 0:0:218:0: enclosure logical id(0x5001636001a42d3d), slot(34) [ 43.859780] scsi 0:0:218:0: enclosure level(0x0000), connector name( C2 ) [ 43.866674] scsi 0:0:218:0: serial_number(ZA1AM6RJ0000R83180VQ) [ 43.872599] scsi 0:0:218:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 43.895987] mpt3sas_cm0: detecting: handle(0x00f3), sas_address(0x5000c500954d143a), phy(35) [ 43.904427] mpt3sas_cm0: REPORT_LUNS: handle(0x00f3), retries(0) [ 43.919946] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00f3), lun(0) [ 43.927072] scsi 0:0:219:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 43.935733] scsi 0:0:219:0: SSP: handle(0x00f3), sas_addr(0x5000c500954d143a), phy(35), device_name(0x5000c500954d1438) [ 43.946508] scsi 0:0:219:0: enclosure logical id(0x5001636001a42d3d), slot(35) [ 43.953813] scsi 0:0:219:0: enclosure level(0x0000), connector name( C2 ) [ 43.960707] scsi 0:0:219:0: serial_number(ZA1AA60J0000R8314VAR) [ 43.966626] scsi 0:0:219:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 43.993987] mpt3sas_cm0: detecting: handle(0x00f4), sas_address(0x5000c5009543120e), phy(36) [ 44.002423] mpt3sas_cm0: REPORT_LUNS: handle(0x00f4), retries(0) [ 44.008908] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00f4), lun(0) [ 44.016058] scsi 0:0:220:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 44.024734] scsi 0:0:220:0: SSP: handle(0x00f4), sas_addr(0x5000c5009543120e), phy(36), device_name(0x5000c5009543120c) [ 44.035508] scsi 0:0:220:0: enclosure logical id(0x5001636001a42d3d), slot(36) [ 44.042813] scsi 0:0:220:0: enclosure level(0x0000), connector name( C2 ) [ 44.049705] scsi 0:0:220:0: serial_number(ZA1AGHF40000C8316HJ5) [ 44.055626] scsi 0:0:220:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 44.078991] mpt3sas_cm0: detecting: handle(0x00f5), sas_address(0x5000c50095432542), phy(37) [ 44.087424] mpt3sas_cm0: REPORT_LUNS: handle(0x00f5), retries(0) [ 44.107788] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00f5), lun(0) [ 44.114948] scsi 0:0:221:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 44.123609] scsi 0:0:221:0: SSP: handle(0x00f5), sas_addr(0x5000c50095432542), phy(37), device_name(0x5000c50095432540) [ 44.134385] scsi 0:0:221:0: enclosure logical id(0x5001636001a42d3d), slot(37) [ 44.141690] scsi 0:0:221:0: enclosure level(0x0000), connector name( C2 ) [ 44.148585] scsi 0:0:221:0: serial_number(ZA1AGMXL0000C8316HCY) [ 44.154503] scsi 0:0:221:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 44.177984] mpt3sas_cm0: detecting: handle(0x00f6), sas_address(0x5000c50095431812), phy(38) [ 44.186423] mpt3sas_cm0: REPORT_LUNS: handle(0x00f6), retries(0) [ 44.205148] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00f6), lun(0) [ 44.212299] scsi 0:0:222:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 44.220956] scsi 0:0:222:0: SSP: handle(0x00f6), sas_addr(0x5000c50095431812), phy(38), device_name(0x5000c50095431810) [ 44.231730] scsi 0:0:222:0: enclosure logical id(0x5001636001a42d3d), slot(38) [ 44.239034] scsi 0:0:222:0: enclosure level(0x0000), connector name( C2 ) [ 44.245927] scsi 0:0:222:0: serial_number(ZA1AGH920000C8316H71) [ 44.251849] scsi 0:0:222:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 44.274988] mpt3sas_cm0: detecting: handle(0x00f7), sas_address(0x5000c500954da44a), phy(39) [ 44.283422] mpt3sas_cm0: REPORT_LUNS: handle(0x00f7), retries(0) [ 44.299993] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00f7), lun(0) [ 44.307116] scsi 0:0:223:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 44.315778] scsi 0:0:223:0: SSP: handle(0x00f7), sas_addr(0x5000c500954da44a), phy(39), device_name(0x5000c500954da448) [ 44.326551] scsi 0:0:223:0: enclosure logical id(0x5001636001a42d3d), slot(39) [ 44.333859] scsi 0:0:223:0: enclosure level(0x0000), connector name( C2 ) [ 44.340751] scsi 0:0:223:0: serial_number(ZA1AM3H20000R8303HLY) [ 44.346669] scsi 0:0:223:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 44.369984] mpt3sas_cm0: detecting: handle(0x00f8), sas_address(0x5000c50095430aea), phy(40) [ 44.378420] mpt3sas_cm0: REPORT_LUNS: handle(0x00f8), retries(0) [ 44.387304] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00f8), lun(0) [ 44.394476] scsi 0:0:224:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 44.403134] scsi 0:0:224:0: SSP: handle(0x00f8), sas_addr(0x5000c50095430aea), phy(40), device_name(0x5000c50095430ae8) [ 44.413905] scsi 0:0:224:0: enclosure logical id(0x5001636001a42d3d), slot(40) [ 44.421210] scsi 0:0:224:0: enclosure level(0x0000), connector name( C2 ) [ 44.428105] scsi 0:0:224:0: serial_number(ZA1AG3D90000R825141Y) [ 44.434023] scsi 0:0:224:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 44.456994] mpt3sas_cm0: detecting: handle(0x00f9), sas_address(0x5000c500954313a6), phy(41) [ 44.465434] mpt3sas_cm0: REPORT_LUNS: handle(0x00f9), retries(0) [ 44.471925] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00f9), lun(0) [ 44.479076] scsi 0:0:225:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 44.487744] scsi 0:0:225:0: SSP: handle(0x00f9), sas_addr(0x5000c500954313a6), phy(41), device_name(0x5000c500954313a4) [ 44.498519] scsi 0:0:225:0: enclosure logical id(0x5001636001a42d3d), slot(41) [ 44.505824] scsi 0:0:225:0: enclosure level(0x0000), connector name( C2 ) [ 44.512719] scsi 0:0:225:0: serial_number(ZA1AGHD50000R723LAMH) [ 44.518635] scsi 0:0:225:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 44.541995] mpt3sas_cm0: detecting: handle(0x00fa), sas_address(0x5000c500954dfd1e), phy(42) [ 44.550451] mpt3sas_cm0: REPORT_LUNS: handle(0x00fa), retries(0) [ 44.566571] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00fa), lun(0) [ 44.573699] scsi 0:0:226:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 44.582364] scsi 0:0:226:0: SSP: handle(0x00fa), sas_addr(0x5000c500954dfd1e), phy(42), device_name(0x5000c500954dfd1c) [ 44.593133] scsi 0:0:226:0: enclosure logical id(0x5001636001a42d3d), slot(42) [ 44.600439] scsi 0:0:226:0: enclosure level(0x0000), connector name( C2 ) [ 44.607330] scsi 0:0:226:0: serial_number(ZA1AM58X0000R8314R2L) [ 44.613250] scsi 0:0:226:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 44.636986] mpt3sas_cm0: detecting: handle(0x00fb), sas_address(0x5000c500954d3032), phy(43) [ 44.645424] mpt3sas_cm0: REPORT_LUNS: handle(0x00fb), retries(0) [ 44.661799] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00fb), lun(0) [ 44.668935] scsi 0:0:227:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 44.677592] scsi 0:0:227:0: SSP: handle(0x00fb), sas_addr(0x5000c500954d3032), phy(43), device_name(0x5000c500954d3030) [ 44.688363] scsi 0:0:227:0: enclosure logical id(0x5001636001a42d3d), slot(43) [ 44.695668] scsi 0:0:227:0: enclosure level(0x0000), connector name( C2 ) [ 44.702561] scsi 0:0:227:0: serial_number(ZA1ALV4B0000R8302VPE) [ 44.708480] scsi 0:0:227:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 44.735587] mpt3sas_cm0: detecting: handle(0x00fc), sas_address(0x5000c500954ddf8a), phy(44) [ 44.744024] mpt3sas_cm0: REPORT_LUNS: handle(0x00fc), retries(0) [ 44.763538] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00fc), lun(0) [ 44.773225] scsi 0:0:228:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 44.781898] scsi 0:0:228:0: SSP: handle(0x00fc), sas_addr(0x5000c500954ddf8a), phy(44), device_name(0x5000c500954ddf88) [ 44.792667] scsi 0:0:228:0: enclosure logical id(0x5001636001a42d3d), slot(44) [ 44.799974] scsi 0:0:228:0: enclosure level(0x0000), connector name( C2 ) [ 44.806867] scsi 0:0:228:0: serial_number(ZA1AM5RJ0000R8317N4L) [ 44.812786] scsi 0:0:228:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 44.835989] mpt3sas_cm0: detecting: handle(0x00fd), sas_address(0x5000c500954cd5b2), phy(45) [ 44.844432] mpt3sas_cm0: REPORT_LUNS: handle(0x00fd), retries(0) [ 44.850923] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00fd), lun(0) [ 44.858092] scsi 0:0:229:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 44.866756] scsi 0:0:229:0: SSP: handle(0x00fd), sas_addr(0x5000c500954cd5b2), phy(45), device_name(0x5000c500954cd5b0) [ 44.877532] scsi 0:0:229:0: enclosure logical id(0x5001636001a42d3d), slot(45) [ 44.884838] scsi 0:0:229:0: enclosure level(0x0000), connector name( C2 ) [ 44.891730] scsi 0:0:229:0: serial_number(ZA1ALGAG0000R8314S6M) [ 44.897650] scsi 0:0:229:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 44.933999] mpt3sas_cm0: detecting: handle(0x00fe), sas_address(0x5000c500954dbcca), phy(46) [ 44.942432] mpt3sas_cm0: REPORT_LUNS: handle(0x00fe), retries(0) [ 44.948912] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00fe), lun(0) [ 44.956083] scsi 0:0:230:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 44.964752] scsi 0:0:230:0: SSP: handle(0x00fe), sas_addr(0x5000c500954dbcca), phy(46), device_name(0x5000c500954dbcc8) [ 44.975527] scsi 0:0:230:0: enclosure logical id(0x5001636001a42d3d), slot(46) [ 44.982833] scsi 0:0:230:0: enclosure level(0x0000), connector name( C2 ) [ 44.989723] scsi 0:0:230:0: serial_number(ZA1AM3460000R8314UPK) [ 44.995645] scsi 0:0:230:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 45.021006] mpt3sas_cm0: detecting: handle(0x00ff), sas_address(0x5000c500954e0d6a), phy(47) [ 45.029465] mpt3sas_cm0: REPORT_LUNS: handle(0x00ff), retries(0) [ 45.035997] mpt3sas_cm0: TEST_UNIT_READY: handle(0x00ff), lun(0) [ 45.043139] scsi 0:0:231:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 45.051801] scsi 0:0:231:0: SSP: handle(0x00ff), sas_addr(0x5000c500954e0d6a), phy(47), device_name(0x5000c500954e0d68) [ 45.062575] scsi 0:0:231:0: enclosure logical id(0x5001636001a42d3d), slot(47) [ 45.069880] scsi 0:0:231:0: enclosure level(0x0000), connector name( C2 ) [ 45.076777] scsi 0:0:231:0: serial_number(ZA1AM51C0000R8317NH2) [ 45.082701] scsi 0:0:231:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 45.105984] mpt3sas_cm0: detecting: handle(0x0100), sas_address(0x5000c5009544642e), phy(48) [ 45.114423] mpt3sas_cm0: REPORT_LUNS: handle(0x0100), retries(0) [ 45.121164] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0100), lun(0) [ 45.128373] scsi 0:0:232:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 45.137038] scsi 0:0:232:0: SSP: handle(0x0100), sas_addr(0x5000c5009544642e), phy(48), device_name(0x5000c5009544642c) [ 45.147813] scsi 0:0:232:0: enclosure logical id(0x5001636001a42d3d), slot(48) [ 45.155119] scsi 0:0:232:0: enclosure level(0x0000), connector name( C2 ) [ 45.162010] scsi 0:0:232:0: serial_number(ZA1AGTE90000C831BTEF) [ 45.167930] scsi 0:0:232:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 45.191993] mpt3sas_cm0: detecting: handle(0x0101), sas_address(0x5000c50095430b32), phy(49) [ 45.200432] mpt3sas_cm0: REPORT_LUNS: handle(0x0101), retries(0) [ 45.235771] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0101), lun(0) [ 45.242954] scsi 0:0:233:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 45.251629] scsi 0:0:233:0: SSP: handle(0x0101), sas_addr(0x5000c50095430b32), phy(49), device_name(0x5000c50095430b30) [ 45.262404] scsi 0:0:233:0: enclosure logical id(0x5001636001a42d3d), slot(49) [ 45.269710] scsi 0:0:233:0: enclosure level(0x0000), connector name( C2 ) [ 45.276604] scsi 0:0:233:0: serial_number(ZA1AC2N80000R8301BGB) [ 45.282522] scsi 0:0:233:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 45.310994] mpt3sas_cm0: detecting: handle(0x0102), sas_address(0x5000c500954311aa), phy(50) [ 45.319446] mpt3sas_cm0: REPORT_LUNS: handle(0x0102), retries(0) [ 45.336249] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0102), lun(0) [ 45.343377] scsi 0:0:234:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 45.352032] scsi 0:0:234:0: SSP: handle(0x0102), sas_addr(0x5000c500954311aa), phy(50), device_name(0x5000c500954311a8) [ 45.362808] scsi 0:0:234:0: enclosure logical id(0x5001636001a42d3d), slot(50) [ 45.370114] scsi 0:0:234:0: enclosure level(0x0000), connector name( C2 ) [ 45.377006] scsi 0:0:234:0: serial_number(ZA1AGHFR0000R8300PAL) [ 45.382927] scsi 0:0:234:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 45.408988] mpt3sas_cm0: detecting: handle(0x0103), sas_address(0x5000c500954463ae), phy(51) [ 45.417438] mpt3sas_cm0: REPORT_LUNS: handle(0x0103), retries(0) [ 45.436455] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0103), lun(0) [ 45.443679] scsi 0:0:235:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 45.452340] scsi 0:0:235:0: SSP: handle(0x0103), sas_addr(0x5000c500954463ae), phy(51), device_name(0x5000c500954463ac) [ 45.463107] scsi 0:0:235:0: enclosure logical id(0x5001636001a42d3d), slot(51) [ 45.470413] scsi 0:0:235:0: enclosure level(0x0000), connector name( C2 ) [ 45.477307] scsi 0:0:235:0: serial_number(ZA1AGTFF0000R8251WAN) [ 45.483227] scsi 0:0:235:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 45.512001] mpt3sas_cm0: detecting: handle(0x0104), sas_address(0x5000c500954d92b2), phy(52) [ 45.520438] mpt3sas_cm0: REPORT_LUNS: handle(0x0104), retries(0) [ 45.540830] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0104), lun(0) [ 45.547995] scsi 0:0:236:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 45.556671] scsi 0:0:236:0: SSP: handle(0x0104), sas_addr(0x5000c500954d92b2), phy(52), device_name(0x5000c500954d92b0) [ 45.567447] scsi 0:0:236:0: enclosure logical id(0x5001636001a42d3d), slot(52) [ 45.574753] scsi 0:0:236:0: enclosure level(0x0000), connector name( C2 ) [ 45.581649] scsi 0:0:236:0: serial_number(ZA1AM7GN0000R8317MAH) [ 45.587575] scsi 0:0:236:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 45.610993] mpt3sas_cm0: detecting: handle(0x0105), sas_address(0x5000c5009537fade), phy(53) [ 45.619427] mpt3sas_cm0: REPORT_LUNS: handle(0x0105), retries(0) [ 45.638654] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0105), lun(0) [ 45.645799] scsi 0:0:237:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 45.654472] scsi 0:0:237:0: SSP: handle(0x0105), sas_addr(0x5000c5009537fade), phy(53), device_name(0x5000c5009537fadc) [ 45.665242] scsi 0:0:237:0: enclosure logical id(0x5001636001a42d3d), slot(53) [ 45.672550] scsi 0:0:237:0: enclosure level(0x0000), connector name( C2 ) [ 45.679440] scsi 0:0:237:0: serial_number(ZA1ACJHL0000R829D8BD) [ 45.685362] scsi 0:0:237:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 45.707990] mpt3sas_cm0: detecting: handle(0x0106), sas_address(0x5000c50095430ce6), phy(54) [ 45.716423] mpt3sas_cm0: REPORT_LUNS: handle(0x0106), retries(0) [ 45.737915] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0106), lun(0) [ 45.745049] scsi 0:0:238:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 45.753705] scsi 0:0:238:0: SSP: handle(0x0106), sas_addr(0x5000c50095430ce6), phy(54), device_name(0x5000c50095430ce4) [ 45.764478] scsi 0:0:238:0: enclosure logical id(0x5001636001a42d3d), slot(54) [ 45.771782] scsi 0:0:238:0: enclosure level(0x0000), connector name( C2 ) [ 45.778676] scsi 0:0:238:0: serial_number(ZA1AGHLP0000C83152MK) [ 45.784595] scsi 0:0:238:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 45.808998] mpt3sas_cm0: detecting: handle(0x0107), sas_address(0x5000c5009543108a), phy(55) [ 45.817436] mpt3sas_cm0: REPORT_LUNS: handle(0x0107), retries(0) [ 45.832291] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0107), lun(0) [ 45.839452] scsi 0:0:239:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 45.848127] scsi 0:0:239:0: SSP: handle(0x0107), sas_addr(0x5000c5009543108a), phy(55), device_name(0x5000c50095431088) [ 45.858902] scsi 0:0:239:0: enclosure logical id(0x5001636001a42d3d), slot(55) [ 45.866208] scsi 0:0:239:0: enclosure level(0x0000), connector name( C2 ) [ 45.873098] scsi 0:0:239:0: serial_number(ZA1AGHH90000R8301C59) [ 45.879019] scsi 0:0:239:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 45.901997] mpt3sas_cm0: detecting: handle(0x0108), sas_address(0x5000c500954da282), phy(56) [ 45.910440] mpt3sas_cm0: REPORT_LUNS: handle(0x0108), retries(0) [ 45.917432] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0108), lun(0) [ 45.924610] scsi 0:0:240:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 45.933276] scsi 0:0:240:0: SSP: handle(0x0108), sas_addr(0x5000c500954da282), phy(56), device_name(0x5000c500954da280) [ 45.944052] scsi 0:0:240:0: enclosure logical id(0x5001636001a42d3d), slot(56) [ 45.951357] scsi 0:0:240:0: enclosure level(0x0000), connector name( C2 ) [ 45.958250] scsi 0:0:240:0: serial_number(ZA1AM3JC0000R830289W) [ 45.964170] scsi 0:0:240:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 45.986999] mpt3sas_cm0: detecting: handle(0x0109), sas_address(0x5000c500954d9aa2), phy(57) [ 45.995434] mpt3sas_cm0: REPORT_LUNS: handle(0x0109), retries(0) [ 46.014813] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0109), lun(0) [ 46.021967] scsi 0:0:241:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 46.030638] scsi 0:0:241:0: SSP: handle(0x0109), sas_addr(0x5000c500954d9aa2), phy(57), device_name(0x5000c500954d9aa0) [ 46.041413] scsi 0:0:241:0: enclosure logical id(0x5001636001a42d3d), slot(57) [ 46.048721] scsi 0:0:241:0: enclosure level(0x0000), connector name( C2 ) [ 46.055614] scsi 0:0:241:0: serial_number(ZA1A7NPW0000R8301C8L) [ 46.061532] scsi 0:0:241:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 46.085000] mpt3sas_cm0: detecting: handle(0x010a), sas_address(0x5000c500954dcd86), phy(58) [ 46.093436] mpt3sas_cm0: REPORT_LUNS: handle(0x010a), retries(0) [ 46.109993] mpt3sas_cm0: TEST_UNIT_READY: handle(0x010a), lun(0) [ 46.117134] scsi 0:0:242:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 46.125796] scsi 0:0:242:0: SSP: handle(0x010a), sas_addr(0x5000c500954dcd86), phy(58), device_name(0x5000c500954dcd84) [ 46.136565] scsi 0:0:242:0: enclosure logical id(0x5001636001a42d3d), slot(58) [ 46.143871] scsi 0:0:242:0: enclosure level(0x0000), connector name( C2 ) [ 46.150767] scsi 0:0:242:0: serial_number(ZA1AM65H0000R8314RX2) [ 46.156683] scsi 0:0:242:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 46.180996] mpt3sas_cm0: detecting: handle(0x010b), sas_address(0x5000c500954dc60e), phy(59) [ 46.189431] mpt3sas_cm0: REPORT_LUNS: handle(0x010b), retries(0) [ 46.208838] mpt3sas_cm0: TEST_UNIT_READY: handle(0x010b), lun(0) [ 46.215962] scsi 0:0:243:0: Direct-Access SEAGATE ST8000NM0075 E004 PQ: 0 ANSI: 6 [ 46.224623] scsi 0:0:243:0: SSP: handle(0x010b), sas_addr(0x5000c500954dc60e), phy(59), device_name(0x5000c500954dc60c) [ 46.235394] scsi 0:0:243:0: enclosure logical id(0x5001636001a42d3d), slot(59) [ 46.242699] scsi 0:0:243:0: enclosure level(0x0000), connector name( C2 ) [ 46.249592] scsi 0:0:243:0: serial_number(ZA1AM3010000R8313J50) [ 46.255511] scsi 0:0:243:0: qdepth(254), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 46.281165] mpt3sas_cm0: detecting: handle(0x010d), sas_address(0x5001636001a42d3d), phy(76) [ 46.289617] mpt3sas_cm0: REPORT_LUNS: handle(0x010d), retries(0) [ 46.295814] mpt3sas_cm0: TEST_UNIT_READY: handle(0x010d), lun(0) [ 46.302332] scsi 0:0:244:0: Enclosure QCT JB4602 SIM 1 1500 PQ: 0 ANSI: 6 [ 46.310804] scsi 0:0:244:0: set ignore_delay_remove for handle(0x010d) [ 46.317330] scsi 0:0:244:0: SES: handle(0x010d), sas_addr(0x5001636001a42d3d), phy(76), device_name(0x5001636001a42d3d) [ 46.328100] scsi 0:0:244:0: enclosure logical id(0x5001636001a42d3d), slot(60) [ 46.335407] scsi 0:0:244:0: enclosure level(0x0000), connector name( C2 ) [ 46.342300] scsi 0:0:244:0: serial_number(EO0153600034 ) [ 46.347875] scsi 0:0:244:0: qdepth(1), tagged(0), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 46.379541] mpt3sas_cm0: port enable: SUCCESS [ 46.412522] sd 0:0:22:0: [sdv] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.413105] sd 0:0:3:0: [sdc] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.413107] sd 0:0:3:0: [sdc] 4096-byte physical blocks [ 46.413306] sd 0:0:73:0: [sdbc] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.413308] sd 0:0:73:0: [sdbc] 4096-byte physical blocks [ 46.413766] sd 0:0:21:0: [sdu] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.413768] sd 0:0:21:0: [sdu] 4096-byte physical blocks [ 46.414054] sd 0:0:28:0: [sdab] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.414056] sd 0:0:28:0: [sdab] 4096-byte physical blocks [ 46.414159] sd 0:0:75:0: [sdbk] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.414161] sd 0:0:75:0: [sdbk] 4096-byte physical blocks [ 46.414613] sd 0:0:74:0: [sdbg] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.414615] sd 0:0:74:0: [sdbg] 4096-byte physical blocks [ 46.415218] sd 0:0:63:0: [sdbn] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.415220] sd 0:0:63:0: [sdbn] 4096-byte physical blocks [ 46.415387] sd 0:0:66:0: [sdbr] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.415392] sd 0:0:66:0: [sdbr] 4096-byte physical blocks [ 46.415400] sd 0:0:37:0: [sdak] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.415402] sd 0:0:37:0: [sdak] 4096-byte physical blocks [ 46.415485] sd 0:0:3:0: [sdc] Write Protect is off [ 46.415487] sd 0:0:3:0: [sdc] Mode Sense: db 00 10 08 [ 46.415597] sd 0:0:73:0: [sdbc] Write Protect is off [ 46.415599] sd 0:0:73:0: [sdbc] Mode Sense: db 00 10 08 [ 46.415718] sd 0:0:46:0: [sdat] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.415719] sd 0:0:46:0: [sdat] 4096-byte physical blocks [ 46.415734] sd 0:0:71:0: [sdbx] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.415736] sd 0:0:71:0: [sdbx] 4096-byte physical blocks [ 46.415966] sd 0:0:47:0: [sdau] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.415968] sd 0:0:47:0: [sdau] 4096-byte physical blocks [ 46.416067] sd 0:0:8:0: [sdh] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.416068] sd 0:0:8:0: [sdh] 4096-byte physical blocks [ 46.416111] sd 0:0:21:0: [sdu] Write Protect is off [ 46.416113] sd 0:0:21:0: [sdu] Mode Sense: db 00 10 08 [ 46.416434] sd 0:0:28:0: [sdab] Write Protect is off [ 46.416436] sd 0:0:28:0: [sdab] Mode Sense: db 00 10 08 [ 46.416774] sd 0:0:75:0: [sdbk] Write Protect is off [ 46.416777] sd 0:0:75:0: [sdbk] Mode Sense: db 00 10 08 [ 46.416902] sd 0:0:74:0: [sdbg] Write Protect is off [ 46.416904] sd 0:0:74:0: [sdbg] Mode Sense: db 00 10 08 [ 46.417117] sd 0:0:3:0: [sdc] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.417132] sd 0:0:53:0: [sdbb] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.417133] sd 0:0:53:0: [sdbb] 4096-byte physical blocks [ 46.417384] sd 0:0:55:0: [sdbe] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.417385] sd 0:0:55:0: [sdbe] 4096-byte physical blocks [ 46.417403] sd 0:0:21:0: [sdu] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.417410] sd 0:0:73:0: [sdbc] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.417442] sd 0:0:56:0: [sdbf] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.417444] sd 0:0:56:0: [sdbf] 4096-byte physical blocks [ 46.417460] sd 0:0:57:0: [sdbh] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.417462] sd 0:0:80:0: [sdca] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.417465] sd 0:0:57:0: [sdbh] 4096-byte physical blocks [ 46.417488] sd 0:0:80:0: [sdca] 4096-byte physical blocks [ 46.417526] sd 0:0:17:0: [sdq] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.417528] sd 0:0:17:0: [sdq] 4096-byte physical blocks [ 46.417545] sd 0:0:63:0: [sdbn] Write Protect is off [ 46.417546] sd 0:0:63:0: [sdbn] Mode Sense: db 00 10 08 [ 46.417625] sd 0:0:58:0: [sdbi] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.417627] sd 0:0:58:0: [sdbi] 4096-byte physical blocks [ 46.417630] sd 0:0:5:0: [sde] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.417632] sd 0:0:5:0: [sde] 4096-byte physical blocks [ 46.417729] sd 0:0:28:0: [sdab] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.417740] sd 0:0:66:0: [sdbr] Write Protect is off [ 46.417741] sd 0:0:66:0: [sdbr] Mode Sense: db 00 10 08 [ 46.417846] sd 0:0:24:0: [sdx] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.417848] sd 0:0:24:0: [sdx] 4096-byte physical blocks [ 46.417909] sd 0:0:10:0: [sdj] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.417910] sd 0:0:10:0: [sdj] 4096-byte physical blocks [ 46.417939] sd 0:0:6:0: [sdf] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.417940] sd 0:0:6:0: [sdf] 4096-byte physical blocks [ 46.418125] sd 0:0:46:0: [sdat] Write Protect is off [ 46.418127] sd 0:0:46:0: [sdat] Mode Sense: db 00 10 08 [ 46.418228] sd 0:0:37:0: [sdak] Write Protect is off [ 46.418230] sd 0:0:37:0: [sdak] Mode Sense: db 00 10 08 [ 46.418295] sd 0:0:74:0: [sdbg] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.418339] sd 0:0:47:0: [sdau] Write Protect is off [ 46.418341] sd 0:0:47:0: [sdau] Mode Sense: db 00 10 08 [ 46.418418] sd 0:0:14:0: [sdn] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.418419] sd 0:0:14:0: [sdn] 4096-byte physical blocks [ 46.418430] sd 0:0:8:0: [sdh] Write Protect is off [ 46.418432] sd 0:0:8:0: [sdh] Mode Sense: db 00 10 08 [ 46.418481] sd 0:0:86:0: [sdcg] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.418483] sd 0:0:86:0: [sdcg] 4096-byte physical blocks [ 46.418514] sd 0:0:75:0: [sdbk] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.418578] sd 0:0:71:0: [sdbx] Write Protect is off [ 46.418580] sd 0:0:71:0: [sdbx] Mode Sense: db 00 10 08 [ 46.418813] sd 0:0:7:0: [sdg] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.418816] sd 0:0:7:0: [sdg] 4096-byte physical blocks [ 46.419006] sd 0:0:63:0: [sdbn] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.419102] sd 0:0:66:0: [sdbr] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.419154] sd 0:0:35:0: [sdai] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.419156] sd 0:0:35:0: [sdai] 4096-byte physical blocks [ 46.419378] sd 0:0:87:0: [sdch] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.419381] sd 0:0:87:0: [sdch] 4096-byte physical blocks [ 46.419428] sd 0:0:46:0: [sdat] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.419638] sd 0:0:68:0: [sdbu] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.419640] sd 0:0:68:0: [sdbu] 4096-byte physical blocks [ 46.419644] sd 0:0:47:0: [sdau] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.419692] sd 0:0:2:0: [sdb] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.419694] sd 0:0:2:0: [sdb] 4096-byte physical blocks [ 46.419710] sd 0:0:37:0: [sdak] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.419720] sd 0:0:53:0: [sdbb] Write Protect is off [ 46.419722] sd 0:0:53:0: [sdbb] Mode Sense: db 00 10 08 [ 46.419755] sd 0:0:55:0: [sdbe] Write Protect is off [ 46.419757] sd 0:0:55:0: [sdbe] Mode Sense: db 00 10 08 [ 46.419776] sd 0:0:8:0: [sdh] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.419811] sd 0:0:56:0: [sdbf] Write Protect is off [ 46.419812] sd 0:0:56:0: [sdbf] Mode Sense: db 00 10 08 [ 46.419882] sd 0:0:57:0: [sdbh] Write Protect is off [ 46.419884] sd 0:0:57:0: [sdbh] Mode Sense: db 00 10 08 [ 46.419909] sd 0:0:17:0: [sdq] Write Protect is off [ 46.419910] sd 0:0:17:0: [sdq] Mode Sense: db 00 10 08 [ 46.419928] sd 0:0:71:0: [sdbx] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.419929] sd 0:0:91:0: [sdcl] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.419931] sd 0:0:91:0: [sdcl] 4096-byte physical blocks [ 46.419978] sd 0:0:80:0: [sdca] Write Protect is off [ 46.419980] sd 0:0:80:0: [sdca] Mode Sense: db 00 10 08 [ 46.419983] sd 0:0:62:0: [sdbm] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.419985] sd 0:0:62:0: [sdbm] 4096-byte physical blocks [ 46.420010] sd 0:0:58:0: [sdbi] Write Protect is off [ 46.420012] sd 0:0:58:0: [sdbi] Mode Sense: db 00 10 08 [ 46.420084] sd 0:0:5:0: [sde] Write Protect is off [ 46.420085] sd 0:0:5:0: [sde] Mode Sense: db 00 10 08 [ 46.420230] sd 0:0:24:0: [sdx] Write Protect is off [ 46.420232] sd 0:0:24:0: [sdx] Mode Sense: db 00 10 08 [ 46.420326] sd 0:0:6:0: [sdf] Write Protect is off [ 46.420327] sd 0:0:6:0: [sdf] Mode Sense: db 00 10 08 [ 46.420448] sd 0:0:72:0: [sdax] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.420450] sd 0:0:72:0: [sdax] 4096-byte physical blocks [ 46.420557] sd 0:0:4:0: [sdd] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.420559] sd 0:0:4:0: [sdd] 4096-byte physical blocks [ 46.420788] sd 0:0:29:0: [sdac] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.420789] sd 0:0:29:0: [sdac] 4096-byte physical blocks [ 46.420846] sd 0:0:41:0: [sdao] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.420848] sd 0:0:41:0: [sdao] 4096-byte physical blocks [ 46.420970] sd 0:0:10:0: [sdj] Write Protect is off [ 46.420972] sd 0:0:10:0: [sdj] Mode Sense: db 00 10 08 [ 46.421043] sd 0:0:55:0: [sdbe] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.421072] sd 0:0:81:0: [sdcb] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.421074] sd 0:0:81:0: [sdcb] 4096-byte physical blocks [ 46.421097] sd 0:0:42:0: [sdap] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.421099] sd 0:0:42:0: [sdap] 4096-byte physical blocks [ 46.421167] sd 0:0:7:0: [sdg] Write Protect is off [ 46.421169] sd 0:0:7:0: [sdg] Mode Sense: db 00 10 08 [ 46.421202] sd 0:0:32:0: [sdaf] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.421204] sd 0:0:32:0: [sdaf] 4096-byte physical blocks [ 46.421210] sd 0:0:53:0: [sdbb] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.421226] sd 0:0:17:0: [sdq] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.421399] sd 0:0:56:0: [sdbf] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.421408] sd 0:0:57:0: [sdbh] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.421457] sd 0:0:44:0: [sdar] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.421459] sd 0:0:44:0: [sdar] 4096-byte physical blocks [ 46.421606] sd 0:0:58:0: [sdbi] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.421616] sd 0:0:35:0: [sdai] Write Protect is off [ 46.421617] sd 0:0:35:0: [sdai] Mode Sense: db 00 10 08 [ 46.421678] sd 0:0:14:0: [sdn] Write Protect is off [ 46.421680] sd 0:0:14:0: [sdn] Mode Sense: db 00 10 08 [ 46.421695] sd 0:0:80:0: [sdca] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.421915] sd 0:0:86:0: [sdcg] Write Protect is off [ 46.421917] sd 0:0:86:0: [sdcg] Mode Sense: db 00 10 08 [ 46.422102] sd 0:0:5:0: [sde] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.422172] sd 0:0:48:0: [sdav] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.422173] sd 0:0:48:0: [sdav] 4096-byte physical blocks [ 46.422182] sd 0:0:6:0: [sdf] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.422196] sd 0:0:24:0: [sdx] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.422311] sd 0:0:10:0: [sdj] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.422409] sd 0:0:62:0: [sdbm] Write Protect is off [ 46.422410] sd 0:0:62:0: [sdbm] Mode Sense: db 00 10 08 [ 46.422422] sd 0:0:68:0: [sdbu] Write Protect is off [ 46.422424] sd 0:0:68:0: [sdbu] Mode Sense: db 00 10 08 [ 46.422496] sd 0:0:7:0: [sdg] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.422552] sd 0:0:87:0: [sdch] Write Protect is off [ 46.422554] sd 0:0:87:0: [sdch] Mode Sense: db 00 10 08 [ 46.422558] sd 0:0:76:0: [sdbo] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.422561] sd 0:0:76:0: [sdbo] 4096-byte physical blocks [ 46.422668] sd 0:0:59:0: [sdbj] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.422670] sd 0:0:59:0: [sdbj] 4096-byte physical blocks [ 46.422794] sd 0:0:2:0: [sdb] Write Protect is off [ 46.422797] sd 0:0:2:0: [sdb] Mode Sense: db 00 10 08 [ 46.422913] sd 0:0:4:0: [sdd] Write Protect is off [ 46.422914] sd 0:0:4:0: [sdd] Mode Sense: db 00 10 08 [ 46.422971] sd 0:0:14:0: [sdn] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.423215] sd 0:0:86:0: [sdcg] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.423220] sd 0:0:41:0: [sdao] Write Protect is off [ 46.423222] sd 0:0:41:0: [sdao] Mode Sense: db 00 10 08 [ 46.423294] sd 0:0:91:0: [sdcl] Write Protect is off [ 46.423296] sd 0:0:91:0: [sdcl] Mode Sense: db 00 10 08 [ 46.423353] sd 0:0:1:0: [sda] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.423355] sd 0:0:1:0: [sda] 4096-byte physical blocks [ 46.423382] sd 0:0:36:0: [sdaj] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.423384] sd 0:0:36:0: [sdaj] 4096-byte physical blocks [ 46.423393] sd 0:0:31:0: [sdae] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.423394] sd 0:0:31:0: [sdae] 4096-byte physical blocks [ 46.423407] sd 0:0:35:0: [sdai] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.423476] sd 0:0:42:0: [sdap] Write Protect is off [ 46.423478] sd 0:0:42:0: [sdap] Mode Sense: db 00 10 08 [ 46.423503] sd 0:0:72:0: [sdax] Write Protect is off [ 46.423505] sd 0:0:72:0: [sdax] Mode Sense: db 00 10 08 [ 46.423573] sd 0:0:27:0: [sdaa] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.423574] sd 0:0:27:0: [sdaa] 4096-byte physical blocks [ 46.423637] sd 0:0:39:0: [sdam] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.423639] sd 0:0:39:0: [sdam] 4096-byte physical blocks [ 46.423719] sd 0:0:68:0: [sdbu] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.423809] sd 0:0:62:0: [sdbm] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.423839] sd 0:0:44:0: [sdar] Write Protect is off [ 46.423840] sd 0:0:44:0: [sdar] Mode Sense: db 00 10 08 [ 46.423842] sd 0:0:87:0: [sdch] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.423937] sd 0:0:25:0: [sdy] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.423939] sd 0:0:25:0: [sdy] 4096-byte physical blocks [ 46.424278] sd 0:0:2:0: [sdb] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.424288] sd 0:0:4:0: [sdd] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.424317] sd 0:0:81:0: [sdcb] Write Protect is off [ 46.424319] sd 0:0:81:0: [sdcb] Mode Sense: db 00 10 08 [ 46.424504] sd 0:0:41:0: [sdao] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.424562] sd 0:0:23:0: [sdw] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.424564] sd 0:0:23:0: [sdw] 4096-byte physical blocks [ 46.424576] sd 0:0:30:0: [sdad] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.424577] sd 0:0:30:0: [sdad] 4096-byte physical blocks [ 46.424612] sd 0:0:48:0: [sdav] Write Protect is off [ 46.424614] sd 0:0:48:0: [sdav] Mode Sense: db 00 10 08 [ 46.424623] sd 0:0:32:0: [sdaf] Write Protect is off [ 46.424625] sd 0:0:32:0: [sdaf] Mode Sense: db 00 10 08 [ 46.424627] sd 0:0:54:0: [sdbd] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.424630] sd 0:0:54:0: [sdbd] 4096-byte physical blocks [ 46.424634] sd 0:0:29:0: [sdac] Write Protect is off [ 46.424635] sd 0:0:29:0: [sdac] Mode Sense: db 00 10 08 [ 46.424699] sd 0:0:91:0: [sdcl] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.424784] sd 0:0:42:0: [sdap] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.424790] sd 0:0:72:0: [sdax] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.424868] sd 0:0:76:0: [sdbo] Write Protect is off [ 46.424870] sd 0:0:76:0: [sdbo] Mode Sense: db 00 10 08 [ 46.424925] sd 0:0:50:0: [sday] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.424927] sd 0:0:50:0: [sday] 4096-byte physical blocks [ 46.425142] sd 0:0:44:0: [sdar] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.425339] sd 0:0:59:0: [sdbj] Write Protect is off [ 46.425342] sd 0:0:82:0: [sdcc] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.425344] sd 0:0:59:0: [sdbj] Mode Sense: db 00 10 08 [ 46.425346] sd 0:0:82:0: [sdcc] 4096-byte physical blocks [ 46.425395] sd 0:0:34:0: [sdah] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.425397] sd 0:0:34:0: [sdah] 4096-byte physical blocks [ 46.425410] sd 0:0:94:0: [sdco] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.425411] sd 0:0:94:0: [sdco] 4096-byte physical blocks [ 46.425465] sd 0:0:38:0: [sdal] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.425467] sd 0:0:38:0: [sdal] 4096-byte physical blocks [ 46.425468] sd 0:0:12:0: [sdl] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.425470] sd 0:0:12:0: [sdl] 4096-byte physical blocks [ 46.425849] sd 0:0:64:0: [sdbp] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.425851] sd 0:0:64:0: [sdbp] 4096-byte physical blocks [ 46.425875] sd 0:0:81:0: [sdcb] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.425929] sd 0:0:26:0: [sdz] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.425930] sd 0:0:26:0: [sdz] 4096-byte physical blocks [ 46.425956] sd 0:0:32:0: [sdaf] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.425966] sd 0:0:29:0: [sdac] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.425992] sd 0:0:48:0: [sdav] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.426009] sd 0:0:11:0: [sdk] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.426010] sd 0:0:11:0: [sdk] 4096-byte physical blocks [ 46.426095] sd 0:0:31:0: [sdae] Write Protect is off [ 46.426096] sd 0:0:31:0: [sdae] Mode Sense: db 00 10 08 [ 46.426106] sd 0:0:36:0: [sdaj] Write Protect is off [ 46.426107] sd 0:0:36:0: [sdaj] Mode Sense: db 00 10 08 [ 46.426116] sd 0:0:1:0: [sda] Write Protect is off [ 46.426118] sd 0:0:1:0: [sda] Mode Sense: db 00 10 08 [ 46.426187] sd 0:0:76:0: [sdbo] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.426196] sd 0:0:69:0: [sdbv] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.426198] sd 0:0:69:0: [sdbv] 4096-byte physical blocks [ 46.426201] sd 0:0:27:0: [sdaa] Write Protect is off [ 46.426202] sd 0:0:27:0: [sdaa] Mode Sense: db 00 10 08 [ 46.426402] sd 0:0:39:0: [sdam] Write Protect is off [ 46.426404] sd 0:0:39:0: [sdam] Mode Sense: db 00 10 08 [ 46.426498] sd 0:0:25:0: [sdy] Write Protect is off [ 46.426500] sd 0:0:25:0: [sdy] Mode Sense: db 00 10 08 [ 46.426570] sd 0:0:45:0: [sdas] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.426571] sd 0:0:45:0: [sdas] 4096-byte physical blocks [ 46.426815] sd 0:0:40:0: [sdan] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.426817] sd 0:0:40:0: [sdan] 4096-byte physical blocks [ 46.426870] sd 0:0:43:0: [sdaq] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.426872] sd 0:0:43:0: [sdaq] 4096-byte physical blocks [ 46.427103] sd 0:0:51:0: [sdaz] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.427104] sd 0:0:51:0: [sdaz] 4096-byte physical blocks [ 46.427151] sd 0:0:33:0: [sdag] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.427153] sd 0:0:33:0: [sdag] 4096-byte physical blocks [ 46.427166] sd 0:0:65:0: [sdbq] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.427168] sd 0:0:65:0: [sdbq] 4096-byte physical blocks [ 46.427222] sd 0:0:30:0: [sdad] Write Protect is off [ 46.427224] sd 0:0:30:0: [sdad] Mode Sense: db 00 10 08 [ 46.427237] sd 0:0:23:0: [sdw] Write Protect is off [ 46.427239] sd 0:0:23:0: [sdw] Mode Sense: db 00 10 08 [ 46.427250] sd 0:0:59:0: [sdbj] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.427295] sd 0:0:88:0: [sdci] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.427297] sd 0:0:88:0: [sdci] 4096-byte physical blocks [ 46.427336] sd 0:0:50:0: [sday] Write Protect is off [ 46.427337] sd 0:0:50:0: [sday] Mode Sense: db 00 10 08 [ 46.427386] sd 0:0:96:0: [sdcq] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.427388] sd 0:0:96:0: [sdcq] 4096-byte physical blocks [ 46.427442] sd 0:0:49:0: [sdaw] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.427443] sd 0:0:49:0: [sdaw] 4096-byte physical blocks [ 46.427454] sd 0:0:15:0: [sdo] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.427455] sd 0:0:15:0: [sdo] 4096-byte physical blocks [ 46.427489] sd 0:0:36:0: [sdaj] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.427499] sd 0:0:31:0: [sdae] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.427508] sd 0:0:1:0: [sda] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.427522] sd 0:0:70:0: [sdbw] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.427523] sd 0:0:70:0: [sdbw] 4096-byte physical blocks [ 46.427670] sd 0:0:82:0: [sdcc] Write Protect is off [ 46.427672] sd 0:0:82:0: [sdcc] Mode Sense: db 00 10 08 [ 46.427756] sd 0:0:54:0: [sdbd] Write Protect is off [ 46.427758] sd 0:0:54:0: [sdbd] Mode Sense: db 00 10 08 [ 46.428054] sd 0:0:12:0: [sdl] Write Protect is off [ 46.428056] sd 0:0:12:0: [sdl] Mode Sense: db 00 10 08 [ 46.428077] sd 0:0:16:0: [sdp] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.428079] sd 0:0:16:0: [sdp] 4096-byte physical blocks [ 46.428081] sd 0:0:85:0: [sdcf] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.428083] sd 0:0:85:0: [sdcf] 4096-byte physical blocks [ 46.428099] sd 0:0:38:0: [sdal] Write Protect is off [ 46.428100] sd 0:0:38:0: [sdal] Mode Sense: db 00 10 08 [ 46.428111] sd 0:0:67:0: [sdbt] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.428143] sd 0:0:27:0: [sdaa] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.428160] sd 0:0:25:0: [sdy] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.428170] sd 0:0:39:0: [sdam] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.428196] sd 0:0:34:0: [sdah] Write Protect is off [ 46.428197] sd 0:0:34:0: [sdah] Mode Sense: db 00 10 08 [ 46.428236] sd 0:0:67:0: [sdbt] 4096-byte physical blocks [ 46.428340] sd 0:0:11:0: [sdk] Write Protect is off [ 46.428341] sd 0:0:11:0: [sdk] Mode Sense: db 00 10 08 [ 46.428388] sd 0:0:79:0: [sdbz] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.428415] sd 0:0:94:0: [sdco] Write Protect is off [ 46.428417] sd 0:0:94:0: [sdco] Mode Sense: db 00 10 08 [ 46.428418] sd 0:0:79:0: [sdbz] 4096-byte physical blocks [ 46.428435] sd 0:0:89:0: [sdcj] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.428437] sd 0:0:89:0: [sdcj] 4096-byte physical blocks [ 46.428448] sd 0:0:64:0: [sdbp] Write Protect is off [ 46.428449] sd 0:0:64:0: [sdbp] Mode Sense: db 00 10 08 [ 46.428630] sd 0:0:26:0: [sdz] Write Protect is off [ 46.428635] sd 0:0:26:0: [sdz] Mode Sense: db 00 10 08 [ 46.428728] sd 0:0:50:0: [sday] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.428925] sd 0:0:78:0: [sdby] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.428926] sd 0:0:78:0: [sdby] 4096-byte physical blocks [ 46.428941] sd 0:0:69:0: [sdbv] Write Protect is off [ 46.428942] sd 0:0:69:0: [sdbv] Mode Sense: db 00 10 08 [ 46.429059] sd 0:0:54:0: [sdbd] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.429061] sd 0:0:60:0: [sdbl] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.429063] sd 0:0:60:0: [sdbl] 4096-byte physical blocks [ 46.429069] sd 0:0:30:0: [sdad] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.429078] sd 0:0:9:0: [sdi] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.429079] sd 0:0:9:0: [sdi] 4096-byte physical blocks [ 46.429080] sd 0:0:23:0: [sdw] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.429097] sd 0:0:82:0: [sdcc] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.429343] sd 0:0:45:0: [sdas] Write Protect is off [ 46.429349] sd 0:0:45:0: [sdas] Mode Sense: db 00 10 08 [ 46.429368] sd 0:0:40:0: [sdan] Write Protect is off [ 46.429370] sd 0:0:40:0: [sdan] Mode Sense: db 00 10 08 [ 46.429392] sd 0:0:43:0: [sdaq] Write Protect is off [ 46.429394] sd 0:0:43:0: [sdaq] Mode Sense: db 00 10 08 [ 46.429602] sd 0:0:51:0: [sdaz] Write Protect is off [ 46.429606] sd 0:0:51:0: [sdaz] Mode Sense: db 00 10 08 [ 46.429649] sd 0:0:33:0: [sdag] Write Protect is off [ 46.429651] sd 0:0:33:0: [sdag] Mode Sense: db 00 10 08 [ 46.429657] sd 0:0:65:0: [sdbq] Write Protect is off [ 46.429659] sd 0:0:65:0: [sdbq] Mode Sense: db 00 10 08 [ 46.429671] sd 0:0:93:0: [sdcn] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.429672] sd 0:0:93:0: [sdcn] 4096-byte physical blocks [ 46.429730] sd 0:0:95:0: [sdcp] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.429732] sd 0:0:95:0: [sdcp] 4096-byte physical blocks [ 46.429737] sd 0:0:34:0: [sdah] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.429738] sd 0:0:88:0: [sdci] Write Protect is off [ 46.429740] sd 0:0:88:0: [sdci] Mode Sense: db 00 10 08 [ 46.429750] sd 0:0:64:0: [sdbp] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.429811] sd 0:0:49:0: [sdaw] Write Protect is off [ 46.429813] sd 0:0:49:0: [sdaw] Mode Sense: db 00 10 08 [ 46.429846] sd 0:0:15:0: [sdo] Write Protect is off [ 46.429847] sd 0:0:38:0: [sdal] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.429848] sd 0:0:15:0: [sdo] Mode Sense: db 00 10 08 [ 46.429920] sd 0:0:94:0: [sdco] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.429934] sd 0:0:26:0: [sdz] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.430183] sd 0:0:77:0: [sdbs] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.430185] sd 0:0:77:0: [sdbs] 4096-byte physical blocks [ 46.430196] sd 0:0:96:0: [sdcq] Write Protect is off [ 46.430198] sd 0:0:96:0: [sdcq] Mode Sense: db 00 10 08 [ 46.430325] sd 0:0:69:0: [sdbv] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.430405] sd 0:0:70:0: [sdbw] Write Protect is off [ 46.430406] sd 0:0:70:0: [sdbw] Mode Sense: db 00 10 08 [ 46.430512] sd 0:0:67:0: [sdbt] Write Protect is off [ 46.430514] sd 0:0:67:0: [sdbt] Mode Sense: db 00 10 08 [ 46.430588] sd 0:0:12:0: [sdl] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.430601] sd 0:0:11:0: [sdk] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.430672] sd 0:0:84:0: [sdce] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.430674] sd 0:0:84:0: [sdce] 4096-byte physical blocks [ 46.430784] sd 0:0:85:0: [sdcf] Write Protect is off [ 46.430787] sd 0:0:85:0: [sdcf] Mode Sense: db 00 10 08 [ 46.430804] sd 0:0:89:0: [sdcj] Write Protect is off [ 46.430805] sd 0:0:89:0: [sdcj] Mode Sense: db 00 10 08 [ 46.430818] sd 0:0:79:0: [sdbz] Write Protect is off [ 46.430820] sd 0:0:79:0: [sdbz] Mode Sense: db 00 10 08 [ 46.430852] sd 0:0:40:0: [sdan] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.430861] sd 0:0:43:0: [sdaq] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.430905] sd 0:0:51:0: [sdaz] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.430949] sd 0:0:33:0: [sdag] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.430951] sd 0:0:65:0: [sdbq] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.431077] sd 0:0:19:0: [sds] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.431079] sd 0:0:19:0: [sds] 4096-byte physical blocks [ 46.431094] sd 0:0:20:0: [sdt] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.431096] sd 0:0:20:0: [sdt] 4096-byte physical blocks [ 46.431107] sd 0:0:18:0: [sdr] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.431108] sd 0:0:18:0: [sdr] 4096-byte physical blocks [ 46.431213] sd 0:0:88:0: [sdci] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.431222] sd 0:0:45:0: [sdas] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.431298] sd 0:0:78:0: [sdby] Write Protect is off [ 46.431300] sd 0:0:78:0: [sdby] Mode Sense: db 00 10 08 [ 46.431387] sd 0:0:52:0: [sdba] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.431389] sd 0:0:52:0: [sdba] 4096-byte physical blocks [ 46.431401] sd 0:0:49:0: [sdaw] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.431411] sd 0:0:15:0: [sdo] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.431461] sd 0:0:96:0: [sdcq] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.431465] sd 0:0:83:0: [sdcd] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.431467] sd 0:0:83:0: [sdcd] 4096-byte physical blocks [ 46.431714] sd 0:0:9:0: [sdi] Write Protect is off [ 46.431716] sd 0:0:70:0: [sdbw] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.431719] sd 0:0:9:0: [sdi] Mode Sense: db 00 10 08 [ 46.431730] sd 0:0:60:0: [sdbl] Write Protect is off [ 46.431732] sd 0:0:60:0: [sdbl] Mode Sense: db 00 10 08 [ 46.431854] sd 0:0:67:0: [sdbt] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.431920] sd 0:0:16:0: [sdp] Write Protect is off [ 46.431922] sd 0:0:16:0: [sdp] Mode Sense: db 00 10 08 [ 46.432057] sd 0:0:95:0: [sdcp] Write Protect is off [ 46.432058] sd 0:0:95:0: [sdcp] Mode Sense: db 00 10 08 [ 46.432071] sd 0:0:89:0: [sdcj] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.432115] sd 0:0:79:0: [sdbz] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.432480] sd 0:0:85:0: [sdcf] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.432521] sd 0:0:93:0: [sdcn] Write Protect is off [ 46.432524] sd 0:0:93:0: [sdcn] Mode Sense: db 00 10 08 [ 46.432580] sd 0:0:78:0: [sdby] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.432581] sd 0:0:77:0: [sdbs] Write Protect is off [ 46.432583] sd 0:0:77:0: [sdbs] Mode Sense: db 00 10 08 [ 46.433064] sd 0:0:90:0: [sdck] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.433065] sd 0:0:90:0: [sdck] 4096-byte physical blocks [ 46.433389] sd 0:0:95:0: [sdcp] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.433562] sd 0:0:60:0: [sdbl] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.433574] sd 0:0:9:0: [sdi] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.433580] sd 0:0:84:0: [sdce] Write Protect is off [ 46.433582] sd 0:0:84:0: [sdce] Mode Sense: db 00 10 08 [ 46.433795] sd 0:0:16:0: [sdp] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.433803] sd 0:0:93:0: [sdcn] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.433843] sd 0:0:20:0: [sdt] Write Protect is off [ 46.433848] sd 0:0:20:0: [sdt] Mode Sense: db 00 10 08 [ 46.433857] sd 0:0:18:0: [sdr] Write Protect is off [ 46.433858] sd 0:0:18:0: [sdr] Mode Sense: db 00 10 08 [ 46.433866] sd 0:0:19:0: [sds] Write Protect is off [ 46.433867] sd 0:0:19:0: [sds] Mode Sense: db 00 10 08 [ 46.433876] sd 0:0:77:0: [sdbs] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.433939] sd 0:0:83:0: [sdcd] Write Protect is off [ 46.433941] sd 0:0:83:0: [sdcd] Mode Sense: db 00 10 08 [ 46.434090] sd 0:0:13:0: [sdm] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.434092] sd 0:0:13:0: [sdm] 4096-byte physical blocks [ 46.434525] sd 0:0:52:0: [sdba] Write Protect is off [ 46.434526] sd 0:0:52:0: [sdba] Mode Sense: db 00 10 08 [ 46.435463] sd 0:0:90:0: [sdck] Write Protect is off [ 46.435465] sd 0:0:90:0: [sdck] Mode Sense: db 00 10 08 [ 46.435515] sd 0:0:18:0: [sdr] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.435524] sd 0:0:84:0: [sdce] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.435526] sd 0:0:20:0: [sdt] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.435545] sd 0:0:19:0: [sds] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.435731] sd 0:0:83:0: [sdcd] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.436183] sd 0:0:98:0: [sdcs] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.436184] sd 0:0:98:0: [sdcs] 4096-byte physical blocks [ 46.436276] sd 0:0:52:0: [sdba] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.436772] sd 0:0:13:0: [sdm] Write Protect is off [ 46.436776] sd 0:0:13:0: [sdm] Mode Sense: db 00 10 08 [ 46.436778] sd 0:0:90:0: [sdck] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.437629] sd 0:0:21:0: [sdu] Attached SCSI disk [ 46.438194] sd 0:0:99:0: [sdct] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.438197] sd 0:0:99:0: [sdct] 4096-byte physical blocks [ 46.438213] sd 0:0:75:0: [sdbk] Attached SCSI disk [ 46.438384] sd 0:0:13:0: [sdm] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.438785] sd 0:0:98:0: [sdcs] Write Protect is off [ 46.438787] sd 0:0:98:0: [sdcs] Mode Sense: db 00 10 08 [ 46.439952] sd 0:0:101:0: [sdcv] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.439954] sd 0:0:101:0: [sdcv] 4096-byte physical blocks [ 46.440083] sd 0:0:98:0: [sdcs] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.440470] sd 0:0:99:0: [sdct] Write Protect is off [ 46.440471] sd 0:0:99:0: [sdct] Mode Sense: db 00 10 08 [ 46.441803] sd 0:0:99:0: [sdct] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.442024] sd 0:0:3:0: [sdc] Attached SCSI disk [ 46.442250] sd 0:0:101:0: [sdcv] Write Protect is off [ 46.442252] sd 0:0:101:0: [sdcv] Mode Sense: db 00 10 08 [ 46.442416] sd 0:0:110:0: [sdde] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.442417] sd 0:0:110:0: [sdde] 4096-byte physical blocks [ 46.442504] sd 0:0:111:0: [sddf] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.442505] sd 0:0:111:0: [sddf] 4096-byte physical blocks [ 46.442652] sd 0:0:108:0: [sddc] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.442653] sd 0:0:108:0: [sddc] 4096-byte physical blocks [ 46.443709] sd 0:0:74:0: [sdbg] Attached SCSI disk [ 46.443727] sd 0:0:101:0: [sdcv] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.443775] sd 0:0:7:0: [sdg] Attached SCSI disk [ 46.444170] sd 0:0:97:0: [sdcr] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.444173] sd 0:0:97:0: [sdcr] 4096-byte physical blocks [ 46.444201] sd 0:0:58:0: [sdbi] Attached SCSI disk [ 46.444409] sd 0:0:87:0: [sdch] Attached SCSI disk [ 46.444476] sd 0:0:57:0: [sdbh] Attached SCSI disk [ 46.444570] sd 0:0:91:0: [sdcl] Attached SCSI disk [ 46.444803] sd 0:0:111:0: [sddf] Write Protect is off [ 46.444804] sd 0:0:111:0: [sddf] Mode Sense: db 00 10 08 [ 46.444848] sd 0:0:86:0: [sdcg] Attached SCSI disk [ 46.445400] sd 0:0:28:0: [sdab] Attached SCSI disk [ 46.445769] sd 0:0:108:0: [sddc] Write Protect is off [ 46.445779] sd 0:0:108:0: [sddc] Mode Sense: db 00 10 08 [ 46.445800] sd 0:0:104:0: [sdcy] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.445801] sd 0:0:104:0: [sdcy] 4096-byte physical blocks [ 46.445822] sd 0:0:110:0: [sdde] Write Protect is off [ 46.445823] sd 0:0:110:0: [sdde] Mode Sense: db 00 10 08 [ 46.446077] sd 0:0:111:0: [sddf] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.446110] sd 0:0:73:0: [sdbc] Attached SCSI disk [ 46.446189] sd 0:0:47:0: [sdau] Attached SCSI disk [ 46.446313] sd 0:0:106:0: [sdda] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.446316] sd 0:0:106:0: [sdda] 4096-byte physical blocks [ 46.446513] sd 0:0:97:0: [sdcr] Write Protect is off [ 46.446515] sd 0:0:97:0: [sdcr] Mode Sense: db 00 10 08 [ 46.447092] sd 0:0:108:0: [sddc] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.447129] sd 0:0:110:0: [sdde] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.447422] sd 0:0:92:0: [sdcm] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.447424] sd 0:0:92:0: [sdcm] 4096-byte physical blocks [ 46.447807] sd 0:0:97:0: [sdcr] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.448026] sd 0:0:104:0: [sdcy] Write Protect is off [ 46.448027] sd 0:0:104:0: [sdcy] Mode Sense: db 00 10 08 [ 46.448506] sd 0:0:103:0: [sdcx] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.448509] sd 0:0:103:0: [sdcx] 4096-byte physical blocks [ 46.448664] sd 0:0:106:0: [sdda] Write Protect is off [ 46.448666] sd 0:0:106:0: [sdda] Mode Sense: db 00 10 08 [ 46.448721] sd 0:0:14:0: [sdn] Attached SCSI disk [ 46.448931] sd 0:0:24:0: [sdx] Attached SCSI disk [ 46.449367] sd 0:0:104:0: [sdcy] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.449562] sdbu: [ 46.449678] sd 0:0:115:0: [sddj] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.449680] sd 0:0:115:0: [sddj] 4096-byte physical blocks [ 46.449777] sd 0:0:71:0: [sdbx] Attached SCSI disk [ 46.449829] sd 0:0:92:0: [sdcm] Write Protect is off [ 46.449831] sd 0:0:92:0: [sdcm] Mode Sense: db 00 10 08 [ 46.449958] sd 0:0:106:0: [sdda] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.450038] sd 0:0:46:0: [sdat] Attached SCSI disk [ 46.450241] sd 0:0:100:0: [sdcu] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.450244] sd 0:0:100:0: [sdcu] 4096-byte physical blocks [ 46.450355] sd 0:0:112:0: [sddg] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.450357] sd 0:0:112:0: [sddg] 4096-byte physical blocks [ 46.450736] sd 0:0:107:0: [sddb] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.450739] sd 0:0:107:0: [sddb] 4096-byte physical blocks [ 46.451172] sd 0:0:103:0: [sdcx] Write Protect is off [ 46.451174] sd 0:0:103:0: [sdcx] Mode Sense: db 00 10 08 [ 46.451494] sd 0:0:102:0: [sdcw] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.451496] sd 0:0:102:0: [sdcw] 4096-byte physical blocks [ 46.451704] sd 0:0:92:0: [sdcm] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.451723] sd 0:0:42:0: [sdap] Attached SCSI disk [ 46.451788] sd 0:0:65:0: [sdbq] Attached SCSI disk [ 46.451818] sd 0:0:66:0: [sdbr] Attached SCSI disk [ 46.451939] sd 0:0:115:0: [sddj] Write Protect is off [ 46.451942] sd 0:0:115:0: [sddj] Mode Sense: db 00 10 08 [ 46.452100] sd 0:0:62:0: [sdbm] Attached SCSI disk [ 46.452175] sd 0:0:41:0: [sdao] Attached SCSI disk [ 46.452527] sd 0:0:103:0: [sdcx] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.452578] sd 0:0:100:0: [sdcu] Write Protect is off [ 46.452580] sd 0:0:100:0: [sdcu] Mode Sense: db 00 10 08 [ 46.452850] sd 0:0:72:0: [sdax] Attached SCSI disk [ 46.452884] sd 0:0:44:0: [sdar] Attached SCSI disk [ 46.452898] sd 0:0:5:0: [sde] Attached SCSI disk [ 46.452929] sd 0:0:2:0: [sdb] Attached SCSI disk [ 46.453109] sd 0:0:107:0: [sddb] Write Protect is off [ 46.453111] sd 0:0:107:0: [sddb] Mode Sense: db 00 10 08 [ 46.453195] sd 0:0:50:0: [sday] Attached SCSI disk [ 46.453291] sd 0:0:115:0: [sddj] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.453314] sd 0:0:105:0: [sdcz] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.453316] sd 0:0:105:0: [sdcz] 4096-byte physical blocks [ 46.453383] sd 0:0:55:0: [sdbe] Attached SCSI disk [ 46.453703] sd 0:0:124:0: [sddr] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.453705] sd 0:0:124:0: [sddr] 4096-byte physical blocks [ 46.453734] sd 0:0:63:0: [sdbn] Attached SCSI disk [ 46.453765] sd 0:0:112:0: [sddg] Write Protect is off [ 46.453766] sd 0:0:112:0: [sddg] Mode Sense: db 00 10 08 [ 46.453899] sd 0:0:100:0: [sdcu] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.453995] sd 0:0:114:0: [sddi] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.453997] sd 0:0:114:0: [sddi] 4096-byte physical blocks [ 46.454028] sd 0:0:109:0: [sddd] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.454029] sd 0:0:109:0: [sddd] 4096-byte physical blocks [ 46.454124] sd 0:0:102:0: [sdcw] Write Protect is off [ 46.454126] sd 0:0:102:0: [sdcw] Mode Sense: db 00 10 08 [ 46.454411] sd 0:0:107:0: [sddb] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.455064] sd 0:0:112:0: [sddg] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.455112] sd 0:0:125:0: [sdds] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.455113] sd 0:0:125:0: [sdds] 4096-byte physical blocks [ 46.455116] sd 0:0:56:0: [sdbf] Attached SCSI disk [ 46.455191] sd 0:0:81:0: [sdcb] Attached SCSI disk [ 46.455229] sd 0:0:38:0: [sdal] Attached SCSI disk [ 46.455433] sd 0:0:102:0: [sdcw] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.455588] sd 0:0:105:0: [sdcz] Write Protect is off [ 46.455589] sd 0:0:105:0: [sdcz] Mode Sense: db 00 10 08 [ 46.455596] sd 0:0:68:0: [sdbu] Attached SCSI disk [ 46.455729] sd 0:0:39:0: [sdam] Attached SCSI disk [ 46.455768] sd 0:0:10:0: [sdj] Attached SCSI disk [ 46.455847] sd 0:0:27:0: [sdaa] Attached SCSI disk [ 46.455864] sd 0:0:113:0: [sddh] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.455866] sd 0:0:113:0: [sddh] 4096-byte physical blocks [ 46.456006] sd 0:0:124:0: [sddr] Write Protect is off [ 46.456008] sd 0:0:124:0: [sddr] Mode Sense: db 00 10 08 [ 46.456175] sd 0:0:80:0: [sdca] Attached SCSI disk [ 46.456264] sd 0:0:114:0: [sddi] Write Protect is off [ 46.456266] sd 0:0:114:0: [sddi] Mode Sense: db 00 10 08 [ 46.456324] sd 0:0:109:0: [sddd] Write Protect is off [ 46.456325] sd 0:0:109:0: [sddd] Mode Sense: db 00 10 08 [ 46.456497] sd 0:0:17:0: [sdq] Attached SCSI disk [ 46.456553] sd 0:0:53:0: [sdbb] Attached SCSI disk [ 46.456881] sd 0:0:105:0: [sdcz] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.457319] sd 0:0:124:0: [sddr] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.457347] sd 0:0:31:0: [sdae] Attached SCSI disk [ 46.457521] sd 0:0:67:0: [sdbt] Attached SCSI disk [ 46.457561] sd 0:0:77:0: [sdbs] Attached SCSI disk [ 46.457597] sd 0:0:114:0: [sddi] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.457694] sd 0:0:109:0: [sddd] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.457734] sd 0:0:120:0: [sddo] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.457736] sd 0:0:120:0: [sddo] 4096-byte physical blocks [ 46.457752] sd 0:0:125:0: [sdds] Write Protect is off [ 46.457753] sd 0:0:125:0: [sdds] Mode Sense: db 00 10 08 [ 46.457789] sd 0:0:126:0: [sddt] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.457790] sd 0:0:126:0: [sddt] 4096-byte physical blocks [ 46.457902] sd 0:0:93:0: [sdcn] Attached SCSI disk [ 46.457934] sd 0:0:37:0: [sdak] Attached SCSI disk [ 46.458053] sd 0:0:6:0: [sdf] Attached SCSI disk [ 46.458108] sd 0:0:29:0: [sdac] Attached SCSI disk [ 46.458163] sd 0:0:123:0: [sddq] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.458165] sd 0:0:123:0: [sddq] 4096-byte physical blocks [ 46.458222] sd 0:0:33:0: [sdag] Attached SCSI disk [ 46.458306] sd 0:0:117:0: [sddl] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.458308] sd 0:0:117:0: [sddl] 4096-byte physical blocks [ 46.458321] sd 0:0:64:0: [sdbp] Attached SCSI disk [ 46.458326] sd 0:0:8:0: [sdh] Attached SCSI disk [ 46.458369] sd 0:0:60:0: [sdbl] Attached SCSI disk [ 46.458474] sd 0:0:127:0: [sddu] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.458476] sd 0:0:127:0: [sddu] 4096-byte physical blocks [ 46.458906] sd 0:0:35:0: [sdai] Attached SCSI disk [ 46.459044] sd 0:0:125:0: [sdds] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.459072] sd 0:0:90:0: [sdck] Attached SCSI disk [ 46.459337] sd 0:0:94:0: [sdco] Attached SCSI disk [ 46.459389] sd 0:0:59:0: [sdbj] Attached SCSI disk [ 46.459505] sd 0:0:82:0: [sdcc] Attached SCSI disk [ 46.459526] sd 0:0:113:0: [sddh] Write Protect is off [ 46.459528] sd 0:0:113:0: [sddh] Mode Sense: db 00 10 08 [ 46.459768] sd 0:0:36:0: [sdaj] Attached SCSI disk [ 46.459841] sd 0:0:76:0: [sdbo] Attached SCSI disk [ 46.459954] sd 0:0:121:0: [sddp] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.459956] sd 0:0:121:0: [sddp] 4096-byte physical blocks [ 46.459978] sd 0:0:128:0: [sddv] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.459979] sd 0:0:128:0: [sddv] 4096-byte physical blocks [ 46.460103] sd 0:0:25:0: [sdy] Attached SCSI disk [ 46.460210] sd 0:0:98:0: [sdcs] Attached SCSI disk [ 46.460261] sd 0:0:78:0: [sdby] Attached SCSI disk [ 46.460439] sd 0:0:48:0: [sdav] Attached SCSI disk [ 46.460582] sd 0:0:4:0: [sdd] Attached SCSI disk [ 46.460614] sd 0:0:129:0: [sddw] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.460616] sd 0:0:129:0: [sddw] 4096-byte physical blocks [ 46.460841] sd 0:0:127:0: [sddu] Write Protect is off [ 46.460843] sd 0:0:127:0: [sddu] Mode Sense: db 00 10 08 [ 46.460846] sd 0:0:113:0: [sddh] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.460848] sd 0:0:117:0: [sddl] Write Protect is off [ 46.460850] sd 0:0:117:0: [sddl] Mode Sense: db 00 10 08 [ 46.460927] sd 0:0:32:0: [sdaf] Attached SCSI disk [ 46.460975] sd 0:0:120:0: [sddo] Write Protect is off [ 46.460977] sd 0:0:120:0: [sddo] Mode Sense: db 00 10 08 [ 46.461028] sd 0:0:88:0: [sdci] Attached SCSI disk [ 46.461089] sd 0:0:18:0: [sdr] Attached SCSI disk [ 46.461156] sd 0:0:12:0: [sdl] Attached SCSI disk [ 46.461296] sd 0:0:116:0: [sddk] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.461299] sd 0:0:116:0: [sddk] 4096-byte physical blocks [ 46.461466] sd 0:0:130:0: [sddx] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.461467] sd 0:0:130:0: [sddx] 4096-byte physical blocks [ 46.461616] sd 0:0:16:0: [sdp] Attached SCSI disk [ 46.461618] sd 0:0:126:0: [sddt] Write Protect is off [ 46.461620] sd 0:0:126:0: [sddt] Mode Sense: db 00 10 08 [ 46.461669] sd 0:0:96:0: [sdcq] Attached SCSI disk [ 46.461802] sd 0:0:123:0: [sddq] Write Protect is off [ 46.461804] sd 0:0:123:0: [sddq] Mode Sense: db 00 10 08 [ 46.461858] sd 0:0:85:0: [sdcf] Attached SCSI disk [ 46.461912] sd 0:0:69:0: [sdbv] Attached SCSI disk [ 46.461958] sd 0:0:9:0: [sdi] Attached SCSI disk [ 46.461961] sd 0:0:54:0: [sdbd] Attached SCSI disk [ 46.462026] sd 0:0:132:0: [sddz] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.462028] sd 0:0:132:0: [sddz] 4096-byte physical blocks [ 46.462034] sd 0:0:23:0: [sdw] Attached SCSI disk [ 46.462130] sd 0:0:127:0: [sddu] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.462157] sd 0:0:52:0: [sdba] Attached SCSI disk [ 46.462212] sd 0:0:117:0: [sddl] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.462244] sd 0:0:131:0: [sddy] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.462246] sd 0:0:131:0: [sddy] 4096-byte physical blocks [ 46.462290] sd 0:0:134:0: [sdeb] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.462292] sd 0:0:134:0: [sdeb] 4096-byte physical blocks [ 46.462304] sd 0:0:121:0: [sddp] Write Protect is off [ 46.462306] sd 0:0:121:0: [sddp] Mode Sense: db 00 10 08 [ 46.462326] sd 0:0:128:0: [sddv] Write Protect is off [ 46.462328] sd 0:0:128:0: [sddv] Mode Sense: db 00 10 08 [ 46.462331] sd 0:0:120:0: [sddo] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.462382] sd 0:0:51:0: [sdaz] Attached SCSI disk [ 46.462401] sd 0:0:26:0: [sdz] Attached SCSI disk [ 46.462783] sd 0:0:136:0: [sded] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.462798] sd 0:0:136:0: [sded] 4096-byte physical blocks [ 46.462906] sd 0:0:126:0: [sddt] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.462914] sd 0:0:129:0: [sddw] Write Protect is off [ 46.462916] sd 0:0:129:0: [sddw] Mode Sense: db 00 10 08 [ 46.462935] sd 0:0:40:0: [sdan] Attached SCSI disk [ 46.462982] sd 0:0:133:0: [sdea] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.462984] sd 0:0:133:0: [sdea] 4096-byte physical blocks [ 46.463055] sd 0:0:34:0: [sdah] Attached SCSI disk [ 46.463135] sd 0:0:79:0: [sdbz] Attached SCSI disk [ 46.463181] sd 0:0:45:0: [sdas] Attached SCSI disk [ 46.463199] sd 0:0:138:0: [sdef] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.463201] sd 0:0:138:0: [sdef] 4096-byte physical blocks [ 46.463296] sd 0:0:43:0: [sdaq] Attached SCSI disk [ 46.463380] sd 0:0:135:0: [sdec] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.463382] sd 0:0:135:0: [sdec] 4096-byte physical blocks [ 46.463477] sd 0:0:139:0: [sdeg] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.463479] sd 0:0:139:0: [sdeg] 4096-byte physical blocks [ 46.463484] sd 0:0:137:0: [sdee] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.463486] sd 0:0:137:0: [sdee] 4096-byte physical blocks [ 46.463600] sd 0:0:121:0: [sddp] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.463634] sd 0:0:116:0: [sddk] Write Protect is off [ 46.463636] sd 0:0:116:0: [sddk] Mode Sense: db 00 10 08 [ 46.463703] sd 0:0:128:0: [sddv] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.463730] sd 0:0:130:0: [sddx] Write Protect is off [ 46.463731] sd 0:0:130:0: [sddx] Mode Sense: db 00 10 08 [ 46.463739] sd 0:0:30:0: [sdad] Attached SCSI disk [ 46.463841] sd 0:0:15:0: [sdo] Attached SCSI disk [ 46.464148] sd 0:0:123:0: [sddq] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.464239] sd 0:0:19:0: [sds] Attached SCSI disk [ 46.464369] sd 0:0:132:0: [sddz] Write Protect is off [ 46.464371] sd 0:0:132:0: [sddz] Mode Sense: db 00 10 08 [ 46.464440] sd 0:0:13:0: [sdm] Attached SCSI disk [ 46.464446] sd 0:0:84:0: [sdce] Attached SCSI disk [ 46.464571] sd 0:0:129:0: [sddw] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.464592] sd 0:0:134:0: [sdeb] Write Protect is off [ 46.464594] sd 0:0:134:0: [sdeb] Mode Sense: db 00 10 08 [ 46.464609] sd 0:0:131:0: [sddy] Write Protect is off [ 46.464611] sd 0:0:131:0: [sddy] Mode Sense: db 00 10 08 [ 46.464812] sd 0:0:140:0: [sdeh] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.464813] sd 0:0:140:0: [sdeh] 4096-byte physical blocks [ 46.464897] sd 0:0:95:0: [sdcp] Attached SCSI disk [ 46.465101] sd 0:0:130:0: [sddx] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.465114] sd 0:0:116:0: [sddk] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.465314] sd 0:0:99:0: [sdct] Attached SCSI disk [ 46.465345] sd 0:0:70:0: [sdbw] Attached SCSI disk [ 46.465428] sd 0:0:136:0: [sded] Write Protect is off [ 46.465430] sd 0:0:136:0: [sded] Mode Sense: db 00 10 08 [ 46.465634] sd 0:0:132:0: [sddz] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.465693] sd 0:0:49:0: [sdaw] Attached SCSI disk [ 46.465695] sd 0:0:83:0: [sdcd] Attached SCSI disk [ 46.465769] sd 0:0:11:0: [sdk] Attached SCSI disk [ 46.465816] sd 0:0:118:0: [sddm] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.465818] sd 0:0:118:0: [sddm] 4096-byte physical blocks [ 46.465862] sd 0:0:134:0: [sdeb] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.465897] sd 0:0:131:0: [sddy] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.465968] sd 0:0:138:0: [sdef] Write Protect is off [ 46.465970] sd 0:0:138:0: [sdef] Mode Sense: db 00 10 08 [ 46.466171] sd 0:0:135:0: [sdec] Write Protect is off [ 46.466173] sd 0:0:135:0: [sdec] Mode Sense: db 00 10 08 [ 46.466262] sd 0:0:119:0: [sddn] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.466264] sd 0:0:119:0: [sddn] 4096-byte physical blocks [ 46.466280] sd 0:0:139:0: [sdeg] Write Protect is off [ 46.466281] sd 0:0:139:0: [sdeg] Mode Sense: db 00 10 08 [ 46.466305] sd 0:0:141:0: [sdei] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.466306] sd 0:0:141:0: [sdei] 4096-byte physical blocks [ 46.466339] sd 0:0:89:0: [sdcj] Attached SCSI disk [ 46.466463] sd 0:0:137:0: [sdee] Write Protect is off [ 46.466464] sd 0:0:137:0: [sdee] Mode Sense: db 00 10 08 [ 46.466728] sd 0:0:20:0: [sdt] Attached SCSI disk [ 46.466886] sd 0:0:133:0: [sdea] Write Protect is off [ 46.466888] sd 0:0:133:0: [sdea] Mode Sense: db 00 10 08 [ 46.466938] sd 0:0:136:0: [sded] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.467246] sd 0:0:138:0: [sdef] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.467402] sd 0:0:140:0: [sdeh] Write Protect is off [ 46.467404] sd 0:0:140:0: [sdeh] Mode Sense: db 00 10 08 [ 46.467501] sd 0:0:135:0: [sdec] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.467555] sd 0:0:139:0: [sdeg] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.467558] sd 0:0:1:0: [sda] Attached SCSI disk [ 46.467739] sd 0:0:137:0: [sdee] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.468342] sd 0:0:142:0: [sdej] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.468344] sd 0:0:142:0: [sdej] 4096-byte physical blocks [ 46.468395] sd 0:0:133:0: [sdea] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.468433] sd 0:0:118:0: [sddm] Write Protect is off [ 46.468435] sd 0:0:118:0: [sddm] Mode Sense: db 00 10 08 [ 46.468547] sd 0:0:110:0: [sdde] Attached SCSI disk [ 46.468680] sd 0:0:140:0: [sdeh] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.468827] sd 0:0:119:0: [sddn] Write Protect is off [ 46.468828] sd 0:0:119:0: [sddn] Mode Sense: db 00 10 08 [ 46.469078] sd 0:0:141:0: [sdei] Write Protect is off [ 46.469079] sd 0:0:141:0: [sdei] Mode Sense: db 00 10 08 [ 46.469727] sd 0:0:118:0: [sddm] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.470155] sd 0:0:119:0: [sddn] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.470359] sd 0:0:141:0: [sdei] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.470589] sd 0:0:142:0: [sdej] Write Protect is off [ 46.470591] sd 0:0:142:0: [sdej] Mode Sense: db 00 10 08 [ 46.472119] sd 0:0:142:0: [sdej] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.474285] sd 0:0:125:0: [sdds] Attached SCSI disk [ 46.474870] sd 0:0:143:0: [sdek] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.474872] sd 0:0:143:0: [sdek] 4096-byte physical blocks [ 46.475152] sd 0:0:104:0: [sdcy] Attached SCSI disk [ 46.475578] sd 0:0:144:0: [sdel] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.475581] sd 0:0:144:0: [sdel] 4096-byte physical blocks [ 46.475952] sd 0:0:111:0: [sddf] Attached SCSI disk [ 46.477061] sd 0:0:143:0: [sdek] Write Protect is off [ 46.477063] sd 0:0:143:0: [sdek] Mode Sense: db 00 10 08 [ 46.477725] sd 0:0:124:0: [sddr] Attached SCSI disk [ 46.477907] sd 0:0:144:0: [sdel] Write Protect is off [ 46.477909] sd 0:0:144:0: [sdel] Mode Sense: db 00 10 08 [ 46.478392] sd 0:0:145:0: [sdem] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.478395] sd 0:0:143:0: [sdek] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.478396] sd 0:0:145:0: [sdem] 4096-byte physical blocks [ 46.478753] sd 0:0:92:0: [sdcm] Attached SCSI disk [ 46.479120] sd 0:0:127:0: [sddu] Attached SCSI disk [ 46.479127] sd 0:0:109:0: [sddd] Attached SCSI disk [ 46.479145] sd 0:0:108:0: [sddc] Attached SCSI disk [ 46.480321] sd 0:0:106:0: [sdda] Attached SCSI disk [ 46.480642] sd 0:0:145:0: [sdem] Write Protect is off [ 46.480644] sd 0:0:145:0: [sdem] Mode Sense: db 00 10 08 [ 46.480787] sd 0:0:123:0: [sddq] Attached SCSI disk [ 46.480799] sd 0:0:144:0: [sdel] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.481053] sd 0:0:114:0: [sddi] Attached SCSI disk [ 46.481315] sd 0:0:146:0: [sden] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.481317] sd 0:0:146:0: [sden] 4096-byte physical blocks [ 46.481409] sd 0:0:128:0: [sddv] Attached SCSI disk [ 46.481788] sd 0:0:97:0: [sdcr] Attached SCSI disk [ 46.481978] sd 0:0:145:0: [sdem] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.482247] sd 0:0:103:0: [sdcx] Attached SCSI disk [ 46.482277] sd 0:0:101:0: [sdcv] Attached SCSI disk [ 46.482369] sd 0:0:100:0: [sdcu] Attached SCSI disk [ 46.483286] sd 0:0:147:0: [sdeo] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.483288] sd 0:0:147:0: [sdeo] 4096-byte physical blocks [ 46.483557] sd 0:0:146:0: [sden] Write Protect is off [ 46.483560] sd 0:0:146:0: [sden] Mode Sense: db 00 10 08 [ 46.484248] sd 0:0:148:0: [sdep] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.484250] sd 0:0:148:0: [sdep] 4096-byte physical blocks [ 46.484827] sd 0:0:149:0: [sdeq] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.484829] sd 0:0:149:0: [sdeq] 4096-byte physical blocks [ 46.484886] sd 0:0:146:0: [sden] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.485093] sd 0:0:150:0: [sder] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.485095] sd 0:0:150:0: [sder] 4096-byte physical blocks [ 46.485292] sd 0:0:151:0: [sdes] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.485294] sd 0:0:151:0: [sdes] 4096-byte physical blocks [ 46.485344] sd 0:0:129:0: [sddw] Attached SCSI disk [ 46.485551] sd 0:0:152:0: [sdet] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.485553] sd 0:0:152:0: [sdet] 4096-byte physical blocks [ 46.485595] sd 0:0:147:0: [sdeo] Write Protect is off [ 46.485597] sd 0:0:147:0: [sdeo] Mode Sense: db 00 10 08 [ 46.485608] sd 0:0:102:0: [sdcw] Attached SCSI disk [ 46.485711] sd 0:0:126:0: [sddt] Attached SCSI disk [ 46.485778] sd 0:0:153:0: [sdeu] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.485779] sd 0:0:153:0: [sdeu] 4096-byte physical blocks [ 46.485968] sd 0:0:140:0: [sdeh] Attached SCSI disk [ 46.485978] sd 0:0:154:0: [sdev] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.485980] sd 0:0:154:0: [sdev] 4096-byte physical blocks [ 46.486106] sd 0:0:134:0: [sdeb] Attached SCSI disk [ 46.486163] sd 0:0:155:0: [sdew] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.486164] sd 0:0:155:0: [sdew] 4096-byte physical blocks [ 46.486247] sd 0:0:131:0: [sddy] Attached SCSI disk [ 46.486443] sd 0:0:138:0: [sdef] Attached SCSI disk [ 46.486505] sd 0:0:156:0: [sdex] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.486507] sd 0:0:156:0: [sdex] 4096-byte physical blocks [ 46.486583] sd 0:0:148:0: [sdep] Write Protect is off [ 46.486584] sd 0:0:148:0: [sdep] Mode Sense: db 00 10 08 [ 46.486889] sd 0:0:147:0: [sdeo] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.486903] sd 0:0:157:0: [sdey] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.486905] sd 0:0:157:0: [sdey] 4096-byte physical blocks [ 46.487055] sd 0:0:130:0: [sddx] Attached SCSI disk [ 46.487148] sd 0:0:158:0: [sdez] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.487150] sd 0:0:158:0: [sdez] 4096-byte physical blocks [ 46.487183] sd 0:0:149:0: [sdeq] Write Protect is off [ 46.487185] sd 0:0:149:0: [sdeq] Mode Sense: db 00 10 08 [ 46.487260] sd 0:0:115:0: [sddj] Attached SCSI disk [ 46.487364] sd 0:0:150:0: [sder] Write Protect is off [ 46.487366] sd 0:0:150:0: [sder] Mode Sense: db 00 10 08 [ 46.487478] sd 0:0:159:0: [sdfa] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.487480] sd 0:0:159:0: [sdfa] 4096-byte physical blocks [ 46.487496] sd 0:0:107:0: [sddb] Attached SCSI disk [ 46.487667] sd 0:0:151:0: [sdes] Write Protect is off [ 46.487669] sd 0:0:151:0: [sdes] Mode Sense: db 00 10 08 [ 46.487835] sd 0:0:160:0: [sdfb] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.487837] sd 0:0:160:0: [sdfb] 4096-byte physical blocks [ 46.487861] sd 0:0:148:0: [sdep] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.488000] sd 0:0:161:0: [sdfc] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.488002] sd 0:0:161:0: [sdfc] 4096-byte physical blocks [ 46.488084] sd 0:0:153:0: [sdeu] Write Protect is off [ 46.488086] sd 0:0:153:0: [sdeu] Mode Sense: db 00 10 08 [ 46.488184] sd 0:0:137:0: [sdee] Attached SCSI disk [ 46.488189] sd 0:0:105:0: [sdcz] Attached SCSI disk [ 46.488272] sd 0:0:113:0: [sddh] Attached SCSI disk [ 46.488300] sd 0:0:152:0: [sdet] Write Protect is off [ 46.488301] sd 0:0:152:0: [sdet] Mode Sense: db 00 10 08 [ 46.488343] sd 0:0:132:0: [sddz] Attached SCSI disk [ 46.488371] sd 0:0:135:0: [sdec] Attached SCSI disk [ 46.488479] sd 0:0:149:0: [sdeq] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.488500] sd 0:0:139:0: [sdeg] Attached SCSI disk [ 46.488508] sd 0:0:155:0: [sdew] Write Protect is off [ 46.488510] sd 0:0:155:0: [sdew] Mode Sense: db 00 10 08 [ 46.488587] sd 0:0:154:0: [sdev] Write Protect is off [ 46.488589] sd 0:0:154:0: [sdev] Mode Sense: db 00 10 08 [ 46.488647] sd 0:0:150:0: [sder] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.488782] sd 0:0:156:0: [sdex] Write Protect is off [ 46.488784] sd 0:0:156:0: [sdex] Mode Sense: db 00 10 08 [ 46.489128] sd 0:0:141:0: [sdei] Attached SCSI disk [ 46.489178] sd 0:0:157:0: [sdey] Write Protect is off [ 46.489180] sd 0:0:157:0: [sdey] Mode Sense: db 00 10 08 [ 46.489529] sd 0:0:151:0: [sdes] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.489568] sd 0:0:158:0: [sdez] Write Protect is off [ 46.489570] sd 0:0:158:0: [sdez] Mode Sense: db 00 10 08 [ 46.489579] sd 0:0:153:0: [sdeu] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.489592] sd 0:0:152:0: [sdet] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.489608] sd 0:0:121:0: [sddp] Attached SCSI disk [ 46.489796] sd 0:0:159:0: [sdfa] Write Protect is off [ 46.489798] sd 0:0:159:0: [sdfa] Mode Sense: db 00 10 08 [ 46.489838] sd 0:0:155:0: [sdew] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.490064] sd 0:0:162:0: [sdfd] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.490066] sd 0:0:162:0: [sdfd] 4096-byte physical blocks [ 46.490074] sd 0:0:112:0: [sddg] Attached SCSI disk [ 46.490104] sd 0:0:163:0: [sdfe] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.490106] sd 0:0:163:0: [sdfe] 4096-byte physical blocks [ 46.490113] sd 0:0:154:0: [sdev] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.490146] sd 0:0:133:0: [sdea] Attached SCSI disk [ 46.490190] sd 0:0:156:0: [sdex] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.490287] sd 0:0:161:0: [sdfc] Write Protect is off [ 46.490288] sd 0:0:161:0: [sdfc] Mode Sense: db 00 10 08 [ 46.490507] sd 0:0:157:0: [sdey] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.490759] sd 0:0:136:0: [sded] Attached SCSI disk [ 46.490838] sd 0:0:158:0: [sdez] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.490940] sd 0:0:117:0: [sddl] Attached SCSI disk [ 46.491086] sd 0:0:159:0: [sdfa] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.491513] sd 0:0:160:0: [sdfb] Write Protect is off [ 46.491515] sd 0:0:160:0: [sdfb] Mode Sense: db 00 10 08 [ 46.491636] sd 0:0:161:0: [sdfc] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.491692] sd 0:0:120:0: [sddo] Attached SCSI disk [ 46.492471] sd 0:0:163:0: [sdfe] Write Protect is off [ 46.492473] sd 0:0:163:0: [sdfe] Mode Sense: db 00 10 08 [ 46.492997] sd 0:0:160:0: [sdfb] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.493604] sd 0:0:162:0: [sdfd] Write Protect is off [ 46.493606] sd 0:0:162:0: [sdfd] Mode Sense: db 00 10 08 [ 46.493712] sd 0:0:142:0: [sdej] Attached SCSI disk [ 46.493752] sd 0:0:163:0: [sdfe] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.494109] sd 0:0:118:0: [sddm] Attached SCSI disk [ 46.494878] sd 0:0:162:0: [sdfd] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.496015] sd 0:0:116:0: [sddk] Attached SCSI disk [ 46.496762] sd 0:0:164:0: [sdff] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.496764] sd 0:0:164:0: [sdff] 4096-byte physical blocks [ 46.496772] sd 0:0:144:0: [sdel] Attached SCSI disk [ 46.497642] sd 0:0:165:0: [sdfg] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.497644] sd 0:0:165:0: [sdfg] 4096-byte physical blocks [ 46.498050] sd 0:0:166:0: [sdfh] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.498053] sd 0:0:166:0: [sdfh] 4096-byte physical blocks [ 46.498445] sd 0:0:167:0: [sdfi] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.498448] sd 0:0:167:0: [sdfi] 4096-byte physical blocks [ 46.498654] sd 0:0:168:0: [sdfj] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.498657] sd 0:0:168:0: [sdfj] 4096-byte physical blocks [ 46.498768] sd 0:0:169:0: [sdfk] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.498770] sd 0:0:169:0: [sdfk] 4096-byte physical blocks [ 46.498803] sd 0:0:119:0: [sddn] Attached SCSI disk [ 46.498896] sd 0:0:170:0: [sdfl] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.498898] sd 0:0:170:0: [sdfl] 4096-byte physical blocks [ 46.499008] sd 0:0:171:0: [sdfm] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.499010] sd 0:0:171:0: [sdfm] 4096-byte physical blocks [ 46.499088] sd 0:0:164:0: [sdff] Write Protect is off [ 46.499090] sd 0:0:164:0: [sdff] Mode Sense: db 00 10 08 [ 46.499151] sd 0:0:172:0: [sdfn] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.499153] sd 0:0:172:0: [sdfn] 4096-byte physical blocks [ 46.499309] sd 0:0:173:0: [sdfo] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.499311] sd 0:0:173:0: [sdfo] 4096-byte physical blocks [ 46.499413] sd 0:0:174:0: [sdfp] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.499415] sd 0:0:174:0: [sdfp] 4096-byte physical blocks [ 46.499582] sd 0:0:175:0: [sdfq] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.499584] sd 0:0:175:0: [sdfq] 4096-byte physical blocks [ 46.499711] sd 0:0:176:0: [sdfr] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.499714] sd 0:0:176:0: [sdfr] 4096-byte physical blocks [ 46.499927] sd 0:0:177:0: [sdfs] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.499928] sd 0:0:177:0: [sdfs] 4096-byte physical blocks [ 46.499964] sd 0:0:165:0: [sdfg] Write Protect is off [ 46.499966] sd 0:0:165:0: [sdfg] Mode Sense: db 00 10 08 [ 46.500282] sd 0:0:166:0: [sdfh] Write Protect is off [ 46.500285] sd 0:0:166:0: [sdfh] Mode Sense: db 00 10 08 [ 46.500378] sd 0:0:164:0: [sdff] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.500749] sd 0:0:167:0: [sdfi] Write Protect is off [ 46.500751] sd 0:0:167:0: [sdfi] Mode Sense: db 00 10 08 [ 46.500942] sd 0:0:168:0: [sdfj] Write Protect is off [ 46.500944] sd 0:0:168:0: [sdfj] Mode Sense: db 00 10 08 [ 46.500995] sd 0:0:147:0: [sdeo] Attached SCSI disk [ 46.501031] sd 0:0:169:0: [sdfk] Write Protect is off [ 46.501033] sd 0:0:169:0: [sdfk] Mode Sense: db 00 10 08 [ 46.501200] sd 0:0:170:0: [sdfl] Write Protect is off [ 46.501203] sd 0:0:170:0: [sdfl] Mode Sense: db 00 10 08 [ 46.501226] sd 0:0:171:0: [sdfm] Write Protect is off [ 46.501228] sd 0:0:171:0: [sdfm] Mode Sense: db 00 10 08 [ 46.501241] sd 0:0:165:0: [sdfg] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.501442] sd 0:0:178:0: [sdft] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.501443] sd 0:0:178:0: [sdft] 4096-byte physical blocks [ 46.501460] sd 0:0:172:0: [sdfn] Write Protect is off [ 46.501461] sd 0:0:172:0: [sdfn] Mode Sense: db 00 10 08 [ 46.501619] sd 0:0:166:0: [sdfh] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.501649] sd 0:0:173:0: [sdfo] Write Protect is off [ 46.501651] sd 0:0:173:0: [sdfo] Mode Sense: db 00 10 08 [ 46.501695] sd 0:0:174:0: [sdfp] Write Protect is off [ 46.501697] sd 0:0:174:0: [sdfp] Mode Sense: db 00 10 08 [ 46.501734] sd 0:0:143:0: [sdek] Attached SCSI disk [ 46.501900] sd 0:0:175:0: [sdfq] Write Protect is off [ 46.501901] sd 0:0:175:0: [sdfq] Mode Sense: db 00 10 08 [ 46.501946] sd 0:0:176:0: [sdfr] Write Protect is off [ 46.501948] sd 0:0:176:0: [sdfr] Mode Sense: db 00 10 08 [ 46.502129] sd 0:0:177:0: [sdfs] Write Protect is off [ 46.502131] sd 0:0:177:0: [sdfs] Mode Sense: db 00 10 08 [ 46.502172] sd 0:0:167:0: [sdfi] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.502255] sd 0:0:168:0: [sdfj] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.502358] sd 0:0:169:0: [sdfk] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.502478] sd 0:0:170:0: [sdfl] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.502610] sd 0:0:171:0: [sdfm] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.502921] sd 0:0:173:0: [sdfo] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.502992] sd 0:0:174:0: [sdfp] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.503232] sd 0:0:175:0: [sdfq] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.503448] sd 0:0:172:0: [sdfn] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.503510] sd 0:0:177:0: [sdfs] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.503521] sd 0:0:179:0: [sdfu] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.503522] sd 0:0:179:0: [sdfu] 4096-byte physical blocks [ 46.503555] sd 0:0:145:0: [sdem] Attached SCSI disk [ 46.503794] sd 0:0:176:0: [sdfr] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.504397] sd 0:0:178:0: [sdft] Write Protect is off [ 46.504398] sd 0:0:178:0: [sdft] Mode Sense: db 00 10 08 [ 46.505669] sd 0:0:178:0: [sdft] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.505807] sd 0:0:180:0: [sdfv] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.505808] sd 0:0:180:0: [sdfv] 4096-byte physical blocks [ 46.506074] sd 0:0:179:0: [sdfu] Write Protect is off [ 46.506075] sd 0:0:179:0: [sdfu] Mode Sense: db 00 10 08 [ 46.506379] sd 0:0:152:0: [sdet] Attached SCSI disk [ 46.506901] sd 0:0:146:0: [sden] Attached SCSI disk [ 46.507075] sd 0:0:151:0: [sdes] Attached SCSI disk [ 46.507353] sd 0:0:179:0: [sdfu] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.507516] sd 0:0:153:0: [sdeu] Attached SCSI disk [ 46.508562] sd 0:0:155:0: [sdew] Attached SCSI disk [ 46.508732] sd 0:0:181:0: [sdfw] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.508734] sd 0:0:181:0: [sdfw] 4096-byte physical blocks [ 46.508799] sd 0:0:180:0: [sdfv] Write Protect is off [ 46.508801] sd 0:0:180:0: [sdfv] Mode Sense: db 00 10 08 [ 46.509352] sd 0:0:158:0: [sdez] Attached SCSI disk [ 46.509647] sd 0:0:163:0: [sdfe] Attached SCSI disk [ 46.509736] sd 0:0:157:0: [sdey] Attached SCSI disk [ 46.510082] sd 0:0:180:0: [sdfv] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.510546] sd 0:0:154:0: [sdev] Attached SCSI disk [ 46.511303] sd 0:0:148:0: [sdep] Attached SCSI disk [ 46.511817] sd 0:0:181:0: [sdfw] Write Protect is off [ 46.511820] sd 0:0:181:0: [sdfw] Mode Sense: db 00 10 08 [ 46.513028] sd 0:0:156:0: [sdex] Attached SCSI disk [ 46.513102] sd 0:0:181:0: [sdfw] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.513390] sd 0:0:149:0: [sdeq] Attached SCSI disk [ 46.513920] sd 0:0:160:0: [sdfb] Attached SCSI disk [ 46.513957] sd 0:0:161:0: [sdfc] Attached SCSI disk [ 46.514341] sd 0:0:150:0: [sder] Attached SCSI disk [ 46.514833] sd 0:0:162:0: [sdfd] Attached SCSI disk [ 46.515686] sd 0:0:159:0: [sdfa] Attached SCSI disk [ 46.517804] sd 0:0:164:0: [sdff] Attached SCSI disk [ 46.518201] sd 0:0:170:0: [sdfl] Attached SCSI disk [ 46.518990] sd 0:0:182:0: [sdfx] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.518992] sd 0:0:182:0: [sdfx] 4096-byte physical blocks [ 46.520277] sd 0:0:166:0: [sdfh] Attached SCSI disk [ 46.521116] sd 0:0:172:0: [sdfn] Attached SCSI disk [ 46.521217] sd 0:0:169:0: [sdfk] Attached SCSI disk [ 46.521243] sd 0:0:182:0: [sdfx] Write Protect is off [ 46.521244] sd 0:0:182:0: [sdfx] Mode Sense: db 00 10 08 [ 46.522504] sd 0:0:182:0: [sdfx] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.522932] sd 0:0:167:0: [sdfi] Attached SCSI disk [ 46.523975] sd 0:0:171:0: [sdfm] Attached SCSI disk [ 46.524840] sd 0:0:184:0: [sdfy] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.524842] sd 0:0:184:0: [sdfy] 4096-byte physical blocks [ 46.525374] sd 0:0:178:0: [sdft] Attached SCSI disk [ 46.525415] sd 0:0:165:0: [sdfg] Attached SCSI disk [ 46.527027] sd 0:0:184:0: [sdfy] Write Protect is off [ 46.527029] sd 0:0:184:0: [sdfy] Mode Sense: db 00 10 08 [ 46.527533] sd 0:0:174:0: [sdfp] Attached SCSI disk [ 46.528308] sd 0:0:184:0: [sdfy] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.529370] sd 0:0:168:0: [sdfj] Attached SCSI disk [ 46.529446] sd 0:0:176:0: [sdfr] Attached SCSI disk [ 46.529868] sd 0:0:173:0: [sdfo] Attached SCSI disk [ 46.530082] sd 0:0:175:0: [sdfq] Attached SCSI disk [ 46.530196] sd 0:0:179:0: [sdfu] Attached SCSI disk [ 46.531307] sd 0:0:185:0: [sdfz] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.531309] sd 0:0:185:0: [sdfz] 4096-byte physical blocks [ 46.531885] sd 0:0:177:0: [sdfs] Attached SCSI disk [ 46.533627] sd 0:0:185:0: [sdfz] Write Protect is off [ 46.533629] sd 0:0:185:0: [sdfz] Mode Sense: db 00 10 08 [ 46.533934] sd 0:0:181:0: [sdfw] Attached SCSI disk [ 46.534963] sd 0:0:185:0: [sdfz] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.535002] sd 0:0:180:0: [sdfv] Attached SCSI disk [ 46.538125] sd 0:0:186:0: [sdga] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.538127] sd 0:0:186:0: [sdga] 4096-byte physical blocks [ 46.540211] sd 0:0:182:0: [sdfx] Attached SCSI disk [ 46.541006] sd 0:0:186:0: [sdga] Write Protect is off [ 46.541008] sd 0:0:186:0: [sdga] Mode Sense: db 00 10 08 [ 46.541265] sd 0:0:187:0: [sdgb] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.541270] sd 0:0:187:0: [sdgb] 4096-byte physical blocks [ 46.542298] sd 0:0:186:0: [sdga] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.543530] sd 0:0:187:0: [sdgb] Write Protect is off [ 46.543532] sd 0:0:187:0: [sdgb] Mode Sense: db 00 10 08 [ 46.544859] sd 0:0:187:0: [sdgb] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.545646] sd 0:0:188:0: [sdgc] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.545648] sd 0:0:188:0: [sdgc] 4096-byte physical blocks [ 46.551591] sd 0:0:189:0: [sdgd] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.551593] sd 0:0:189:0: [sdgd] 4096-byte physical blocks [ 46.553965] sd 0:0:184:0: [sdfy] Attached SCSI disk [ 46.553978] sd 0:0:189:0: [sdgd] Write Protect is off [ 46.553980] sd 0:0:189:0: [sdgd] Mode Sense: db 00 10 08 [ 46.555491] sd 0:0:188:0: [sdgc] Write Protect is off [ 46.555494] sd 0:0:188:0: [sdgc] Mode Sense: db 00 10 08 [ 46.556812] sd 0:0:188:0: [sdgc] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.563768] sd 0:0:190:0: [sdge] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.563770] sd 0:0:190:0: [sdge] 4096-byte physical blocks [ 46.564593] sd 0:0:185:0: [sdfz] Attached SCSI disk [ 46.565551] sd 0:0:186:0: [sdga] Attached SCSI disk [ 46.566061] sd 0:0:190:0: [sdge] Write Protect is off [ 46.566063] sd 0:0:190:0: [sdge] Mode Sense: db 00 10 08 [ 46.567327] sd 0:0:190:0: [sdge] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.567400] sd 0:0:189:0: [sdgd] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.567641] sd 0:0:191:0: [sdgf] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.567643] sd 0:0:191:0: [sdgf] 4096-byte physical blocks [ 46.570006] sd 0:0:191:0: [sdgf] Write Protect is off [ 46.570009] sd 0:0:191:0: [sdgf] Mode Sense: db 00 10 08 [ 46.571316] sd 0:0:191:0: [sdgf] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.573086] sd 0:0:192:0: [sdgg] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.573088] sd 0:0:192:0: [sdgg] 4096-byte physical blocks [ 46.575374] sd 0:0:192:0: [sdgg] Write Protect is off [ 46.575376] sd 0:0:192:0: [sdgg] Mode Sense: db 00 10 08 [ 46.576709] sd 0:0:192:0: [sdgg] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.591848] sd 0:0:196:0: [sdgk] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.591850] sd 0:0:196:0: [sdgk] 4096-byte physical blocks [ 46.592787] sd 0:0:193:0: [sdgh] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.592790] sd 0:0:193:0: [sdgh] 4096-byte physical blocks [ 46.594229] sd 0:0:196:0: [sdgk] Write Protect is off [ 46.594231] sd 0:0:196:0: [sdgk] Mode Sense: db 00 10 08 [ 46.595338] sd 0:0:197:0: [sdgl] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.595339] sd 0:0:197:0: [sdgl] 4096-byte physical blocks [ 46.595522] sd 0:0:196:0: [sdgk] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.596346] sd 0:0:191:0: [sdgf] Attached SCSI disk [ 46.596512] sd 0:0:194:0: [sdgi] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.596514] sd 0:0:194:0: [sdgi] 4096-byte physical blocks [ 46.597691] sd 0:0:197:0: [sdgl] Write Protect is off [ 46.597692] sd 0:0:197:0: [sdgl] Mode Sense: db 00 10 08 [ 46.598870] sd 0:0:198:0: [sdgm] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.598872] sd 0:0:198:0: [sdgm] 4096-byte physical blocks [ 46.599040] sd 0:0:197:0: [sdgl] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.599297] sd 0:0:194:0: [sdgi] Write Protect is off [ 46.599300] sd 0:0:194:0: [sdgi] Mode Sense: db 00 10 08 [ 46.599919] sd 0:0:189:0: [sdgd] Attached SCSI disk [ 46.600090] sd 0:0:192:0: [sdgg] Attached SCSI disk [ 46.600405] sd 0:0:199:0: [sdgn] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.600407] sd 0:0:199:0: [sdgn] 4096-byte physical blocks [ 46.600586] sd 0:0:194:0: [sdgi] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.601209] sd 0:0:198:0: [sdgm] Write Protect is off [ 46.601212] sd 0:0:198:0: [sdgm] Mode Sense: db 00 10 08 [ 46.602665] sd 0:0:199:0: [sdgn] Write Protect is off [ 46.602667] sd 0:0:199:0: [sdgn] Mode Sense: db 00 10 08 [ 46.604002] sd 0:0:199:0: [sdgn] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.606693] sdge: [ 46.607249] sd 0:0:195:0: [sdgj] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.607251] sd 0:0:195:0: [sdgj] 4096-byte physical blocks [ 46.609733] sd 0:0:195:0: [sdgj] Write Protect is off [ 46.609736] sd 0:0:195:0: [sdgj] Mode Sense: db 00 10 08 [ 46.611029] sd 0:0:195:0: [sdgj] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.611416] sd 0:0:193:0: [sdgh] Write Protect is off [ 46.611419] sd 0:0:193:0: [sdgh] Mode Sense: db 00 10 08 [ 46.612059] sd 0:0:187:0: [sdgb] Attached SCSI disk [ 46.612782] sd 0:0:193:0: [sdgh] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.614334] sd 0:0:202:0: [sdgq] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.614336] sd 0:0:202:0: [sdgq] 4096-byte physical blocks [ 46.614522] sd 0:0:200:0: [sdgo] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.614524] sd 0:0:200:0: [sdgo] 4096-byte physical blocks [ 46.615833] sd 0:0:203:0: [sdgr] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.615840] sd 0:0:203:0: [sdgr] 4096-byte physical blocks [ 46.616587] sd 0:0:190:0: [sdge] Attached SCSI disk [ 46.616719] sd 0:0:202:0: [sdgq] Write Protect is off [ 46.616721] sd 0:0:202:0: [sdgq] Mode Sense: db 00 10 08 [ 46.617835] sd 0:0:198:0: [sdgm] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.618016] sd 0:0:202:0: [sdgq] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.618354] sd 0:0:194:0: [sdgi] Attached SCSI disk [ 46.618709] sd 0:0:203:0: [sdgr] Write Protect is off [ 46.618711] sd 0:0:203:0: [sdgr] Mode Sense: db 00 10 08 [ 46.619230] sd 0:0:196:0: [sdgk] Attached SCSI disk [ 46.620742] sd 0:0:203:0: [sdgr] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.624830] sd 0:0:197:0: [sdgl] Attached SCSI disk [ 46.626343] sd 0:0:195:0: [sdgj] Attached SCSI disk [ 46.628600] sd 0:0:201:0: [sdgp] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.628603] sd 0:0:201:0: [sdgp] 4096-byte physical blocks [ 46.630573] sd 0:0:205:0: [sdgt] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.630575] sd 0:0:205:0: [sdgt] 4096-byte physical blocks [ 46.630721] sd 0:0:193:0: [sdgh] Attached SCSI disk [ 46.631439] sd 0:0:200:0: [sdgo] Write Protect is off [ 46.631441] sd 0:0:200:0: [sdgo] Mode Sense: db 00 10 08 [ 46.631661] sd 0:0:208:0: [sdgw] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.631663] sd 0:0:208:0: [sdgw] 4096-byte physical blocks [ 46.631928] sd 0:0:209:0: [sdgx] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.631931] sd 0:0:209:0: [sdgx] 4096-byte physical blocks [ 46.632759] sd 0:0:200:0: [sdgo] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.633514] sd 0:0:205:0: [sdgt] Write Protect is off [ 46.633516] sd 0:0:205:0: [sdgt] Mode Sense: db 00 10 08 [ 46.634039] sd 0:0:208:0: [sdgw] Write Protect is off [ 46.634041] sd 0:0:208:0: [sdgw] Mode Sense: db 00 10 08 [ 46.634343] sd 0:0:209:0: [sdgx] Write Protect is off [ 46.634345] sd 0:0:209:0: [sdgx] Mode Sense: db 00 10 08 [ 46.634798] sd 0:0:205:0: [sdgt] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.634900] sd 0:0:211:0: [sdgz] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.634902] sd 0:0:211:0: [sdgz] 4096-byte physical blocks [ 46.635322] sd 0:0:208:0: [sdgw] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.635705] sd 0:0:209:0: [sdgx] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.637188] sd 0:0:211:0: [sdgz] Write Protect is off [ 46.637193] sd 0:0:211:0: [sdgz] Mode Sense: db 00 10 08 [ 46.637782] sd 0:0:210:0: [sdgy] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.637784] sd 0:0:210:0: [sdgy] 4096-byte physical blocks [ 46.638204] sd 0:0:212:0: [sdha] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.638206] sd 0:0:212:0: [sdha] 4096-byte physical blocks [ 46.638519] sd 0:0:211:0: [sdgz] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.638559] sd 0:0:203:0: [sdgr] Attached SCSI disk [ 46.638965] sd 0:0:202:0: [sdgq] Attached SCSI disk [ 46.639560] sd 0:0:213:0: [sdhb] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.639562] sd 0:0:213:0: [sdhb] 4096-byte physical blocks [ 46.640221] sd 0:0:210:0: [sdgy] Write Protect is off [ 46.640223] sd 0:0:210:0: [sdgy] Mode Sense: db 00 10 08 [ 46.641109] sd 0:0:212:0: [sdha] Write Protect is off [ 46.641110] sd 0:0:212:0: [sdha] Mode Sense: db 00 10 08 [ 46.641576] sd 0:0:210:0: [sdgy] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.642348] sd 0:0:213:0: [sdhb] Write Protect is off [ 46.642350] sd 0:0:213:0: [sdhb] Mode Sense: db 00 10 08 [ 46.642399] sd 0:0:212:0: [sdha] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.644073] sd 0:0:213:0: [sdhb] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.645595] sd 0:0:204:0: [sdgs] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.645597] sd 0:0:204:0: [sdgs] 4096-byte physical blocks [ 46.647522] sd 0:0:207:0: [sdgv] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.647524] sd 0:0:207:0: [sdgv] 4096-byte physical blocks [ 46.647904] sd 0:0:206:0: [sdgu] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.647906] sd 0:0:206:0: [sdgu] 4096-byte physical blocks [ 46.649780] sd 0:0:188:0: [sdgc] Attached SCSI disk [ 46.650094] sd 0:0:207:0: [sdgv] Write Protect is off [ 46.650096] sd 0:0:207:0: [sdgv] Mode Sense: db 00 10 08 [ 46.651034] sd 0:0:201:0: [sdgp] Write Protect is off [ 46.651036] sd 0:0:201:0: [sdgp] Mode Sense: db 00 10 08 [ 46.651374] sd 0:0:207:0: [sdgv] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.652379] sd 0:0:201:0: [sdgp] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.654230] sd 0:0:216:0: [sdhe] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.654232] sd 0:0:216:0: [sdhe] 4096-byte physical blocks [ 46.654753] sd 0:0:210:0: [sdgy] Attached SCSI disk [ 46.656476] sd 0:0:214:0: [sdhc] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.656478] sd 0:0:214:0: [sdhc] 4096-byte physical blocks [ 46.656619] sd 0:0:216:0: [sdhe] Write Protect is off [ 46.656621] sd 0:0:216:0: [sdhe] Mode Sense: db 00 10 08 [ 46.657911] sd 0:0:208:0: [sdgw] Attached SCSI disk [ 46.657914] sd 0:0:216:0: [sdhe] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.659840] sd 0:0:214:0: [sdhc] Write Protect is off [ 46.659842] sd 0:0:214:0: [sdhc] Mode Sense: db 00 10 08 [ 46.660399] sd 0:0:215:0: [sdhd] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.660401] sd 0:0:215:0: [sdhd] 4096-byte physical blocks [ 46.661684] sd 0:0:214:0: [sdhc] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.662771] sd 0:0:215:0: [sdhd] Write Protect is off [ 46.662773] sd 0:0:215:0: [sdhd] Mode Sense: db 00 10 08 [ 46.662963] sd 0:0:209:0: [sdgx] Attached SCSI disk [ 46.663177] sd 0:0:218:0: [sdhg] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.663179] sd 0:0:218:0: [sdhg] 4096-byte physical blocks [ 46.664120] sd 0:0:215:0: [sdhd] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.664647] sd 0:0:198:0: [sdgm] Attached SCSI disk [ 46.665506] sd 0:0:218:0: [sdhg] Write Protect is off [ 46.665508] sd 0:0:218:0: [sdhg] Mode Sense: db 00 10 08 [ 46.666807] sd 0:0:212:0: [sdha] Attached SCSI disk [ 46.666809] sd 0:0:218:0: [sdhg] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.667406] sd 0:0:219:0: [sdhh] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.667408] sd 0:0:219:0: [sdhh] 4096-byte physical blocks [ 46.668380] sd 0:0:206:0: [sdgu] Write Protect is off [ 46.668381] sd 0:0:206:0: [sdgu] Mode Sense: db 00 10 08 [ 46.668464] sd 0:0:207:0: [sdgv] Attached SCSI disk [ 46.669636] sd 0:0:219:0: [sdhh] Write Protect is off [ 46.669637] sd 0:0:219:0: [sdhh] Mode Sense: db 00 10 08 [ 46.669647] sd 0:0:206:0: [sdgu] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.670751] sd 0:0:220:0: [sdhi] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.670753] sd 0:0:220:0: [sdhi] 4096-byte physical blocks [ 46.670967] sd 0:0:219:0: [sdhh] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.671491] sd 0:0:201:0: [sdgp] Attached SCSI disk [ 46.672282] sd 0:0:199:0: [sdgn] Attached SCSI disk [ 46.672384] sd 0:0:204:0: [sdgs] Write Protect is off [ 46.672386] sd 0:0:204:0: [sdgs] Mode Sense: db 00 10 08 [ 46.673029] sd 0:0:220:0: [sdhi] Write Protect is off [ 46.673031] sd 0:0:220:0: [sdhi] Mode Sense: db 00 10 08 [ 46.674377] sd 0:0:220:0: [sdhi] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.674771] sd 0:0:204:0: [sdgs] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.675486] sd 0:0:217:0: [sdhf] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.675488] sd 0:0:217:0: [sdhf] 4096-byte physical blocks [ 46.677280] sd 0:0:213:0: [sdhb] Attached SCSI disk [ 46.677891] sd 0:0:221:0: [sdhj] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.677893] sd 0:0:221:0: [sdhj] 4096-byte physical blocks [ 46.677904] sd 0:0:217:0: [sdhf] Write Protect is off [ 46.677906] sd 0:0:217:0: [sdhf] Mode Sense: db 00 10 08 [ 46.679229] sd 0:0:217:0: [sdhf] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.680023] sd 0:0:222:0: [sdhk] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.680025] sd 0:0:222:0: [sdhk] 4096-byte physical blocks [ 46.680163] sd 0:0:221:0: [sdhj] Write Protect is off [ 46.680164] sd 0:0:221:0: [sdhj] Mode Sense: db 00 10 08 [ 46.680284] sd 0:0:215:0: [sdhd] Attached SCSI disk [ 46.681488] sd 0:0:221:0: [sdhj] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.682497] sd 0:0:222:0: [sdhk] Write Protect is off [ 46.682499] sd 0:0:222:0: [sdhk] Mode Sense: db 00 10 08 [ 46.682745] sd 0:0:216:0: [sdhe] Attached SCSI disk [ 46.683839] sd 0:0:222:0: [sdhk] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.686338] sd 0:0:206:0: [sdgu] Attached SCSI disk [ 46.686986] sd 0:0:218:0: [sdhg] Attached SCSI disk [ 46.688645] sd 0:0:223:0: [sdhl] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.688646] sd 0:0:223:0: [sdhl] 4096-byte physical blocks [ 46.688980] sd 0:0:204:0: [sdgs] Attached SCSI disk [ 46.690620] sd 0:0:211:0: [sdgz] Attached SCSI disk [ 46.690895] sd 0:0:223:0: [sdhl] Write Protect is off [ 46.690896] sd 0:0:223:0: [sdhl] Mode Sense: db 00 10 08 [ 46.692222] sd 0:0:223:0: [sdhl] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.694388] sd 0:0:214:0: [sdhc] Attached SCSI disk [ 46.695435] sd 0:0:220:0: [sdhi] Attached SCSI disk [ 46.695600] sd 0:0:217:0: [sdhf] Attached SCSI disk [ 46.700076] sd 0:0:221:0: [sdhj] Attached SCSI disk [ 46.702101] sd 0:0:226:0: [sdho] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.702102] sd 0:0:226:0: [sdho] 4096-byte physical blocks [ 46.704345] sd 0:0:226:0: [sdho] Write Protect is off [ 46.704346] sd 0:0:226:0: [sdho] Mode Sense: db 00 10 08 [ 46.705697] sd 0:0:226:0: [sdho] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.712618] sd 0:0:229:0: [sdhr] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.712620] sd 0:0:229:0: [sdhr] 4096-byte physical blocks [ 46.713470] sd 0:0:205:0: [sdgt] Attached SCSI disk [ 46.713496] sd 0:0:230:0: [sdhs] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.713498] sd 0:0:230:0: [sdhs] 4096-byte physical blocks [ 46.714926] sd 0:0:229:0: [sdhr] Write Protect is off [ 46.714929] sd 0:0:229:0: [sdhr] Mode Sense: db 00 10 08 [ 46.715774] sd 0:0:230:0: [sdhs] Write Protect is off [ 46.715776] sd 0:0:230:0: [sdhs] Mode Sense: db 00 10 08 [ 46.716225] sd 0:0:232:0: [sdhu] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.716228] sd 0:0:232:0: [sdhu] 4096-byte physical blocks [ 46.716285] sd 0:0:229:0: [sdhr] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.717106] sd 0:0:230:0: [sdhs] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.717773] sd 0:0:233:0: [sdhv] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.717775] sd 0:0:233:0: [sdhv] 4096-byte physical blocks [ 46.718286] sd 0:0:227:0: [sdhp] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.718289] sd 0:0:227:0: [sdhp] 4096-byte physical blocks [ 46.718605] sd 0:0:232:0: [sdhu] Write Protect is off [ 46.718607] sd 0:0:232:0: [sdhu] Mode Sense: db 00 10 08 [ 46.719861] sd 0:0:200:0: [sdgo] Attached SCSI disk [ 46.719897] sd 0:0:232:0: [sdhu] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.720108] sd 0:0:233:0: [sdhv] Write Protect is off [ 46.720111] sd 0:0:233:0: [sdhv] Mode Sense: db 00 10 08 [ 46.720701] sd 0:0:228:0: [sdhq] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.720703] sd 0:0:228:0: [sdhq] 4096-byte physical blocks [ 46.721385] sd 0:0:233:0: [sdhv] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.723874] sd 0:0:238:0: [sdia] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.723876] sd 0:0:238:0: [sdia] 4096-byte physical blocks [ 46.723937] sd 0:0:241:0: [sdid] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.723939] sd 0:0:241:0: [sdid] 4096-byte physical blocks [ 46.724169] sd 0:0:240:0: [sdic] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.724171] sd 0:0:240:0: [sdic] 4096-byte physical blocks [ 46.724903] sd 0:0:226:0: [sdho] Attached SCSI disk [ 46.725321] sd 1:2:0:0: [sdig] 233308160 512-byte logical blocks: (119 GB/111 GiB) [ 46.725538] sd 1:2:0:0: [sdig] Write Protect is off [ 46.725546] sd 1:2:0:0: [sdig] Mode Sense: 1f 00 10 08 [ 46.725601] sd 1:2:0:0: [sdig] Write cache: disabled, read cache: disabled, supports DPO and FUA [ 46.726813] sd 0:0:238:0: [sdia] Write Protect is off [ 46.726816] sd 0:0:238:0: [sdia] Mode Sense: db 00 10 08 [ 46.727064] sd 0:0:240:0: [sdic] Write Protect is off [ 46.727067] sd 0:0:240:0: [sdic] Mode Sense: db 00 10 08 [ 46.727700] sdig: sdig1 sdig2 sdig3 [ 46.727912] sd 0:0:234:0: [sdhw] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.727914] sd 0:0:234:0: [sdhw] 4096-byte physical blocks [ 46.728112] sd 0:0:238:0: [sdia] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.728407] sd 0:0:240:0: [sdic] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.728513] sd 1:2:0:0: [sdig] Attached SCSI disk [ 46.728567] sd 0:0:219:0: [sdhh] Attached SCSI disk [ 46.728712] sd 0:0:229:0: [sdhr] Attached SCSI disk [ 46.730423] sd 0:0:237:0: [sdhz] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.730425] sd 0:0:237:0: [sdhz] 4096-byte physical blocks [ 46.734085] sd 0:0:235:0: [sdhx] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.734087] sd 0:0:235:0: [sdhx] 4096-byte physical blocks [ 46.735683] sd 0:0:230:0: [sdhs] Attached SCSI disk [ 46.735705] sd 0:0:231:0: [sdht] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.735706] sd 0:0:231:0: [sdht] 4096-byte physical blocks [ 46.736494] sd 0:0:225:0: [sdhn] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.736496] sd 0:0:225:0: [sdhn] 4096-byte physical blocks [ 46.736796] sd 0:0:239:0: [sdib] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.736797] sd 0:0:239:0: [sdib] 4096-byte physical blocks [ 46.736957] sd 0:0:222:0: [sdhk] Attached SCSI disk [ 46.738864] sd 0:0:241:0: [sdid] Write Protect is off [ 46.738866] sd 0:0:241:0: [sdid] Mode Sense: db 00 10 08 [ 46.742054] sd 0:0:243:0: [sdif] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.742055] sd 0:0:243:0: [sdif] 4096-byte physical blocks [ 46.742670] sd 0:0:228:0: [sdhq] Write Protect is off [ 46.742672] sd 0:0:228:0: [sdhq] Mode Sense: db 00 10 08 [ 46.742928] sd 0:0:236:0: [sdhy] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.742930] sd 0:0:236:0: [sdhy] 4096-byte physical blocks [ 46.743028] sd 0:0:224:0: [sdhm] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.743030] sd 0:0:224:0: [sdhm] 4096-byte physical blocks [ 46.743067] sd 0:0:242:0: [sdie] 15628053168 512-byte logical blocks: (8.00 TB/7.27 TiB) [ 46.743069] sd 0:0:242:0: [sdie] 4096-byte physical blocks [ 46.744037] sd 0:0:228:0: [sdhq] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.744461] sd 0:0:243:0: [sdif] Write Protect is off [ 46.744463] sd 0:0:243:0: [sdif] Mode Sense: db 00 10 08 [ 46.746197] sd 0:0:243:0: [sdif] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.746293] sd 0:0:236:0: [sdhy] Write Protect is off [ 46.746295] sd 0:0:236:0: [sdhy] Mode Sense: db 00 10 08 [ 46.747586] sd 0:0:236:0: [sdhy] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.750072] sd 0:0:237:0: [sdhz] Write Protect is off [ 46.750075] sd 0:0:237:0: [sdhz] Mode Sense: db 00 10 08 [ 46.750377] sd 0:0:232:0: [sdhu] Attached SCSI disk [ 46.750467] sd 0:0:227:0: [sdhp] Write Protect is off [ 46.750470] sd 0:0:227:0: [sdhp] Mode Sense: db 00 10 08 [ 46.751621] sd 0:0:237:0: [sdhz] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.751694] sd 0:0:235:0: [sdhx] Write Protect is off [ 46.751695] sd 0:0:235:0: [sdhx] Mode Sense: db 00 10 08 [ 46.751773] sd 0:0:227:0: [sdhp] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.751972] sd 0:0:234:0: [sdhw] Write Protect is off [ 46.751974] sd 0:0:234:0: [sdhw] Mode Sense: db 00 10 08 [ 46.753325] sd 0:0:235:0: [sdhx] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.753345] sd 0:0:234:0: [sdhw] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.756499] sd 0:0:239:0: [sdib] Write Protect is off [ 46.756500] sd 0:0:239:0: [sdib] Mode Sense: db 00 10 08 [ 46.757416] sd 0:0:231:0: [sdht] Write Protect is off [ 46.757418] sd 0:0:231:0: [sdht] Mode Sense: db 00 10 08 [ 46.758165] sd 0:0:228:0: [sdhq] Attached SCSI disk [ 46.758757] sd 0:0:231:0: [sdht] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.759477] sd 0:0:239:0: [sdib] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.760265] sd 0:0:243:0: [sdif] Attached SCSI disk [ 46.762085] sd 0:0:236:0: [sdhy] Attached SCSI disk [ 46.762955] sd 0:0:242:0: [sdie] Write Protect is off [ 46.762957] sd 0:0:242:0: [sdie] Mode Sense: db 00 10 08 [ 46.764180] sd 0:0:223:0: [sdhl] Attached SCSI disk [ 46.764294] sd 0:0:242:0: [sdie] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.766370] sd 0:0:227:0: [sdhp] Attached SCSI disk [ 46.766492] sd 0:0:234:0: [sdhw] Attached SCSI disk [ 46.767150] sd 0:0:241:0: [sdid] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.767827] sd 0:0:237:0: [sdhz] Attached SCSI disk [ 46.767838] sd 0:0:233:0: [sdhv] Attached SCSI disk [ 46.767851] sd 0:0:235:0: [sdhx] Attached SCSI disk [ 46.769104] sd 0:0:225:0: [sdhn] Write Protect is off [ 46.769105] sd 0:0:225:0: [sdhn] Mode Sense: db 00 10 08 [ 46.770391] sd 0:0:225:0: [sdhn] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.778141] sd 0:0:242:0: [sdie] Attached SCSI disk [ 46.779350] sd 0:0:231:0: [sdht] Attached SCSI disk [ 46.779436] sd 0:0:239:0: [sdib] Attached SCSI disk [ 46.779899] sd 0:0:224:0: [sdhm] Write Protect is off [ 46.779901] sd 0:0:224:0: [sdhm] Mode Sense: db 00 10 08 [ 46.780850] sd 0:0:241:0: [sdid] Attached SCSI disk [ 46.781269] sd 0:0:224:0: [sdhm] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 46.786927] sd 0:0:240:0: [sdic] Attached SCSI disk [ 46.786953] sd 0:0:238:0: [sdia] Attached SCSI disk [ 46.789463] sd 0:0:225:0: [sdhn] Attached SCSI disk [ 46.798479] sd 0:0:224:0: [sdhm] Attached SCSI disk [ 46.992575] sd 0:0:22:0: [sdv] 4096-byte physical blocks [ 47.003305] sd 0:0:22:0: [sdv] Write Protect is off [ 47.003307] sd 0:0:22:0: [sdv] Mode Sense: db 00 10 08 [ 47.004605] sd 0:0:22:0: [sdv] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 47.029308] sd 0:0:22:0: [sdv] Attached SCSI disk [ 54.223272] EXT4-fs (sdig2): mounted filesystem with ordered data mode. Opts: (null) [ 54.523363] systemd-journald[352]: Received SIGTERM from PID 1 (systemd). [ 54.560492] SELinux: Disabled at runtime. [ 54.565111] SELinux: Unregistering netfilter hooks [ 54.616593] type=1404 audit(1558744873.047:2): selinux=0 auid=4294967295 ses=4294967295 [ 54.641927] ip_tables: (C) 2000-2006 Netfilter Core Team [ 54.647829] systemd[1]: Inserted module 'ip_tables' [ 54.750896] EXT4-fs (sdig2): re-mounted. Opts: (null) [ 54.751881] Request for unknown module key 'Mellanox Technologies signing key: 61feb074fc7292f958419386ffdd9d5ca999e403' err -11 [ 54.770284] knem 1.1.3.90mlnx1: initialized [ 54.782385] systemd-journald[14986]: Received request to flush runtime journal from PID 1 [ 54.917236] ACPI Error: No handler for Region [SYSI] (ffff9e93fcf40b40) [IPMI] (20130517/evregion-162) [ 54.930307] ACPI Error: Region IPMI (ID=7) has no handler (20130517/exfldio-305) [ 54.941972] ACPI Error: Method parse/execution failed [\_SB_.PMI0._GHL] (Node ffff9e6ba9e7b5a0), AE_NOT_EXIST (20130517/psparse-536) [ 54.960865] ACPI Error: Method parse/execution failed [\_SB_.PMI0._PMC] (Node ffff9e6ba9e7b500), AE_NOT_EXIST (20130517/psparse-536) [ 54.979802] ACPI Exception: AE_NOT_EXIST, Evaluating _PMC (20130517/power_meter-753) [ 54.992681] ipmi message handler version 39.2 [ 54.999310] scsi 0:0:0:0: Attached scsi generic sg0 type 13 [ 55.006971] ipmi device interface [ 55.007902] sd 0:0:1:0: Attached scsi generic sg1 type 0 [ 55.008417] sd 0:0:2:0: Attached scsi generic sg2 type 0 [ 55.008700] sd 0:0:3:0: Attached scsi generic sg3 type 0 [ 55.008933] sd 0:0:4:0: Attached scsi generic sg4 type 0 [ 55.009117] sd 0:0:5:0: Attached scsi generic sg5 type 0 [ 55.009275] sd 0:0:6:0: Attached scsi generic sg6 type 0 [ 55.009412] sd 0:0:7:0: Attached scsi generic sg7 type 0 [ 55.009522] sd 0:0:8:0: Attached scsi generic sg8 type 0 [ 55.009660] sd 0:0:9:0: Attached scsi generic sg9 type 0 [ 55.009819] sd 0:0:10:0: Attached scsi generic sg10 type 0 [ 55.009942] sd 0:0:11:0: Attached scsi generic sg11 type 0 [ 55.010049] sd 0:0:12:0: Attached scsi generic sg12 type 0 [ 55.010158] sd 0:0:13:0: Attached scsi generic sg13 type 0 [ 55.014799] sd 0:0:14:0: Attached scsi generic sg14 type 0 [ 55.015434] sd 0:0:15:0: Attached scsi generic sg15 type 0 [ 55.015828] sd 0:0:16:0: Attached scsi generic sg16 type 0 [ 55.018421] sd 0:0:17:0: Attached scsi generic sg17 type 0 [ 55.018839] sd 0:0:18:0: Attached scsi generic sg18 type 0 [ 55.019120] sd 0:0:19:0: Attached scsi generic sg19 type 0 [ 55.022060] sd 0:0:20:0: Attached scsi generic sg20 type 0 [ 55.024668] sd 0:0:21:0: Attached scsi generic sg21 type 0 [ 55.029765] sd 0:0:22:0: Attached scsi generic sg22 type 0 [ 55.032022] sd 0:0:23:0: Attached scsi generic sg23 type 0 [ 55.034284] sd 0:0:24:0: Attached scsi generic sg24 type 0 [ 55.034773] sd 0:0:25:0: Attached scsi generic sg25 type 0 [ 55.043499] sd 0:0:26:0: Attached scsi generic sg26 type 0 [ 55.043782] sd 0:0:27:0: Attached scsi generic sg27 type 0 [ 55.044073] sd 0:0:28:0: Attached scsi generic sg28 type 0 [ 55.044289] sd 0:0:29:0: Attached scsi generic sg29 type 0 [ 55.044511] sd 0:0:30:0: Attached scsi generic sg30 type 0 [ 55.044714] sd 0:0:31:0: Attached scsi generic sg31 type 0 [ 55.044878] sd 0:0:32:0: Attached scsi generic sg32 type 0 [ 55.045208] sd 0:0:33:0: Attached scsi generic sg33 type 0 [ 55.045560] sd 0:0:34:0: Attached scsi generic sg34 type 0 [ 55.045895] sd 0:0:35:0: Attached scsi generic sg35 type 0 [ 55.046524] sd 0:0:36:0: Attached scsi generic sg36 type 0 [ 55.047062] sd 0:0:37:0: Attached scsi generic sg37 type 0 [ 55.058630] sd 0:0:38:0: Attached scsi generic sg38 type 0 [ 55.065359] sd 0:0:39:0: Attached scsi generic sg39 type 0 [ 55.065556] sd 0:0:40:0: Attached scsi generic sg40 type 0 [ 55.066789] sd 0:0:41:0: Attached scsi generic sg41 type 0 [ 55.067278] sd 0:0:42:0: Attached scsi generic sg42 type 0 [ 55.068885] sd 0:0:43:0: Attached scsi generic sg43 type 0 [ 55.069515] sd 0:0:44:0: Attached scsi generic sg44 type 0 [ 55.069864] sd 0:0:45:0: Attached scsi generic sg45 type 0 [ 55.071797] sd 0:0:46:0: Attached scsi generic sg46 type 0 [ 55.078175] sd 0:0:47:0: Attached scsi generic sg47 type 0 [ 55.078957] sd 0:0:48:0: Attached scsi generic sg48 type 0 [ 55.079928] sd 0:0:49:0: Attached scsi generic sg49 type 0 [ 55.080161] sd 0:0:50:0: Attached scsi generic sg50 type 0 [ 55.080380] sd 0:0:51:0: Attached scsi generic sg51 type 0 [ 55.080806] sd 0:0:52:0: Attached scsi generic sg52 type 0 [ 55.081312] sd 0:0:53:0: Attached scsi generic sg53 type 0 [ 55.082737] sd 0:0:54:0: Attached scsi generic sg54 type 0 [ 55.090603] sd 0:0:55:0: Attached scsi generic sg55 type 0 [ 55.092016] sd 0:0:56:0: Attached scsi generic sg56 type 0 [ 55.092372] sd 0:0:57:0: Attached scsi generic sg57 type 0 [ 55.092679] sd 0:0:58:0: Attached scsi generic sg58 type 0 [ 55.094027] sd 0:0:59:0: Attached scsi generic sg59 type 0 [ 55.094216] sd 0:0:60:0: Attached scsi generic sg60 type 0 [ 55.094454] scsi 0:0:61:0: Attached scsi generic sg61 type 13 [ 55.095429] sd 0:0:62:0: Attached scsi generic sg62 type 0 [ 55.095694] sd 0:0:63:0: Attached scsi generic sg63 type 0 [ 55.103113] sd 0:0:64:0: Attached scsi generic sg64 type 0 [ 55.103761] sd 0:0:65:0: Attached scsi generic sg65 type 0 [ 55.104102] sd 0:0:66:0: Attached scsi generic sg66 type 0 [ 55.104576] sd 0:0:67:0: Attached scsi generic sg67 type 0 [ 55.106762] sd 0:0:68:0: Attached scsi generic sg68 type 0 [ 55.108908] sd 0:0:69:0: Attached scsi generic sg69 type 0 [ 55.109424] sd 0:0:70:0: Attached scsi generic sg70 type 0 [ 55.112133] sd 0:0:71:0: Attached scsi generic sg71 type 0 [ 55.114413] sd 0:0:72:0: Attached scsi generic sg72 type 0 [ 55.114877] sd 0:0:73:0: Attached scsi generic sg73 type 0 [ 55.115153] sd 0:0:74:0: Attached scsi generic sg74 type 0 [ 55.115425] sd 0:0:75:0: Attached scsi generic sg75 type 0 [ 55.115638] sd 0:0:76:0: Attached scsi generic sg76 type 0 [ 55.115846] sd 0:0:77:0: Attached scsi generic sg77 type 0 [ 55.116265] sd 0:0:78:0: Attached scsi generic sg78 type 0 [ 55.116725] sd 0:0:79:0: Attached scsi generic sg79 type 0 [ 55.117280] sd 0:0:80:0: Attached scsi generic sg80 type 0 [ 55.117866] sd 0:0:81:0: Attached scsi generic sg81 type 0 [ 55.119535] sd 0:0:82:0: Attached scsi generic sg82 type 0 [ 55.119930] sd 0:0:83:0: Attached scsi generic sg83 type 0 [ 55.120293] sd 0:0:84:0: Attached scsi generic sg84 type 0 [ 55.123790] sd 0:0:85:0: Attached scsi generic sg85 type 0 [ 55.124096] sd 0:0:86:0: Attached scsi generic sg86 type 0 [ 55.124506] sd 0:0:87:0: Attached scsi generic sg87 type 0 [ 55.127691] sd 0:0:88:0: Attached scsi generic sg88 type 0 [ 55.130847] sd 0:0:89:0: Attached scsi generic sg89 type 0 [ 55.131621] sd 0:0:90:0: Attached scsi generic sg90 type 0 [ 55.131689] sd 0:0:91:0: Attached scsi generic sg91 type 0 [ 55.136130] sd 0:0:92:0: Attached scsi generic sg92 type 0 [ 55.136932] sd 0:0:93:0: Attached scsi generic sg93 type 0 [ 55.137684] sd 0:0:94:0: Attached scsi generic sg94 type 0 [ 55.138634] sd 0:0:95:0: Attached scsi generic sg95 type 0 [ 55.138835] sd 0:0:96:0: Attached scsi generic sg96 type 0 [ 55.140744] sd 0:0:97:0: Attached scsi generic sg97 type 0 [ 55.141301] sd 0:0:98:0: Attached scsi generic sg98 type 0 [ 55.141820] sd 0:0:99:0: Attached scsi generic sg99 type 0 [ 55.142206] sd 0:0:100:0: Attached scsi generic sg100 type 0 [ 55.144653] sd 0:0:101:0: Attached scsi generic sg101 type 0 [ 55.145118] sd 0:0:102:0: Attached scsi generic sg102 type 0 [ 55.145584] sd 0:0:103:0: Attached scsi generic sg103 type 0 [ 55.146041] sd 0:0:104:0: Attached scsi generic sg104 type 0 [ 55.147009] sd 0:0:105:0: Attached scsi generic sg105 type 0 [ 55.147475] sd 0:0:106:0: Attached scsi generic sg106 type 0 [ 55.148100] sd 0:0:107:0: Attached scsi generic sg107 type 0 [ 55.151105] sd 0:0:108:0: Attached scsi generic sg108 type 0 [ 55.153547] sd 0:0:109:0: Attached scsi generic sg109 type 0 [ 55.154050] sd 0:0:110:0: Attached scsi generic sg110 type 0 [ 55.154373] sd 0:0:111:0: Attached scsi generic sg111 type 0 [ 55.154775] sd 0:0:112:0: Attached scsi generic sg112 type 0 [ 55.159285] sd 0:0:113:0: Attached scsi generic sg113 type 0 [ 55.159985] sd 0:0:114:0: Attached scsi generic sg114 type 0 [ 55.160533] sd 0:0:115:0: Attached scsi generic sg115 type 0 [ 55.161146] sd 0:0:116:0: Attached scsi generic sg116 type 0 [ 55.161505] sd 0:0:117:0: Attached scsi generic sg117 type 0 [ 55.161920] sd 0:0:118:0: Attached scsi generic sg118 type 0 [ 55.162400] sd 0:0:119:0: Attached scsi generic sg119 type 0 [ 55.164915] sd 0:0:120:0: Attached scsi generic sg120 type 0 [ 55.165652] sd 0:0:121:0: Attached scsi generic sg121 type 0 [ 55.166217] scsi 0:0:122:0: Attached scsi generic sg122 type 13 [ 55.168464] sd 0:0:123:0: Attached scsi generic sg123 type 0 [ 55.169073] sd 0:0:124:0: Attached scsi generic sg124 type 0 [ 55.169614] sd 0:0:125:0: Attached scsi generic sg125 type 0 [ 55.170002] sd 0:0:126:0: Attached scsi generic sg126 type 0 [ 55.170819] sd 0:0:127:0: Attached scsi generic sg127 type 0 [ 55.171274] sd 0:0:128:0: Attached scsi generic sg128 type 0 [ 55.171618] sd 0:0:129:0: Attached scsi generic sg129 type 0 [ 55.174162] sd 0:0:130:0: Attached scsi generic sg130 type 0 [ 55.174612] sd 0:0:131:0: Attached scsi generic sg131 type 0 [ 55.176184] sd 0:0:132:0: Attached scsi generic sg132 type 0 [ 55.176896] sd 0:0:133:0: Attached scsi generic sg133 type 0 [ 55.177414] sd 0:0:134:0: Attached scsi generic sg134 type 0 [ 55.178001] sd 0:0:135:0: Attached scsi generic sg135 type 0 [ 55.178422] sd 0:0:136:0: Attached scsi generic sg136 type 0 [ 55.178772] sd 0:0:137:0: Attached scsi generic sg137 type 0 [ 55.184989] sd 0:0:138:0: Attached scsi generic sg138 type 0 [ 55.187080] sd 0:0:139:0: Attached scsi generic sg139 type 0 [ 55.187489] sd 0:0:140:0: Attached scsi generic sg140 type 0 [ 55.190297] sd 0:0:141:0: Attached scsi generic sg141 type 0 [ 55.190687] sd 0:0:142:0: Attached scsi generic sg142 type 0 [ 55.193933] sd 0:0:143:0: Attached scsi generic sg143 type 0 [ 55.196254] sd 0:0:144:0: Attached scsi generic sg144 type 0 [ 55.198507] sd 0:0:145:0: Attached scsi generic sg145 type 0 [ 55.198798] sd 0:0:146:0: Attached scsi generic sg146 type 0 [ 55.199160] sd 0:0:147:0: Attached scsi generic sg147 type 0 [ 55.199351] sd 0:0:148:0: Attached scsi generic sg148 type 0 [ 55.201658] sd 0:0:149:0: Attached scsi generic sg149 type 0 [ 55.205269] sd 0:0:150:0: Attached scsi generic sg150 type 0 [ 55.205585] sd 0:0:151:0: Attached scsi generic sg151 type 0 [ 55.205831] sd 0:0:152:0: Attached scsi generic sg152 type 0 [ 55.206069] sd 0:0:153:0: Attached scsi generic sg153 type 0 [ 55.206341] sd 0:0:154:0: Attached scsi generic sg154 type 0 [ 55.206581] sd 0:0:155:0: Attached scsi generic sg155 type 0 [ 55.206829] sd 0:0:156:0: Attached scsi generic sg156 type 0 [ 55.207143] sd 0:0:157:0: Attached scsi generic sg157 type 0 [ 55.207870] sd 0:0:158:0: Attached scsi generic sg158 type 0 [ 55.208023] sd 0:0:159:0: Attached scsi generic sg159 type 0 [ 55.208445] sd 0:0:160:0: Attached scsi generic sg160 type 0 [ 55.208688] sd 0:0:161:0: Attached scsi generic sg161 type 0 [ 55.208972] sd 0:0:162:0: Attached scsi generic sg162 type 0 [ 55.209780] sd 0:0:163:0: Attached scsi generic sg163 type 0 [ 55.210003] sd 0:0:164:0: Attached scsi generic sg164 type 0 [ 55.210523] sd 0:0:165:0: Attached scsi generic sg165 type 0 [ 55.214336] sd 0:0:166:0: Attached scsi generic sg166 type 0 [ 55.214659] sd 0:0:167:0: Attached scsi generic sg167 type 0 [ 55.215064] sd 0:0:168:0: Attached scsi generic sg168 type 0 [ 55.216214] sd 0:0:169:0: Attached scsi generic sg169 type 0 [ 55.216478] sd 0:0:170:0: Attached scsi generic sg170 type 0 [ 55.216818] sd 0:0:171:0: Attached scsi generic sg171 type 0 [ 55.217842] sd 0:0:172:0: Attached scsi generic sg172 type 0 [ 55.218168] sd 0:0:173:0: Attached scsi generic sg173 type 0 [ 55.218884] sd 0:0:174:0: Attached scsi generic sg174 type 0 [ 55.219123] sd 0:0:175:0: Attached scsi generic sg175 type 0 [ 55.219366] sd 0:0:176:0: Attached scsi generic sg176 type 0 [ 55.219567] sd 0:0:177:0: Attached scsi generic sg177 type 0 [ 55.219831] sd 0:0:178:0: Attached scsi generic sg178 type 0 [ 55.220149] sd 0:0:179:0: Attached scsi generic sg179 type 0 [ 55.220453] sd 0:0:180:0: Attached scsi generic sg180 type 0 [ 55.223134] sd 0:0:181:0: Attached scsi generic sg181 type 0 [ 55.223299] sd 0:0:182:0: Attached scsi generic sg182 type 0 [ 55.223497] scsi 0:0:183:0: Attached scsi generic sg183 type 13 [ 55.223836] sd 0:0:184:0: Attached scsi generic sg184 type 0 [ 55.224108] sd 0:0:185:0: Attached scsi generic sg185 type 0 [ 55.225848] sd 0:0:186:0: Attached scsi generic sg186 type 0 [ 55.226278] sd 0:0:187:0: Attached scsi generic sg187 type 0 [ 55.227252] sd 0:0:188:0: Attached scsi generic sg188 type 0 [ 55.232929] sd 0:0:189:0: Attached scsi generic sg189 type 0 [ 55.233162] sd 0:0:190:0: Attached scsi generic sg190 type 0 [ 55.233391] sd 0:0:191:0: Attached scsi generic sg191 type 0 [ 55.236645] sd 0:0:192:0: Attached scsi generic sg192 type 0 [ 55.237010] sd 0:0:193:0: Attached scsi generic sg193 type 0 [ 55.237357] sd 0:0:194:0: Attached scsi generic sg194 type 0 [ 55.237752] sd 0:0:195:0: Attached scsi generic sg195 type 0 [ 55.241016] sd 0:0:196:0: Attached scsi generic sg196 type 0 [ 55.241269] sd 0:0:197:0: Attached scsi generic sg197 type 0 [ 55.241507] sd 0:0:198:0: Attached scsi generic sg198 type 0 [ 55.241748] sd 0:0:199:0: Attached scsi generic sg199 type 0 [ 55.241991] sd 0:0:200:0: Attached scsi generic sg200 type 0 [ 55.246930] sd 0:0:201:0: Attached scsi generic sg201 type 0 [ 55.251770] sd 0:0:202:0: Attached scsi generic sg202 type 0 [ 55.252151] sd 0:0:203:0: Attached scsi generic sg203 type 0 [ 55.256410] sd 0:0:204:0: Attached scsi generic sg204 type 0 [ 55.256613] sd 0:0:205:0: Attached scsi generic sg205 type 0 [ 55.256794] sd 0:0:206:0: Attached scsi generic sg206 type 0 [ 55.258172] sd 0:0:207:0: Attached scsi generic sg207 type 0 [ 55.259996] sd 0:0:208:0: Attached scsi generic sg208 type 0 [ 55.260286] sd 0:0:209:0: Attached scsi generic sg209 type 0 [ 55.261032] sd 0:0:210:0: Attached scsi generic sg210 type 0 [ 55.261280] sd 0:0:211:0: Attached scsi generic sg211 type 0 [ 55.261461] sd 0:0:212:0: Attached scsi generic sg212 type 0 [ 55.261595] sd 0:0:213:0: Attached scsi generic sg213 type 0 [ 55.261904] sd 0:0:214:0: Attached scsi generic sg214 type 0 [ 55.262134] sd 0:0:215:0: Attached scsi generic sg215 type 0 [ 55.262370] sd 0:0:216:0: Attached scsi generic sg216 type 0 [ 55.262535] sd 0:0:217:0: Attached scsi generic sg217 type 0 [ 55.262774] sd 0:0:218:0: Attached scsi generic sg218 type 0 [ 55.263102] sd 0:0:219:0: Attached scsi generic sg219 type 0 [ 55.263394] sd 0:0:220:0: Attached scsi generic sg220 type 0 [ 55.264136] sd 0:0:221:0: Attached scsi generic sg221 type 0 [ 55.265210] sd 0:0:222:0: Attached scsi generic sg222 type 0 [ 55.265431] sd 0:0:223:0: Attached scsi generic sg223 type 0 [ 55.265712] sd 0:0:224:0: Attached scsi generic sg224 type 0 [ 55.266307] sd 0:0:225:0: Attached scsi generic sg225 type 0 [ 55.266508] sd 0:0:226:0: Attached scsi generic sg226 type 0 [ 55.266705] sd 0:0:227:0: Attached scsi generic sg227 type 0 [ 55.266948] sd 0:0:228:0: Attached scsi generic sg228 type 0 [ 55.267156] sd 0:0:229:0: Attached scsi generic sg229 type 0 [ 55.267404] sd 0:0:230:0: Attached scsi generic sg230 type 0 [ 55.267626] sd 0:0:231:0: Attached scsi generic sg231 type 0 [ 55.268229] sd 0:0:232:0: Attached scsi generic sg232 type 0 [ 55.268359] sd 0:0:233:0: Attached scsi generic sg233 type 0 [ 55.268422] sd 0:0:234:0: Attached scsi generic sg234 type 0 [ 55.268494] sd 0:0:235:0: Attached scsi generic sg235 type 0 [ 55.272960] sd 0:0:236:0: Attached scsi generic sg236 type 0 [ 55.273220] sd 0:0:237:0: Attached scsi generic sg237 type 0 [ 55.273421] sd 0:0:238:0: Attached scsi generic sg238 type 0 [ 55.273576] sd 0:0:239:0: Attached scsi generic sg239 type 0 [ 55.273835] sd 0:0:240:0: Attached scsi generic sg240 type 0 [ 55.274002] sd 0:0:241:0: Attached scsi generic sg241 type 0 [ 55.274270] sd 0:0:242:0: Attached scsi generic sg242 type 0 [ 55.276814] sd 0:0:243:0: Attached scsi generic sg243 type 0 [ 55.277826] scsi 0:0:244:0: Attached scsi generic sg244 type 13 [ 55.278163] sd 1:2:0:0: Attached scsi generic sg245 type 0 [ 55.313992] device-mapper: uevent: version 1.0.3 [ 55.316423] device-mapper: ioctl: 4.37.1-ioctl (2018-04-03) initialised: dm-devel@redhat.com [ 55.441950] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.460102] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.460152] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.460198] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.460243] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.460289] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.460335] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.460378] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.460421] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.460464] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.460507] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.460550] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.460594] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.460645] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.460694] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.460742] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.460780] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.460817] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.460855] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.460894] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.460951] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.460994] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.461032] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.461078] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.461118] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.461156] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.461205] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.461257] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.461321] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.461365] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.461434] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.461479] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.461550] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.461595] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.461674] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.462471] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.462530] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.462920] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.462966] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.463011] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.463052] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.463099] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.463142] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.463185] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.463240] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.463284] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.463329] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.463369] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.463413] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.463457] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.463526] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.463569] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.463621] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.463661] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.463704] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.463745] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.463787] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.463829] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.463870] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.463916] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.463956] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.463999] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.464042] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.464086] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.464133] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.464174] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.464216] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.464259] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.464301] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.464344] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.464385] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.464426] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.464466] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.464507] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.464548] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.464595] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.464648] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.465201] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.465244] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.465284] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.465325] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.465363] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.465401] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.465448] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.465500] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.465542] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.465586] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.465640] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.465685] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.465730] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.465788] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.466005] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.466052] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.466096] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.466140] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.466185] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.466229] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.466270] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.466315] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.467619] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.467662] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.467706] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.467750] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.467802] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.467849] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.467898] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.467943] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.467991] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.468040] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.468083] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.468130] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.468175] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.468224] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.468893] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.468946] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.468992] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.469033] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.469076] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.469120] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.469165] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.469211] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.469255] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.469301] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.469344] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.469385] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.469428] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.469471] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.469512] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.469554] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.469597] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.469642] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.469690] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.469745] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.469791] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.469840] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.469888] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.469932] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.469973] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.470015] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.470057] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.470102] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.470143] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.470185] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.470228] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.470268] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.470313] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.470354] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.470391] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.470432] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.470514] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.470578] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.470670] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.470721] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.470778] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.470842] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.470893] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.470955] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.471010] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.471080] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.471126] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.471201] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.472649] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.473176] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.473236] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.473310] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.473580] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.473649] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.474407] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.474467] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.474525] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.474597] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.475589] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.475686] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.475730] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.475774] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.475820] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.475868] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.475912] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.475957] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.476004] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.476050] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.476100] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.476143] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.476191] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.476238] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.476283] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.476325] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.476377] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.476428] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.476476] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.476524] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.476566] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.476649] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.476689] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.476730] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.476768] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.476807] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.476855] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.476900] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.476943] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.476988] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.477026] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.477062] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.477107] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.477156] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.477194] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.477235] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.477273] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.477309] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.477353] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.477399] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.477443] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.477488] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.477538] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.477581] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.477632] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.477670] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.477716] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.477759] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.477803] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.477857] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.477910] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.477958] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.478027] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.478075] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.478118] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.478164] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.478214] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.478267] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.478311] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.478354] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.478398] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.478441] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.478487] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.478533] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.478580] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.478635] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.478685] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.478731] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.478776] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.478822] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.478869] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.478915] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.478959] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.479002] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.479046] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.479093] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.479138] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.479182] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.479228] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.479273] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.479322] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.479368] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.479421] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.479508] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.479555] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.479613] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.479664] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.479713] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.479760] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.479819] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.479864] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.479909] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.479955] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.479999] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.480043] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.480089] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.480135] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.480181] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.480228] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.480272] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.480317] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.480361] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.480404] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.480449] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.480493] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.480533] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.480643] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.480691] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.480742] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.480790] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.480842] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.480903] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.480966] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.481018] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.481082] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.481132] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.481188] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.481265] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.481316] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.481364] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.481413] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.481461] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.481516] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.481565] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.481617] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.481667] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.481716] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.481761] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.481810] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.481864] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.698717] IPMI System Interface driver. [ 55.698736] ipmi_si ipmi_si.0: ipmi_platform: probing via SMBIOS [ 55.698738] ipmi_si: SMBIOS: io 0xca8 regsize 1 spacing 4 irq 10 [ 55.698739] ipmi_si: Adding SMBIOS-specified kcs state machine [ 55.698760] ipmi_si IPI0001:00: ipmi_platform: probing via ACPI [ 55.698779] ipmi_si IPI0001:00: [io 0x0ca8] regsize 1 spacing 4 irq 10 [ 55.698781] ipmi_si ipmi_si.0: Removing SMBIOS-specified kcs state machine in favor of ACPI [ 55.698781] ipmi_si: Adding ACPI-specified kcs state machine [ 55.698853] ipmi_si: Trying ACPI-specified kcs state machine at i/o address 0xca8, slave address 0x20, irq 10 [ 55.708656] ipmi_si IPI0001:00: The BMC does not support setting the recv irq bit, compensating, but the BMC needs to be fixed. [ 55.709728] ipmi_si IPI0001:00: Using irq 10 [ 55.711883] ipmi_si IPI0001:00: Found new BMC (man_id: 0x0002a2, prod_id: 0x0100, dev_id: 0x20) [ 55.772746] ipmi_si IPI0001:00: IPMI kcs interface initialized [ 55.984636] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.986451] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.988283] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.990098] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.991957] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.993721] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.995502] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.997330] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 55.999229] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.001041] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.002850] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.004696] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.006506] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.008377] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.010197] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.012014] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.013809] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.015646] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.017408] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.019247] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.021050] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.022851] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.024739] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.026555] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.028369] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.030196] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.032062] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.033874] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.035668] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.037431] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.039212] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.041100] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.042913] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.044739] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.046590] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.048441] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.050252] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.052078] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.053882] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.055701] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.057495] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.059262] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.061060] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.062913] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.064738] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.066542] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.068370] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.070190] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.072049] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.073973] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.075807] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.077571] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.079868] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.081821] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.083655] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.085490] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.087827] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.089663] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.091952] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.093777] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.531895] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.535396] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.538928] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.542929] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.546480] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.551254] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.555815] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.559371] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.562942] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.566542] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.570448] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.574004] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.577609] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.581259] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.585349] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.588850] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.592316] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.595845] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.599457] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.602911] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.606455] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.609988] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.613534] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.617558] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.621166] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.624721] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.628493] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.632026] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.635607] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.639094] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.642771] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.646343] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.649842] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.653342] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.656861] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.660837] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.664307] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.667783] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.671324] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.674860] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.678306] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.681764] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.685252] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.689244] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.693280] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.696838] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.700431] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.703973] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.707608] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.711218] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.715481] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.719346] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.723287] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.727103] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.730695] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.734185] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.737659] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.741287] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.744825] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 56.749567] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 57.213537] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 57.218867] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 57.224167] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 57.229846] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 57.235082] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 57.240786] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 57.246043] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 57.251279] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 57.256537] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 57.261834] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 57.267121] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 57.272421] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 57.277722] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 57.283037] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 57.288290] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 57.293719] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 57.299014] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 57.304257] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 57.309595] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 57.315529] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 57.321161] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 57.326812] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 57.332175] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 57.337428] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 57.342705] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 57.348021] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 57.353273] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 57.358531] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 57.363762] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 57.368984] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 57.374233] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 57.379457] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 57.384689] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 57.389887] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 57.395183] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 57.400386] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 57.405626] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 57.410877] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 57.416083] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 57.421278] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 57.426523] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 57.431728] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 57.437004] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 57.442219] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 57.447497] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 57.452700] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 57.457945] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 57.463126] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 57.468377] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 57.474111] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 57.479294] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 57.484473] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 57.489661] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 57.494892] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 57.500162] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 57.505352] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 57.510553] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 57.515807] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 57.521011] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 57.526214] mpt3sas_cm0: log_info(0x31200205): originator(PL), code(0x20), sub_code(0x0205) [ 57.955939] ses 0:0:0:0: Attached Enclosure device [ 57.956016] ses 0:0:61:0: Attached Enclosure device [ 57.956104] ses 0:0:122:0: Attached Enclosure device [ 57.956181] ses 0:0:183:0: Attached Enclosure device [ 57.956241] ses 0:0:244:0: Attached Enclosure device [ 60.330254] ccp 0000:02:00.2: 3 command queues available [ 60.330289] ccp 0000:02:00.2: irq 238 for MSI/MSI-X [ 60.330299] ccp 0000:02:00.2: irq 239 for MSI/MSI-X [ 60.330385] ccp 0000:02:00.2: Queue 2 can access 4 LSB regions [ 60.330386] ccp 0000:02:00.2: Queue 3 can access 4 LSB regions [ 60.330388] ccp 0000:02:00.2: Queue 4 can access 4 LSB regions [ 60.330389] ccp 0000:02:00.2: Queue 0 gets LSB 4 [ 60.330390] ccp 0000:02:00.2: Queue 1 gets LSB 5 [ 60.330391] ccp 0000:02:00.2: Queue 2 gets LSB 6 [ 60.342862] ccp 0000:02:00.2: enabled [ 60.343105] ccp 0000:03:00.1: 5 command queues available [ 60.343175] ccp 0000:03:00.1: irq 241 for MSI/MSI-X [ 60.343231] ccp 0000:03:00.1: Queue 0 can access 7 LSB regions [ 60.343233] ccp 0000:03:00.1: Queue 1 can access 7 LSB regions [ 60.343235] ccp 0000:03:00.1: Queue 2 can access 7 LSB regions [ 60.343237] ccp 0000:03:00.1: Queue 3 can access 7 LSB regions [ 60.343239] ccp 0000:03:00.1: Queue 4 can access 7 LSB regions [ 60.343240] ccp 0000:03:00.1: Queue 0 gets LSB 1 [ 60.343241] ccp 0000:03:00.1: Queue 1 gets LSB 2 [ 60.343242] ccp 0000:03:00.1: Queue 2 gets LSB 3 [ 60.343243] ccp 0000:03:00.1: Queue 3 gets LSB 4 [ 60.343244] ccp 0000:03:00.1: Queue 4 gets LSB 5 [ 60.349996] ccp 0000:03:00.1: enabled [ 60.350256] ccp 0000:41:00.2: 3 command queues available [ 60.350288] ccp 0000:41:00.2: irq 243 for MSI/MSI-X [ 60.350297] ccp 0000:41:00.2: irq 244 for MSI/MSI-X [ 60.350375] ccp 0000:41:00.2: Queue 2 can access 4 LSB regions [ 60.350377] ccp 0000:41:00.2: Queue 3 can access 4 LSB regions [ 60.350378] ccp 0000:41:00.2: Queue 4 can access 4 LSB regions [ 60.350380] ccp 0000:41:00.2: Queue 0 gets LSB 4 [ 60.350381] ccp 0000:41:00.2: Queue 1 gets LSB 5 [ 60.350382] ccp 0000:41:00.2: Queue 2 gets LSB 6 [ 60.358368] ccp 0000:41:00.2: enabled [ 60.358562] ccp 0000:42:00.1: 5 command queues available [ 60.358593] ccp 0000:42:00.1: irq 246 for MSI/MSI-X [ 60.358644] ccp 0000:42:00.1: Queue 0 can access 7 LSB regions [ 60.358646] ccp 0000:42:00.1: Queue 1 can access 7 LSB regions [ 60.358647] ccp 0000:42:00.1: Queue 2 can access 7 LSB regions [ 60.358649] ccp 0000:42:00.1: Queue 3 can access 7 LSB regions [ 60.358651] ccp 0000:42:00.1: Queue 4 can access 7 LSB regions [ 60.358653] ccp 0000:42:00.1: Queue 0 gets LSB 1 [ 60.358654] ccp 0000:42:00.1: Queue 1 gets LSB 2 [ 60.358654] ccp 0000:42:00.1: Queue 2 gets LSB 3 [ 60.358655] ccp 0000:42:00.1: Queue 3 gets LSB 4 [ 60.358656] ccp 0000:42:00.1: Queue 4 gets LSB 5 [ 60.359694] ccp 0000:42:00.1: enabled [ 60.359921] ccp 0000:85:00.2: 3 command queues available [ 60.359952] ccp 0000:85:00.2: irq 248 for MSI/MSI-X [ 60.359967] ccp 0000:85:00.2: irq 249 for MSI/MSI-X [ 60.360083] ccp 0000:85:00.2: Queue 2 can access 4 LSB regions [ 60.360085] ccp 0000:85:00.2: Queue 3 can access 4 LSB regions [ 60.360087] ccp 0000:85:00.2: Queue 4 can access 4 LSB regions [ 60.360089] ccp 0000:85:00.2: Queue 0 gets LSB 4 [ 60.360090] ccp 0000:85:00.2: Queue 1 gets LSB 5 [ 60.360091] ccp 0000:85:00.2: Queue 2 gets LSB 6 [ 60.361159] ccp 0000:85:00.2: enabled [ 60.361331] ccp 0000:86:00.1: 5 command queues available [ 60.361367] ccp 0000:86:00.1: irq 251 for MSI/MSI-X [ 60.361437] ccp 0000:86:00.1: Queue 0 can access 7 LSB regions [ 60.361439] ccp 0000:86:00.1: Queue 1 can access 7 LSB regions [ 60.361441] ccp 0000:86:00.1: Queue 2 can access 7 LSB regions [ 60.361442] ccp 0000:86:00.1: Queue 3 can access 7 LSB regions [ 60.361444] ccp 0000:86:00.1: Queue 4 can access 7 LSB regions [ 60.361445] ccp 0000:86:00.1: Queue 0 gets LSB 1 [ 60.361446] ccp 0000:86:00.1: Queue 1 gets LSB 2 [ 60.361447] ccp 0000:86:00.1: Queue 2 gets LSB 3 [ 60.361448] ccp 0000:86:00.1: Queue 3 gets LSB 4 [ 60.361449] ccp 0000:86:00.1: Queue 4 gets LSB 5 [ 60.378040] ccp 0000:86:00.1: enabled [ 60.378268] ccp 0000:c2:00.2: 3 command queues available [ 60.378313] ccp 0000:c2:00.2: irq 253 for MSI/MSI-X [ 60.378326] ccp 0000:c2:00.2: irq 254 for MSI/MSI-X [ 60.378445] ccp 0000:c2:00.2: Queue 2 can access 4 LSB regions [ 60.378447] ccp 0000:c2:00.2: Queue 3 can access 4 LSB regions [ 60.378449] ccp 0000:c2:00.2: Queue 4 can access 4 LSB regions [ 60.378451] ccp 0000:c2:00.2: Queue 0 gets LSB 4 [ 60.378452] ccp 0000:c2:00.2: Queue 1 gets LSB 5 [ 60.378453] ccp 0000:c2:00.2: Queue 2 gets LSB 6 [ 60.380240] ccp 0000:c2:00.2: enabled [ 60.380481] ccp 0000:c3:00.1: 5 command queues available [ 60.380519] ccp 0000:c3:00.1: irq 256 for MSI/MSI-X [ 60.380548] ccp 0000:c3:00.1: Queue 0 can access 7 LSB regions [ 60.380551] ccp 0000:c3:00.1: Queue 1 can access 7 LSB regions [ 60.380553] ccp 0000:c3:00.1: Queue 2 can access 7 LSB regions [ 60.380555] ccp 0000:c3:00.1: Queue 3 can access 7 LSB regions [ 60.380557] ccp 0000:c3:00.1: Queue 4 can access 7 LSB regions [ 60.380558] ccp 0000:c3:00.1: Queue 0 gets LSB 1 [ 60.380560] ccp 0000:c3:00.1: Queue 1 gets LSB 2 [ 60.380561] ccp 0000:c3:00.1: Queue 2 gets LSB 3 [ 60.380562] ccp 0000:c3:00.1: Queue 3 gets LSB 4 [ 60.380563] ccp 0000:c3:00.1: Queue 4 gets LSB 5 [ 60.382919] ccp 0000:c3:00.1: enabled [ 60.447367] piix4_smbus 0000:00:14.0: SMBus Host Controller at 0xb00, revision 0 [ 60.447369] piix4_smbus 0000:00:14.0: Using register 0x2e for SMBus port selection [ 60.776319] input: PC Speaker as /devices/platform/pcspkr/input/input2 [ 61.670511] dcdbas dcdbas: Dell Systems Management Base Driver (version 5.6.0-3.3) [ 61.775943] cryptd: max_cpu_qlen set to 1000 [ 61.800872] AVX2 version of gcm_enc/dec engaged. [ 61.805506] AES CTR mode by8 optimization enabled [ 61.813031] alg: No test for __gcm-aes-aesni (__driver-gcm-aes-aesni) [ 61.819787] alg: No test for __generic-gcm-aes-aesni (__driver-generic-gcm-aes-aesni) [ 61.899355] kvm: Nested Paging enabled [ 61.907588] MCE: In-kernel MCE decoding enabled. [ 61.916869] AMD64 EDAC driver v3.4.0 [ 61.920515] EDAC amd64: DRAM ECC enabled. [ 61.924540] EDAC amd64: F17h detected (node 0). [ 61.929698] EDAC MC: UMC0 chip selects: [ 61.929702] EDAC amd64: MC: 0: 0MB 1: 0MB [ 61.934427] EDAC amd64: MC: 2: 32767MB 3: 32767MB [ 61.939151] EDAC amd64: MC: 4: 0MB 5: 0MB [ 61.943871] EDAC amd64: MC: 6: 0MB 7: 0MB [ 61.948634] EDAC MC: UMC1 chip selects: [ 61.948637] EDAC amd64: MC: 0: 0MB 1: 0MB [ 61.953386] EDAC amd64: MC: 2: 32767MB 3: 32767MB [ 61.958118] EDAC amd64: MC: 4: 0MB 5: 0MB [ 61.962835] EDAC amd64: MC: 6: 0MB 7: 0MB [ 61.967550] EDAC amd64: using x8 syndromes. [ 61.971743] EDAC amd64: MCT channel count: 2 [ 61.976178] EDAC MC0: Giving out device to 'amd64_edac' 'F17h': DEV 0000:00:18.3 [ 61.983653] EDAC amd64: DRAM ECC enabled. [ 61.987768] EDAC amd64: F17h detected (node 1). [ 61.992396] EDAC MC: UMC0 chip selects: [ 61.992398] EDAC amd64: MC: 0: 0MB 1: 0MB [ 61.997126] EDAC amd64: MC: 2: 32767MB 3: 32767MB [ 62.001839] EDAC amd64: MC: 4: 0MB 5: 0MB [ 62.006553] EDAC amd64: MC: 6: 0MB 7: 0MB [ 62.011261] EDAC MC: UMC1 chip selects: [ 62.011263] EDAC amd64: MC: 0: 0MB 1: 0MB [ 62.015988] EDAC amd64: MC: 2: 32767MB 3: 32767MB [ 62.020697] EDAC amd64: MC: 4: 0MB 5: 0MB [ 62.025403] EDAC amd64: MC: 6: 0MB 7: 0MB [ 62.030109] EDAC amd64: using x8 syndromes. [ 62.034295] EDAC amd64: MCT channel count: 2 [ 62.038706] EDAC MC1: Giving out device to 'amd64_edac' 'F17h': DEV 0000:00:19.3 [ 62.046104] EDAC amd64: DRAM ECC enabled. [ 62.050121] EDAC amd64: F17h detected (node 2). [ 62.054698] EDAC MC: UMC0 chip selects: [ 62.054699] EDAC amd64: MC: 0: 0MB 1: 0MB [ 62.059411] EDAC amd64: MC: 2: 32767MB 3: 32767MB [ 62.064118] EDAC amd64: MC: 4: 0MB 5: 0MB [ 62.068826] EDAC amd64: MC: 6: 0MB 7: 0MB [ 62.073541] EDAC MC: UMC1 chip selects: [ 62.073542] EDAC amd64: MC: 0: 0MB 1: 0MB [ 62.078252] EDAC amd64: MC: 2: 32767MB 3: 32767MB [ 62.082959] EDAC amd64: MC: 4: 0MB 5: 0MB [ 62.087664] EDAC amd64: MC: 6: 0MB 7: 0MB [ 62.092372] EDAC amd64: using x8 syndromes. [ 62.096566] EDAC amd64: MCT channel count: 2 [ 62.100957] EDAC MC2: Giving out device to 'amd64_edac' 'F17h': DEV 0000:00:1a.3 [ 62.108358] EDAC amd64: DRAM ECC enabled. [ 62.112375] EDAC amd64: F17h detected (node 3). [ 62.116946] EDAC MC: UMC0 chip selects: [ 62.116948] EDAC amd64: MC: 0: 0MB 1: 0MB [ 62.121656] EDAC amd64: MC: 2: 32767MB 3: 32767MB [ 62.126361] EDAC amd64: MC: 4: 0MB 5: 0MB [ 62.131068] EDAC amd64: MC: 6: 0MB 7: 0MB [ 62.135776] EDAC MC: UMC1 chip selects: [ 62.135777] EDAC amd64: MC: 0: 0MB 1: 0MB [ 62.140488] EDAC amd64: MC: 2: 32767MB 3: 32767MB [ 62.145195] EDAC amd64: MC: 4: 0MB 5: 0MB [ 62.149901] EDAC amd64: MC: 6: 0MB 7: 0MB [ 62.154607] EDAC amd64: using x8 syndromes. [ 62.158794] EDAC amd64: MCT channel count: 2 [ 62.163206] EDAC MC3: Giving out device to 'amd64_edac' 'F17h': DEV 0000:00:1b.3 [ 62.170625] EDAC PCI0: Giving out device to module 'amd64_edac' controller 'EDAC PCI controller': DEV '0000:00:18.0' (POLLED) [ 68.688513] device-mapper: multipath service-time: version 0.3.0 loaded [ 99.905216] Adding 4194300k swap on /dev/sdig3. Priority:-2 extents:1 across:4194300k FS [ 99.919269] FAT-fs (sdig1): Volume was not properly unmounted. Some data may be corrupt. Please run fsck. [ 99.959110] type=1305 audit(1558744918.389:3): audit_pid=64883 old=0 auid=4294967295 ses=4294967295 res=1 [ 99.982164] RPC: Registered named UNIX socket transport module. [ 99.988625] RPC: Registered udp transport module. [ 99.994717] RPC: Registered tcp transport module. [ 100.000807] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 100.302832] Request for unknown module key 'Mellanox Technologies signing key: 61feb074fc7292f958419386ffdd9d5ca999e403' err -11 [ 100.382034] Request for unknown module key 'Mellanox Technologies signing key: 61feb074fc7292f958419386ffdd9d5ca999e403' err -11 [ 100.436778] Request for unknown module key 'Mellanox Technologies signing key: 61feb074fc7292f958419386ffdd9d5ca999e403' err -11 [ 100.565245] Request for unknown module key 'Mellanox Technologies signing key: 61feb074fc7292f958419386ffdd9d5ca999e403' err -11 [ 100.613325] Request for unknown module key 'Mellanox Technologies signing key: 61feb074fc7292f958419386ffdd9d5ca999e403' err -11 [ 100.696974] Request for unknown module key 'Mellanox Technologies signing key: 61feb074fc7292f958419386ffdd9d5ca999e403' err -11 [ 100.711152] Request for unknown module key 'Mellanox Technologies signing key: 61feb074fc7292f958419386ffdd9d5ca999e403' err -11 [ 100.727453] mlx5_core 0000:84:00.0: slow_pci_heuristic:5202:(pid 65170): Max link speed = 100000, PCI BW = 126016 [ 100.737814] mlx5_core 0000:84:00.0: MLX5E: StrdRq(0) RqSz(1024) StrdSz(64) RxCqeCmprss(0) [ 100.746004] mlx5_core 0000:84:00.0: MLX5E: StrdRq(0) RqSz(1024) StrdSz(64) RxCqeCmprss(0) [ 100.885549] Request for unknown module key 'Mellanox Technologies signing key: 61feb074fc7292f958419386ffdd9d5ca999e403' err -11 [ 100.898398] Request for unknown module key 'Mellanox Technologies signing key: 61feb074fc7292f958419386ffdd9d5ca999e403' err -11 [ 100.947873] Request for unknown module key 'Mellanox Technologies signing key: 61feb074fc7292f958419386ffdd9d5ca999e403' err -11 [ 100.996203] Request for unknown module key 'Mellanox Technologies signing key: 61feb074fc7292f958419386ffdd9d5ca999e403' err -11 [ 101.279205] tg3 0000:81:00.0: irq 257 for MSI/MSI-X [ 101.279219] tg3 0000:81:00.0: irq 258 for MSI/MSI-X [ 101.279229] tg3 0000:81:00.0: irq 259 for MSI/MSI-X [ 101.279240] tg3 0000:81:00.0: irq 260 for MSI/MSI-X [ 101.279250] tg3 0000:81:00.0: irq 261 for MSI/MSI-X [ 101.405363] IPv6: ADDRCONF(NETDEV_UP): em1: link is not ready [ 104.788978] tg3 0000:81:00.0 em1: Link is up at 1000 Mbps, full duplex [ 104.795510] tg3 0000:81:00.0 em1: Flow control is on for TX and on for RX [ 104.802300] tg3 0000:81:00.0 em1: EEE is enabled [ 104.806938] IPv6: ADDRCONF(NETDEV_CHANGE): em1: link becomes ready [ 105.638057] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready [ 105.750074] IPv6: ADDRCONF(NETDEV_CHANGE): ib0: link becomes ready [ 109.883606] FS-Cache: Loaded [ 109.914275] FS-Cache: Netfs 'nfs' registered for caching [ 109.923817] Key type dns_resolver registered [ 109.952398] NFS: Registering the id_resolver key type [ 109.957465] Key type id_resolver registered [ 109.961652] Key type id_legacy registered [ 543.984317] LNet: HW NUMA nodes: 4, HW CPU cores: 48, npartitions: 4 [ 543.991973] alg: No test for adler32 (adler32-zlib) [ 544.795609] Lustre: Lustre: Build Version: 2.12.0.pl9 [ 544.919669] LNet: Using FastReg for registration [ 544.946557] LNet: Added LNI 10.0.10.108@o2ib7 [8/1024/0/180] [ 547.158371] md: md1 stopped. [ 547.169296] async_tx: api initialized (async) [ 547.175677] xor: automatically using best checksumming function: [ 547.191241] avx : 9624.000 MB/sec [ 547.223243] raid6: sse2x1 gen() 6085 MB/s [ 547.244244] raid6: sse2x2 gen() 11289 MB/s [ 547.265239] raid6: sse2x4 gen() 12917 MB/s [ 547.286243] raid6: avx2x1 gen() 14156 MB/s [ 547.307242] raid6: avx2x2 gen() 18808 MB/s [ 547.328243] raid6: avx2x4 gen() 18800 MB/s [ 547.332518] raid6: using algorithm avx2x2 gen() (18808 MB/s) [ 547.338179] raid6: using avx2x2 recovery algorithm [ 547.359137] md/raid:md1: not clean -- starting background reconstruction [ 547.365954] md/raid:md1: device dm-12 operational as raid disk 0 [ 547.371971] md/raid:md1: device dm-47 operational as raid disk 9 [ 547.377977] md/raid:md1: device dm-46 operational as raid disk 8 [ 547.383984] md/raid:md1: device dm-33 operational as raid disk 7 [ 547.389998] md/raid:md1: device dm-32 operational as raid disk 6 [ 547.396002] md/raid:md1: device dm-20 operational as raid disk 5 [ 547.402007] md/raid:md1: device dm-19 operational as raid disk 4 [ 547.408019] md/raid:md1: device dm-7 operational as raid disk 3 [ 547.413944] md/raid:md1: device dm-6 operational as raid disk 2 [ 547.419864] md/raid:md1: device dm-23 operational as raid disk 1 [ 547.426970] md/raid:md1: raid level 6 active with 10 out of 10 devices, algorithm 2 [ 547.473206] md1: detected capacity change from 0 to 64011422924800 [ 547.479461] md: resync of RAID array md1 [ 547.492857] md: md7 stopped. [ 547.515792] md/raid:md7: not clean -- starting background reconstruction [ 547.522604] md/raid:md7: device dm-71 operational as raid disk 0 [ 547.528617] md/raid:md7: device dm-106 operational as raid disk 9 [ 547.534715] md/raid:md7: device dm-105 operational as raid disk 8 [ 547.540808] md/raid:md7: device dm-92 operational as raid disk 7 [ 547.546815] md/raid:md7: device dm-91 operational as raid disk 6 [ 547.552831] md/raid:md7: device dm-79 operational as raid disk 5 [ 547.558843] md/raid:md7: device dm-78 operational as raid disk 4 [ 547.564851] md/raid:md7: device dm-66 operational as raid disk 3 [ 547.570883] md/raid:md7: device dm-65 operational as raid disk 2 [ 547.576897] md/raid:md7: device dm-82 operational as raid disk 1 [ 547.583688] md/raid:md7: raid level 6 active with 10 out of 10 devices, algorithm 2 [ 547.611462] md7: detected capacity change from 0 to 64011422924800 [ 547.617762] md: resync of RAID array md7 [ 547.620822] md: md3 stopped. [ 547.645893] md/raid:md3: device dm-56 operational as raid disk 0 [ 547.651919] md/raid:md3: device dm-51 operational as raid disk 9 [ 547.657940] md/raid:md3: device dm-50 operational as raid disk 8 [ 547.663969] md/raid:md3: device dm-38 operational as raid disk 7 [ 547.670013] md/raid:md3: device dm-37 operational as raid disk 6 [ 547.676073] md/raid:md3: device dm-25 operational as raid disk 5 [ 547.682105] md/raid:md3: device dm-24 operational as raid disk 4 [ 547.688132] md/raid:md3: device dm-11 operational as raid disk 3 [ 547.694185] md/raid:md3: device dm-10 operational as raid disk 2 [ 547.700237] md/raid:md3: device dm-57 operational as raid disk 1 [ 547.707301] md/raid:md3: raid level 6 active with 10 out of 10 devices, algorithm 2 [ 547.739845] md3: detected capacity change from 0 to 64011422924800 [ 547.761886] md: md11 stopped. [ 547.789986] md/raid:md11: not clean -- starting background reconstruction [ 547.796929] md/raid:md11: device dm-61 operational as raid disk 0 [ 547.803034] md/raid:md11: device dm-114 operational as raid disk 9 [ 547.809232] md/raid:md11: device dm-113 operational as raid disk 8 [ 547.815414] md/raid:md11: device dm-101 operational as raid disk 7 [ 547.821650] md/raid:md11: device dm-100 operational as raid disk 6 [ 547.827847] md/raid:md11: device dm-88 operational as raid disk 5 [ 547.833975] md/raid:md11: device dm-87 operational as raid disk 4 [ 547.840081] md/raid:md11: device dm-75 operational as raid disk 3 [ 547.846181] md/raid:md11: device dm-74 operational as raid disk 2 [ 547.852311] md/raid:md11: device dm-62 operational as raid disk 1 [ 547.859279] md/raid:md11: raid level 6 active with 10 out of 10 devices, algorithm 2 [ 547.889033] md11: detected capacity change from 0 to 64011422924800 [ 547.895422] md: resync of RAID array md11 [ 547.960983] md: md5 stopped. [ 548.020015] md/raid:md5: not clean -- starting background reconstruction [ 548.026961] md/raid:md5: device dm-2 operational as raid disk 0 [ 548.032943] md/raid:md5: device dm-55 operational as raid disk 9 [ 548.038987] md/raid:md5: device dm-54 operational as raid disk 8 [ 548.045002] md/raid:md5: device dm-42 operational as raid disk 7 [ 548.051021] md/raid:md5: device dm-41 operational as raid disk 6 [ 548.057044] md/raid:md5: device dm-29 operational as raid disk 5 [ 548.063065] md/raid:md5: device dm-28 operational as raid disk 4 [ 548.069081] md/raid:md5: device dm-16 operational as raid disk 3 [ 548.075100] md/raid:md5: device dm-15 operational as raid disk 2 [ 548.081116] md/raid:md5: device dm-3 operational as raid disk 1 [ 548.087863] md/raid:md5: raid level 6 active with 10 out of 10 devices, algorithm 2 [ 548.132011] md5: detected capacity change from 0 to 64011422924800 [ 548.138468] md: resync of RAID array md5 [ 548.149367] md: md9 stopped. [ 548.198436] md/raid:md9: not clean -- starting background reconstruction [ 548.205621] md/raid:md9: device dm-115 operational as raid disk 0 [ 548.211770] md/raid:md9: device dm-110 operational as raid disk 9 [ 548.217885] md/raid:md9: device dm-109 operational as raid disk 8 [ 548.224147] md/raid:md9: device dm-97 operational as raid disk 7 [ 548.230378] md/raid:md9: device dm-96 operational as raid disk 6 [ 548.236540] md/raid:md9: device dm-84 operational as raid disk 5 [ 548.242560] md/raid:md9: device dm-83 operational as raid disk 4 [ 548.242595] LDISKFS-fs warning (device md1): ldiskfs_multi_mount_protect:321: MMP interval 42 higher than expected, please wait. [ 548.261689] md/raid:md9: device dm-70 operational as raid disk 3 [ 548.267747] md/raid:md9: device dm-69 operational as raid disk 2 [ 548.273855] md/raid:md9: device dm-116 operational as raid disk 1 [ 548.280677] md/raid:md9: raid level 6 active with 10 out of 10 devices, algorithm 2 [ 548.333148] md9: detected capacity change from 0 to 64011422924800 [ 548.339651] md: resync of RAID array md9 [ 548.356470] LDISKFS-fs warning (device md7): ldiskfs_multi_mount_protect:321: MMP interval 42 higher than expected, please wait. [ 548.617338] LDISKFS-fs warning (device md3): ldiskfs_multi_mount_protect:321: MMP interval 42 higher than expected, please wait. [ 548.905926] LDISKFS-fs warning (device md11): ldiskfs_multi_mount_protect:321: MMP interval 42 higher than expected, please wait. [ 549.002748] LDISKFS-fs warning (device md5): ldiskfs_multi_mount_protect:321: MMP interval 42 higher than expected, please wait. [ 549.307095] LDISKFS-fs warning (device md9): ldiskfs_multi_mount_protect:321: MMP interval 42 higher than expected, please wait. [ 568.231321] md: md7: resync done. [ 569.658005] md: md11: resync done. [ 570.634652] md: md1: resync done. [ 570.833142] md: md9: resync done. [ 571.321103] md: md5: resync done. [ 590.319765] LDISKFS-fs (md1): file extents enabled, maximum tree depth=5 [ 590.451782] LDISKFS-fs (md7): file extents enabled, maximum tree depth=5 [ 590.707952] LDISKFS-fs (md3): file extents enabled, maximum tree depth=5 [ 591.037763] LDISKFS-fs (md11): file extents enabled, maximum tree depth=5 [ 591.112786] LDISKFS-fs (md5): file extents enabled, maximum tree depth=5 [ 591.386784] LDISKFS-fs (md9): file extents enabled, maximum tree depth=5 [ 595.071659] LDISKFS-fs (md7): recovery complete [ 595.095067] LDISKFS-fs (md7): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 595.277021] LDISKFS-fs (md3): recovery complete [ 595.336554] LDISKFS-fs (md3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 595.483273] LDISKFS-fs (md9): recovery complete [ 595.537951] LDISKFS-fs (md9): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 595.547320] LDISKFS-fs (md5): recovery complete [ 595.562544] LDISKFS-fs (md11): recovery complete [ 595.586044] LDISKFS-fs (md11): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 595.598915] LDISKFS-fs (md5): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 595.686175] LDISKFS-fs (md1): recovery complete [ 595.706644] LDISKFS-fs (md1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 600.919577] LNet: 72376:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 10.0.10.52@o2ib7: 0 seconds [ 600.936679] LustreError: 137-5: fir-OST002b_UUID: not available for connect from 10.8.30.5@o2ib6 (no target). If you are running an HA pair check that the target is mounted on the other server. [ 600.953877] LustreError: Skipped 10 previous similar messages [ 601.291583] Lustre: fir-OST0027: Not available for connect from 10.8.23.14@o2ib6 (not set up) [ 601.447962] LustreError: 137-5: fir-OST0028_UUID: not available for connect from 10.8.1.36@o2ib6 (no target). If you are running an HA pair check that the target is mounted on the other server. [ 601.465157] LustreError: Skipped 267 previous similar messages [ 601.804216] Lustre: fir-OST0027: Not available for connect from 10.9.109.58@o2ib4 (not set up) [ 601.812836] Lustre: Skipped 27 previous similar messages [ 602.453285] LustreError: 137-5: fir-OST002d_UUID: not available for connect from 10.8.11.8@o2ib6 (no target). If you are running an HA pair check that the target is mounted on the other server. [ 602.470484] LustreError: Skipped 461 previous similar messages [ 604.460989] LustreError: 137-5: fir-OST0025_UUID: not available for connect from 10.8.24.18@o2ib6 (no target). If you are running an HA pair check that the target is mounted on the other server. [ 604.478272] LustreError: Skipped 743 previous similar messages [ 607.919621] LNet: 72376:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 10.0.10.52@o2ib7: 0 seconds [ 608.466373] LustreError: 137-5: fir-OST002d_UUID: not available for connect from 10.8.24.3@o2ib6 (no target). If you are running an HA pair check that the target is mounted on the other server. [ 608.483569] LustreError: Skipped 1173 previous similar messages [ 613.919658] LNet: 72376:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 10.0.10.52@o2ib7: 0 seconds [ 616.485899] LustreError: 137-5: fir-OST0025_UUID: not available for connect from 10.9.109.2@o2ib4 (no target). If you are running an HA pair check that the target is mounted on the other server. [ 616.503198] LustreError: Skipped 1453 previous similar messages [ 616.919670] LNet: 72376:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 10.0.10.52@o2ib7: 3 seconds [ 616.929750] LNet: 72376:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Skipped 1 previous similar message [ 616.941901] Lustre: fir-OST0027: Imperative Recovery not enabled, recovery window 300-900 [ 616.950823] Lustre: fir-OST0027: in recovery but waiting for the first client to connect [ 616.968416] Lustre: fir-OST0027: Will be in recovery for at least 5:00, or until 1220 clients reconnect [ 616.977867] Lustre: fir-OST0027: Connection restored to (at 10.8.23.9@o2ib6) [ 616.985026] Lustre: Skipped 1 previous similar message [ 616.996047] Lustre: fir-OST0027: Denying connection for new client 7e2f1b77-e605-f279-b45d-e428b3d96daf(at 10.9.101.3@o2ib4), waiting for 1220 known clients (2 recovered, 0 in progress, and 0 evicted) to recover in 9:36 [ 617.277224] Lustre: fir-OST002b: Not available for connect from 10.8.8.16@o2ib6 (not set up) [ 617.285664] Lustre: Skipped 45 previous similar messages [ 617.485365] Lustre: fir-OST0027: Connection restored to (at 10.8.25.1@o2ib6) [ 617.492505] Lustre: Skipped 80 previous similar messages [ 617.593154] Lustre: fir-OST0027: Denying connection for new client 2d4bfef3-e59d-3bc4-9d14-028b7cbb00af(at 10.9.102.8@o2ib4), waiting for 1220 known clients (98 recovered, 4 in progress, and 0 evicted) to recover in 9:35 [ 617.612685] Lustre: Skipped 6 previous similar messages [ 618.485055] Lustre: fir-OST0027: Connection restored to (at 10.8.26.16@o2ib6) [ 618.492287] Lustre: Skipped 160 previous similar messages [ 618.627051] Lustre: fir-OST0027: Denying connection for new client 59eb580d-79f6-c9fa-7886-60aca8aaf8c9(at 10.9.101.22@o2ib4), waiting for 1220 known clients (232 recovered, 30 in progress, and 0 evicted) to recover in 9:34 [ 618.646846] Lustre: Skipped 20 previous similar messages [ 620.489046] Lustre: fir-OST0027: Connection restored to a5ca2b7c-8f3c-9580-8b61-2daecce0170a (at 10.8.31.5@o2ib6) [ 620.499308] Lustre: Skipped 256 previous similar messages [ 620.811594] Lustre: fir-OST0027: Denying connection for new client 1b8eb0eb-a92d-0512-8ca2-6e352d9d2c67(at 10.9.108.30@o2ib4), waiting for 1220 known clients (468 recovered, 65 in progress, and 0 evicted) to recover in 9:32 [ 620.831398] Lustre: Skipped 31 previous similar messages [ 622.919715] LNet: 72376:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 10.0.10.52@o2ib7: 0 seconds [ 624.488735] Lustre: fir-OST0027: Connection restored to (at 10.8.31.2@o2ib6) [ 624.495877] Lustre: Skipped 491 previous similar messages [ 624.816910] Lustre: fir-OST0027: Denying connection for new client 603ef852-66df-b745-900b-b12995ddbb59(at 10.9.104.51@o2ib4), waiting for 1220 known clients (905 recovered, 117 in progress, and 0 evicted) to recover in 9:28 [ 624.836795] Lustre: Skipped 47 previous similar messages [ 631.919761] LNet: 72376:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 10.0.10.52@o2ib7: 3 seconds [ 631.929844] LNet: 72376:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Skipped 2 previous similar messages [ 631.942222] Lustre: fir-OST002b: Imperative Recovery not enabled, recovery window 300-900 [ 631.955190] Lustre: fir-OST002b: in recovery but waiting for the first client to connect [ 631.967132] Lustre: fir-OST002b: Will be in recovery for at least 5:00, or until 1223 clients reconnect [ 632.299918] Lustre: fir-OST002f: Not available for connect from 10.9.101.48@o2ib4 (not set up) [ 632.308536] Lustre: Skipped 1 previous similar message [ 632.489078] Lustre: fir-OST002b: Connection restored to (at 10.9.107.47@o2ib4) [ 632.496395] Lustre: Skipped 188 previous similar messages [ 632.581866] LustreError: 137-5: fir-OST002d_UUID: not available for connect from 10.8.24.19@o2ib6 (no target). If you are running an HA pair check that the target is mounted on the other server. [ 632.599147] LustreError: Skipped 593 previous similar messages [ 632.850442] Lustre: fir-OST002b: Denying connection for new client 78523b3d-4f18-6c06-8391-66360d709348(at 10.9.108.43@o2ib4), waiting for 1223 known clients (45 recovered, 1 in progress, and 0 evicted) to recover in 9:37 [ 632.870063] Lustre: Skipped 19 previous similar messages [ 636.922011] Lustre: fir-OST002f: Imperative Recovery not enabled, recovery window 300-900 [ 636.930854] Lustre: fir-OST002f: in recovery but waiting for the first client to connect [ 636.957589] Lustre: fir-OST002f: Will be in recovery for at least 5:00, or until 1241 clients reconnect [ 641.922896] Lustre: fir-OST002d: Imperative Recovery not enabled, recovery window 300-900 [ 641.931770] Lustre: fir-OST002d: in recovery but waiting for the first client to connect [ 641.943247] Lustre: fir-OST002d: Will be in recovery for at least 5:00, or until 1237 clients reconnect [ 646.922826] Lustre: fir-OST0029: Imperative Recovery not enabled, recovery window 300-900 [ 646.931719] Lustre: fir-OST0029: in recovery but waiting for the first client to connect [ 646.941747] Lustre: fir-OST0029: Will be in recovery for at least 5:00, or until 1216 clients reconnect [ 647.232012] Lustre: fir-OST0025: Not available for connect from 10.9.112.2@o2ib4 (not set up) [ 648.496171] Lustre: fir-OST002d: Connection restored to (at 10.9.108.44@o2ib4) [ 648.503495] Lustre: Skipped 3365 previous similar messages [ 648.853183] Lustre: fir-OST0027: Denying connection for new client d9929f71-189d-4e78-455b-7e10107f50db(at 10.9.107.15@o2ib4), waiting for 1220 known clients (1052 recovered, 141 in progress, and 0 evicted) to recover in 9:04 [ 648.873150] Lustre: Skipped 368 previous similar messages [ 649.919862] LNet: 72376:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Timed out tx for 10.0.10.52@o2ib7: 21 seconds [ 649.930036] LNet: 72376:0:(o2iblnd_cb.c:3370:kiblnd_check_conns()) Skipped 13 previous similar messages [ 655.922928] Lustre: fir-OST0025: Imperative Recovery not enabled, recovery window 300-900 [ 655.931816] Lustre: fir-OST0025: in recovery but waiting for the first client to connect [ 655.944167] Lustre: fir-OST0025: Will be in recovery for at least 5:00, or until 1222 clients reconnect [ 680.962439] Lustre: fir-OST0027: Denying connection for new client a5710290-cea4-478e-aa9b-9f853a1ed392(at 10.9.106.68@o2ib4), waiting for 1220 known clients (1070 recovered, 146 in progress, and 0 evicted) to recover in 8:32 [ 680.982418] Lustre: Skipped 906 previous similar messages [ 684.057600] Lustre: fir-OST0029: Connection restored to (at 10.8.22.15@o2ib6) [ 684.064830] Lustre: Skipped 2760 previous similar messages [ 744.984750] Lustre: fir-OST0027: Denying connection for new client da74a6ae-9e7c-db01-39f9-c8d7b66544b1(at 10.9.101.19@o2ib4), waiting for 1220 known clients (1072 recovered, 146 in progress, and 0 evicted) to recover in 7:28 [ 745.004841] Lustre: Skipped 1959 previous similar messages [ 761.713859] Lustre: fir-OST002d: Connection restored to (at 10.9.106.17@o2ib4) [ 761.721180] Lustre: Skipped 17 previous similar messages [ 872.990765] Lustre: fir-OST0029: Denying connection for new client da2044d0-4d1f-46be-9f3b-250354ced4dc(at 10.9.106.2@o2ib4), waiting for 1216 known clients (1066 recovered, 147 in progress, and 0 evicted) to recover in 5:49 [ 873.010649] Lustre: Skipped 4597 previous similar messages [ 973.144003] Lustre: fir-OST002d: Connection restored to (at 10.9.104.8@o2ib4) [ 973.151299] Lustre: Skipped 7 previous similar messages [ 1129.058137] Lustre: fir-OST002d: Denying connection for new client 0ba60e4c-b718-64d3-62ae-bf4e916fc4e8(at 10.9.112.1@o2ib4), waiting for 1237 known clients (1074 recovered, 160 in progress, and 0 evicted) to recover in 1:29 [ 1129.078025] Lustre: Skipped 9933 previous similar messages [ 1493.501192] Lustre: fir-OST0027: recovery is timed out, evict stale exports [ 1493.508400] Lustre: fir-OST0027: disconnecting 2 stale clients [ 1493.514311] Lustre: 75663:0:(ldlm_lib.c:1771:extend_recovery_timer()) fir-OST0027: extended recovery timer reaching hard limit: 900, extend: 1 [ 1493.594139] LustreError: 168-f: fir-OST0027: BAD WRITE CHECKSUM: from 12345-10.8.10.2@o2ib6 via 10.0.10.204@o2ib7 inode [0x280025c30:0x8df:0x0] object 0x340000401:4763693 extent [24199168-25165823]: client csum 21f41572, server csum 271b6fbb [ 1493.826795] Lustre: fir-OST0027: Recovery already passed deadline 4:38, It is most likely due to DNE recovery is failed or stuck, please wait a few more minutes or abort the recovery. [ 1493.828418] Lustre: fir-OST0027: Connection restored to aaecd157-f885-52d3-de9b-d33aaec07cfc (at 10.8.29.4@o2ib6) [ 1493.853392] Lustre: Skipped 3 previous similar messages [ 1493.944908] Lustre: fir-OST0027: Recovery over after 14:37, of 1220 clients 1218 recovered and 2 were evicted. [ 1494.700419] Lustre: fir-OST0027: deleting orphan objects from 0x340000401:4764288 to 0x340000401:4764289 [ 1494.746673] Lustre: fir-OST0027: deleting orphan objects from 0x340000402:10923962 to 0x340000402:10924033 [ 1509.885124] Lustre: fir-OST002b: recovery is timed out, evict stale exports [ 1509.892255] Lustre: fir-OST002b: disconnecting 4 stale clients [ 1509.898170] Lustre: 75898:0:(ldlm_lib.c:1771:extend_recovery_timer()) fir-OST002b: extended recovery timer reaching hard limit: 900, extend: 1 [ 1509.910982] Lustre: 75898:0:(ldlm_lib.c:1771:extend_recovery_timer()) Skipped 1054 previous similar messages [ 1509.924158] Lustre: fir-OST002b: Recovery already passed deadline 4:38, It is most likely due to DNE recovery is failed or stuck, please wait a few more minutes or abort the recovery. [ 1509.940487] Lustre: Skipped 4 previous similar messages [ 1510.097629] Lustre: fir-OST002b: Recovery over after 14:38, of 1223 clients 1219 recovered and 4 were evicted. [ 1510.738624] Lustre: fir-OST002b: deleting orphan objects from 0x700000401:4763838 to 0x700000401:4763841 [ 1510.748154] Lustre: fir-OST002b: deleting orphan objects from 0x700000402:10921222 to 0x700000402:10921249 [ 1513.981149] Lustre: fir-OST002f: recovery is timed out, evict stale exports [ 1513.988286] Lustre: fir-OST002f: disconnecting 2 stale clients [ 1513.994184] Lustre: 75979:0:(ldlm_lib.c:1771:extend_recovery_timer()) fir-OST002f: extended recovery timer reaching hard limit: 900, extend: 1 [ 1514.006993] Lustre: 75979:0:(ldlm_lib.c:1771:extend_recovery_timer()) Skipped 1036 previous similar messages [ 1514.824549] Lustre: fir-OST002f: Recovery already passed deadline 4:38, It is most likely due to DNE recovery is failed or stuck, please wait a few more minutes or abort the recovery. [ 1514.840877] Lustre: Skipped 6 previous similar messages [ 1514.924747] Lustre: fir-OST002f: Recovery over after 14:38, of 1241 clients 1239 recovered and 2 were evicted. [ 1515.320230] Lustre: fir-OST002f: deleting orphan objects from 0xa80000401:10923451 to 0xa80000401:10923553 [ 1518.077175] Lustre: fir-OST002d: recovery is timed out, evict stale exports [ 1518.084373] Lustre: fir-OST002d: disconnecting 3 stale clients [ 1518.090307] Lustre: 76045:0:(ldlm_lib.c:1771:extend_recovery_timer()) fir-OST002d: extended recovery timer reaching hard limit: 900, extend: 1 [ 1518.103112] Lustre: 76045:0:(ldlm_lib.c:1771:extend_recovery_timer()) Skipped 1058 previous similar messages [ 1518.833233] Lustre: fir-OST002d: Recovery already passed deadline 4:37, It is most likely due to DNE recovery is failed or stuck, please wait a few more minutes or abort the recovery. [ 1518.849565] Lustre: Skipped 11 previous similar messages [ 1518.932337] Lustre: fir-OST002d: Recovery over after 14:37, of 1237 clients 1234 recovered and 3 were evicted. [ 1519.283681] Lustre: fir-OST002d: deleting orphan objects from 0xa40000401:10915554 to 0xa40000401:10915617 [ 1519.283682] Lustre: fir-OST002d: deleting orphan objects from 0xa40000400:4763193 to 0xa40000400:4763201 [ 1522.173203] Lustre: fir-OST0029: recovery is timed out, evict stale exports [ 1522.180328] Lustre: fir-OST0029: disconnecting 3 stale clients [ 1522.186251] Lustre: 76175:0:(ldlm_lib.c:1771:extend_recovery_timer()) fir-OST0029: extended recovery timer reaching hard limit: 900, extend: 1 [ 1522.199059] Lustre: 76175:0:(ldlm_lib.c:1771:extend_recovery_timer()) Skipped 1044 previous similar messages [ 1523.248941] Lustre: fir-OST0029: deleting orphan objects from 0x840000402:10917701 to 0x840000402:10917729 [ 1532.413267] Lustre: fir-OST0025: recovery is timed out, evict stale exports [ 1532.420460] Lustre: fir-OST0025: disconnecting 1 stale clients [ 1532.426368] Lustre: 76337:0:(ldlm_lib.c:1771:extend_recovery_timer()) fir-OST0025: extended recovery timer reaching hard limit: 900, extend: 1 [ 1532.439175] Lustre: 76337:0:(ldlm_lib.c:1771:extend_recovery_timer()) Skipped 1037 previous similar messages [ 1532.763073] Lustre: fir-OST0025: Recovery already passed deadline 4:38, It is most likely due to DNE recovery is failed or stuck, please wait a few more minutes or abort the recovery. [ 1532.779418] Lustre: Skipped 14 previous similar messages [ 1532.959146] Lustre: fir-OST0025: Recovery over after 14:37, of 1222 clients 1221 recovered and 1 was evicted. [ 1532.969063] Lustre: Skipped 1 previous similar message [ 1533.887856] Lustre: fir-OST0025: deleting orphan objects from 0xc00000401:10918117 to 0xc00000401:10918209 [ 1547.519022] LustreError: 87171:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002b: cli ecaf3ea1-3d24-ab9f-6856-0bf7294c7cf4 claims 4083712 GRANT, real grant 0 [ 1551.984701] LustreError: 86774:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0029: cli 8cb89dc0-c88e-79a3-15bf-ba0c55574ada claims 4218880 GRANT, real grant 4022272 [ 1551.999475] LustreError: 86774:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 1 previous similar message [ 1554.619892] LustreError: 86769:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002d: cli a6519f19-aa1f-7c07-30a6-27183c6aabc4 claims 327680 GRANT, real grant 135168 [ 1580.555509] Lustre: fir-OST0025: Export ffff9e6a59da3c00 already connecting from 10.9.108.41@o2ib4 [ 1588.531030] Lustre: fir-OST0025: Export ffff9e9aae94f800 already connecting from 10.9.101.5@o2ib4 [ 1589.775105] Lustre: fir-OST0025: Export ffff9e89cb6d8800 already connecting from 10.9.102.64@o2ib4 [ 1589.784065] Lustre: Skipped 2 previous similar messages [ 1592.178788] Lustre: fir-OST0025: Export ffff9e8982413400 already connecting from 10.9.105.6@o2ib4 [ 1592.187808] Lustre: Skipped 10 previous similar messages [ 1596.257242] Lustre: fir-OST0025: Export ffff9e6a5d6d6800 already connecting from 10.9.106.31@o2ib4 [ 1596.266207] Lustre: Skipped 25 previous similar messages [ 1604.277255] Lustre: fir-OST0025: Export ffff9e6a5c5f6400 already connecting from 10.9.104.4@o2ib4 [ 1604.286132] Lustre: Skipped 54 previous similar messages [ 1618.824041] Lustre: fir-OST0025: Client 40edf202-1dd9-d482-e1d9-d8df453c34c1 (at 10.9.102.4@o2ib4) reconnecting [ 1626.569175] Lustre: fir-OST0025: Client b26e37d1-e3a0-065b-3db0-b0f8734fcb6f (at 10.9.108.41@o2ib4) reconnecting [ 1636.851606] Lustre: fir-OST0025: Client 2b594365-b35c-08d1-9e9b-5138798f2c33 (at 10.9.104.26@o2ib4) reconnecting [ 1638.861636] Lustre: fir-OST0025: Client 8cb4545c-7ae7-b480-7124-b36f47a47160 (at 10.9.113.10@o2ib4) reconnecting [ 1638.871822] Lustre: Skipped 2 previous similar messages [ 1642.864027] Lustre: fir-OST0025: Client 492585ec-a5aa-1ba0-19ca-f69975156f5c (at 10.9.103.7@o2ib4) reconnecting [ 1642.874125] Lustre: Skipped 16 previous similar messages [ 1650.891187] Lustre: fir-OST0025: Client abffd720-a2aa-412e-9038-98cd76f7763d (at 10.9.103.11@o2ib4) reconnecting [ 1650.901384] Lustre: Skipped 52 previous similar messages [ 1670.192680] Lustre: fir-OST0025: Client 4f958dd8-52c3-c072-cab0-92786c461769 (at 10.9.104.32@o2ib4) reconnecting [ 1670.202862] Lustre: Skipped 67 previous similar messages [ 1692.412760] LustreError: 137-5: fir-OST002e_UUID: not available for connect from 10.8.29.4@o2ib6 (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1692.429956] LustreError: Skipped 262 previous similar messages [ 1700.024874] LustreError: 137-5: fir-OST0028_UUID: not available for connect from 10.8.15.3@o2ib6 (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1700.042071] LustreError: Skipped 27 previous similar messages [ 1708.479438] LustreError: 137-5: fir-OST002c_UUID: not available for connect from 10.8.7.2@o2ib6 (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1708.496549] LustreError: Skipped 1 previous similar message [ 1720.293763] Lustre: fir-OST0027: haven't heard from client 680a416d-9f0a-9afe-4168-5dcc0d748b22 (at 10.9.101.43@o2ib4) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e9ae665f000, cur 1558746538 expire 1558746388 last 1558746311 [ 1724.486835] LustreError: 137-5: fir-OST002c_UUID: not available for connect from 10.8.13.8@o2ib6 (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1724.504037] LustreError: Skipped 138 previous similar messages [ 1736.298244] Lustre: fir-OST002b: haven't heard from client 680a416d-9f0a-9afe-4168-5dcc0d748b22 (at 10.9.101.43@o2ib4) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e9af87c4400, cur 1558746554 expire 1558746404 last 1558746327 [ 1741.293333] Lustre: fir-OST002f: haven't heard from client 680a416d-9f0a-9afe-4168-5dcc0d748b22 (at 10.9.101.43@o2ib4) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e7a8f620400, cur 1558746559 expire 1558746409 last 1558746332 [ 1745.294800] Lustre: fir-OST002d: haven't heard from client 680a416d-9f0a-9afe-4168-5dcc0d748b22 (at 10.9.101.43@o2ib4) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e7a8f0ec000, cur 1558746563 expire 1558746413 last 1558746336 [ 1749.374238] Lustre: fir-OST0029: haven't heard from client 680a416d-9f0a-9afe-4168-5dcc0d748b22 (at 10.9.101.43@o2ib4) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e7a8a42b400, cur 1558746567 expire 1558746417 last 1558746340 [ 1756.531414] LustreError: 137-5: fir-OST0024_UUID: not available for connect from 10.8.21.11@o2ib6 (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1756.548718] LustreError: Skipped 7793 previous similar messages [ 1820.597068] LustreError: 137-5: fir-OST0024_UUID: not available for connect from 10.9.105.31@o2ib4 (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1820.614436] LustreError: Skipped 8758 previous similar messages [ 1911.206512] LustreError: 86775:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002d: cli a6519f19-aa1f-7c07-30a6-27183c6aabc4 claims 4218880 GRANT, real grant 0 [ 1919.084783] LustreError: 86775:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002d: cli a6519f19-aa1f-7c07-30a6-27183c6aabc4 claims 4218880 GRANT, real grant 0 [ 1941.229294] LustreError: 86775:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002d: cli a6519f19-aa1f-7c07-30a6-27183c6aabc4 claims 4087808 GRANT, real grant 0 [ 1948.647587] LustreError: 137-5: fir-OST0024_UUID: not available for connect from 10.8.21.5@o2ib6 (no target). If you are running an HA pair check that the target is mounted on the other server. [ 1948.664801] LustreError: Skipped 16987 previous similar messages [ 2205.204745] LustreError: 137-5: fir-OST0024_UUID: not available for connect from 10.8.24.28@o2ib6 (no target). If you are running an HA pair check that the target is mounted on the other server. [ 2205.222046] LustreError: Skipped 8408 previous similar messages [ 2293.008841] LustreError: 86775:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002d: cli a6519f19-aa1f-7c07-30a6-27183c6aabc4 claims 4218880 GRANT, real grant 0 [ 2293.022920] LustreError: 86775:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 1 previous similar message [ 2363.938255] LustreError: 87509:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002b: cli ecaf3ea1-3d24-ab9f-6856-0bf7294c7cf4 claims 4218880 GRANT, real grant 0 [ 2363.952350] LustreError: 87509:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 3 previous similar messages [ 2393.840690] md: md2 stopped. [ 2393.852158] md/raid:md2: not clean -- starting background reconstruction [ 2393.858962] md/raid:md2: device dm-34 operational as raid disk 0 [ 2393.864974] md/raid:md2: device dm-49 operational as raid disk 9 [ 2393.870985] md/raid:md2: device dm-48 operational as raid disk 8 [ 2393.876992] md/raid:md2: device dm-36 operational as raid disk 7 [ 2393.883007] md/raid:md2: device dm-35 operational as raid disk 6 [ 2393.889020] md/raid:md2: device dm-22 operational as raid disk 5 [ 2393.895027] md/raid:md2: device dm-21 operational as raid disk 4 [ 2393.901042] md/raid:md2: device dm-9 operational as raid disk 3 [ 2393.906970] md/raid:md2: device dm-8 operational as raid disk 2 [ 2393.912897] md/raid:md2: device dm-45 operational as raid disk 1 [ 2393.919506] md/raid:md2: raid level 6 active with 10 out of 10 devices, algorithm 2 [ 2393.960603] md2: detected capacity change from 0 to 64011422924800 [ 2393.966897] md: resync of RAID array md2 [ 2393.981144] md: md4 stopped. [ 2394.005184] md/raid:md4: not clean -- starting background reconstruction [ 2394.011998] md/raid:md4: device dm-58 operational as raid disk 0 [ 2394.018011] md/raid:md4: device dm-53 operational as raid disk 9 [ 2394.024025] md/raid:md4: device dm-52 operational as raid disk 8 [ 2394.030036] md/raid:md4: device dm-40 operational as raid disk 7 [ 2394.036046] md/raid:md4: device dm-39 operational as raid disk 6 [ 2394.042059] md/raid:md4: device dm-27 operational as raid disk 5 [ 2394.048074] md/raid:md4: device dm-26 operational as raid disk 4 [ 2394.054089] md/raid:md4: device dm-14 operational as raid disk 3 [ 2394.060105] md/raid:md4: device dm-13 operational as raid disk 2 [ 2394.066120] md/raid:md4: device dm-59 operational as raid disk 1 [ 2394.072744] md/raid:md4: raid level 6 active with 10 out of 10 devices, algorithm 2 [ 2394.117231] md4: detected capacity change from 0 to 64011422924800 [ 2394.123524] md: resync of RAID array md4 [ 2394.129817] md: md10 stopped. [ 2394.157645] md/raid:md10: not clean -- starting background reconstruction [ 2394.164570] md/raid:md10: device dm-117 operational as raid disk 0 [ 2394.170763] md/raid:md10: device dm-112 operational as raid disk 9 [ 2394.176948] md/raid:md10: device dm-111 operational as raid disk 8 [ 2394.183140] md/raid:md10: device dm-99 operational as raid disk 7 [ 2394.189243] md/raid:md10: device dm-98 operational as raid disk 6 [ 2394.195345] md/raid:md10: device dm-86 operational as raid disk 5 [ 2394.201446] md/raid:md10: device dm-85 operational as raid disk 4 [ 2394.207558] md/raid:md10: device dm-73 operational as raid disk 3 [ 2394.213666] md/raid:md10: device dm-72 operational as raid disk 2 [ 2394.219768] md/raid:md10: device dm-118 operational as raid disk 1 [ 2394.227286] md/raid:md10: raid level 6 active with 10 out of 10 devices, algorithm 2 [ 2394.266169] md10: detected capacity change from 0 to 64011422924800 [ 2394.272587] md: resync of RAID array md10 [ 2394.334498] md: md0 stopped. [ 2394.366813] md/raid:md0: device dm-0 operational as raid disk 0 [ 2394.372748] md/raid:md0: device dm-44 operational as raid disk 9 [ 2394.378772] md/raid:md0: device dm-43 operational as raid disk 8 [ 2394.384790] md/raid:md0: device dm-31 operational as raid disk 7 [ 2394.390806] md/raid:md0: device dm-30 operational as raid disk 6 [ 2394.396820] md/raid:md0: device dm-18 operational as raid disk 5 [ 2394.402830] md/raid:md0: device dm-17 operational as raid disk 4 [ 2394.408844] md/raid:md0: device dm-5 operational as raid disk 3 [ 2394.414771] md/raid:md0: device dm-4 operational as raid disk 2 [ 2394.420703] md/raid:md0: device dm-1 operational as raid disk 1 [ 2394.427468] md/raid:md0: raid level 6 active with 10 out of 10 devices, algorithm 2 [ 2394.461422] md0: detected capacity change from 0 to 64011422924800 [ 2394.481763] md: md8 stopped. [ 2394.509434] md/raid:md8: not clean -- starting background reconstruction [ 2394.516502] md/raid:md8: device dm-93 operational as raid disk 0 [ 2394.522522] md/raid:md8: device dm-108 operational as raid disk 9 [ 2394.528623] md/raid:md8: device dm-107 operational as raid disk 8 [ 2394.534725] md/raid:md8: device dm-95 operational as raid disk 7 [ 2394.540738] md/raid:md8: device dm-94 operational as raid disk 6 [ 2394.546748] md/raid:md8: device dm-81 operational as raid disk 5 [ 2394.552763] md/raid:md8: device dm-80 operational as raid disk 4 [ 2394.558786] md/raid:md8: device dm-68 operational as raid disk 3 [ 2394.564803] md/raid:md8: device dm-67 operational as raid disk 2 [ 2394.570822] md/raid:md8: device dm-104 operational as raid disk 1 [ 2394.577863] md/raid:md8: raid level 6 active with 10 out of 10 devices, algorithm 2 [ 2394.630792] md8: detected capacity change from 0 to 64011422924800 [ 2394.637251] md: resync of RAID array md8 [ 2394.685306] md: md6 stopped. [ 2394.703832] md/raid:md6: device dm-119 operational as raid disk 0 [ 2394.709935] md/raid:md6: device dm-103 operational as raid disk 9 [ 2394.716040] md/raid:md6: device dm-102 operational as raid disk 8 [ 2394.722143] md/raid:md6: device dm-90 operational as raid disk 7 [ 2394.728155] md/raid:md6: device dm-89 operational as raid disk 6 [ 2394.730717] LDISKFS-fs warning (device md2): ldiskfs_multi_mount_protect:321: MMP interval 42 higher than expected, please wait. [ 2394.747203] md/raid:md6: device dm-77 operational as raid disk 5 [ 2394.753224] md/raid:md6: device dm-76 operational as raid disk 4 [ 2394.759245] md/raid:md6: device dm-64 operational as raid disk 3 [ 2394.765260] md/raid:md6: device dm-63 operational as raid disk 2 [ 2394.771271] md/raid:md6: device dm-60 operational as raid disk 1 [ 2394.778291] md/raid:md6: raid level 6 active with 10 out of 10 devices, algorithm 2 [ 2394.807788] md6: detected capacity change from 0 to 64011422924800 [ 2394.990342] LDISKFS-fs warning (device md4): ldiskfs_multi_mount_protect:321: MMP interval 42 higher than expected, please wait. [ 2395.213645] LDISKFS-fs warning (device md10): ldiskfs_multi_mount_protect:321: MMP interval 42 higher than expected, please wait. [ 2395.453600] LDISKFS-fs warning (device md0): ldiskfs_multi_mount_protect:321: MMP interval 42 higher than expected, please wait. [ 2395.675599] LDISKFS-fs warning (device md8): ldiskfs_multi_mount_protect:321: MMP interval 42 higher than expected, please wait. [ 2395.930931] LDISKFS-fs warning (device md6): ldiskfs_multi_mount_protect:321: MMP interval 42 higher than expected, please wait. [ 2400.438076] md: md8: resync done. [ 2428.409318] md: md4: resync done. [ 2431.722697] md: md10: resync done. [ 2432.636311] md: md2: resync done. [ 2436.798765] LDISKFS-fs (md2): file extents enabled, maximum tree depth=5 [ 2437.064302] LDISKFS-fs (md4): file extents enabled, maximum tree depth=5 [ 2437.307383] LDISKFS-fs (md10): file extents enabled, maximum tree depth=5 [ 2437.538287] LDISKFS-fs (md0): file extents enabled, maximum tree depth=5 [ 2437.772545] LDISKFS-fs (md8): file extents enabled, maximum tree depth=5 [ 2438.021307] LDISKFS-fs (md6): file extents enabled, maximum tree depth=5 [ 2439.351245] LDISKFS-fs (md2): recovery complete [ 2439.376775] LDISKFS-fs (md2): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2439.782619] LDISKFS-fs (md0): recovery complete [ 2439.826489] LDISKFS-fs (md0): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2439.881812] LDISKFS-fs (md6): recovery complete [ 2439.933520] LDISKFS-fs (md6): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2440.129456] LDISKFS-fs (md4): recovery complete [ 2440.158303] LDISKFS-fs (md4): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2440.263573] Lustre: fir-OST0026: Not available for connect from 10.8.30.15@o2ib6 (not set up) [ 2440.272110] Lustre: Skipped 2 previous similar messages [ 2440.290329] Lustre: fir-OST0026: Imperative Recovery enabled, recovery window shrunk from 300-900 down to 150-900 [ 2440.301259] Lustre: fir-OST0026: in recovery but waiting for the first client to connect [ 2440.301276] LustreError: 98381:0:(ofd_obd.c:1337:ofd_iocontrol()) fir-OST0026: aborting recovery [ 2440.301278] LustreError: 98381:0:(ldlm_lib.c:2605:target_stop_recovery_thread()) fir-OST0026: Aborting recovery [ 2440.328213] Lustre: 100998:0:(ldlm_lib.c:2058:target_recovery_overseer()) recovery is aborted, evict exports in recovery [ 2440.333534] Lustre: fir-OST0026: Connection restored to (at 10.9.115.6@o2ib4) [ 2440.333537] Lustre: Skipped 1273 previous similar messages [ 2440.352332] Lustre: fir-OST0026: disconnecting 1403 stale clients [ 2440.389469] Lustre: fir-OST0026: Denying connection for new client 7c8f3d4b-bd47-410e-e2b0-ab5d1412be03(at 10.8.23.21@o2ib6), waiting for 1404 known clients (1 recovered, 0 in progress, and 1403 evicted) already passed deadline 40:38 [ 2440.410136] Lustre: Skipped 16248 previous similar messages [ 2440.676516] LDISKFS-fs (md10): recovery complete [ 2440.678889] LDISKFS-fs (md8): recovery complete [ 2440.697149] LDISKFS-fs (md8): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2440.711776] LDISKFS-fs (md10): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 2441.032556] Lustre: fir-OST0024: Imperative Recovery enabled, recovery window shrunk from 300-900 down to 150-900 [ 2441.046307] LustreError: 98958:0:(ofd_obd.c:1337:ofd_iocontrol()) fir-OST0024: aborting recovery [ 2441.055120] LustreError: 98958:0:(ldlm_lib.c:2605:target_stop_recovery_thread()) fir-OST0024: Aborting recovery [ 2441.065244] Lustre: 101050:0:(ldlm_lib.c:2058:target_recovery_overseer()) recovery is aborted, evict exports in recovery [ 2441.076109] Lustre: 101050:0:(ldlm_lib.c:2058:target_recovery_overseer()) Skipped 2 previous similar messages [ 2441.491136] Lustre: fir-OST002a: Not available for connect from 10.9.105.66@o2ib4 (not set up) [ 2442.445584] Lustre: fir-OST0028: Imperative Recovery enabled, recovery window shrunk from 300-900 down to 150-900 [ 2442.455847] Lustre: Skipped 1 previous similar message [ 2442.461694] Lustre: fir-OST0028: in recovery but waiting for the first client to connect [ 2442.461706] LustreError: 98538:0:(ofd_obd.c:1337:ofd_iocontrol()) fir-OST0028: aborting recovery [ 2442.461708] LustreError: 98538:0:(ofd_obd.c:1337:ofd_iocontrol()) Skipped 1 previous similar message [ 2442.461711] LustreError: 98538:0:(ldlm_lib.c:2605:target_stop_recovery_thread()) fir-OST0028: Aborting recovery [ 2442.461713] LustreError: 98538:0:(ldlm_lib.c:2605:target_stop_recovery_thread()) Skipped 1 previous similar message [ 2442.508238] Lustre: Skipped 8 previous similar messages [ 2442.513492] Lustre: 101149:0:(ldlm_lib.c:2058:target_recovery_overseer()) recovery is aborted, evict exports in recovery [ 2442.524376] Lustre: 101149:0:(ldlm_lib.c:2058:target_recovery_overseer()) Skipped 5 previous similar messages [ 2442.534624] Lustre: fir-OST0028: disconnecting 1400 stale clients [ 2442.540731] Lustre: Skipped 2 previous similar messages [ 2443.493466] Lustre: fir-OST002e: Not available for connect from 10.8.18.31@o2ib6 (not set up) [ 2443.501993] Lustre: Skipped 28 previous similar messages [ 2445.874337] Lustre: fir-OST0026: deleting orphan objects from 0xe40000400:4764313 to 0xe40000400:4764321 [ 2445.874538] Lustre: fir-OST0024: deleting orphan objects from 0xe80000400:4763417 to 0xe80000400:4763425 [ 2445.874667] Lustre: fir-OST0028: deleting orphan objects from 0xa00000400:4763065 to 0xa00000400:4763073 [ 2445.885286] Lustre: fir-OST002e: deleting orphan objects from 0x4c0000401:4764026 to 0x4c0000401:4764033 [ 2445.896369] Lustre: fir-OST002a: deleting orphan objects from 0x500000401:4763224 to 0x500000401:4763231 [ 2445.925181] Lustre: fir-OST002c: deleting orphan objects from 0x7c0000401:4763418 to 0x7c0000401:4763425 [ 2448.151246] Lustre: fir-OST002e: deleting orphan objects from 0x0:3580782 to 0x0:3580801 [ 2448.151271] Lustre: fir-OST002c: deleting orphan objects from 0x0:3580398 to 0x0:3580417 [ 2448.151733] Lustre: fir-OST002a: deleting orphan objects from 0x0:3579822 to 0x0:3579841 [ 2448.165374] Lustre: fir-OST0024: deleting orphan objects from 0x0:3579470 to 0x0:3579489 [ 2448.168178] Lustre: fir-OST0026: deleting orphan objects from 0x0:3581870 to 0x0:3581889 [ 2448.175807] Lustre: fir-OST0028: deleting orphan objects from 0x0:3579438 to 0x0:3579457 [ 2490.216510] LustreError: 75395:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002c: cli cdf11e38-c747-d1fa-b60b-6fdeccc6cd9f claims 4382720 GRANT, real grant 36864 [ 2490.230938] LustreError: 75395:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 7 previous similar messages [ 2619.810108] LustreError: 86771:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0024: cli 6ea10cfc-48e7-f6e7-b834-4eb6674e3061 claims 2523136 GRANT, real grant 0 [ 2619.824200] LustreError: 86771:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 89 previous similar messages [ 2770.299320] Lustre: fir-OST002b: haven't heard from client b7362542-9494-eee6-bccf-aa77e2aea9a9 (at 10.8.23.14@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e9adbb60c00, cur 1558747588 expire 1558747438 last 1558747361 [ 2886.716261] LustreError: 75395:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3870720 GRANT, real grant 0 [ 2886.730342] LustreError: 75395:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 114 previous similar messages [ 3402.166109] LustreError: 87186:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4222976 GRANT, real grant 0 [ 3402.180209] LustreError: 87186:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 209 previous similar messages [ 3677.160887] LustreError: 114092:0:(lustre_dlm.h:1424:ldlm_lvbo_update()) delayed lvb init failed (rc -2) [ 4016.051798] LustreError: 87613:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0024: cli 6ea10cfc-48e7-f6e7-b834-4eb6674e3061 claims 3895296 GRANT, real grant 0 [ 4016.065878] LustreError: 87613:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 468 previous similar messages [ 4050.764941] Lustre: fir-OST0025: Connection restored to (at 10.8.23.14@o2ib6) [ 4050.772169] Lustre: Skipped 8384 previous similar messages [ 4125.938510] Lustre: fir-OST0024: Connection restored to (at 10.8.23.14@o2ib6) [ 4125.945738] Lustre: Skipped 5 previous similar messages [ 4617.059648] LustreError: 87376:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002e: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 4366336 GRANT, real grant 0 [ 4617.073727] LustreError: 87376:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 449 previous similar messages [ 5221.533569] LustreError: 87509:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0024: cli 6ea10cfc-48e7-f6e7-b834-4eb6674e3061 claims 2994176 GRANT, real grant 0 [ 5221.547750] LustreError: 87509:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 344 previous similar messages [ 5822.926901] LustreError: 87379:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3895296 GRANT, real grant 0 [ 5822.940984] LustreError: 87379:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 318 previous similar messages [ 6423.696757] LustreError: 87515:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4145152 GRANT, real grant 0 [ 6423.710837] LustreError: 87515:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 473 previous similar messages [ 7029.005214] LustreError: 88145:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4165632 GRANT, real grant 0 [ 7029.019324] LustreError: 88145:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 276 previous similar messages [ 7634.295111] LustreError: 87182:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4341760 GRANT, real grant 0 [ 7634.309265] LustreError: 87182:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 231 previous similar messages [ 8244.457851] LustreError: 87567:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3973120 GRANT, real grant 0 [ 8244.472014] LustreError: 87567:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 363 previous similar messages [ 8849.780127] LustreError: 87330:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4169728 GRANT, real grant 0 [ 8849.794272] LustreError: 87330:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 191 previous similar messages [ 9450.163725] LustreError: 87197:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3870720 GRANT, real grant 0 [ 9450.177875] LustreError: 87197:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 136 previous similar messages [10050.832554] LustreError: 87181:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002c: cli cdf11e38-c747-d1fa-b60b-6fdeccc6cd9f claims 1875968 GRANT, real grant 0 [10050.846634] LustreError: 87181:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 138 previous similar messages [10662.776494] LustreError: 67749:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002e: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 4366336 GRANT, real grant 0 [10662.790604] LustreError: 67749:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 427 previous similar messages [11265.876939] LustreError: 87382:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002c: cli cdf11e38-c747-d1fa-b60b-6fdeccc6cd9f claims 4218880 GRANT, real grant 0 [11265.891016] LustreError: 87382:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 410 previous similar messages [11868.148416] LustreError: 86828:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0027: cli 1d02240d-6817-4f2d-eb33-71d0a2e61934 claims 487424 GRANT, real grant 0 [11868.162441] LustreError: 86828:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 295 previous similar messages [12470.019565] LustreError: 87591:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002c: cli cdf11e38-c747-d1fa-b60b-6fdeccc6cd9f claims 4218880 GRANT, real grant 0 [12470.033648] LustreError: 87591:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 267 previous similar messages [13070.884309] LustreError: 86769:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002d: cli a6519f19-aa1f-7c07-30a6-27183c6aabc4 claims 4087808 GRANT, real grant 0 [13070.898424] LustreError: 86769:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 177 previous similar messages [13671.996798] LustreError: 67773:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002c: cli cdf11e38-c747-d1fa-b60b-6fdeccc6cd9f claims 1826816 GRANT, real grant 0 [13672.010937] LustreError: 67773:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 181 previous similar messages [14280.621140] LustreError: 87540:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002c: cli cdf11e38-c747-d1fa-b60b-6fdeccc6cd9f claims 4100096 GRANT, real grant 0 [14280.635217] LustreError: 87540:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 248 previous similar messages [14903.425379] LustreError: 87595:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002c: cli cdf11e38-c747-d1fa-b60b-6fdeccc6cd9f claims 3895296 GRANT, real grant 0 [14903.439951] LustreError: 87595:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 236 previous similar messages [15503.880134] LustreError: 86825:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002c: cli cdf11e38-c747-d1fa-b60b-6fdeccc6cd9f claims 4218880 GRANT, real grant 0 [15503.894212] LustreError: 86825:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 185 previous similar messages [15539.668420] LNetError: 72379:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [15567.662729] LNetError: 72389:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [15613.692438] LNetError: 72380:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [15673.239760] LNetError: 72381:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [15759.466140] LNetError: 72386:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [15770.315400] LNetError: 72389:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [15770.327692] LNetError: 72389:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 1 previous similar message [15966.658889] perf: interrupt took too long (2504 > 2500), lowering kernel.perf_event_max_sample_rate to 79000 [16054.407481] LNetError: 72388:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [16105.261576] LustreError: 75394:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002c: cli cdf11e38-c747-d1fa-b60b-6fdeccc6cd9f claims 4218880 GRANT, real grant 0 [16105.275671] LustreError: 75394:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 175 previous similar messages [16180.080571] LNetError: 72380:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [16474.472866] LNetError: 72386:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [16474.485169] LNetError: 72386:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 2 previous similar messages [16680.555958] LNetError: 72384:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [16705.586138] LustreError: 87691:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002c: cli cdf11e38-c747-d1fa-b60b-6fdeccc6cd9f claims 4218880 GRANT, real grant 0 [16705.600250] LustreError: 87691:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 289 previous similar messages [16973.542631] LNetError: 72392:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [17247.994396] perf: interrupt took too long (3163 > 3130), lowering kernel.perf_event_max_sample_rate to 63000 [17314.760179] LustreError: 86828:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002c: cli cdf11e38-c747-d1fa-b60b-6fdeccc6cd9f claims 4218880 GRANT, real grant 0 [17314.774372] LustreError: 86828:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 292 previous similar messages [17548.867103] LNetError: 72388:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [17548.879489] LNetError: 72388:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 18 previous similar messages [17614.230404] perf: interrupt took too long (3968 > 3953), lowering kernel.perf_event_max_sample_rate to 50000 [17915.967439] LustreError: 12926:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002c: cli cdf11e38-c747-d1fa-b60b-6fdeccc6cd9f claims 4218880 GRANT, real grant 0 [17915.981674] LustreError: 12926:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 189 previous similar messages [18192.886522] LNetError: 72393:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [18192.898828] LNetError: 72393:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 19 previous similar messages [18538.156756] LustreError: 75395:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002c: cli cdf11e38-c747-d1fa-b60b-6fdeccc6cd9f claims 4329472 GRANT, real grant 0 [18538.170942] LustreError: 75395:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 200 previous similar messages [18804.413981] LNetError: 72387:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [18804.426382] LNetError: 72387:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 5 previous similar messages [18876.016095] perf: interrupt took too long (5103 > 4960), lowering kernel.perf_event_max_sample_rate to 39000 [18935.313708] Lustre: fir-OST0025: Connection restored to (at 10.9.115.13@o2ib4) [18935.321055] Lustre: Skipped 3 previous similar messages [19010.506673] Lustre: fir-OST002a: Connection restored to (at 10.9.115.13@o2ib4) [19010.513992] Lustre: Skipped 6 previous similar messages [19145.068704] LustreError: 86460:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002c: cli cdf11e38-c747-d1fa-b60b-6fdeccc6cd9f claims 4218880 GRANT, real grant 0 [19145.082805] LustreError: 86460:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 286 previous similar messages [19497.616654] LNetError: 72380:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [19497.629041] LNetError: 72380:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 17 previous similar messages [19745.766715] LustreError: 87977:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002c: cli cdf11e38-c747-d1fa-b60b-6fdeccc6cd9f claims 552960 GRANT, real grant 0 [19745.780941] LustreError: 87977:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 61 previous similar messages [20126.822230] LNetError: 72381:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [20126.834704] LNetError: 72381:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 2 previous similar messages [20368.478375] LustreError: 87198:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002c: cli cdf11e38-c747-d1fa-b60b-6fdeccc6cd9f claims 3469312 GRANT, real grant 0 [20368.492522] LustreError: 87198:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 64 previous similar messages [20746.745648] LNetError: 72391:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [20746.757939] LNetError: 72391:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 10 previous similar messages [20971.638882] LustreError: 87193:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002c: cli cdf11e38-c747-d1fa-b60b-6fdeccc6cd9f claims 4218880 GRANT, real grant 0 [20971.653102] LustreError: 87193:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 69 previous similar messages [21405.657577] LNetError: 72379:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [21405.670179] LNetError: 72379:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 6 previous similar messages [21594.131321] LustreError: 87186:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002c: cli cdf11e38-c747-d1fa-b60b-6fdeccc6cd9f claims 3919872 GRANT, real grant 0 [21594.145462] LustreError: 87186:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 180 previous similar messages [22211.524809] LustreError: 87689:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002c: cli cdf11e38-c747-d1fa-b60b-6fdeccc6cd9f claims 3624960 GRANT, real grant 0 [22211.539023] LustreError: 87689:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 156 previous similar messages [22284.173879] LNetError: 72388:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [22284.186221] LNetError: 72388:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 5 previous similar messages [22818.651300] LustreError: 67789:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002c: cli cdf11e38-c747-d1fa-b60b-6fdeccc6cd9f claims 3588096 GRANT, real grant 0 [22818.665498] LustreError: 67789:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 152 previous similar messages [22994.867788] LNetError: 72380:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [22994.880128] LNetError: 72380:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 9 previous similar messages [23420.097730] LustreError: 86830:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002c: cli cdf11e38-c747-d1fa-b60b-6fdeccc6cd9f claims 4218880 GRANT, real grant 0 [23420.111930] LustreError: 86830:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 169 previous similar messages [23647.358315] LNetError: 72383:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [23647.370744] LNetError: 72383:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 7 previous similar messages [24020.679827] LustreError: 67787:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002c: cli cdf11e38-c747-d1fa-b60b-6fdeccc6cd9f claims 4218880 GRANT, real grant 0 [24020.693959] LustreError: 67787:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 173 previous similar messages [24302.315624] LNetError: 72389:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [24302.328015] LNetError: 72389:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 12 previous similar messages [24627.972247] LustreError: 86823:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002c: cli cdf11e38-c747-d1fa-b60b-6fdeccc6cd9f claims 2973696 GRANT, real grant 0 [24627.986444] LustreError: 86823:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 127 previous similar messages [24946.709035] LNetError: 72391:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [24946.721374] LNetError: 72391:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 12 previous similar messages [25247.158498] LustreError: 87567:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002c: cli cdf11e38-c747-d1fa-b60b-6fdeccc6cd9f claims 4218880 GRANT, real grant 0 [25247.172797] LustreError: 87567:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 224 previous similar messages [25554.913983] LNetError: 72389:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [25554.926298] LNetError: 72389:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 11 previous similar messages [25849.249678] LustreError: 87516:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002c: cli cdf11e38-c747-d1fa-b60b-6fdeccc6cd9f claims 4218880 GRANT, real grant 0 [25849.263820] LustreError: 87516:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 246 previous similar messages [26035.425273] Lustre: fir-OST002e: haven't heard from client c1f89352-3b41-251b-6e1f-dbef9f82862f (at 10.8.27.19@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e6a1240c800, cur 1558770853 expire 1558770703 last 1558770626 [26035.447124] Lustre: Skipped 23 previous similar messages [26266.121580] LNetError: 72380:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [26266.133985] LNetError: 72380:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 8 previous similar messages [26452.487348] LustreError: 67782:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002c: cli cdf11e38-c747-d1fa-b60b-6fdeccc6cd9f claims 1826816 GRANT, real grant 0 [26452.501505] LustreError: 67782:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 80 previous similar messages [26924.717586] LNetError: 72392:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [26924.729889] LNetError: 72392:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 8 previous similar messages [27056.522274] LustreError: 87612:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0025: cli c85b79ba-f35a-df4c-7ce6-3db4837c1dc9 claims 1085440 GRANT, real grant 0 [27056.536367] LustreError: 87612:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 94 previous similar messages [27110.429296] Lustre: fir-OST002e: haven't heard from client 6b2680d5-bdc9-ca83-2c96-fb6c2ef38f1a (at 10.8.9.8@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e7363e64000, cur 1558771928 expire 1558771778 last 1558771701 [27110.451070] Lustre: Skipped 11 previous similar messages [27130.429633] Lustre: fir-OST002c: haven't heard from client 6b2680d5-bdc9-ca83-2c96-fb6c2ef38f1a (at 10.8.9.8@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e64e6463400, cur 1558771948 expire 1558771798 last 1558771721 [27130.451423] Lustre: Skipped 7 previous similar messages [27547.886754] LNetError: 72390:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [27547.899119] LNetError: 72390:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 8 previous similar messages [27628.430206] Lustre: fir-OST0028: haven't heard from client 6519c919-e2e8-89a4-1fa4-d0ad3d892e61 (at 10.8.27.20@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e7aedeea800, cur 1558772446 expire 1558772296 last 1558772219 [27628.452039] Lustre: Skipped 3 previous similar messages [27640.430258] Lustre: fir-OST0027: haven't heard from client 6519c919-e2e8-89a4-1fa4-d0ad3d892e61 (at 10.8.27.20@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e9ae0f20000, cur 1558772458 expire 1558772308 last 1558772231 [27640.452168] Lustre: Skipped 3 previous similar messages [27662.675778] LustreError: 75384:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002c: cli cdf11e38-c747-d1fa-b60b-6fdeccc6cd9f claims 3813376 GRANT, real grant 0 [27662.689879] LustreError: 75384:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 151 previous similar messages [28031.367159] Lustre: fir-OST0027: Connection restored to 6b2680d5-bdc9-ca83-2c96-fb6c2ef38f1a (at 10.8.9.8@o2ib6) [28031.377485] Lustre: Skipped 6 previous similar messages [28106.525014] Lustre: fir-OST0024: Connection restored to 6b2680d5-bdc9-ca83-2c96-fb6c2ef38f1a (at 10.8.9.8@o2ib6) [28106.535280] Lustre: Skipped 5 previous similar messages [28238.884521] LNetError: 72392:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [28238.896867] LNetError: 72392:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 13 previous similar messages [28273.575760] LustreError: 87383:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002e: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 1581056 GRANT, real grant 0 [28273.589900] LustreError: 87383:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 199 previous similar messages [28682.726554] Lustre: fir-OST0025: Connection restored to (at 10.8.27.19@o2ib6) [28682.733873] Lustre: Skipped 4 previous similar messages [28757.915431] Lustre: fir-OST002a: Connection restored to (at 10.8.27.19@o2ib6) [28757.922713] Lustre: Skipped 6 previous similar messages [28874.264069] LustreError: 67781:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002c: cli cdf11e38-c747-d1fa-b60b-6fdeccc6cd9f claims 4218880 GRANT, real grant 0 [28874.278253] LustreError: 67781:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 157 previous similar messages [29684.210802] LustreError: 87368:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002b: cli ecaf3ea1-3d24-ab9f-6856-0bf7294c7cf4 claims 4218880 GRANT, real grant 0 [29684.224895] LustreError: 87368:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 16 previous similar messages [30659.966569] LustreError: 87591:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002b: cli ecaf3ea1-3d24-ab9f-6856-0bf7294c7cf4 claims 4218880 GRANT, real grant 0 [30659.980645] LustreError: 87591:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 7 previous similar messages [31174.337952] Lustre: fir-OST0025: Connection restored to (at 10.8.27.20@o2ib6) [31174.345182] Lustre: Skipped 5 previous similar messages [31249.538594] Lustre: fir-OST0024: Connection restored to (at 10.8.27.20@o2ib6) [31249.545823] Lustre: Skipped 4 previous similar messages [31647.169217] LustreError: 75384:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002b: cli ecaf3ea1-3d24-ab9f-6856-0bf7294c7cf4 claims 4218880 GRANT, real grant 0 [31647.183290] LustreError: 75384:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 7 previous similar messages [32633.668606] LustreError: 87368:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002b: cli ecaf3ea1-3d24-ab9f-6856-0bf7294c7cf4 claims 4218880 GRANT, real grant 0 [32633.682687] LustreError: 87368:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 7 previous similar messages [33495.312340] LustreError: 87591:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002d: cli b37c54be-7fed-724b-d760-c5bd71b2a4e0 claims 4218880 GRANT, real grant 2514944 [33495.326947] LustreError: 87591:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 7 previous similar messages [34371.842473] LustreError: 87609:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002d: cli b37c54be-7fed-724b-d760-c5bd71b2a4e0 claims 36864 GRANT, real grant 0 [34371.856383] LustreError: 87609:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 8 previous similar messages [34986.844264] LustreError: 87196:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002d: cli b37c54be-7fed-724b-d760-c5bd71b2a4e0 claims 3035136 GRANT, real grant 0 [34986.858369] LustreError: 87196:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 12 previous similar messages [35602.387003] LustreError: 87609:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002b: cli ecaf3ea1-3d24-ab9f-6856-0bf7294c7cf4 claims 4218880 GRANT, real grant 0 [35602.401079] LustreError: 87609:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 2 previous similar messages [36222.040012] LustreError: 87569:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002d: cli b37c54be-7fed-724b-d760-c5bd71b2a4e0 claims 638976 GRANT, real grant 0 [36222.054004] LustreError: 87569:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 8 previous similar messages [36849.923903] LustreError: 67790:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002d: cli b37c54be-7fed-724b-d760-c5bd71b2a4e0 claims 3637248 GRANT, real grant 0 [36849.937983] LustreError: 67790:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 10 previous similar messages [37839.305283] LustreError: 86858:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002d: cli b37c54be-7fed-724b-d760-c5bd71b2a4e0 claims 45056 GRANT, real grant 0 [37839.319211] LustreError: 86858:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 7 previous similar messages [38457.278720] LustreError: 87196:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002d: cli b37c54be-7fed-724b-d760-c5bd71b2a4e0 claims 3039232 GRANT, real grant 0 [38457.292798] LustreError: 87196:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 10 previous similar messages [39571.561424] LustreError: 88145:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002d: cli b37c54be-7fed-724b-d760-c5bd71b2a4e0 claims 45056 GRANT, real grant 0 [39571.575334] LustreError: 88145:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 8 previous similar messages [40188.311304] LustreError: 86460:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002d: cli b37c54be-7fed-724b-d760-c5bd71b2a4e0 claims 3043328 GRANT, real grant 0 [40188.325379] LustreError: 86460:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 10 previous similar messages [40993.611319] Lustre: fir-OST0025: Connection restored to (at 10.9.112.13@o2ib4) [40993.618637] Lustre: Skipped 5 previous similar messages [41068.854703] Lustre: fir-OST0024: Connection restored to (at 10.9.112.13@o2ib4) [41068.862021] Lustre: Skipped 5 previous similar messages [41241.928068] LustreError: 75384:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002b: cli ecaf3ea1-3d24-ab9f-6856-0bf7294c7cf4 claims 4218880 GRANT, real grant 0 [41241.942145] LustreError: 75384:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 8 previous similar messages [41494.518759] Lustre: fir-OST0024: haven't heard from client a6feb84a-4421-83f6-04a3-1f0aa9b8c635 (at 10.9.112.15@o2ib4) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e842ebd4400, cur 1558786312 expire 1558786162 last 1558786085 [41494.540565] Lustre: Skipped 7 previous similar messages [41932.261606] LustreError: 87609:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002d: cli b37c54be-7fed-724b-d760-c5bd71b2a4e0 claims 3047424 GRANT, real grant 0 [41932.275731] LustreError: 87609:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 10 previous similar messages [43057.426023] LustreError: 86771:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002d: cli b37c54be-7fed-724b-d760-c5bd71b2a4e0 claims 53248 GRANT, real grant 0 [43057.439924] LustreError: 86771:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 3 previous similar messages [43680.240290] LustreError: 86858:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002d: cli b37c54be-7fed-724b-d760-c5bd71b2a4e0 claims 3047424 GRANT, real grant 0 [43680.254371] LustreError: 86858:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 4 previous similar messages [44813.094035] LustreError: 75384:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002d: cli b37c54be-7fed-724b-d760-c5bd71b2a4e0 claims 53248 GRANT, real grant 0 [44813.107940] LustreError: 75384:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 2 previous similar messages [45434.235427] LustreError: 75384:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002d: cli b37c54be-7fed-724b-d760-c5bd71b2a4e0 claims 3051520 GRANT, real grant 0 [45434.249509] LustreError: 75384:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 4 previous similar messages [46560.176899] LustreError: 87565:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002d: cli b37c54be-7fed-724b-d760-c5bd71b2a4e0 claims 57344 GRANT, real grant 0 [46560.190806] LustreError: 87565:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 2 previous similar messages [48460.558667] LustreError: 87330:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002c: cli cdf11e38-c747-d1fa-b60b-6fdeccc6cd9f claims 4059136 GRANT, real grant 0 [48460.572771] LustreError: 87330:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 4 previous similar messages [48469.853338] LNetError: 72393:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [48469.865634] LNetError: 72393:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 12 previous similar messages [48483.095787] Lustre: 87105:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1558793293/real 1558793293] req@ffff9e79457af200 x1634466521250352/t0(0) o106->fir-OST0027@10.9.112.16@o2ib4:15/16 lens 296/280 e 0 to 1 dl 1558793300 ref 1 fl Rpc:X/0/ffffffff rc 0/-1 [48483.123263] Lustre: 87105:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 6 previous similar messages [48484.209792] Lustre: 86590:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1558793294/real 1558793294] req@ffff9e5ac4906600 x1634466521258720/t0(0) o106->fir-OST0024@10.9.112.16@o2ib4:15/16 lens 296/280 e 0 to 1 dl 1558793301 ref 1 fl Rpc:X/0/ffffffff rc 0/-1 [48484.237377] Lustre: 86590:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 6 previous similar messages [48490.095810] Lustre: 87098:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1558793300/real 1558793300] req@ffff9e7b89d04800 x1634466521250416/t0(0) o106->fir-OST002b@10.9.112.16@o2ib4:15/16 lens 296/280 e 0 to 1 dl 1558793307 ref 1 fl Rpc:X/2/ffffffff rc 0/-1 [48490.123289] Lustre: 87098:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 28 previous similar messages [48497.095874] Lustre: 86584:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1558793307/real 1558793307] req@ffff9e9257cf9200 x1634466521250384/t0(0) o106->fir-OST002e@10.9.112.16@o2ib4:15/16 lens 296/280 e 0 to 1 dl 1558793314 ref 1 fl Rpc:X/2/ffffffff rc 0/-1 [48497.123430] Lustre: 86584:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 36 previous similar messages [48504.096907] Lustre: 86805:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1558793314/real 1558793314] req@ffff9e6b6ce9b900 x1634466521250288/t0(0) o106->fir-OST0025@10.9.112.16@o2ib4:15/16 lens 296/280 e 0 to 1 dl 1558793321 ref 1 fl Rpc:X/2/ffffffff rc 0/-1 [48504.124373] Lustre: 86805:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 35 previous similar messages [48512.211947] Lustre: 86560:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1558793322/real 1558793322] req@ffff9e8179f93c00 x1634466521258768/t0(0) o106->fir-OST0027@10.9.112.16@o2ib4:15/16 lens 296/280 e 0 to 1 dl 1558793329 ref 1 fl Rpc:X/2/ffffffff rc 0/-1 [48512.239651] Lustre: 86560:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 45 previous similar messages [48532.100053] Lustre: 86547:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1558793342/real 1558793342] req@ffff9e99b4226300 x1634466521250272/t0(0) o106->fir-OST0024@10.9.112.16@o2ib4:15/16 lens 296/280 e 0 to 1 dl 1558793349 ref 1 fl Rpc:X/2/ffffffff rc 0/-1 [48532.127461] Lustre: 86547:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 104 previous similar messages [48541.166998] LustreError: 87977:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002c: cli cdf11e38-c747-d1fa-b60b-6fdeccc6cd9f claims 2768896 GRANT, real grant 0 [48541.181134] LustreError: 87977:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 13 previous similar messages [48562.086115] LNetError: 72380:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [48562.098588] LNetError: 72380:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 11 previous similar messages [48567.104265] Lustre: 86480:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1558793377/real 1558793377] req@ffff9e864f456f00 x1634466521250448/t0(0) o106->fir-OST002c@10.9.112.16@o2ib4:15/16 lens 296/280 e 0 to 1 dl 1558793384 ref 1 fl Rpc:X/2/ffffffff rc 0/-1 [48567.131928] Lustre: 86480:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 191 previous similar messages [48631.229578] Lustre: 87112:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1558793441/real 1558793441] req@ffff9e7b89d06f00 x1634466521258736/t0(0) o106->fir-OST0025@10.9.112.16@o2ib4:15/16 lens 296/280 e 0 to 1 dl 1558793448 ref 1 fl Rpc:X/2/ffffffff rc 0/-1 [48631.256939] Lustre: 87112:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 367 previous similar messages [48665.567165] Lustre: fir-OST002b: haven't heard from client d29027f7-b27d-0b30-df4a-7dfdbfe2d839 (at 10.9.112.16@o2ib4) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e9af9fc2800, cur 1558793483 expire 1558793333 last 1558793256 [48665.588963] Lustre: Skipped 11 previous similar messages [48666.571978] Lustre: fir-OST002d: haven't heard from client d29027f7-b27d-0b30-df4a-7dfdbfe2d839 (at 10.9.112.16@o2ib4) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e7a8f0c1400, cur 1558793484 expire 1558793334 last 1558793257 [48666.593792] Lustre: Skipped 5 previous similar messages [48667.625844] Lustre: fir-OST0024: haven't heard from client d29027f7-b27d-0b30-df4a-7dfdbfe2d839 (at 10.9.112.16@o2ib4) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e9aaf281800, cur 1558793485 expire 1558793335 last 1558793258 [48667.647654] Lustre: Skipped 2 previous similar messages [48796.038869] LustreError: 87172:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0024: cli ff229835-b050-95f2-4a86-35428cf816bd claims 45056 GRANT, real grant 0 [48796.052800] LustreError: 87172:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 1 previous similar message [49116.619390] LustreError: 86860:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002c: cli cdf11e38-c747-d1fa-b60b-6fdeccc6cd9f claims 552960 GRANT, real grant 0 [49116.633482] LustreError: 86860:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 3 previous similar messages [49125.275582] LNetError: 72383:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [49438.866368] LNetError: 72390:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [49438.878717] LNetError: 72390:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 1 previous similar message [49719.003576] LustreError: 87542:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002c: cli cdf11e38-c747-d1fa-b60b-6fdeccc6cd9f claims 4022272 GRANT, real grant 0 [49719.017943] LustreError: 87542:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 80 previous similar messages [50243.962362] LNetError: 72388:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [50243.974791] LNetError: 72388:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 4 previous similar messages [50435.479421] LustreError: 87517:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0024: cli 6ea10cfc-48e7-f6e7-b834-4eb6674e3061 claims 991232 GRANT, real grant 0 [50435.493518] LustreError: 87517:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 485 previous similar messages [50898.983827] LNetError: 72390:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [50898.996175] LNetError: 72390:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 12 previous similar messages [51153.570262] Lustre: fir-OST0024: haven't heard from client df23de56-dd2e-8a63-a8d5-338686a662ec (at 10.8.17.18@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e7a8c781400, cur 1558795971 expire 1558795821 last 1558795744 [51153.592189] Lustre: Skipped 2 previous similar messages [51296.715625] LustreError: 87512:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0024: cli 6ea10cfc-48e7-f6e7-b834-4eb6674e3061 claims 4169728 GRANT, real grant 0 [51296.729831] LustreError: 87512:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 14 previous similar messages [51530.873376] LNetError: 72381:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [51530.885752] LNetError: 72381:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 15 previous similar messages [51835.683362] Lustre: fir-OST0029: Connection restored to d7e6489c-4ac3-8ad5-951f-ff4462d87a95 (at 10.8.15.2@o2ib6) [51835.693680] Lustre: Skipped 5 previous similar messages [51910.888971] Lustre: fir-OST0024: Connection restored to d7e6489c-4ac3-8ad5-951f-ff4462d87a95 (at 10.8.15.2@o2ib6) [51910.899343] Lustre: Skipped 5 previous similar messages [51911.573237] Lustre: fir-OST002b: haven't heard from client 25c68a06-73fb-c817-93ec-98f34b969f96 (at 10.8.23.14@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e72ebe79c00, cur 1558796729 expire 1558796579 last 1558796502 [51911.595204] Lustre: Skipped 107 previous similar messages [51929.437027] LustreError: 86828:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0024: cli 6ea10cfc-48e7-f6e7-b834-4eb6674e3061 claims 1105920 GRANT, real grant 0 [51929.451144] LustreError: 86828:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 23 previous similar messages [52149.143974] LNetError: 72379:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [52149.156325] LNetError: 72379:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 9 previous similar messages [52766.185918] LustreError: 86772:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0024: cli 6ea10cfc-48e7-f6e7-b834-4eb6674e3061 claims 2760704 GRANT, real grant 0 [52766.200189] LustreError: 86772:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 128 previous similar messages [52798.591763] Lustre: fir-OST0025: Connection restored to (at 10.8.23.14@o2ib6) [52798.598995] Lustre: Skipped 4 previous similar messages [52873.838290] Lustre: fir-OST0024: Connection restored to (at 10.8.23.14@o2ib6) [52873.845609] Lustre: Skipped 6 previous similar messages [52927.330749] LNetError: 72393:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [52927.343103] LNetError: 72393:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 11 previous similar messages [53380.661723] LustreError: 86838:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0024: cli ff229835-b050-95f2-4a86-35428cf816bd claims 45056 GRANT, real grant 0 [53380.675746] LustreError: 86838:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 89 previous similar messages [53535.321797] LNetError: 72391:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [53535.334146] LNetError: 72391:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 11 previous similar messages [53754.051903] Lustre: fir-OST0025: Connection restored to f0ba9527-4000-78d5-07ea-44ae00898a99 (at 10.8.15.5@o2ib6) [53754.062233] Lustre: Skipped 5 previous similar messages [53778.580893] Lustre: fir-OST0027: Connection restored to e267eed0-45c3-44be-99a6-206acecf07ea (at 10.8.15.6@o2ib6) [53778.591199] Lustre: Skipped 4 previous similar messages [53829.255372] Lustre: fir-OST0024: Connection restored to f0ba9527-4000-78d5-07ea-44ae00898a99 (at 10.8.15.5@o2ib6) [53829.265751] Lustre: Skipped 6 previous similar messages [53853.833070] Lustre: fir-OST0026: Connection restored to e267eed0-45c3-44be-99a6-206acecf07ea (at 10.8.15.6@o2ib6) [53853.843413] Lustre: Skipped 5 previous similar messages [54026.224211] LustreError: 86796:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 552960 GRANT, real grant 0 [54026.238522] LustreError: 86796:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 55 previous similar messages [54026.328565] Lustre: fir-OST0027: Connection restored to (at 10.8.21.24@o2ib6) [54026.335894] Lustre: Skipped 5 previous similar messages [54052.766496] Lustre: fir-OST0025: Connection restored to (at 10.8.17.15@o2ib6) [54052.773781] Lustre: Skipped 5 previous similar messages [54079.834277] Lustre: fir-OST0029: Connection restored to 834edbb7-1073-058c-c5af-7281bda3b502 (at 10.8.17.17@o2ib6) [54079.844740] Lustre: Skipped 17 previous similar messages [54127.999086] Lustre: fir-OST0024: Connection restored to (at 10.8.17.15@o2ib6) [54128.006323] Lustre: Skipped 29 previous similar messages [54153.385177] LNetError: 72382:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [54153.397524] LNetError: 72382:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 17 previous similar messages [54227.248147] Lustre: fir-OST0025: Connection restored to dc489b81-8258-354a-1cb8-0896baf24eea (at 10.8.12.24@o2ib6) [54227.258602] Lustre: Skipped 63 previous similar messages [54462.532639] Lustre: fir-OST0027: Connection restored to (at 10.9.108.60@o2ib4) [54462.540020] Lustre: Skipped 22 previous similar messages [54653.279803] LustreError: 12926:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0024: cli 6ea10cfc-48e7-f6e7-b834-4eb6674e3061 claims 3997696 GRANT, real grant 0 [54653.294101] LustreError: 12926:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 50 previous similar messages [54766.697406] LNetError: 72384:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [54766.709858] LNetError: 72384:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 6 previous similar messages [55906.598161] Lustre: fir-OST0027: haven't heard from client f0ba9527-4000-78d5-07ea-44ae00898a99 (at 10.8.15.5@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e8394a5d800, cur 1558800724 expire 1558800574 last 1558800497 [55906.619782] Lustre: Skipped 11 previous similar messages [55937.311388] LustreError: 87192:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0024: cli 6ea10cfc-48e7-f6e7-b834-4eb6674e3061 claims 3862528 GRANT, real grant 0 [55937.325468] LustreError: 87192:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 64 previous similar messages [56174.007860] LustreError: 67760:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0027: cli c429ac87-0af5-acec-8a40-5e6c2e99ccb1 claims 4218880 GRANT, real grant 3969024 [56174.022477] LustreError: 67760:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 4 previous similar messages [56228.988668] LNetError: 72392:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [56229.001004] LNetError: 72392:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 1 previous similar message [56327.760784] LustreError: 86825:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3063808 GRANT, real grant 0 [56327.775022] LustreError: 86825:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 21 previous similar messages [56354.234445] LNetError: 72390:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [56354.246780] LNetError: 72390:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 3 previous similar messages [56355.594943] Lustre: fir-OST002f: haven't heard from client 848f740d-df40-cec0-fa62-b1fb04074945 (at 10.9.105.45@o2ib4) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e7a8f502c00, cur 1558801173 expire 1558801023 last 1558800946 [56355.616919] Lustre: Skipped 11 previous similar messages [56505.343831] LNetError: 72388:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [56505.356168] LNetError: 72388:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 1 previous similar message [56653.267160] LustreError: 87175:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 1105920 GRANT, real grant 0 [56653.281509] LustreError: 87175:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 48 previous similar messages [56842.271780] LNetError: 72383:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [56842.284159] LNetError: 72383:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 6 previous similar messages [57253.410731] LustreError: 67751:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0024: cli 6ea10cfc-48e7-f6e7-b834-4eb6674e3061 claims 438272 GRANT, real grant 0 [57253.424778] LustreError: 67751:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 381 previous similar messages [57448.568331] LNetError: 72385:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [57448.580661] LNetError: 72385:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 26 previous similar messages [57964.115852] LustreError: 86768:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3903488 GRANT, real grant 0 [57964.129973] LustreError: 86768:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 239 previous similar messages [58069.439159] LNetError: 72379:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [58069.451516] LNetError: 72379:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 17 previous similar messages [58566.011230] LustreError: 86768:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 4218880 GRANT, real grant 0 [58566.025411] LustreError: 86768:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 207 previous similar messages [58673.785894] LNetError: 72384:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [58673.798277] LNetError: 72384:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 25 previous similar messages [59168.542843] LustreError: 87519:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 4218880 GRANT, real grant 0 [59168.556953] LustreError: 87519:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 264 previous similar messages [59274.845153] LNetError: 72392:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [59274.857430] LNetError: 72392:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 16 previous similar messages [59791.870119] LustreError: 87942:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 1658880 GRANT, real grant 0 [59791.884391] LustreError: 87942:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 131 previous similar messages [59882.800719] LNetError: 72380:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [59882.813130] LNetError: 72380:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 9 previous similar messages [60398.486950] LustreError: 87685:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 2211840 GRANT, real grant 0 [60398.501112] LustreError: 87685:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 98 previous similar messages [60488.897254] LNetError: 72383:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [60488.909622] LNetError: 72383:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 20 previous similar messages [61005.668973] LustreError: 87509:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002b: cli c429ac87-0af5-acec-8a40-5e6c2e99ccb1 claims 16670720 GRANT, real grant 0 [61005.683326] LustreError: 87509:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 257 previous similar messages [61104.445951] LNetError: 72380:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [61104.458348] LNetError: 72380:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 18 previous similar messages [61606.055045] LustreError: 87596:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0024: cli 6ea10cfc-48e7-f6e7-b834-4eb6674e3061 claims 552960 GRANT, real grant 0 [61606.069192] LustreError: 87596:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 404 previous similar messages [61719.819424] LNetError: 72391:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [61719.831814] LNetError: 72391:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 14 previous similar messages [62206.561726] LustreError: 87378:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 4218880 GRANT, real grant 0 [62206.575929] LustreError: 87378:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 865 previous similar messages [62340.823788] LNetError: 72388:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [62340.836264] LNetError: 72388:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 14 previous similar messages [62437.621952] Lustre: fir-OST002e: haven't heard from client 867c6b81-471e-6c9e-bfa4-db750466d07d (at 10.8.15.7@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e842ffe9c00, cur 1558807255 expire 1558807105 last 1558807028 [62437.643697] Lustre: Skipped 11 previous similar messages [62447.621765] Lustre: fir-OST0027: haven't heard from client 867c6b81-471e-6c9e-bfa4-db750466d07d (at 10.8.15.7@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e9adf333400, cur 1558807265 expire 1558807115 last 1558807038 [62807.121457] LustreError: 75387:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [62807.135665] LustreError: 75387:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 928 previous similar messages [62979.106003] LNetError: 72381:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [62979.118356] LNetError: 72381:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 15 previous similar messages [63408.428426] LustreError: 91039:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [63408.442579] LustreError: 91039:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 674 previous similar messages [63649.505221] LNetError: 72378:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [63649.517603] LNetError: 72378:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 9 previous similar messages [64008.886058] LustreError: 86791:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 4218880 GRANT, real grant 0 [64008.900211] LustreError: 86791:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 258 previous similar messages [64263.879871] LNetError: 72383:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [64263.892173] LNetError: 72383:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 17 previous similar messages [64628.546748] LustreError: 87182:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3313664 GRANT, real grant 0 [64628.560923] LustreError: 87182:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 273 previous similar messages [64884.374821] LNetError: 72378:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [64884.387242] LNetError: 72378:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 14 previous similar messages [65230.018419] LustreError: 75393:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [65230.032574] LustreError: 75393:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 365 previous similar messages [65504.206241] LNetError: 72391:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [65504.218585] LNetError: 72391:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 10 previous similar messages [65837.538230] LustreError: 87179:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [65837.552430] LustreError: 87179:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 194 previous similar messages [66122.110376] LNetError: 72387:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [66122.122680] LNetError: 72387:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 8 previous similar messages [66438.087420] LustreError: 86775:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3743744 GRANT, real grant 0 [66438.101902] LustreError: 86775:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 166 previous similar messages [66834.446307] LNetError: 72386:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [66834.458719] LNetError: 72386:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 7 previous similar messages [67039.006701] LustreError: 87379:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 2760704 GRANT, real grant 0 [67039.020858] LustreError: 87379:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 133 previous similar messages [67420.642416] Lustre: fir-OST002a: haven't heard from client e267eed0-45c3-44be-99a6-206acecf07ea (at 10.8.15.6@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e6c4b370400, cur 1558812238 expire 1558812088 last 1558812011 [67420.664043] Lustre: Skipped 10 previous similar messages [67471.453779] LNetError: 72381:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [67471.466118] LNetError: 72381:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 6 previous similar messages [67646.867009] LustreError: 87591:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 4263936 GRANT, real grant 0 [67646.881156] LustreError: 87591:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 265 previous similar messages [68124.902935] LNetError: 72388:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [68124.915296] LNetError: 72388:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 8 previous similar messages [68251.717454] LustreError: 87198:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 4218880 GRANT, real grant 0 [68251.731630] LustreError: 87198:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 428 previous similar messages [68677.270887] Lustre: fir-OST0026: Client d4242da5-5a9c-4508-f9da-c1e7f36347f4 (at 10.9.114.4@o2ib4) reconnecting [68677.270944] Lustre: fir-OST002d: Connection restored to (at 10.9.114.4@o2ib4) [68677.270953] Lustre: Skipped 6 previous similar messages [68677.293593] Lustre: Skipped 2 previous similar messages [68749.068396] LNetError: 72379:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [68749.080848] LNetError: 72379:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 5 previous similar messages [68858.152186] LustreError: 86790:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4153344 GRANT, real grant 0 [68858.166288] LustreError: 86790:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 403 previous similar messages [69422.433450] LNetError: 72380:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [69422.445859] LNetError: 72380:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 10 previous similar messages [69459.738751] LustreError: 86791:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4190208 GRANT, real grant 0 [69459.753165] LustreError: 86791:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 351 previous similar messages [70048.658943] LNetError: 72386:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [70048.671266] LNetError: 72386:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 9 previous similar messages [70061.493159] LustreError: 86780:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3751936 GRANT, real grant 0 [70061.507286] LustreError: 86780:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 254 previous similar messages [70667.019722] LustreError: 87186:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3756032 GRANT, real grant 0 [70667.033857] LustreError: 87186:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 306 previous similar messages [70674.911769] LNetError: 72383:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [70674.924160] LNetError: 72383:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 5 previous similar messages [71283.417721] LustreError: 31678:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [71283.431840] LustreError: 31678:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 346 previous similar messages [71445.404415] LNetError: 72378:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [71445.416805] LNetError: 72378:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 5 previous similar messages [71885.726040] LustreError: 87511:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0024: cli 6ea10cfc-48e7-f6e7-b834-4eb6674e3061 claims 1892352 GRANT, real grant 0 [71885.740235] LustreError: 87511:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 201 previous similar messages [72072.870119] LNetError: 72383:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [72072.882464] LNetError: 72383:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 6 previous similar messages [72487.427936] LustreError: 87169:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [72487.442076] LustreError: 87169:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 169 previous similar messages [72687.969122] LNetError: 72387:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [72687.981500] LNetError: 72387:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 9 previous similar messages [72850.946151] LustreError: 75297:0:(ldlm_lockd.c:256:expired_lock_main()) ### lock callback timer expired after 100s: evicting client at 10.9.112.3@o2ib4 ns: filter-fir-OST0028_UUID lock: ffff9e8112e03600/0x50506a34a6f84c9c lrc: 3/0,0 mode: PW/PW res: [0xa00000402:0x83d556:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 268435456->8589934591) flags: 0x60000400010020 nid: 10.9.112.3@o2ib4 remote: 0xe219d34994c4aedf expref: 126 pid: 86574 timeout: 72849 lvb_type: 0 [72859.306255] Lustre: fir-OST002f: Connection restored to (at 10.9.112.3@o2ib4) [72859.313503] Lustre: Skipped 9 previous similar messages [73085.672399] Lustre: fir-OST0028: haven't heard from client 507fe63e-2eba-dc91-49a6-94f7b912a620 (at 10.9.112.3@o2ib4) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e97247cb400, cur 1558817903 expire 1558817753 last 1558817676 [73085.694104] Lustre: Skipped 11 previous similar messages [73089.514666] LustreError: 12926:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [73089.528785] LustreError: 12926:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 162 previous similar messages [73490.843463] LNetError: 72385:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [73490.855938] LNetError: 72385:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 9 previous similar messages [73620.432626] LustreError: 87595:0:(ldlm_lib.c:3273:target_bulk_io()) @@@ truncated bulk READ 0(20480) req@ffff9e7adde88850 x1634066933511920/t0(0) o3->b4286a36-07ab-3cea-d672-fe340d951df2@10.8.15.4@o2ib6:154/0 lens 488/440 e 1 to 0 dl 1558818454 ref 1 fl Interpret:/0/0 rc 0/0 [73620.457246] Lustre: fir-OST0029: Bulk IO read error with b4286a36-07ab-3cea-d672-fe340d951df2 (at 10.8.15.4@o2ib6), client will retry: rc -110 [73693.208455] LustreError: 87685:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 4218880 GRANT, real grant 0 [73693.222620] LustreError: 87685:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 259 previous similar messages [73764.675866] Lustre: fir-OST002b: haven't heard from client b4286a36-07ab-3cea-d672-fe340d951df2 (at 10.8.15.4@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e9af559b000, cur 1558818582 expire 1558818432 last 1558818355 [73764.697631] Lustre: Skipped 7 previous similar messages [73765.675874] Lustre: fir-OST002d: haven't heard from client b4286a36-07ab-3cea-d672-fe340d951df2 (at 10.8.15.4@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e7a8e150800, cur 1558818583 expire 1558818433 last 1558818356 [73765.697514] Lustre: Skipped 4 previous similar messages [73768.675927] Lustre: fir-OST0025: haven't heard from client b4286a36-07ab-3cea-d672-fe340d951df2 (at 10.8.15.4@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e7a884f6c00, cur 1558818586 expire 1558818436 last 1558818359 [73783.675898] Lustre: fir-OST0028: haven't heard from client b4286a36-07ab-3cea-d672-fe340d951df2 (at 10.8.15.4@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e7a822b8c00, cur 1558818601 expire 1558818451 last 1558818374 [73795.676366] Lustre: fir-OST0029: haven't heard from client b4286a36-07ab-3cea-d672-fe340d951df2 (at 10.8.15.4@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e7a8ab9e400, cur 1558818613 expire 1558818463 last 1558818386 [73795.697998] Lustre: Skipped 3 previous similar messages [73989.676989] Lustre: fir-OST002f: haven't heard from client 9e0c86e9-d27e-6bee-5d42-522a759c8a69 (at 10.8.9.8@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e83e8607400, cur 1558818807 expire 1558818657 last 1558818580 [74167.116791] LNetError: 72389:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [74167.129070] LNetError: 72389:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 5 previous similar messages [74294.593699] LustreError: 87183:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3842048 GRANT, real grant 0 [74294.607875] LustreError: 87183:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 276 previous similar messages [74835.135284] LNetError: 72387:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [74835.147661] LNetError: 72387:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 8 previous similar messages [74898.188265] LustreError: 67777:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [74898.202355] LustreError: 67777:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 308 previous similar messages [75500.440547] LustreError: 87186:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 4218880 GRANT, real grant 0 [75500.454685] LustreError: 87186:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 134 previous similar messages [75505.654991] LNetError: 72389:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [75505.667359] LNetError: 72389:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 7 previous similar messages [76118.464150] LustreError: 87197:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3317760 GRANT, real grant 0 [76118.478283] LustreError: 87197:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 312 previous similar messages [76247.414631] LNetError: 72380:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [76247.426938] LNetError: 72380:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 4 previous similar messages [76720.450560] LustreError: 67769:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 1077248 GRANT, real grant 0 [76720.464830] LustreError: 67769:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 278 previous similar messages [76896.357757] LNetError: 72382:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [76896.370138] LNetError: 72382:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 8 previous similar messages [77321.409123] LustreError: 86832:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 1093632 GRANT, real grant 0 [77321.423375] LustreError: 86832:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 198 previous similar messages [77553.227072] LNetError: 72379:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [77553.239424] LNetError: 72379:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 8 previous similar messages [77921.511747] LustreError: 67754:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [77921.525905] LustreError: 67754:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 221 previous similar messages [78237.733916] LNetError: 72391:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [78237.746237] LNetError: 72391:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 7 previous similar messages [78523.792379] LustreError: 12906:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0024: cli 6ea10cfc-48e7-f6e7-b834-4eb6674e3061 claims 4292608 GRANT, real grant 0 [78523.806514] LustreError: 12906:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 245 previous similar messages [78980.320336] LNetError: 72387:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [78980.332645] LNetError: 72387:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 11 previous similar messages [78994.334044] LNetError: 72376:0:(o2iblnd_cb.c:3324:kiblnd_check_txs_locked()) Timed out tx: active_txs, 0 seconds [78994.344212] LNetError: 72376:0:(o2iblnd_cb.c:3399:kiblnd_check_conns()) Timed out RDMA with 10.0.10.209@o2ib7 (0): c: 0, oc: 1, rc: 0 [78994.357718] LustreError: 72376:0:(events.c:450:server_bulk_callback()) event type 5, status -103, desc ffff9e5b07451c00 [78994.368525] LustreError: 72376:0:(events.c:450:server_bulk_callback()) event type 5, status -103, desc ffff9e75128f3e00 [78994.379325] LustreError: 72376:0:(events.c:450:server_bulk_callback()) event type 5, status -103, desc ffff9e5b064b1a00 [78994.390190] LustreError: 72376:0:(events.c:450:server_bulk_callback()) event type 5, status -103, desc ffff9e5b07451200 [78994.401028] LustreError: 72376:0:(events.c:450:server_bulk_callback()) event type 5, status -103, desc ffff9e864748a200 [78994.413915] LustreError: 72376:0:(events.c:450:server_bulk_callback()) event type 5, status -103, desc ffff9e5ad9e6dc00 [78994.424742] LustreError: 72376:0:(events.c:450:server_bulk_callback()) event type 5, status -103, desc ffff9e709ba43a00 [78994.435577] LustreError: 72376:0:(events.c:450:server_bulk_callback()) event type 5, status -103, desc ffff9e7d1920c600 [78994.446430] LustreError: 72376:0:(events.c:450:server_bulk_callback()) event type 5, status -103, desc ffff9e8759f28800 [78994.457292] LustreError: 72376:0:(events.c:450:server_bulk_callback()) event type 5, status -103, desc ffff9e5ad0b57600 [78994.468209] LustreError: 72376:0:(events.c:450:server_bulk_callback()) event type 5, status -103, desc ffff9e5ad0b57600 [78995.086049] Lustre: 86594:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1558823805/real 1558823805] req@ffff9e7ed5999800 x1634468797386816/t0(0) o106->fir-OST0026@10.9.106.54@o2ib4:15/16 lens 296/280 e 0 to 1 dl 1558823812 ref 1 fl Rpc:X/0/ffffffff rc 0/-1 [78995.086051] Lustre: 86604:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1558823805/real 1558823805] req@ffff9e7dea444b00 x1634468797386848/t0(0) o106->fir-OST0024@10.9.106.54@o2ib4:15/16 lens 296/280 e 0 to 1 dl 1558823812 ref 1 fl Rpc:X/0/ffffffff rc 0/-1 [78995.086055] Lustre: 86604:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 211 previous similar messages [78995.150939] Lustre: 86594:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 1 previous similar message [78995.334052] LNetError: 72376:0:(o2iblnd_cb.c:3324:kiblnd_check_txs_locked()) Timed out tx: tx_queue, 0 seconds [78995.344048] LNetError: 72376:0:(o2iblnd_cb.c:3324:kiblnd_check_txs_locked()) Skipped 1 previous similar message [78995.354129] LNetError: 72376:0:(o2iblnd_cb.c:3399:kiblnd_check_conns()) Timed out RDMA with 10.0.10.210@o2ib7 (0): c: 0, oc: 2, rc: 4 [78995.366110] LNetError: 72376:0:(o2iblnd_cb.c:3399:kiblnd_check_conns()) Skipped 1 previous similar message [78995.382009] LustreError: 72376:0:(events.c:450:server_bulk_callback()) event type 5, status -103, desc ffff9e8759f2c000 [78995.392851] LustreError: 72376:0:(events.c:450:server_bulk_callback()) event type 5, status -103, desc ffff9e8759f2c000 [78995.403696] LustreError: 72376:0:(events.c:450:server_bulk_callback()) event type 5, status -103, desc ffff9e5b07451200 [78995.414522] LustreError: 72376:0:(events.c:450:server_bulk_callback()) event type 5, status -103, desc ffff9e75128f3a00 [78997.305657] Lustre: fir-OST002f: Client f5f74966-59a2-6619-dc33-28e321e9f975 (at 10.9.108.31@o2ib4) reconnecting [78997.316008] Lustre: fir-OST002f: Connection restored to (at 10.9.108.31@o2ib4) [79000.102815] Lustre: fir-OST0025: Client f5f74966-59a2-6619-dc33-28e321e9f975 (at 10.9.108.31@o2ib4) reconnecting [79000.102843] Lustre: fir-OST002d: Connection restored to (at 10.9.108.31@o2ib4) [79000.102845] Lustre: Skipped 1 previous similar message [79000.125581] Lustre: Skipped 2 previous similar messages [79011.219116] Lustre: 86474:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1558823821/real 1558823821] req@ffff9e87b110b600 x1634468797399392/t0(0) o106->fir-OST0026@10.9.106.54@o2ib4:15/16 lens 296/280 e 0 to 1 dl 1558823828 ref 1 fl Rpc:X/2/ffffffff rc 0/-1 [79011.246488] Lustre: 86474:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 310 previous similar messages [79033.048717] Lustre: fir-OST002a: Client 4dbe6048-7f70-8f0f-700e-3b78f70d5297 (at 10.9.108.12@o2ib4) reconnecting [79033.058913] Lustre: fir-OST002a: Connection restored to (at 10.9.108.12@o2ib4) [79033.066284] Lustre: Skipped 1 previous similar message [79033.324206] LustreError: 87186:0:(ldlm_lib.c:3258:target_bulk_io()) @@@ Reconnect on bulk READ req@ffff9e94df514450 x1634066676974176/t0(0) o3->057ec416-808c-71c9-81c2-afdc1ab01557@10.9.113.11@o2ib4:289/0 lens 488/440 e 1 to 0 dl 1558823874 ref 1 fl Interpret:/0/0 rc 0/0 [79033.348578] Lustre: fir-OST002a: Bulk IO read error with 057ec416-808c-71c9-81c2-afdc1ab01557 (at 10.9.113.11@o2ib4), client will retry: rc -110 [79033.876216] LustreError: 764:0:(ldlm_lib.c:3258:target_bulk_io()) @@@ Reconnect on bulk READ req@ffff9e86d4a02050 x1634066676974016/t0(0) o3->057ec416-808c-71c9-81c2-afdc1ab01557@10.9.113.11@o2ib4:289/0 lens 488/440 e 1 to 0 dl 1558823874 ref 1 fl Interpret:/0/0 rc 0/0 [79033.900130] LustreError: 764:0:(ldlm_lib.c:3258:target_bulk_io()) Skipped 2 previous similar messages [79033.909712] Lustre: fir-OST002a: Bulk IO read error with 057ec416-808c-71c9-81c2-afdc1ab01557 (at 10.9.113.11@o2ib4), client will retry: rc -110 [79033.922672] Lustre: Skipped 2 previous similar messages [79037.825968] Lustre: fir-OST0028: Client 603ef852-66df-b745-900b-b12995ddbb59 (at 10.9.104.51@o2ib4) reconnecting [79037.831530] Lustre: fir-OST002f: Connection restored to (at 10.9.105.5@o2ib4) [79037.831532] Lustre: Skipped 4 previous similar messages [79037.848588] Lustre: Skipped 6 previous similar messages [79043.871258] Lustre: 87126:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1558823854/real 1558823854] req@ffff9e758d1fce00 x1634468797392272/t0(0) o106->fir-OST0026@10.9.106.54@o2ib4:15/16 lens 296/280 e 0 to 1 dl 1558823861 ref 1 fl Rpc:X/2/ffffffff rc 0/-1 [79043.898701] Lustre: 87126:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 667 previous similar messages [79045.699181] LustreError: 87568:0:(ldlm_lib.c:3264:target_bulk_io()) @@@ network error on bulk READ req@ffff9e5ae9226450 x1634481445221344/t0(0) o3->ab0e6c13-1da8-4bda-f184-551837378ab5@10.9.115.13@o2ib4:289/0 lens 488/440 e 1 to 0 dl 1558823874 ref 1 fl Interpret:/0/0 rc 0/0 [79045.699250] Lustre: fir-OST0026: Bulk IO read error with aea5ba3f-2c7e-6072-5c51-f17a66d3e2f1 (at 10.9.115.1@o2ib4), client will retry: rc -110 [79045.705771] LustreError: 87173:0:(ldlm_lib.c:3207:target_bulk_io()) @@@ bulk READ failed: rc -107 req@ffff9e771d6f5450 x1633647257125936/t0(0) o3->6e48472f-542d-f444-2879-49b8d614290d@10.9.108.8@o2ib4:297/0 lens 488/440 e 1 to 0 dl 1558823882 ref 1 fl Interpret:/0/0 rc 0/0 [79045.760857] LustreError: 87568:0:(ldlm_lib.c:3264:target_bulk_io()) Skipped 7 previous similar messages [79058.023341] Lustre: fir-OST002a: Client a012f954-274c-2ad9-91a0-3bd8760ed55b (at 10.9.114.8@o2ib4) reconnecting [79058.033446] Lustre: Skipped 35 previous similar messages [79058.038792] Lustre: fir-OST002a: Connection restored to (at 10.9.114.8@o2ib4) [79058.046018] Lustre: Skipped 37 previous similar messages [79099.321574] Lustre: fir-OST002a: Client ab0e6c13-1da8-4bda-f184-551837378ab5 (at 10.9.115.13@o2ib4) reconnecting [79099.331748] Lustre: Skipped 5 previous similar messages [79099.337002] Lustre: fir-OST002a: Connection restored to (at 10.9.115.13@o2ib4) [79099.344350] Lustre: Skipped 5 previous similar messages [79107.871613] Lustre: 86789:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1558823918/real 1558823918] req@ffff9e7780910f00 x1634468797387392/t0(0) o106->fir-OST0024@10.9.106.54@o2ib4:15/16 lens 296/280 e 0 to 1 dl 1558823925 ref 1 fl Rpc:X/2/ffffffff rc 0/-1 [79107.898961] Lustre: 86789:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 1351 previous similar messages [79124.302462] LustreError: 12906:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 4218880 GRANT, real grant 0 [79124.316534] LustreError: 12906:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 405 previous similar messages [79188.374967] LNet: Service thread pid 87116 was inactive for 200.28s. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes: [79188.391912] Pid: 87116, comm: ll_ost01_080 3.10.0-957.1.3.el7_lustre.x86_64 #1 SMP Fri Dec 7 14:50:35 PST 2018 [79188.401953] Call Trace: [79188.404421] [] ptlrpc_set_wait+0x500/0x8d0 [ptlrpc] [79188.411029] [] ldlm_run_ast_work+0xd5/0x3a0 [ptlrpc] [79188.417704] [] ldlm_glimpse_locks+0x3b/0x100 [ptlrpc] [79188.424479] [] ofd_intent_policy+0x69b/0x920 [ofd] [79188.430963] [] ldlm_lock_enqueue+0x366/0xa60 [ptlrpc] [79188.437723] [] ldlm_handle_enqueue0+0xa47/0x15a0 [ptlrpc] [79188.444838] [] tgt_enqueue+0x62/0x210 [ptlrpc] [79188.451018] [] tgt_request_handle+0xaea/0x1580 [ptlrpc] [79188.457959] [] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc] [79188.465706] [] ptlrpc_main+0xafc/0x1fc0 [ptlrpc] [79188.472044] [] kthread+0xd1/0xe0 [79188.476978] [] ret_from_fork_nospec_begin+0xe/0x21 [79188.483455] [] 0xffffffffffffffff [79188.488476] LustreError: dumping log to /tmp/lustre-log.1558824005.87116 [79188.909533] LNet: Service thread pid 86837 was inactive for 200.46s. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes: [79188.926493] Pid: 86837, comm: ll_ost01_033 3.10.0-957.1.3.el7_lustre.x86_64 #1 SMP Fri Dec 7 14:50:35 PST 2018 [79188.936506] Call Trace: [79188.938974] [] ptlrpc_set_wait+0x500/0x8d0 [ptlrpc] [79188.945608] [] ldlm_run_ast_work+0xd5/0x3a0 [ptlrpc] [79188.952284] [] ldlm_glimpse_locks+0x3b/0x100 [ptlrpc] [79188.959061] [] ofd_intent_policy+0x69b/0x920 [ofd] [79188.965534] [] ldlm_lock_enqueue+0x366/0xa60 [ptlrpc] [79188.972309] [] ldlm_handle_enqueue0+0xa47/0x15a0 [ptlrpc] [79188.979418] [] tgt_enqueue+0x62/0x210 [ptlrpc] [79188.985612] [] tgt_request_handle+0xaea/0x1580 [ptlrpc] [79188.992558] [] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc] [79189.000279] [] ptlrpc_main+0xafc/0x1fc0 [ptlrpc] [79189.006615] [] kthread+0xd1/0xe0 [79189.011543] [] ret_from_fork_nospec_begin+0xe/0x21 [79189.018052] [] 0xffffffffffffffff [79189.023093] Pid: 87157, comm: ll_ost03_102 3.10.0-957.1.3.el7_lustre.x86_64 #1 SMP Fri Dec 7 14:50:35 PST 2018 [79189.033118] Call Trace: [79189.035575] [] ptlrpc_set_wait+0x500/0x8d0 [ptlrpc] [79189.042175] [] ldlm_run_ast_work+0xd5/0x3a0 [ptlrpc] [79189.048866] [] ldlm_glimpse_locks+0x3b/0x100 [ptlrpc] [79189.055626] [] ofd_intent_policy+0x69b/0x920 [ofd] [79189.062100] [] ldlm_lock_enqueue+0x366/0xa60 [ptlrpc] [79189.068895] [] ldlm_handle_enqueue0+0xa47/0x15a0 [ptlrpc] [79189.076016] [] tgt_enqueue+0x62/0x210 [ptlrpc] [79189.082203] [] tgt_request_handle+0xaea/0x1580 [ptlrpc] [79189.089164] [] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc] [79189.096901] [] ptlrpc_main+0xafc/0x1fc0 [ptlrpc] [79189.103245] [] kthread+0xd1/0xe0 [79189.108177] [] ret_from_fork_nospec_begin+0xe/0x21 [79189.114675] [] 0xffffffffffffffff [79189.119719] Pid: 86479, comm: ll_ost02_011 3.10.0-957.1.3.el7_lustre.x86_64 #1 SMP Fri Dec 7 14:50:35 PST 2018 [79189.129739] Call Trace: [79189.132202] [] ptlrpc_set_wait+0x500/0x8d0 [ptlrpc] [79189.138791] [] ldlm_run_ast_work+0xd5/0x3a0 [ptlrpc] [79189.145482] [] ldlm_glimpse_locks+0x3b/0x100 [ptlrpc] [79189.152261] [] ofd_intent_policy+0x69b/0x920 [ofd] [79189.158748] [] ldlm_lock_enqueue+0x366/0xa60 [ptlrpc] [79189.165523] [] ldlm_handle_enqueue0+0xa47/0x15a0 [ptlrpc] [79189.172636] [] tgt_enqueue+0x62/0x210 [ptlrpc] [79189.178817] [] tgt_request_handle+0xaea/0x1580 [ptlrpc] [79189.185755] [] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc] [79189.193470] [] ptlrpc_main+0xafc/0x1fc0 [ptlrpc] [79189.199840] [] kthread+0xd1/0xe0 [79189.204745] [] ret_from_fork_nospec_begin+0xe/0x21 [79189.211227] [] 0xffffffffffffffff [79189.216242] Pid: 86649, comm: ll_ost02_072 3.10.0-957.1.3.el7_lustre.x86_64 #1 SMP Fri Dec 7 14:50:35 PST 2018 [79189.226261] Call Trace: [79189.228724] [] ptlrpc_set_wait+0x500/0x8d0 [ptlrpc] [79189.235313] [] ldlm_run_ast_work+0xd5/0x3a0 [ptlrpc] [79189.241979] [] ldlm_glimpse_locks+0x3b/0x100 [ptlrpc] [79189.248772] [] ofd_intent_policy+0x69b/0x920 [ofd] [79189.255247] [] ldlm_lock_enqueue+0x366/0xa60 [ptlrpc] [79189.262007] [] ldlm_handle_enqueue0+0xa47/0x15a0 [ptlrpc] [79189.269134] [] tgt_enqueue+0x62/0x210 [ptlrpc] [79189.275306] [] tgt_request_handle+0xaea/0x1580 [ptlrpc] [79189.282263] [] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc] [79189.289999] [] ptlrpc_main+0xafc/0x1fc0 [ptlrpc] [79189.296351] [] kthread+0xd1/0xe0 [79189.301268] [] ret_from_fork_nospec_begin+0xe/0x21 [79189.307741] [] 0xffffffffffffffff [79189.312780] LNet: Service thread pid 86725 was inactive for 200.44s. Watchdog stack traces are limited to 3 per 300 seconds, skipping this one. [79189.910985] LNet: Service thread pid 86809 was inactive for 200.54s. Watchdog stack traces are limited to 3 per 300 seconds, skipping this one. [79189.923900] LNet: Skipped 22 previous similar messages [79189.929049] LustreError: dumping log to /tmp/lustre-log.1558824007.86809 [79190.934985] LNet: Service thread pid 86805 was inactive for 200.65s. Watchdog stack traces are limited to 3 per 300 seconds, skipping this one. [79190.947851] LNet: Skipped 15 previous similar messages [79190.952997] LustreError: dumping log to /tmp/lustre-log.1558824008.86805 [79191.958983] LustreError: dumping log to /tmp/lustre-log.1558824009.87121 [79192.982996] LNet: Service thread pid 86744 was inactive for 200.06s. Watchdog stack traces are limited to 3 per 300 seconds, skipping this one. [79192.995928] LNet: Skipped 23 previous similar messages [79193.001078] LustreError: dumping log to /tmp/lustre-log.1558824010.86744 [79194.007006] LustreError: dumping log to /tmp/lustre-log.1558824011.86820 [79195.030998] LustreError: dumping log to /tmp/lustre-log.1558824012.87097 [79196.567011] LustreError: dumping log to /tmp/lustre-log.1558824013.86676 [79197.079004] LNet: Service thread pid 86792 was inactive for 200.20s. Watchdog stack traces are limited to 3 per 300 seconds, skipping this one. [79197.091890] LNet: Skipped 55 previous similar messages [79197.097039] LustreError: dumping log to /tmp/lustre-log.1558824014.86792 [79198.103014] LustreError: dumping log to /tmp/lustre-log.1558824015.87136 [79199.127014] LustreError: dumping log to /tmp/lustre-log.1558824016.75381 [79200.151020] LustreError: dumping log to /tmp/lustre-log.1558824017.86836 [79213.701427] Lustre: fir-OST0025: haven't heard from client 331501bb-cfe1-c596-612e-0a33cb1f9ac1 (at 10.9.106.54@o2ib4) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e7a88b99400, cur 1558824031 expire 1558823881 last 1558823804 [79213.723236] Lustre: Skipped 11 previous similar messages [79213.728799] LNet: Service thread pid 86630 completed after 216.85s. This indicates the system was overloaded (too many service threads, or there were not enough hardware resources). [79213.744964] LNet: Skipped 148 previous similar messages [79213.755965] LustreError: 75416:0:(client.c:1175:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff9e957db9da00 x1634468797654016/t0(0) o106->fir-OST0024@10.9.106.54@o2ib4:15/16 lens 296/280 e 0 to 0 dl 0 ref 1 fl Rpc:/0/ffffffff rc 0/-1 [79213.777087] LustreError: 75416:0:(client.c:1175:ptlrpc_import_delay_req()) Skipped 3 previous similar messages [79729.038344] LustreError: 67774:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3317760 GRANT, real grant 0 [79729.052487] LustreError: 67774:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 415 previous similar messages [79762.655590] Lustre: fir-OST002b: Client 7ae46df0-95ff-edbe-35f2-1ea841efe69a (at 10.9.0.81@o2ib4) reconnecting [79762.665617] Lustre: fir-OST002b: Connection restored to (at 10.9.0.81@o2ib4) [79900.748733] LNetError: 72386:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [79900.761007] LNetError: 72386:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 3 previous similar messages [80331.700203] LustreError: 67779:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 811008 GRANT, real grant 0 [80331.714274] LustreError: 67779:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 330 previous similar messages [80545.832807] LNetError: 72386:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [80545.845108] LNetError: 72386:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 5 previous similar messages [80933.828644] Lustre: fir-OST0025: Connection restored to (at 10.9.106.54@o2ib4) [80933.835977] Lustre: Skipped 5 previous similar messages [80933.922680] LustreError: 67751:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4272128 GRANT, real grant 0 [80933.936774] LustreError: 67751:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 194 previous similar messages [81010.383081] Lustre: fir-OST0028: Connection restored to (at 10.9.106.54@o2ib4) [81010.390415] Lustre: Skipped 5 previous similar messages [81305.844331] LNetError: 72384:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [81305.856682] LNetError: 72384:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 6 previous similar messages [81537.984053] LustreError: 87590:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [81537.998184] LustreError: 87590:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 304 previous similar messages [81588.987341] LustreError: 75297:0:(ldlm_lockd.c:256:expired_lock_main()) ### lock callback timer expired after 100s: evicting client at 10.9.112.3@o2ib4 ns: filter-fir-OST002b_UUID lock: ffff9e87c25b7740/0x50506a345c0d5e36 lrc: 3/0,0 mode: PR/PR res: [0x700000400:0x82d7fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 17179869184->18446744073709551615) flags: 0x60000400010020 nid: 10.9.112.3@o2ib4 remote: 0xe219d34994c3aaf8 expref: 129 pid: 86517 timeout: 81587 lvb_type: 1 [81589.030207] LustreError: 75297:0:(ldlm_lockd.c:256:expired_lock_main()) Skipped 7 previous similar messages [81589.040424] LustreError: 86560:0:(client.c:1175:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff9e82eb2f3600 x1634468802918368/t0(0) o104->fir-OST002b@10.9.112.3@o2ib4:15/16 lens 296/224 e 0 to 0 dl 0 ref 1 fl Rpc:/0/ffffffff rc 0/-1 [81589.061500] LustreError: 86560:0:(client.c:1175:ptlrpc_import_delay_req()) Skipped 13 previous similar messages [81616.961744] Lustre: fir-OST0029: Connection restored to (at 10.9.112.3@o2ib4) [81616.968994] Lustre: Skipped 2 previous similar messages [81843.713553] Lustre: fir-OST0029: haven't heard from client 507fe63e-2eba-dc91-49a6-94f7b912a620 (at 10.9.112.3@o2ib4) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e8f1ac31000, cur 1558826661 expire 1558826511 last 1558826434 [81843.735301] Lustre: Skipped 11 previous similar messages [81952.269135] LNetError: 72378:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [81952.281479] LNetError: 72378:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 4 previous similar messages [82142.375071] LustreError: 87186:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [82142.389169] LustreError: 87186:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 312 previous similar messages [82744.921800] LustreError: 87188:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 2183168 GRANT, real grant 0 [82744.935912] LustreError: 87188:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 222 previous similar messages [82843.288850] LNetError: 72379:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [82843.301197] LNetError: 72379:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 7 previous similar messages [83356.239323] LustreError: 49692:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4231168 GRANT, real grant 0 [83356.253404] LustreError: 49692:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 152 previous similar messages [83593.656413] LNetError: 72386:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [83593.668722] LNetError: 72386:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 8 previous similar messages [83958.046605] LustreError: 75392:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [83958.060743] LustreError: 75392:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 220 previous similar messages [84242.649610] LNetError: 72383:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [84242.661904] LNetError: 72383:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 15 previous similar messages [84562.523765] LustreError: 67752:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3764224 GRANT, real grant 0 [84562.537879] LustreError: 67752:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 311 previous similar messages [84854.724226] LNetError: 72380:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [84854.736518] LNetError: 72380:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 4 previous similar messages [85163.292516] LustreError: 87194:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3256320 GRANT, real grant 0 [85163.306607] LustreError: 87194:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 278 previous similar messages [85612.176295] LNetError: 72385:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [85612.188576] LNetError: 72385:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 4 previous similar messages [85764.095859] LustreError: 86855:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 4218880 GRANT, real grant 0 [85764.110007] LustreError: 86855:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 535 previous similar messages [85879.733804] Lustre: fir-OST0027: haven't heard from client ae5ba2ac-70f5-4893-84e2-16bb34569e9b (at 10.8.23.14@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e77f6e4d800, cur 1558830697 expire 1558830547 last 1558830470 [85879.755510] Lustre: Skipped 3 previous similar messages [85880.733814] Lustre: fir-OST002f: haven't heard from client ae5ba2ac-70f5-4893-84e2-16bb34569e9b (at 10.8.23.14@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e6e9a3d9800, cur 1558830698 expire 1558830548 last 1558830471 [85880.755570] Lustre: Skipped 4 previous similar messages [86379.402167] LustreError: 87368:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [86379.416264] LustreError: 87368:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 164 previous similar messages [86693.906471] LNetError: 72388:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [86693.918771] LNetError: 72388:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 7 previous similar messages [86979.566665] LustreError: 87381:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 4218880 GRANT, real grant 0 [86979.580788] LustreError: 87381:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 223 previous similar messages [87314.064493] LNetError: 72381:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [87314.076784] LNetError: 72381:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 3 previous similar messages [87581.241388] LustreError: 87687:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 4218880 GRANT, real grant 0 [87581.255762] LustreError: 87687:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 488 previous similar messages [87617.637403] Lustre: fir-OST0029: Connection restored to (at 10.8.23.14@o2ib6) [87617.644675] Lustre: Skipped 5 previous similar messages [87692.804441] Lustre: fir-OST002c: Connection restored to (at 10.8.23.14@o2ib6) [87692.811679] Lustre: Skipped 6 previous similar messages [87971.341945] LNetError: 72389:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [87971.354217] LNetError: 72389:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 6 previous similar messages [88188.123781] LustreError: 67779:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [88188.137981] LustreError: 67779:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 227 previous similar messages [88792.646467] LustreError: 87509:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [88792.660635] LustreError: 87509:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 179 previous similar messages [88806.200267] LNetError: 72385:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [88806.212612] LNetError: 72385:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 3 previous similar messages [89393.329907] LustreError: 87593:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [89393.344051] LustreError: 87593:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 276 previous similar messages [89411.430675] LNetError: 72381:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [89411.442973] LNetError: 72381:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 7 previous similar messages [89993.950604] LustreError: 86838:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3837952 GRANT, real grant 0 [89993.964731] LustreError: 86838:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 397 previous similar messages [90067.430677] LNetError: 72387:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [90067.442945] LNetError: 72387:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 7 previous similar messages [90599.757282] LustreError: 86829:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3977216 GRANT, real grant 0 [90599.771396] LustreError: 86829:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 410 previous similar messages [90801.374533] LNetError: 72381:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [90801.386835] LNetError: 72381:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 1 previous similar message [91203.132801] LustreError: 1545:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3911680 GRANT, real grant 0 [91203.146928] LustreError: 1545:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 419 previous similar messages [91554.474800] LNetError: 72379:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [91554.487065] LNetError: 72379:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 3 previous similar messages [91805.113644] LustreError: 67769:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 4390912 GRANT, real grant 0 [91805.127756] LustreError: 67769:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 316 previous similar messages [92216.801257] LNetError: 72380:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [92216.813581] LNetError: 72380:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 2 previous similar messages [92407.167411] LustreError: 87513:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [92407.181550] LustreError: 87513:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 276 previous similar messages [93008.885927] LustreError: 86771:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 4218880 GRANT, real grant 0 [93008.900035] LustreError: 86771:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 401 previous similar messages [93049.808253] LNetError: 72386:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [93049.820537] LNetError: 72386:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 3 previous similar messages [93240.570552] Lustre: fir-OST002d: Connection restored to (at 10.9.112.3@o2ib4) [93240.577792] Lustre: Skipped 10 previous similar messages [93609.987833] LustreError: 87183:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3870720 GRANT, real grant 0 [93610.001939] LustreError: 87183:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 379 previous similar messages [94211.536300] LustreError: 31679:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [94211.550470] LustreError: 31679:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 298 previous similar messages [94359.931660] LNetError: 72388:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [94359.943932] LNetError: 72388:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 3 previous similar messages [94576.879412] LNetError: 72386:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [94812.805882] LustreError: 87378:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 552960 GRANT, real grant 0 [94812.819931] LustreError: 87378:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 340 previous similar messages [95125.136454] LNetError: 72387:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [95413.598791] LustreError: 86780:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [95413.612896] LustreError: 86780:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 333 previous similar messages [95436.262615] LNetError: 72388:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [95436.274890] LNetError: 72388:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 2 previous similar messages [96018.070784] LustreError: 87509:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3883008 GRANT, real grant 0 [96018.084997] LustreError: 87509:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 316 previous similar messages [96532.784183] Lustre: fir-OST0024: haven't heard from client 16d59ace-f762-bc77-4ee6-c902beb7129b (at 10.8.26.4@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e6adc234800, cur 1558841350 expire 1558841200 last 1558841123 [96532.805799] Lustre: Skipped 6 previous similar messages [96567.592208] LNetError: 72389:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [96567.604483] LNetError: 72389:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 2 previous similar messages [96621.155783] LustreError: 49694:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [96621.169859] LustreError: 49694:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 288 previous similar messages [97225.463884] LustreError: 87371:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3977216 GRANT, real grant 0 [97225.477990] LustreError: 87371:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 311 previous similar messages [97366.426051] LNetError: 72391:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [97366.438316] LNetError: 72391:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 4 previous similar messages [97832.296463] LustreError: 87373:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3952640 GRANT, real grant 0 [97832.310587] LustreError: 87373:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 280 previous similar messages [98004.717652] LNetError: 72383:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [98004.729919] LNetError: 72383:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 1 previous similar message [98440.371569] LustreError: 49692:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [98440.385644] LustreError: 49692:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 400 previous similar messages [98441.531493] Lustre: fir-OST0026: Client 0f8f808f-b03b-81e6-e30e-46ff547f2e45 (at 10.9.113.3@o2ib4) reconnecting [98441.542360] Lustre: fir-OST0026: Connection restored to (at 10.9.113.3@o2ib4) [98505.978701] Lustre: fir-OST002c: Client 0f8f808f-b03b-81e6-e30e-46ff547f2e45 (at 10.9.113.3@o2ib4) reconnecting [98505.988834] Lustre: fir-OST002c: Connection restored to (at 10.9.113.3@o2ib4) [98512.932590] Lustre: fir-OST002a: Client 0f8f808f-b03b-81e6-e30e-46ff547f2e45 (at 10.9.113.3@o2ib4) reconnecting [98512.942710] Lustre: Skipped 1 previous similar message [98512.948659] Lustre: fir-OST002a: Connection restored to (at 10.9.113.3@o2ib4) [98512.955912] Lustre: Skipped 1 previous similar message [98515.242527] Lustre: fir-OST0028: Client 0f8f808f-b03b-81e6-e30e-46ff547f2e45 (at 10.9.113.3@o2ib4) reconnecting [98515.252766] Lustre: fir-OST0028: Connection restored to (at 10.9.113.3@o2ib4) [98524.718216] Lustre: fir-OST0029: Client 0f8f808f-b03b-81e6-e30e-46ff547f2e45 (at 10.9.113.3@o2ib4) reconnecting [98524.728388] Lustre: fir-OST0029: Connection restored to (at 10.9.113.3@o2ib4) [98554.795782] Lustre: fir-OST0027: Client 0f8f808f-b03b-81e6-e30e-46ff547f2e45 (at 10.9.113.3@o2ib4) reconnecting [98554.805914] Lustre: Skipped 1 previous similar message [98554.811147] Lustre: fir-OST0027: Connection restored to (at 10.9.113.3@o2ib4) [98554.818401] Lustre: Skipped 1 previous similar message [98578.216681] Lustre: fir-OST0026: Client 0f8f808f-b03b-81e6-e30e-46ff547f2e45 (at 10.9.113.3@o2ib4) reconnecting [98578.227406] Lustre: fir-OST0026: Connection restored to (at 10.9.113.3@o2ib4) [98578.234664] Lustre: Skipped 6 previous similar messages [98622.198552] Lustre: fir-OST0024: Client 0f8f808f-b03b-81e6-e30e-46ff547f2e45 (at 10.9.113.3@o2ib4) reconnecting [98622.208660] Lustre: Skipped 1 previous similar message [98622.213864] Lustre: fir-OST0024: Connection restored to (at 10.9.113.3@o2ib4) [98622.221102] Lustre: Skipped 1 previous similar message [98650.300908] LNetError: 72384:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [98650.313196] LNetError: 72384:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 4 previous similar messages [98696.210455] Lustre: fir-OST0024: Client 0f8f808f-b03b-81e6-e30e-46ff547f2e45 (at 10.9.113.3@o2ib4) reconnecting [98696.210597] Lustre: fir-OST002a: Connection restored to (at 10.9.113.3@o2ib4) [98696.210599] Lustre: Skipped 17 previous similar messages [98696.233126] Lustre: Skipped 12 previous similar messages [98937.571655] Lustre: fir-OST0025: Connection restored to (at 10.8.21.24@o2ib6) [98937.578964] Lustre: Skipped 6 previous similar messages [99043.201971] LustreError: 87526:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 4276224 GRANT, real grant 0 [99043.216080] LustreError: 87526:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 467 previous similar messages [99181.071077] LustreError: 75297:0:(ldlm_lockd.c:256:expired_lock_main()) ### lock callback timer expired after 100s: evicting client at 10.9.113.3@o2ib4 ns: filter-fir-OST0025_UUID lock: ffff9e70f44a5100/0x50506a3c34ed84e1 lrc: 3/0,0 mode: PR/PR res: [0x373786:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 131072->16777215) flags: 0x60000400000020 nid: 10.9.113.3@o2ib4 remote: 0xf46aef7221c527ec expref: 10 pid: 86636 timeout: 99179 lvb_type: 1 [99181.111544] LustreError: 75297:0:(ldlm_lockd.c:256:expired_lock_main()) Skipped 7 previous similar messages [99218.066821] Lustre: fir-OST0025: Connection restored to (at 10.9.113.3@o2ib4) [99218.074110] Lustre: Skipped 6 previous similar messages [99290.486145] LNetError: 72392:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [99290.498415] LNetError: 72392:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 4 previous similar messages [99444.796431] Lustre: fir-OST0025: haven't heard from client 0f8f808f-b03b-81e6-e30e-46ff547f2e45 (at 10.9.113.3@o2ib4) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e8c3c945800, cur 1558844262 expire 1558844112 last 1558844035 [99444.818145] Lustre: Skipped 11 previous similar messages [99649.322723] LustreError: 87169:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3870720 GRANT, real grant 0 [99649.336937] LustreError: 87169:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 504 previous similar messages [100118.747345] LNetError: 72386:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [100118.759711] LNetError: 72386:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 5 previous similar messages [100253.248745] LustreError: 92471:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0024: cli 6ea10cfc-48e7-f6e7-b834-4eb6674e3061 claims 4194304 GRANT, real grant 0 [100253.262943] LustreError: 92471:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 477 previous similar messages [100521.313829] Lustre: fir-OST0025: Connection restored to (at 10.9.113.3@o2ib4) [100746.513512] LNetError: 72385:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [100746.525885] LNetError: 72385:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 3 previous similar messages [100856.101811] LustreError: 86338:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0024: cli 6ea10cfc-48e7-f6e7-b834-4eb6674e3061 claims 1544192 GRANT, real grant 0 [100856.115974] LustreError: 86338:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 329 previous similar messages [101461.662533] LustreError: 92447:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 4218880 GRANT, real grant 0 [101461.676782] LustreError: 92447:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 491 previous similar messages [101533.548668] LNetError: 72389:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [101533.561052] LNetError: 72389:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 7 previous similar messages [102064.958979] LustreError: 87381:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3317760 GRANT, real grant 0 [102064.973193] LustreError: 87381:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 348 previous similar messages [102352.844730] LNetError: 72378:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [102352.857089] LNetError: 72378:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 4 previous similar messages [102667.847267] LustreError: 92465:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0029: cli 75a243e1-9f6a-0fab-ec0e-ce32dad51415 claims 1982464 GRANT, real grant 0 [102667.861447] LustreError: 92465:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 335 previous similar messages [103037.708430] LNetError: 72390:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [103037.720803] LNetError: 72390:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 1 previous similar message [103269.011620] LustreError: 86780:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [103269.025803] LustreError: 86780:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 292 previous similar messages [103863.587601] LNetError: 72383:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [103863.600015] LNetError: 72383:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 3 previous similar messages [103876.515401] LustreError: 13640:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [103876.529586] LustreError: 13640:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 276 previous similar messages [104476.749314] LustreError: 99605:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [104476.763581] LustreError: 99605:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 558 previous similar messages [104643.731014] LNetError: 72392:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [104643.743374] LNetError: 72392:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 6 previous similar messages [105077.959935] LustreError: 24679:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [105077.974120] LustreError: 24679:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 427 previous similar messages [105606.762930] LNetError: 72393:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [105606.775324] LNetError: 72393:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 5 previous similar messages [105681.868394] LustreError: 87381:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3723264 GRANT, real grant 0 [105681.882848] LustreError: 87381:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 380 previous similar messages [106282.559841] LustreError: 67761:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [106282.574099] LustreError: 67761:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 236 previous similar messages [106445.389693] LNetError: 72388:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [106445.402073] LNetError: 72388:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 9 previous similar messages [106888.220712] LustreError: 87334:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3846144 GRANT, real grant 0 [106888.234963] LustreError: 87334:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 199 previous similar messages [107144.613734] LNetError: 72384:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [107144.626141] LNetError: 72384:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 4 previous similar messages [107547.913277] LustreError: 49690:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 552960 GRANT, real grant 0 [107547.928102] LustreError: 49690:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 173 previous similar messages [107759.586383] LNetError: 72380:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [107759.598878] LNetError: 72380:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 7 previous similar messages [108150.426112] LustreError: 67759:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 2772992 GRANT, real grant 0 [108150.440310] LustreError: 67759:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 155 previous similar messages [108371.199940] LNetError: 72378:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [108371.212407] LNetError: 72378:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 10 previous similar messages [108750.445342] LustreError: 87381:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3911680 GRANT, real grant 0 [108750.459556] LustreError: 87381:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 215 previous similar messages [109053.135655] LNetError: 72379:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [109053.148223] LNetError: 72379:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 14 previous similar messages [109351.721615] LustreError: 87330:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0024: cli 6ea10cfc-48e7-f6e7-b834-4eb6674e3061 claims 4202496 GRANT, real grant 0 [109351.735896] LustreError: 87330:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 362 previous similar messages [109659.451837] LNetError: 72387:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [109659.464241] LNetError: 72387:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 14 previous similar messages [109957.840459] LustreError: 125951:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 4042752 GRANT, real grant 0 [109957.854753] LustreError: 125951:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 331 previous similar messages [110435.901029] LNetError: 72380:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [110435.913633] LNetError: 72380:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 10 previous similar messages [110558.682138] LustreError: 87572:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0024: cli 6ea10cfc-48e7-f6e7-b834-4eb6674e3061 claims 4390912 GRANT, real grant 0 [110558.696394] LustreError: 87572:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 405 previous similar messages [111168.972976] LustreError: 24815:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 4218880 GRANT, real grant 0 [111168.987141] LustreError: 24815:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 488 previous similar messages [111769.388578] LustreError: 88144:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [111769.402744] LustreError: 88144:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 386 previous similar messages [112158.047907] LNetError: 72385:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [112158.060306] LNetError: 72385:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 9 previous similar messages [112268.544160] LNetError: 72383:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [112369.675185] LustreError: 87519:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [112369.690097] LustreError: 87519:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 471 previous similar messages [112422.301755] LNetError: 72380:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [112422.314502] LNetError: 72380:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 2 previous similar messages [112770.748254] LNetError: 72384:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [112770.760689] LNetError: 72384:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 5 previous similar messages [112784.283325] md: data-check of RAID array md6 [112790.436440] md: data-check of RAID array md8 [112796.419485] md: data-check of RAID array md0 [112802.580759] md: data-check of RAID array md10 [112808.849231] md: data-check of RAID array md4 [112814.905949] md: data-check of RAID array md2 [112820.974985] md: data-check of RAID array md9 [112827.093393] md: data-check of RAID array md5 [112833.204295] md: data-check of RAID array md11 [112839.354619] md: data-check of RAID array md3 [112845.506205] md: data-check of RAID array md7 [112851.766723] md: data-check of RAID array md1 [112970.816683] LustreError: 128678:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3952640 GRANT, real grant 0 [112970.831008] LustreError: 128678:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 683 previous similar messages [113373.893638] LNetError: 72387:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [113373.906107] LNetError: 72387:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 8 previous similar messages [113571.251233] LustreError: 87565:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [113571.265531] LustreError: 87565:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 211 previous similar messages [113987.395459] LNetError: 72388:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [113987.407857] LNetError: 72388:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 8 previous similar messages [114175.326872] LustreError: 129448:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [114175.341220] LustreError: 129448:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 171 previous similar messages [114684.923949] LNetError: 72378:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [114684.936486] LNetError: 72378:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 9 previous similar messages [114777.125510] LustreError: 87566:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 552960 GRANT, real grant 0 [114777.139809] LustreError: 87566:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 188 previous similar messages [115019.870463] Lustre: fir-OST002c: haven't heard from client 19137d10-74c1-23e8-6134-e61c339febce (at 10.8.15.10@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e7ae3aea800, cur 1558859837 expire 1558859687 last 1558859610 [115022.870541] Lustre: fir-OST002b: haven't heard from client 19137d10-74c1-23e8-6134-e61c339febce (at 10.8.15.10@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e9ad8f6d800, cur 1558859840 expire 1558859690 last 1558859613 [115022.892455] Lustre: Skipped 1 previous similar message [115025.870518] Lustre: fir-OST002a: haven't heard from client 19137d10-74c1-23e8-6134-e61c339febce (at 10.8.15.10@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e7a8559f800, cur 1558859843 expire 1558859693 last 1558859616 [115025.892436] Lustre: Skipped 1 previous similar message [115029.870659] Lustre: fir-OST002f: haven't heard from client 19137d10-74c1-23e8-6134-e61c339febce (at 10.8.15.10@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e7a8e9ab000, cur 1558859847 expire 1558859697 last 1558859620 [115029.892510] Lustre: Skipped 1 previous similar message [115039.871032] Lustre: fir-OST0025: haven't heard from client 19137d10-74c1-23e8-6134-e61c339febce (at 10.8.15.10@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e7a8854f400, cur 1558859857 expire 1558859707 last 1558859630 [115039.892878] Lustre: Skipped 2 previous similar messages [115312.703731] LNetError: 72378:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [115312.716273] LNetError: 72378:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 11 previous similar messages [115383.583581] LustreError: 87596:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3723264 GRANT, real grant 0 [115383.597862] LustreError: 87596:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 266 previous similar messages [115936.527734] LNetError: 72383:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [115936.540308] LNetError: 72383:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 6 previous similar messages [116001.100062] LustreError: 87840:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3891200 GRANT, real grant 0 [116001.114297] LustreError: 87840:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 264 previous similar messages [116561.562850] LNetError: 72382:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [116561.575379] LNetError: 72382:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 6 previous similar messages [116611.026335] LustreError: 86776:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 4218880 GRANT, real grant 0 [116611.040621] LustreError: 86776:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 262 previous similar messages [117171.435028] LNetError: 72393:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [117171.447479] LNetError: 72393:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 13 previous similar messages [117213.815150] LustreError: 86776:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [117213.829513] LustreError: 86776:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 330 previous similar messages [117808.305808] LNetError: 72380:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [117808.318262] LNetError: 72380:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 20 previous similar messages [117814.222435] LustreError: 87183:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 4218880 GRANT, real grant 0 [117814.236680] LustreError: 87183:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 294 previous similar messages [118418.063130] LustreError: 87541:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [118418.077472] LustreError: 87541:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 347 previous similar messages [118427.337598] LNetError: 72392:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [118427.350053] LNetError: 72392:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 16 previous similar messages [119024.486844] LustreError: 952:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [119024.501852] LustreError: 952:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 251 previous similar messages [119053.821250] LNetError: 72390:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [119053.833707] LNetError: 72390:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 22 previous similar messages [119628.845803] LustreError: 1546:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 2199552 GRANT, real grant 0 [119628.860006] LustreError: 1546:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 290 previous similar messages [119660.427619] LNetError: 72389:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [119660.440026] LNetError: 72389:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 13 previous similar messages [120230.519161] LustreError: 49690:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0024: cli 6ea10cfc-48e7-f6e7-b834-4eb6674e3061 claims 2785280 GRANT, real grant 0 [120230.533418] LustreError: 49690:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 228 previous similar messages [120365.889380] LNetError: 72379:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [120365.901933] LNetError: 72379:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 7 previous similar messages [120833.492669] LustreError: 99691:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0024: cli 6ea10cfc-48e7-f6e7-b834-4eb6674e3061 claims 4390912 GRANT, real grant 0 [120833.506891] LustreError: 99691:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 267 previous similar messages [121029.493204] LNetError: 72386:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [121029.505641] LNetError: 72386:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 3 previous similar messages [121439.293101] LustreError: 24815:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4296704 GRANT, real grant 0 [121439.307390] LustreError: 24815:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 410 previous similar messages [121635.781409] LNetError: 72388:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [121635.793778] LNetError: 72388:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 12 previous similar messages [122041.677090] LustreError: 75385:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 1105920 GRANT, real grant 0 [122041.691369] LustreError: 75385:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 367 previous similar messages [122248.509027] LNetError: 72382:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [122248.521500] LNetError: 72382:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 11 previous similar messages [122643.211778] LustreError: 125952:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3854336 GRANT, real grant 0 [122643.226117] LustreError: 125952:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 336 previous similar messages [122676.907601] Lustre: fir-OST002d: haven't heard from client 3488727c-9371-7307-4f65-41352a731000 (at 10.8.14.1@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e7a8f25a400, cur 1558867494 expire 1558867344 last 1558867267 [122676.929351] Lustre: Skipped 2 previous similar messages [123244.814870] LustreError: 75384:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [123244.829097] LustreError: 75384:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 441 previous similar messages [123849.233653] LustreError: 99682:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0024: cli 6ea10cfc-48e7-f6e7-b834-4eb6674e3061 claims 4362240 GRANT, real grant 0 [123849.247825] LustreError: 99682:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 394 previous similar messages [124450.447325] LustreError: 1888:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [124450.461462] LustreError: 1888:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 436 previous similar messages [125051.210424] LustreError: 99699:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 4218880 GRANT, real grant 0 [125051.224588] LustreError: 99699:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 186 previous similar messages [125655.029980] LustreError: 87518:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 2236416 GRANT, real grant 0 [125655.044254] LustreError: 87518:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 221 previous similar messages [126257.994584] LustreError: 12926:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 589824 GRANT, real grant 0 [126258.008742] LustreError: 12926:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 191 previous similar messages [126860.702886] LustreError: 87169:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [126860.717053] LustreError: 87169:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 323 previous similar messages [127461.206762] LustreError: 86768:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4268032 GRANT, real grant 0 [127461.220930] LustreError: 86768:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 317 previous similar messages [128064.551283] LustreError: 11079:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [128064.565498] LustreError: 11079:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 406 previous similar messages [128674.488541] LustreError: 86831:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3780608 GRANT, real grant 0 [128674.502771] LustreError: 86831:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 348 previous similar messages [129275.905940] LustreError: 87381:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 4218880 GRANT, real grant 0 [129275.920104] LustreError: 87381:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 369 previous similar messages [129876.095572] LustreError: 129794:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0024: cli 6ea10cfc-48e7-f6e7-b834-4eb6674e3061 claims 4194304 GRANT, real grant 0 [129876.110165] LustreError: 129794:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 284 previous similar messages [130484.127803] LustreError: 125952:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3891200 GRANT, real grant 0 [130484.142057] LustreError: 125952:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 331 previous similar messages [130824.956750] Lustre: fir-OST002f: haven't heard from client f994e1df-f8b5-f52f-a9b6-7b770c0cce6e (at 10.8.1.29@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e7a8ea6e400, cur 1558875642 expire 1558875492 last 1558875415 [130824.978478] Lustre: Skipped 11 previous similar messages [131089.217531] LustreError: 87372:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002d: cli a6519f19-aa1f-7c07-30a6-27183c6aabc4 claims 32768 GRANT, real grant 0 [131089.231528] LustreError: 87372:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 377 previous similar messages [131693.666462] LustreError: 87333:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [131693.680633] LustreError: 87333:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 606 previous similar messages [132294.112253] LustreError: 86833:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [132294.126417] LustreError: 86833:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 512 previous similar messages [132750.756446] Lustre: fir-OST0025: Connection restored to (at 10.8.1.29@o2ib6) [132750.763704] Lustre: Skipped 3 previous similar messages [132825.903400] Lustre: fir-OST0024: Connection restored to (at 10.8.1.29@o2ib6) [132825.910626] Lustre: Skipped 7 previous similar messages [132894.475710] LustreError: 49690:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3813376 GRANT, real grant 0 [132894.490058] LustreError: 49690:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 506 previous similar messages [133497.058520] LustreError: 24815:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3244032 GRANT, real grant 0 [133497.072686] LustreError: 24815:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 516 previous similar messages [134100.130785] LustreError: 87572:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002d: cli a6519f19-aa1f-7c07-30a6-27183c6aabc4 claims 28672 GRANT, real grant 0 [134100.144833] LustreError: 87572:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 402 previous similar messages [134700.886158] LustreError: 75384:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002d: cli a6519f19-aa1f-7c07-30a6-27183c6aabc4 claims 40960 GRANT, real grant 0 [134700.900147] LustreError: 75384:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 365 previous similar messages [134982.168853] LNetError: 72383:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [134982.181209] LNetError: 72383:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 10 previous similar messages [135139.518483] LNetError: 72388:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [135303.227677] LustreError: 24680:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [135303.242842] LustreError: 24680:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 370 previous similar messages [135516.318008] LNetError: 72378:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [135516.330392] LNetError: 72378:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 1 previous similar message [135904.377340] LustreError: 129794:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [135904.391666] LustreError: 129794:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 327 previous similar messages [136504.927360] LustreError: 87383:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002d: cli a6519f19-aa1f-7c07-30a6-27183c6aabc4 claims 40960 GRANT, real grant 0 [136504.941361] LustreError: 87383:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 454 previous similar messages [137013.296134] LNetError: 72385:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [137013.308495] LNetError: 72385:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 1 previous similar message [137106.290438] LustreError: 127964:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002d: cli a6519f19-aa1f-7c07-30a6-27183c6aabc4 claims 28672 GRANT, real grant 0 [137106.304538] LustreError: 127964:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 355 previous similar messages [137707.637647] LustreError: 87333:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002d: cli a6519f19-aa1f-7c07-30a6-27183c6aabc4 claims 45056 GRANT, real grant 0 [137707.651635] LustreError: 87333:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 240 previous similar messages [138315.182697] LustreError: 92470:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0024: cli 6ea10cfc-48e7-f6e7-b834-4eb6674e3061 claims 2097152 GRANT, real grant 0 [138315.196887] LustreError: 92470:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 172 previous similar messages [138927.528836] LustreError: 31679:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3883008 GRANT, real grant 0 [138927.542993] LustreError: 31679:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 330 previous similar messages [139527.848588] LustreError: 87517:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3166208 GRANT, real grant 0 [139527.862756] LustreError: 87517:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 385 previous similar messages [140128.701520] LustreError: 128021:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 2363392 GRANT, real grant 0 [140128.715771] LustreError: 128021:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 412 previous similar messages [140730.229068] LustreError: 99606:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [140730.243231] LustreError: 99606:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 382 previous similar messages [141331.494560] LustreError: 87380:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [141331.508749] LustreError: 87380:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 303 previous similar messages [141932.016193] LustreError: 92463:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [141932.030367] LustreError: 92463:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 411 previous similar messages [142547.993385] LustreError: 92448:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3268608 GRANT, real grant 0 [142548.007567] LustreError: 92448:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 315 previous similar messages [143149.340561] LustreError: 128021:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3895296 GRANT, real grant 0 [143149.354826] LustreError: 128021:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 253 previous similar messages [143750.076163] LustreError: 87381:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [143750.090334] LustreError: 87381:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 250 previous similar messages [144302.028716] Lustre: fir-OST0026: haven't heard from client b51e5084-7e0e-d8fc-5bc9-a11ecbf160d9 (at 10.8.17.12@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e9abd146000, cur 1558889119 expire 1558888969 last 1558888892 [144302.050536] Lustre: Skipped 11 previous similar messages [144355.656003] LustreError: 1896:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 2703360 GRANT, real grant 0 [144355.670079] LustreError: 1896:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 240 previous similar messages [144957.774417] LustreError: 87520:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [144957.788584] LustreError: 87520:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 311 previous similar messages [145564.286997] LustreError: 75386:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [145564.301210] LustreError: 75386:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 308 previous similar messages [145723.037163] Lustre: fir-OST0026: haven't heard from client 1d6cee4a-b768-f82f-7034-d3a602fcc23e (at 10.8.23.12@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e7a85278800, cur 1558890540 expire 1558890390 last 1558890313 [145723.058954] Lustre: Skipped 11 previous similar messages [146170.960416] LustreError: 67753:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4112384 GRANT, real grant 0 [146170.974655] LustreError: 67753:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 266 previous similar messages [146784.830646] LustreError: 129794:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3977216 GRANT, real grant 0 [146784.844926] LustreError: 129794:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 259 previous similar messages [147389.326428] LustreError: 67769:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3751936 GRANT, real grant 0 [147389.340696] LustreError: 67769:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 382 previous similar messages [147990.689669] LustreError: 67778:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0024: cli 6ea10cfc-48e7-f6e7-b834-4eb6674e3061 claims 4087808 GRANT, real grant 0 [147990.703907] LustreError: 67778:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 410 previous similar messages [148592.917166] LustreError: 75391:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [148592.931331] LustreError: 75391:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 445 previous similar messages [148802.057939] Lustre: fir-OST0029: haven't heard from client 8c259189-372b-ea94-3ea6-a2fa1f119887 (at 10.8.11.14@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e7a8a7c3c00, cur 1558893619 expire 1558893469 last 1558893392 [148802.079772] Lustre: Skipped 11 previous similar messages [149133.294966] Lustre: fir-OST0025: Connection restored to (at 10.8.17.12@o2ib6) [149133.302426] Lustre: Skipped 5 previous similar messages [149194.189273] LustreError: 99605:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3878912 GRANT, real grant 0 [149194.203509] LustreError: 99605:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 510 previous similar messages [149208.465522] Lustre: fir-OST0024: Connection restored to (at 10.8.17.12@o2ib6) [149208.472862] Lustre: Skipped 5 previous similar messages [149800.613859] LustreError: 87566:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0024: cli 6ea10cfc-48e7-f6e7-b834-4eb6674e3061 claims 548864 GRANT, real grant 0 [149800.627947] LustreError: 87566:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 401 previous similar messages [150410.814490] LustreError: 87572:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0024: cli 6ea10cfc-48e7-f6e7-b834-4eb6674e3061 claims 4415488 GRANT, real grant 0 [150410.828667] LustreError: 87572:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 309 previous similar messages [151024.596269] LustreError: 87689:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [151024.610436] LustreError: 87689:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 305 previous similar messages [151632.061992] LustreError: 86768:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3936256 GRANT, real grant 0 [151632.076181] LustreError: 86768:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 226 previous similar messages [152232.723661] LustreError: 99688:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [152232.737825] LustreError: 99688:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 496 previous similar messages [152845.420781] LustreError: 125966:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [152845.435034] LustreError: 125966:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 328 previous similar messages [153465.442886] LustreError: 99605:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3866624 GRANT, real grant 0 [153465.458758] LustreError: 99605:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 403 previous similar messages [154093.246196] LustreError: 92451:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4100096 GRANT, real grant 0 [154093.260458] LustreError: 92451:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 179 previous similar messages [154694.425438] LustreError: 87513:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0024: cli 6ea10cfc-48e7-f6e7-b834-4eb6674e3061 claims 3862528 GRANT, real grant 0 [154694.439670] LustreError: 87513:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 493 previous similar messages [155295.503843] LustreError: 87596:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [155295.518006] LustreError: 87596:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 795 previous similar messages [155898.605139] LustreError: 31679:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [155898.619304] LustreError: 31679:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 525 previous similar messages [156465.495376] LNetError: 72378:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [156500.008403] LustreError: 87369:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3428352 GRANT, real grant 0 [156500.022649] LustreError: 87369:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 591 previous similar messages [157102.838613] LustreError: 128676:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 4218880 GRANT, real grant 0 [157102.852893] LustreError: 128676:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 477 previous similar messages [157719.288832] LustreError: 99687:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3706880 GRANT, real grant 0 [157719.303038] LustreError: 99687:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 272 previous similar messages [158329.415922] LustreError: 86861:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3895296 GRANT, real grant 0 [158329.430090] LustreError: 86861:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 169 previous similar messages [158934.472281] LustreError: 86790:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 2314240 GRANT, real grant 0 [158934.486466] LustreError: 86790:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 238 previous similar messages [159540.778084] LustreError: 86838:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3911680 GRANT, real grant 0 [159540.792248] LustreError: 86838:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 295 previous similar messages [160146.491633] LustreError: 49693:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3895296 GRANT, real grant 0 [160146.505791] LustreError: 49693:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 275 previous similar messages [160754.505904] LustreError: 92466:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3895296 GRANT, real grant 0 [160754.520114] LustreError: 92466:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 313 previous similar messages [161360.568990] LustreError: 86894:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3907584 GRANT, real grant 0 [161360.583173] LustreError: 86894:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 212 previous similar messages [161971.573726] LustreError: 1861:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3895296 GRANT, real grant 0 [161971.587903] LustreError: 1861:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 170 previous similar messages [162572.609043] LustreError: 1809:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3284992 GRANT, real grant 0 [162572.623161] LustreError: 1809:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 291 previous similar messages [163174.884417] LustreError: 765:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 4390912 GRANT, real grant 0 [163174.898415] LustreError: 765:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 323 previous similar messages [163766.292954] LNetError: 72381:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [163778.142736] LustreError: 87690:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0027: cli 1d02240d-6817-4f2d-eb33-71d0a2e61934 claims 61440 GRANT, real grant 0 [163778.156729] LustreError: 87690:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 315 previous similar messages [163790.525481] LNetError: 72382:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [163855.043571] LNetError: 72385:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [164104.640421] LNetError: 72379:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [164379.763861] LustreError: 67758:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [164379.778023] LustreError: 67758:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 319 previous similar messages [164500.834672] LNetError: 72380:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [164642.527043] LNetError: 72387:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [164642.539417] LNetError: 72387:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 1 previous similar message [164729.042380] LNetError: 72384:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [164897.689116] LNetError: 72386:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [164997.224396] LustreError: 1888:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3895296 GRANT, real grant 0 [164997.238672] LustreError: 1888:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 332 previous similar messages [165006.088780] LNetError: 72390:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [165218.809028] LNetError: 72386:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [165518.956397] LNetError: 72387:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [165518.968786] LNetError: 72387:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 9 previous similar messages [165602.546243] LustreError: 49692:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3846144 GRANT, real grant 0 [165602.560473] LustreError: 49692:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 272 previous similar messages [166148.524211] LNetError: 72383:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [166148.536647] LNetError: 72383:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 16 previous similar messages [166202.694158] LustreError: 75395:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3932160 GRANT, real grant 0 [166202.708401] LustreError: 75395:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 358 previous similar messages [166767.542116] LNetError: 72384:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [166767.554516] LNetError: 72384:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 17 previous similar messages [166808.278323] LustreError: 67791:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3944448 GRANT, real grant 0 [166808.292563] LustreError: 67791:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 292 previous similar messages [167387.702733] LNetError: 72380:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [167387.715289] LNetError: 72380:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 21 previous similar messages [167418.592678] LustreError: 16614:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3932160 GRANT, real grant 0 [167418.606925] LustreError: 16614:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 208 previous similar messages [168028.773057] LustreError: 92469:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0024: cli 6ea10cfc-48e7-f6e7-b834-4eb6674e3061 claims 548864 GRANT, real grant 0 [168028.787181] LustreError: 92469:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 169 previous similar messages [168632.266643] LustreError: 128022:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 4218880 GRANT, real grant 0 [168632.281002] LustreError: 128022:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 315 previous similar messages [169234.054705] LustreError: 88039:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [169234.068899] LustreError: 88039:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 352 previous similar messages [169379.403451] LNetError: 72380:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [169379.415955] LNetError: 72380:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 8 previous similar messages [169569.908212] LNetError: 72380:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [169569.920813] LNetError: 72380:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 2 previous similar messages [169802.902229] LNetError: 72380:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [169802.914877] LNetError: 72380:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 1 previous similar message [169834.131164] LustreError: 125965:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [169834.145504] LustreError: 125965:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 387 previous similar messages [170448.699537] LustreError: 99679:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 4415488 GRANT, real grant 0 [170448.713715] LustreError: 99679:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 227 previous similar messages [171055.319171] LustreError: 99686:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3809280 GRANT, real grant 0 [171055.333361] LustreError: 99686:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 255 previous similar messages [171154.880142] LNetError: 72380:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [171154.892570] LNetError: 72380:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 4 previous similar messages [171199.127224] LNetError: 72389:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [171434.834482] LNetError: 72383:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [171645.129846] LNetError: 72387:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [171645.142207] LNetError: 72387:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 1 previous similar message [171656.901893] LustreError: 129794:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3870720 GRANT, real grant 0 [171656.916252] LustreError: 129794:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 312 previous similar messages [171947.852073] LNetError: 72378:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [171947.864453] LNetError: 72378:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 1 previous similar message [172269.447690] LustreError: 75386:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3829760 GRANT, real grant 0 [172269.461882] LustreError: 75386:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 296 previous similar messages [172870.744847] LustreError: 88039:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3977216 GRANT, real grant 0 [172870.759029] LustreError: 88039:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 320 previous similar messages [173483.873954] LustreError: 75395:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 81920 GRANT, real grant 0 [173483.887948] LustreError: 75395:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 184 previous similar messages [174084.429764] LustreError: 86787:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3858432 GRANT, real grant 0 [174084.443930] LustreError: 86787:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 227 previous similar messages [174085.662897] Lustre: fir-OST0025: Connection restored to (at 10.8.21.24@o2ib6) [174085.670231] Lustre: Skipped 5 previous similar messages [174160.838251] Lustre: fir-OST0024: Connection restored to (at 10.8.21.24@o2ib6) [174160.845624] Lustre: Skipped 5 previous similar messages [174685.966459] LustreError: 67779:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3911680 GRANT, real grant 0 [174685.980695] LustreError: 67779:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 483 previous similar messages [175296.425971] LustreError: 87332:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3858432 GRANT, real grant 0 [175296.440137] LustreError: 87332:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 362 previous similar messages [175907.043488] LustreError: 92469:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3878912 GRANT, real grant 0 [175907.057672] LustreError: 92469:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 341 previous similar messages [176507.612738] LustreError: 128682:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4018176 GRANT, real grant 0 [176507.627022] LustreError: 128682:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 208 previous similar messages [177112.267890] LustreError: 92413:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3854336 GRANT, real grant 0 [177112.282087] LustreError: 92413:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 320 previous similar messages [177713.538455] LustreError: 87203:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3866624 GRANT, real grant 0 [177713.552762] LustreError: 87203:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 382 previous similar messages [178325.624542] LustreError: 31677:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 4390912 GRANT, real grant 0 [178325.638702] LustreError: 31677:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 369 previous similar messages [178925.678384] LustreError: 84196:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0024: cli 6ea10cfc-48e7-f6e7-b834-4eb6674e3061 claims 1101824 GRANT, real grant 0 [178925.692550] LustreError: 84196:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 283 previous similar messages [179531.474507] LustreError: 99699:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0024: cli 6ea10cfc-48e7-f6e7-b834-4eb6674e3061 claims 552960 GRANT, real grant 0 [179531.488621] LustreError: 99699:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 194 previous similar messages [180135.075489] LustreError: 87520:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 4218880 GRANT, real grant 0 [180135.089657] LustreError: 87520:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 328 previous similar messages [180750.827356] LustreError: 1546:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 4288512 GRANT, real grant 0 [180750.841575] LustreError: 1546:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 359 previous similar messages [181359.350903] LustreError: 88039:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3231744 GRANT, real grant 0 [181359.365081] LustreError: 88039:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 346 previous similar messages [181553.489639] LNetError: 72392:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [181553.501987] LNetError: 72392:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 5 previous similar messages [181967.442215] LustreError: 87333:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [181967.456406] LustreError: 87333:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 259 previous similar messages [182012.604229] LNetError: 72379:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [182012.616754] LNetError: 72379:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 1 previous similar message [182193.384018] LNetError: 72380:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [182571.657618] LustreError: 1886:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 4304896 GRANT, real grant 0 [182571.671736] LustreError: 1886:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 286 previous similar messages [182685.660717] LNetError: 72381:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [183173.442910] LustreError: 99694:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3842048 GRANT, real grant 0 [183173.457091] LustreError: 99694:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 330 previous similar messages [183773.847546] LustreError: 87691:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0024: cli 6ea10cfc-48e7-f6e7-b834-4eb6674e3061 claims 548864 GRANT, real grant 0 [183773.861660] LustreError: 87691:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 375 previous similar messages [184382.482918] LustreError: 12906:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3854336 GRANT, real grant 0 [184382.497142] LustreError: 12906:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 374 previous similar messages [184887.695604] LNetError: 72387:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [184983.189569] LustreError: 87195:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3276800 GRANT, real grant 0 [184983.203746] LustreError: 87195:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 253 previous similar messages [185586.300892] LustreError: 24739:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3866624 GRANT, real grant 0 [185586.315076] LustreError: 24739:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 247 previous similar messages [186192.078257] LustreError: 128678:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3878912 GRANT, real grant 0 [186192.092561] LustreError: 128678:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 433 previous similar messages [186733.253611] LNetError: 72391:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [186796.555282] LustreError: 96017:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 1658880 GRANT, real grant 0 [186796.569466] LustreError: 96017:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 412 previous similar messages [187274.821620] LNetError: 72389:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [187398.462423] LustreError: 92465:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3756032 GRANT, real grant 0 [187398.476619] LustreError: 92465:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 448 previous similar messages [187964.532880] LNetError: 72378:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [188045.577889] LustreError: 14368:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0024: cli 6ea10cfc-48e7-f6e7-b834-4eb6674e3061 claims 901120 GRANT, real grant 0 [188045.592005] LustreError: 14368:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 263 previous similar messages [188647.453463] LustreError: 14368:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0024: cli 6ea10cfc-48e7-f6e7-b834-4eb6674e3061 claims 1097728 GRANT, real grant 0 [188647.467669] LustreError: 14368:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 459 previous similar messages [188649.673488] LNetError: 72385:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [188727.018454] LNetError: 72390:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [188770.998283] LNetError: 72393:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [188966.346511] LNetError: 72378:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [189080.120820] LNetError: 72390:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [189249.495845] LustreError: 125966:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3272704 GRANT, real grant 0 [189249.510136] LustreError: 125966:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 644 previous similar messages [189341.037563] LNetError: 72383:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [189706.185623] LNetError: 72382:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [189851.843297] LustreError: 87541:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [189851.857484] LustreError: 87541:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 362 previous similar messages [189963.555526] LNetError: 72378:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [190269.833914] LNetError: 72379:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [190463.833202] LustreError: 24816:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3870720 GRANT, real grant 0 [190463.847405] LustreError: 24816:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 166 previous similar messages [191066.450613] LustreError: 87376:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0024: cli 6ea10cfc-48e7-f6e7-b834-4eb6674e3061 claims 2973696 GRANT, real grant 0 [191066.464801] LustreError: 87376:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 81 previous similar messages [191676.760890] LustreError: 67780:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3284992 GRANT, real grant 0 [191676.775076] LustreError: 67780:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 53 previous similar messages [192299.800746] LustreError: 87611:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3936256 GRANT, real grant 0 [192299.814944] LustreError: 87611:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 68 previous similar messages [192902.448558] LustreError: 87176:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0024: cli 6ea10cfc-48e7-f6e7-b834-4eb6674e3061 claims 548864 GRANT, real grant 0 [192902.462639] LustreError: 87176:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 153 previous similar messages [193504.931259] LustreError: 99698:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3903488 GRANT, real grant 0 [193504.945464] LustreError: 99698:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 225 previous similar messages [194133.892301] LustreError: 96018:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3870720 GRANT, real grant 0 [194133.906498] LustreError: 96018:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 586 previous similar messages [194735.486613] LustreError: 24680:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [194735.500780] LustreError: 24680:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 370 previous similar messages [195337.287748] LustreError: 1808:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [195337.301853] LustreError: 1808:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 363 previous similar messages [195940.089776] LustreError: 86774:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [195940.103952] LustreError: 86774:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 356 previous similar messages [196361.232572] Lustre: 86636:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1558941170/real 1558941170] req@ffff9e5b27628000 x1634472516936176/t0(0) o106->fir-OST0029@10.9.101.40@o2ib4:15/16 lens 296/280 e 0 to 1 dl 1558941177 ref 1 fl Rpc:X/0/ffffffff rc 0/-1 [196361.260040] Lustre: 86636:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 2253 previous similar messages [196377.695661] Lustre: 86655:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1558941187/real 1558941187] req@ffff9e5b0f743900 x1634472516955184/t0(0) o106->fir-OST0029@10.9.101.40@o2ib4:15/16 lens 296/280 e 0 to 1 dl 1558941194 ref 1 fl Rpc:X/2/ffffffff rc 0/-1 [196377.723157] Lustre: 86655:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 13 previous similar messages [196410.269849] Lustre: 86636:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1558941219/real 1558941219] req@ffff9e5b27628000 x1634472516936176/t0(0) o106->fir-OST0029@10.9.101.40@o2ib4:15/16 lens 296/280 e 0 to 1 dl 1558941226 ref 1 fl Rpc:X/2/ffffffff rc 0/-1 [196410.297344] Lustre: 86636:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 33 previous similar messages [196475.143217] Lustre: 86624:0:(client.c:2132:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1558941284/real 1558941284] req@ffff9e94385b4200 x1634472516941936/t0(0) o106->fir-OST0029@10.9.101.40@o2ib4:15/16 lens 296/280 e 0 to 1 dl 1558941291 ref 1 fl Rpc:X/2/ffffffff rc 0/-1 [196475.170646] Lustre: 86624:0:(client.c:2132:ptlrpc_expire_one_request()) Skipped 85 previous similar messages [196494.751351] LustreError: 86479:0:(ldlm_lockd.c:682:ldlm_handle_ast_error()) ### client (nid 10.9.101.40@o2ib4) failed to reply to blocking AST (req@ffff9e7c7109f800 x1634472517016992 status 0 rc -110), evict it ns: filter-fir-OST0029_UUID lock: ffff9e7d70825340/0x50506a465e7dda87 lrc: 4/0,0 mode: PR/PR res: [0x840000402:0xa21e08:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 131072->16777215) flags: 0x60000400000020 nid: 10.9.101.40@o2ib4 remote: 0x926fdd5db157efbe expref: 1272 pid: 86734 timeout: 196585 lvb_type: 1 [196494.797942] LustreError: 138-a: fir-OST0029: A client on nid 10.9.101.40@o2ib4 was evicted due to a lock blocking callback time out: rc -110 [196494.810683] LustreError: 75297:0:(ldlm_lockd.c:256:expired_lock_main()) ### lock callback timer expired after 105s: evicting client at 10.9.101.40@o2ib4 ns: filter-fir-OST0029_UUID lock: ffff9e7d70825340/0x50506a465e7dda87 lrc: 3/0,0 mode: PR/PR res: [0x840000402:0xa21e08:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 131072->16777215) flags: 0x60000400000020 nid: 10.9.101.40@o2ib4 remote: 0x926fdd5db157efbe expref: 1273 pid: 86734 timeout: 0 lvb_type: 1 [196494.895447] LustreError: 86675:0:(client.c:1175:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff9e9965b6e600 x1634472517416240/t0(0) o104->fir-OST0029@10.9.101.40@o2ib4:15/16 lens 296/224 e 0 to 0 dl 0 ref 1 fl Rpc:/0/ffffffff rc 0/-1 [196550.339981] LustreError: 87571:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3993600 GRANT, real grant 0 [196550.354166] LustreError: 87571:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 310 previous similar messages [196574.304461] Lustre: fir-OST002c: haven't heard from client 66026a75-5d85-a05b-4624-1a1e815adb46 (at 10.9.101.40@o2ib4) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e7a83eba400, cur 1558941391 expire 1558941241 last 1558941164 [196574.326370] Lustre: Skipped 11 previous similar messages [196575.304680] Lustre: fir-OST002b: haven't heard from client 66026a75-5d85-a05b-4624-1a1e815adb46 (at 10.9.101.40@o2ib4) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e9afab6c400, cur 1558941392 expire 1558941242 last 1558941165 [196578.329111] Lustre: fir-OST0025: haven't heard from client 66026a75-5d85-a05b-4624-1a1e815adb46 (at 10.9.101.40@o2ib4) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e7a8849ac00, cur 1558941395 expire 1558941245 last 1558941168 [196578.350996] Lustre: Skipped 1 previous similar message [196580.349836] Lustre: fir-OST0027: haven't heard from client 66026a75-5d85-a05b-4624-1a1e815adb46 (at 10.9.101.40@o2ib4) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e93fce1cc00, cur 1558941397 expire 1558941247 last 1558941170 [196580.371712] Lustre: Skipped 6 previous similar messages [197154.342734] LustreError: 86832:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [197154.356920] LustreError: 86832:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 373 previous similar messages [197761.017527] LustreError: 87542:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3809280 GRANT, real grant 0 [197761.031816] LustreError: 87542:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 305 previous similar messages [198362.729032] LustreError: 87372:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3715072 GRANT, real grant 0 [198362.743224] LustreError: 87372:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 267 previous similar messages [198969.959102] LustreError: 129448:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4100096 GRANT, real grant 0 [198969.973389] LustreError: 129448:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 240 previous similar messages [199572.802069] LustreError: 86787:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3923968 GRANT, real grant 0 [199572.816239] LustreError: 86787:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 204 previous similar messages [200184.953546] LustreError: 87182:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0024: cli 6ea10cfc-48e7-f6e7-b834-4eb6674e3061 claims 4194304 GRANT, real grant 0 [200184.967723] LustreError: 87182:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 187 previous similar messages [200798.213003] LustreError: 75386:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4304896 GRANT, real grant 0 [200798.227172] LustreError: 75386:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 244 previous similar messages [201407.539409] LustreError: 128684:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4038656 GRANT, real grant 0 [201407.553710] LustreError: 128684:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 167 previous similar messages [202012.514531] LustreError: 67775:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3985408 GRANT, real grant 0 [202012.528739] LustreError: 67775:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 268 previous similar messages [202619.008831] LustreError: 87369:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3903488 GRANT, real grant 0 [202619.023025] LustreError: 87369:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 314 previous similar messages [203219.213593] LustreError: 99687:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3895296 GRANT, real grant 0 [203219.227771] LustreError: 99687:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 247 previous similar messages [203821.977007] LustreError: 87942:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3850240 GRANT, real grant 0 [203821.991215] LustreError: 87942:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 335 previous similar messages [204425.593284] LustreError: 128681:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [204425.607543] LustreError: 128681:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 357 previous similar messages [205025.719151] LustreError: 87333:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [205025.733398] LustreError: 87333:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 288 previous similar messages [205628.131516] LustreError: 87183:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [205628.145685] LustreError: 87183:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 492 previous similar messages [206230.650873] LustreError: 86829:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [206230.665121] LustreError: 86829:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 440 previous similar messages [206832.508569] LustreError: 87591:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3829760 GRANT, real grant 0 [206832.522749] LustreError: 87591:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 314 previous similar messages [207433.999900] LustreError: 87173:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [207434.014099] LustreError: 87173:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 230 previous similar messages [208041.182737] LustreError: 87542:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3825664 GRANT, real grant 0 [208041.196916] LustreError: 87542:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 244 previous similar messages [208642.708455] LustreError: 125951:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [208642.722705] LustreError: 125951:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 345 previous similar messages [209250.562882] LustreError: 99677:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3854336 GRANT, real grant 0 [209250.577050] LustreError: 99677:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 400 previous similar messages [209851.585917] LustreError: 87368:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3715072 GRANT, real grant 0 [209851.600086] LustreError: 87368:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 397 previous similar messages [210459.025469] LustreError: 91039:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 4218880 GRANT, real grant 0 [210459.039668] LustreError: 91039:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 412 previous similar messages [211073.342151] LustreError: 87521:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0024: cli 6ea10cfc-48e7-f6e7-b834-4eb6674e3061 claims 1654784 GRANT, real grant 0 [211073.356344] LustreError: 87521:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 268 previous similar messages [211677.835225] LustreError: 1896:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 1105920 GRANT, real grant 0 [211677.849320] LustreError: 1896:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 104 previous similar messages [212291.543738] LustreError: 92466:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3977216 GRANT, real grant 0 [212291.558006] LustreError: 92466:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 88 previous similar messages [212892.523149] LustreError: 87187:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3895296 GRANT, real grant 0 [212892.537311] LustreError: 87187:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 222 previous similar messages [213512.884649] LustreError: 86796:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3854336 GRANT, real grant 0 [213512.898820] LustreError: 86796:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 245 previous similar messages [214125.692605] LustreError: 128023:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4141056 GRANT, real grant 0 [214125.707487] LustreError: 128023:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 302 previous similar messages [214731.455072] LustreError: 75384:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 4325376 GRANT, real grant 0 [214731.469247] LustreError: 75384:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 316 previous similar messages [215332.948724] LustreError: 13739:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [215332.962884] LustreError: 13739:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 333 previous similar messages [215935.047596] LustreError: 1896:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3952640 GRANT, real grant 0 [215935.061691] LustreError: 1896:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 370 previous similar messages [216535.919180] LustreError: 87566:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [216535.933404] LustreError: 87566:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 354 previous similar messages [217154.782326] LustreError: 99685:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3874816 GRANT, real grant 0 [217154.796521] LustreError: 99685:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 384 previous similar messages [217774.548778] LustreError: 87978:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3325952 GRANT, real grant 0 [217774.563063] LustreError: 87978:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 237 previous similar messages [218376.091153] LustreError: 86826:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3211264 GRANT, real grant 0 [218376.105335] LustreError: 86826:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 208 previous similar messages [218987.637359] LustreError: 67760:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 2285568 GRANT, real grant 0 [218987.651572] LustreError: 67760:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 267 previous similar messages [219594.844621] LustreError: 2713:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [219594.858724] LustreError: 2713:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 335 previous similar messages [220197.507826] LustreError: 86794:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3276800 GRANT, real grant 0 [220197.522009] LustreError: 86794:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 338 previous similar messages [220798.625573] LustreError: 1809:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0024: cli 6ea10cfc-48e7-f6e7-b834-4eb6674e3061 claims 4091904 GRANT, real grant 0 [220798.639702] LustreError: 1809:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 300 previous similar messages [221398.694901] LustreError: 67775:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3923968 GRANT, real grant 0 [221398.709076] LustreError: 67775:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 311 previous similar messages [222008.229057] LustreError: 86790:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3866624 GRANT, real grant 0 [222008.243264] LustreError: 86790:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 291 previous similar messages [222615.623209] LustreError: 87565:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3272704 GRANT, real grant 0 [222615.637372] LustreError: 87565:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 291 previous similar messages [223217.598622] LustreError: 11079:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3870720 GRANT, real grant 0 [223217.612909] LustreError: 11079:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 303 previous similar messages [223827.846044] LustreError: 86894:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3956736 GRANT, real grant 0 [223827.860212] LustreError: 86894:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 79 previous similar messages [224437.570702] LustreError: 14368:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3895296 GRANT, real grant 0 [224437.584924] LustreError: 14368:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 109 previous similar messages [225043.797013] LustreError: 29525:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3854336 GRANT, real grant 0 [225043.811235] LustreError: 29525:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 190 previous similar messages [225644.876991] LustreError: 14368:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 2805760 GRANT, real grant 0 [225644.891155] LustreError: 14368:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 317 previous similar messages [226247.898838] LustreError: 87333:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0024: cli 6ea10cfc-48e7-f6e7-b834-4eb6674e3061 claims 1105920 GRANT, real grant 0 [226247.913020] LustreError: 87333:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 329 previous similar messages [226804.137671] sd 0:0:177:0: [sdfs] tag#9 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE [226804.146292] sd 0:0:177:0: [sdfs] tag#9 Sense Key : Medium Error [current] [descriptor] [226804.154384] sd 0:0:177:0: [sdfs] tag#9 Add. Sense: Unrecovered read error [226804.161263] sd 0:0:177:0: [sdfs] tag#9 CDB: Read(16) 88 00 00 00 00 02 65 e8 60 00 00 00 00 e0 00 00 [226804.170483] blk_update_request: critical medium error, dev sdfs, sector 10299662504 [226804.178260] blk_update_request: critical medium error, dev dm-50, sector 10299662336 [226853.112990] LustreError: 1547:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3854336 GRANT, real grant 0 [226853.127123] LustreError: 1547:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 369 previous similar messages [227176.332223] sd 0:0:177:0: [sdfs] tag#6 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE [227176.340854] sd 0:0:177:0: [sdfs] tag#6 Sense Key : Medium Error [current] [descriptor] [227176.348957] sd 0:0:177:0: [sdfs] tag#6 Add. Sense: Unrecovered read error [227176.355841] sd 0:0:177:0: [sdfs] tag#6 CDB: Read(16) 88 00 00 00 00 02 65 f0 22 00 00 00 00 e0 00 00 [227176.365066] blk_update_request: critical medium error, dev sdfs, sector 10300170944 [227176.372846] blk_update_request: critical medium error, dev dm-50, sector 10300170752 [227179.370983] sd 0:0:177:0: [sdfs] tag#42 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE [227179.379713] sd 0:0:177:0: [sdfs] tag#42 Sense Key : Medium Error [current] [descriptor] [227179.387902] sd 0:0:177:0: [sdfs] tag#42 Add. Sense: Unrecovered read error [227179.394879] sd 0:0:177:0: [sdfs] tag#42 CDB: Read(16) 88 00 00 00 00 02 65 f0 22 80 00 00 00 60 00 00 [227179.404192] blk_update_request: critical medium error, dev sdfs, sector 10300170944 [227179.411959] blk_update_request: critical medium error, dev dm-50, sector 10300170944 [227179.708419] md/raid:md3: read error corrected (8 sectors at 10300170944 on dm-50) [227179.715996] md/raid:md3: read error corrected (8 sectors at 10300170952 on dm-50) [227179.723574] md/raid:md3: read error corrected (8 sectors at 10300170960 on dm-50) [227179.731154] md/raid:md3: read error corrected (8 sectors at 10300170968 on dm-50) [227455.063154] LustreError: 24816:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3919872 GRANT, real grant 0 [227455.077317] LustreError: 24816:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 377 previous similar messages [228057.441325] LustreError: 99695:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3354624 GRANT, real grant 0 [228057.455569] LustreError: 99695:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 378 previous similar messages [228663.106259] LustreError: 87191:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3764224 GRANT, real grant 0 [228663.120430] LustreError: 87191:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 386 previous similar messages [229269.679747] LustreError: 128680:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4046848 GRANT, real grant 0 [229269.694005] LustreError: 128680:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 360 previous similar messages [229870.972721] LustreError: 99696:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3248128 GRANT, real grant 0 [229870.986914] LustreError: 99696:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 192 previous similar messages [230482.510663] LustreError: 86861:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 552960 GRANT, real grant 0 [230482.524745] LustreError: 86861:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 183 previous similar messages [231087.112206] LustreError: 86769:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 4390912 GRANT, real grant 0 [231087.126461] LustreError: 86769:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 267 previous similar messages [231688.963865] LustreError: 87174:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [231688.978057] LustreError: 87174:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 300 previous similar messages [232289.937115] LustreError: 87942:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3821568 GRANT, real grant 0 [232289.951301] LustreError: 87942:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 345 previous similar messages [232900.196352] LustreError: 67786:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0024: cli 6ea10cfc-48e7-f6e7-b834-4eb6674e3061 claims 4153344 GRANT, real grant 0 [232900.210529] LustreError: 67786:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 358 previous similar messages [233503.616991] LustreError: 13640:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4190208 GRANT, real grant 0 [233503.631196] LustreError: 13640:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 307 previous similar messages [234105.867046] LustreError: 29525:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0024: cli ff229835-b050-95f2-4a86-35428cf816bd claims 1257472 GRANT, real grant 0 [234105.881331] LustreError: 29525:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 514 previous similar messages [234707.488172] LustreError: 86790:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002f: cli aecec54c-c922-2a32-e90d-f9ec22e83d8e claims 401408 GRANT, real grant 0 [234707.502263] LustreError: 86790:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 1191 previous similar messages [235325.044062] LustreError: 128973:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0024: cli 6ea10cfc-48e7-f6e7-b834-4eb6674e3061 claims 4177920 GRANT, real grant 0 [235325.058423] LustreError: 128973:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 609 previous similar messages [235936.108236] LustreError: 87174:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3858432 GRANT, real grant 0 [235936.122439] LustreError: 87174:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 127 previous similar messages [236538.284487] LustreError: 87566:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3870720 GRANT, real grant 0 [236538.298724] LustreError: 87566:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 196 previous similar messages [237141.112455] LustreError: 87543:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3911680 GRANT, real grant 0 [237141.126726] LustreError: 87543:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 311 previous similar messages [237745.389511] LustreError: 86785:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [237745.403718] LustreError: 86785:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 298 previous similar messages [238347.649581] LustreError: 128021:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [238347.663839] LustreError: 128021:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 353 previous similar messages [238832.561641] LNetError: 72389:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [238832.574006] LNetError: 72389:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 1 previous similar message [238957.439906] LustreError: 87333:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [238957.454194] LustreError: 87333:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 375 previous similar messages [239030.323219] LNetError: 72392:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [239030.335568] LNetError: 72392:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 2 previous similar messages [239112.717264] LNetError: 72379:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [239338.505206] LNetError: 72381:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [239504.535832] LNetError: 72379:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [239504.548219] LNetError: 72379:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 1 previous similar message [239560.202546] LustreError: 99685:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3735552 GRANT, real grant 0 [239560.216738] LustreError: 99685:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 347 previous similar messages [239905.274303] LNetError: 72387:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [240021.538786] Lustre: fir-OST0027: haven't heard from client 1346efb5-101b-3738-d341-3ea5ef4570b8 (at 10.8.23.14@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e72b1f21400, cur 1558984838 expire 1558984688 last 1558984611 [240022.538912] Lustre: fir-OST002c: haven't heard from client 1346efb5-101b-3738-d341-3ea5ef4570b8 (at 10.8.23.14@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e5e092a2400, cur 1558984839 expire 1558984689 last 1558984612 [240022.560717] Lustre: Skipped 5 previous similar messages [240029.538811] Lustre: fir-OST002f: haven't heard from client 1346efb5-101b-3738-d341-3ea5ef4570b8 (at 10.8.23.14@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e9223951000, cur 1558984846 expire 1558984696 last 1558984619 [240029.560611] Lustre: Skipped 3 previous similar messages [240161.004205] LustreError: 99678:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 4333568 GRANT, real grant 0 [240161.018395] LustreError: 99678:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 382 previous similar messages [240773.861943] LustreError: 24812:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3944448 GRANT, real grant 0 [240773.876134] LustreError: 24812:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 273 previous similar messages [240874.488841] LNetError: 72387:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [240874.501202] LNetError: 72387:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 1 previous similar message [241374.510308] LustreError: 87331:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3895296 GRANT, real grant 0 [241374.524501] LustreError: 87331:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 306 previous similar messages [241612.744403] LNetError: 72380:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [241612.756874] LNetError: 72380:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 4 previous similar messages [241843.437853] Lustre: fir-OST0025: Connection restored to (at 10.8.23.14@o2ib6) [241843.445199] Lustre: Skipped 5 previous similar messages [241918.613777] Lustre: fir-OST0026: Connection restored to (at 10.8.23.14@o2ib6) [241918.621121] Lustre: Skipped 5 previous similar messages [241978.910009] LustreError: 86825:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3993600 GRANT, real grant 0 [241978.924944] LustreError: 86825:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 235 previous similar messages [242312.817150] LNetError: 72391:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [242582.613598] LustreError: 125952:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 1658880 GRANT, real grant 0 [242582.627879] LustreError: 125952:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 289 previous similar messages [243186.069633] LustreError: 87514:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3895296 GRANT, real grant 0 [243186.083827] LustreError: 87514:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 244 previous similar messages [243273.652786] LNetError: 72388:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [243273.665152] LNetError: 72388:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 1 previous similar message [243790.993104] LustreError: 87183:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3932160 GRANT, real grant 0 [243791.007299] LustreError: 87183:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 259 previous similar messages [244194.246443] LNetError: 72383:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [244194.258794] LNetError: 72383:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 3 previous similar messages [244392.398720] LustreError: 87595:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 4218880 GRANT, real grant 0 [244392.412929] LustreError: 87595:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 365 previous similar messages [244832.692728] LNetError: 72386:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [244832.705085] LNetError: 72386:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 2 previous similar messages [244999.425492] LustreError: 67783:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0024: cli 6ea10cfc-48e7-f6e7-b834-4eb6674e3061 claims 4075520 GRANT, real grant 0 [244999.439696] LustreError: 67783:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 306 previous similar messages [245604.194130] LustreError: 67789:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0024: cli 6ea10cfc-48e7-f6e7-b834-4eb6674e3061 claims 4390912 GRANT, real grant 0 [245604.208328] LustreError: 67789:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 238 previous similar messages [245962.772984] LNetError: 72380:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [245962.785432] LNetError: 72380:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 1 previous similar message [246214.746563] LustreError: 24817:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0024: cli 6ea10cfc-48e7-f6e7-b834-4eb6674e3061 claims 4341760 GRANT, real grant 0 [246214.760775] LustreError: 24817:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 116 previous similar messages [246685.049180] LNetError: 72379:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [246685.061610] LNetError: 72379:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 1 previous similar message [246827.133537] LustreError: 24682:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0029: cli ecaf3ea1-3d24-ab9f-6856-0bf7294c7cf4 claims 360448 GRANT, real grant 0 [246827.147644] LustreError: 24682:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 147 previous similar messages [247442.632176] LustreError: 25134:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3854336 GRANT, real grant 0 [247442.646364] LustreError: 25134:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 127 previous similar messages [247963.406968] LNetError: 72392:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [247963.419321] LNetError: 72392:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 2 previous similar messages [248045.500528] LustreError: 128744:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 2789376 GRANT, real grant 0 [248045.514797] LustreError: 128744:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 188 previous similar messages [248657.623838] LustreError: 125966:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3989504 GRANT, real grant 0 [248657.638305] LustreError: 125966:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 273 previous similar messages [248779.250317] LNetError: 72389:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [248779.262681] LNetError: 72389:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 1 previous similar message [249111.109878] LNetError: 72388:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [249274.599743] LustreError: 14368:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3919872 GRANT, real grant 0 [249274.613993] LustreError: 14368:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 275 previous similar messages [249762.275735] LNetError: 72388:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [249884.359081] LustreError: 87691:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 4415488 GRANT, real grant 0 [249884.373278] LustreError: 87691:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 240 previous similar messages [250489.601355] LustreError: 99685:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3895296 GRANT, real grant 0 [250489.615554] LustreError: 99685:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 266 previous similar messages [250861.517535] LNetError: 72390:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [251092.731200] LustreError: 87942:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3801088 GRANT, real grant 0 [251092.745409] LustreError: 87942:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 243 previous similar messages [251695.733893] LustreError: 128021:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [251695.748161] LustreError: 128021:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 235 previous similar messages [251918.633214] LNetError: 72380:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [252092.930123] LNetError: 72390:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [252109.458081] LNetError: 72388:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [252296.686726] LustreError: 49692:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3686400 GRANT, real grant 0 [252296.700917] LustreError: 49692:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 252 previous similar messages [252381.054787] LNetError: 72379:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [252432.639149] LNetError: 72393:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [252648.486941] LNetError: 72382:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [252900.947417] LustreError: 87180:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [252900.961604] LustreError: 87180:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 268 previous similar messages [253092.860085] Lustre: fir-OST0029: Client 87da5719-38f8-e25f-27bd-899baebba0f4 (at 10.8.0.65@o2ib6) reconnecting [253092.870515] Lustre: fir-OST0029: Connection restored to 87da5719-38f8-e25f-27bd-899baebba0f4 (at 10.8.0.65@o2ib6) [253434.148738] LNetError: 72389:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [253439.878881] LNetError: 72388:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [253510.819525] LustreError: 92465:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3977216 GRANT, real grant 0 [253510.833709] LustreError: 92465:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 244 previous similar messages [254068.390874] LNetError: 72380:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [254112.725761] LustreError: 67772:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [254112.739949] LustreError: 67772:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 240 previous similar messages [254222.090025] LNetError: 72378:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [254728.705449] LustreError: 87517:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 2789376 GRANT, real grant 0 [254728.719629] LustreError: 87517:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 230 previous similar messages [255000.208400] LNetError: 72381:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [255337.996952] LustreError: 87687:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [255338.011142] LustreError: 87687:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 170 previous similar messages [255525.968727] LNetError: 72389:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [255545.615490] LNetError: 72390:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [255662.968530] LNetError: 72378:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [255804.618273] LNetError: 72389:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [255850.494569] Lustre: fir-OST0029: Client fc977666-c4b6-3fe0-db30-e6c45f1ae23e (at 10.8.0.66@o2ib6) reconnecting [255850.505514] Lustre: fir-OST0029: Connection restored to (at 10.8.0.66@o2ib6) [255932.026824] LNetError: 72381:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [255939.241198] LustreError: 96018:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [255939.255416] LustreError: 96018:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 203 previous similar messages [256385.098907] LNetError: 72387:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [256562.316748] LustreError: 67751:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 1658880 GRANT, real grant 0 [256562.330934] LustreError: 67751:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 181 previous similar messages [256883.931674] LNetError: 72387:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [257164.138675] LustreError: 67769:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3878912 GRANT, real grant 0 [257164.152895] LustreError: 67769:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 202 previous similar messages [257774.659864] LustreError: 87993:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3854336 GRANT, real grant 0 [257774.674059] LustreError: 87993:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 233 previous similar messages [258390.707771] LustreError: 92468:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0024: cli 6ea10cfc-48e7-f6e7-b834-4eb6674e3061 claims 1658880 GRANT, real grant 0 [258390.721974] LustreError: 92468:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 224 previous similar messages [259000.100074] LustreError: 87519:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0024: cli 6ea10cfc-48e7-f6e7-b834-4eb6674e3061 claims 4067328 GRANT, real grant 0 [259000.114296] LustreError: 87519:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 238 previous similar messages [259616.844113] LustreError: 87609:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3919872 GRANT, real grant 0 [259616.858302] LustreError: 87609:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 234 previous similar messages [259891.896322] LNetError: 72393:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [260231.729812] LustreError: 86825:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0024: cli 6ea10cfc-48e7-f6e7-b834-4eb6674e3061 claims 4202496 GRANT, real grant 0 [260231.744007] LustreError: 86825:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 246 previous similar messages [260832.009579] LustreError: 86771:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0024: cli 6ea10cfc-48e7-f6e7-b834-4eb6674e3061 claims 991232 GRANT, real grant 0 [260832.023686] LustreError: 86771:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 280 previous similar messages [261448.377773] LustreError: 88144:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3870720 GRANT, real grant 0 [261448.391980] LustreError: 88144:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 296 previous similar messages [261702.355587] LNetError: 72388:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [262054.757451] LustreError: 92465:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0024: cli 6ea10cfc-48e7-f6e7-b834-4eb6674e3061 claims 3858432 GRANT, real grant 0 [262054.771626] LustreError: 92465:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 352 previous similar messages [262432.645315] Lustre: fir-OST002a: haven't heard from client 87da5719-38f8-e25f-27bd-899baebba0f4 (at 10.8.0.65@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e6a5f3b9400, cur 1559007249 expire 1559007099 last 1559007022 [262432.667035] Lustre: Skipped 1 previous similar message [262450.644991] Lustre: fir-OST002b: haven't heard from client 87da5719-38f8-e25f-27bd-899baebba0f4 (at 10.8.0.65@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e9af9fc2000, cur 1559007267 expire 1559007117 last 1559007040 [262452.644736] Lustre: fir-OST0026: haven't heard from client 87da5719-38f8-e25f-27bd-899baebba0f4 (at 10.8.0.65@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e7a85717c00, cur 1559007269 expire 1559007119 last 1559007042 [262452.666462] Lustre: Skipped 1 previous similar message [262465.655812] Lustre: fir-OST0029: haven't heard from client 87da5719-38f8-e25f-27bd-899baebba0f4 (at 10.8.0.65@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e7a8a42e800, cur 1559007282 expire 1559007132 last 1559007055 [262465.677527] Lustre: Skipped 2 previous similar messages [262535.918286] Lustre: fir-OST002a: Connection restored to 87da5719-38f8-e25f-27bd-899baebba0f4 (at 10.8.0.65@o2ib6) [262544.335951] Lustre: fir-OST0029: Connection restored to 87da5719-38f8-e25f-27bd-899baebba0f4 (at 10.8.0.65@o2ib6) [262544.336122] Lustre: fir-OST002e: Client 87da5719-38f8-e25f-27bd-899baebba0f4 (at 10.8.0.65@o2ib6) reconnecting [262544.356409] Lustre: Skipped 5 previous similar messages [262545.095743] LNetError: 72378:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [262654.773052] LustreError: 49690:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [262654.787237] LustreError: 49690:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 392 previous similar messages [262762.646593] Lustre: fir-OST002a: haven't heard from client 87da5719-38f8-e25f-27bd-899baebba0f4 (at 10.8.0.65@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e7623113400, cur 1559007579 expire 1559007429 last 1559007352 [262770.648763] Lustre: fir-OST0029: haven't heard from client 87da5719-38f8-e25f-27bd-899baebba0f4 (at 10.8.0.65@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e87465a7c00, cur 1559007587 expire 1559007437 last 1559007360 [262770.670533] Lustre: Skipped 10 previous similar messages [262814.138954] Lustre: fir-OST0024: Connection restored to 87da5719-38f8-e25f-27bd-899baebba0f4 (at 10.8.0.65@o2ib6) [262814.149310] Lustre: Skipped 10 previous similar messages [262839.812467] Lustre: fir-OST0028: Connection restored to 87da5719-38f8-e25f-27bd-899baebba0f4 (at 10.8.0.65@o2ib6) [262981.624822] Lustre: fir-OST002f: Client 87da5719-38f8-e25f-27bd-899baebba0f4 (at 10.8.0.65@o2ib6) reconnecting [262981.634919] Lustre: Skipped 4 previous similar messages [262981.640265] Lustre: fir-OST002f: Connection restored to 87da5719-38f8-e25f-27bd-899baebba0f4 (at 10.8.0.65@o2ib6) [262992.559364] Lustre: fir-OST0025: Client 87da5719-38f8-e25f-27bd-899baebba0f4 (at 10.8.0.65@o2ib6) reconnecting [262992.560378] Lustre: fir-OST0026: Connection restored to 87da5719-38f8-e25f-27bd-899baebba0f4 (at 10.8.0.65@o2ib6) [262992.560380] Lustre: Skipped 1 previous similar message [262992.585019] Lustre: Skipped 3 previous similar messages [262999.234123] Lustre: fir-OST0029: Client 87da5719-38f8-e25f-27bd-899baebba0f4 (at 10.8.0.65@o2ib6) reconnecting [262999.244213] Lustre: Skipped 1 previous similar message [263003.262459] Lustre: fir-OST0024: Client 87da5719-38f8-e25f-27bd-899baebba0f4 (at 10.8.0.65@o2ib6) reconnecting [263003.272554] Lustre: Skipped 1 previous similar message [263016.399137] Lustre: fir-OST002d: Client 87da5719-38f8-e25f-27bd-899baebba0f4 (at 10.8.0.65@o2ib6) reconnecting [263016.399372] Lustre: fir-OST002f: Connection restored to 87da5719-38f8-e25f-27bd-899baebba0f4 (at 10.8.0.65@o2ib6) [263016.399374] Lustre: Skipped 9 previous similar messages [263016.424898] Lustre: Skipped 4 previous similar messages [263046.023207] Lustre: fir-OST0025: Client 87da5719-38f8-e25f-27bd-899baebba0f4 (at 10.8.0.65@o2ib6) reconnecting [263046.023208] Lustre: fir-OST0026: Client 87da5719-38f8-e25f-27bd-899baebba0f4 (at 10.8.0.65@o2ib6) reconnecting [263046.043383] Lustre: Skipped 7 previous similar messages [263210.001466] LNetError: 72386:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [263259.311513] LustreError: 87203:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3883008 GRANT, real grant 0 [263259.325686] LustreError: 87203:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 330 previous similar messages [263870.415754] LustreError: 16614:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 4231168 GRANT, real grant 0 [263870.429946] LustreError: 16614:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 285 previous similar messages [263966.122152] Lustre: fir-OST002c: Client fdc52cb1-2cc9-0d98-0f2b-dc082fc53acc (at 10.8.8.37@o2ib6) reconnecting [263966.122153] Lustre: fir-OST0028: Client fdc52cb1-2cc9-0d98-0f2b-dc082fc53acc (at 10.8.8.37@o2ib6) reconnecting [263966.122168] Lustre: fir-OST0028: Connection restored to (at 10.8.8.37@o2ib6) [263966.122170] Lustre: Skipped 10 previous similar messages [263966.154973] Lustre: Skipped 2 previous similar messages [264067.523590] Lustre: fir-OST002c: Client fdc52cb1-2cc9-0d98-0f2b-dc082fc53acc (at 10.8.8.37@o2ib6) reconnecting [264067.533681] Lustre: Skipped 8 previous similar messages [264067.539024] Lustre: fir-OST002c: Connection restored to (at 10.8.8.37@o2ib6) [264067.546247] Lustre: Skipped 11 previous similar messages [264097.943879] Lustre: fir-OST0028: Client fdc52cb1-2cc9-0d98-0f2b-dc082fc53acc (at 10.8.8.37@o2ib6) reconnecting [264097.953986] Lustre: fir-OST0028: Connection restored to (at 10.8.8.37@o2ib6) [264192.656098] Lustre: fir-OST0026: haven't heard from client fdc52cb1-2cc9-0d98-0f2b-dc082fc53acc (at 10.8.8.37@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e6a5e736000, cur 1559009009 expire 1559008859 last 1559008782 [264248.858664] Lustre: fir-OST0024: Connection restored to (at 10.8.8.37@o2ib6) [264248.865903] Lustre: Skipped 2 previous similar messages [264253.516227] Lustre: fir-OST0029: Client fdc52cb1-2cc9-0d98-0f2b-dc082fc53acc (at 10.8.8.37@o2ib6) reconnecting [264253.526315] Lustre: Skipped 1 previous similar message [264299.967308] Lustre: fir-OST002c: Connection restored to (at 10.8.8.37@o2ib6) [264299.974540] Lustre: Skipped 9 previous similar messages [264375.246151] Lustre: fir-OST0026: Client fdc52cb1-2cc9-0d98-0f2b-dc082fc53acc (at 10.8.8.37@o2ib6) reconnecting [264375.246198] Lustre: fir-OST0024: Connection restored to (at 10.8.8.37@o2ib6) [264375.263484] Lustre: Skipped 11 previous similar messages [264471.277419] LustreError: 86856:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [264471.291609] LustreError: 86856:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 363 previous similar messages [264802.446853] LNetError: 72389:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [265073.635510] LustreError: 12926:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3989504 GRANT, real grant 0 [265073.649716] LustreError: 12926:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 319 previous similar messages [265675.022144] LustreError: 87690:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3891200 GRANT, real grant 0 [265675.036343] LustreError: 87690:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 287 previous similar messages [265775.686608] LNetError: 72379:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [266279.307123] LustreError: 67753:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0029: cli ecaf3ea1-3d24-ab9f-6856-0bf7294c7cf4 claims 40960 GRANT, real grant 0 [266279.321152] LustreError: 67753:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 428 previous similar messages [266788.438135] LNetError: 72386:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [266883.246124] LustreError: 86772:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0029: cli ecaf3ea1-3d24-ab9f-6856-0bf7294c7cf4 claims 45056 GRANT, real grant 0 [266883.260151] LustreError: 86772:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 285 previous similar messages [267486.504853] LustreError: 67757:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [267486.519116] LustreError: 67757:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 186 previous similar messages [267547.829252] LNetError: 72388:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [267652.215614] LNetError: 72378:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [268087.088296] LustreError: 87514:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [268087.102479] LustreError: 87514:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 139 previous similar messages [268218.474495] LNetError: 72378:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [268340.328170] LNetError: 72390:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [268340.340515] LNetError: 72390:0:(lib-msg.c:811:lnet_is_health_check()) Skipped 1 previous similar message [268687.106582] LustreError: 87514:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4341760 GRANT, real grant 0 [268687.120758] LustreError: 87514:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 122 previous similar messages [268904.158344] LNetError: 72378:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [269092.871359] LNetError: 72378:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [269288.583247] LustreError: 86857:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [269288.597486] LustreError: 86857:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 93 previous similar messages [269295.709825] LNetError: 72378:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [269891.804363] LustreError: 67763:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002f: cli aecec54c-c922-2a32-e90d-f9ec22e83d8e claims 360448 GRANT, real grant 0 [269891.818469] LustreError: 67763:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 95 previous similar messages [270503.487198] LustreError: 67785:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3911680 GRANT, real grant 0 [270503.501542] LustreError: 67785:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 166 previous similar messages [271118.180070] LustreError: 25149:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0024: cli 6ea10cfc-48e7-f6e7-b834-4eb6674e3061 claims 3997696 GRANT, real grant 0 [271118.194249] LustreError: 25149:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 257 previous similar messages [271284.349153] LNetError: 72389:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [271727.009620] LustreError: 29526:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3936256 GRANT, real grant 0 [271727.023812] LustreError: 29526:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 246 previous similar messages [271994.676489] LNetError: 72389:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [272138.446403] LNetError: 72386:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [272346.122214] LustreError: 67761:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4190208 GRANT, real grant 0 [272346.136412] LustreError: 67761:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 232 previous similar messages [272670.700682] LNetError: 72390:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [272950.563964] LustreError: 87517:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 4218880 GRANT, real grant 0 [272950.578175] LustreError: 87517:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 283 previous similar messages [273499.610355] LNetError: 72383:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [273557.667588] LustreError: 75384:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3903488 GRANT, real grant 0 [273557.681777] LustreError: 75384:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 473 previous similar messages [273709.657109] LNetError: 72388:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [274007.634090] LNetError: 72380:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [274171.268852] LustreError: 87330:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0024: cli 6ea10cfc-48e7-f6e7-b834-4eb6674e3061 claims 4292608 GRANT, real grant 0 [274171.283132] LustreError: 87330:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 351 previous similar messages [274361.371494] LNetError: 72389:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [274772.380043] LustreError: 86855:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0024: cli 6ea10cfc-48e7-f6e7-b834-4eb6674e3061 claims 552960 GRANT, real grant 0 [274772.394126] LustreError: 86855:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 273 previous similar messages [274792.847494] LNetError: 72379:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [275172.003002] LNetError: 72389:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [275372.614191] LustreError: 67762:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 2793472 GRANT, real grant 0 [275372.628415] LustreError: 67762:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 339 previous similar messages [275591.593444] LNetError: 72387:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [275974.055745] LustreError: 92462:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3313664 GRANT, real grant 0 [275974.069956] LustreError: 92462:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 340 previous similar messages [275984.272791] LNetError: 72383:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [276129.170669] LNetError: 72379:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [276575.846693] LustreError: 128670:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [276575.860960] LustreError: 128670:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 293 previous similar messages [277183.399952] LustreError: 67761:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3870720 GRANT, real grant 0 [277183.414146] LustreError: 67761:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 294 previous similar messages [277257.662960] LNetError: 72381:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [277783.921586] LustreError: 128021:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3911680 GRANT, real grant 0 [277783.935848] LustreError: 128021:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 236 previous similar messages [278384.104372] LustreError: 128679:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0027: cli 8c5335a4-0990-f15a-e5ae-5c2f122b62dd claims 4218880 GRANT, real grant 0 [278384.118639] LustreError: 128679:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 676 previous similar messages [278657.725036] Lustre: fir-OST0025: haven't heard from client 579cb360-ee0e-d01b-59f9-15b905fcabe2 (at 10.8.10.20@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e7a88614c00, cur 1559023474 expire 1559023324 last 1559023247 [278657.746825] Lustre: Skipped 2 previous similar messages [278668.724933] Lustre: fir-OST002d: haven't heard from client 579cb360-ee0e-d01b-59f9-15b905fcabe2 (at 10.8.10.20@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e7a8e251800, cur 1559023485 expire 1559023335 last 1559023258 [278668.746724] Lustre: Skipped 1 previous similar message [278986.201212] LustreError: 87522:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3358720 GRANT, real grant 0 [278986.215495] LustreError: 87522:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 711 previous similar messages [279587.104226] LustreError: 128676:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3878912 GRANT, real grant 0 [279587.118489] LustreError: 128676:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 229 previous similar messages [280207.679508] LustreError: 87567:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3891200 GRANT, real grant 0 [280207.693734] LustreError: 87567:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 276 previous similar messages [280810.451448] LustreError: 86823:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3809280 GRANT, real grant 0 [280810.465608] LustreError: 86823:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 325 previous similar messages [281411.174948] LustreError: 86804:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [281411.189178] LustreError: 86804:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 184 previous similar messages [282031.720329] LustreError: 87541:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4374528 GRANT, real grant 0 [282031.734561] LustreError: 87541:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 200 previous similar messages [282634.494241] LustreError: 87977:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3911680 GRANT, real grant 0 [282634.508428] LustreError: 87977:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 193 previous similar messages [283245.626452] LustreError: 88138:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3878912 GRANT, real grant 0 [283245.640622] LustreError: 88138:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 194 previous similar messages [283861.575848] LustreError: 99692:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3895296 GRANT, real grant 0 [283861.590060] LustreError: 99692:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 197 previous similar messages [284249.755391] Lustre: fir-OST002d: haven't heard from client 912b1ef7-d590-8fe8-8893-2dcb8dc1fcf1 (at 10.9.101.12@o2ib4) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e7a8e1d2c00, cur 1559029066 expire 1559028916 last 1559028839 [284249.777319] Lustre: Skipped 9 previous similar messages [284463.335347] LustreError: 128686:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0024: cli 6ea10cfc-48e7-f6e7-b834-4eb6674e3061 claims 4005888 GRANT, real grant 0 [284463.349628] LustreError: 128686:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 218 previous similar messages [285063.355382] LustreError: 67766:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3866624 GRANT, real grant 0 [285063.369608] LustreError: 67766:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 318 previous similar messages [285676.772716] LustreError: 87177:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0024: cli 6ea10cfc-48e7-f6e7-b834-4eb6674e3061 claims 3985408 GRANT, real grant 0 [285676.786887] LustreError: 87177:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 276 previous similar messages [286059.273241] Lustre: fir-OST0025: Connection restored to (at 10.9.101.12@o2ib4) [286059.280653] Lustre: Skipped 10 previous similar messages [286134.540452] Lustre: fir-OST0024: Connection restored to (at 10.9.101.12@o2ib4) [286134.547975] Lustre: Skipped 5 previous similar messages [286281.457658] LustreError: 87194:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0024: cli 6ea10cfc-48e7-f6e7-b834-4eb6674e3061 claims 3969024 GRANT, real grant 0 [286281.471904] LustreError: 87194:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 365 previous similar messages [286883.375402] LustreError: 128678:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4341760 GRANT, real grant 0 [286883.389662] LustreError: 128678:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 427 previous similar messages [287486.672504] LustreError: 24682:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3911680 GRANT, real grant 0 [287486.686681] LustreError: 24682:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 426 previous similar messages [288094.842497] LustreError: 86856:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3866624 GRANT, real grant 0 [288094.856685] LustreError: 86856:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 229 previous similar messages [288697.614370] LustreError: 86825:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3276800 GRANT, real grant 0 [288697.628549] LustreError: 86825:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 356 previous similar messages [289312.541407] LustreError: 87973:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 4182016 GRANT, real grant 0 [289312.555607] LustreError: 87973:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 323 previous similar messages [289912.681029] LustreError: 67754:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3854336 GRANT, real grant 0 [289912.695393] LustreError: 67754:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 279 previous similar messages [290513.756945] LustreError: 67777:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 4390912 GRANT, real grant 0 [290513.771109] LustreError: 67777:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 270 previous similar messages [291119.259673] LustreError: 87592:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [291119.273842] LustreError: 87592:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 208 previous similar messages [291726.117696] LustreError: 99696:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3854336 GRANT, real grant 0 [291726.131881] LustreError: 99696:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 231 previous similar messages [292340.402724] LustreError: 128675:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3911680 GRANT, real grant 0 [292340.416986] LustreError: 128675:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 154 previous similar messages [292944.491244] LustreError: 86823:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3866624 GRANT, real grant 0 [292944.505446] LustreError: 86823:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 272 previous similar messages [293143.802903] Lustre: fir-OST0025: haven't heard from client 9dbb0c37-9f3a-e539-1dae-b4ddd105eb52 (at 10.9.112.13@o2ib4) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e75fea9f400, cur 1559037960 expire 1559037810 last 1559037733 [293143.824855] Lustre: Skipped 11 previous similar messages [293145.802456] Lustre: fir-OST002d: haven't heard from client 9dbb0c37-9f3a-e539-1dae-b4ddd105eb52 (at 10.9.112.13@o2ib4) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e73562eec00, cur 1559037962 expire 1559037812 last 1559037735 [293145.824369] Lustre: Skipped 6 previous similar messages [293545.064271] LustreError: 25151:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4333568 GRANT, real grant 0 [293545.078433] LustreError: 25151:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 282 previous similar messages [294145.209331] LustreError: 86823:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4247552 GRANT, real grant 0 [294145.223537] LustreError: 86823:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 237 previous similar messages [294746.816693] LustreError: 91040:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3895296 GRANT, real grant 0 [294746.831079] LustreError: 91040:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 109 previous similar messages [295348.276546] LustreError: 87373:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 1658880 GRANT, real grant 0 [295348.290730] LustreError: 87373:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 217 previous similar messages [295967.312524] LustreError: 87567:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0024: cli 6ea10cfc-48e7-f6e7-b834-4eb6674e3061 claims 4194304 GRANT, real grant 0 [295967.326758] LustreError: 87567:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 253 previous similar messages [296577.957977] LustreError: 128043:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4333568 GRANT, real grant 0 [296577.972267] LustreError: 128043:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 286 previous similar messages [297179.241758] LustreError: 1886:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3944448 GRANT, real grant 0 [297179.255874] LustreError: 1886:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 350 previous similar messages [297780.151113] LustreError: 31677:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0024: cli 6ea10cfc-48e7-f6e7-b834-4eb6674e3061 claims 4354048 GRANT, real grant 0 [297780.165278] LustreError: 31677:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 383 previous similar messages [298382.220210] LustreError: 128676:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3760128 GRANT, real grant 0 [298382.235504] LustreError: 128676:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 301 previous similar messages [298984.490601] LustreError: 1894:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [298984.504687] LustreError: 1894:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 395 previous similar messages [299586.589393] LustreError: 86781:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [299586.603604] LustreError: 86781:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 366 previous similar messages [300190.303873] LustreError: 92451:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [300190.318057] LustreError: 92451:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 418 previous similar messages [300791.411285] LustreError: 125965:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3284992 GRANT, real grant 0 [300791.425531] LustreError: 125965:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 238 previous similar messages [301401.266856] LustreError: 86832:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [301401.281023] LustreError: 86832:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 291 previous similar messages [302004.705067] LustreError: 67780:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 552960 GRANT, real grant 0 [302004.719492] LustreError: 67780:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 339 previous similar messages [302606.226303] LustreError: 99700:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [302606.240474] LustreError: 99700:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 212 previous similar messages [303208.880318] LustreError: 99699:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3911680 GRANT, real grant 0 [303208.894514] LustreError: 99699:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 228 previous similar messages [303823.763004] LustreError: 99680:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0024: cli 6ea10cfc-48e7-f6e7-b834-4eb6674e3061 claims 2211840 GRANT, real grant 0 [303823.777192] LustreError: 99680:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 284 previous similar messages [304426.358288] LustreError: 128676:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 2551808 GRANT, real grant 0 [304426.372564] LustreError: 128676:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 187 previous similar messages [305027.114362] LustreError: 86823:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 4218880 GRANT, real grant 0 [305027.128529] LustreError: 86823:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 214 previous similar messages [305629.456606] LustreError: 88144:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002d: cli ab79e19d-0a9d-29dd-3734-7953a41e2ead claims 36864 GRANT, real grant 0 [305629.470600] LustreError: 88144:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 304 previous similar messages [306229.988624] LustreError: 91040:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4128768 GRANT, real grant 0 [306230.002927] LustreError: 91040:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 376 previous similar messages [306834.318382] LustreError: 67783:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 4415488 GRANT, real grant 0 [306834.332544] LustreError: 67783:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 610 previous similar messages [307444.034763] LustreError: 75390:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4333568 GRANT, real grant 0 [307444.048930] LustreError: 75390:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 338 previous similar messages [308046.024168] LustreError: 29525:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [308046.038352] LustreError: 29525:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 321 previous similar messages [308649.246636] LustreError: 86785:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [308649.260824] LustreError: 86785:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 340 previous similar messages [309250.273830] LustreError: 84358:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 4218880 GRANT, real grant 0 [309250.287997] LustreError: 84358:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 586 previous similar messages [309463.931177] Lustre: fir-OST0029: haven't heard from client e3619986-57e5-2d1c-d037-0e3ae374bbd4 (at 10.8.26.4@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e5bfee82000, cur 1559054280 expire 1559054130 last 1559054053 [309463.952980] Lustre: Skipped 4 previous similar messages [309472.893837] Lustre: fir-OST002c: haven't heard from client e3619986-57e5-2d1c-d037-0e3ae374bbd4 (at 10.8.26.4@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e82a75f3400, cur 1559054289 expire 1559054139 last 1559054062 [309477.893476] Lustre: fir-OST0024: haven't heard from client e3619986-57e5-2d1c-d037-0e3ae374bbd4 (at 10.8.26.4@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e72ebe7c400, cur 1559054294 expire 1559054144 last 1559054067 [309853.142431] LustreError: 86788:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [309853.156642] LustreError: 86788:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 427 previous similar messages [310458.275932] LustreError: 87520:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0024: cli 6ea10cfc-48e7-f6e7-b834-4eb6674e3061 claims 4087808 GRANT, real grant 0 [310458.290105] LustreError: 87520:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 402 previous similar messages [311058.748684] LustreError: 128678:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002d: cli ab79e19d-0a9d-29dd-3734-7953a41e2ead claims 36864 GRANT, real grant 0 [311058.762782] LustreError: 128678:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 198 previous similar messages [311659.952437] LustreError: 128672:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 552960 GRANT, real grant 0 [311659.966699] LustreError: 128672:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 199 previous similar messages [311845.368508] Lustre: fir-OST0025: Connection restored to (at 10.8.26.4@o2ib6) [311845.375732] Lustre: Skipped 5 previous similar messages [311920.565788] Lustre: fir-OST0024: Connection restored to (at 10.8.26.4@o2ib6) [311920.573022] Lustre: Skipped 5 previous similar messages [312264.238899] LustreError: 96018:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0024: cli 6ea10cfc-48e7-f6e7-b834-4eb6674e3061 claims 3997696 GRANT, real grant 0 [312264.253058] LustreError: 96018:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 319 previous similar messages [312881.175227] LustreError: 1887:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 2740224 GRANT, real grant 0 [312881.189403] LustreError: 1887:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 332 previous similar messages [313482.123108] LustreError: 87993:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3780608 GRANT, real grant 0 [313482.137316] LustreError: 87993:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 196 previous similar messages [314084.988786] LustreError: 128687:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3858432 GRANT, real grant 0 [314085.003032] LustreError: 128687:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 196 previous similar messages [314694.574588] LustreError: 25151:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002d: cli ab79e19d-0a9d-29dd-3734-7953a41e2ead claims 36864 GRANT, real grant 0 [314694.588574] LustreError: 25151:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 218 previous similar messages [315297.527147] LustreError: 87193:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3842048 GRANT, real grant 0 [315297.541307] LustreError: 87193:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 232 previous similar messages [315898.451405] LustreError: 84358:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 4358144 GRANT, real grant 0 [315898.465570] LustreError: 84358:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 238 previous similar messages [316499.718233] LustreError: 99681:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3981312 GRANT, real grant 0 [316499.732408] LustreError: 99681:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 235 previous similar messages [316997.931337] Lustre: fir-OST002a: haven't heard from client 7b074a6a-71d1-b588-1012-cdc05d24d9a2 (at 10.9.106.1@o2ib4) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e736824c000, cur 1559061814 expire 1559061664 last 1559061587 [316997.953131] Lustre: Skipped 9 previous similar messages [317105.515919] LustreError: 86781:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3907584 GRANT, real grant 0 [317105.530126] LustreError: 86781:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 241 previous similar messages [317705.816221] LustreError: 84358:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3870720 GRANT, real grant 0 [317705.830410] LustreError: 84358:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 239 previous similar messages [318306.266919] LustreError: 99679:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 2826240 GRANT, real grant 0 [318306.281093] LustreError: 99679:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 254 previous similar messages [318906.826436] LustreError: 88144:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3846144 GRANT, real grant 0 [318906.840633] LustreError: 88144:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 233 previous similar messages [319523.437415] LustreError: 87572:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3952640 GRANT, real grant 0 [319523.451606] LustreError: 87572:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 238 previous similar messages [320128.547200] LustreError: 128043:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4145152 GRANT, real grant 0 [320128.561449] LustreError: 128043:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 222 previous similar messages [320390.948950] Lustre: fir-OST0028: haven't heard from client 96ecfb5d-12fa-85d7-ac84-9afc15a4bd2b (at 10.9.0.64@o2ib4) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e64e5e14000, cur 1559065207 expire 1559065057 last 1559064980 [320390.970686] Lustre: Skipped 47 previous similar messages [320489.012899] Lustre: fir-OST0025: Connection restored to 62eaee78-0f96-7d84-182a-31c450135ed2 (at 10.9.105.12@o2ib4) [320489.023426] Lustre: Skipped 5 previous similar messages [320564.223173] Lustre: fir-OST0024: Connection restored to 62eaee78-0f96-7d84-182a-31c450135ed2 (at 10.9.105.12@o2ib4) [320564.233704] Lustre: Skipped 4 previous similar messages [320605.498970] Lustre: fir-OST0025: Connection restored to (at 10.9.106.1@o2ib4) [320605.506299] Lustre: Skipped 5 previous similar messages [320680.734944] Lustre: fir-OST0024: Connection restored to (at 10.9.106.1@o2ib4) [320680.742276] Lustre: Skipped 5 previous similar messages [320730.159510] LustreError: 128742:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [320730.173826] LustreError: 128742:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 265 previous similar messages [320864.378572] Lustre: fir-OST0025: Connection restored to (at 10.9.106.54@o2ib4) [320864.385975] Lustre: Skipped 5 previous similar messages [320939.602511] Lustre: fir-OST0026: Connection restored to (at 10.9.106.54@o2ib4) [320939.609911] Lustre: Skipped 5 previous similar messages [321022.253274] Lustre: fir-OST0025: Connection restored to (at 10.9.112.1@o2ib4) [321022.260599] Lustre: Skipped 5 previous similar messages [321097.489923] Lustre: fir-OST0024: Connection restored to (at 10.9.112.1@o2ib4) [321097.497254] Lustre: Skipped 3 previous similar messages [321338.606623] LustreError: 13641:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [321338.620785] LustreError: 13641:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 400 previous similar messages [321939.478793] LustreError: 87200:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3895296 GRANT, real grant 0 [321939.492976] LustreError: 87200:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 351 previous similar messages [322544.293274] LustreError: 87195:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 1695744 GRANT, real grant 0 [322544.307439] LustreError: 87195:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 272 previous similar messages [323144.607599] LustreError: 86772:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 2764800 GRANT, real grant 0 [323144.622024] LustreError: 86772:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 293 previous similar messages [323745.273393] LustreError: 86460:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002f: cli 75c31e1e-77de-1d06-3ba1-5bf70911b79e claims 4218880 GRANT, real grant 0 [323745.287578] LustreError: 86460:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 290 previous similar messages [324345.917466] LustreError: 67791:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 4149248 GRANT, real grant 0 [324345.931631] LustreError: 67791:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 377 previous similar messages [324951.154815] LustreError: 87513:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3854336 GRANT, real grant 0 [324951.169065] LustreError: 87513:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 226 previous similar messages [325020.723027] Lustre: fir-OST0025: Connection restored to (at 10.9.0.64@o2ib4) [325020.730295] Lustre: Skipped 7 previous similar messages [325097.250879] Lustre: fir-OST0024: Connection restored to (at 10.9.0.64@o2ib4) [325097.258109] Lustre: Skipped 5 previous similar messages [325555.379027] LustreError: 92468:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4104192 GRANT, real grant 0 [325555.393191] LustreError: 92468:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 237 previous similar messages [326158.209607] LustreError: 87973:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0024: cli 6ea10cfc-48e7-f6e7-b834-4eb6674e3061 claims 4390912 GRANT, real grant 0 [326158.223810] LustreError: 87973:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 323 previous similar messages [326773.552900] LustreError: 126890:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0024: cli 6ea10cfc-48e7-f6e7-b834-4eb6674e3061 claims 4194304 GRANT, real grant 0 [326773.567217] LustreError: 126890:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 307 previous similar messages [327373.727272] LustreError: 75388:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 4440064 GRANT, real grant 0 [327373.741465] LustreError: 75388:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 328 previous similar messages [327982.143992] LustreError: 87184:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [327982.158180] LustreError: 87184:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 262 previous similar messages [328585.477245] LustreError: 86776:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3870720 GRANT, real grant 0 [328585.491493] LustreError: 86776:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 242 previous similar messages [329186.880329] LustreError: 67751:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3895296 GRANT, real grant 0 [329186.894514] LustreError: 67751:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 179 previous similar messages [329301.103595] Lustre: fir-OST0024: Client ebb0ff39-b00e-6e1a-c25b-64754a77a1b9 (at 10.8.0.82@o2ib6) reconnecting [329301.113718] Lustre: Skipped 2 previous similar messages [329301.119079] Lustre: fir-OST0024: Connection restored to ebb0ff39-b00e-6e1a-c25b-64754a77a1b9 (at 10.8.0.82@o2ib6) [329307.217678] Lustre: fir-OST002d: Connection restored to ebb0ff39-b00e-6e1a-c25b-64754a77a1b9 (at 10.8.0.82@o2ib6) [329307.228051] Lustre: Skipped 1 previous similar message [329354.033760] Lustre: fir-OST0027: Client ebb0ff39-b00e-6e1a-c25b-64754a77a1b9 (at 10.8.0.82@o2ib6) reconnecting [329354.043856] Lustre: Skipped 5 previous similar messages [329354.051389] Lustre: fir-OST0027: Connection restored to ebb0ff39-b00e-6e1a-c25b-64754a77a1b9 (at 10.8.0.82@o2ib6) [329354.061742] Lustre: Skipped 3 previous similar messages [329787.336796] LustreError: 87333:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 2764800 GRANT, real grant 0 [329787.350960] LustreError: 87333:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 229 previous similar messages [330397.609951] LustreError: 99685:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3870720 GRANT, real grant 0 [330397.624272] LustreError: 99685:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 332 previous similar messages [330998.000495] LustreError: 31678:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3907584 GRANT, real grant 0 [330998.014678] LustreError: 31678:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 259 previous similar messages [331598.549771] LustreError: 952:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3870720 GRANT, real grant 0 [331598.563792] LustreError: 952:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 197 previous similar messages [332201.848904] LustreError: 87181:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0024: cli 6ea10cfc-48e7-f6e7-b834-4eb6674e3061 claims 552960 GRANT, real grant 0 [332201.863060] LustreError: 87181:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 128 previous similar messages [332824.803279] LustreError: 87592:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3870720 GRANT, real grant 0 [332824.817441] LustreError: 87592:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 169 previous similar messages [333360.017934] Lustre: fir-OST0028: haven't heard from client 55d04c32-11a2-6a12-8931-7a6f8ebd2cb2 (at 10.8.14.7@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e8aabe6cc00, cur 1559078176 expire 1559078026 last 1559077949 [333360.039686] Lustre: Skipped 11 previous similar messages [333430.505648] LustreError: 99683:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3944448 GRANT, real grant 0 [333430.519882] LustreError: 99683:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 139 previous similar messages [334033.530756] LustreError: 87181:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0024: cli 6ea10cfc-48e7-f6e7-b834-4eb6674e3061 claims 774144 GRANT, real grant 0 [334033.544828] LustreError: 87181:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 149 previous similar messages [334636.999598] LustreError: 86775:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4022272 GRANT, real grant 0 [334637.013807] LustreError: 86775:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 169 previous similar messages [335245.683984] LustreError: 96016:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3854336 GRANT, real grant 0 [335245.698145] LustreError: 96016:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 293 previous similar messages [335852.275208] LustreError: 99683:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3907584 GRANT, real grant 0 [335852.289420] LustreError: 99683:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 303 previous similar messages [336453.361126] LustreError: 87175:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3911680 GRANT, real grant 0 [336453.375306] LustreError: 87175:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 307 previous similar messages [336623.035861] Lustre: fir-OST002e: haven't heard from client f1ee4071-ebc6-bf81-c7b9-fdf4a07cb1d8 (at 10.8.26.33@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e7365bcb400, cur 1559081439 expire 1559081289 last 1559081212 [336623.057662] Lustre: Skipped 11 previous similar messages [336633.034472] Lustre: fir-OST0024: haven't heard from client f1ee4071-ebc6-bf81-c7b9-fdf4a07cb1d8 (at 10.8.26.33@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e73643d9800, cur 1559081449 expire 1559081299 last 1559081222 [336633.056329] Lustre: Skipped 1 previous similar message [336639.033877] Lustre: fir-OST002a: haven't heard from client f1ee4071-ebc6-bf81-c7b9-fdf4a07cb1d8 (at 10.8.26.33@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e842d47c400, cur 1559081455 expire 1559081305 last 1559081228 [336639.055735] Lustre: Skipped 5 previous similar messages [336885.463178] Lustre: fir-OST0025: Connection restored to (at 10.9.101.40@o2ib4) [336885.470713] Lustre: Skipped 5 previous similar messages [336932.538914] Lustre: fir-OST0025: Connection restored to (at 10.9.112.13@o2ib4) [336932.546337] Lustre: Skipped 11 previous similar messages [336960.688504] Lustre: fir-OST0024: Connection restored to (at 10.9.101.40@o2ib4) [336960.695914] Lustre: Skipped 5 previous similar messages [336984.033017] Lustre: fir-OST0025: Connection restored to (at 10.8.15.7@o2ib6) [336984.040253] Lustre: Skipped 9 previous similar messages [337007.782972] Lustre: fir-OST0024: Connection restored to (at 10.9.112.13@o2ib4) [337007.790375] Lustre: Skipped 4 previous similar messages [337054.079611] LustreError: 74309:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3870720 GRANT, real grant 0 [337054.093781] LustreError: 74309:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 322 previous similar messages [337059.289323] Lustre: fir-OST0024: Connection restored to (at 10.8.15.7@o2ib6) [337059.296560] Lustre: Skipped 18 previous similar messages [337136.071289] Lustre: fir-OST0025: Connection restored to (at 10.8.15.4@o2ib6) [337136.078525] Lustre: Skipped 29 previous similar messages [337290.323439] Lustre: fir-OST0026: Connection restored to 6b2680d5-bdc9-ca83-2c96-fb6c2ef38f1a (at 10.8.9.8@o2ib6) [337290.323440] Lustre: fir-OST0024: Connection restored to 6b2680d5-bdc9-ca83-2c96-fb6c2ef38f1a (at 10.8.9.8@o2ib6) [337290.323443] Lustre: Skipped 36 previous similar messages [337290.349361] Lustre: Skipped 3 previous similar messages [337654.702192] LustreError: 86861:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 2211840 GRANT, real grant 0 [337654.716431] LustreError: 86861:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 393 previous similar messages [337816.682267] Lustre: fir-OST0024: Connection restored to (at 10.8.14.1@o2ib6) [337816.689501] Lustre: Skipped 17 previous similar messages [338255.839485] LustreError: 84357:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3985408 GRANT, real grant 0 [338255.853657] LustreError: 84357:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 355 previous similar messages [338319.042750] Lustre: fir-OST002e: haven't heard from client dbdc59d3-fd23-f370-050c-e70c1db4ef52 (at 10.8.11.14@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e80c0151000, cur 1559083135 expire 1559082985 last 1559082908 [338319.064569] Lustre: Skipped 3 previous similar messages [338319.564823] Lustre: fir-OST002d: haven't heard from client dbdc59d3-fd23-f370-050c-e70c1db4ef52 (at 10.8.11.14@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e7f26271000, cur 1559083135 expire 1559082985 last 1559082908 [338319.586657] Lustre: Skipped 5 previous similar messages [338856.356073] LustreError: 87688:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3317760 GRANT, real grant 0 [338856.370243] LustreError: 87688:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 222 previous similar messages [339457.459570] LustreError: 35708:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 1662976 GRANT, real grant 0 [339457.473733] LustreError: 35708:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 157 previous similar messages [339931.046259] Lustre: fir-OST0026: haven't heard from client f08bd63b-d893-639c-0785-35d8cad2aae0 (at 10.9.112.15@o2ib4) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e86d4a05400, cur 1559084747 expire 1559084597 last 1559084520 [339931.068135] Lustre: Skipped 5 previous similar messages [340059.233791] LustreError: 99692:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3829760 GRANT, real grant 0 [340059.247967] LustreError: 99692:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 180 previous similar messages [340660.883508] LustreError: 67772:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3936256 GRANT, real grant 0 [340660.897826] LustreError: 67772:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 279 previous similar messages [340732.836382] Lustre: fir-OST0025: Connection restored to (at 10.8.15.10@o2ib6) [340732.843695] Lustre: Skipped 35 previous similar messages [340808.066544] Lustre: fir-OST0024: Connection restored to (at 10.8.15.10@o2ib6) [340808.073863] Lustre: Skipped 5 previous similar messages [341276.370750] LustreError: 87331:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3878912 GRANT, real grant 0 [341276.385087] LustreError: 87331:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 274 previous similar messages [341797.260384] Lustre: fir-OST0025: Connection restored to (at 10.9.105.45@o2ib4) [341797.267781] Lustre: Skipped 4 previous similar messages [341872.408307] Lustre: fir-OST0024: Connection restored to (at 10.9.105.45@o2ib4) [341872.415716] Lustre: Skipped 5 previous similar messages [341880.718395] LustreError: 99696:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3870720 GRANT, real grant 0 [341880.732585] LustreError: 99696:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 242 previous similar messages [342489.112615] LustreError: 87372:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002d: cli ab79e19d-0a9d-29dd-3734-7953a41e2ead claims 86016 GRANT, real grant 0 [342489.126619] LustreError: 87372:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 242 previous similar messages [343098.680450] LustreError: 99700:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4063232 GRANT, real grant 0 [343098.694633] LustreError: 99700:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 223 previous similar messages [343384.699137] Lustre: fir-OST0025: Connection restored to f1e5782e-af19-ddf0-2ad1-8301912a2327 (at 10.8.17.29@o2ib6) [343384.709571] Lustre: Skipped 5 previous similar messages [343459.853421] Lustre: fir-OST0024: Connection restored to f1e5782e-af19-ddf0-2ad1-8301912a2327 (at 10.8.17.29@o2ib6) [343459.863885] Lustre: Skipped 4 previous similar messages [343709.529121] LustreError: 99681:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3870720 GRANT, real grant 0 [343709.543295] LustreError: 99681:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 265 previous similar messages [344310.560680] LustreError: 49692:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3858432 GRANT, real grant 0 [344310.574840] LustreError: 49692:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 282 previous similar messages [344911.440002] LustreError: 125963:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0024: cli 6ea10cfc-48e7-f6e7-b834-4eb6674e3061 claims 552960 GRANT, real grant 0 [344911.454173] LustreError: 125963:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 320 previous similar messages [345515.356220] LustreError: 31677:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 4218880 GRANT, real grant 0 [345515.370387] LustreError: 31677:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 357 previous similar messages [346119.387999] LustreError: 99685:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3854336 GRANT, real grant 0 [346119.402167] LustreError: 99685:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 314 previous similar messages [346178.074132] Lustre: fir-OST0024: haven't heard from client 51631ce2-6f91-ea9a-c8f6-2338bd80685f (at 10.8.2.19@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e8ad7bfe400, cur 1559090994 expire 1559090844 last 1559090767 [346178.095870] Lustre: Skipped 11 previous similar messages [346726.305667] LustreError: 99696:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3870720 GRANT, real grant 0 [346726.319833] LustreError: 99696:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 265 previous similar messages [347328.016770] LustreError: 92451:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3858432 GRANT, real grant 0 [347328.031054] LustreError: 92451:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 204 previous similar messages [347935.349794] LustreError: 86791:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3907584 GRANT, real grant 0 [347935.364038] LustreError: 86791:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 245 previous similar messages [348543.550669] LustreError: 87567:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3854336 GRANT, real grant 0 [348543.564848] LustreError: 87567:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 261 previous similar messages [349148.805883] LustreError: 31678:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [349148.820048] LustreError: 31678:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 200 previous similar messages [349759.793975] LustreError: 99682:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3977216 GRANT, real grant 0 [349759.808144] LustreError: 99682:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 474 previous similar messages [350111.405422] Lustre: fir-OST0025: Connection restored to (at 10.9.112.15@o2ib4) [350111.412825] Lustre: Skipped 5 previous similar messages [350186.644300] Lustre: fir-OST0024: Connection restored to (at 10.9.112.15@o2ib4) [350186.651718] Lustre: Skipped 6 previous similar messages [350360.447010] LustreError: 74313:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 4390912 GRANT, real grant 0 [350360.461263] LustreError: 74313:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 443 previous similar messages [350529.416312] Lustre: fir-OST0025: Connection restored to (at 10.8.11.14@o2ib6) [350529.423631] Lustre: Skipped 5 previous similar messages [350554.400246] Lustre: fir-OST0025: Connection restored to (at 10.8.2.19@o2ib6) [350554.407486] Lustre: Skipped 5 previous similar messages [350604.571744] Lustre: fir-OST0024: Connection restored to (at 10.8.11.14@o2ib6) [350604.579063] Lustre: Skipped 5 previous similar messages [350629.593737] Lustre: fir-OST0024: Connection restored to (at 10.8.2.19@o2ib6) [350629.600984] Lustre: Skipped 5 previous similar messages [350961.570846] LustreError: 67790:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3870720 GRANT, real grant 0 [350961.585143] LustreError: 67790:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 300 previous similar messages [351339.016851] Lustre: fir-OST0025: Connection restored to (at 10.8.26.33@o2ib6) [351339.024174] Lustre: Skipped 5 previous similar messages [351414.216369] Lustre: fir-OST0024: Connection restored to (at 10.8.26.33@o2ib6) [351414.223766] Lustre: Skipped 5 previous similar messages [351564.973117] LustreError: 92449:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [351564.987345] LustreError: 92449:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 236 previous similar messages [352167.047462] LustreError: 87972:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0024: cli 6ea10cfc-48e7-f6e7-b834-4eb6674e3061 claims 548864 GRANT, real grant 0 [352167.061557] LustreError: 87972:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 270 previous similar messages [352782.547649] LustreError: 84358:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3313664 GRANT, real grant 0 [352782.561834] LustreError: 84358:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 199 previous similar messages [353389.392709] LustreError: 87373:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3911680 GRANT, real grant 0 [353389.406880] LustreError: 87373:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 211 previous similar messages [353972.117505] Lustre: fir-OST0025: haven't heard from client bb6ea0ed-ec0b-5fdb-d834-ab756498f069 (at 10.8.23.12@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e730ae36000, cur 1559098788 expire 1559098638 last 1559098561 [353972.139326] Lustre: Skipped 11 previous similar messages [354006.199146] LustreError: 86796:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 1105920 GRANT, real grant 0 [354006.213343] LustreError: 86796:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 51 previous similar messages [354620.577058] LustreError: 35706:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 4390912 GRANT, real grant 0 [354620.591225] LustreError: 35706:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 72 previous similar messages [355226.443872] LustreError: 86804:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002d: cli ab79e19d-0a9d-29dd-3734-7953a41e2ead claims 61440 GRANT, real grant 0 [355226.457938] LustreError: 86804:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 158 previous similar messages [355821.515360] Lustre: fir-OST0025: Connection restored to (at 10.8.23.12@o2ib6) [355821.522704] Lustre: Skipped 5 previous similar messages [355830.559342] LustreError: 67769:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002d: cli ab79e19d-0a9d-29dd-3734-7953a41e2ead claims 36864 GRANT, real grant 0 [355830.573382] LustreError: 67769:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 144 previous similar messages [355896.786487] Lustre: fir-OST0024: Connection restored to (at 10.8.23.12@o2ib6) [355896.793805] Lustre: Skipped 5 previous similar messages [356436.879199] LustreError: 49693:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 4390912 GRANT, real grant 0 [356436.893457] LustreError: 49693:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 153 previous similar messages [357042.175899] LustreError: 128672:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3911680 GRANT, real grant 0 [357042.190689] LustreError: 128672:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 133 previous similar messages [357268.136218] Lustre: fir-OST0025: haven't heard from client e15a0ffb-58b5-dcb2-ebe8-0fb73db3c5d9 (at 10.8.23.12@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e7444f70000, cur 1559102084 expire 1559101934 last 1559101857 [357268.158016] Lustre: Skipped 11 previous similar messages [357277.136221] Lustre: fir-OST0027: haven't heard from client e15a0ffb-58b5-dcb2-ebe8-0fb73db3c5d9 (at 10.8.23.12@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e6ec9cc1800, cur 1559102093 expire 1559101943 last 1559101866 [357277.158042] Lustre: Skipped 6 previous similar messages [357642.645781] LustreError: 87513:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3936256 GRANT, real grant 0 [357642.659963] LustreError: 87513:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 116 previous similar messages [358249.320618] LustreError: 125965:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0024: cli 6ea10cfc-48e7-f6e7-b834-4eb6674e3061 claims 552960 GRANT, real grant 0 [358249.334807] LustreError: 125965:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 338 previous similar messages [358860.722452] LustreError: 86788:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3325952 GRANT, real grant 0 [358860.736697] LustreError: 86788:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 359 previous similar messages [359064.822233] Lustre: fir-OST0025: Connection restored to (at 10.8.23.12@o2ib6) [359064.829563] Lustre: Skipped 5 previous similar messages [359140.084097] Lustre: fir-OST0024: Connection restored to (at 10.8.23.12@o2ib6) [359140.091421] Lustre: Skipped 5 previous similar messages [359468.392006] LustreError: 128676:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4390912 GRANT, real grant 0 [359468.406301] LustreError: 128676:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 333 previous similar messages [360073.134564] LustreError: 24809:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3985408 GRANT, real grant 0 [360073.148737] LustreError: 24809:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 261 previous similar messages [360688.512485] LustreError: 87171:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4157440 GRANT, real grant 0 [360688.526662] LustreError: 87171:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 190 previous similar messages [361289.946789] LustreError: 87188:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002b: cli af9e9e07-3495-a7fa-a77e-ad96faa0f3a6 claims 2707456 GRANT, real grant 0 [361289.960986] LustreError: 87188:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 193 previous similar messages [361311.407686] LNetError: 72388:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [361890.263146] LustreError: 87295:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [361890.277409] LustreError: 87295:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 378 previous similar messages [362494.777565] LustreError: 87381:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3911680 GRANT, real grant 0 [362494.791821] LustreError: 87381:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 342 previous similar messages [363098.310093] LustreError: 99679:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [363098.324287] LustreError: 99679:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 393 previous similar messages [363702.487408] LustreError: 87170:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3813376 GRANT, real grant 0 [363702.501582] LustreError: 87170:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 332 previous similar messages [364309.850512] LustreError: 88144:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [364309.864712] LustreError: 88144:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 313 previous similar messages [364913.145499] LustreError: 67762:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3780608 GRANT, real grant 0 [364913.159794] LustreError: 67762:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 322 previous similar messages [365522.478675] LustreError: 67769:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 4218880 GRANT, real grant 0 [365522.492895] LustreError: 67769:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 321 previous similar messages [366123.557901] LustreError: 86460:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [366123.572838] LustreError: 86460:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 244 previous similar messages [366729.063234] LustreError: 87370:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002b: cli af9e9e07-3495-a7fa-a77e-ad96faa0f3a6 claims 2736128 GRANT, real grant 0 [366729.077434] LustreError: 87370:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 296 previous similar messages [367358.908561] LustreError: 86823:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4333568 GRANT, real grant 0 [367358.922720] LustreError: 86823:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 242 previous similar messages [367959.207030] LustreError: 67767:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 2199552 GRANT, real grant 0 [367959.221205] LustreError: 67767:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 123 previous similar messages [368563.914199] LustreError: 25151:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 4034560 GRANT, real grant 0 [368563.928399] LustreError: 25151:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 169 previous similar messages [369165.974249] LustreError: 74313:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3932160 GRANT, real grant 0 [369165.988463] LustreError: 74313:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 244 previous similar messages [369578.201045] Lustre: fir-OST0027: haven't heard from client fe1114de-6afc-56c5-59b3-ce46a56cb035 (at 10.8.2.15@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e93fce1f400, cur 1559114394 expire 1559114244 last 1559114167 [369578.222758] Lustre: Skipped 4 previous similar messages [369589.201226] Lustre: fir-OST002b: haven't heard from client fe1114de-6afc-56c5-59b3-ce46a56cb035 (at 10.8.2.15@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e9ac5304c00, cur 1559114405 expire 1559114255 last 1559114178 [369589.222952] Lustre: Skipped 7 previous similar messages [369767.656803] LustreError: 87538:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 1884160 GRANT, real grant 0 [369767.670975] LustreError: 87538:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 240 previous similar messages [370369.311284] LustreError: 67777:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4046848 GRANT, real grant 0 [370369.325524] LustreError: 67777:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 237 previous similar messages [370974.219784] LustreError: 125967:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3870720 GRANT, real grant 0 [370974.234036] LustreError: 125967:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 183 previous similar messages [371581.251408] LustreError: 1892:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0024: cli 6ea10cfc-48e7-f6e7-b834-4eb6674e3061 claims 221184 GRANT, real grant 0 [371581.265464] LustreError: 1892:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 187 previous similar messages [372185.445146] LustreError: 29525:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [372185.459369] LustreError: 29525:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 239 previous similar messages [372785.556256] LustreError: 87180:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 2764800 GRANT, real grant 0 [372785.570445] LustreError: 87180:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 358 previous similar messages [373386.536247] LustreError: 67781:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 1695744 GRANT, real grant 0 [373386.550431] LustreError: 67781:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 359 previous similar messages [373993.830571] LustreError: 67753:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3883008 GRANT, real grant 0 [373993.844735] LustreError: 67753:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 318 previous similar messages [374595.323097] LustreError: 24814:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [374595.337270] LustreError: 24814:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 275 previous similar messages [375219.255810] LustreError: 99696:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 1093632 GRANT, real grant 0 [375219.270007] LustreError: 99696:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 404 previous similar messages [375827.768509] LustreError: 87526:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3866624 GRANT, real grant 0 [375827.782731] LustreError: 87526:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 231 previous similar messages [376329.237667] Lustre: fir-OST0024: haven't heard from client cac19017-3881-6185-88a4-025eb457e97a (at 10.8.15.6@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e86d8d53400, cur 1559121145 expire 1559120995 last 1559120918 [376329.259378] Lustre: Skipped 3 previous similar messages [376442.353202] LustreError: 67776:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [376442.367374] LustreError: 67776:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 291 previous similar messages [377043.384090] LustreError: 67750:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 4218880 GRANT, real grant 0 [377043.398252] LustreError: 67750:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 255 previous similar messages [377649.831895] LustreError: 99606:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [377649.846065] LustreError: 99606:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 325 previous similar messages [378077.335891] Lustre: fir-OST0025: Connection restored to e267eed0-45c3-44be-99a6-206acecf07ea (at 10.8.15.6@o2ib6) [378077.346276] Lustre: Skipped 4 previous similar messages [378152.600904] Lustre: fir-OST0028: Connection restored to e267eed0-45c3-44be-99a6-206acecf07ea (at 10.8.15.6@o2ib6) [378152.611266] Lustre: Skipped 5 previous similar messages [378268.930665] LustreError: 1887:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3903488 GRANT, real grant 0 [378268.944747] LustreError: 1887:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 298 previous similar messages [378869.933309] LustreError: 87593:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [378869.947520] LustreError: 87593:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 142 previous similar messages [379474.203440] LustreError: 765:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4182016 GRANT, real grant 0 [379474.217457] LustreError: 765:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 152 previous similar messages [380075.020991] LustreError: 87972:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4247552 GRANT, real grant 0 [380075.035175] LustreError: 87972:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 152 previous similar messages [380680.996659] LustreError: 13641:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3919872 GRANT, real grant 0 [380681.010819] LustreError: 13641:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 169 previous similar messages [381292.205940] LustreError: 67752:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4038656 GRANT, real grant 0 [381292.220161] LustreError: 67752:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 204 previous similar messages [381901.939057] LustreError: 87177:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0024: cli 6ea10cfc-48e7-f6e7-b834-4eb6674e3061 claims 2207744 GRANT, real grant 0 [381901.953352] LustreError: 87177:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 258 previous similar messages [382515.240924] LustreError: 99693:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4091904 GRANT, real grant 0 [382515.255092] LustreError: 99693:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 254 previous similar messages [383126.476313] LustreError: 87367:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 4390912 GRANT, real grant 0 [383126.490511] LustreError: 87367:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 267 previous similar messages [383738.500530] LustreError: 29525:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002d: cli ab79e19d-0a9d-29dd-3734-7953a41e2ead claims 36864 GRANT, real grant 0 [383738.514597] LustreError: 29525:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 271 previous similar messages [384341.631471] LustreError: 759:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3870720 GRANT, real grant 0 [384341.645604] LustreError: 759:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 249 previous similar messages [384941.642260] LustreError: 86793:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002d: cli ab79e19d-0a9d-29dd-3734-7953a41e2ead claims 36864 GRANT, real grant 0 [384941.656302] LustreError: 86793:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 255 previous similar messages [385551.162381] LustreError: 86834:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [385551.176760] LustreError: 86834:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 321 previous similar messages [386165.730343] LustreError: 86804:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 4390912 GRANT, real grant 0 [386165.744507] LustreError: 86804:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 245 previous similar messages [386768.939221] LustreError: 86894:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002d: cli a6519f19-aa1f-7c07-30a6-27183c6aabc4 claims 49152 GRANT, real grant 0 [386768.953229] LustreError: 86894:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 291 previous similar messages [387371.374774] LustreError: 87592:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3846144 GRANT, real grant 0 [387371.388942] LustreError: 87592:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 335 previous similar messages [387973.585344] LustreError: 29525:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002d: cli a6519f19-aa1f-7c07-30a6-27183c6aabc4 claims 1724416 GRANT, real grant 0 [387973.599587] LustreError: 29525:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 259 previous similar messages [388576.213859] LustreError: 91041:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [388576.228298] LustreError: 91041:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 264 previous similar messages [389185.356789] LustreError: 128743:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [389185.371182] LustreError: 128743:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 201 previous similar messages [389790.344311] LustreError: 92468:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 552960 GRANT, real grant 0 [389790.358441] LustreError: 92468:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 184 previous similar messages [390393.146914] LustreError: 99604:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [390393.161090] LustreError: 99604:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 281 previous similar messages [390999.299631] LustreError: 75393:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0024: cli 6ea10cfc-48e7-f6e7-b834-4eb6674e3061 claims 3854336 GRANT, real grant 0 [390999.313796] LustreError: 75393:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 232 previous similar messages [391605.316161] LustreError: 84355:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4128768 GRANT, real grant 0 [391605.330613] LustreError: 84355:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 276 previous similar messages [392207.101589] LustreError: 87179:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3870720 GRANT, real grant 0 [392207.115753] LustreError: 87179:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 221 previous similar messages [392807.969582] LustreError: 67779:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3895296 GRANT, real grant 0 [392807.983792] LustreError: 67779:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 252 previous similar messages [393408.480294] LustreError: 13641:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3981312 GRANT, real grant 0 [393408.494464] LustreError: 13641:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 241 previous similar messages [394019.653624] LustreError: 24739:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3944448 GRANT, real grant 0 [394019.667791] LustreError: 24739:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 316 previous similar messages [394630.013678] LustreError: 67774:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0024: cli 6ea10cfc-48e7-f6e7-b834-4eb6674e3061 claims 4349952 GRANT, real grant 0 [394630.027865] LustreError: 67774:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 336 previous similar messages [395231.964173] LustreError: 86856:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 4374528 GRANT, real grant 0 [395231.978400] LustreError: 86856:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 290 previous similar messages [395614.335097] Lustre: fir-OST0027: haven't heard from client ca5a9bd7-5706-b717-88d6-269566f7a76f (at 10.8.9.8@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e77b690d000, cur 1559140430 expire 1559140280 last 1559140203 [395614.356722] Lustre: Skipped 11 previous similar messages [395621.334895] Lustre: fir-OST002b: haven't heard from client ca5a9bd7-5706-b717-88d6-269566f7a76f (at 10.8.9.8@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e72ebe79800, cur 1559140437 expire 1559140287 last 1559140210 [395621.356546] Lustre: Skipped 9 previous similar messages [395623.342550] Lustre: fir-OST0029: haven't heard from client ca5a9bd7-5706-b717-88d6-269566f7a76f (at 10.8.9.8@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e7623115800, cur 1559140439 expire 1559140289 last 1559140212 [395850.878708] LustreError: 99691:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4157440 GRANT, real grant 0 [395850.892908] LustreError: 99691:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 306 previous similar messages [395947.551118] LNetError: 72381:0:(lib-msg.c:811:lnet_is_health_check()) Msg is in inconsistent state, don't perform health checking (0, 5) [396454.679170] LustreError: 99688:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [396454.693358] LustreError: 99688:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 220 previous similar messages [397063.025128] LustreError: 67779:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3112960 GRANT, real grant 0 [397063.039368] LustreError: 67779:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 320 previous similar messages [397376.852326] Lustre: fir-OST0025: Connection restored to 6b2680d5-bdc9-ca83-2c96-fb6c2ef38f1a (at 10.8.9.8@o2ib6) [397376.862596] Lustre: Skipped 2 previous similar messages [397452.011167] Lustre: fir-OST0026: Connection restored to 6b2680d5-bdc9-ca83-2c96-fb6c2ef38f1a (at 10.8.9.8@o2ib6) [397452.021435] Lustre: Skipped 5 previous similar messages [397665.416051] LustreError: 67769:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [397665.430291] LustreError: 67769:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 298 previous similar messages [398270.157838] LustreError: 24813:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3932160 GRANT, real grant 0 [398270.172011] LustreError: 24813:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 222 previous similar messages [398873.869027] LustreError: 86787:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4218880 GRANT, real grant 0 [398873.883334] LustreError: 86787:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 236 previous similar messages [399484.486488] LustreError: 127908:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3895296 GRANT, real grant 0 [399484.500753] LustreError: 127908:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 321 previous similar messages [400087.426397] LustreError: 99683:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3289088 GRANT, real grant 0 [400087.440634] LustreError: 99683:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 264 previous similar messages [400691.075146] LustreError: 84355:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST002d: cli ab79e19d-0a9d-29dd-3734-7953a41e2ead claims 36864 GRANT, real grant 0 [400691.089142] LustreError: 84355:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 242 previous similar messages [401295.692524] LustreError: 67778:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 1658880 GRANT, real grant 0 [401295.706840] LustreError: 67778:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 114 previous similar messages [401483.359607] Lustre: fir-OST0028: haven't heard from client 20c4c6ab-4ecd-0837-1234-3e34d095f792 (at 10.8.26.4@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e64baf1b000, cur 1559146299 expire 1559146149 last 1559146072 [401901.957084] LustreError: 67784:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3796992 GRANT, real grant 0 [401901.971265] LustreError: 67784:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 117 previous similar messages [402838.526976] LustreError: 128672:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 540672 GRANT, real grant 0 [402838.541215] LustreError: 128672:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 163 previous similar messages [402885.366718] Lustre: fir-OST0028: haven't heard from client fbe4d5af-9e4b-cb31-1ce8-0eea4d23f133 (at 10.8.30.25@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e73567fd000, cur 1559147701 expire 1559147551 last 1559147474 [402885.388513] Lustre: Skipped 11 previous similar messages [402896.366499] Lustre: fir-OST002d: haven't heard from client fbe4d5af-9e4b-cb31-1ce8-0eea4d23f133 (at 10.8.30.25@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e7a8f25c400, cur 1559147712 expire 1559147562 last 1559147485 [402896.388289] Lustre: Skipped 5 previous similar messages [403302.193925] Lustre: fir-OST0025: Connection restored to (at 10.8.26.4@o2ib6) [403302.201153] Lustre: Skipped 5 previous similar messages [403377.425233] Lustre: fir-OST0024: Connection restored to (at 10.8.26.4@o2ib6) [403377.432503] Lustre: Skipped 5 previous similar messages [403438.651132] LustreError: 11078:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3854336 GRANT, real grant 0 [403438.665428] LustreError: 11078:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 154 previous similar messages [404048.856742] LustreError: 92451:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3956736 GRANT, real grant 0 [404048.871063] LustreError: 92451:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 129 previous similar messages [404653.956703] LustreError: 16614:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3895296 GRANT, real grant 0 [404653.970913] LustreError: 16614:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 206 previous similar messages [405259.574569] LustreError: 128744:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3895296 GRANT, real grant 0 [405259.588834] LustreError: 128744:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 254 previous similar messages [405865.869442] LustreError: 86829:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3870720 GRANT, real grant 0 [405865.883636] LustreError: 86829:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 257 previous similar messages [406132.383380] Lustre: fir-OST002d: haven't heard from client 1918e6fa-9729-7f10-59da-361a8d6f7025 (at 10.9.115.2@o2ib4) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e8afa0b7c00, cur 1559150948 expire 1559150798 last 1559150721 [406132.405173] Lustre: Skipped 5 previous similar messages [406467.382599] LustreError: 87534:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4186112 GRANT, real grant 0 [406467.396813] LustreError: 87534:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 302 previous similar messages [407070.779330] LustreError: 14367:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3911680 GRANT, real grant 0 [407070.793697] LustreError: 14367:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 312 previous similar messages [407686.652033] LustreError: 86830:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 4153344 GRANT, real grant 0 [407686.666219] LustreError: 86830:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 229 previous similar messages [408294.500989] LustreError: 99693:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3854336 GRANT, real grant 0 [408294.515164] LustreError: 99693:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 367 previous similar messages [408837.398642] Lustre: fir-OST0027: haven't heard from client 65f0b071-0111-98d2-a90e-94f4aa753d0a (at 10.8.15.7@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e9a04eb0000, cur 1559153653 expire 1559153503 last 1559153426 [408837.420346] Lustre: Skipped 11 previous similar messages [408851.397400] Lustre: fir-OST002e: haven't heard from client 65f0b071-0111-98d2-a90e-94f4aa753d0a (at 10.8.15.7@o2ib6) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e83b611e800, cur 1559153667 expire 1559153517 last 1559153440 [408851.419122] Lustre: Skipped 1 previous similar message [408898.651393] LustreError: 24813:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 2777088 GRANT, real grant 0 [408898.665570] LustreError: 24813:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 382 previous similar messages [409502.407902] LustreError: 13631:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0024: cli 6ea10cfc-48e7-f6e7-b834-4eb6674e3061 claims 1105920 GRANT, real grant 0 [409502.422064] LustreError: 13631:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 302 previous similar messages [409786.263280] Lustre: fir-OST0025: Connection restored to (at 10.9.115.2@o2ib4) [409786.270611] Lustre: Skipped 4 previous similar messages [409861.510180] Lustre: fir-OST0024: Connection restored to (at 10.9.115.2@o2ib4) [409861.517541] Lustre: Skipped 6 previous similar messages [410102.515705] LustreError: 13641:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3817472 GRANT, real grant 0 [410102.529872] LustreError: 13641:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 229 previous similar messages [410705.213843] LustreError: 67784:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3895296 GRANT, real grant 0 [410705.228017] LustreError: 67784:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 217 previous similar messages [411310.172386] LustreError: 1546:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3870720 GRANT, real grant 0 [411310.186496] LustreError: 1546:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 240 previous similar messages [411912.582805] LustreError: 128678:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3305472 GRANT, real grant 0 [411912.597102] LustreError: 128678:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 258 previous similar messages [412523.291449] LustreError: 87611:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3923968 GRANT, real grant 0 [412523.305649] LustreError: 87611:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 179 previous similar messages [413133.047652] LustreError: 1860:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 4132864 GRANT, real grant 0 [413133.061828] LustreError: 1860:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 209 previous similar messages [413733.569845] LustreError: 1546:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 7ccedfb6-dc58-53e5-7474-adae274cd5d7 claims 3780608 GRANT, real grant 0 [413733.583920] LustreError: 1546:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 206 previous similar messages [414347.351179] LustreError: 87688:0:(tgt_grant.c:742:tgt_grant_check()) fir-OST0028: cli 100744eb-5315-bfcb-8c97-cf1e0209fc7b claims 3911680 GRANT, real grant 0 [414347.365413] LustreError: 87688:0:(tgt_grant.c:742:tgt_grant_check()) Skipped 197 previous similar messages [414687.733602] LustreError: 108071:0:(osd_handler.c:2133:osd_object_release()) ASSERTION( !(o->oo_destroyed == 0 && o->oo_inode && o->oo_inode->i_nlink == 0) ) failed: [414687.748464] LustreError: 108071:0:(osd_handler.c:2133:osd_object_release()) LBUG [414687.755956] Pid: 108071, comm: ldlm_cn01_010 3.10.0-957.1.3.el7_lustre.x86_64 #1 SMP Fri Dec 7 14:50:35 PST 2018 [414687.766217] Call Trace: [414687.768773] [] libcfs_call_trace+0x8c/0xc0 [libcfs] [414687.775434] [] lbug_with_loc+0x4c/0xa0 [libcfs] [414687.781736] [] osd_object_release+0x7c/0x80 [osd_ldiskfs] [414687.788910] [] lu_object_put+0x190/0x3d0 [obdclass] [414687.795582] [] ofd_lvbo_update+0x5e6/0xdf0 [ofd] [414687.801980] [] ldlm_request_cancel+0x3c9/0x740 [ptlrpc] [414687.809008] [] ldlm_handle_cancel+0xba/0x250 [ptlrpc] [414687.815859] [] ldlm_cancel_handler+0x158/0x590 [ptlrpc] [414687.822885] [] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc] [414687.830693] [] ptlrpc_main+0xafc/0x1fc0 [ptlrpc] [414687.837115] [] kthread+0xd1/0xe0 [414687.842115] [] ret_from_fork_nospec_begin+0xe/0x21 [414687.848677] [] 0xffffffffffffffff [414687.853780] Kernel panic - not syncing: LBUG [414687.858140] CPU: 33 PID: 108071 Comm: ldlm_cn01_010 Kdump: loaded Tainted: G OE ------------ 3.10.0-957.1.3.el7_lustre.x86_64 #1 [414687.870905] Hardware name: Dell Inc. PowerEdge R6415/065PKD, BIOS 1.6.7 10/29/2018 [414687.878557] Call Trace: [414687.881102] [] dump_stack+0x19/0x1b [414687.886332] [] panic+0xe8/0x21f [414687.891217] [] lbug_with_loc+0x9b/0xa0 [libcfs] [414687.897492] [] osd_object_release+0x7c/0x80 [osd_ldiskfs] [414687.904650] [] lu_object_put+0x190/0x3d0 [obdclass] [414687.911272] [] ofd_lvbo_update+0x5e6/0xdf0 [ofd] [414687.917650] [] ? class_handle2object+0xb9/0x1c0 [obdclass] [414687.924905] [] ldlm_request_cancel+0x3c9/0x740 [ptlrpc] [414687.931901] [] ldlm_handle_cancel+0xba/0x250 [ptlrpc] [414687.938717] [] ldlm_cancel_handler+0x158/0x590 [ptlrpc] [414687.945715] [] ptlrpc_server_handle_request+0x24b/0xab0 [ptlrpc] [414687.953496] [] ? ptlrpc_wait_event+0xa5/0x360 [ptlrpc] [414687.960375] [] ? default_wake_function+0x12/0x20 [414687.966734] [] ? __wake_up_common+0x5b/0x90 [414687.972689] [] ptlrpc_main+0xafc/0x1fc0 [ptlrpc] [414687.979075] [] ? ptlrpc_register_service+0xf80/0xf80 [ptlrpc] [414687.986556] [] kthread+0xd1/0xe0 [414687.991520] [] ? insert_kthread_work+0x40/0x40 [414687.997703] [] ret_from_fork_nospec_begin+0xe/0x21 [414688.004237] [] ? insert_kthread_work+0x40/0x40