[ 5.718716] pci_bus 0000:81: resource 1 [mem 0x99200000-0x992fffff] [ 5.718717] pci_bus 0000:81: resource 2 [mem 0x90000000-0x901fffff 64bit pref] [ 5.718717] pci_bus 0000:82: resource 1 [mem 0x99100000-0x991fffff] [ 5.718718] pci_bus 0000:83: resource 1 [mem 0x99000000-0x990fffff] [ 5.718722] pci 0000:a0:03.1: BAR 14: assigned [mem 0x9d000000-0x9d0fffff] [ 5.725593] pci 0000:a1:00.0: BAR 6: assigned [mem 0x9d000000-0x9d0fffff pref] [ 5.732812] pci 0000:a0:03.1: PCI bridge to [bus a1] [ 5.737780] pci 0000:a0:03.1: bridge window [mem 0x9d000000-0x9d0fffff] [ 5.744572] pci 0000:a0:03.1: bridge window [mem 0x9e000000-0x9fffffff 64bit pref] [ 5.752314] pci 0000:a0:07.1: PCI bridge to [bus a2] [ 5.757287] pci 0000:a0:07.1: bridge window [mem 0xa6200000-0xa62fffff] [ 5.764075] pci 0000:a0:08.1: PCI bridge to [bus a3] [ 5.769046] pci 0000:a0:08.1: bridge window [mem 0xa6000000-0xa61fffff] [ 5.775834] pci_bus 0000:a0: resource 4 [io 0x6000-0x6fff window] [ 5.775834] pci_bus 0000:a0: resource 5 [mem 0x9d000000-0xa9ffffff window] [ 5.775835] pci_bus 0000:a0: resource 6 [mem 0x63dc0000000-0x71d5fffffff window] [ 5.775836] pci_bus 0000:a1: resource 1 [mem 0x9d000000-0x9d0fffff] [ 5.775837] pci_bus 0000:a1: resource 2 [mem 0x9e000000-0x9fffffff 64bit pref] [ 5.775837] pci_bus 0000:a2: resource 1 [mem 0xa6200000-0xa62fffff] [ 5.775838] pci_bus 0000:a3: resource 1 [mem 0xa6000000-0xa61fffff] [ 5.775841] pci 0000:c0:07.1: PCI bridge to [bus c1] [ 5.780807] pci 0000:c0:07.1: bridge window [mem 0xb3200000-0xb32fffff] [ 5.787596] pci 0000:c0:08.1: PCI bridge to [bus c2] [ 5.792572] pci 0000:c0:08.1: bridge window [mem 0xb3100000-0xb31fffff] [ 5.799363] pci 0000:c0:08.3: PCI bridge to [bus c3] [ 5.804335] pci 0000:c0:08.3: bridge window [mem 0xb3000000-0xb30fffff] [ 5.811123] pci_bus 0000:c0: resource 4 [io 0x7000-0x7fff window] [ 5.811124] pci_bus 0000:c0: resource 5 [mem 0xaa000000-0xb6ffffff window] [ 5.811124] pci_bus 0000:c0: resource 6 [mem 0x55e20000000-0x63dbfffffff window] [ 5.811125] pci_bus 0000:c1: resource 1 [mem 0xb3200000-0xb32fffff] [ 5.811126] pci_bus 0000:c2: resource 1 [mem 0xb3100000-0xb31fffff] [ 5.811127] pci_bus 0000:c3: resource 1 [mem 0xb3000000-0xb30fffff] [ 5.811130] pci 0000:e0:05.1: BAR 14: assigned [mem 0xb7100000-0xb71fffff] [ 5.818002] pci 0000:e1:00.0: BAR 6: assigned [mem 0xb7100000-0xb713ffff pref] [ 5.825222] pci 0000:e1:00.1: BAR 6: assigned [mem 0xb7140000-0xb717ffff pref] [ 5.832440] pci 0000:e0:05.1: PCI bridge to [bus e1] [ 5.837408] pci 0000:e0:05.1: bridge window [mem 0xb7100000-0xb71fffff] [ 5.844194] pci 0000:e0:05.1: bridge window [mem 0xb7000000-0xb70fffff 64bit pref] [ 5.851933] pci 0000:e0:07.1: PCI bridge to [bus e2] [ 5.856906] pci 0000:e0:07.1: bridge window [mem 0xc0100000-0xc01fffff] [ 5.863695] pci 0000:e0:08.1: PCI bridge to [bus e3] [ 5.868666] pci 0000:e0:08.1: bridge window [mem 0xc0000000-0xc00fffff] [ 5.875454] pci_bus 0000:e0: resource 4 [io 0x8000-0xffff window] [ 5.875455] pci_bus 0000:e0: resource 5 [mem 0xb7000000-0xc3ffffff window] [ 5.875456] pci_bus 0000:e0: resource 6 [mem 0x47e80000000-0x55e1fffffff window] [ 5.875456] pci_bus 0000:e1: resource 1 [mem 0xb7100000-0xb71fffff] [ 5.875457] pci_bus 0000:e1: resource 2 [mem 0xb7000000-0xb70fffff 64bit pref] [ 5.875458] pci_bus 0000:e2: resource 1 [mem 0xc0100000-0xc01fffff] [ 5.875459] pci_bus 0000:e3: resource 1 [mem 0xc0000000-0xc00fffff] [ 5.875499] NET: Registered protocol family 2 [ 5.880244] TCP established hash table entries: 524288 (order: 10, 4194304 bytes) [ 5.888370] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes) [ 5.895226] TCP: Hash tables configured (established 524288 bind 65536) [ 5.901859] TCP: reno registered [ 5.905138] UDP hash table entries: 65536 (order: 9, 2097152 bytes) [ 5.911773] UDP-Lite hash table entries: 65536 (order: 9, 2097152 bytes) [ 5.918847] NET: Registered protocol family 1 [ 5.923524] pci 0000:62:00.0: Boot video device [ 5.923600] PCI: CLS mismatch (32 != 64), using 64 bytes [ 5.923634] Unpacking initramfs... [ 6.076849] Freeing initrd memory: 19916k freed [ 6.087918] AMD-Vi: IOMMU performance counters supported [ 6.093262] AMD-Vi: IOMMU performance counters supported [ 6.098591] AMD-Vi: IOMMU performance counters supported [ 6.103918] AMD-Vi: IOMMU performance counters supported [ 6.109254] AMD-Vi: IOMMU performance counters supported [ 6.114581] AMD-Vi: IOMMU performance counters supported [ 6.119912] AMD-Vi: IOMMU performance counters supported [ 6.125240] AMD-Vi: IOMMU performance counters supported [ 6.130942] iommu: Adding device 0000:00:01.0 to group 0 [ 6.136292] iommu: Using direct mapping for device 0000:00:01.0 [ 6.142362] iommu: Adding device 0000:00:01.1 to group 1 [ 6.147708] iommu: Using direct mapping for device 0000:00:01.1 [ 6.153791] iommu: Adding device 0000:00:02.0 to group 2 [ 6.159130] iommu: Using direct mapping for device 0000:00:02.0 [ 6.165176] iommu: Adding device 0000:00:03.0 to group 3 [ 6.170517] iommu: Using direct mapping for device 0000:00:03.0 [ 6.176534] iommu: Adding device 0000:00:04.0 to group 4 [ 6.181878] iommu: Using direct mapping for device 0000:00:04.0 [ 6.188058] iommu: Adding device 0000:00:05.0 to group 5 [ 6.193408] iommu: Using direct mapping for device 0000:00:05.0 [ 6.199437] iommu: Adding device 0000:00:07.0 to group 6 [ 6.204788] iommu: Using direct mapping for device 0000:00:07.0 [ 6.210806] iommu: Adding device 0000:00:07.1 to group 7 [ 6.216150] iommu: Using direct mapping for device 0000:00:07.1 [ 6.222164] iommu: Adding device 0000:00:08.0 to group 8 [ 6.227509] iommu: Using direct mapping for device 0000:00:08.0 [ 6.233523] iommu: Adding device 0000:00:08.1 to group 9 [ 6.238882] iommu: Using direct mapping for device 0000:00:08.1 [ 6.244900] iommu: Adding device 0000:00:14.0 to group 10 [ 6.250329] iommu: Using direct mapping for device 0000:00:14.0 [ 6.256268] iommu: Adding device 0000:00:14.3 to group 10 [ 6.261799] iommu: Adding device 0000:00:18.0 to group 11 [ 6.267229] iommu: Using direct mapping for device 0000:00:18.0 [ 6.273168] iommu: Adding device 0000:00:18.1 to group 11 [ 6.278584] iommu: Adding device 0000:00:18.2 to group 11 [ 6.284000] iommu: Adding device 0000:00:18.3 to group 11 [ 6.289415] iommu: Adding device 0000:00:18.4 to group 11 [ 6.294832] iommu: Adding device 0000:00:18.5 to group 11 [ 6.300250] iommu: Adding device 0000:00:18.6 to group 11 [ 6.305665] iommu: Adding device 0000:00:18.7 to group 11 [ 6.311389] iommu: Adding device 0000:00:19.0 to group 12 [ 6.316818] iommu: Using direct mapping for device 0000:00:19.0 [ 6.322756] iommu: Adding device 0000:00:19.1 to group 12 [ 6.328174] iommu: Adding device 0000:00:19.2 to group 12 [ 6.333588] iommu: Adding device 0000:00:19.3 to group 12 [ 6.339004] iommu: Adding device 0000:00:19.4 to group 12 [ 6.344424] iommu: Adding device 0000:00:19.5 to group 12 [ 6.349839] iommu: Adding device 0000:00:19.6 to group 12 [ 6.355255] iommu: Adding device 0000:00:19.7 to group 12 [ 6.361762] iommu: Adding device 0000:01:00.0 to group 13 [ 6.367198] iommu: Using direct mapping for device 0000:01:00.0 [ 6.373229] iommu: Adding device 0000:02:00.0 to group 14 [ 6.378661] iommu: Using direct mapping for device 0000:02:00.0 [ 6.384725] iommu: Adding device 0000:02:00.2 to group 15 [ 6.390160] iommu: Using direct mapping for device 0000:02:00.2 [ 6.396197] iommu: Adding device 0000:03:00.0 to group 16 [ 6.401626] iommu: Using direct mapping for device 0000:03:00.0 [ 6.407652] iommu: Adding device 0000:03:00.2 to group 17 [ 6.413082] iommu: Using direct mapping for device 0000:03:00.2 [ 6.419116] iommu: Adding device 0000:03:00.3 to group 18 [ 6.424554] iommu: Using direct mapping for device 0000:03:00.3 [ 6.430581] iommu: Adding device 0000:20:01.0 to group 19 [ 6.436016] iommu: Using direct mapping for device 0000:20:01.0 [ 6.442029] iommu: Adding device 0000:20:02.0 to group 20 [ 6.447464] iommu: Using direct mapping for device 0000:20:02.0 [ 6.453475] iommu: Adding device 0000:20:03.0 to group 21 [ 6.458911] iommu: Using direct mapping for device 0000:20:03.0 [ 6.464923] iommu: Adding device 0000:20:04.0 to group 22 [ 6.470359] iommu: Using direct mapping for device 0000:20:04.0 [ 6.476373] iommu: Adding device 0000:20:05.0 to group 23 [ 6.481805] iommu: Using direct mapping for device 0000:20:05.0 [ 6.487822] iommu: Adding device 0000:20:07.0 to group 24 [ 6.493255] iommu: Using direct mapping for device 0000:20:07.0 [ 6.499270] iommu: Adding device 0000:20:07.1 to group 25 [ 6.504705] iommu: Using direct mapping for device 0000:20:07.1 [ 6.510720] iommu: Adding device 0000:20:08.0 to group 26 [ 6.516150] iommu: Using direct mapping for device 0000:20:08.0 [ 6.522165] iommu: Adding device 0000:20:08.1 to group 27 [ 6.527601] iommu: Using direct mapping for device 0000:20:08.1 [ 6.533620] iommu: Adding device 0000:21:00.0 to group 28 [ 6.539047] iommu: Using direct mapping for device 0000:21:00.0 [ 6.545062] iommu: Adding device 0000:21:00.2 to group 29 [ 6.550495] iommu: Using direct mapping for device 0000:21:00.2 [ 6.556516] iommu: Adding device 0000:22:00.0 to group 30 [ 6.561945] iommu: Using direct mapping for device 0000:22:00.0 [ 6.567962] iommu: Adding device 0000:22:00.1 to group 31 [ 6.573394] iommu: Using direct mapping for device 0000:22:00.1 [ 6.579409] iommu: Adding device 0000:22:00.2 to group 32 [ 6.584844] iommu: Using direct mapping for device 0000:22:00.2 [ 6.590878] iommu: Adding device 0000:22:00.3 to group 33 [ 6.596308] iommu: Using direct mapping for device 0000:22:00.3 [ 6.602330] iommu: Adding device 0000:40:01.0 to group 34 [ 6.607765] iommu: Using direct mapping for device 0000:40:01.0 [ 6.613783] iommu: Adding device 0000:40:01.1 to group 35 [ 6.619213] iommu: Using direct mapping for device 0000:40:01.1 [ 6.625230] iommu: Adding device 0000:40:02.0 to group 36 [ 6.630660] iommu: Using direct mapping for device 0000:40:02.0 [ 6.636674] iommu: Adding device 0000:40:03.0 to group 37 [ 6.642109] iommu: Using direct mapping for device 0000:40:03.0 [ 6.648121] iommu: Adding device 0000:40:04.0 to group 38 [ 6.653558] iommu: Using direct mapping for device 0000:40:04.0 [ 6.659577] iommu: Adding device 0000:40:05.0 to group 39 [ 6.665007] iommu: Using direct mapping for device 0000:40:05.0 [ 6.671022] iommu: Adding device 0000:40:07.0 to group 40 [ 6.676454] iommu: Using direct mapping for device 0000:40:07.0 [ 6.682469] iommu: Adding device 0000:40:07.1 to group 41 [ 6.687901] iommu: Using direct mapping for device 0000:40:07.1 [ 6.693917] iommu: Adding device 0000:40:08.0 to group 42 [ 6.699350] iommu: Using direct mapping for device 0000:40:08.0 [ 6.705362] iommu: Adding device 0000:40:08.1 to group 43 [ 6.710798] iommu: Using direct mapping for device 0000:40:08.1 [ 6.716817] iommu: Adding device 0000:41:00.0 to group 44 [ 6.722247] iommu: Using direct mapping for device 0000:41:00.0 [ 6.728269] iommu: Adding device 0000:42:00.0 to group 45 [ 6.733703] iommu: Using direct mapping for device 0000:42:00.0 [ 6.739721] iommu: Adding device 0000:42:00.2 to group 46 [ 6.745153] iommu: Using direct mapping for device 0000:42:00.2 [ 6.751174] iommu: Adding device 0000:43:00.0 to group 47 [ 6.756610] iommu: Using direct mapping for device 0000:43:00.0 [ 6.762624] iommu: Adding device 0000:43:00.2 to group 48 [ 6.768057] iommu: Using direct mapping for device 0000:43:00.2 [ 6.774076] iommu: Adding device 0000:60:01.0 to group 49 [ 6.779511] iommu: Using direct mapping for device 0000:60:01.0 [ 6.785524] iommu: Adding device 0000:60:02.0 to group 50 [ 6.790954] iommu: Using direct mapping for device 0000:60:02.0 [ 6.796967] iommu: Adding device 0000:60:03.0 to group 51 [ 6.802402] iommu: Using direct mapping for device 0000:60:03.0 [ 6.808415] iommu: Adding device 0000:60:04.0 to group 52 [ 6.813850] iommu: Using direct mapping for device 0000:60:04.0 [ 6.819871] iommu: Adding device 0000:60:05.0 to group 53 [ 6.825299] iommu: Using direct mapping for device 0000:60:05.0 [ 6.831246] iommu: Adding device 0000:60:05.2 to group 53 [ 6.836741] iommu: Adding device 0000:60:07.0 to group 54 [ 6.842170] iommu: Using direct mapping for device 0000:60:07.0 [ 6.848185] iommu: Adding device 0000:60:07.1 to group 55 [ 6.853619] iommu: Using direct mapping for device 0000:60:07.1 [ 6.859638] iommu: Adding device 0000:60:08.0 to group 56 [ 6.865068] iommu: Using direct mapping for device 0000:60:08.0 [ 6.871082] iommu: Adding device 0000:60:08.1 to group 57 [ 6.876523] iommu: Using direct mapping for device 0000:60:08.1 [ 6.882456] iommu: Adding device 0000:61:00.0 to group 53 [ 6.887866] iommu: Adding device 0000:62:00.0 to group 53 [ 6.893360] iommu: Adding device 0000:63:00.0 to group 58 [ 6.898790] iommu: Using direct mapping for device 0000:63:00.0 [ 6.904803] iommu: Adding device 0000:63:00.2 to group 59 [ 6.910238] iommu: Using direct mapping for device 0000:63:00.2 [ 6.916256] iommu: Adding device 0000:64:00.0 to group 60 [ 6.921687] iommu: Using direct mapping for device 0000:64:00.0 [ 6.927702] iommu: Adding device 0000:64:00.2 to group 61 [ 6.933132] iommu: Using direct mapping for device 0000:64:00.2 [ 6.939151] iommu: Adding device 0000:80:01.0 to group 62 [ 6.944583] iommu: Using direct mapping for device 0000:80:01.0 [ 6.950598] iommu: Adding device 0000:80:01.1 to group 63 [ 6.956029] iommu: Using direct mapping for device 0000:80:01.1 [ 6.962042] iommu: Adding device 0000:80:02.0 to group 64 [ 6.967471] iommu: Using direct mapping for device 0000:80:02.0 [ 6.973481] iommu: Adding device 0000:80:03.0 to group 65 [ 6.978910] iommu: Using direct mapping for device 0000:80:03.0 [ 6.984922] iommu: Adding device 0000:80:04.0 to group 66 [ 6.990359] iommu: Using direct mapping for device 0000:80:04.0 [ 6.996370] iommu: Adding device 0000:80:05.0 to group 67 [ 7.001798] iommu: Using direct mapping for device 0000:80:05.0 [ 7.007812] iommu: Adding device 0000:80:07.0 to group 68 [ 7.013244] iommu: Using direct mapping for device 0000:80:07.0 [ 7.019257] iommu: Adding device 0000:80:07.1 to group 69 [ 7.024685] iommu: Using direct mapping for device 0000:80:07.1 [ 7.030699] iommu: Adding device 0000:80:08.0 to group 70 [ 7.036133] iommu: Using direct mapping for device 0000:80:08.0 [ 7.042146] iommu: Adding device 0000:80:08.1 to group 71 [ 7.047583] iommu: Using direct mapping for device 0000:80:08.1 [ 7.053619] iommu: Adding device 0000:81:00.0 to group 72 [ 7.059048] iommu: Using direct mapping for device 0000:81:00.0 [ 7.065065] iommu: Adding device 0000:82:00.0 to group 73 [ 7.070502] iommu: Using direct mapping for device 0000:82:00.0 [ 7.076525] iommu: Adding device 0000:82:00.2 to group 74 [ 7.081962] iommu: Using direct mapping for device 0000:82:00.2 [ 7.087977] iommu: Adding device 0000:83:00.0 to group 75 [ 7.093408] iommu: Using direct mapping for device 0000:83:00.0 [ 7.099423] iommu: Adding device 0000:83:00.2 to group 76 [ 7.104857] iommu: Using direct mapping for device 0000:83:00.2 [ 7.110874] iommu: Adding device 0000:a0:01.0 to group 77 [ 7.116306] iommu: Using direct mapping for device 0000:a0:01.0 [ 7.122319] iommu: Adding device 0000:a0:02.0 to group 78 [ 7.127754] iommu: Using direct mapping for device 0000:a0:02.0 [ 7.133770] iommu: Adding device 0000:a0:03.0 to group 79 [ 7.139201] iommu: Using direct mapping for device 0000:a0:03.0 [ 7.145216] iommu: Adding device 0000:a0:03.1 to group 80 [ 7.150651] iommu: Using direct mapping for device 0000:a0:03.1 [ 7.156664] iommu: Adding device 0000:a0:04.0 to group 81 [ 7.162100] iommu: Using direct mapping for device 0000:a0:04.0 [ 7.168113] iommu: Adding device 0000:a0:05.0 to group 82 [ 7.173547] iommu: Using direct mapping for device 0000:a0:05.0 [ 7.179570] iommu: Adding device 0000:a0:07.0 to group 83 [ 7.185004] iommu: Using direct mapping for device 0000:a0:07.0 [ 7.191017] iommu: Adding device 0000:a0:07.1 to group 84 [ 7.196453] iommu: Using direct mapping for device 0000:a0:07.1 [ 7.202469] iommu: Adding device 0000:a0:08.0 to group 85 [ 7.207900] iommu: Using direct mapping for device 0000:a0:08.0 [ 7.213915] iommu: Adding device 0000:a0:08.1 to group 86 [ 7.219349] iommu: Using direct mapping for device 0000:a0:08.1 [ 7.225404] iommu: Adding device 0000:a1:00.0 to group 87 [ 7.230832] iommu: Using direct mapping for device 0000:a1:00.0 [ 7.236848] iommu: Adding device 0000:a2:00.0 to group 88 [ 7.242281] iommu: Using direct mapping for device 0000:a2:00.0 [ 7.248292] iommu: Adding device 0000:a2:00.2 to group 89 [ 7.253719] iommu: Using direct mapping for device 0000:a2:00.2 [ 7.259737] iommu: Adding device 0000:a3:00.0 to group 90 [ 7.265169] iommu: Using direct mapping for device 0000:a3:00.0 [ 7.271181] iommu: Adding device 0000:a3:00.1 to group 91 [ 7.276618] iommu: Using direct mapping for device 0000:a3:00.1 [ 7.282633] iommu: Adding device 0000:a3:00.2 to group 92 [ 7.288065] iommu: Using direct mapping for device 0000:a3:00.2 [ 7.294081] iommu: Adding device 0000:c0:01.0 to group 93 [ 7.299518] iommu: Using direct mapping for device 0000:c0:01.0 [ 7.305532] iommu: Adding device 0000:c0:02.0 to group 94 [ 7.310961] iommu: Using direct mapping for device 0000:c0:02.0 [ 7.316977] iommu: Adding device 0000:c0:03.0 to group 95 [ 7.322410] iommu: Using direct mapping for device 0000:c0:03.0 [ 7.328423] iommu: Adding device 0000:c0:04.0 to group 96 [ 7.333860] iommu: Using direct mapping for device 0000:c0:04.0 [ 7.339869] iommu: Adding device 0000:c0:05.0 to group 97 [ 7.345297] iommu: Using direct mapping for device 0000:c0:05.0 [ 7.351314] iommu: Adding device 0000:c0:07.0 to group 98 [ 7.356744] iommu: Using direct mapping for device 0000:c0:07.0 [ 7.362764] iommu: Adding device 0000:c0:07.1 to group 99 [ 7.368198] iommu: Using direct mapping for device 0000:c0:07.1 [ 7.374214] iommu: Adding device 0000:c0:08.0 to group 100 [ 7.379730] iommu: Using direct mapping for device 0000:c0:08.0 [ 7.385739] iommu: Adding device 0000:c0:08.1 to group 101 [ 7.391256] iommu: Using direct mapping for device 0000:c0:08.1 [ 7.397268] iommu: Adding device 0000:c0:08.3 to group 102 [ 7.402793] iommu: Using direct mapping for device 0000:c0:08.3 [ 7.408807] iommu: Adding device 0000:c1:00.0 to group 103 [ 7.414327] iommu: Using direct mapping for device 0000:c1:00.0 [ 7.420338] iommu: Adding device 0000:c1:00.2 to group 104 [ 7.425862] iommu: Using direct mapping for device 0000:c1:00.2 [ 7.431878] iommu: Adding device 0000:c2:00.0 to group 105 [ 7.437394] iommu: Using direct mapping for device 0000:c2:00.0 [ 7.443412] iommu: Adding device 0000:c2:00.2 to group 106 [ 7.448929] iommu: Using direct mapping for device 0000:c2:00.2 [ 7.454947] iommu: Adding device 0000:c3:00.0 to group 107 [ 7.460473] iommu: Using direct mapping for device 0000:c3:00.0 [ 7.466500] iommu: Adding device 0000:e0:01.0 to group 108 [ 7.472019] iommu: Using direct mapping for device 0000:e0:01.0 [ 7.478034] iommu: Adding device 0000:e0:02.0 to group 109 [ 7.483553] iommu: Using direct mapping for device 0000:e0:02.0 [ 7.489565] iommu: Adding device 0000:e0:03.0 to group 110 [ 7.495087] iommu: Using direct mapping for device 0000:e0:03.0 [ 7.501100] iommu: Adding device 0000:e0:04.0 to group 111 [ 7.506624] iommu: Using direct mapping for device 0000:e0:04.0 [ 7.512639] iommu: Adding device 0000:e0:05.0 to group 112 [ 7.518157] iommu: Using direct mapping for device 0000:e0:05.0 [ 7.524170] iommu: Adding device 0000:e0:05.1 to group 113 [ 7.529691] iommu: Using direct mapping for device 0000:e0:05.1 [ 7.535730] iommu: Adding device 0000:e0:07.0 to group 114 [ 7.541247] iommu: Using direct mapping for device 0000:e0:07.0 [ 7.547272] iommu: Adding device 0000:e0:07.1 to group 115 [ 7.552792] iommu: Using direct mapping for device 0000:e0:07.1 [ 7.558842] iommu: Adding device 0000:e0:08.0 to group 116 [ 7.564359] iommu: Using direct mapping for device 0000:e0:08.0 [ 7.570372] iommu: Adding device 0000:e0:08.1 to group 117 [ 7.575894] iommu: Using direct mapping for device 0000:e0:08.1 [ 7.581928] iommu: Adding device 0000:e1:00.0 to group 118 [ 7.587445] iommu: Using direct mapping for device 0000:e1:00.0 [ 7.593405] iommu: Adding device 0000:e1:00.1 to group 118 [ 7.598990] iommu: Adding device 0000:e2:00.0 to group 119 [ 7.604509] iommu: Using direct mapping for device 0000:e2:00.0 [ 7.610532] iommu: Adding device 0000:e2:00.2 to group 120 [ 7.616054] iommu: Using direct mapping for device 0000:e2:00.2 [ 7.622083] iommu: Adding device 0000:e3:00.0 to group 121 [ 7.627608] iommu: Using direct mapping for device 0000:e3:00.0 [ 7.633634] iommu: Adding device 0000:e3:00.2 to group 122 [ 7.639158] iommu: Using direct mapping for device 0000:e3:00.2 [ 7.645487] AMD-Vi: Found IOMMU at 0000:60:00.2 cap 0x40 [ 7.650799] AMD-Vi: Extended features (0x59f77efa2094ade): [ 7.656284] PPR X2APIC NX GT IA GA PC [ 7.660188] AMD-Vi: Found IOMMU at 0000:40:00.2 cap 0x40 [ 7.665507] AMD-Vi: Extended features (0x59f77efa2094ade): [ 7.670990] PPR X2APIC NX GT IA GA PC [ 7.674912] AMD-Vi: Found IOMMU at 0000:20:00.2 cap 0x40 [ 7.680229] AMD-Vi: Extended features (0x59f77efa2094ade): [ 7.685713] PPR X2APIC NX GT IA GA PC [ 7.689624] AMD-Vi: Found IOMMU at 0000:00:00.2 cap 0x40 [ 7.694935] AMD-Vi: Extended features (0x59f77efa2094ade): [ 7.700424] PPR X2APIC NX GT IA GA PC [ 7.704333] AMD-Vi: Found IOMMU at 0000:e0:00.2 cap 0x40 [ 7.709644] AMD-Vi: Extended features (0x59f77efa2094ade): [ 7.715130] PPR X2APIC NX GT IA GA PC [ 7.719041] AMD-Vi: Found IOMMU at 0000:c0:00.2 cap 0x40 [ 7.724360] AMD-Vi: Extended features (0x59f77efa2094ade): [ 7.729846] PPR X2APIC NX GT IA GA PC [ 7.733758] AMD-Vi: Found IOMMU at 0000:a0:00.2 cap 0x40 [ 7.739075] AMD-Vi: Extended features (0x59f77efa2094ade): [ 7.744560] PPR X2APIC NX GT IA GA PC [ 7.748476] AMD-Vi: Found IOMMU at 0000:80:00.2 cap 0x40 [ 7.753791] AMD-Vi: Extended features (0x59f77efa2094ade): [ 7.759277] PPR X2APIC NX GT IA GA PC [ 7.763171] AMD-Vi: Interrupt remapping enabled [ 7.767708] AMD-Vi: X2APIC enabled [ 7.771188] pci 0000:60:00.2: irq 26 for MSI/MSI-X [ 7.771311] pci 0000:40:00.2: irq 27 for MSI/MSI-X [ 7.771395] pci 0000:20:00.2: irq 28 for MSI/MSI-X [ 7.771489] pci 0000:00:00.2: irq 29 for MSI/MSI-X [ 7.771571] pci 0000:e0:00.2: irq 30 for MSI/MSI-X [ 7.771647] pci 0000:c0:00.2: irq 31 for MSI/MSI-X [ 7.771720] pci 0000:a0:00.2: irq 32 for MSI/MSI-X [ 7.771793] pci 0000:80:00.2: irq 33 for MSI/MSI-X [ 7.771855] AMD-Vi: Lazy IO/TLB flushing enabled [ 7.776481] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 7.782918] software IO TLB [mem 0x4879e000-0x4c79e000] (64MB) mapped at [ffff9dc48879e000-ffff9dc48c79dfff] [ 7.792800] perf: AMD NB counters detected [ 7.796905] perf: AMD LLC counters detected [ 7.801718] LVT offset 0 assigned for vector 0x400 [ 7.806576] perf: AMD IBS detected (0x000003ff) [ 7.816506] sha1_ssse3: Using SHA-NI optimized SHA-1 implementation [ 7.822855] sha256_ssse3: Using SHA-256-NI optimized SHA-256 implementation [ 7.830495] futex hash table entries: 16384 (order: 8, 1048576 bytes) [ 7.837083] Initialise system trusted keyring [ 7.841480] audit: initializing netlink socket (disabled) [ 7.846903] type=2000 audit(1706808040.855:1): initialized [ 7.867678] HugeTLB registered 1 GB page size, pre-allocated 0 pages [ 7.874030] HugeTLB registered 2 MB page size, pre-allocated 0 pages [ 7.881142] zpool: loaded [ 7.883770] zbud: loaded [ 7.886438] VFS: Disk quotas dquot_6.6.0 [ 7.890390] Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 7.897004] Key type big_key registered [ 7.900842] SELinux: Registering netfilter hooks [ 7.902264] NET: Registered protocol family 38 [ 7.906715] Key type asymmetric registered [ 7.910819] Asymmetric key parser 'x509' registered [ 7.915726] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) [ 7.923303] io scheduler noop registered [ 7.927233] io scheduler deadline registered (default) [ 7.932385] io scheduler cfq registered [ 7.936225] io scheduler mq-deadline registered [ 7.940760] io scheduler kyber registered [ 7.945061] pcieport 0000:00:01.1: irq 34 for MSI/MSI-X [ 7.945431] pcieport 0000:00:07.1: irq 36 for MSI/MSI-X [ 7.945588] pcieport 0000:00:08.1: irq 37 for MSI/MSI-X [ 7.945782] pcieport 0000:20:07.1: irq 39 for MSI/MSI-X [ 7.945905] pcieport 0000:20:08.1: irq 40 for MSI/MSI-X [ 7.946037] pcieport 0000:40:01.1: irq 41 for MSI/MSI-X [ 7.946257] pcieport 0000:40:07.1: irq 43 for MSI/MSI-X [ 7.946436] pcieport 0000:40:08.1: irq 45 for MSI/MSI-X [ 7.946586] pcieport 0000:60:05.2: irq 46 for MSI/MSI-X [ 7.946767] pcieport 0000:60:07.1: irq 48 for MSI/MSI-X [ 7.946894] pcieport 0000:60:08.1: irq 50 for MSI/MSI-X [ 7.947029] pcieport 0000:80:01.1: irq 51 for MSI/MSI-X [ 7.947220] pcieport 0000:80:07.1: irq 53 for MSI/MSI-X [ 7.947310] pcieport 0000:80:08.1: irq 55 for MSI/MSI-X [ 7.947376] pcieport 0000:a0:03.1: irq 56 for MSI/MSI-X [ 7.947490] pcieport 0000:a0:07.1: irq 58 for MSI/MSI-X [ 7.947573] pcieport 0000:a0:08.1: irq 60 for MSI/MSI-X [ 7.947664] pcieport 0000:c0:07.1: irq 62 for MSI/MSI-X [ 7.947754] pcieport 0000:c0:08.1: irq 64 for MSI/MSI-X [ 7.947830] pcieport 0000:c0:08.3: irq 65 for MSI/MSI-X [ 7.947898] pcieport 0000:e0:05.1: irq 66 for MSI/MSI-X [ 7.947999] pcieport 0000:e0:07.1: irq 68 for MSI/MSI-X [ 7.948079] pcieport 0000:e0:08.1: irq 70 for MSI/MSI-X [ 7.948141] pcieport 0000:00:01.1: Signaling PME through PCIe PME interrupt [ 7.955103] pci 0000:01:00.0: Signaling PME through PCIe PME interrupt [ 7.961628] pcie_pme 0000:00:01.1:pcie001: service driver pcie_pme loaded [ 7.961648] pcieport 0000:00:07.1: Signaling PME through PCIe PME interrupt [ 7.968613] pci 0000:02:00.0: Signaling PME through PCIe PME interrupt [ 7.975138] pci 0000:02:00.2: Signaling PME through PCIe PME interrupt [ 7.981664] pcie_pme 0000:00:07.1:pcie001: service driver pcie_pme loaded [ 7.981680] pcieport 0000:00:08.1: Signaling PME through PCIe PME interrupt [ 7.988640] pci 0000:03:00.0: Signaling PME through PCIe PME interrupt [ 7.995168] pci 0000:03:00.2: Signaling PME through PCIe PME interrupt [ 8.001693] pci 0000:03:00.3: Signaling PME through PCIe PME interrupt [ 8.008218] pcie_pme 0000:00:08.1:pcie001: service driver pcie_pme loaded [ 8.008243] pcieport 0000:20:07.1: Signaling PME through PCIe PME interrupt [ 8.015201] pci 0000:21:00.0: Signaling PME through PCIe PME interrupt [ 8.021727] pci 0000:21:00.2: Signaling PME through PCIe PME interrupt [ 8.028256] pcie_pme 0000:20:07.1:pcie001: service driver pcie_pme loaded [ 8.028276] pcieport 0000:20:08.1: Signaling PME through PCIe PME interrupt [ 8.035238] pci 0000:22:00.0: Signaling PME through PCIe PME interrupt [ 8.041766] pci 0000:22:00.1: Signaling PME through PCIe PME interrupt [ 8.048289] pci 0000:22:00.2: Signaling PME through PCIe PME interrupt [ 8.054816] pci 0000:22:00.3: Signaling PME through PCIe PME interrupt [ 8.061344] pcie_pme 0000:20:08.1:pcie001: service driver pcie_pme loaded [ 8.061363] pcieport 0000:40:01.1: Signaling PME through PCIe PME interrupt [ 8.068327] pci 0000:41:00.0: Signaling PME through PCIe PME interrupt [ 8.074854] pcie_pme 0000:40:01.1:pcie001: service driver pcie_pme loaded [ 8.074873] pcieport 0000:40:07.1: Signaling PME through PCIe PME interrupt [ 8.081829] pci 0000:42:00.0: Signaling PME through PCIe PME interrupt [ 8.088355] pci 0000:42:00.2: Signaling PME through PCIe PME interrupt [ 8.094883] pcie_pme 0000:40:07.1:pcie001: service driver pcie_pme loaded [ 8.094900] pcieport 0000:40:08.1: Signaling PME through PCIe PME interrupt [ 8.101857] pci 0000:43:00.0: Signaling PME through PCIe PME interrupt [ 8.108382] pci 0000:43:00.2: Signaling PME through PCIe PME interrupt [ 8.114911] pcie_pme 0000:40:08.1:pcie001: service driver pcie_pme loaded [ 8.114929] pcieport 0000:60:05.2: Signaling PME through PCIe PME interrupt [ 8.121885] pci 0000:61:00.0: Signaling PME through PCIe PME interrupt [ 8.128411] pci 0000:62:00.0: Signaling PME through PCIe PME interrupt [ 8.134938] pcie_pme 0000:60:05.2:pcie001: service driver pcie_pme loaded [ 8.134957] pcieport 0000:60:07.1: Signaling PME through PCIe PME interrupt [ 8.141913] pci 0000:63:00.0: Signaling PME through PCIe PME interrupt [ 8.148438] pci 0000:63:00.2: Signaling PME through PCIe PME interrupt [ 8.154967] pcie_pme 0000:60:07.1:pcie001: service driver pcie_pme loaded [ 8.154985] pcieport 0000:60:08.1: Signaling PME through PCIe PME interrupt [ 8.161941] pci 0000:64:00.0: Signaling PME through PCIe PME interrupt [ 8.168466] pci 0000:64:00.2: Signaling PME through PCIe PME interrupt [ 8.174994] pcie_pme 0000:60:08.1:pcie001: service driver pcie_pme loaded [ 8.175008] pcieport 0000:80:01.1: Signaling PME through PCIe PME interrupt [ 8.181969] pci 0000:81:00.0: Signaling PME through PCIe PME interrupt [ 8.188496] pcie_pme 0000:80:01.1:pcie001: service driver pcie_pme loaded [ 8.188509] pcieport 0000:80:07.1: Signaling PME through PCIe PME interrupt [ 8.195472] pci 0000:82:00.0: Signaling PME through PCIe PME interrupt [ 8.201997] pci 0000:82:00.2: Signaling PME through PCIe PME interrupt [ 8.208525] pcie_pme 0000:80:07.1:pcie001: service driver pcie_pme loaded [ 8.208537] pcieport 0000:80:08.1: Signaling PME through PCIe PME interrupt [ 8.215500] pci 0000:83:00.0: Signaling PME through PCIe PME interrupt [ 8.222025] pci 0000:83:00.2: Signaling PME through PCIe PME interrupt [ 8.228552] pcie_pme 0000:80:08.1:pcie001: service driver pcie_pme loaded [ 8.228566] pcieport 0000:a0:03.1: Signaling PME through PCIe PME interrupt [ 8.235526] pci 0000:a1:00.0: Signaling PME through PCIe PME interrupt [ 8.242055] pcie_pme 0000:a0:03.1:pcie001: service driver pcie_pme loaded [ 8.242069] pcieport 0000:a0:07.1: Signaling PME through PCIe PME interrupt [ 8.249028] pci 0000:a2:00.0: Signaling PME through PCIe PME interrupt [ 8.255556] pci 0000:a2:00.2: Signaling PME through PCIe PME interrupt [ 8.262082] pcie_pme 0000:a0:07.1:pcie001: service driver pcie_pme loaded [ 8.262097] pcieport 0000:a0:08.1: Signaling PME through PCIe PME interrupt [ 8.269057] pci 0000:a3:00.0: Signaling PME through PCIe PME interrupt [ 8.275581] pci 0000:a3:00.1: Signaling PME through PCIe PME interrupt [ 8.282108] pci 0000:a3:00.2: Signaling PME through PCIe PME interrupt [ 8.288635] pcie_pme 0000:a0:08.1:pcie001: service driver pcie_pme loaded [ 8.288649] pcieport 0000:c0:07.1: Signaling PME through PCIe PME interrupt [ 8.295611] pci 0000:c1:00.0: Signaling PME through PCIe PME interrupt [ 8.302137] pci 0000:c1:00.2: Signaling PME through PCIe PME interrupt [ 8.308665] pcie_pme 0000:c0:07.1:pcie001: service driver pcie_pme loaded [ 8.308679] pcieport 0000:c0:08.1: Signaling PME through PCIe PME interrupt [ 8.315639] pci 0000:c2:00.0: Signaling PME through PCIe PME interrupt [ 8.322165] pci 0000:c2:00.2: Signaling PME through PCIe PME interrupt [ 8.328693] pcie_pme 0000:c0:08.1:pcie001: service driver pcie_pme loaded [ 8.328705] pcieport 0000:c0:08.3: Signaling PME through PCIe PME interrupt [ 8.335666] pci 0000:c3:00.0: Signaling PME through PCIe PME interrupt [ 8.342194] pcie_pme 0000:c0:08.3:pcie001: service driver pcie_pme loaded [ 8.342207] pcieport 0000:e0:05.1: Signaling PME through PCIe PME interrupt [ 8.349169] pci 0000:e1:00.0: Signaling PME through PCIe PME interrupt [ 8.355694] pci 0000:e1:00.1: Signaling PME through PCIe PME interrupt [ 8.362224] pcie_pme 0000:e0:05.1:pcie001: service driver pcie_pme loaded [ 8.362238] pcieport 0000:e0:07.1: Signaling PME through PCIe PME interrupt [ 8.369196] pci 0000:e2:00.0: Signaling PME through PCIe PME interrupt [ 8.375723] pci 0000:e2:00.2: Signaling PME through PCIe PME interrupt [ 8.382250] pcie_pme 0000:e0:07.1:pcie001: service driver pcie_pme loaded [ 8.382264] pcieport 0000:e0:08.1: Signaling PME through PCIe PME interrupt [ 8.389225] pci 0000:e3:00.0: Signaling PME through PCIe PME interrupt [ 8.395750] pci 0000:e3:00.2: Signaling PME through PCIe PME interrupt [ 8.402277] pcie_pme 0000:e0:08.1:pcie001: service driver pcie_pme loaded [ 8.402294] pci_hotplug: PCI Hot Plug PCI Core version: 0.5 [ 8.407873] pciehp: PCI Express Hot Plug Controller Driver version: 0.4 [ 8.414538] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 8.421308] efifb: probing for efifb [ 8.424895] efifb: framebuffer at 0xde000000, mapped to 0xffffad4072400000, using 3072k, total 3072k [ 8.434023] efifb: mode is 1024x768x32, linelength=4096, pages=1 [ 8.440028] efifb: scrolling: redraw [ 8.443606] efifb: Truecolor: size=8:8:8:8, shift=24:16:8:0 [ 8.466143] Console: switching to colour frame buffer device 128x48 [ 8.489208] fb0: EFI VGA frame buffer device [ 8.493637] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 [ 8.501032] ACPI: Power Button [PWRF] [ 8.505520] ERST: Error Record Serialization Table (ERST) support is initialized. [ 8.512999] pstore: Registered erst as persistent store backend [ 8.519208] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 8.526670] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 8.553634] 00:03: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A [ 8.579937] 00:04: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A [ 8.585913] Non-volatile memory driver v1.3 [ 8.590134] Linux agpgart interface v0.103 [ 8.596259] tpm_tis MSFT0101:00: 2.0 TPM (device-id 0xFC, rev-id 1) [ 8.617573] crash memory driver: version 1.1 [ 8.622139] rdac: device handler registered [ 8.626395] hp_sw: device handler registered [ 8.630675] emc: device handler registered [ 8.634970] alua: device handler registered [ 8.639195] libphy: Fixed MDIO Bus: probed [ 8.643342] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver [ 8.649875] ehci-pci: EHCI PCI platform driver [ 8.654331] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver [ 8.660510] ohci-pci: OHCI PCI platform driver [ 8.664961] uhci_hcd: USB Universal Host Controller Interface driver [ 8.671554] xhci_hcd 0000:03:00.3: xHCI Host Controller [ 8.676870] xhci_hcd 0000:03:00.3: new USB bus registered, assigned bus number 1 [ 8.684366] xhci_hcd 0000:03:00.3: hcc params 0x0260ffe5 hci version 0x110 quirks 0x0000000000000410 [ 8.693528] xhci_hcd 0000:03:00.3: irq 72 for MSI/MSI-X [ 8.693535] xhci_hcd 0000:03:00.3: irq 73 for MSI/MSI-X [ 8.693543] xhci_hcd 0000:03:00.3: irq 74 for MSI/MSI-X [ 8.693551] xhci_hcd 0000:03:00.3: irq 75 for MSI/MSI-X [ 8.693560] xhci_hcd 0000:03:00.3: irq 76 for MSI/MSI-X [ 8.693568] xhci_hcd 0000:03:00.3: irq 77 for MSI/MSI-X [ 8.693576] xhci_hcd 0000:03:00.3: irq 78 for MSI/MSI-X [ 8.693583] xhci_hcd 0000:03:00.3: irq 79 for MSI/MSI-X [ 8.693790] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 3.10 [ 8.702047] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 8.709292] usb usb1: Product: xHCI Host Controller [ 8.714170] usb usb1: Manufacturer: Linux 3.10.0-1160.108.1.el7_lustre.pl1.x86_64 xhci-hcd [ 8.722431] usb usb1: SerialNumber: 0000:03:00.3 [ 8.727171] hub 1-0:1.0: USB hub found [ 8.730930] hub 1-0:1.0: 2 ports detected [ 8.735238] xhci_hcd 0000:03:00.3: xHCI Host Controller [ 8.740517] xhci_hcd 0000:03:00.3: new USB bus registered, assigned bus number 2 [ 8.747919] xhci_hcd 0000:03:00.3: Host supports USB 3.10 Enhanced SuperSpeed [ 8.755061] usb usb2: We don't know the algorithms for LPM for this host, disabling LPM. [ 8.763153] usb usb2: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 3.10 [ 8.771412] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 8.778629] usb usb2: Product: xHCI Host Controller [ 8.783510] usb usb2: Manufacturer: Linux 3.10.0-1160.108.1.el7_lustre.pl1.x86_64 xhci-hcd [ 8.791768] usb usb2: SerialNumber: 0000:03:00.3 [ 8.796466] hub 2-0:1.0: USB hub found [ 8.800225] hub 2-0:1.0: 2 ports detected [ 8.804520] xhci_hcd 0000:22:00.3: xHCI Host Controller [ 8.809799] xhci_hcd 0000:22:00.3: new USB bus registered, assigned bus number 3 [ 8.813416] tsc: Refined TSC clocksource calibration: 3194.001 MHz [ 8.823425] Switched to clocksource tsc [ 8.823481] xhci_hcd 0000:22:00.3: hcc params 0x0260ffe5 hci version 0x110 quirks 0x0000000000000410 [ 8.823507] xhci_hcd 0000:22:00.3: irq 81 for MSI/MSI-X [ 8.823515] xhci_hcd 0000:22:00.3: irq 82 for MSI/MSI-X [ 8.823523] xhci_hcd 0000:22:00.3: irq 83 for MSI/MSI-X [ 8.823537] xhci_hcd 0000:22:00.3: irq 84 for MSI/MSI-X [ 8.823543] xhci_hcd 0000:22:00.3: irq 85 for MSI/MSI-X [ 8.823551] xhci_hcd 0000:22:00.3: irq 86 for MSI/MSI-X [ 8.823558] xhci_hcd 0000:22:00.3: irq 87 for MSI/MSI-X [ 8.823565] xhci_hcd 0000:22:00.3: irq 88 for MSI/MSI-X [ 8.823749] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 3.10 [ 8.823750] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 8.823750] usb usb3: Product: xHCI Host Controller [ 8.823751] usb usb3: Manufacturer: Linux 3.10.0-1160.108.1.el7_lustre.pl1.x86_64 xhci-hcd [ 8.823751] usb usb3: SerialNumber: 0000:22:00.3 [ 8.823811] hub 3-0:1.0: USB hub found [ 8.823814] hub 3-0:1.0: 2 ports detected [ 8.823948] xhci_hcd 0000:22:00.3: xHCI Host Controller [ 8.823977] xhci_hcd 0000:22:00.3: new USB bus registered, assigned bus number 4 [ 8.823978] xhci_hcd 0000:22:00.3: Host supports USB 3.10 Enhanced SuperSpeed [ 8.823985] usb usb4: We don't know the algorithms for LPM for this host, disabling LPM. [ 8.823993] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 3.10 [ 8.823994] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 8.823994] usb usb4: Product: xHCI Host Controller [ 8.823995] usb usb4: Manufacturer: Linux 3.10.0-1160.108.1.el7_lustre.pl1.x86_64 xhci-hcd [ 8.823995] usb usb4: SerialNumber: 0000:22:00.3 [ 8.824049] hub 4-0:1.0: USB hub found [ 8.824052] hub 4-0:1.0: 2 ports detected [ 8.824237] usbcore: registered new interface driver usbserial_generic [ 8.824241] usbserial: USB Serial support registered for generic [ 8.824274] i8042: PNP: No PS/2 controller found. Probing ports directly. [ 9.135379] usb 3-1: new high-speed USB device number 2 using xhci_hcd [ 9.265350] usb 3-1: New USB device found, idVendor=1604, idProduct=10c0, bcdDevice= 0.00 [ 9.273523] usb 3-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 9.336111] hub 3-1:1.0: USB hub found [ 9.340092] hub 3-1:1.0: 4 ports detected [ 9.457361] usb 3-2: new high-speed USB device number 3 using xhci_hcd [ 9.587329] usb 3-2: New USB device found, idVendor=0424, idProduct=2514, bcdDevice= 0.00 [ 9.595505] usb 3-2: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 9.656111] hub 3-2:1.0: USB hub found [ 9.660071] hub 3-2:1.0: 2 ports detected [ 9.867124] i8042: No controller found [ 9.870996] mousedev: PS/2 mouse device common for all mice [ 9.876704] rtc_cmos 00:02: RTC can wake from S4 [ 9.881500] rtc_cmos 00:02: rtc core: registered rtc_cmos as rtc0 [ 9.887649] rtc_cmos 00:02: alarms up to one month, y3k, 114 bytes nvram, hpet irqs [ 9.895338] cpuidle: using governor menu [ 9.899530] EFI Variables Facility v0.08 2004-May-17 [ 9.906748] hidraw: raw HID events driver (C) Jiri Kosina [ 9.912234] usbcore: registered new interface driver usbhid [ 9.917804] usbhid: USB HID core driver [ 9.921820] drop_monitor: Initializing network drop monitor service [ 9.928123] Netfilter messages via NETLINK v0.30. [ 9.932859] TCP: cubic registered [ 9.936180] Initializing XFRM netlink socket [ 9.940554] NET: Registered protocol family 10 [ 9.945369] NET: Registered protocol family 17 [ 9.949827] mpls_gso: MPLS GSO support [ 9.955362] intel_rdt: Intel RDT L3 allocation detected [ 9.960584] intel_rdt: Intel RDT L3DATA allocation detected [ 9.966154] intel_rdt: Intel RDT L3CODE allocation detected [ 9.971729] intel_rdt: Intel RDT L3 monitoring detected [ 9.976951] mce: Using 28 MCE banks [ 9.980498] microcode: CPU0: patch_level=0x0a0011d1 [ 9.985383] microcode: CPU1: patch_level=0x0a0011d1 [ 9.990272] microcode: CPU2: patch_level=0x0a0011d1 [ 9.995159] microcode: CPU3: patch_level=0x0a0011d1 [ 10.000055] microcode: CPU4: patch_level=0x0a0011d1 [ 10.004944] microcode: CPU5: patch_level=0x0a0011d1 [ 10.009830] microcode: CPU6: patch_level=0x0a0011d1 [ 10.014717] microcode: CPU7: patch_level=0x0a0011d1 [ 10.019607] microcode: CPU8: patch_level=0x0a0011d1 [ 10.020330] usb 3-1.1: new high-speed USB device number 4 using xhci_hcd [ 10.031184] microcode: CPU9: patch_level=0x0a0011d1 [ 10.036065] microcode: CPU10: patch_level=0x0a0011d1 [ 10.041038] microcode: CPU11: patch_level=0x0a0011d1 [ 10.046022] microcode: CPU12: patch_level=0x0a0011d1 [ 10.050997] microcode: CPU13: patch_level=0x0a0011d1 [ 10.055971] microcode: CPU14: patch_level=0x0a0011d1 [ 10.060945] microcode: CPU15: patch_level=0x0a0011d1 [ 10.065922] microcode: CPU16: patch_level=0x0a0011d1 [ 10.070894] microcode: CPU17: patch_level=0x0a0011d1 [ 10.075868] microcode: CPU18: patch_level=0x0a0011d1 [ 10.080842] microcode: CPU19: patch_level=0x0a0011d1 [ 10.085817] microcode: CPU20: patch_level=0x0a0011d1 [ 10.090788] microcode: CPU21: patch_level=0x0a0011d1 [ 10.094305] usb 3-1.1: New USB device found, idVendor=1604, idProduct=10c0, bcdDevice= 0.00 [ 10.094306] usb 3-1.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 10.111407] microcode: CPU22: patch_level=0x0a0011d1 [ 10.116371] microcode: CPU23: patch_level=0x0a0011d1 [ 10.121343] microcode: CPU24: patch_level=0x0a0011d1 [ 10.126319] microcode: CPU25: patch_level=0x0a0011d1 [ 10.131288] microcode: CPU26: patch_level=0x0a0011d1 [ 10.136075] hub 3-1.1:1.0: USB hub found [ 10.136423] hub 3-1.1:1.0: 4 ports detected [ 10.144369] microcode: CPU27: patch_level=0x0a0011d1 [ 10.149342] microcode: CPU28: patch_level=0x0a0011d1 [ 10.154316] microcode: CPU29: patch_level=0x0a0011d1 [ 10.159289] microcode: CPU30: patch_level=0x0a0011d1 [ 10.164255] microcode: CPU31: patch_level=0x0a0011d1 [ 10.169225] microcode: CPU32: patch_level=0x0a0011d1 [ 10.174195] microcode: CPU33: patch_level=0x0a0011d1 [ 10.179161] microcode: CPU34: patch_level=0x0a0011d1 [ 10.184128] microcode: CPU35: patch_level=0x0a0011d1 [ 10.189097] microcode: CPU36: patch_level=0x0a0011d1 [ 10.194070] microcode: CPU37: patch_level=0x0a0011d1 [ 10.199042] microcode: CPU38: patch_level=0x0a0011d1 [ 10.200314] usb 3-1.3: new high-speed USB device number 5 using xhci_hcd [ 10.210698] microcode: CPU39: patch_level=0x0a0011d1 [ 10.215665] microcode: CPU40: patch_level=0x0a0011d1 [ 10.220640] microcode: CPU41: patch_level=0x0a0011d1 [ 10.225604] microcode: CPU42: patch_level=0x0a0011d1 [ 10.230570] microcode: CPU43: patch_level=0x0a0011d1 [ 10.235539] microcode: CPU44: patch_level=0x0a0011d1 [ 10.240509] microcode: CPU45: patch_level=0x0a0011d1 [ 10.245476] microcode: CPU46: patch_level=0x0a0011d1 [ 10.250442] microcode: CPU47: patch_level=0x0a0011d1 [ 10.255411] microcode: CPU48: patch_level=0x0a0011d1 [ 10.260383] microcode: CPU49: patch_level=0x0a0011d1 [ 10.265348] microcode: CPU50: patch_level=0x0a0011d1 [ 10.270313] microcode: CPU51: patch_level=0x0a0011d1 [ 10.275282] microcode: CPU52: patch_level=0x0a0011d1 [ 10.280251] microcode: CPU53: patch_level=0x0a0011d1 [ 10.285217] microcode: CPU54: patch_level=0x0a0011d1 [ 10.290184] microcode: CPU55: patch_level=0x0a0011d1 [ 10.295152] microcode: CPU56: patch_level=0x0a0011d1 [ 10.300118] microcode: CPU57: patch_level=0x0a0011d1 [ 10.300410] usb 3-1.3: New USB device found, idVendor=413c, idProduct=a102, bcdDevice= 3.16 [ 10.300411] usb 3-1.3: New USB device strings: Mfr=1, Product=2, SerialNumber=3 [ 10.300412] usb 3-1.3: Product: iDRAC Virtual NIC USB Device [ 10.300412] usb 3-1.3: Manufacturer: Dell(TM) [ 10.300413] usb 3-1.3: SerialNumber: 5678 [ 10.334741] microcode: CPU58: patch_level=0x0a0011d1 [ 10.339714] microcode: CPU59: patch_level=0x0a0011d1 [ 10.344681] microcode: CPU60: patch_level=0x0a0011d1 [ 10.349655] microcode: CPU61: patch_level=0x0a0011d1 [ 10.354620] microcode: CPU62: patch_level=0x0a0011d1 [ 10.359586] microcode: CPU63: patch_level=0x0a0011d1 [ 10.364578] microcode: Microcode Update Driver: v2.01 , Peter Oruba [ 10.373431] PM: Hibernation image not present or could not be loaded. [ 10.373433] Loading compiled-in X.509 certificates [ 10.378246] Loaded X.509 cert 'CentOS Linux kpatch signing key: ea0413152cde1d98ebdca3fe6f0230904c9ef717' [ 10.387807] Loaded X.509 cert 'CentOS Linux Driver update signing key: 7f421ee0ab69461574bb358861dbe77762a4201b' [ 10.398183] Loaded X.509 cert 'CentOS Linux kernel signing key: 106442da66175b3be3a784b413f596d41f209f17' [ 10.407752] registered taskstats version 1 [ 10.411865] page_owner is disabled [ 10.417413] Key type trusted registered [ 10.422477] Key type encrypted registered [ 10.426307] usb 3-1.4: new high-speed USB device number 6 using xhci_hcd [ 10.470233] BERT: Boot Error Record Table support is disabled. Enable it by using bert_enable as kernel parameter. [ 10.480642] Magic number: 12:124:339 [ 10.484534] acpi ACPI0007:01: hash matches [ 10.488785] memory memory2708: hash matches [ 10.493066] memory memory1422: hash matches [ 10.497313] memory memory635: hash matches [ 10.500277] usb 3-1.4: New USB device found, idVendor=1604, idProduct=10c0, bcdDevice= 0.00 [ 10.500278] usb 3-1.4: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 10.517146] memory memory189: hash matches [ 10.521308] rtc_cmos 00:02: setting system clock to 2024-02-01 17:20:50 UTC (1706808050) [ 10.529983] Freeing unused kernel memory: 2176k freed [ 10.535178] Write protecting the kernel read-only data: 12288k [ 10.541271] Freeing unused kernel memory: 192k freed [ 10.546872] Freeing unused kernel memory: 524k freed [ 10.559275] systemd[1]: systemd 219 running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 -SECCOMP +BLKID +ELFUTILS +KMOD +IDN) [ 10.577352] systemd[1]: Detected architecture x86-64. [ 10.582405] systemd[1]: Running in initial RAM disk. [ 10.584041] hub 3-1.4:1.0: USB hub found [ 10.584393] hub 3-1.4:1.0: 4 ports detected [ 10.604399] systemd[1]: Set hostname to . [ 10.636417] systemd[1]: Reached target Local File Systems. [ 10.647344] systemd[1]: Reached target Swap. [ 10.656546] systemd[1]: Created slice Root Slice. [ 10.665355] systemd[1]: Created slice System Slice. [ 10.676341] systemd[1]: Reached target Slices. [ 10.685408] systemd[1]: Listening on Journal Socket. [ 10.697004] systemd[1]: Starting Apply Kernel Variables... [ 10.707720] systemd[1]: Starting dracut cmdline hook... [ 10.717610] systemd[1]: Starting Journal Service... [ 10.727935] systemd[1]: Starting Setup Virtual Console... [ 10.738668] systemd[1]: Starting Create list of required static device nodes for the current kernel... [ 10.769354] systemd[1]: Listening on udev Kernel Socket. [ 10.780368] systemd[1]: Listening on udev Control Socket. [ 10.791321] systemd[1]: Reached target Sockets. [ 10.800315] systemd[1]: Reached target Timers. [ 10.809599] systemd[1]: Started Journal Service. [ 10.975195] megasas: 07.714.04.00-rh1 [ 10.979153] megaraid_sas 0000:01:00.0: BAR:0x0 BAR's base_addr(phys):0x00000000eb000000 mapped virt_addr:0xffffad40712fc000 [ 10.979159] megaraid_sas 0000:01:00.0: FW now in Ready state [ 10.984831] megaraid_sas 0000:01:00.0: 63 bit DMA mask and 63 bit consistent mask [ 10.992427] megaraid_sas 0000:01:00.0: firmware supports msix : (128) [ 11.000463] megaraid_sas 0000:01:00.0: irq 90 for MSI/MSI-X [ 11.000478] megaraid_sas 0000:01:00.0: irq 91 for MSI/MSI-X [ 11.000487] megaraid_sas 0000:01:00.0: irq 92 for MSI/MSI-X [ 11.000496] megaraid_sas 0000:01:00.0: irq 93 for MSI/MSI-X [ 11.000503] megaraid_sas 0000:01:00.0: irq 94 for MSI/MSI-X [ 11.000518] megaraid_sas 0000:01:00.0: irq 95 for MSI/MSI-X [ 11.000525] megaraid_sas 0000:01:00.0: irq 96 for MSI/MSI-X [ 11.000532] megaraid_sas 0000:01:00.0: irq 97 for MSI/MSI-X [ 11.000538] megaraid_sas 0000:01:00.0: irq 98 for MSI/MSI-X [ 11.000546] megaraid_sas 0000:01:00.0: irq 99 for MSI/MSI-X [ 11.000552] megaraid_sas 0000:01:00.0: irq 100 for MSI/MSI-X [ 11.000559] megaraid_sas 0000:01:00.0: irq 101 for MSI/MSI-X [ 11.000570] megaraid_sas 0000:01:00.0: irq 102 for MSI/MSI-X [ 11.000579] megaraid_sas 0000:01:00.0: irq 103 for MSI/MSI-X [ 11.000589] megaraid_sas 0000:01:00.0: irq 104 for MSI/MSI-X [ 11.000599] megaraid_sas 0000:01:00.0: irq 105 for MSI/MSI-X [ 11.000606] megaraid_sas 0000:01:00.0: irq 106 for MSI/MSI-X [ 11.000617] megaraid_sas 0000:01:00.0: irq 107 for MSI/MSI-X [ 11.000624] megaraid_sas 0000:01:00.0: irq 108 for MSI/MSI-X [ 11.000634] megaraid_sas 0000:01:00.0: irq 109 for MSI/MSI-X [ 11.000642] megaraid_sas 0000:01:00.0: irq 110 for MSI/MSI-X [ 11.000655] megaraid_sas 0000:01:00.0: irq 111 for MSI/MSI-X [ 11.000662] megaraid_sas 0000:01:00.0: irq 112 for MSI/MSI-X [ 11.000670] megaraid_sas 0000:01:00.0: irq 113 for MSI/MSI-X [ 11.000678] megaraid_sas 0000:01:00.0: irq 114 for MSI/MSI-X [ 11.000686] megaraid_sas 0000:01:00.0: irq 115 for MSI/MSI-X [ 11.000695] megaraid_sas 0000:01:00.0: irq 116 for MSI/MSI-X [ 11.000704] megaraid_sas 0000:01:00.0: irq 117 for MSI/MSI-X [ 11.000711] megaraid_sas 0000:01:00.0: irq 118 for MSI/MSI-X [ 11.000719] megaraid_sas 0000:01:00.0: irq 119 for MSI/MSI-X [ 11.000731] megaraid_sas 0000:01:00.0: irq 120 for MSI/MSI-X [ 11.000732] pps_core: LinuxPPS API ver. 1 registered [ 11.000734] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 11.017280] megaraid_sas 0000:01:00.0: irq 121 for MSI/MSI-X [ 11.017295] megaraid_sas 0000:01:00.0: irq 122 for MSI/MSI-X [ 11.017314] megaraid_sas 0000:01:00.0: irq 123 for MSI/MSI-X [ 11.017322] megaraid_sas 0000:01:00.0: irq 124 for MSI/MSI-X [ 11.017332] megaraid_sas 0000:01:00.0: irq 125 for MSI/MSI-X [ 11.017340] megaraid_sas 0000:01:00.0: irq 126 for MSI/MSI-X [ 11.017348] megaraid_sas 0000:01:00.0: irq 127 for MSI/MSI-X [ 11.017356] megaraid_sas 0000:01:00.0: irq 128 for MSI/MSI-X [ 11.017364] megaraid_sas 0000:01:00.0: irq 129 for MSI/MSI-X [ 11.017384] megaraid_sas 0000:01:00.0: irq 130 for MSI/MSI-X [ 11.017394] megaraid_sas 0000:01:00.0: irq 131 for MSI/MSI-X [ 11.017402] megaraid_sas 0000:01:00.0: irq 132 for MSI/MSI-X [ 11.017413] megaraid_sas 0000:01:00.0: irq 133 for MSI/MSI-X [ 11.017422] megaraid_sas 0000:01:00.0: irq 134 for MSI/MSI-X [ 11.017430] megaraid_sas 0000:01:00.0: irq 135 for MSI/MSI-X [ 11.017442] megaraid_sas 0000:01:00.0: irq 136 for MSI/MSI-X [ 11.017452] megaraid_sas 0000:01:00.0: irq 137 for MSI/MSI-X [ 11.017461] megaraid_sas 0000:01:00.0: irq 138 for MSI/MSI-X [ 11.017475] megaraid_sas 0000:01:00.0: irq 139 for MSI/MSI-X [ 11.017485] megaraid_sas 0000:01:00.0: irq 140 for MSI/MSI-X [ 11.017494] megaraid_sas 0000:01:00.0: irq 141 for MSI/MSI-X [ 11.017506] megaraid_sas 0000:01:00.0: irq 142 for MSI/MSI-X [ 11.017517] megaraid_sas 0000:01:00.0: irq 143 for MSI/MSI-X [ 11.017527] megaraid_sas 0000:01:00.0: irq 144 for MSI/MSI-X [ 11.017535] megaraid_sas 0000:01:00.0: irq 145 for MSI/MSI-X [ 11.017547] megaraid_sas 0000:01:00.0: irq 146 for MSI/MSI-X [ 11.017557] megaraid_sas 0000:01:00.0: irq 147 for MSI/MSI-X [ 11.017568] megaraid_sas 0000:01:00.0: irq 148 for MSI/MSI-X [ 11.017582] megaraid_sas 0000:01:00.0: irq 149 for MSI/MSI-X [ 11.017592] megaraid_sas 0000:01:00.0: irq 150 for MSI/MSI-X [ 11.017601] megaraid_sas 0000:01:00.0: irq 151 for MSI/MSI-X [ 11.017614] megaraid_sas 0000:01:00.0: irq 152 for MSI/MSI-X [ 11.017628] megaraid_sas 0000:01:00.0: irq 153 for MSI/MSI-X [ 11.017640] megaraid_sas 0000:01:00.0: irq 154 for MSI/MSI-X [ 11.017659] megaraid_sas 0000:01:00.0: irq 155 for MSI/MSI-X [ 11.017669] megaraid_sas 0000:01:00.0: irq 156 for MSI/MSI-X [ 11.017681] megaraid_sas 0000:01:00.0: irq 157 for MSI/MSI-X [ 11.017705] megaraid_sas 0000:01:00.0: irq 158 for MSI/MSI-X [ 11.017731] megaraid_sas 0000:01:00.0: irq 159 for MSI/MSI-X [ 11.017763] megaraid_sas 0000:01:00.0: irq 160 for MSI/MSI-X [ 11.017787] megaraid_sas 0000:01:00.0: irq 161 for MSI/MSI-X [ 11.017843] mpt3sas: loading out-of-tree module taints kernel. [ 11.018106] mpt3sas: loading out-of-tree module taints kernel. [ 11.018184] megaraid_sas 0000:01:00.0: requested/available msix 72/72 [ 11.018191] megaraid_sas 0000:01:00.0: current msix/online cpus : (72/64) [ 11.018192] megaraid_sas 0000:01:00.0: RDPQ mode : (enabled) [ 11.018196] megaraid_sas 0000:01:00.0: Current firmware supports maximum commands: 1517 LDIO threshold: 0 [ 11.018613] megaraid_sas 0000:01:00.0: Configured max firmware commands: 1516 [ 11.021010] megaraid_sas 0000:01:00.0: Performance mode :Balanced [ 11.021011] megaraid_sas 0000:01:00.0: FW supports sync cache : Yes [ 11.021014] megaraid_sas 0000:01:00.0: megasas_disable_intr_fusion is called outbound_intr_mask:0x40000009 [ 11.036046] mpt3sas: module verification failed: signature and/or required key missing - tainting kernel [ 11.097162] PTP clock support registered [ 11.103916] Compat-mlnx-ofed backport release: 5f79a79 [ 11.109783] Backport based on mlnx_ofed/mlnx-ofa_kernel-4.0.git 5f79a79 [ 11.116402] compat.git: mlnx_ofed/mlnx-ofa_kernel-4.0.git [ 11.122374] libata version 3.00 loaded. [ 11.122403] mpt3sas version 46.00.00.00 loaded [ 11.128096] mpt3sas_cm0: 63 BIT PCI BUS DMA ADDRESSING SUPPORTED, total mem (527661840 kB) [ 11.137845] tg3.c:v3.137 (May 11, 2014) [ 11.144993] ahci 0000:c3:00.0: version 3.0 [ 11.145185] ahci 0000:c3:00.0: irq 165 for MSI/MSI-X [ 11.145190] ahci 0000:c3:00.0: irq 166 for MSI/MSI-X [ 11.145193] ahci 0000:c3:00.0: irq 167 for MSI/MSI-X [ 11.145197] ahci 0000:c3:00.0: irq 168 for MSI/MSI-X [ 11.145201] ahci 0000:c3:00.0: irq 169 for MSI/MSI-X [ 11.145204] ahci 0000:c3:00.0: irq 170 for MSI/MSI-X [ 11.145208] ahci 0000:c3:00.0: irq 171 for MSI/MSI-X [ 11.145212] ahci 0000:c3:00.0: irq 172 for MSI/MSI-X [ 11.145216] ahci 0000:c3:00.0: irq 173 for MSI/MSI-X [ 11.145219] ahci 0000:c3:00.0: irq 174 for MSI/MSI-X [ 11.145223] ahci 0000:c3:00.0: irq 175 for MSI/MSI-X [ 11.145227] ahci 0000:c3:00.0: irq 176 for MSI/MSI-X [ 11.145230] ahci 0000:c3:00.0: irq 177 for MSI/MSI-X [ 11.145234] ahci 0000:c3:00.0: irq 178 for MSI/MSI-X [ 11.145238] ahci 0000:c3:00.0: irq 179 for MSI/MSI-X [ 11.145241] ahci 0000:c3:00.0: irq 180 for MSI/MSI-X [ 11.152194] tg3 0000:e1:00.0 eth0: Tigon3 [partno(BCM95720) rev 5720000] (PCI Express) MAC address c4:5a:b1:af:ae:12 [ 11.156330] ahci 0000:c3:00.0: AHCI 0001.0301 32 slots 8 ports 6 Gbps 0xff impl SATA mode [ 11.156332] ahci 0000:c3:00.0: flags: 64bit ncq sntf ilck pm led clo only pmp fbs pio slum part sxs [ 11.157235] scsi host2: ahci [ 11.157386] scsi host3: ahci [ 11.157497] scsi host4: ahci [ 11.157621] scsi host5: ahci [ 11.157708] scsi host6: ahci [ 11.157810] scsi host7: ahci [ 11.157900] scsi host8: ahci [ 11.158000] scsi host9: ahci [ 11.158032] ata1: SATA max UDMA/133 abar m2048@0xb3000000 port 0xb3000100 irq 165 [ 11.158034] ata2: SATA max UDMA/133 abar m2048@0xb3000000 port 0xb3000180 irq 166 [ 11.158036] ata3: SATA max UDMA/133 abar m2048@0xb3000000 port 0xb3000200 irq 167 [ 11.158037] ata4: SATA max UDMA/133 abar m2048@0xb3000000 port 0xb3000280 irq 168 [ 11.158038] ata5: SATA max UDMA/133 abar m2048@0xb3000000 port 0xb3000300 irq 169 [ 11.158040] ata6: SATA max UDMA/133 abar m2048@0xb3000000 port 0xb3000380 irq 170 [ 11.158041] ata7: SATA max UDMA/133 abar m2048@0xb3000000 port 0xb3000400 irq 171 [ 11.158042] ata8: SATA max UDMA/133 abar m2048@0xb3000000 port 0xb3000480 irq 172 [ 11.172263] megaraid_sas 0000:01:00.0: FW supports atomic descriptor : Yes [ 11.183064] tg3 0000:e1:00.0 eth0: attached PHY is 5720C (10/100/1000Base-T Ethernet) (WireSpeed[1], EEE[1]) [ 11.183065] tg3 0000:e1:00.0 eth0: RXcsums[1] LinkChgREG[0] MIirq[0] ASF[1] TSOcap[1] [ 11.183066] tg3 0000:e1:00.0 eth0: dma_rwctrl[00000001] dma_mask[64-bit] [ 11.193261] megaraid_sas 0000:01:00.0: FW provided supportMaxExtLDs: 0 max_lds: 32 [ 11.193261] megaraid_sas 0000:01:00.0: controller type : iMR(0MB) [ 11.193262] megaraid_sas 0000:01:00.0: Online Controller Reset(OCR) : Enabled [ 11.193263] megaraid_sas 0000:01:00.0: Secure JBOD support : No [ 11.193264] megaraid_sas 0000:01:00.0: NVMe passthru support : Yes [ 11.193265] megaraid_sas 0000:01:00.0: FW provided TM TaskAbort/Reset timeout : 6 secs/60 secs [ 11.193265] megaraid_sas 0000:01:00.0: JBOD sequence map support : Yes [ 11.193266] megaraid_sas 0000:01:00.0: PCI Lane Margining support : Yes [ 11.202200] tg3 0000:e1:00.1 eth1: Tigon3 [partno(BCM95720) rev 5720000] (PCI Express) MAC address c4:5a:b1:af:ae:13 [ 11.202201] tg3 0000:e1:00.1 eth1: attached PHY is 5720C (10/100/1000Base-T Ethernet) (WireSpeed[1], EEE[1]) [ 11.202201] tg3 0000:e1:00.1 eth1: RXcsums[1] LinkChgREG[0] MIirq[0] ASF[1] TSOcap[1] [ 11.202202] tg3 0000:e1:00.1 eth1: dma_rwctrl[00000001] dma_mask[64-bit] [ 11.211678] mlx5_core 0000:a1:00.0: firmware version: 20.38.1002 [ 11.211701] mlx5_core 0000:a1:00.0: 252.048 Gb/s available PCIe bandwidth (16 GT/s x16 link) [ 11.213259] mpt3sas_cm0: IOC Number : 0 [ 11.213271] mpt3sas 0000:41:00.0: PCIe device speed is 16.0GHz [ 11.213340] mpt3sas 0000:41:00.0: irq 183 for MSI/MSI-X [ 11.213348] mpt3sas 0000:41:00.0: irq 184 for MSI/MSI-X [ 11.213361] mpt3sas 0000:41:00.0: irq 185 for MSI/MSI-X [ 11.213369] mpt3sas 0000:41:00.0: irq 186 for MSI/MSI-X [ 11.213376] mpt3sas 0000:41:00.0: irq 187 for MSI/MSI-X [ 11.213385] mpt3sas 0000:41:00.0: irq 188 for MSI/MSI-X [ 11.213391] mpt3sas 0000:41:00.0: irq 189 for MSI/MSI-X [ 11.213398] mpt3sas 0000:41:00.0: irq 190 for MSI/MSI-X [ 11.213405] mpt3sas 0000:41:00.0: irq 191 for MSI/MSI-X [ 11.213415] mpt3sas 0000:41:00.0: irq 192 for MSI/MSI-X [ 11.213422] mpt3sas 0000:41:00.0: irq 193 for MSI/MSI-X [ 11.213428] mpt3sas 0000:41:00.0: irq 194 for MSI/MSI-X [ 11.213435] mpt3sas 0000:41:00.0: irq 195 for MSI/MSI-X [ 11.213441] mpt3sas 0000:41:00.0: irq 196 for MSI/MSI-X [ 11.213449] mpt3sas 0000:41:00.0: irq 197 for MSI/MSI-X [ 11.213455] mpt3sas 0000:41:00.0: irq 198 for MSI/MSI-X [ 11.213461] mpt3sas 0000:41:00.0: irq 199 for MSI/MSI-X [ 11.213468] mpt3sas 0000:41:00.0: irq 200 for MSI/MSI-X [ 11.213480] mpt3sas 0000:41:00.0: irq 201 for MSI/MSI-X [ 11.213486] mpt3sas 0000:41:00.0: irq 202 for MSI/MSI-X [ 11.213492] mpt3sas 0000:41:00.0: irq 203 for MSI/MSI-X [ 11.213500] mpt3sas 0000:41:00.0: irq 204 for MSI/MSI-X [ 11.213507] mpt3sas 0000:41:00.0: irq 205 for MSI/MSI-X [ 11.213514] mpt3sas 0000:41:00.0: irq 206 for MSI/MSI-X [ 11.213520] mpt3sas 0000:41:00.0: irq 207 for MSI/MSI-X [ 11.213526] mpt3sas 0000:41:00.0: irq 208 for MSI/MSI-X [ 11.213533] mpt3sas 0000:41:00.0: irq 209 for MSI/MSI-X [ 11.213539] mpt3sas 0000:41:00.0: irq 210 for MSI/MSI-X [ 11.213545] mpt3sas 0000:41:00.0: irq 211 for MSI/MSI-X [ 11.213553] mpt3sas 0000:41:00.0: irq 212 for MSI/MSI-X [ 11.213559] mpt3sas 0000:41:00.0: irq 213 for MSI/MSI-X [ 11.213565] mpt3sas 0000:41:00.0: irq 214 for MSI/MSI-X [ 11.213571] mpt3sas 0000:41:00.0: irq 215 for MSI/MSI-X [ 11.213578] mpt3sas 0000:41:00.0: irq 216 for MSI/MSI-X [ 11.213590] mpt3sas 0000:41:00.0: irq 217 for MSI/MSI-X [ 11.213596] mpt3sas 0000:41:00.0: irq 218 for MSI/MSI-X [ 11.213603] mpt3sas 0000:41:00.0: irq 219 for MSI/MSI-X [ 11.213611] mpt3sas 0000:41:00.0: irq 220 for MSI/MSI-X [ 11.213617] mpt3sas 0000:41:00.0: irq 221 for MSI/MSI-X [ 11.213624] mpt3sas 0000:41:00.0: irq 222 for MSI/MSI-X [ 11.213630] mpt3sas 0000:41:00.0: irq 223 for MSI/MSI-X [ 11.213637] mpt3sas 0000:41:00.0: irq 224 for MSI/MSI-X [ 11.213644] mpt3sas 0000:41:00.0: irq 225 for MSI/MSI-X [ 11.213650] mpt3sas 0000:41:00.0: irq 226 for MSI/MSI-X [ 11.213656] mpt3sas 0000:41:00.0: irq 227 for MSI/MSI-X [ 11.213664] mpt3sas 0000:41:00.0: irq 228 for MSI/MSI-X [ 11.213673] mpt3sas 0000:41:00.0: irq 229 for MSI/MSI-X [ 11.213682] mpt3sas 0000:41:00.0: irq 230 for MSI/MSI-X [ 11.213691] mpt3sas 0000:41:00.0: irq 231 for MSI/MSI-X [ 11.213700] mpt3sas 0000:41:00.0: irq 232 for MSI/MSI-X [ 11.213714] mpt3sas 0000:41:00.0: irq 233 for MSI/MSI-X [ 11.213723] mpt3sas 0000:41:00.0: irq 234 for MSI/MSI-X [ 11.213732] mpt3sas 0000:41:00.0: irq 235 for MSI/MSI-X [ 11.213742] mpt3sas 0000:41:00.0: irq 236 for MSI/MSI-X [ 11.213751] mpt3sas 0000:41:00.0: irq 237 for MSI/MSI-X [ 11.213761] mpt3sas 0000:41:00.0: irq 238 for MSI/MSI-X [ 11.213770] mpt3sas 0000:41:00.0: irq 239 for MSI/MSI-X [ 11.213780] mpt3sas 0000:41:00.0: irq 240 for MSI/MSI-X [ 11.213789] mpt3sas 0000:41:00.0: irq 241 for MSI/MSI-X [ 11.213798] mpt3sas 0000:41:00.0: irq 242 for MSI/MSI-X [ 11.213807] mpt3sas 0000:41:00.0: irq 243 for MSI/MSI-X [ 11.213818] mpt3sas 0000:41:00.0: irq 244 for MSI/MSI-X [ 11.213827] mpt3sas 0000:41:00.0: irq 245 for MSI/MSI-X [ 11.213836] mpt3sas 0000:41:00.0: irq 246 for MSI/MSI-X [ 11.213845] mpt3sas 0000:41:00.0: irq 247 for MSI/MSI-X [ 11.213854] mpt3sas 0000:41:00.0: irq 248 for MSI/MSI-X [ 11.213866] mpt3sas 0000:41:00.0: irq 249 for MSI/MSI-X [ 11.213875] mpt3sas 0000:41:00.0: irq 250 for MSI/MSI-X [ 11.213886] mpt3sas 0000:41:00.0: irq 251 for MSI/MSI-X [ 11.213896] mpt3sas 0000:41:00.0: irq 252 for MSI/MSI-X [ 11.213906] mpt3sas 0000:41:00.0: irq 253 for MSI/MSI-X [ 11.213915] mpt3sas 0000:41:00.0: irq 254 for MSI/MSI-X [ 11.214530] megaraid_sas 0000:01:00.0: NVME page size : (4096) [ 11.214757] mpt3sas0-msix0: PCI-MSI-X enabled: IRQ 183 [ 11.214757] mpt3sas0-msix1: PCI-MSI-X enabled: IRQ 184 [ 11.214758] mpt3sas0-msix2: PCI-MSI-X enabled: IRQ 185 [ 11.214758] mpt3sas0-msix3: PCI-MSI-X enabled: IRQ 186 [ 11.214758] mpt3sas0-msix4: PCI-MSI-X enabled: IRQ 187 [ 11.214759] mpt3sas0-msix5: PCI-MSI-X enabled: IRQ 188 [ 11.214759] mpt3sas0-msix6: PCI-MSI-X enabled: IRQ 189 [ 11.214759] mpt3sas0-msix7: PCI-MSI-X enabled: IRQ 190 [ 11.214759] mpt3sas0-msix8: PCI-MSI-X enabled: IRQ 191 [ 11.214759] mpt3sas0-msix9: PCI-MSI-X enabled: IRQ 192 [ 11.214760] mpt3sas0-msix10: PCI-MSI-X enabled: IRQ 193 [ 11.214760] mpt3sas0-msix11: PCI-MSI-X enabled: IRQ 194 [ 11.214760] mpt3sas0-msix12: PCI-MSI-X enabled: IRQ 195 [ 11.214760] mpt3sas0-msix13: PCI-MSI-X enabled: IRQ 196 [ 11.214760] mpt3sas0-msix14: PCI-MSI-X enabled: IRQ 197 [ 11.214761] mpt3sas0-msix15: PCI-MSI-X enabled: IRQ 198 [ 11.214761] mpt3sas0-msix16: PCI-MSI-X enabled: IRQ 199 [ 11.214761] mpt3sas0-msix17: PCI-MSI-X enabled: IRQ 200 [ 11.214761] mpt3sas0-msix18: PCI-MSI-X enabled: IRQ 201 [ 11.214761] mpt3sas0-msix19: PCI-MSI-X enabled: IRQ 202 [ 11.214762] mpt3sas0-msix20: PCI-MSI-X enabled: IRQ 203 [ 11.214762] mpt3sas0-msix21: PCI-MSI-X enabled: IRQ 204 [ 11.214762] mpt3sas0-msix22: PCI-MSI-X enabled: IRQ 205 [ 11.214762] mpt3sas0-msix23: PCI-MSI-X enabled: IRQ 206 [ 11.214762] mpt3sas0-msix24: PCI-MSI-X enabled: IRQ 207 [ 11.214763] mpt3sas0-msix25: PCI-MSI-X enabled: IRQ 208 [ 11.214763] mpt3sas0-msix26: PCI-MSI-X enabled: IRQ 209 [ 11.214763] mpt3sas0-msix27: PCI-MSI-X enabled: IRQ 210 [ 11.214763] mpt3sas0-msix28: PCI-MSI-X enabled: IRQ 211 [ 11.214763] mpt3sas0-msix29: PCI-MSI-X enabled: IRQ 212 [ 11.214764] mpt3sas0-msix30: PCI-MSI-X enabled: IRQ 213 [ 11.214764] mpt3sas0-msix31: PCI-MSI-X enabled: IRQ 214 [ 11.214764] mpt3sas0-msix32: PCI-MSI-X enabled: IRQ 215 [ 11.214764] mpt3sas0-msix33: PCI-MSI-X enabled: IRQ 216 [ 11.214764] mpt3sas0-msix34: PCI-MSI-X enabled: IRQ 217 [ 11.214765] mpt3sas0-msix35: PCI-MSI-X enabled: IRQ 218 [ 11.214765] mpt3sas0-msix36: PCI-MSI-X enabled: IRQ 219 [ 11.214765] mpt3sas0-msix37: PCI-MSI-X enabled: IRQ 220 [ 11.214765] mpt3sas0-msix38: PCI-MSI-X enabled: IRQ 221 [ 11.214765] mpt3sas0-msix39: PCI-MSI-X enabled: IRQ 222 [ 11.214765] mpt3sas0-msix40: PCI-MSI-X enabled: IRQ 223 [ 11.214766] mpt3sas0-msix41: PCI-MSI-X enabled: IRQ 224 [ 11.214766] mpt3sas0-msix42: PCI-MSI-X enabled: IRQ 225 [ 11.214766] mpt3sas0-msix43: PCI-MSI-X enabled: IRQ 226 [ 11.214766] mpt3sas0-msix44: PCI-MSI-X enabled: IRQ 227 [ 11.214766] mpt3sas0-msix45: PCI-MSI-X enabled: IRQ 228 [ 11.214767] mpt3sas0-msix46: PCI-MSI-X enabled: IRQ 229 [ 11.214767] mpt3sas0-msix47: PCI-MSI-X enabled: IRQ 230 [ 11.214767] mpt3sas0-msix48: PCI-MSI-X enabled: IRQ 231 [ 11.214767] mpt3sas0-msix49: PCI-MSI-X enabled: IRQ 232 [ 11.214767] mpt3sas0-msix50: PCI-MSI-X enabled: IRQ 233 [ 11.214768] mpt3sas0-msix51: PCI-MSI-X enabled: IRQ 234 [ 11.214768] mpt3sas0-msix52: PCI-MSI-X enabled: IRQ 235 [ 11.214768] mpt3sas0-msix53: PCI-MSI-X enabled: IRQ 236 [ 11.214768] mpt3sas0-msix54: PCI-MSI-X enabled: IRQ 237 [ 11.214768] mpt3sas0-msix55: PCI-MSI-X enabled: IRQ 238 [ 11.214769] mpt3sas0-msix56: PCI-MSI-X enabled: IRQ 239 [ 11.214769] mpt3sas0-msix57: PCI-MSI-X enabled: IRQ 240 [ 11.214769] mpt3sas0-msix58: PCI-MSI-X enabled: IRQ 241 [ 11.214769] mpt3sas0-msix59: PCI-MSI-X enabled: IRQ 242 [ 11.214769] mpt3sas0-msix60: PCI-MSI-X enabled: IRQ 243 [ 11.214770] mpt3sas0-msix61: PCI-MSI-X enabled: IRQ 244 [ 11.214770] mpt3sas0-msix62: PCI-MSI-X enabled: IRQ 245 [ 11.214770] mpt3sas0-msix63: PCI-MSI-X enabled: IRQ 246 [ 11.214770] mpt3sas0-msix64: PCI-MSI-X enabled: IRQ 247 [ 11.214770] mpt3sas0-msix65: PCI-MSI-X enabled: IRQ 248 [ 11.214771] mpt3sas0-msix66: PCI-MSI-X enabled: IRQ 249 [ 11.214771] mpt3sas0-msix67: PCI-MSI-X enabled: IRQ 250 [ 11.214771] mpt3sas0-msix68: PCI-MSI-X enabled: IRQ 251 [ 11.214771] mpt3sas0-msix69: PCI-MSI-X enabled: IRQ 252 [ 11.214771] mpt3sas0-msix70: PCI-MSI-X enabled: IRQ 253 [ 11.214772] mpt3sas0-msix71: PCI-MSI-X enabled: IRQ 254 [ 11.214772] mpt3sas_cm0: iomem(0x00000000d1000000), mapped(0xffffad4072c00000), size(1048576) [ 11.214773] mpt3sas_cm0: ioport(0x0000000000003000), size(256) [ 11.215445] megaraid_sas 0000:01:00.0: megasas_enable_intr_fusion is called outbound_intr_mask:0x40000000 [ 11.215446] megaraid_sas 0000:01:00.0: INIT adapter done [ 11.215773] mlx5_core 0000:a1:00.0: handle_hca_cap:707:(pid 375): log_max_qp value in current profile is 18, changing it to HCA capability limit (17) [ 11.250593] megaraid_sas 0000:01:00.0: Snap dump wait time : 25 [ 11.250595] megaraid_sas 0000:01:00.0: pci id : (0x1000)/(0x10e6)/(0x1028)/(0x2173) [ 11.250595] megaraid_sas 0000:01:00.0: unevenspan support : yes [ 11.250596] megaraid_sas 0000:01:00.0: firmware crash dump : no [ 11.250597] megaraid_sas 0000:01:00.0: JBOD sequence map : enabled [ 11.250643] scsi host0: Avago SAS based MegaRAID driver [ 11.274159] scsi 0:2:0:0: Direct-Access DELL PERC H355 Front 5.26 PQ: 0 ANSI: 5 [ 11.291251] mpt3sas_cm0: IOC Number : 0 [ 11.291253] mpt3sas_cm0: sending message unit reset !! [ 11.293251] mpt3sas_cm0: message unit reset: SUCCESS [ 11.327248] mpt3sas_cm0: scatter gather: sge_in_main_msg(0), sge_per_chain(7), sge_per_io(128), chains_per_io(19) [ 11.327306] mpt3sas_cm0: request pool(0xffff9e03b4700000) - dma(0x3f74700000): depth(4360), frame_size(128), pool_size(545 kB) [ 11.341952] mpt3sas_cm0: sense pool(0xffff9e03b2f80000) - dma(0x3f72f80000): depth(4339), element_size(96), pool_size (406 kB) [ 11.341999] mpt3sas_cm0: reply pool(0xffff9e03b2800000) - dma(0x3f72800000): depth(4424)frame_size(128), pool_size(553 kB) [ 11.342535] mpt3sas_cm0: config page(0xffff9e03b2f35000) - dma(0x3f72f35000): size(512) [ 11.342535] mpt3sas_cm0: Allocated physical memory: size(19978 kB) [ 11.342536] mpt3sas_cm0: Current Controller Queue Depth(4336), Max Controller Queue Depth(4352) [ 11.441860] mlx5_core 0000:a1:00.0: irq 255 for MSI/MSI-X [ 11.441874] mlx5_core 0000:a1:00.0: irq 256 for MSI/MSI-X [ 11.441881] mlx5_core 0000:a1:00.0: irq 257 for MSI/MSI-X [ 11.441887] mlx5_core 0000:a1:00.0: irq 258 for MSI/MSI-X [ 11.441892] mlx5_core 0000:a1:00.0: irq 259 for MSI/MSI-X [ 11.441898] mlx5_core 0000:a1:00.0: irq 260 for MSI/MSI-X [ 11.441904] mlx5_core 0000:a1:00.0: irq 261 for MSI/MSI-X [ 11.441910] mlx5_core 0000:a1:00.0: irq 262 for MSI/MSI-X [ 11.441916] mlx5_core 0000:a1:00.0: irq 263 for MSI/MSI-X [ 11.441922] mlx5_core 0000:a1:00.0: irq 264 for MSI/MSI-X [ 11.441927] mlx5_core 0000:a1:00.0: irq 265 for MSI/MSI-X [ 11.441934] mlx5_core 0000:a1:00.0: irq 266 for MSI/MSI-X [ 11.441939] mlx5_core 0000:a1:00.0: irq 267 for MSI/MSI-X [ 11.441944] mlx5_core 0000:a1:00.0: irq 268 for MSI/MSI-X [ 11.441951] mlx5_core 0000:a1:00.0: irq 269 for MSI/MSI-X [ 11.441962] mlx5_core 0000:a1:00.0: irq 270 for MSI/MSI-X [ 11.441967] mlx5_core 0000:a1:00.0: irq 271 for MSI/MSI-X [ 11.441972] mlx5_core 0000:a1:00.0: irq 272 for MSI/MSI-X [ 11.441977] mlx5_core 0000:a1:00.0: irq 273 for MSI/MSI-X [ 11.441982] mlx5_core 0000:a1:00.0: irq 274 for MSI/MSI-X [ 11.441987] mlx5_core 0000:a1:00.0: irq 275 for MSI/MSI-X [ 11.441992] mlx5_core 0000:a1:00.0: irq 276 for MSI/MSI-X [ 11.441997] mlx5_core 0000:a1:00.0: irq 277 for MSI/MSI-X [ 11.442001] mlx5_core 0000:a1:00.0: irq 278 for MSI/MSI-X [ 11.442007] mlx5_core 0000:a1:00.0: irq 279 for MSI/MSI-X [ 11.442011] mlx5_core 0000:a1:00.0: irq 280 for MSI/MSI-X [ 11.442016] mlx5_core 0000:a1:00.0: irq 281 for MSI/MSI-X [ 11.442021] mlx5_core 0000:a1:00.0: irq 282 for MSI/MSI-X [ 11.442026] mlx5_core 0000:a1:00.0: irq 283 for MSI/MSI-X [ 11.442030] mlx5_core 0000:a1:00.0: irq 284 for MSI/MSI-X [ 11.442035] mlx5_core 0000:a1:00.0: irq 285 for MSI/MSI-X [ 11.442043] mlx5_core 0000:a1:00.0: irq 286 for MSI/MSI-X [ 11.442048] mlx5_core 0000:a1:00.0: irq 287 for MSI/MSI-X [ 11.442053] mlx5_core 0000:a1:00.0: irq 288 for MSI/MSI-X [ 11.442057] mlx5_core 0000:a1:00.0: irq 289 for MSI/MSI-X [ 11.442062] mlx5_core 0000:a1:00.0: irq 290 for MSI/MSI-X [ 11.442067] mlx5_core 0000:a1:00.0: irq 291 for MSI/MSI-X [ 11.442071] mlx5_core 0000:a1:00.0: irq 292 for MSI/MSI-X [ 11.442076] mlx5_core 0000:a1:00.0: irq 293 for MSI/MSI-X [ 11.442080] mlx5_core 0000:a1:00.0: irq 294 for MSI/MSI-X [ 11.442085] mlx5_core 0000:a1:00.0: irq 295 for MSI/MSI-X [ 11.442090] mlx5_core 0000:a1:00.0: irq 296 for MSI/MSI-X [ 11.442094] mlx5_core 0000:a1:00.0: irq 297 for MSI/MSI-X [ 11.442099] mlx5_core 0000:a1:00.0: irq 298 for MSI/MSI-X [ 11.442105] mlx5_core 0000:a1:00.0: irq 299 for MSI/MSI-X [ 11.442110] mlx5_core 0000:a1:00.0: irq 300 for MSI/MSI-X [ 11.442115] mlx5_core 0000:a1:00.0: irq 301 for MSI/MSI-X [ 11.442123] mlx5_core 0000:a1:00.0: irq 302 for MSI/MSI-X [ 11.442129] mlx5_core 0000:a1:00.0: irq 303 for MSI/MSI-X [ 11.442133] mlx5_core 0000:a1:00.0: irq 304 for MSI/MSI-X [ 11.442138] mlx5_core 0000:a1:00.0: irq 305 for MSI/MSI-X [ 11.442143] mlx5_core 0000:a1:00.0: irq 306 for MSI/MSI-X [ 11.442147] mlx5_core 0000:a1:00.0: irq 307 for MSI/MSI-X [ 11.442152] mlx5_core 0000:a1:00.0: irq 308 for MSI/MSI-X [ 11.442156] mlx5_core 0000:a1:00.0: irq 309 for MSI/MSI-X [ 11.442161] mlx5_core 0000:a1:00.0: irq 310 for MSI/MSI-X [ 11.442166] mlx5_core 0000:a1:00.0: irq 311 for MSI/MSI-X [ 11.442170] mlx5_core 0000:a1:00.0: irq 312 for MSI/MSI-X [ 11.442175] mlx5_core 0000:a1:00.0: irq 313 for MSI/MSI-X [ 11.442179] mlx5_core 0000:a1:00.0: irq 314 for MSI/MSI-X [ 11.442184] mlx5_core 0000:a1:00.0: irq 315 for MSI/MSI-X [ 11.442188] mlx5_core 0000:a1:00.0: irq 316 for MSI/MSI-X [ 11.442193] mlx5_core 0000:a1:00.0: irq 317 for MSI/MSI-X [ 11.442201] mlx5_core 0000:a1:00.0: irq 318 for MSI/MSI-X [ 11.443425] mlx5_core 0000:a1:00.0: Port module event: module 0, Cable plugged [ 11.443766] mlx5_core 0000:a1:00.0: mlx5_pcie_event:306:(pid 5): PCIe slot advertised sufficient power (75W). [ 11.460911] mlx5_core 0000:a1:00.0: mlx5_fw_tracer_start:821:(pid 375): FWTracer: Ownership granted and active [ 11.463264] ata2: SATA link down (SStatus 0 SControl 300) [ 11.466264] ata3: SATA link down (SStatus 0 SControl 300) [ 11.466295] ata1: SATA link down (SStatus 0 SControl 300) [ 11.469271] ata4: SATA link down (SStatus 0 SControl 300) [ 11.475259] ata6: SATA link down (SStatus 0 SControl 300) [ 11.475290] ata5: SATA link down (SStatus 0 SControl 300) [ 11.475321] ata8: SATA link down (SStatus 0 SControl 300) [ 11.476258] ata7: SATA link down (SStatus 0 SControl 300) [ 11.676958] mpt3sas_cm0: FW Package Version(28.00.00.00) [ 11.677641] mpt3sas_cm0: SAS3816: FWVersion(28.00.00.00), ChipRevision(0x00) [ 11.677644] mpt3sas_cm0: Protocol=(Initiator,Target,NVMe), Capabilities=(TLR,EEDP,Diag Trace Buffer,Task Set Full,NCQ) [ 11.677776] mpt3sas 0000:41:00.0: Enabled Extended Tags as Controller Supports [ 11.677838] mpt3sas_cm0: Enable interrupt coalescing only for first 8 reply queues [ 11.677922] mpt3sas_cm0: performance mode: balanced [ 11.678019] mpt3sas_cm0: : host protection capabilities enabled DIF1 DIF2 DIF3 [ 11.678028] scsi host1: Fusion MPT SAS Host [ 11.678266] mpt3sas_cm0: registering trace buffer support [ 11.678422] mpt3sas_cm1: 63 BIT PCI BUS DMA ADDRESSING SUPPORTED, total mem (527661840 kB) [ 11.682056] mpt3sas_cm0: Trace buffer memory 2048 KB allocated [ 11.682056] mpt3sas_cm0: sending port enable !! [ 11.682501] mpt3sas_cm0: hba_port entry: ffff9e03ba6f1a40, port: 0 is added to hba_port list [ 11.682827] random: crng init done [ 11.683075] mpt3sas_cm0: hba_port entry: ffff9e03b83cf740, port: 1 is added to hba_port list [ 11.683584] mpt3sas_cm0: hba_port entry: ffff9e03bb36ee80, port: 8 is added to hba_port list [ 11.684053] mpt3sas_cm0: hba_port entry: ffff9e03ba4a1c80, port: 9 is added to hba_port list [ 11.684956] mpt3sas_cm0: host_add: handle(0x0001), sas_addr(0x500062b2198a7600), phys(21) [ 11.687022] mpt3sas_cm0: expander_add: handle(0x002f), parent(0x0001), sas_addr(0x500c0ff00c18423f), phys(37) [ 11.687185] expander-1:0: mpt3sas_transport_port_add: added: handle(0x002f), sas_addr(0x500c0ff00c18423f) [ 11.707068] mpt3sas_cm0: detecting: handle(0x0030), sas_address(0x5000c500ec922bb2), phy(0) [ 11.707070] mpt3sas_cm0: REPORT_LUNS: handle(0x0030), retries(0) [ 11.708421] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0030), lun(0) [ 11.709458] mpt3sas_cm0: handle(0x30) sas_address(0x5000c500ec922bb2) port_type(0x1) [ 11.714098] scsi 1:0:0:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 11.716365] scsi 1:0:0:0: SSP: handle(0x0030), sas_addr(0x5000c500ec922bb2), phy(0), device_name(0x5000c500ec922bb0) [ 11.716367] scsi 1:0:0:0: enclosure logical id(0x500c0ff0f6f4a33c), slot(0) [ 11.716367] scsi 1:0:0:0: enclosure level(0x0000), connector name( C1 ) [ 11.716368] scsi 1:0:0:0: serial_number(HWL031EA0000822150Z3) [ 11.716369] scsi 1:0:0:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 11.754226] mpt3sas_cm1: IOC Number : 0 [ 11.754237] mpt3sas 0000:81:00.0: PCIe device speed is 16.0GHz [ 11.754302] mpt3sas 0000:81:00.0: irq 320 for MSI/MSI-X [ 11.754309] mpt3sas 0000:81:00.0: irq 321 for MSI/MSI-X [ 11.754316] mpt3sas 0000:81:00.0: irq 322 for MSI/MSI-X [ 11.754324] mpt3sas 0000:81:00.0: irq 323 for MSI/MSI-X [ 11.754332] mpt3sas 0000:81:00.0: irq 324 for MSI/MSI-X [ 11.754340] mpt3sas 0000:81:00.0: irq 325 for MSI/MSI-X [ 11.754347] mpt3sas 0000:81:00.0: irq 326 for MSI/MSI-X [ 11.754354] mpt3sas 0000:81:00.0: irq 327 for MSI/MSI-X [ 11.754360] mpt3sas 0000:81:00.0: irq 328 for MSI/MSI-X [ 11.754367] mpt3sas 0000:81:00.0: irq 329 for MSI/MSI-X [ 11.754374] mpt3sas 0000:81:00.0: irq 330 for MSI/MSI-X [ 11.754380] mpt3sas 0000:81:00.0: irq 331 for MSI/MSI-X [ 11.754386] mpt3sas 0000:81:00.0: irq 332 for MSI/MSI-X [ 11.754393] mpt3sas 0000:81:00.0: irq 333 for MSI/MSI-X [ 11.754404] mpt3sas 0000:81:00.0: irq 334 for MSI/MSI-X [ 11.754410] mpt3sas 0000:81:00.0: irq 335 for MSI/MSI-X [ 11.754417] mpt3sas 0000:81:00.0: irq 336 for MSI/MSI-X [ 11.754423] mpt3sas 0000:81:00.0: irq 337 for MSI/MSI-X [ 11.754430] mpt3sas 0000:81:00.0: irq 338 for MSI/MSI-X [ 11.754437] mpt3sas 0000:81:00.0: irq 339 for MSI/MSI-X [ 11.754443] mpt3sas 0000:81:00.0: irq 340 for MSI/MSI-X [ 11.754450] mpt3sas 0000:81:00.0: irq 341 for MSI/MSI-X [ 11.754456] mpt3sas 0000:81:00.0: irq 342 for MSI/MSI-X [ 11.754462] mpt3sas 0000:81:00.0: irq 343 for MSI/MSI-X [ 11.754469] mpt3sas 0000:81:00.0: irq 344 for MSI/MSI-X [ 11.754475] mpt3sas 0000:81:00.0: irq 345 for MSI/MSI-X [ 11.754482] mpt3sas 0000:81:00.0: irq 346 for MSI/MSI-X [ 11.754488] mpt3sas 0000:81:00.0: irq 347 for MSI/MSI-X [ 11.754495] mpt3sas 0000:81:00.0: irq 348 for MSI/MSI-X [ 11.754505] mpt3sas 0000:81:00.0: irq 349 for MSI/MSI-X [ 11.754516] mpt3sas 0000:81:00.0: irq 350 for MSI/MSI-X [ 11.754523] mpt3sas 0000:81:00.0: irq 351 for MSI/MSI-X [ 11.754530] mpt3sas 0000:81:00.0: irq 352 for MSI/MSI-X [ 11.754536] mpt3sas 0000:81:00.0: irq 353 for MSI/MSI-X [ 11.754543] mpt3sas 0000:81:00.0: irq 354 for MSI/MSI-X [ 11.754549] mpt3sas 0000:81:00.0: irq 355 for MSI/MSI-X [ 11.754556] mpt3sas 0000:81:00.0: irq 356 for MSI/MSI-X [ 11.754563] mpt3sas 0000:81:00.0: irq 357 for MSI/MSI-X [ 11.754569] mpt3sas 0000:81:00.0: irq 358 for MSI/MSI-X [ 11.754576] mpt3sas 0000:81:00.0: irq 359 for MSI/MSI-X [ 11.754582] mpt3sas 0000:81:00.0: irq 360 for MSI/MSI-X [ 11.754589] mpt3sas 0000:81:00.0: irq 361 for MSI/MSI-X [ 11.754595] mpt3sas 0000:81:00.0: irq 362 for MSI/MSI-X [ 11.754602] mpt3sas 0000:81:00.0: irq 363 for MSI/MSI-X [ 11.754608] mpt3sas 0000:81:00.0: irq 364 for MSI/MSI-X [ 11.754615] mpt3sas 0000:81:00.0: irq 365 for MSI/MSI-X [ 11.754625] mpt3sas 0000:81:00.0: irq 366 for MSI/MSI-X [ 11.754632] mpt3sas 0000:81:00.0: irq 367 for MSI/MSI-X [ 11.754638] mpt3sas 0000:81:00.0: irq 368 for MSI/MSI-X [ 11.754644] mpt3sas 0000:81:00.0: irq 369 for MSI/MSI-X [ 11.754651] mpt3sas 0000:81:00.0: irq 370 for MSI/MSI-X [ 11.754658] mpt3sas 0000:81:00.0: irq 371 for MSI/MSI-X [ 11.754664] mpt3sas 0000:81:00.0: irq 372 for MSI/MSI-X [ 11.754671] mpt3sas 0000:81:00.0: irq 373 for MSI/MSI-X [ 11.754677] mpt3sas 0000:81:00.0: irq 374 for MSI/MSI-X [ 11.754684] mpt3sas 0000:81:00.0: irq 375 for MSI/MSI-X [ 11.754690] mpt3sas 0000:81:00.0: irq 376 for MSI/MSI-X [ 11.754696] mpt3sas 0000:81:00.0: irq 377 for MSI/MSI-X [ 11.754703] mpt3sas 0000:81:00.0: irq 378 for MSI/MSI-X [ 11.754709] mpt3sas 0000:81:00.0: irq 379 for MSI/MSI-X [ 11.754716] mpt3sas 0000:81:00.0: irq 380 for MSI/MSI-X [ 11.754722] mpt3sas 0000:81:00.0: irq 381 for MSI/MSI-X [ 11.754732] mpt3sas 0000:81:00.0: irq 382 for MSI/MSI-X [ 11.754738] mpt3sas 0000:81:00.0: irq 383 for MSI/MSI-X [ 11.754749] mpt3sas 0000:81:00.0: irq 384 for MSI/MSI-X [ 11.754759] mpt3sas 0000:81:00.0: irq 385 for MSI/MSI-X [ 11.754769] mpt3sas 0000:81:00.0: irq 386 for MSI/MSI-X [ 11.754779] mpt3sas 0000:81:00.0: irq 387 for MSI/MSI-X [ 11.754788] mpt3sas 0000:81:00.0: irq 388 for MSI/MSI-X [ 11.754798] mpt3sas 0000:81:00.0: irq 389 for MSI/MSI-X [ 11.754808] mpt3sas 0000:81:00.0: irq 390 for MSI/MSI-X [ 11.754818] mpt3sas 0000:81:00.0: irq 391 for MSI/MSI-X [ 11.755592] mpt3sas1-msix0: PCI-MSI-X enabled: IRQ 320 [ 11.755593] mpt3sas1-msix1: PCI-MSI-X enabled: IRQ 321 [ 11.755593] mpt3sas1-msix2: PCI-MSI-X enabled: IRQ 322 [ 11.755593] mpt3sas1-msix3: PCI-MSI-X enabled: IRQ 323 [ 11.755593] mpt3sas1-msix4: PCI-MSI-X enabled: IRQ 324 [ 11.755594] mpt3sas1-msix5: PCI-MSI-X enabled: IRQ 325 [ 11.755594] mpt3sas1-msix6: PCI-MSI-X enabled: IRQ 326 [ 11.755594] mpt3sas1-msix7: PCI-MSI-X enabled: IRQ 327 [ 11.755594] mpt3sas1-msix8: PCI-MSI-X enabled: IRQ 328 [ 11.755594] mpt3sas1-msix9: PCI-MSI-X enabled: IRQ 329 [ 11.755595] mpt3sas1-msix10: PCI-MSI-X enabled: IRQ 330 [ 11.755595] mpt3sas1-msix11: PCI-MSI-X enabled: IRQ 331 [ 11.755595] mpt3sas1-msix12: PCI-MSI-X enabled: IRQ 332 [ 11.755595] mpt3sas1-msix13: PCI-MSI-X enabled: IRQ 333 [ 11.755595] mpt3sas1-msix14: PCI-MSI-X enabled: IRQ 334 [ 11.755596] mpt3sas1-msix15: PCI-MSI-X enabled: IRQ 335 [ 11.755596] mpt3sas1-msix16: PCI-MSI-X enabled: IRQ 336 [ 11.755596] mpt3sas1-msix17: PCI-MSI-X enabled: IRQ 337 [ 11.755596] mpt3sas1-msix18: PCI-MSI-X enabled: IRQ 338 [ 11.755596] mpt3sas1-msix19: PCI-MSI-X enabled: IRQ 339 [ 11.755597] mpt3sas1-msix20: PCI-MSI-X enabled: IRQ 340 [ 11.755597] mpt3sas1-msix21: PCI-MSI-X enabled: IRQ 341 [ 11.755597] mpt3sas1-msix22: PCI-MSI-X enabled: IRQ 342 [ 11.755597] mpt3sas1-msix23: PCI-MSI-X enabled: IRQ 343 [ 11.755597] mpt3sas1-msix24: PCI-MSI-X enabled: IRQ 344 [ 11.755598] mpt3sas1-msix25: PCI-MSI-X enabled: IRQ 345 [ 11.755598] mpt3sas1-msix26: PCI-MSI-X enabled: IRQ 346 [ 11.755598] mpt3sas1-msix27: PCI-MSI-X enabled: IRQ 347 [ 11.755598] mpt3sas1-msix28: PCI-MSI-X enabled: IRQ 348 [ 11.755598] mpt3sas1-msix29: PCI-MSI-X enabled: IRQ 349 [ 11.755599] mpt3sas1-msix30: PCI-MSI-X enabled: IRQ 350 [ 11.755599] mpt3sas1-msix31: PCI-MSI-X enabled: IRQ 351 [ 11.755599] mpt3sas1-msix32: PCI-MSI-X enabled: IRQ 352 [ 11.755599] mpt3sas1-msix33: PCI-MSI-X enabled: IRQ 353 [ 11.755599] mpt3sas1-msix34: PCI-MSI-X enabled: IRQ 354 [ 11.755600] mpt3sas1-msix35: PCI-MSI-X enabled: IRQ 355 [ 11.755600] mpt3sas1-msix36: PCI-MSI-X enabled: IRQ 356 [ 11.755600] mpt3sas1-msix37: PCI-MSI-X enabled: IRQ 357 [ 11.755600] mpt3sas1-msix38: PCI-MSI-X enabled: IRQ 358 [ 11.755600] mpt3sas1-msix39: PCI-MSI-X enabled: IRQ 359 [ 11.755601] mpt3sas1-msix40: PCI-MSI-X enabled: IRQ 360 [ 11.755601] mpt3sas1-msix41: PCI-MSI-X enabled: IRQ 361 [ 11.755601] mpt3sas1-msix42: PCI-MSI-X enabled: IRQ 362 [ 11.755601] mpt3sas1-msix43: PCI-MSI-X enabled: IRQ 363 [ 11.755601] mpt3sas1-msix44: PCI-MSI-X enabled: IRQ 364 [ 11.755602] mpt3sas1-msix45: PCI-MSI-X enabled: IRQ 365 [ 11.755602] mpt3sas1-msix46: PCI-MSI-X enabled: IRQ 366 [ 11.755602] mpt3sas1-msix47: PCI-MSI-X enabled: IRQ 367 [ 11.755602] mpt3sas1-msix48: PCI-MSI-X enabled: IRQ 368 [ 11.755602] mpt3sas1-msix49: PCI-MSI-X enabled: IRQ 369 [ 11.755603] mpt3sas1-msix50: PCI-MSI-X enabled: IRQ 370 [ 11.755603] mpt3sas1-msix51: PCI-MSI-X enabled: IRQ 371 [ 11.755603] mpt3sas1-msix52: PCI-MSI-X enabled: IRQ 372 [ 11.755603] mpt3sas1-msix53: PCI-MSI-X enabled: IRQ 373 [ 11.755603] mpt3sas1-msix54: PCI-MSI-X enabled: IRQ 374 [ 11.755604] mpt3sas1-msix55: PCI-MSI-X enabled: IRQ 375 [ 11.755604] mpt3sas1-msix56: PCI-MSI-X enabled: IRQ 376 [ 11.755604] mpt3sas1-msix57: PCI-MSI-X enabled: IRQ 377 [ 11.755604] mpt3sas1-msix58: PCI-MSI-X enabled: IRQ 378 [ 11.755604] mpt3sas1-msix59: PCI-MSI-X enabled: IRQ 379 [ 11.755605] mpt3sas1-msix60: PCI-MSI-X enabled: IRQ 380 [ 11.755605] mpt3sas1-msix61: PCI-MSI-X enabled: IRQ 381 [ 11.755605] mpt3sas1-msix62: PCI-MSI-X enabled: IRQ 382 [ 11.755605] mpt3sas1-msix63: PCI-MSI-X enabled: IRQ 383 [ 11.755605] mpt3sas1-msix64: PCI-MSI-X enabled: IRQ 384 [ 11.755606] mpt3sas1-msix65: PCI-MSI-X enabled: IRQ 385 [ 11.755606] mpt3sas1-msix66: PCI-MSI-X enabled: IRQ 386 [ 11.755606] mpt3sas1-msix67: PCI-MSI-X enabled: IRQ 387 [ 11.755606] mpt3sas1-msix68: PCI-MSI-X enabled: IRQ 388 [ 11.755606] mpt3sas1-msix69: PCI-MSI-X enabled: IRQ 389 [ 11.755606] mpt3sas1-msix70: PCI-MSI-X enabled: IRQ 390 [ 11.755607] mpt3sas1-msix71: PCI-MSI-X enabled: IRQ 391 [ 11.755608] mpt3sas_cm1: iomem(0x0000000090000000), mapped(0xffffad4072e00000), size(1048576) [ 11.755608] mpt3sas_cm1: ioport(0x0000000000005000), size(256) [ 11.831223] mpt3sas_cm1: IOC Number : 0 [ 11.831226] mpt3sas_cm1: sending message unit reset !! [ 11.833227] mpt3sas_cm1: message unit reset: SUCCESS [ 11.867219] mpt3sas_cm1: scatter gather: sge_in_main_msg(0), sge_per_chain(7), sge_per_io(128), chains_per_io(19) [ 11.867285] mpt3sas_cm1: request pool(0xffff9e43b7200000) - dma(0x7f77200000): depth(4360), frame_size(128), pool_size(545 kB) [ 11.882024] mpt3sas_cm1: sense pool(0xffff9e43b5f00000) - dma(0x7f75f00000): depth(4339), element_size(96), pool_size (406 kB) [ 11.882071] mpt3sas_cm1: reply pool(0xffff9e43b5800000) - dma(0x7f75800000): depth(4424)frame_size(128), pool_size(553 kB) [ 11.882610] mpt3sas_cm1: config page(0xffff9e43b5ebc000) - dma(0x7f75ebc000): size(512) [ 11.882610] mpt3sas_cm1: Allocated physical memory: size(19978 kB) [ 11.882611] mpt3sas_cm1: Current Controller Queue Depth(4336), Max Controller Queue Depth(4352) [ 12.216922] mpt3sas_cm1: FW Package Version(28.00.00.00) [ 12.217559] mpt3sas_cm1: SAS3816: FWVersion(28.00.00.00), ChipRevision(0x00) [ 12.217563] mpt3sas_cm1: Protocol=(Initiator,Target,NVMe), Capabilities=(TLR,EEDP,Diag Trace Buffer,Task Set Full,NCQ) [ 12.217682] mpt3sas 0000:81:00.0: Enabled Extended Tags as Controller Supports [ 12.217741] mpt3sas_cm1: Enable interrupt coalescing only for first 8 reply queues [ 12.217821] mpt3sas_cm1: performance mode: balanced [ 12.217905] mpt3sas_cm1: : host protection capabilities enabled DIF1 DIF2 DIF3 [ 12.217910] scsi host10: Fusion MPT SAS Host [ 12.218062] mpt3sas_cm1: registering trace buffer support [ 12.221927] mpt3sas_cm1: Trace buffer memory 2048 KB allocated [ 12.221930] mpt3sas_cm1: sending port enable !! [ 12.222350] mpt3sas_cm1: hba_port entry: ffff9e43baa83e00, port: 0 is added to hba_port list [ 12.222816] mpt3sas_cm1: hba_port entry: ffff9e43ba319780, port: 1 is added to hba_port list [ 12.223200] mpt3sas_cm1: hba_port entry: ffff9e43ba319640, port: 8 is added to hba_port list [ 12.223569] mpt3sas_cm1: hba_port entry: ffff9e43ba319500, port: 9 is added to hba_port list [ 12.224267] mpt3sas_cm1: host_add: handle(0x0001), sas_addr(0x500062b2198ac400), phys(21) [ 12.225853] mpt3sas_cm1: expander_add: handle(0x002f), parent(0x0001), sas_addr(0x500c0ff00c17553f), phys(37) [ 12.225995] expander-10:0: mpt3sas_transport_port_add: added: handle(0x002f), sas_addr(0x500c0ff00c17553f) [ 12.230495] mpt3sas_cm1: handle(0x30) sas_address(0x5000c500ec95a6e1) port_type(0x1) [ 12.230566] mpt3sas_cm1: handle(0x31) sas_address(0x5000c500ec95a6f1) port_type(0x1) [ 12.230634] mpt3sas_cm1: handle(0x32) sas_address(0x5000c500ec955e6d) port_type(0x1) [ 12.230700] mpt3sas_cm1: handle(0x33) sas_address(0x5000c500ec955edd) port_type(0x1) [ 12.230769] mpt3sas_cm1: handle(0x34) sas_address(0x5000c500ec955ed5) port_type(0x1) [ 12.230838] mpt3sas_cm1: handle(0x35) sas_address(0x5000c500ec955fa1) port_type(0x1) [ 12.230907] mpt3sas_cm1: handle(0x36) sas_address(0x5000c500ec955f65) port_type(0x1) [ 12.230974] mpt3sas_cm1: handle(0x37) sas_address(0x5000c500ec955dfd) port_type(0x1) [ 12.231042] mpt3sas_cm1: handle(0x38) sas_address(0x5000c500ec955d91) port_type(0x1) [ 12.231111] mpt3sas_cm1: handle(0x39) sas_address(0x5000c500ec955e7d) port_type(0x1) [ 12.231178] mpt3sas_cm1: handle(0x3a) sas_address(0x5000c500ec95a6d9) port_type(0x1) [ 12.231255] mpt3sas_cm1: handle(0x3b) sas_address(0x5000c500ec95a6d5) port_type(0x1) [ 12.231330] mpt3sas_cm1: handle(0x3c) sas_address(0x5000c500ec95a6cd) port_type(0x1) [ 12.231398] mpt3sas_cm1: handle(0x3d) sas_address(0x5000c500ec95a729) port_type(0x1) [ 12.231465] mpt3sas_cm1: handle(0x3e) sas_address(0x5000c500ec95a66d) port_type(0x1) [ 12.231534] mpt3sas_cm1: handle(0x3f) sas_address(0x5000c500ec95a6a5) port_type(0x1) [ 12.231603] mpt3sas_cm1: handle(0x40) sas_address(0x5000c500ec95a56d) port_type(0x1) [ 12.231669] mpt3sas_cm1: handle(0x41) sas_address(0x5000c500ec95a715) port_type(0x1) [ 12.231736] mpt3sas_cm1: handle(0x42) sas_address(0x5000c500ec95a701) port_type(0x1) [ 12.231803] mpt3sas_cm1: handle(0x43) sas_address(0x5000c500ec95a6c9) port_type(0x1) [ 12.231873] mpt3sas_cm1: handle(0x44) sas_address(0x5000c500ec955d35) port_type(0x1) [ 12.231939] mpt3sas_cm1: handle(0x45) sas_address(0x5000c500ec955f95) port_type(0x1) [ 12.232406] mpt3sas_cm1: handle(0x46) sas_address(0x5000c500ec955d81) port_type(0x1) [ 12.232475] mpt3sas_cm1: handle(0x47) sas_address(0x5000c500ec955f79) port_type(0x1) [ 12.232908] mpt3sas_cm1: handle(0x49) sas_address(0x500c0ff00c17553e) port_type(0x1) [ 12.233377] mpt3sas_cm1: expander_add: handle(0x0065), parent(0x0002), sas_addr(0x500c0ff00c17023f), phys(37) [ 12.233491] expander-10:1: mpt3sas_transport_port_add: added: handle(0x0065), sas_addr(0x500c0ff00c17023f) [ 12.237102] mpt3sas_cm1: handle(0x66) sas_address(0x5000c500ec95a695) port_type(0x1) [ 12.237173] mpt3sas_cm1: handle(0x67) sas_address(0x5000c500ec955f75) port_type(0x1) [ 12.237239] mpt3sas_cm1: handle(0x68) sas_address(0x5000c500ec9567d1) port_type(0x1) [ 12.237307] mpt3sas_cm1: handle(0x69) sas_address(0x5000c500ec915845) port_type(0x1) [ 12.237373] mpt3sas_cm1: handle(0x6a) sas_address(0x5000c500ec95684d) port_type(0x1) [ 12.237444] mpt3sas_cm1: handle(0x6b) sas_address(0x5000c500ec9567c9) port_type(0x1) [ 12.237510] mpt3sas_cm1: handle(0x6c) sas_address(0x5000c500ec9567cd) port_type(0x1) [ 12.237579] mpt3sas_cm1: handle(0x6d) sas_address(0x5000c500ec9567c5) port_type(0x1) [ 12.237647] mpt3sas_cm1: handle(0x6e) sas_address(0x5000c500ec923261) port_type(0x1) [ 12.237715] mpt3sas_cm1: handle(0x6f) sas_address(0x5000c500ec9156b1) port_type(0x1) [ 12.237782] mpt3sas_cm1: handle(0x70) sas_address(0x5000c500ec952ae1) port_type(0x1) [ 12.237853] mpt3sas_cm1: handle(0x71) sas_address(0x5000c500ec95682d) port_type(0x1) [ 12.237920] mpt3sas_cm1: handle(0x72) sas_address(0x5000c500ec95a575) port_type(0x1) [ 12.237988] mpt3sas_cm1: handle(0x73) sas_address(0x5000c500ec95a641) port_type(0x1) [ 12.238054] mpt3sas_cm1: handle(0x74) sas_address(0x5000c500ec95a6f5) port_type(0x1) [ 12.238125] mpt3sas_cm1: handle(0x75) sas_address(0x5000c500ec95a649) port_type(0x1) [ 12.238195] mpt3sas_cm1: handle(0x76) sas_address(0x5000c500ec955f4d) port_type(0x1) [ 12.238265] mpt3sas_cm1: handle(0x77) sas_address(0x5000c500ec955ed9) port_type(0x1) [ 12.238337] mpt3sas_cm1: handle(0x78) sas_address(0x5000c500ec955f71) port_type(0x1) [ 12.238411] mpt3sas_cm1: handle(0x79) sas_address(0x5000c500ec955d85) port_type(0x1) [ 12.238475] mpt3sas_cm1: handle(0x7a) sas_address(0x5000c500ec955ee1) port_type(0x1) [ 12.238552] mpt3sas_cm1: handle(0x7b) sas_address(0x5000c500ec955f49) port_type(0x1) [ 12.239020] mpt3sas_cm1: handle(0x7c) sas_address(0x5000c500ec955ec1) port_type(0x1) [ 12.239089] mpt3sas_cm1: handle(0x7d) sas_address(0x5000c500ec95a691) port_type(0x1) [ 12.239526] mpt3sas_cm1: handle(0x7f) sas_address(0x500c0ff00c17023e) port_type(0x1) [ 12.239971] mpt3sas_cm1: expander_add: handle(0x004a), parent(0x0009), sas_addr(0x500c0ff00c17833f), phys(37) [ 12.240082] expander-10:2: mpt3sas_transport_port_add: added: handle(0x004a), sas_addr(0x500c0ff00c17833f) [ 12.244802] mpt3sas_cm1: handle(0x4b) sas_address(0x5000c500ec91557d) port_type(0x1) [ 12.244876] mpt3sas_cm1: handle(0x4c) sas_address(0x5000c500ec91bd65) port_type(0x1) [ 12.244944] mpt3sas_cm1: handle(0x4d) sas_address(0x5000c500ec91bd59) port_type(0x1) [ 12.245015] mpt3sas_cm1: handle(0x4e) sas_address(0x5000c500ec919e95) port_type(0x1) [ 12.245086] mpt3sas_cm1: handle(0x4f) sas_address(0x5000c500ec922ba1) port_type(0x1) [ 12.245154] mpt3sas_cm1: handle(0x50) sas_address(0x5000c500ec922b6d) port_type(0x1) [ 12.245228] mpt3sas_cm1: handle(0x51) sas_address(0x5000c500ec922bf5) port_type(0x1) [ 12.245301] mpt3sas_cm1: handle(0x52) sas_address(0x5000c500ec922b4d) port_type(0x1) [ 12.245369] mpt3sas_cm1: handle(0x53) sas_address(0x5000c500ec922bf1) port_type(0x1) [ 12.245436] mpt3sas_cm1: handle(0x54) sas_address(0x5000c500ec922bb9) port_type(0x1) [ 12.245505] mpt3sas_cm1: handle(0x55) sas_address(0x5000c500ec922c01) port_type(0x1) [ 12.245574] mpt3sas_cm1: handle(0x56) sas_address(0x5000c500ec922be5) port_type(0x1) [ 12.245644] mpt3sas_cm1: handle(0x57) sas_address(0x5000c500ec922bc1) port_type(0x1) [ 12.245713] mpt3sas_cm1: handle(0x58) sas_address(0x5000c500ec922bcd) port_type(0x1) [ 12.245783] mpt3sas_cm1: handle(0x59) sas_address(0x5000c500ec922bed) port_type(0x1) [ 12.245852] mpt3sas_cm1: handle(0x5a) sas_address(0x5000c500ec922b91) port_type(0x1) [ 12.245919] mpt3sas_cm1: handle(0x5b) sas_address(0x5000c500ec922b45) port_type(0x1) [ 12.245989] mpt3sas_cm1: handle(0x5c) sas_address(0x5000c500ec922b49) port_type(0x1) [ 12.246058] mpt3sas_cm1: handle(0x5d) sas_address(0x5000c500ec91bdd5) port_type(0x1) [ 12.246126] mpt3sas_cm1: handle(0x5e) sas_address(0x5000c500ec91bd51) port_type(0x1) [ 12.246195] mpt3sas_cm1: handle(0x5f) sas_address(0x5000c500ec91bd25) port_type(0x1) [ 12.246265] mpt3sas_cm1: handle(0x60) sas_address(0x5000c500ec91bd69) port_type(0x1) [ 12.246716] mpt3sas_cm1: handle(0x61) sas_address(0x5000c500ec919ea9) port_type(0x1) [ 12.246785] mpt3sas_cm1: handle(0x62) sas_address(0x5000c500ec91bd95) port_type(0x1) [ 12.247221] mpt3sas_cm1: handle(0x64) sas_address(0x500c0ff00c17833e) port_type(0x1) [ 12.247690] mpt3sas_cm1: expander_add: handle(0x0080), parent(0x000a), sas_addr(0x500c0ff00c170c3f), phys(37) [ 12.247822] expander-10:3: mpt3sas_transport_port_add: added: handle(0x0080), sas_addr(0x500c0ff00c170c3f) [ 12.251569] mpt3sas_cm1: handle(0x81) sas_address(0x5000c500ec922bb1) port_type(0x1) [ 12.251635] mpt3sas_cm1: handle(0x82) sas_address(0x5000c500ec922b89) port_type(0x1) [ 12.251707] mpt3sas_cm1: handle(0x83) sas_address(0x5000c500ec922b99) port_type(0x1) [ 12.251776] mpt3sas_cm1: handle(0x84) sas_address(0x5000c500ec922b75) port_type(0x1) [ 12.251846] mpt3sas_cm1: handle(0x85) sas_address(0x5000c500ec922bfd) port_type(0x1) [ 12.251913] mpt3sas_cm1: handle(0x86) sas_address(0x5000c500ec922b51) port_type(0x1) [ 12.251982] mpt3sas_cm1: handle(0x87) sas_address(0x5000c500ec91bddd) port_type(0x1) [ 12.252051] mpt3sas_cm1: handle(0x88) sas_address(0x5000c500ec922b65) port_type(0x1) [ 12.252122] mpt3sas_cm1: handle(0x89) sas_address(0x5000c500ec91982d) port_type(0x1) [ 12.252191] mpt3sas_cm1: handle(0x8a) sas_address(0x5000c500ec919e99) port_type(0x1) [ 12.252262] mpt3sas_cm1: handle(0x8b) sas_address(0x5000c500ec91bd45) port_type(0x1) [ 12.252329] mpt3sas_cm1: handle(0x8c) sas_address(0x5000c500ec919eb1) port_type(0x1) [ 12.252398] mpt3sas_cm1: handle(0x8d) sas_address(0x5000c500ec91bdb5) port_type(0x1) [ 12.252467] mpt3sas_cm1: handle(0x8e) sas_address(0x5000c500ec91bdf1) port_type(0x1) [ 12.252538] mpt3sas_cm1: handle(0x8f) sas_address(0x5000c500ec8deb3d) port_type(0x1) [ 12.252604] mpt3sas_cm1: handle(0x90) sas_address(0x5000c500ec955d55) port_type(0x1) [ 12.252674] mpt3sas_cm1: handle(0x91) sas_address(0x5000c500ec955f91) port_type(0x1) [ 12.252741] mpt3sas_cm1: handle(0x92) sas_address(0x5000c500ec955fa5) port_type(0x1) [ 12.252812] mpt3sas_cm1: handle(0x93) sas_address(0x5000c500ec955e05) port_type(0x1) [ 12.252878] mpt3sas_cm1: handle(0x94) sas_address(0x5000c500ec955d89) port_type(0x1) [ 12.252950] mpt3sas_cm1: handle(0x95) sas_address(0x5000c500ec915865) port_type(0x1) [ 12.253019] mpt3sas_cm1: handle(0x96) sas_address(0x5000c500ec9191f5) port_type(0x1) [ 12.253476] mpt3sas_cm1: handle(0x97) sas_address(0x5000c500ec91583d) port_type(0x1) [ 12.253549] mpt3sas_cm1: handle(0x98) sas_address(0x5000c500ec955da1) port_type(0x1) [ 12.253990] mpt3sas_cm1: handle(0x9a) sas_address(0x500c0ff00c170c3e) port_type(0x1) [ 12.254199] mpt3sas_cm1: port enable: SUCCESS [ 12.258024] scsi 10:0:0:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 12.260348] scsi 10:0:0:0: SSP: handle(0x0030), sas_addr(0x5000c500ec95a6e1), phy(0), device_name(0x5000c500ec95a6e0) [ 12.260349] scsi 10:0:0:0: enclosure logical id(0x500c0ff0f6f3173c), slot(0) [ 12.260350] scsi 10:0:0:0: enclosure level(0x0000), connector name( C1 ) [ 12.260350] scsi 10:0:0:0: serial_number(HWL031X90000822150Z3) [ 12.260353] scsi 10:0:0:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 13.796478] end_device-1:0:0: mpt3sas_transport_port_add: added: handle(0x0030), sas_addr(0x5000c500ec922bb2) [ 13.802892] end_device-10:0:0: mpt3sas_transport_port_add: added: handle(0x0030), sas_addr(0x5000c500ec95a6e1) [ 13.806733] scsi 10:0:1:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 13.809059] scsi 10:0:1:0: SSP: handle(0x0031), sas_addr(0x5000c500ec95a6f1), phy(1), device_name(0x5000c500ec95a6f0) [ 13.809061] scsi 10:0:1:0: enclosure logical id(0x500c0ff0f6f3173c), slot(1) [ 13.809062] scsi 10:0:1:0: enclosure level(0x0000), connector name( C1 ) [ 13.809063] scsi 10:0:1:0: serial_number(HWL032060000822150Z3) [ 13.809066] scsi 10:0:1:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 13.835604] mpt3sas_cm0: detecting: handle(0x0031), sas_address(0x5000c500ec922b8a), phy(1) [ 13.835612] mpt3sas_cm0: REPORT_LUNS: handle(0x0031), retries(0) [ 13.836967] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0031), lun(0) [ 13.838007] mpt3sas_cm0: handle(0x31) sas_address(0x5000c500ec922b8a) port_type(0x1) [ 13.842640] scsi 1:0:1:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 13.844919] scsi 1:0:1:0: SSP: handle(0x0031), sas_addr(0x5000c500ec922b8a), phy(1), device_name(0x5000c500ec922b88) [ 13.844921] scsi 1:0:1:0: enclosure logical id(0x500c0ff0f6f4a33c), slot(1) [ 13.844922] scsi 1:0:1:0: enclosure level(0x0000), connector name( C1 ) [ 13.844923] scsi 1:0:1:0: serial_number(HWL031HD0000822150Z3) [ 13.844925] scsi 1:0:1:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 13.941642] sd 0:2:0:0: [sda] 936640512 512-byte logical blocks: (479 GB/446 GiB) [ 13.949490] sd 0:2:0:0: [sda] Write Protect is off [ 13.954281] sd 0:2:0:0: [sda] Mode Sense: 1f 00 10 08 [ 13.954363] sd 0:2:0:0: [sda] Write cache: disabled, read cache: disabled, supports DPO and FUA [ 13.963063] sd 0:2:0:0: [sda] Optimal transfer size 65536 bytes [ 13.964452] end_device-10:0:1: mpt3sas_transport_port_add: added: handle(0x0031), sas_addr(0x5000c500ec95a6f1) [ 13.968307] scsi 10:0:2:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 13.970630] scsi 10:0:2:0: SSP: handle(0x0032), sas_addr(0x5000c500ec955e6d), phy(2), device_name(0x5000c500ec955e6c) [ 13.970631] scsi 10:0:2:0: enclosure logical id(0x500c0ff0f6f3173c), slot(2) [ 13.970631] scsi 10:0:2:0: enclosure level(0x0000), connector name( C1 ) [ 13.970632] scsi 10:0:2:0: serial_number(HWL031GS0000822150Z3) [ 13.970633] scsi 10:0:2:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 14.027476] sda: sda1 sda2 sda3 [ 14.029454] end_device-1:0:1: mpt3sas_transport_port_add: added: handle(0x0031), sas_addr(0x5000c500ec922b8a) [ 14.029527] mpt3sas_cm0: detecting: handle(0x0032), sas_address(0x5000c500ec922b9a), phy(2) [ 14.029530] mpt3sas_cm0: REPORT_LUNS: handle(0x0032), retries(0) [ 14.030915] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0032), lun(0) [ 14.031957] mpt3sas_cm0: handle(0x32) sas_address(0x5000c500ec922b9a) port_type(0x1) [ 14.036557] scsi 1:0:2:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 14.038856] scsi 1:0:2:0: SSP: handle(0x0032), sas_addr(0x5000c500ec922b9a), phy(2), device_name(0x5000c500ec922b98) [ 14.038859] scsi 1:0:2:0: enclosure logical id(0x500c0ff0f6f4a33c), slot(2) [ 14.038861] scsi 1:0:2:0: enclosure level(0x0000), connector name( C1 ) [ 14.038862] scsi 1:0:2:0: serial_number(HWL031F40000822150Z3) [ 14.038864] scsi 1:0:2:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 14.116409] sd 0:2:0:0: [sda] Attached SCSI disk [ 14.129429] end_device-10:0:2: mpt3sas_transport_port_add: added: handle(0x0032), sas_addr(0x5000c500ec955e6d) [ 14.142429] end_device-1:0:2: mpt3sas_transport_port_add: added: handle(0x0032), sas_addr(0x5000c500ec922b9a) [ 14.143524] scsi 10:0:3:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 14.145856] scsi 10:0:3:0: SSP: handle(0x0033), sas_addr(0x5000c500ec955edd), phy(3), device_name(0x5000c500ec955edc) [ 14.145857] scsi 10:0:3:0: enclosure logical id(0x500c0ff0f6f3173c), slot(3) [ 14.145858] scsi 10:0:3:0: enclosure level(0x0000), connector name( C1 ) [ 14.145865] scsi 10:0:3:0: serial_number(HWL031K30000822150Z3) [ 14.145866] scsi 10:0:3:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 14.199985] mpt3sas_cm0: detecting: handle(0x0033), sas_address(0x5000c500ec922b76), phy(3) [ 14.208339] mpt3sas_cm0: REPORT_LUNS: handle(0x0033), retries(0) [ 14.215722] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0033), lun(0) [ 14.221803] mpt3sas_cm0: handle(0x33) sas_address(0x5000c500ec922b76) port_type(0x1) [ 14.232433] end_device-10:0:3: mpt3sas_transport_port_add: added: handle(0x0033), sas_addr(0x5000c500ec955edd) [ 14.233547] scsi 1:0:3:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 14.235857] scsi 1:0:3:0: SSP: handle(0x0033), sas_addr(0x5000c500ec922b76), phy(3), device_name(0x5000c500ec922b74) [ 14.235859] scsi 1:0:3:0: enclosure logical id(0x500c0ff0f6f4a33c), slot(3) [ 14.235860] scsi 1:0:3:0: enclosure level(0x0000), connector name( C1 ) [ 14.235861] scsi 1:0:3:0: serial_number(HWL030TD0000822150Z3) [ 14.235863] scsi 1:0:3:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 14.293351] scsi 10:0:4:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 14.302893] scsi 10:0:4:0: SSP: handle(0x0034), sas_addr(0x5000c500ec955ed5), phy(4), device_name(0x5000c500ec955ed4) [ 14.313490] scsi 10:0:4:0: enclosure logical id(0x500c0ff0f6f3173c), slot(4) [ 14.320622] scsi 10:0:4:0: enclosure level(0x0000), connector name( C1 ) [ 14.327412] scsi 10:0:4:0: serial_number(HWL030TP0000822150Z3) [ 14.333290] scsi 10:0:4:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 14.345450] end_device-1:0:3: mpt3sas_transport_port_add: added: handle(0x0033), sas_addr(0x5000c500ec922b76) [ 14.355525] mpt3sas_cm0: detecting: handle(0x0034), sas_address(0x5000c500ec922bfe), phy(4) [ 14.363874] mpt3sas_cm0: REPORT_LUNS: handle(0x0034), retries(0) [ 14.371230] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0034), lun(0) [ 14.377313] mpt3sas_cm0: handle(0x34) sas_address(0x5000c500ec922bfe) port_type(0x1) [ 14.387426] end_device-10:0:4: mpt3sas_transport_port_add: added: handle(0x0034), sas_addr(0x5000c500ec955ed5) [ 14.389111] scsi 1:0:4:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 14.391443] scsi 1:0:4:0: SSP: handle(0x0034), sas_addr(0x5000c500ec922bfe), phy(4), device_name(0x5000c500ec922bfc) [ 14.391444] scsi 1:0:4:0: enclosure logical id(0x500c0ff0f6f4a33c), slot(4) [ 14.391445] scsi 1:0:4:0: enclosure level(0x0000), connector name( C1 ) [ 14.391446] scsi 1:0:4:0: serial_number(HWL0314V0000822150Z3) [ 14.391447] scsi 1:0:4:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 14.448390] scsi 10:0:5:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 14.458206] scsi 10:0:5:0: SSP: handle(0x0035), sas_addr(0x5000c500ec955fa1), phy(5), device_name(0x5000c500ec955fa0) [ 14.468800] scsi 10:0:5:0: enclosure logical id(0x500c0ff0f6f3173c), slot(5) [ 14.475932] scsi 10:0:5:0: enclosure level(0x0000), connector name( C1 ) [ 14.482726] scsi 10:0:5:0: serial_number(HWL030XP0000822150Z3) [ 14.484411] end_device-1:0:4: mpt3sas_transport_port_add: added: handle(0x0034), sas_addr(0x5000c500ec922bfe) [ 14.484497] mpt3sas_cm0: detecting: handle(0x0035), sas_address(0x5000c500ec922b52), phy(5) [ 14.484501] mpt3sas_cm0: REPORT_LUNS: handle(0x0035), retries(0) [ 14.485877] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0035), lun(0) [ 14.486932] mpt3sas_cm0: handle(0x35) sas_address(0x5000c500ec922b52) port_type(0x1) [ 14.491536] scsi 1:0:5:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 14.493854] scsi 1:0:5:0: SSP: handle(0x0035), sas_addr(0x5000c500ec922b52), phy(5), device_name(0x5000c500ec922b50) [ 14.493855] scsi 1:0:5:0: enclosure logical id(0x500c0ff0f6f4a33c), slot(5) [ 14.493856] scsi 1:0:5:0: enclosure level(0x0000), connector name( C1 ) [ 14.493857] scsi 1:0:5:0: serial_number(HWL0312B0000822150Z3) [ 14.493858] scsi 1:0:5:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 14.573603] scsi 10:0:5:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 14.597409] end_device-1:0:5: mpt3sas_transport_port_add: added: handle(0x0035), sas_addr(0x5000c500ec922b52) [ 14.607494] mpt3sas_cm0: detecting: handle(0x0036), sas_address(0x5000c500ec91bdde), phy(6) [ 14.610415] end_device-10:0:5: mpt3sas_transport_port_add: added: handle(0x0035), sas_addr(0x5000c500ec955fa1) [ 14.614377] scsi 10:0:6:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 14.616691] scsi 10:0:6:0: SSP: handle(0x0036), sas_addr(0x5000c500ec955f65), phy(6), device_name(0x5000c500ec955f64) [ 14.616693] scsi 10:0:6:0: enclosure logical id(0x500c0ff0f6f3173c), slot(6) [ 14.616694] scsi 10:0:6:0: enclosure level(0x0000), connector name( C1 ) [ 14.616695] scsi 10:0:6:0: serial_number(HWL031J90000822150Z3) [ 14.616698] scsi 10:0:6:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 14.673412] mpt3sas_cm0: REPORT_LUNS: handle(0x0036), retries(0) [ 14.680771] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0036), lun(0) [ 14.686859] mpt3sas_cm0: handle(0x36) sas_address(0x5000c500ec91bdde) port_type(0x1) [ 14.698406] end_device-10:0:6: mpt3sas_transport_port_add: added: handle(0x0036), sas_addr(0x5000c500ec955f65) [ 14.698674] scsi 1:0:6:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 14.700976] scsi 1:0:6:0: SSP: handle(0x0036), sas_addr(0x5000c500ec91bdde), phy(6), device_name(0x5000c500ec91bddc) [ 14.700977] scsi 1:0:6:0: enclosure logical id(0x500c0ff0f6f4a33c), slot(6) [ 14.700979] scsi 1:0:6:0: enclosure level(0x0000), connector name( C1 ) [ 14.700980] scsi 1:0:6:0: serial_number(HWL031EB0000822150Z3) [ 14.700982] scsi 1:0:6:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 14.759331] scsi 10:0:7:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 14.768842] scsi 10:0:7:0: SSP: handle(0x0037), sas_addr(0x5000c500ec955dfd), phy(7), device_name(0x5000c500ec955dfc) [ 14.779437] scsi 10:0:7:0: enclosure logical id(0x500c0ff0f6f3173c), slot(7) [ 14.786570] scsi 10:0:7:0: enclosure level(0x0000), connector name( C1 ) [ 14.793359] scsi 10:0:7:0: serial_number(HWL0316J0000822150Z3) [ 14.799190] scsi 10:0:7:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 14.811418] end_device-1:0:6: mpt3sas_transport_port_add: added: handle(0x0036), sas_addr(0x5000c500ec91bdde) [ 14.821493] mpt3sas_cm0: detecting: handle(0x0037), sas_address(0x5000c500ec922b66), phy(7) [ 14.829840] mpt3sas_cm0: REPORT_LUNS: handle(0x0037), retries(0) [ 14.837195] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0037), lun(0) [ 14.843290] mpt3sas_cm0: handle(0x37) sas_address(0x5000c500ec922b66) port_type(0x1) [ 14.854959] scsi 1:0:7:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 14.857402] end_device-10:0:7: mpt3sas_transport_port_add: added: handle(0x0037), sas_addr(0x5000c500ec955dfd) [ 14.861267] scsi 10:0:8:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 14.863580] scsi 10:0:8:0: SSP: handle(0x0038), sas_addr(0x5000c500ec955d91), phy(8), device_name(0x5000c500ec955d90) [ 14.863581] scsi 10:0:8:0: enclosure logical id(0x500c0ff0f6f3173c), slot(8) [ 14.863583] scsi 10:0:8:0: enclosure level(0x0000), connector name( C1 ) [ 14.863584] scsi 10:0:8:0: serial_number(HWL0313J0000822150Z3) [ 14.863585] scsi 10:0:8:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 14.921913] scsi 1:0:7:0: SSP: handle(0x0037), sas_addr(0x5000c500ec922b66), phy(7), device_name(0x5000c500ec922b64) [ 14.932424] scsi 1:0:7:0: enclosure logical id(0x500c0ff0f6f4a33c), slot(7) [ 14.939470] scsi 1:0:7:0: enclosure level(0x0000), connector name( C1 ) [ 14.946174] scsi 1:0:7:0: serial_number(HWL031GC0000822150Z3) [ 14.951917] scsi 1:0:7:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 14.969377] end_device-10:0:8: mpt3sas_transport_port_add: added: handle(0x0038), sas_addr(0x5000c500ec955d91) [ 14.983304] scsi 10:0:9:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 14.992864] scsi 10:0:9:0: SSP: handle(0x0039), sas_addr(0x5000c500ec955e7d), phy(9), device_name(0x5000c500ec955e7c) [ 15.003464] scsi 10:0:9:0: enclosure logical id(0x500c0ff0f6f3173c), slot(9) [ 15.010595] scsi 10:0:9:0: enclosure level(0x0000), connector name( C1 ) [ 15.017385] scsi 10:0:9:0: serial_number(HWL031L90000822150Z3) [ 15.023216] scsi 10:0:9:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 15.035400] end_device-1:0:7: mpt3sas_transport_port_add: added: handle(0x0037), sas_addr(0x5000c500ec922b66) [ 15.045490] mpt3sas_cm0: detecting: handle(0x0038), sas_address(0x5000c500ec91982e), phy(8) [ 15.053855] mpt3sas_cm0: REPORT_LUNS: handle(0x0038), retries(0) [ 15.061214] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0038), lun(0) [ 15.067313] mpt3sas_cm0: handle(0x38) sas_address(0x5000c500ec91982e) port_type(0x1) [ 15.079226] scsi 1:0:8:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 15.081368] end_device-10:0:9: mpt3sas_transport_port_add: added: handle(0x0039), sas_addr(0x5000c500ec955e7d) [ 15.085236] scsi 10:0:10:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 15.087545] scsi 10:0:10:0: SSP: handle(0x003a), sas_addr(0x5000c500ec95a6d9), phy(10), device_name(0x5000c500ec95a6d8) [ 15.087546] scsi 10:0:10:0: enclosure logical id(0x500c0ff0f6f3173c), slot(10) [ 15.087548] scsi 10:0:10:0: enclosure level(0x0000), connector name( C1 ) [ 15.087549] scsi 10:0:10:0: serial_number(HWL031YT0000822150Z3) [ 15.087550] scsi 10:0:10:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 15.146907] scsi 1:0:8:0: SSP: handle(0x0038), sas_addr(0x5000c500ec91982e), phy(8), device_name(0x5000c500ec91982c) [ 15.157421] scsi 1:0:8:0: enclosure logical id(0x500c0ff0f6f4a33c), slot(8) [ 15.164466] scsi 1:0:8:0: enclosure level(0x0000), connector name( C1 ) [ 15.171176] scsi 1:0:8:0: serial_number(HWL030W10000822150Z3) [ 15.176922] scsi 1:0:8:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 15.197404] end_device-10:0:10: mpt3sas_transport_port_add: added: handle(0x003a), sas_addr(0x5000c500ec95a6d9) [ 15.211505] scsi 10:0:11:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 15.221118] scsi 10:0:11:0: SSP: handle(0x003b), sas_addr(0x5000c500ec95a6d5), phy(11), device_name(0x5000c500ec95a6d4) [ 15.222363] end_device-1:0:8: mpt3sas_transport_port_add: added: handle(0x0038), sas_addr(0x5000c500ec91982e) [ 15.222453] mpt3sas_cm0: detecting: handle(0x0039), sas_address(0x5000c500ec919e9a), phy(9) [ 15.222457] mpt3sas_cm0: REPORT_LUNS: handle(0x0039), retries(0) [ 15.223810] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0039), lun(0) [ 15.224848] mpt3sas_cm0: handle(0x39) sas_address(0x5000c500ec919e9a) port_type(0x1) [ 15.229453] scsi 1:0:9:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 15.231762] scsi 1:0:9:0: SSP: handle(0x0039), sas_addr(0x5000c500ec919e9a), phy(9), device_name(0x5000c500ec919e98) [ 15.231764] scsi 1:0:9:0: enclosure logical id(0x500c0ff0f6f4a33c), slot(9) [ 15.231765] scsi 1:0:9:0: enclosure level(0x0000), connector name( C1 ) [ 15.231767] scsi 1:0:9:0: serial_number(HWL0314W0000822150Z3) [ 15.231769] scsi 1:0:9:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 15.316882] scsi 10:0:11:0: enclosure logical id(0x500c0ff0f6f3173c), slot(11) [ 15.324188] scsi 10:0:11:0: enclosure level(0x0000), connector name( C1 ) [ 15.331073] scsi 10:0:11:0: serial_number(HWL032050000822150Z3) [ 15.336994] scsi 10:0:11:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 15.356400] end_device-1:0:9: mpt3sas_transport_port_add: added: handle(0x0039), sas_addr(0x5000c500ec919e9a) [ 15.366483] mpt3sas_cm0: detecting: handle(0x003a), sas_address(0x5000c500ec91bd46), phy(10) [ 15.374922] mpt3sas_cm0: REPORT_LUNS: handle(0x003a), retries(0) [ 15.382289] mpt3sas_cm0: TEST_UNIT_READY: handle(0x003a), lun(0) [ 15.388427] mpt3sas_cm0: handle(0x3a) sas_address(0x5000c500ec91bd46) port_type(0x1) [ 15.391483] end_device-10:0:11: mpt3sas_transport_port_add: added: handle(0x003b), sas_addr(0x5000c500ec95a6d5) [ 15.395488] scsi 10:0:12:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 15.397788] scsi 10:0:12:0: SSP: handle(0x003c), sas_addr(0x5000c500ec95a6cd), phy(12), device_name(0x5000c500ec95a6cc) [ 15.397790] scsi 10:0:12:0: enclosure logical id(0x500c0ff0f6f3173c), slot(12) [ 15.397792] scsi 10:0:12:0: enclosure level(0x0000), connector name( C1 ) [ 15.397794] scsi 10:0:12:0: serial_number(HWL031Y00000822150Z3) [ 15.397796] scsi 10:0:12:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 15.459164] scsi 1:0:10:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 15.468708] scsi 1:0:10:0: SSP: handle(0x003a), sas_addr(0x5000c500ec91bd46), phy(10), device_name(0x5000c500ec91bd44) [ 15.479395] scsi 1:0:10:0: enclosure logical id(0x500c0ff0f6f4a33c), slot(10) [ 15.486612] scsi 1:0:10:0: enclosure level(0x0000), connector name( C1 ) [ 15.493408] scsi 1:0:10:0: serial_number(HWL031260000822150Z3) [ 15.499245] scsi 1:0:10:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 15.511356] end_device-10:0:12: mpt3sas_transport_port_add: added: handle(0x003c), sas_addr(0x5000c500ec95a6cd) [ 15.525488] scsi 10:0:13:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 15.535092] scsi 10:0:13:0: SSP: handle(0x003d), sas_addr(0x5000c500ec95a729), phy(13), device_name(0x5000c500ec95a728) [ 15.545865] scsi 10:0:13:0: enclosure logical id(0x500c0ff0f6f3173c), slot(13) [ 15.553169] scsi 10:0:13:0: enclosure level(0x0000), connector name( C1 ) [ 15.560054] scsi 10:0:13:0: serial_number(HWL031Z10000822150Z3) [ 15.562387] end_device-1:0:10: mpt3sas_transport_port_add: added: handle(0x003a), sas_addr(0x5000c500ec91bd46) [ 15.562491] mpt3sas_cm0: detecting: handle(0x003b), sas_address(0x5000c500ec919eb2), phy(11) [ 15.562494] mpt3sas_cm0: REPORT_LUNS: handle(0x003b), retries(0) [ 15.563841] mpt3sas_cm0: TEST_UNIT_READY: handle(0x003b), lun(0) [ 15.564898] mpt3sas_cm0: handle(0x3b) sas_address(0x5000c500ec919eb2) port_type(0x1) [ 15.569483] scsi 1:0:11:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 15.571825] scsi 1:0:11:0: SSP: handle(0x003b), sas_addr(0x5000c500ec919eb2), phy(11), device_name(0x5000c500ec919eb0) [ 15.571827] scsi 1:0:11:0: enclosure logical id(0x500c0ff0f6f4a33c), slot(11) [ 15.571829] scsi 1:0:11:0: enclosure level(0x0000), connector name( C1 ) [ 15.571830] scsi 1:0:11:0: serial_number(HWL0313R0000822150Z3) [ 15.571833] scsi 1:0:11:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 15.651884] scsi 10:0:13:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 15.675355] end_device-1:0:11: mpt3sas_transport_port_add: added: handle(0x003b), sas_addr(0x5000c500ec919eb2) [ 15.685530] mpt3sas_cm0: detecting: handle(0x003c), sas_address(0x5000c500ec91bdb6), phy(12) [ 15.693972] mpt3sas_cm0: REPORT_LUNS: handle(0x003c), retries(0) [ 15.701338] mpt3sas_cm0: TEST_UNIT_READY: handle(0x003c), lun(0) [ 15.702345] end_device-10:0:13: mpt3sas_transport_port_add: added: handle(0x003d), sas_addr(0x5000c500ec95a729) [ 15.706239] scsi 10:0:14:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 15.708545] scsi 10:0:14:0: SSP: handle(0x003e), sas_addr(0x5000c500ec95a66d), phy(14), device_name(0x5000c500ec95a66c) [ 15.708546] scsi 10:0:14:0: enclosure logical id(0x500c0ff0f6f3173c), slot(14) [ 15.708548] scsi 10:0:14:0: enclosure level(0x0000), connector name( C1 ) [ 15.708548] scsi 10:0:14:0: serial_number(HWL0320B0000822150Z3) [ 15.708550] scsi 10:0:14:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 15.765752] mpt3sas_cm0: handle(0x3c) sas_address(0x5000c500ec91bdb6) port_type(0x1) [ 15.777582] scsi 1:0:12:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 15.787115] scsi 1:0:12:0: SSP: handle(0x003c), sas_addr(0x5000c500ec91bdb6), phy(12), device_name(0x5000c500ec91bdb4) [ 15.789346] end_device-10:0:14: mpt3sas_transport_port_add: added: handle(0x003e), sas_addr(0x5000c500ec95a66d) [ 15.793268] scsi 10:0:15:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 15.795656] scsi 10:0:15:0: SSP: handle(0x003f), sas_addr(0x5000c500ec95a6a5), phy(15), device_name(0x5000c500ec95a6a4) [ 15.795657] scsi 10:0:15:0: enclosure logical id(0x500c0ff0f6f3173c), slot(15) [ 15.795659] scsi 10:0:15:0: enclosure level(0x0000), connector name( C1 ) [ 15.795659] scsi 10:0:15:0: serial_number(HWL031YL0000822150Z3) [ 15.795661] scsi 10:0:15:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 15.856094] scsi 1:0:12:0: enclosure logical id(0x500c0ff0f6f4a33c), slot(12) [ 15.863313] scsi 1:0:12:0: enclosure level(0x0000), connector name( C1 ) [ 15.870109] scsi 1:0:12:0: serial_number(HWL0311W0000822150Z3) [ 15.875943] scsi 1:0:12:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 15.896316] end_device-10:0:15: mpt3sas_transport_port_add: added: handle(0x003f), sas_addr(0x5000c500ec95a6a5) [ 15.910371] scsi 10:0:16:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 15.919981] scsi 10:0:16:0: SSP: handle(0x0040), sas_addr(0x5000c500ec95a56d), phy(16), device_name(0x5000c500ec95a56c) [ 15.930755] scsi 10:0:16:0: enclosure logical id(0x500c0ff0f6f3173c), slot(16) [ 15.938061] scsi 10:0:16:0: enclosure level(0x0000), connector name( C1 ) [ 15.944939] scsi 10:0:16:0: serial_number(HWL031XE0000822150Z3) [ 15.950859] scsi 10:0:16:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 15.962337] end_device-1:0:12: mpt3sas_transport_port_add: added: handle(0x003c), sas_addr(0x5000c500ec91bdb6) [ 15.972520] mpt3sas_cm0: detecting: handle(0x003d), sas_address(0x5000c500ec91bdf2), phy(13) [ 15.980960] mpt3sas_cm0: REPORT_LUNS: handle(0x003d), retries(0) [ 15.988325] mpt3sas_cm0: TEST_UNIT_READY: handle(0x003d), lun(0) [ 15.994422] mpt3sas_cm0: handle(0x3d) sas_address(0x5000c500ec91bdf2) port_type(0x1) [ 16.005325] end_device-10:0:16: mpt3sas_transport_port_add: added: handle(0x0040), sas_addr(0x5000c500ec95a56d) [ 16.006046] scsi 1:0:13:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 16.008356] scsi 1:0:13:0: SSP: handle(0x003d), sas_addr(0x5000c500ec91bdf2), phy(13), device_name(0x5000c500ec91bdf0) [ 16.008358] scsi 1:0:13:0: enclosure logical id(0x500c0ff0f6f4a33c), slot(13) [ 16.008360] scsi 1:0:13:0: enclosure level(0x0000), connector name( C1 ) [ 16.008361] scsi 1:0:13:0: serial_number(HWL0315D0000822150Z3) [ 16.008363] scsi 1:0:13:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 16.067121] scsi 10:0:17:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 16.076722] scsi 10:0:17:0: SSP: handle(0x0041), sas_addr(0x5000c500ec95a715), phy(17), device_name(0x5000c500ec95a714) [ 16.087495] scsi 10:0:17:0: enclosure logical id(0x500c0ff0f6f3173c), slot(17) [ 16.094802] scsi 10:0:17:0: enclosure level(0x0000), connector name( C1 ) [ 16.101680] scsi 10:0:17:0: serial_number(HWL031XL0000822150Z3) [ 16.107595] scsi 10:0:17:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 16.119320] end_device-1:0:13: mpt3sas_transport_port_add: added: handle(0x003d), sas_addr(0x5000c500ec91bdf2) [ 16.129475] mpt3sas_cm0: detecting: handle(0x003e), sas_address(0x5000c500ec8deb3e), phy(14) [ 16.137920] mpt3sas_cm0: REPORT_LUNS: handle(0x003e), retries(0) [ 16.145290] mpt3sas_cm0: TEST_UNIT_READY: handle(0x003e), lun(0) [ 16.151385] mpt3sas_cm0: handle(0x3e) sas_address(0x5000c500ec8deb3e) port_type(0x1) [ 16.162316] end_device-10:0:17: mpt3sas_transport_port_add: added: handle(0x0041), sas_addr(0x5000c500ec95a715) [ 16.163169] scsi 1:0:14:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 16.165479] scsi 1:0:14:0: SSP: handle(0x003e), sas_addr(0x5000c500ec8deb3e), phy(14), device_name(0x5000c500ec8deb3c) [ 16.165481] scsi 1:0:14:0: enclosure logical id(0x500c0ff0f6f4a33c), slot(14) [ 16.165483] scsi 1:0:14:0: enclosure level(0x0000), connector name( C1 ) [ 16.165484] scsi 1:0:14:0: serial_number(HWL0305R0000822150Z3) [ 16.165486] scsi 1:0:14:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 16.224008] scsi 10:0:18:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 16.233606] scsi 10:0:18:0: SSP: handle(0x0042), sas_addr(0x5000c500ec95a701), phy(18), device_name(0x5000c500ec95a700) [ 16.244373] scsi 10:0:18:0: enclosure logical id(0x500c0ff0f6f3173c), slot(18) [ 16.251680] scsi 10:0:18:0: enclosure level(0x0000), connector name( C1 ) [ 16.258558] scsi 10:0:18:0: serial_number(HWL031Y20000822150Z3) [ 16.264472] scsi 10:0:18:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 16.276317] end_device-1:0:14: mpt3sas_transport_port_add: added: handle(0x003e), sas_addr(0x5000c500ec8deb3e) [ 16.286486] mpt3sas_cm0: detecting: handle(0x003f), sas_address(0x5000c500ec955d56), phy(15) [ 16.294931] mpt3sas_cm0: REPORT_LUNS: handle(0x003f), retries(0) [ 16.302295] mpt3sas_cm0: TEST_UNIT_READY: handle(0x003f), lun(0) [ 16.308390] mpt3sas_cm0: handle(0x3f) sas_address(0x5000c500ec955d56) port_type(0x1) [ 16.320053] scsi 1:0:15:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 16.320297] end_device-10:0:18: mpt3sas_transport_port_add: added: handle(0x0042), sas_addr(0x5000c500ec95a701) [ 16.324238] scsi 10:0:19:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 16.326549] scsi 10:0:19:0: SSP: handle(0x0043), sas_addr(0x5000c500ec95a6c9), phy(19), device_name(0x5000c500ec95a6c8) [ 16.326550] scsi 10:0:19:0: enclosure logical id(0x500c0ff0f6f3173c), slot(19) [ 16.326552] scsi 10:0:19:0: enclosure level(0x0000), connector name( C1 ) [ 16.326553] scsi 10:0:19:0: serial_number(HWL031XR0000822150Z3) [ 16.326555] scsi 10:0:19:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 16.387921] scsi 1:0:15:0: SSP: handle(0x003f), sas_addr(0x5000c500ec955d56), phy(15), device_name(0x5000c500ec955d54) [ 16.398609] scsi 1:0:15:0: enclosure logical id(0x500c0ff0f6f4a33c), slot(15) [ 16.405827] scsi 1:0:15:0: enclosure level(0x0000), connector name( C1 ) [ 16.412622] scsi 1:0:15:0: serial_number(HWL031FY0000822150Z3) [ 16.418458] scsi 1:0:15:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 16.440302] end_device-10:0:19: mpt3sas_transport_port_add: added: handle(0x0043), sas_addr(0x5000c500ec95a6c9) [ 16.454285] scsi 10:0:20:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 16.463888] scsi 10:0:20:0: SSP: handle(0x0044), sas_addr(0x5000c500ec955d35), phy(20), device_name(0x5000c500ec955d34) [ 16.465303] end_device-1:0:15: mpt3sas_transport_port_add: added: handle(0x003f), sas_addr(0x5000c500ec955d56) [ 16.465378] mpt3sas_cm0: detecting: handle(0x0040), sas_address(0x5000c500ec955f92), phy(16) [ 16.465381] mpt3sas_cm0: REPORT_LUNS: handle(0x0040), retries(0) [ 16.466728] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0040), lun(0) [ 16.467762] mpt3sas_cm0: handle(0x40) sas_address(0x5000c500ec955f92) port_type(0x1) [ 16.472361] scsi 1:0:16:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 16.474681] scsi 1:0:16:0: SSP: handle(0x0040), sas_addr(0x5000c500ec955f92), phy(16), device_name(0x5000c500ec955f90) [ 16.474682] scsi 1:0:16:0: enclosure logical id(0x500c0ff0f6f4a33c), slot(16) [ 16.474683] scsi 1:0:16:0: enclosure level(0x0000), connector name( C1 ) [ 16.474684] scsi 1:0:16:0: serial_number(HWL0312J0000822150Z3) [ 16.474686] scsi 1:0:16:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 16.560497] scsi 10:0:20:0: enclosure logical id(0x500c0ff0f6f3173c), slot(20) [ 16.567804] scsi 10:0:20:0: enclosure level(0x0000), connector name( C1 ) [ 16.574681] scsi 10:0:20:0: serial_number(HWL031FG0000822150Z3) [ 16.580596] scsi 10:0:20:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 16.603292] end_device-1:0:16: mpt3sas_transport_port_add: added: handle(0x0040), sas_addr(0x5000c500ec955f92) [ 16.613446] mpt3sas_cm0: detecting: handle(0x0041), sas_address(0x5000c500ec955fa6), phy(17) [ 16.621891] mpt3sas_cm0: REPORT_LUNS: handle(0x0041), retries(0) [ 16.629254] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0041), lun(0) [ 16.635334] mpt3sas_cm0: handle(0x41) sas_address(0x5000c500ec955fa6) port_type(0x1) [ 16.638349] end_device-10:0:20: mpt3sas_transport_port_add: added: handle(0x0044), sas_addr(0x5000c500ec955d35) [ 16.642343] scsi 10:0:21:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 16.644649] scsi 10:0:21:0: SSP: handle(0x0045), sas_addr(0x5000c500ec955f95), phy(21), device_name(0x5000c500ec955f94) [ 16.644651] scsi 10:0:21:0: enclosure logical id(0x500c0ff0f6f3173c), slot(21) [ 16.644652] scsi 10:0:21:0: enclosure level(0x0000), connector name( C1 ) [ 16.644653] scsi 10:0:21:0: serial_number(HWL031C40000822150Z3) [ 16.644654] scsi 10:0:21:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 16.705511] scsi 1:0:17:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 16.715040] scsi 1:0:17:0: SSP: handle(0x0041), sas_addr(0x5000c500ec955fa6), phy(17), device_name(0x5000c500ec955fa4) [ 16.725720] scsi 1:0:17:0: enclosure logical id(0x500c0ff0f6f4a33c), slot(17) [ 16.732931] scsi 1:0:17:0: enclosure level(0x0000), connector name( C1 ) [ 16.739721] scsi 1:0:17:0: serial_number(HWL031J00000822150Z3) [ 16.745555] scsi 1:0:17:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 16.757268] end_device-10:0:21: mpt3sas_transport_port_add: added: handle(0x0045), sas_addr(0x5000c500ec955f95) [ 16.771376] scsi 10:0:22:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 16.780988] scsi 10:0:22:0: SSP: handle(0x0046), sas_addr(0x5000c500ec955d81), phy(22), device_name(0x5000c500ec955d80) [ 16.791759] scsi 10:0:22:0: enclosure logical id(0x500c0ff0f6f3173c), slot(22) [ 16.799064] scsi 10:0:22:0: enclosure level(0x0000), connector name( C1 ) [ 16.805949] scsi 10:0:22:0: serial_number(HWL0312N0000822150Z3) [ 16.811870] scsi 10:0:22:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 16.829287] end_device-1:0:17: mpt3sas_transport_port_add: added: handle(0x0041), sas_addr(0x5000c500ec955fa6) [ 16.839455] mpt3sas_cm0: detecting: handle(0x0042), sas_address(0x5000c500ec955e06), phy(18) [ 16.847897] mpt3sas_cm0: REPORT_LUNS: handle(0x0042), retries(0) [ 16.855251] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0042), lun(0) [ 16.861323] mpt3sas_cm0: handle(0x42) sas_address(0x5000c500ec955e06) port_type(0x1) [ 16.872277] end_device-10:0:22: mpt3sas_transport_port_add: added: handle(0x0046), sas_addr(0x5000c500ec955d81) [ 16.873235] scsi 1:0:18:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 16.875539] scsi 1:0:18:0: SSP: handle(0x0042), sas_addr(0x5000c500ec955e06), phy(18), device_name(0x5000c500ec955e04) [ 16.875541] scsi 1:0:18:0: enclosure logical id(0x500c0ff0f6f4a33c), slot(18) [ 16.875543] scsi 1:0:18:0: enclosure level(0x0000), connector name( C1 ) [ 16.875544] scsi 1:0:18:0: serial_number(HWL0319Y0000822150Z3) [ 16.875546] scsi 1:0:18:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 16.934020] scsi 10:0:23:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 16.943620] scsi 10:0:23:0: SSP: handle(0x0047), sas_addr(0x5000c500ec955f79), phy(23), device_name(0x5000c500ec955f78) [ 16.954392] scsi 10:0:23:0: enclosure logical id(0x500c0ff0f6f3173c), slot(23) [ 16.961699] scsi 10:0:23:0: enclosure level(0x0000), connector name( C1 ) [ 16.968578] scsi 10:0:23:0: serial_number(HWL031KP0000822150Z3) [ 16.974500] scsi 10:0:23:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 16.986277] end_device-1:0:18: mpt3sas_transport_port_add: added: handle(0x0042), sas_addr(0x5000c500ec955e06) [ 16.996456] mpt3sas_cm0: detecting: handle(0x0043), sas_address(0x5000c500ec955d8a), phy(19) [ 17.004899] mpt3sas_cm0: REPORT_LUNS: handle(0x0043), retries(0) [ 17.012264] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0043), lun(0) [ 17.018351] mpt3sas_cm0: handle(0x43) sas_address(0x5000c500ec955d8a) port_type(0x1) [ 17.030141] scsi 1:0:19:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 17.030257] end_device-10:0:23: mpt3sas_transport_port_add: added: handle(0x0047), sas_addr(0x5000c500ec955f79) [ 17.031726] scsi 10:0:24:0: Enclosure SEAGATE SP-3224A-E12EBD 52B7 PQ: 0 ANSI: 6 [ 17.032325] scsi 10:0:24:0: set ignore_delay_remove for handle(0x0049) [ 17.032327] scsi 10:0:24:0: SES: handle(0x0049), sas_addr(0x500c0ff00c17553e), phy(36), device_name(0x500c0ff0f6f3173c) [ 17.032328] scsi 10:0:24:0: enclosure logical id(0x500c0ff0f6f3173c), slot(24) [ 17.032329] scsi 10:0:24:0: enclosure level(0x0000), connector name( C1 ) [ 17.032330] scsi 10:0:24:0: serial_number(SGFGD2338F6F317) [ 17.032332] scsi 10:0:24:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 17.104061] scsi 1:0:19:0: SSP: handle(0x0043), sas_addr(0x5000c500ec955d8a), phy(19), device_name(0x5000c500ec955d88) [ 17.114745] scsi 1:0:19:0: enclosure logical id(0x500c0ff0f6f4a33c), slot(19) [ 17.121964] scsi 1:0:19:0: enclosure level(0x0000), connector name( C1 ) [ 17.128761] scsi 1:0:19:0: serial_number(HWL0310H0000822150Z3) [ 17.134594] scsi 1:0:19:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 17.151423] end_device-10:0:24: mpt3sas_transport_port_add: added: handle(0x0049), sas_addr(0x500c0ff00c17553e) [ 17.165438] scsi 10:0:25:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 17.175043] scsi 10:0:25:0: SSP: handle(0x0066), sas_addr(0x5000c500ec95a695), phy(0), device_name(0x5000c500ec95a694) [ 17.185723] scsi 10:0:25:0: enclosure logical id(0x500c0ff0f6f2153c), slot(0) [ 17.192942] scsi 10:0:25:0: enclosure level(0x0000), connector name( C0 ) [ 17.199821] scsi 10:0:25:0: serial_number(HWL031ZX0000822150Z3) [ 17.205737] scsi 10:0:25:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 17.217270] end_device-1:0:19: mpt3sas_transport_port_add: added: handle(0x0043), sas_addr(0x5000c500ec955d8a) [ 17.227436] mpt3sas_cm0: detecting: handle(0x0044), sas_address(0x5000c500ec915866), phy(20) [ 17.235875] mpt3sas_cm0: REPORT_LUNS: handle(0x0044), retries(0) [ 17.243243] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0044), lun(0) [ 17.249333] mpt3sas_cm0: handle(0x44) sas_address(0x5000c500ec915866) port_type(0x1) [ 17.261211] scsi 1:0:20:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 17.261248] end_device-10:1:0: mpt3sas_transport_port_add: added: handle(0x0066), sas_addr(0x5000c500ec95a695) [ 17.265157] scsi 10:0:26:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 17.267462] scsi 10:0:26:0: SSP: handle(0x0067), sas_addr(0x5000c500ec955f75), phy(1), device_name(0x5000c500ec955f74) [ 17.267464] scsi 10:0:26:0: enclosure logical id(0x500c0ff0f6f2153c), slot(1) [ 17.267465] scsi 10:0:26:0: enclosure level(0x0000), connector name( C0 ) [ 17.267466] scsi 10:0:26:0: serial_number(HWL031FQ0000822150Z3) [ 17.267468] scsi 10:0:26:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 17.328811] scsi 1:0:20:0: SSP: handle(0x0044), sas_addr(0x5000c500ec915866), phy(20), device_name(0x5000c500ec915864) [ 17.339498] scsi 1:0:20:0: enclosure logical id(0x500c0ff0f6f4a33c), slot(20) [ 17.346718] scsi 1:0:20:0: enclosure level(0x0000), connector name( C1 ) [ 17.353516] scsi 1:0:20:0: serial_number(HWL031DX0000822150Z3) [ 17.359347] scsi 1:0:20:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 17.378248] end_device-10:1:1: mpt3sas_transport_port_add: added: handle(0x0067), sas_addr(0x5000c500ec955f75) [ 17.392151] scsi 10:0:27:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 17.401761] scsi 10:0:27:0: SSP: handle(0x0068), sas_addr(0x5000c500ec9567d1), phy(2), device_name(0x5000c500ec9567d0) [ 17.403246] end_device-1:0:20: mpt3sas_transport_port_add: added: handle(0x0044), sas_addr(0x5000c500ec915866) [ 17.403335] mpt3sas_cm0: detecting: handle(0x0045), sas_address(0x5000c500ec9191f6), phy(21) [ 17.403338] mpt3sas_cm0: REPORT_LUNS: handle(0x0045), retries(0) [ 17.404686] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0045), lun(0) [ 17.405734] mpt3sas_cm0: handle(0x45) sas_address(0x5000c500ec9191f6) port_type(0x1) [ 17.410321] scsi 1:0:21:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 17.412644] scsi 1:0:21:0: SSP: handle(0x0045), sas_addr(0x5000c500ec9191f6), phy(21), device_name(0x5000c500ec9191f4) [ 17.412647] scsi 1:0:21:0: enclosure logical id(0x500c0ff0f6f4a33c), slot(21) [ 17.412648] scsi 1:0:21:0: enclosure level(0x0000), connector name( C1 ) [ 17.412649] scsi 1:0:21:0: serial_number(HWL031J30000822150Z3) [ 17.412651] scsi 1:0:21:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 17.498346] scsi 10:0:27:0: enclosure logical id(0x500c0ff0f6f2153c), slot(2) [ 17.505565] scsi 10:0:27:0: enclosure level(0x0000), connector name( C0 ) [ 17.512446] scsi 10:0:27:0: serial_number(HWL031RS0000822150Z3) [ 17.518366] scsi 10:0:27:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 17.540239] end_device-1:0:21: mpt3sas_transport_port_add: added: handle(0x0045), sas_addr(0x5000c500ec9191f6) [ 17.551028] mpt3sas_cm0: detecting: handle(0x0046), sas_address(0x5000c500ec91583e), phy(22) [ 17.559467] mpt3sas_cm0: REPORT_LUNS: handle(0x0046), retries(0) [ 17.566822] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0046), lun(0) [ 17.568229] end_device-10:1:2: mpt3sas_transport_port_add: added: handle(0x0068), sas_addr(0x5000c500ec9567d1) [ 17.572637] scsi 10:0:28:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 17.574959] scsi 10:0:28:0: SSP: handle(0x0069), sas_addr(0x5000c500ec915845), phy(3), device_name(0x5000c500ec915844) [ 17.574961] scsi 10:0:28:0: enclosure logical id(0x500c0ff0f6f2153c), slot(3) [ 17.574962] scsi 10:0:28:0: enclosure level(0x0000), connector name( C0 ) [ 17.574963] scsi 10:0:28:0: serial_number(HWL030V90000822150Z3) [ 17.574965] scsi 10:0:28:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 17.630976] mpt3sas_cm0: handle(0x46) sas_address(0x5000c500ec91583e) port_type(0x1) [ 17.643121] scsi 1:0:22:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 17.652653] scsi 1:0:22:0: SSP: handle(0x0046), sas_addr(0x5000c500ec91583e), phy(22), device_name(0x5000c500ec91583c) [ 17.655245] end_device-10:1:3: mpt3sas_transport_port_add: added: handle(0x0069), sas_addr(0x5000c500ec915845) [ 17.659749] scsi 10:0:29:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 17.662078] scsi 10:0:29:0: SSP: handle(0x006a), sas_addr(0x5000c500ec95684d), phy(4), device_name(0x5000c500ec95684c) [ 17.662079] scsi 10:0:29:0: enclosure logical id(0x500c0ff0f6f2153c), slot(4) [ 17.662080] scsi 10:0:29:0: enclosure level(0x0000), connector name( C0 ) [ 17.662081] scsi 10:0:29:0: serial_number(HWL031V30000822150Z3) [ 17.662083] scsi 10:0:29:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 17.721374] scsi 1:0:22:0: enclosure logical id(0x500c0ff0f6f4a33c), slot(22) [ 17.728593] scsi 1:0:22:0: enclosure level(0x0000), connector name( C1 ) [ 17.735390] scsi 1:0:22:0: serial_number(HWL031LD0000822150Z3) [ 17.741225] scsi 1:0:22:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 17.762236] end_device-10:1:4: mpt3sas_transport_port_add: added: handle(0x006a), sas_addr(0x5000c500ec95684d) [ 17.776331] scsi 10:0:30:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 17.778213] end_device-1:0:22: mpt3sas_transport_port_add: added: handle(0x0046), sas_addr(0x5000c500ec91583e) [ 17.778277] mpt3sas_cm0: detecting: handle(0x0047), sas_address(0x5000c500ec955da2), phy(23) [ 17.778279] mpt3sas_cm0: REPORT_LUNS: handle(0x0047), retries(0) [ 17.779613] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0047), lun(0) [ 17.780667] mpt3sas_cm0: handle(0x47) sas_address(0x5000c500ec955da2) port_type(0x1) [ 17.785260] scsi 1:0:23:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 17.787572] scsi 1:0:23:0: SSP: handle(0x0047), sas_addr(0x5000c500ec955da2), phy(23), device_name(0x5000c500ec955da0) [ 17.787574] scsi 1:0:23:0: enclosure logical id(0x500c0ff0f6f4a33c), slot(23) [ 17.787575] scsi 1:0:23:0: enclosure level(0x0000), connector name( C1 ) [ 17.787576] scsi 1:0:23:0: serial_number(HWL031A40000822150Z3) [ 17.787578] scsi 1:0:23:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 17.871878] scsi 10:0:30:0: SSP: handle(0x006b), sas_addr(0x5000c500ec9567c9), phy(5), device_name(0x5000c500ec9567c8) [ 17.882561] scsi 10:0:30:0: enclosure logical id(0x500c0ff0f6f2153c), slot(5) [ 17.889778] scsi 10:0:30:0: enclosure level(0x0000), connector name( C0 ) [ 17.896660] scsi 10:0:30:0: serial_number(HWL031NK0000822150Z3) [ 17.902584] scsi 10:0:30:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 17.921213] end_device-1:0:23: mpt3sas_transport_port_add: added: handle(0x0047), sas_addr(0x5000c500ec955da2) [ 17.931984] mpt3sas_cm0: detecting: handle(0x0049), sas_address(0x500c0ff00c18423e), phy(36) [ 17.940427] mpt3sas_cm0: REPORT_LUNS: handle(0x0049), retries(0) [ 17.947125] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0049), lun(0) [ 17.953483] mpt3sas_cm0: handle(0x49) sas_address(0x500c0ff00c18423e) port_type(0x1) [ 17.956228] end_device-10:1:5: mpt3sas_transport_port_add: added: handle(0x006b), sas_addr(0x5000c500ec9567c9) [ 17.960256] scsi 10:0:31:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 17.962564] scsi 10:0:31:0: SSP: handle(0x006c), sas_addr(0x5000c500ec9567cd), phy(6), device_name(0x5000c500ec9567cc) [ 17.962565] scsi 10:0:31:0: enclosure logical id(0x500c0ff0f6f2153c), slot(6) [ 17.962566] scsi 10:0:31:0: enclosure level(0x0000), connector name( C0 ) [ 17.962567] scsi 10:0:31:0: serial_number(HWL031QC0000822150Z3) [ 17.962569] scsi 10:0:31:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 18.020957] scsi 1:0:24:0: Enclosure SEAGATE SP-3224A-E12EBD 52B7 PQ: 0 ANSI: 6 [ 18.029711] scsi 1:0:24:0: set ignore_delay_remove for handle(0x0049) [ 18.036145] scsi 1:0:24:0: SES: handle(0x0049), sas_addr(0x500c0ff00c18423e), phy(36), device_name(0x500c0ff0f6f4a33c) [ 18.046830] scsi 1:0:24:0: enclosure logical id(0x500c0ff0f6f4a33c), slot(24) [ 18.054054] scsi 1:0:24:0: enclosure level(0x0000), connector name( C1 ) [ 18.060851] scsi 1:0:24:0: serial_number(SGFGD2338F6F4A3) [ 18.066248] scsi 1:0:24:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 18.084222] end_device-10:1:6: mpt3sas_transport_port_add: added: handle(0x006c), sas_addr(0x5000c500ec9567cd) [ 18.098389] scsi 10:0:32:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 18.099444] end_device-1:0:24: mpt3sas_transport_port_add: added: handle(0x0049), sas_addr(0x500c0ff00c18423e) [ 18.100207] mpt3sas_cm0: expander_add: handle(0x0065), parent(0x0002), sas_addr(0x500c0ff00c16f33f), phys(37) [ 18.100509] expander-1:1: mpt3sas_transport_port_add: added: handle(0x0065), sas_addr(0x500c0ff00c16f33f) [ 18.107597] mpt3sas_cm0: detecting: handle(0x0066), sas_address(0x5000c500ec91557e), phy(0) [ 18.107599] mpt3sas_cm0: REPORT_LUNS: handle(0x0066), retries(0) [ 18.108955] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0066), lun(0) [ 18.109999] mpt3sas_cm0: handle(0x66) sas_address(0x5000c500ec91557e) port_type(0x1) [ 18.114586] scsi 1:0:25:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 18.116902] scsi 1:0:25:0: SSP: handle(0x0066), sas_addr(0x5000c500ec91557e), phy(0), device_name(0x5000c500ec91557c) [ 18.116904] scsi 1:0:25:0: enclosure logical id(0x500c0ff0f6f3a63c), slot(0) [ 18.116905] scsi 1:0:25:0: enclosure level(0x0000), connector name( C0 ) [ 18.116906] scsi 1:0:25:0: serial_number(HWL0312F0000822150Z3) [ 18.116908] scsi 1:0:25:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 18.213217] scsi 10:0:32:0: SSP: handle(0x006d), sas_addr(0x5000c500ec9567c5), phy(7), device_name(0x5000c500ec9567c4) [ 18.223903] scsi 10:0:32:0: enclosure logical id(0x500c0ff0f6f2153c), slot(7) [ 18.231120] scsi 10:0:32:0: enclosure level(0x0000), connector name( C0 ) [ 18.238003] scsi 10:0:32:0: serial_number(HWL031R80000822150Z3) [ 18.243929] scsi 10:0:32:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 18.265197] end_device-1:1:0: mpt3sas_transport_port_add: added: handle(0x0066), sas_addr(0x5000c500ec91557e) [ 18.275279] mpt3sas_cm0: detecting: handle(0x0067), sas_address(0x5000c500ec91bd66), phy(1) [ 18.283631] mpt3sas_cm0: REPORT_LUNS: handle(0x0067), retries(0) [ 18.290993] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0067), lun(0) [ 18.292198] end_device-10:1:7: mpt3sas_transport_port_add: added: handle(0x006d), sas_addr(0x5000c500ec9567c5) [ 18.296187] scsi 10:0:33:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 18.298518] scsi 10:0:33:0: SSP: handle(0x006e), sas_addr(0x5000c500ec923261), phy(8), device_name(0x5000c500ec923260) [ 18.298520] scsi 10:0:33:0: enclosure logical id(0x500c0ff0f6f2153c), slot(8) [ 18.298522] scsi 10:0:33:0: enclosure level(0x0000), connector name( C0 ) [ 18.298523] scsi 10:0:33:0: serial_number(HWL031GT0000822150Z3) [ 18.298525] scsi 10:0:33:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 18.355125] mpt3sas_cm0: handle(0x67) sas_address(0x5000c500ec91bd66) port_type(0x1) [ 18.367034] scsi 1:0:26:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 18.376579] scsi 1:0:26:0: SSP: handle(0x0067), sas_addr(0x5000c500ec91bd66), phy(1), device_name(0x5000c500ec91bd64) [ 18.378184] end_device-10:1:8: mpt3sas_transport_port_add: added: handle(0x006e), sas_addr(0x5000c500ec923261) [ 18.382119] scsi 10:0:34:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 18.384423] scsi 10:0:34:0: SSP: handle(0x006f), sas_addr(0x5000c500ec9156b1), phy(9), device_name(0x5000c500ec9156b0) [ 18.384425] scsi 10:0:34:0: enclosure logical id(0x500c0ff0f6f2153c), slot(9) [ 18.384427] scsi 10:0:34:0: enclosure level(0x0000), connector name( C0 ) [ 18.384428] scsi 10:0:34:0: serial_number(HWL031CA0000822150Z3) [ 18.384430] scsi 10:0:34:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 18.445207] scsi 1:0:26:0: enclosure logical id(0x500c0ff0f6f3a63c), slot(1) [ 18.452340] scsi 1:0:26:0: enclosure level(0x0000), connector name( C0 ) [ 18.459138] scsi 1:0:26:0: serial_number(HWL031JA0000822150Z3) [ 18.464969] scsi 1:0:26:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 18.488178] end_device-10:1:9: mpt3sas_transport_port_add: added: handle(0x006f), sas_addr(0x5000c500ec9156b1) [ 18.502081] scsi 10:0:35:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 18.504188] end_device-1:1:1: mpt3sas_transport_port_add: added: handle(0x0067), sas_addr(0x5000c500ec91bd66) [ 18.504271] mpt3sas_cm0: detecting: handle(0x0068), sas_address(0x5000c500ec91bd5a), phy(2) [ 18.504275] mpt3sas_cm0: REPORT_LUNS: handle(0x0068), retries(0) [ 18.506004] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0068), lun(0) [ 18.507043] mpt3sas_cm0: handle(0x68) sas_address(0x5000c500ec91bd5a) port_type(0x1) [ 18.511642] scsi 1:0:27:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 18.513955] scsi 1:0:27:0: SSP: handle(0x0068), sas_addr(0x5000c500ec91bd5a), phy(2), device_name(0x5000c500ec91bd58) [ 18.513956] scsi 1:0:27:0: enclosure logical id(0x500c0ff0f6f3a63c), slot(2) [ 18.513958] scsi 1:0:27:0: enclosure level(0x0000), connector name( C0 ) [ 18.513960] scsi 1:0:27:0: serial_number(HWL031FR0000822150Z3) [ 18.513962] scsi 1:0:27:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 18.597245] scsi 10:0:35:0: SSP: handle(0x0070), sas_addr(0x5000c500ec952ae1), phy(10), device_name(0x5000c500ec952ae0) [ 18.608014] scsi 10:0:35:0: enclosure logical id(0x500c0ff0f6f2153c), slot(10) [ 18.615317] scsi 10:0:35:0: enclosure level(0x0000), connector name( C0 ) [ 18.622196] scsi 10:0:35:0: serial_number(HWL030MH0000822150Z3) [ 18.628112] scsi 10:0:35:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 18.649186] end_device-1:1:2: mpt3sas_transport_port_add: added: handle(0x0068), sas_addr(0x5000c500ec91bd5a) [ 18.659281] mpt3sas_cm0: detecting: handle(0x0069), sas_address(0x5000c500ec919e96), phy(3) [ 18.667643] mpt3sas_cm0: REPORT_LUNS: handle(0x0069), retries(0) [ 18.675025] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0069), lun(0) [ 18.675164] end_device-10:1:10: mpt3sas_transport_port_add: added: handle(0x0070), sas_addr(0x5000c500ec952ae1) [ 18.679361] scsi 10:0:36:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 18.681679] scsi 10:0:36:0: SSP: handle(0x0071), sas_addr(0x5000c500ec95682d), phy(11), device_name(0x5000c500ec95682c) [ 18.681681] scsi 10:0:36:0: enclosure logical id(0x500c0ff0f6f2153c), slot(11) [ 18.681682] scsi 10:0:36:0: enclosure level(0x0000), connector name( C0 ) [ 18.681683] scsi 10:0:36:0: serial_number(HWL031TN0000822150Z3) [ 18.681685] scsi 10:0:36:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 18.739477] mpt3sas_cm0: handle(0x69) sas_address(0x5000c500ec919e96) port_type(0x1) [ 18.751227] scsi 1:0:28:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 18.760793] scsi 1:0:28:0: SSP: handle(0x0069), sas_addr(0x5000c500ec919e96), phy(3), device_name(0x5000c500ec919e94) [ 18.771390] scsi 1:0:28:0: enclosure logical id(0x500c0ff0f6f3a63c), slot(3) [ 18.778525] scsi 1:0:28:0: enclosure level(0x0000), connector name( C0 ) [ 18.785325] scsi 1:0:28:0: serial_number(HWL031DQ0000822150Z3) [ 18.791154] scsi 1:0:28:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 18.803216] end_device-10:1:11: mpt3sas_transport_port_add: added: handle(0x0071), sas_addr(0x5000c500ec95682d) [ 18.817380] scsi 10:0:37:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 18.826982] scsi 10:0:37:0: SSP: handle(0x0072), sas_addr(0x5000c500ec95a575), phy(12), device_name(0x5000c500ec95a574) [ 18.837749] scsi 10:0:37:0: enclosure logical id(0x500c0ff0f6f2153c), slot(12) [ 18.845055] scsi 10:0:37:0: enclosure level(0x0000), connector name( C0 ) [ 18.851938] scsi 10:0:37:0: serial_number(HWL031Z40000822150Z3) [ 18.857859] scsi 10:0:37:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 18.870183] end_device-1:1:3: mpt3sas_transport_port_add: added: handle(0x0069), sas_addr(0x5000c500ec919e96) [ 18.880255] mpt3sas_cm0: detecting: handle(0x006a), sas_address(0x5000c500ec922ba2), phy(4) [ 18.888606] mpt3sas_cm0: REPORT_LUNS: handle(0x006a), retries(0) [ 18.895962] mpt3sas_cm0: TEST_UNIT_READY: handle(0x006a), lun(0) [ 18.902057] mpt3sas_cm0: handle(0x6a) sas_address(0x5000c500ec922ba2) port_type(0x1) [ 18.913147] end_device-10:1:12: mpt3sas_transport_port_add: added: handle(0x0072), sas_addr(0x5000c500ec95a575) [ 18.913961] scsi 1:0:29:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 18.916282] scsi 1:0:29:0: SSP: handle(0x006a), sas_addr(0x5000c500ec922ba2), phy(4), device_name(0x5000c500ec922ba0) [ 18.916284] scsi 1:0:29:0: enclosure logical id(0x500c0ff0f6f3a63c), slot(4) [ 18.916286] scsi 1:0:29:0: enclosure level(0x0000), connector name( C0 ) [ 18.916287] scsi 1:0:29:0: serial_number(HWL031990000822150Z3) [ 18.916290] scsi 1:0:29:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 18.974844] scsi 10:0:38:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 18.984450] scsi 10:0:38:0: SSP: handle(0x0073), sas_addr(0x5000c500ec95a641), phy(13), device_name(0x5000c500ec95a640) [ 18.995217] scsi 10:0:38:0: enclosure logical id(0x500c0ff0f6f2153c), slot(13) [ 19.002524] scsi 10:0:38:0: enclosure level(0x0000), connector name( C0 ) [ 19.009402] scsi 10:0:38:0: serial_number(HWL031Y80000822150Z3) [ 19.015316] scsi 10:0:38:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 19.033224] end_device-1:1:4: mpt3sas_transport_port_add: added: handle(0x006a), sas_addr(0x5000c500ec922ba2) [ 19.043321] mpt3sas_cm0: detecting: handle(0x006b), sas_address(0x5000c500ec922b6e), phy(5) [ 19.051677] mpt3sas_cm0: REPORT_LUNS: handle(0x006b), retries(0) [ 19.059027] mpt3sas_cm0: TEST_UNIT_READY: handle(0x006b), lun(0) [ 19.065116] mpt3sas_cm0: handle(0x6b) sas_address(0x5000c500ec922b6e) port_type(0x1) [ 19.076144] end_device-10:1:13: mpt3sas_transport_port_add: added: handle(0x0073), sas_addr(0x5000c500ec95a641) [ 19.077206] scsi 1:0:30:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 19.079551] scsi 1:0:30:0: SSP: handle(0x006b), sas_addr(0x5000c500ec922b6e), phy(5), device_name(0x5000c500ec922b6c) [ 19.079553] scsi 1:0:30:0: enclosure logical id(0x500c0ff0f6f3a63c), slot(5) [ 19.079555] scsi 1:0:30:0: enclosure level(0x0000), connector name( C0 ) [ 19.079556] scsi 1:0:30:0: serial_number(HWL031270000822150Z3) [ 19.079558] scsi 1:0:30:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 19.137822] scsi 10:0:39:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 19.147431] scsi 10:0:39:0: SSP: handle(0x0074), sas_addr(0x5000c500ec95a6f5), phy(14), device_name(0x5000c500ec95a6f4) [ 19.158206] scsi 10:0:39:0: enclosure logical id(0x500c0ff0f6f2153c), slot(14) [ 19.165512] scsi 10:0:39:0: enclosure level(0x0000), connector name( C0 ) [ 19.172395] scsi 10:0:39:0: serial_number(HWL031WR0000822150Z3) [ 19.178319] scsi 10:0:39:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 19.190162] end_device-1:1:5: mpt3sas_transport_port_add: added: handle(0x006b), sas_addr(0x5000c500ec922b6e) [ 19.200247] mpt3sas_cm0: detecting: handle(0x006c), sas_address(0x5000c500ec922bf6), phy(6) [ 19.208600] mpt3sas_cm0: REPORT_LUNS: handle(0x006c), retries(0) [ 19.215959] mpt3sas_cm0: TEST_UNIT_READY: handle(0x006c), lun(0) [ 19.222049] mpt3sas_cm0: handle(0x6c) sas_address(0x5000c500ec922bf6) port_type(0x1) [ 19.233122] end_device-10:1:14: mpt3sas_transport_port_add: added: handle(0x0074), sas_addr(0x5000c500ec95a6f5) [ 19.233915] scsi 1:0:31:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 19.236217] scsi 1:0:31:0: SSP: handle(0x006c), sas_addr(0x5000c500ec922bf6), phy(6), device_name(0x5000c500ec922bf4) [ 19.236218] scsi 1:0:31:0: enclosure logical id(0x500c0ff0f6f3a63c), slot(6) [ 19.236219] scsi 1:0:31:0: enclosure level(0x0000), connector name( C0 ) [ 19.236220] scsi 1:0:31:0: serial_number(HWL031KV0000822150Z3) [ 19.236222] scsi 1:0:31:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 19.294847] scsi 10:0:40:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 19.304519] scsi 10:0:40:0: SSP: handle(0x0075), sas_addr(0x5000c500ec95a649), phy(15), device_name(0x5000c500ec95a648) [ 19.315294] scsi 10:0:40:0: enclosure logical id(0x500c0ff0f6f2153c), slot(15) [ 19.322600] scsi 10:0:40:0: enclosure level(0x0000), connector name( C0 ) [ 19.329481] scsi 10:0:40:0: serial_number(HWL031XY0000822150Z3) [ 19.335402] scsi 10:0:40:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 19.347139] end_device-1:1:6: mpt3sas_transport_port_add: added: handle(0x006c), sas_addr(0x5000c500ec922bf6) [ 19.357222] mpt3sas_cm0: detecting: handle(0x006d), sas_address(0x5000c500ec922b4e), phy(7) [ 19.365573] mpt3sas_cm0: REPORT_LUNS: handle(0x006d), retries(0) [ 19.372929] mpt3sas_cm0: TEST_UNIT_READY: handle(0x006d), lun(0) [ 19.379007] mpt3sas_cm0: handle(0x6d) sas_address(0x5000c500ec922b4e) port_type(0x1) [ 19.389128] end_device-10:1:15: mpt3sas_transport_port_add: added: handle(0x0075), sas_addr(0x5000c500ec95a649) [ 19.390864] scsi 1:0:32:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 19.393180] scsi 1:0:32:0: SSP: handle(0x006d), sas_addr(0x5000c500ec922b4e), phy(7), device_name(0x5000c500ec922b4c) [ 19.393182] scsi 1:0:32:0: enclosure logical id(0x500c0ff0f6f3a63c), slot(7) [ 19.393183] scsi 1:0:32:0: enclosure level(0x0000), connector name( C0 ) [ 19.393184] scsi 1:0:32:0: serial_number(HWL030XV0000822150Z3) [ 19.393186] scsi 1:0:32:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 19.450870] scsi 10:0:41:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 19.460478] scsi 10:0:41:0: SSP: handle(0x0076), sas_addr(0x5000c500ec955f4d), phy(16), device_name(0x5000c500ec955f4c) [ 19.471245] scsi 10:0:41:0: enclosure logical id(0x500c0ff0f6f2153c), slot(16) [ 19.478549] scsi 10:0:41:0: enclosure level(0x0000), connector name( C0 ) [ 19.485428] scsi 10:0:41:0: serial_number(HWL0315N0000822150Z3) [ 19.491344] scsi 10:0:41:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 19.506131] end_device-1:1:7: mpt3sas_transport_port_add: added: handle(0x006d), sas_addr(0x5000c500ec922b4e) [ 19.516207] mpt3sas_cm0: detecting: handle(0x006e), sas_address(0x5000c500ec922bf2), phy(8) [ 19.524556] mpt3sas_cm0: REPORT_LUNS: handle(0x006e), retries(0) [ 19.531910] mpt3sas_cm0: TEST_UNIT_READY: handle(0x006e), lun(0) [ 19.537993] mpt3sas_cm0: handle(0x6e) sas_address(0x5000c500ec922bf2) port_type(0x1) [ 19.548103] end_device-10:1:16: mpt3sas_transport_port_add: added: handle(0x0076), sas_addr(0x5000c500ec955f4d) [ 19.549845] scsi 1:0:33:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 19.552161] scsi 1:0:33:0: SSP: handle(0x006e), sas_addr(0x5000c500ec922bf2), phy(8), device_name(0x5000c500ec922bf0) [ 19.552163] scsi 1:0:33:0: enclosure logical id(0x500c0ff0f6f3a63c), slot(8) [ 19.552165] scsi 1:0:33:0: enclosure level(0x0000), connector name( C0 ) [ 19.552166] scsi 1:0:33:0: serial_number(HWL0317Q0000822150Z3) [ 19.552168] scsi 1:0:33:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 19.609776] scsi 10:0:42:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 19.619384] scsi 10:0:42:0: SSP: handle(0x0077), sas_addr(0x5000c500ec955ed9), phy(17), device_name(0x5000c500ec955ed8) [ 19.630160] scsi 10:0:42:0: enclosure logical id(0x500c0ff0f6f2153c), slot(17) [ 19.637465] scsi 10:0:42:0: enclosure level(0x0000), connector name( C0 ) [ 19.644346] scsi 10:0:42:0: serial_number(HWL031DW0000822150Z3) [ 19.650269] scsi 10:0:42:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 19.662126] end_device-1:1:8: mpt3sas_transport_port_add: added: handle(0x006e), sas_addr(0x5000c500ec922bf2) [ 19.672197] mpt3sas_cm0: detecting: handle(0x006f), sas_address(0x5000c500ec922bba), phy(9) [ 19.680556] mpt3sas_cm0: REPORT_LUNS: handle(0x006f), retries(0) [ 19.687912] mpt3sas_cm0: TEST_UNIT_READY: handle(0x006f), lun(0) [ 19.693995] mpt3sas_cm0: handle(0x6f) sas_address(0x5000c500ec922bba) port_type(0x1) [ 19.705101] end_device-10:1:17: mpt3sas_transport_port_add: added: handle(0x0077), sas_addr(0x5000c500ec955ed9) [ 19.705793] scsi 1:0:34:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 19.708107] scsi 1:0:34:0: SSP: handle(0x006f), sas_addr(0x5000c500ec922bba), phy(9), device_name(0x5000c500ec922bb8) [ 19.708109] scsi 1:0:34:0: enclosure logical id(0x500c0ff0f6f3a63c), slot(9) [ 19.708110] scsi 1:0:34:0: enclosure level(0x0000), connector name( C0 ) [ 19.708111] scsi 1:0:34:0: serial_number(HWL031FZ0000822150Z3) [ 19.708113] scsi 1:0:34:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 19.766819] scsi 10:0:43:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 19.776445] scsi 10:0:43:0: SSP: handle(0x0078), sas_addr(0x5000c500ec955f71), phy(18), device_name(0x5000c500ec955f70) [ 19.787219] scsi 10:0:43:0: enclosure logical id(0x500c0ff0f6f2153c), slot(18) [ 19.794526] scsi 10:0:43:0: enclosure level(0x0000), connector name( C0 ) [ 19.801407] scsi 10:0:43:0: serial_number(HWL0316M0000822150Z3) [ 19.807330] scsi 10:0:43:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 19.819128] end_device-1:1:9: mpt3sas_transport_port_add: added: handle(0x006f), sas_addr(0x5000c500ec922bba) [ 19.829232] mpt3sas_cm0: detecting: handle(0x0070), sas_address(0x5000c500ec922c02), phy(10) [ 19.837693] mpt3sas_cm0: REPORT_LUNS: handle(0x0070), retries(0) [ 19.845066] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0070), lun(0) [ 19.851190] mpt3sas_cm0: handle(0x70) sas_address(0x5000c500ec922c02) port_type(0x1) [ 19.862097] end_device-10:1:18: mpt3sas_transport_port_add: added: handle(0x0078), sas_addr(0x5000c500ec955f71) [ 19.863026] scsi 1:0:35:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 19.865324] scsi 1:0:35:0: SSP: handle(0x0070), sas_addr(0x5000c500ec922c02), phy(10), device_name(0x5000c500ec922c00) [ 19.865325] scsi 1:0:35:0: enclosure logical id(0x500c0ff0f6f3a63c), slot(10) [ 19.865326] scsi 1:0:35:0: enclosure level(0x0000), connector name( C0 ) [ 19.865327] scsi 1:0:35:0: serial_number(HWL031JD0000822150Z3) [ 19.865329] scsi 1:0:35:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 19.923971] scsi 10:0:44:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 19.933573] scsi 10:0:44:0: SSP: handle(0x0079), sas_addr(0x5000c500ec955d85), phy(19), device_name(0x5000c500ec955d84) [ 19.944342] scsi 10:0:44:0: enclosure logical id(0x500c0ff0f6f2153c), slot(19) [ 19.951647] scsi 10:0:44:0: enclosure level(0x0000), connector name( C0 ) [ 19.958529] scsi 10:0:44:0: serial_number(HWL031GZ0000822150Z3) [ 19.964452] scsi 10:0:44:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 19.976103] end_device-1:1:10: mpt3sas_transport_port_add: added: handle(0x0070), sas_addr(0x5000c500ec922c02) [ 19.986286] mpt3sas_cm0: detecting: handle(0x0071), sas_address(0x5000c500ec922be6), phy(11) [ 19.994744] mpt3sas_cm0: REPORT_LUNS: handle(0x0071), retries(0) [ 20.002221] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0071), lun(0) [ 20.008324] mpt3sas_cm0: handle(0x71) sas_address(0x5000c500ec922be6) port_type(0x1) [ 20.019203] end_device-10:1:19: mpt3sas_transport_port_add: added: handle(0x0079), sas_addr(0x5000c500ec955d85) [ 20.020216] scsi 1:0:36:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 20.022534] scsi 1:0:36:0: SSP: handle(0x0071), sas_addr(0x5000c500ec922be6), phy(11), device_name(0x5000c500ec922be4) [ 20.022536] scsi 1:0:36:0: enclosure logical id(0x500c0ff0f6f3a63c), slot(11) [ 20.022537] scsi 1:0:36:0: enclosure level(0x0000), connector name( C0 ) [ 20.022538] scsi 1:0:36:0: serial_number(HWL0317P0000822150Z3) [ 20.022540] scsi 1:0:36:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 20.081053] scsi 10:0:45:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 20.090660] scsi 10:0:45:0: SSP: handle(0x007a), sas_addr(0x5000c500ec955ee1), phy(20), device_name(0x5000c500ec955ee0) [ 20.101427] scsi 10:0:45:0: enclosure logical id(0x500c0ff0f6f2153c), slot(20) [ 20.108733] scsi 10:0:45:0: enclosure level(0x0000), connector name( C0 ) [ 20.115614] scsi 10:0:45:0: serial_number(HWL031B70000822150Z3) [ 20.121538] scsi 10:0:45:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 20.133081] end_device-1:1:11: mpt3sas_transport_port_add: added: handle(0x0071), sas_addr(0x5000c500ec922be6) [ 20.143247] mpt3sas_cm0: detecting: handle(0x0072), sas_address(0x5000c500ec922bc2), phy(12) [ 20.151684] mpt3sas_cm0: REPORT_LUNS: handle(0x0072), retries(0) [ 20.159044] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0072), lun(0) [ 20.165123] mpt3sas_cm0: handle(0x72) sas_address(0x5000c500ec922bc2) port_type(0x1) [ 20.176076] end_device-10:1:20: mpt3sas_transport_port_add: added: handle(0x007a), sas_addr(0x5000c500ec955ee1) [ 20.176981] scsi 1:0:37:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 20.179341] scsi 1:0:37:0: SSP: handle(0x0072), sas_addr(0x5000c500ec922bc2), phy(12), device_name(0x5000c500ec922bc0) [ 20.179343] scsi 1:0:37:0: enclosure logical id(0x500c0ff0f6f3a63c), slot(12) [ 20.179344] scsi 1:0:37:0: enclosure level(0x0000), connector name( C0 ) [ 20.179345] scsi 1:0:37:0: serial_number(HWL030X10000822150Z3) [ 20.179347] scsi 1:0:37:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 20.237901] scsi 10:0:46:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 20.247498] scsi 10:0:46:0: SSP: handle(0x007b), sas_addr(0x5000c500ec955f49), phy(21), device_name(0x5000c500ec955f48) [ 20.258271] scsi 10:0:46:0: enclosure logical id(0x500c0ff0f6f2153c), slot(21) [ 20.265578] scsi 10:0:46:0: enclosure level(0x0000), connector name( C0 ) [ 20.272456] scsi 10:0:46:0: serial_number(HWL0316W0000822150Z3) [ 20.278377] scsi 10:0:46:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 20.293095] end_device-1:1:12: mpt3sas_transport_port_add: added: handle(0x0072), sas_addr(0x5000c500ec922bc2) [ 20.303277] mpt3sas_cm0: detecting: handle(0x0073), sas_address(0x5000c500ec922bce), phy(13) [ 20.311720] mpt3sas_cm0: REPORT_LUNS: handle(0x0073), retries(0) [ 20.319076] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0073), lun(0) [ 20.325157] mpt3sas_cm0: handle(0x73) sas_address(0x5000c500ec922bce) port_type(0x1) [ 20.336063] end_device-10:1:21: mpt3sas_transport_port_add: added: handle(0x007b), sas_addr(0x5000c500ec955f49) [ 20.336921] scsi 1:0:38:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 20.339236] scsi 1:0:38:0: SSP: handle(0x0073), sas_addr(0x5000c500ec922bce), phy(13), device_name(0x5000c500ec922bcc) [ 20.339238] scsi 1:0:38:0: enclosure logical id(0x500c0ff0f6f3a63c), slot(13) [ 20.339239] scsi 1:0:38:0: enclosure level(0x0000), connector name( C0 ) [ 20.339240] scsi 1:0:38:0: serial_number(HWL031GX0000822150Z3) [ 20.339241] scsi 1:0:38:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 20.398044] scsi 10:0:47:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 20.407650] scsi 10:0:47:0: SSP: handle(0x007c), sas_addr(0x5000c500ec955ec1), phy(22), device_name(0x5000c500ec955ec0) [ 20.418416] scsi 10:0:47:0: enclosure logical id(0x500c0ff0f6f2153c), slot(22) [ 20.425723] scsi 10:0:47:0: enclosure level(0x0000), connector name( C0 ) [ 20.432605] scsi 10:0:47:0: serial_number(HWL031AN0000822150Z3) [ 20.438526] scsi 10:0:47:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 20.450076] end_device-1:1:13: mpt3sas_transport_port_add: added: handle(0x0073), sas_addr(0x5000c500ec922bce) [ 20.460232] mpt3sas_cm0: detecting: handle(0x0074), sas_address(0x5000c500ec922bee), phy(14) [ 20.468683] mpt3sas_cm0: REPORT_LUNS: handle(0x0074), retries(0) [ 20.476041] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0074), lun(0) [ 20.482124] mpt3sas_cm0: handle(0x74) sas_address(0x5000c500ec922bee) port_type(0x1) [ 20.493863] scsi 1:0:39:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 20.494059] end_device-10:1:22: mpt3sas_transport_port_add: added: handle(0x007c), sas_addr(0x5000c500ec955ec1) [ 20.498115] scsi 10:0:48:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 20.500427] scsi 10:0:48:0: SSP: handle(0x007d), sas_addr(0x5000c500ec95a691), phy(23), device_name(0x5000c500ec95a690) [ 20.500429] scsi 10:0:48:0: enclosure logical id(0x500c0ff0f6f2153c), slot(23) [ 20.500430] scsi 10:0:48:0: enclosure level(0x0000), connector name( C0 ) [ 20.500431] scsi 10:0:48:0: serial_number(HWL031Y70000822150Z3) [ 20.500433] scsi 10:0:48:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 20.561713] scsi 1:0:39:0: SSP: handle(0x0074), sas_addr(0x5000c500ec922bee), phy(14), device_name(0x5000c500ec922bec) [ 20.572394] scsi 1:0:39:0: enclosure logical id(0x500c0ff0f6f3a63c), slot(14) [ 20.579611] scsi 1:0:39:0: enclosure level(0x0000), connector name( C0 ) [ 20.586404] scsi 1:0:39:0: serial_number(HWL0311V0000822150Z3) [ 20.592232] scsi 1:0:39:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 20.610069] end_device-10:1:23: mpt3sas_transport_port_add: added: handle(0x007d), sas_addr(0x5000c500ec95a691) [ 20.621858] scsi 10:0:49:0: Enclosure SEAGATE SP-3224A-E12EBD 52B7 PQ: 0 ANSI: 6 [ 20.630713] scsi 10:0:49:0: set ignore_delay_remove for handle(0x007f) [ 20.637243] scsi 10:0:49:0: SES: handle(0x007f), sas_addr(0x500c0ff00c17023e), phy(36), device_name(0x500c0ff0f6f2153c) [ 20.648016] scsi 10:0:49:0: enclosure logical id(0x500c0ff0f6f2153c), slot(24) [ 20.655320] scsi 10:0:49:0: enclosure level(0x0000), connector name( C0 ) [ 20.662204] scsi 10:0:49:0: serial_number(SGFGD2338F6F215) [ 20.667699] scsi 10:0:49:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 20.680049] end_device-1:1:14: mpt3sas_transport_port_add: added: handle(0x0074), sas_addr(0x5000c500ec922bee) [ 20.690226] mpt3sas_cm0: detecting: handle(0x0075), sas_address(0x5000c500ec922b92), phy(15) [ 20.698675] mpt3sas_cm0: REPORT_LUNS: handle(0x0075), retries(0) [ 20.706035] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0075), lun(0) [ 20.712118] mpt3sas_cm0: handle(0x75) sas_address(0x5000c500ec922b92) port_type(0x1) [ 20.722315] end_device-10:1:24: mpt3sas_transport_port_add: added: handle(0x007f), sas_addr(0x500c0ff00c17023e) [ 20.723839] scsi 1:0:40:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 20.726155] scsi 1:0:40:0: SSP: handle(0x0075), sas_addr(0x5000c500ec922b92), phy(15), device_name(0x5000c500ec922b90) [ 20.726157] scsi 1:0:40:0: enclosure logical id(0x500c0ff0f6f3a63c), slot(15) [ 20.726159] scsi 1:0:40:0: enclosure level(0x0000), connector name( C0 ) [ 20.726160] scsi 1:0:40:0: serial_number(HWL0318P0000822150Z3) [ 20.726162] scsi 1:0:40:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 20.784164] scsi 10:0:50:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 20.793768] scsi 10:0:50:0: SSP: handle(0x004b), sas_addr(0x5000c500ec91557d), phy(0), device_name(0x5000c500ec91557c) [ 20.804451] scsi 10:0:50:0: enclosure logical id(0x500c0ff0f6f3a63c), slot(0) [ 20.811673] scsi 10:0:50:0: enclosure level(0x0000), connector name( C3 ) [ 20.818551] scsi 10:0:50:0: serial_number(HWL0312F0000822150Z3) [ 20.824476] scsi 10:0:50:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 20.842054] end_device-1:1:15: mpt3sas_transport_port_add: added: handle(0x0075), sas_addr(0x5000c500ec922b92) [ 20.852223] mpt3sas_cm0: detecting: handle(0x0076), sas_address(0x5000c500ec922b46), phy(16) [ 20.860661] mpt3sas_cm0: REPORT_LUNS: handle(0x0076), retries(0) [ 20.868028] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0076), lun(0) [ 20.874123] mpt3sas_cm0: handle(0x76) sas_address(0x5000c500ec922b46) port_type(0x1) [ 20.886028] scsi 1:0:41:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 20.886038] end_device-10:2:0: mpt3sas_transport_port_add: added: handle(0x004b), sas_addr(0x5000c500ec91557d) [ 20.890025] scsi 10:0:51:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 20.892344] scsi 10:0:51:0: SSP: handle(0x004c), sas_addr(0x5000c500ec91bd65), phy(1), device_name(0x5000c500ec91bd64) [ 20.892345] scsi 10:0:51:0: enclosure logical id(0x500c0ff0f6f3a63c), slot(1) [ 20.892347] scsi 10:0:51:0: enclosure level(0x0000), connector name( C3 ) [ 20.892348] scsi 10:0:51:0: serial_number(HWL031JA0000822150Z3) [ 20.892350] scsi 10:0:51:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 20.953630] scsi 1:0:41:0: SSP: handle(0x0076), sas_addr(0x5000c500ec922b46), phy(16), device_name(0x5000c500ec922b44) [ 20.964312] scsi 1:0:41:0: enclosure logical id(0x500c0ff0f6f3a63c), slot(16) [ 20.971530] scsi 1:0:41:0: enclosure level(0x0000), connector name( C0 ) [ 20.978327] scsi 1:0:41:0: serial_number(HWL0311R0000822150Z3) [ 20.984159] scsi 1:0:41:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 21.005035] end_device-10:2:1: mpt3sas_transport_port_add: added: handle(0x004c), sas_addr(0x5000c500ec91bd65) [ 21.019124] scsi 10:0:52:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 21.028795] scsi 10:0:52:0: SSP: handle(0x004d), sas_addr(0x5000c500ec91bd59), phy(2), device_name(0x5000c500ec91bd58) [ 21.030032] end_device-1:1:16: mpt3sas_transport_port_add: added: handle(0x0076), sas_addr(0x5000c500ec922b46) [ 21.030129] mpt3sas_cm0: detecting: handle(0x0077), sas_address(0x5000c500ec922b4a), phy(17) [ 21.030132] mpt3sas_cm0: REPORT_LUNS: handle(0x0077), retries(0) [ 21.031491] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0077), lun(0) [ 21.032531] mpt3sas_cm0: handle(0x77) sas_address(0x5000c500ec922b4a) port_type(0x1) [ 21.037123] scsi 1:0:42:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 21.039434] scsi 1:0:42:0: SSP: handle(0x0077), sas_addr(0x5000c500ec922b4a), phy(17), device_name(0x5000c500ec922b48) [ 21.039436] scsi 1:0:42:0: enclosure logical id(0x500c0ff0f6f3a63c), slot(17) [ 21.039437] scsi 1:0:42:0: enclosure level(0x0000), connector name( C0 ) [ 21.039437] scsi 1:0:42:0: serial_number(HWL0310R0000822150Z3) [ 21.039439] scsi 1:0:42:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 21.125352] scsi 10:0:52:0: enclosure logical id(0x500c0ff0f6f3a63c), slot(2) [ 21.132570] scsi 10:0:52:0: enclosure level(0x0000), connector name( C3 ) [ 21.139448] scsi 10:0:52:0: serial_number(HWL031FR0000822150Z3) [ 21.145365] scsi 10:0:52:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 21.171020] end_device-1:1:17: mpt3sas_transport_port_add: added: handle(0x0077), sas_addr(0x5000c500ec922b4a) [ 21.181186] mpt3sas_cm0: detecting: handle(0x0078), sas_address(0x5000c500ec91bdd6), phy(18) [ 21.189617] mpt3sas_cm0: REPORT_LUNS: handle(0x0078), retries(0) [ 21.196972] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0078), lun(0) [ 21.198001] end_device-10:2:2: mpt3sas_transport_port_add: added: handle(0x004d), sas_addr(0x5000c500ec91bd59) [ 21.202038] scsi 10:0:53:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 21.204364] scsi 10:0:53:0: SSP: handle(0x004e), sas_addr(0x5000c500ec919e95), phy(3), device_name(0x5000c500ec919e94) [ 21.204365] scsi 10:0:53:0: enclosure logical id(0x500c0ff0f6f3a63c), slot(3) [ 21.204367] scsi 10:0:53:0: enclosure level(0x0000), connector name( C3 ) [ 21.204369] scsi 10:0:53:0: serial_number(HWL031DQ0000822150Z3) [ 21.204371] scsi 10:0:53:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 21.261128] mpt3sas_cm0: handle(0x78) sas_address(0x5000c500ec91bdd6) port_type(0x1) [ 21.272988] scsi 1:0:43:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 21.282526] scsi 1:0:43:0: SSP: handle(0x0078), sas_addr(0x5000c500ec91bdd6), phy(18), device_name(0x5000c500ec91bdd4) [ 21.284040] end_device-10:2:3: mpt3sas_transport_port_add: added: handle(0x004e), sas_addr(0x5000c500ec919e95) [ 21.288313] scsi 10:0:54:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 21.290643] scsi 10:0:54:0: SSP: handle(0x004f), sas_addr(0x5000c500ec922ba1), phy(4), device_name(0x5000c500ec922ba0) [ 21.290645] scsi 10:0:54:0: enclosure logical id(0x500c0ff0f6f3a63c), slot(4) [ 21.290646] scsi 10:0:54:0: enclosure level(0x0000), connector name( C3 ) [ 21.290647] scsi 10:0:54:0: serial_number(HWL031990000822150Z3) [ 21.290649] scsi 10:0:54:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 21.351230] scsi 1:0:43:0: enclosure logical id(0x500c0ff0f6f3a63c), slot(18) [ 21.358450] scsi 1:0:43:0: enclosure level(0x0000), connector name( C0 ) [ 21.365248] scsi 1:0:43:0: serial_number(HWL031E90000822150Z3) [ 21.371079] scsi 1:0:43:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 21.392999] end_device-10:2:4: mpt3sas_transport_port_add: added: handle(0x004f), sas_addr(0x5000c500ec922ba1) [ 21.406945] scsi 10:0:55:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 21.408013] end_device-1:1:18: mpt3sas_transport_port_add: added: handle(0x0078), sas_addr(0x5000c500ec91bdd6) [ 21.408103] mpt3sas_cm0: detecting: handle(0x0079), sas_address(0x5000c500ec91bd52), phy(19) [ 21.408108] mpt3sas_cm0: REPORT_LUNS: handle(0x0079), retries(0) [ 21.409457] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0079), lun(0) [ 21.410507] mpt3sas_cm0: handle(0x79) sas_address(0x5000c500ec91bd52) port_type(0x1) [ 21.415092] scsi 1:0:44:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 21.417397] scsi 1:0:44:0: SSP: handle(0x0079), sas_addr(0x5000c500ec91bd52), phy(19), device_name(0x5000c500ec91bd50) [ 21.417399] scsi 1:0:44:0: enclosure logical id(0x500c0ff0f6f3a63c), slot(19) [ 21.417401] scsi 1:0:44:0: enclosure level(0x0000), connector name( C0 ) [ 21.417402] scsi 1:0:44:0: serial_number(HWL030XB0000822150Z3) [ 21.417404] scsi 1:0:44:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 21.502458] scsi 10:0:55:0: SSP: handle(0x0050), sas_addr(0x5000c500ec922b6d), phy(5), device_name(0x5000c500ec922b6c) [ 21.513145] scsi 10:0:55:0: enclosure logical id(0x500c0ff0f6f3a63c), slot(5) [ 21.520364] scsi 10:0:55:0: enclosure level(0x0000), connector name( C3 ) [ 21.527242] scsi 10:0:55:0: serial_number(HWL031270000822150Z3) [ 21.533167] scsi 10:0:55:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 21.552000] end_device-1:1:19: mpt3sas_transport_port_add: added: handle(0x0079), sas_addr(0x5000c500ec91bd52) [ 21.562163] mpt3sas_cm0: detecting: handle(0x007a), sas_address(0x5000c500ec91bd26), phy(20) [ 21.570603] mpt3sas_cm0: REPORT_LUNS: handle(0x007a), retries(0) [ 21.577968] mpt3sas_cm0: TEST_UNIT_READY: handle(0x007a), lun(0) [ 21.584063] mpt3sas_cm0: handle(0x7a) sas_address(0x5000c500ec91bd26) port_type(0x1) [ 21.587024] end_device-10:2:5: mpt3sas_transport_port_add: added: handle(0x0050), sas_addr(0x5000c500ec922b6d) [ 21.590965] scsi 10:0:56:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 21.593276] scsi 10:0:56:0: SSP: handle(0x0051), sas_addr(0x5000c500ec922bf5), phy(6), device_name(0x5000c500ec922bf4) [ 21.593278] scsi 10:0:56:0: enclosure logical id(0x500c0ff0f6f3a63c), slot(6) [ 21.593279] scsi 10:0:56:0: enclosure level(0x0000), connector name( C3 ) [ 21.593280] scsi 10:0:56:0: serial_number(HWL031KV0000822150Z3) [ 21.593282] scsi 10:0:56:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 21.653978] scsi 1:0:45:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 21.663504] scsi 1:0:45:0: SSP: handle(0x007a), sas_addr(0x5000c500ec91bd26), phy(20), device_name(0x5000c500ec91bd24) [ 21.674190] scsi 1:0:45:0: enclosure logical id(0x500c0ff0f6f3a63c), slot(20) [ 21.681409] scsi 1:0:45:0: enclosure level(0x0000), connector name( C0 ) [ 21.688210] scsi 1:0:45:0: serial_number(HWL030X80000822150Z3) [ 21.694043] scsi 1:0:45:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 21.705992] end_device-10:2:6: mpt3sas_transport_port_add: added: handle(0x0051), sas_addr(0x5000c500ec922bf5) [ 21.720102] scsi 10:0:57:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 21.729702] scsi 10:0:57:0: SSP: handle(0x0052), sas_addr(0x5000c500ec922b4d), phy(7), device_name(0x5000c500ec922b4c) [ 21.740386] scsi 10:0:57:0: enclosure logical id(0x500c0ff0f6f3a63c), slot(7) [ 21.747603] scsi 10:0:57:0: enclosure level(0x0000), connector name( C3 ) [ 21.754484] scsi 10:0:57:0: serial_number(HWL030XV0000822150Z3) [ 21.760406] scsi 10:0:57:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 21.771993] end_device-1:1:20: mpt3sas_transport_port_add: added: handle(0x007a), sas_addr(0x5000c500ec91bd26) [ 21.782154] mpt3sas_cm0: detecting: handle(0x007b), sas_address(0x5000c500ec91bd6a), phy(21) [ 21.790595] mpt3sas_cm0: REPORT_LUNS: handle(0x007b), retries(0) [ 21.798001] mpt3sas_cm0: TEST_UNIT_READY: handle(0x007b), lun(0) [ 21.804093] mpt3sas_cm0: handle(0x7b) sas_address(0x5000c500ec91bd6a) port_type(0x1) [ 21.814979] end_device-10:2:7: mpt3sas_transport_port_add: added: handle(0x0052), sas_addr(0x5000c500ec922b4d) [ 21.816050] scsi 1:0:46:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 21.818353] scsi 1:0:46:0: SSP: handle(0x007b), sas_addr(0x5000c500ec91bd6a), phy(21), device_name(0x5000c500ec91bd68) [ 21.818355] scsi 1:0:46:0: enclosure logical id(0x500c0ff0f6f3a63c), slot(21) [ 21.818357] scsi 1:0:46:0: enclosure level(0x0000), connector name( C0 ) [ 21.818358] scsi 1:0:46:0: serial_number(HWL031370000822150Z3) [ 21.818360] scsi 1:0:46:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 21.876772] scsi 10:0:58:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 21.886427] scsi 10:0:58:0: SSP: handle(0x0053), sas_addr(0x5000c500ec922bf1), phy(8), device_name(0x5000c500ec922bf0) [ 21.897108] scsi 10:0:58:0: enclosure logical id(0x500c0ff0f6f3a63c), slot(8) [ 21.904326] scsi 10:0:58:0: enclosure level(0x0000), connector name( C3 ) [ 21.911206] scsi 10:0:58:0: serial_number(HWL0317Q0000822150Z3) [ 21.917119] scsi 10:0:58:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 21.931992] end_device-1:1:21: mpt3sas_transport_port_add: added: handle(0x007b), sas_addr(0x5000c500ec91bd6a) [ 21.942793] mpt3sas_cm0: detecting: handle(0x007c), sas_address(0x5000c500ec919eaa), phy(22) [ 21.951230] mpt3sas_cm0: REPORT_LUNS: handle(0x007c), retries(0) [ 21.958595] mpt3sas_cm0: TEST_UNIT_READY: handle(0x007c), lun(0) [ 21.964681] mpt3sas_cm0: handle(0x7c) sas_address(0x5000c500ec919eaa) port_type(0x1) [ 21.974966] end_device-10:2:8: mpt3sas_transport_port_add: added: handle(0x0053), sas_addr(0x5000c500ec922bf1) [ 21.976465] scsi 1:0:47:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 21.979022] scsi 1:0:47:0: SSP: handle(0x007c), sas_addr(0x5000c500ec919eaa), phy(22), device_name(0x5000c500ec919ea8) [ 21.979024] scsi 1:0:47:0: enclosure logical id(0x500c0ff0f6f3a63c), slot(22) [ 21.979026] scsi 1:0:47:0: enclosure level(0x0000), connector name( C0 ) [ 21.979027] scsi 1:0:47:0: serial_number(HWL0310G0000822150Z3) [ 21.979029] scsi 1:0:47:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 22.036735] scsi 10:0:59:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 22.046336] scsi 10:0:59:0: SSP: handle(0x0054), sas_addr(0x5000c500ec922bb9), phy(9), device_name(0x5000c500ec922bb8) [ 22.057020] scsi 10:0:59:0: enclosure logical id(0x500c0ff0f6f3a63c), slot(9) [ 22.064238] scsi 10:0:59:0: enclosure level(0x0000), connector name( C3 ) [ 22.071119] scsi 10:0:59:0: serial_number(HWL031FZ0000822150Z3) [ 22.077040] scsi 10:0:59:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 22.088986] end_device-1:1:22: mpt3sas_transport_port_add: added: handle(0x007c), sas_addr(0x5000c500ec919eaa) [ 22.099147] mpt3sas_cm0: detecting: handle(0x007d), sas_address(0x5000c500ec91bd96), phy(23) [ 22.107587] mpt3sas_cm0: REPORT_LUNS: handle(0x007d), retries(0) [ 22.114949] mpt3sas_cm0: TEST_UNIT_READY: handle(0x007d), lun(0) [ 22.121027] mpt3sas_cm0: handle(0x7d) sas_address(0x5000c500ec91bd96) port_type(0x1) [ 22.131959] end_device-10:2:9: mpt3sas_transport_port_add: added: handle(0x0054), sas_addr(0x5000c500ec922bb9) [ 22.132856] scsi 1:0:48:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 22.135166] scsi 1:0:48:0: SSP: handle(0x007d), sas_addr(0x5000c500ec91bd96), phy(23), device_name(0x5000c500ec91bd94) [ 22.135168] scsi 1:0:48:0: enclosure logical id(0x500c0ff0f6f3a63c), slot(23) [ 22.135169] scsi 1:0:48:0: enclosure level(0x0000), connector name( C0 ) [ 22.135170] scsi 1:0:48:0: serial_number(HWL0315L0000822150Z3) [ 22.135173] scsi 1:0:48:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 22.193687] scsi 10:0:60:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 22.203294] scsi 10:0:60:0: SSP: handle(0x0055), sas_addr(0x5000c500ec922c01), phy(10), device_name(0x5000c500ec922c00) [ 22.214062] scsi 10:0:60:0: enclosure logical id(0x500c0ff0f6f3a63c), slot(10) [ 22.221369] scsi 10:0:60:0: enclosure level(0x0000), connector name( C3 ) [ 22.228248] scsi 10:0:60:0: serial_number(HWL031JD0000822150Z3) [ 22.234171] scsi 10:0:60:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 22.248996] end_device-1:1:23: mpt3sas_transport_port_add: added: handle(0x007d), sas_addr(0x5000c500ec91bd96) [ 22.259779] mpt3sas_cm0: detecting: handle(0x007f), sas_address(0x500c0ff00c16f33e), phy(36) [ 22.268217] mpt3sas_cm0: REPORT_LUNS: handle(0x007f), retries(0) [ 22.274946] mpt3sas_cm0: TEST_UNIT_READY: handle(0x007f), lun(0) [ 22.282880] mpt3sas_cm0: handle(0x7f) sas_address(0x500c0ff00c16f33e) port_type(0x1) [ 22.284005] end_device-10:2:10: mpt3sas_transport_port_add: added: handle(0x0055), sas_addr(0x5000c500ec922c01) [ 22.287861] scsi 10:0:61:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 22.290191] scsi 10:0:61:0: SSP: handle(0x0056), sas_addr(0x5000c500ec922be5), phy(11), device_name(0x5000c500ec922be4) [ 22.290193] scsi 10:0:61:0: enclosure logical id(0x500c0ff0f6f3a63c), slot(11) [ 22.290194] scsi 10:0:61:0: enclosure level(0x0000), connector name( C3 ) [ 22.290195] scsi 10:0:61:0: serial_number(HWL0317P0000822150Z3) [ 22.290197] scsi 10:0:61:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 22.350342] scsi 1:0:49:0: Enclosure SEAGATE SP-3224A-E12EBD 52B7 PQ: 0 ANSI: 6 [ 22.361208] scsi 1:0:49:0: set ignore_delay_remove for handle(0x007f) [ 22.367648] scsi 1:0:49:0: SES: handle(0x007f), sas_addr(0x500c0ff00c16f33e), phy(36), device_name(0x500c0ff0f6f3a63c) [ 22.378333] scsi 1:0:49:0: enclosure logical id(0x500c0ff0f6f3a63c), slot(24) [ 22.385554] scsi 1:0:49:0: enclosure level(0x0000), connector name( C0 ) [ 22.392351] scsi 1:0:49:0: serial_number(SGFGD2338F6F3A6) [ 22.397750] scsi 1:0:49:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 22.412942] end_device-10:2:11: mpt3sas_transport_port_add: added: handle(0x0056), sas_addr(0x5000c500ec922be5) [ 22.427224] scsi 10:0:62:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 22.436829] scsi 10:0:62:0: SSP: handle(0x0057), sas_addr(0x5000c500ec922bc1), phy(12), device_name(0x5000c500ec922bc0) [ 22.437191] end_device-1:1:24: mpt3sas_transport_port_add: added: handle(0x007f), sas_addr(0x500c0ff00c16f33e) [ 22.437915] mpt3sas_cm0: expander_add: handle(0x004a), parent(0x0009), sas_addr(0x500c0ff00c16db3f), phys(37) [ 22.438270] expander-1:2: mpt3sas_transport_port_add: added: handle(0x004a), sas_addr(0x500c0ff00c16db3f) [ 22.445792] mpt3sas_cm0: detecting: handle(0x004b), sas_address(0x5000c500ec95a696), phy(0) [ 22.445795] mpt3sas_cm0: REPORT_LUNS: handle(0x004b), retries(0) [ 22.447144] mpt3sas_cm0: TEST_UNIT_READY: handle(0x004b), lun(0) [ 22.448177] mpt3sas_cm0: handle(0x4b) sas_address(0x5000c500ec95a696) port_type(0x1) [ 22.452790] scsi 1:0:50:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 22.455104] scsi 1:0:50:0: SSP: handle(0x004b), sas_addr(0x5000c500ec95a696), phy(0), device_name(0x5000c500ec95a694) [ 22.455106] scsi 1:0:50:0: enclosure logical id(0x500c0ff0f6f2153c), slot(0) [ 22.455107] scsi 1:0:50:0: enclosure level(0x0000), connector name( C3 ) [ 22.455107] scsi 1:0:50:0: serial_number(HWL031ZX0000822150Z3) [ 22.455109] scsi 1:0:50:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 22.552779] scsi 10:0:62:0: enclosure logical id(0x500c0ff0f6f3a63c), slot(12) [ 22.560085] scsi 10:0:62:0: enclosure level(0x0000), connector name( C3 ) [ 22.566969] scsi 10:0:62:0: serial_number(HWL030X10000822150Z3) [ 22.572888] scsi 10:0:62:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 22.600009] end_device-1:2:0: mpt3sas_transport_port_add: added: handle(0x004b), sas_addr(0x5000c500ec95a696) [ 22.610094] mpt3sas_cm0: detecting: handle(0x004c), sas_address(0x5000c500ec955f76), phy(1) [ 22.618445] mpt3sas_cm0: REPORT_LUNS: handle(0x004c), retries(0) [ 22.625804] mpt3sas_cm0: TEST_UNIT_READY: handle(0x004c), lun(0) [ 22.626945] end_device-10:2:12: mpt3sas_transport_port_add: added: handle(0x0057), sas_addr(0x5000c500ec922bc1) [ 22.631063] scsi 10:0:63:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 22.633373] scsi 10:0:63:0: SSP: handle(0x0058), sas_addr(0x5000c500ec922bcd), phy(13), device_name(0x5000c500ec922bcc) [ 22.633375] scsi 10:0:63:0: enclosure logical id(0x500c0ff0f6f3a63c), slot(13) [ 22.633376] scsi 10:0:63:0: enclosure level(0x0000), connector name( C3 ) [ 22.633376] scsi 10:0:63:0: serial_number(HWL031GX0000822150Z3) [ 22.633378] scsi 10:0:63:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 22.690236] mpt3sas_cm0: handle(0x4c) sas_address(0x5000c500ec955f76) port_type(0x1) [ 22.702278] scsi 1:0:51:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 22.711801] scsi 1:0:51:0: SSP: handle(0x004c), sas_addr(0x5000c500ec955f76), phy(1), device_name(0x5000c500ec955f74) [ 22.722398] scsi 1:0:51:0: enclosure logical id(0x500c0ff0f6f2153c), slot(1) [ 22.729530] scsi 1:0:51:0: enclosure level(0x0000), connector name( C3 ) [ 22.736325] scsi 1:0:51:0: serial_number(HWL031FQ0000822150Z3) [ 22.742158] scsi 1:0:51:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 22.753912] end_device-10:2:13: mpt3sas_transport_port_add: added: handle(0x0058), sas_addr(0x5000c500ec922bcd) [ 22.768082] scsi 10:0:64:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 22.777980] scsi 10:0:64:0: SSP: handle(0x0059), sas_addr(0x5000c500ec922bed), phy(14), device_name(0x5000c500ec922bec) [ 22.788747] scsi 10:0:64:0: enclosure logical id(0x500c0ff0f6f3a63c), slot(14) [ 22.796052] scsi 10:0:64:0: enclosure level(0x0000), connector name( C3 ) [ 22.802929] scsi 10:0:64:0: serial_number(HWL0311V0000822150Z3) [ 22.808846] scsi 10:0:64:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 22.820939] end_device-1:2:1: mpt3sas_transport_port_add: added: handle(0x004c), sas_addr(0x5000c500ec955f76) [ 22.831026] mpt3sas_cm0: detecting: handle(0x004d), sas_address(0x5000c500ec9567d2), phy(2) [ 22.839373] mpt3sas_cm0: REPORT_LUNS: handle(0x004d), retries(0) [ 22.846724] mpt3sas_cm0: TEST_UNIT_READY: handle(0x004d), lun(0) [ 22.852811] mpt3sas_cm0: handle(0x4d) sas_address(0x5000c500ec9567d2) port_type(0x1) [ 22.862925] end_device-10:2:14: mpt3sas_transport_port_add: added: handle(0x0059), sas_addr(0x5000c500ec922bed) [ 22.864753] scsi 1:0:52:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 22.867063] scsi 1:0:52:0: SSP: handle(0x004d), sas_addr(0x5000c500ec9567d2), phy(2), device_name(0x5000c500ec9567d0) [ 22.867065] scsi 1:0:52:0: enclosure logical id(0x500c0ff0f6f2153c), slot(2) [ 22.867066] scsi 1:0:52:0: enclosure level(0x0000), connector name( C3 ) [ 22.867067] scsi 1:0:52:0: serial_number(HWL031RS0000822150Z3) [ 22.867069] scsi 1:0:52:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 22.924578] scsi 10:0:65:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 22.934170] scsi 10:0:65:0: SSP: handle(0x005a), sas_addr(0x5000c500ec922b91), phy(15), device_name(0x5000c500ec922b90) [ 22.944941] scsi 10:0:65:0: enclosure logical id(0x500c0ff0f6f3a63c), slot(15) [ 22.952247] scsi 10:0:65:0: enclosure level(0x0000), connector name( C3 ) [ 22.959123] scsi 10:0:65:0: serial_number(HWL0318P0000822150Z3) [ 22.965039] scsi 10:0:65:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 22.979920] end_device-1:2:2: mpt3sas_transport_port_add: added: handle(0x004d), sas_addr(0x5000c500ec9567d2) [ 22.989997] mpt3sas_cm0: detecting: handle(0x004e), sas_address(0x5000c500ec915846), phy(3) [ 22.998349] mpt3sas_cm0: REPORT_LUNS: handle(0x004e), retries(0) [ 23.005713] mpt3sas_cm0: TEST_UNIT_READY: handle(0x004e), lun(0) [ 23.011799] mpt3sas_cm0: handle(0x4e) sas_address(0x5000c500ec915846) port_type(0x1) [ 23.021901] end_device-10:2:15: mpt3sas_transport_port_add: added: handle(0x005a), sas_addr(0x5000c500ec922b91) [ 23.023720] scsi 1:0:53:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 23.026028] scsi 1:0:53:0: SSP: handle(0x004e), sas_addr(0x5000c500ec915846), phy(3), device_name(0x5000c500ec915844) [ 23.026031] scsi 1:0:53:0: enclosure logical id(0x500c0ff0f6f2153c), slot(3) [ 23.026032] scsi 1:0:53:0: enclosure level(0x0000), connector name( C3 ) [ 23.026033] scsi 1:0:53:0: serial_number(HWL030V90000822150Z3) [ 23.026035] scsi 1:0:53:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 23.083774] scsi 10:0:66:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 23.093364] scsi 10:0:66:0: SSP: handle(0x005b), sas_addr(0x5000c500ec922b45), phy(16), device_name(0x5000c500ec922b44) [ 23.104131] scsi 10:0:66:0: enclosure logical id(0x500c0ff0f6f3a63c), slot(16) [ 23.111439] scsi 10:0:66:0: enclosure level(0x0000), connector name( C3 ) [ 23.118316] scsi 10:0:66:0: serial_number(HWL0311R0000822150Z3) [ 23.124232] scsi 10:0:66:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 23.135944] end_device-1:2:3: mpt3sas_transport_port_add: added: handle(0x004e), sas_addr(0x5000c500ec915846) [ 23.146023] mpt3sas_cm0: detecting: handle(0x004f), sas_address(0x5000c500ec95684e), phy(4) [ 23.154370] mpt3sas_cm0: REPORT_LUNS: handle(0x004f), retries(0) [ 23.161767] mpt3sas_cm0: TEST_UNIT_READY: handle(0x004f), lun(0) [ 23.167855] mpt3sas_cm0: handle(0x4f) sas_address(0x5000c500ec95684e) port_type(0x1) [ 23.178896] end_device-10:2:16: mpt3sas_transport_port_add: added: handle(0x005b), sas_addr(0x5000c500ec922b45) [ 23.179731] scsi 1:0:54:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 23.182040] scsi 1:0:54:0: SSP: handle(0x004f), sas_addr(0x5000c500ec95684e), phy(4), device_name(0x5000c500ec95684c) [ 23.182041] scsi 1:0:54:0: enclosure logical id(0x500c0ff0f6f2153c), slot(4) [ 23.182043] scsi 1:0:54:0: enclosure level(0x0000), connector name( C3 ) [ 23.182043] scsi 1:0:54:0: serial_number(HWL031V30000822150Z3) [ 23.182045] scsi 1:0:54:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 23.240570] scsi 10:0:67:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 23.250176] scsi 10:0:67:0: SSP: handle(0x005c), sas_addr(0x5000c500ec922b49), phy(17), device_name(0x5000c500ec922b48) [ 23.260952] scsi 10:0:67:0: enclosure logical id(0x500c0ff0f6f3a63c), slot(17) [ 23.268256] scsi 10:0:67:0: enclosure level(0x0000), connector name( C3 ) [ 23.275142] scsi 10:0:67:0: serial_number(HWL0310R0000822150Z3) [ 23.281063] scsi 10:0:67:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 23.298920] end_device-1:2:4: mpt3sas_transport_port_add: added: handle(0x004f), sas_addr(0x5000c500ec95684e) [ 23.309004] mpt3sas_cm0: detecting: handle(0x0050), sas_address(0x5000c500ec9567ca), phy(5) [ 23.317359] mpt3sas_cm0: REPORT_LUNS: handle(0x0050), retries(0) [ 23.324722] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0050), lun(0) [ 23.330804] mpt3sas_cm0: handle(0x50) sas_address(0x5000c500ec9567ca) port_type(0x1) [ 23.333880] end_device-10:2:17: mpt3sas_transport_port_add: added: handle(0x005c), sas_addr(0x5000c500ec922b49) [ 23.337728] scsi 10:0:68:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 23.340043] scsi 10:0:68:0: SSP: handle(0x005d), sas_addr(0x5000c500ec91bdd5), phy(18), device_name(0x5000c500ec91bdd4) [ 23.340044] scsi 10:0:68:0: enclosure logical id(0x500c0ff0f6f3a63c), slot(18) [ 23.340044] scsi 10:0:68:0: enclosure level(0x0000), connector name( C3 ) [ 23.340045] scsi 10:0:68:0: serial_number(HWL031E90000822150Z3) [ 23.340046] scsi 10:0:68:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 23.400911] scsi 1:0:55:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 23.410431] scsi 1:0:55:0: SSP: handle(0x0050), sas_addr(0x5000c500ec9567ca), phy(5), device_name(0x5000c500ec9567c8) [ 23.421029] scsi 1:0:55:0: enclosure logical id(0x500c0ff0f6f2153c), slot(5) [ 23.428159] scsi 1:0:55:0: enclosure level(0x0000), connector name( C3 ) [ 23.434949] scsi 1:0:55:0: serial_number(HWL031NK0000822150Z3) [ 23.440781] scsi 1:0:55:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 23.452893] end_device-10:2:18: mpt3sas_transport_port_add: added: handle(0x005d), sas_addr(0x5000c500ec91bdd5) [ 23.467088] scsi 10:0:69:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 23.476697] scsi 10:0:69:0: SSP: handle(0x005e), sas_addr(0x5000c500ec91bd51), phy(19), device_name(0x5000c500ec91bd50) [ 23.487464] scsi 10:0:69:0: enclosure logical id(0x500c0ff0f6f3a63c), slot(19) [ 23.494771] scsi 10:0:69:0: enclosure level(0x0000), connector name( C3 ) [ 23.501649] scsi 10:0:69:0: serial_number(HWL030XB0000822150Z3) [ 23.507566] scsi 10:0:69:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 23.522904] end_device-1:2:5: mpt3sas_transport_port_add: added: handle(0x0050), sas_addr(0x5000c500ec9567ca) [ 23.532983] mpt3sas_cm0: detecting: handle(0x0051), sas_address(0x5000c500ec9567ce), phy(6) [ 23.541344] mpt3sas_cm0: REPORT_LUNS: handle(0x0051), retries(0) [ 23.548709] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0051), lun(0) [ 23.554799] mpt3sas_cm0: handle(0x51) sas_address(0x5000c500ec9567ce) port_type(0x1) [ 23.565881] end_device-10:2:19: mpt3sas_transport_port_add: added: handle(0x005e), sas_addr(0x5000c500ec91bd51) [ 23.566587] scsi 1:0:56:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 23.568904] scsi 1:0:56:0: SSP: handle(0x0051), sas_addr(0x5000c500ec9567ce), phy(6), device_name(0x5000c500ec9567cc) [ 23.568905] scsi 1:0:56:0: enclosure logical id(0x500c0ff0f6f2153c), slot(6) [ 23.568906] scsi 1:0:56:0: enclosure level(0x0000), connector name( C3 ) [ 23.568906] scsi 1:0:56:0: serial_number(HWL031QC0000822150Z3) [ 23.568908] scsi 1:0:56:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 23.627556] scsi 10:0:70:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 23.637168] scsi 10:0:70:0: SSP: handle(0x005f), sas_addr(0x5000c500ec91bd25), phy(20), device_name(0x5000c500ec91bd24) [ 23.647938] scsi 10:0:70:0: enclosure logical id(0x500c0ff0f6f3a63c), slot(20) [ 23.655245] scsi 10:0:70:0: enclosure level(0x0000), connector name( C3 ) [ 23.662126] scsi 10:0:70:0: serial_number(HWL030X80000822150Z3) [ 23.668049] scsi 10:0:70:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 23.679884] end_device-1:2:6: mpt3sas_transport_port_add: added: handle(0x0051), sas_addr(0x5000c500ec9567ce) [ 23.689962] mpt3sas_cm0: detecting: handle(0x0052), sas_address(0x5000c500ec9567c6), phy(7) [ 23.698315] mpt3sas_cm0: REPORT_LUNS: handle(0x0052), retries(0) [ 23.705669] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0052), lun(0) [ 23.711762] mpt3sas_cm0: handle(0x52) sas_address(0x5000c500ec9567c6) port_type(0x1) [ 23.721874] end_device-10:2:20: mpt3sas_transport_port_add: added: handle(0x005f), sas_addr(0x5000c500ec91bd25) [ 23.723702] scsi 1:0:57:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 23.726008] scsi 1:0:57:0: SSP: handle(0x0052), sas_addr(0x5000c500ec9567c6), phy(7), device_name(0x5000c500ec9567c4) [ 23.726009] scsi 1:0:57:0: enclosure logical id(0x500c0ff0f6f2153c), slot(7) [ 23.726010] scsi 1:0:57:0: enclosure level(0x0000), connector name( C3 ) [ 23.726010] scsi 1:0:57:0: serial_number(HWL031R80000822150Z3) [ 23.726012] scsi 1:0:57:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 23.783656] scsi 10:0:71:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 23.793257] scsi 10:0:71:0: SSP: handle(0x0060), sas_addr(0x5000c500ec91bd69), phy(21), device_name(0x5000c500ec91bd68) [ 23.804029] scsi 10:0:71:0: enclosure logical id(0x500c0ff0f6f3a63c), slot(21) [ 23.811335] scsi 10:0:71:0: enclosure level(0x0000), connector name( C3 ) [ 23.818221] scsi 10:0:71:0: serial_number(HWL031370000822150Z3) [ 23.824137] scsi 10:0:71:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 23.835871] end_device-1:2:7: mpt3sas_transport_port_add: added: handle(0x0052), sas_addr(0x5000c500ec9567c6) [ 23.845949] mpt3sas_cm0: detecting: handle(0x0053), sas_address(0x5000c500ec923262), phy(8) [ 23.854307] mpt3sas_cm0: REPORT_LUNS: handle(0x0053), retries(0) [ 23.861666] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0053), lun(0) [ 23.867750] mpt3sas_cm0: handle(0x53) sas_address(0x5000c500ec923262) port_type(0x1) [ 23.877863] end_device-10:2:21: mpt3sas_transport_port_add: added: handle(0x0060), sas_addr(0x5000c500ec91bd69) [ 23.879565] scsi 1:0:58:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 23.881876] scsi 1:0:58:0: SSP: handle(0x0053), sas_addr(0x5000c500ec923262), phy(8), device_name(0x5000c500ec923260) [ 23.881878] scsi 1:0:58:0: enclosure logical id(0x500c0ff0f6f2153c), slot(8) [ 23.881879] scsi 1:0:58:0: enclosure level(0x0000), connector name( C3 ) [ 23.881880] scsi 1:0:58:0: serial_number(HWL031GT0000822150Z3) [ 23.881882] scsi 1:0:58:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 23.939525] scsi 10:0:72:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 23.949125] scsi 10:0:72:0: SSP: handle(0x0061), sas_addr(0x5000c500ec919ea9), phy(22), device_name(0x5000c500ec919ea8) [ 23.959894] scsi 10:0:72:0: enclosure logical id(0x500c0ff0f6f3a63c), slot(22) [ 23.967199] scsi 10:0:72:0: enclosure level(0x0000), connector name( C3 ) [ 23.974075] scsi 10:0:72:0: serial_number(HWL0310G0000822150Z3) [ 23.979994] scsi 10:0:72:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 23.994873] end_device-1:2:8: mpt3sas_transport_port_add: added: handle(0x0053), sas_addr(0x5000c500ec923262) [ 24.004948] mpt3sas_cm0: detecting: handle(0x0054), sas_address(0x5000c500ec9156b2), phy(9) [ 24.013304] mpt3sas_cm0: REPORT_LUNS: handle(0x0054), retries(0) [ 24.020662] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0054), lun(0) [ 24.026754] mpt3sas_cm0: handle(0x54) sas_address(0x5000c500ec9156b2) port_type(0x1) [ 24.037856] end_device-10:2:22: mpt3sas_transport_port_add: added: handle(0x0061), sas_addr(0x5000c500ec919ea9) [ 24.038620] scsi 1:0:59:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 24.040938] scsi 1:0:59:0: SSP: handle(0x0054), sas_addr(0x5000c500ec9156b2), phy(9), device_name(0x5000c500ec9156b0) [ 24.040940] scsi 1:0:59:0: enclosure logical id(0x500c0ff0f6f2153c), slot(9) [ 24.040942] scsi 1:0:59:0: enclosure level(0x0000), connector name( C3 ) [ 24.040943] scsi 1:0:59:0: serial_number(HWL031CA0000822150Z3) [ 24.040945] scsi 1:0:59:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 24.099652] scsi 10:0:73:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 24.109252] scsi 10:0:73:0: SSP: handle(0x0062), sas_addr(0x5000c500ec91bd95), phy(23), device_name(0x5000c500ec91bd94) [ 24.120022] scsi 10:0:73:0: enclosure logical id(0x500c0ff0f6f3a63c), slot(23) [ 24.127328] scsi 10:0:73:0: enclosure level(0x0000), connector name( C3 ) [ 24.134207] scsi 10:0:73:0: serial_number(HWL0315L0000822150Z3) [ 24.140121] scsi 10:0:73:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 24.154853] end_device-1:2:9: mpt3sas_transport_port_add: added: handle(0x0054), sas_addr(0x5000c500ec9156b2) [ 24.164922] mpt3sas_cm0: detecting: handle(0x0055), sas_address(0x5000c500ec952ae2), phy(10) [ 24.173365] mpt3sas_cm0: REPORT_LUNS: handle(0x0055), retries(0) [ 24.180720] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0055), lun(0) [ 24.186806] mpt3sas_cm0: handle(0x55) sas_address(0x5000c500ec952ae2) port_type(0x1) [ 24.197850] end_device-10:2:23: mpt3sas_transport_port_add: added: handle(0x0062), sas_addr(0x5000c500ec91bd95) [ 24.198763] scsi 1:0:60:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 24.201066] scsi 1:0:60:0: SSP: handle(0x0055), sas_addr(0x5000c500ec952ae2), phy(10), device_name(0x5000c500ec952ae0) [ 24.201067] scsi 1:0:60:0: enclosure logical id(0x500c0ff0f6f2153c), slot(10) [ 24.201069] scsi 1:0:60:0: enclosure level(0x0000), connector name( C3 ) [ 24.201070] scsi 1:0:60:0: serial_number(HWL030MH0000822150Z3) [ 24.201071] scsi 1:0:60:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 24.258347] scsi 10:0:74:0: Enclosure SEAGATE SP-3224A-E12EBD 52B7 PQ: 0 ANSI: 6 [ 24.267058] scsi 10:0:74:0: set ignore_delay_remove for handle(0x0064) [ 24.273583] scsi 10:0:74:0: SES: handle(0x0064), sas_addr(0x500c0ff00c17833e), phy(36), device_name(0x500c0ff0f6f3a63c) [ 24.284355] scsi 10:0:74:0: enclosure logical id(0x500c0ff0f6f3a63c), slot(24) [ 24.291661] scsi 10:0:74:0: enclosure level(0x0000), connector name( C3 ) [ 24.298536] scsi 10:0:74:0: serial_number(SGFGD2338F6F3A6) [ 24.304021] scsi 10:0:74:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 24.318847] end_device-1:2:10: mpt3sas_transport_port_add: added: handle(0x0055), sas_addr(0x5000c500ec952ae2) [ 24.329010] mpt3sas_cm0: detecting: handle(0x0056), sas_address(0x5000c500ec95682e), phy(11) [ 24.337452] mpt3sas_cm0: REPORT_LUNS: handle(0x0056), retries(0) [ 24.344798] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0056), lun(0) [ 24.350884] mpt3sas_cm0: handle(0x56) sas_address(0x5000c500ec95682e) port_type(0x1) [ 24.353036] end_device-10:2:24: mpt3sas_transport_port_add: added: handle(0x0064), sas_addr(0x500c0ff00c17833e) [ 24.357001] scsi 10:0:75:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 24.359310] scsi 10:0:75:0: SSP: handle(0x0081), sas_addr(0x5000c500ec922bb1), phy(0), device_name(0x5000c500ec922bb0) [ 24.359311] scsi 10:0:75:0: enclosure logical id(0x500c0ff0f6f4a33c), slot(0) [ 24.359313] scsi 10:0:75:0: enclosure level(0x0000), connector name( C2 ) [ 24.359314] scsi 10:0:75:0: serial_number(HWL031EA0000822150Z3) [ 24.359316] scsi 10:0:75:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 24.420936] scsi 1:0:61:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 24.430512] scsi 1:0:61:0: SSP: handle(0x0056), sas_addr(0x5000c500ec95682e), phy(11), device_name(0x5000c500ec95682c) [ 24.441197] scsi 1:0:61:0: enclosure logical id(0x500c0ff0f6f2153c), slot(11) [ 24.448415] scsi 1:0:61:0: enclosure level(0x0000), connector name( C3 ) [ 24.455205] scsi 1:0:61:0: serial_number(HWL031TN0000822150Z3) [ 24.461038] scsi 1:0:61:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 24.472817] end_device-10:3:0: mpt3sas_transport_port_add: added: handle(0x0081), sas_addr(0x5000c500ec922bb1) [ 24.486993] scsi 10:0:76:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 24.496606] scsi 10:0:76:0: SSP: handle(0x0082), sas_addr(0x5000c500ec922b89), phy(1), device_name(0x5000c500ec922b88) [ 24.507287] scsi 10:0:76:0: enclosure logical id(0x500c0ff0f6f4a33c), slot(1) [ 24.514506] scsi 10:0:76:0: enclosure level(0x0000), connector name( C2 ) [ 24.521387] scsi 10:0:76:0: serial_number(HWL031HD0000822150Z3) [ 24.527309] scsi 10:0:76:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 24.541833] end_device-1:2:11: mpt3sas_transport_port_add: added: handle(0x0056), sas_addr(0x5000c500ec95682e) [ 24.552007] mpt3sas_cm0: detecting: handle(0x0057), sas_address(0x5000c500ec95a576), phy(12) [ 24.560444] mpt3sas_cm0: REPORT_LUNS: handle(0x0057), retries(0) [ 24.567804] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0057), lun(0) [ 24.573895] mpt3sas_cm0: handle(0x57) sas_address(0x5000c500ec95a576) port_type(0x1) [ 24.586071] scsi 1:0:62:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 24.587808] end_device-10:3:1: mpt3sas_transport_port_add: added: handle(0x0082), sas_addr(0x5000c500ec922b89) [ 24.591839] scsi 10:0:77:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 24.594160] scsi 10:0:77:0: SSP: handle(0x0083), sas_addr(0x5000c500ec922b99), phy(2), device_name(0x5000c500ec922b98) [ 24.594162] scsi 10:0:77:0: enclosure logical id(0x500c0ff0f6f4a33c), slot(2) [ 24.594163] scsi 10:0:77:0: enclosure level(0x0000), connector name( C2 ) [ 24.594164] scsi 10:0:77:0: serial_number(HWL031F40000822150Z3) [ 24.594166] scsi 10:0:77:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 24.653661] scsi 1:0:62:0: SSP: handle(0x0057), sas_addr(0x5000c500ec95a576), phy(12), device_name(0x5000c500ec95a574) [ 24.664349] scsi 1:0:62:0: enclosure logical id(0x500c0ff0f6f2153c), slot(12) [ 24.671566] scsi 1:0:62:0: enclosure level(0x0000), connector name( C3 ) [ 24.678364] scsi 1:0:62:0: serial_number(HWL031Z40000822150Z3) [ 24.684197] scsi 1:0:62:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 24.701809] end_device-10:3:2: mpt3sas_transport_port_add: added: handle(0x0083), sas_addr(0x5000c500ec922b99) [ 24.715776] scsi 10:0:78:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 24.725384] scsi 10:0:78:0: SSP: handle(0x0084), sas_addr(0x5000c500ec922b75), phy(3), device_name(0x5000c500ec922b74) [ 24.736071] scsi 10:0:78:0: enclosure logical id(0x500c0ff0f6f4a33c), slot(3) [ 24.743289] scsi 10:0:78:0: enclosure level(0x0000), connector name( C2 ) [ 24.750168] scsi 10:0:78:0: serial_number(HWL030TD0000822150Z3) [ 24.756083] scsi 10:0:78:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 24.767795] end_device-1:2:12: mpt3sas_transport_port_add: added: handle(0x0057), sas_addr(0x5000c500ec95a576) [ 24.777952] mpt3sas_cm0: detecting: handle(0x0058), sas_address(0x5000c500ec95a642), phy(13) [ 24.786390] mpt3sas_cm0: REPORT_LUNS: handle(0x0058), retries(0) [ 24.793738] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0058), lun(0) [ 24.799823] mpt3sas_cm0: handle(0x58) sas_address(0x5000c500ec95a642) port_type(0x1) [ 24.811796] scsi 1:0:63:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 24.813831] end_device-10:3:3: mpt3sas_transport_port_add: added: handle(0x0084), sas_addr(0x5000c500ec922b75) [ 24.817865] scsi 10:0:79:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 24.820174] scsi 10:0:79:0: SSP: handle(0x0085), sas_addr(0x5000c500ec922bfd), phy(4), device_name(0x5000c500ec922bfc) [ 24.820175] scsi 10:0:79:0: enclosure logical id(0x500c0ff0f6f4a33c), slot(4) [ 24.820177] scsi 10:0:79:0: enclosure level(0x0000), connector name( C2 ) [ 24.820178] scsi 10:0:79:0: serial_number(HWL0314V0000822150Z3) [ 24.820179] scsi 10:0:79:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 24.879397] scsi 1:0:63:0: SSP: handle(0x0058), sas_addr(0x5000c500ec95a642), phy(13), device_name(0x5000c500ec95a640) [ 24.890082] scsi 1:0:63:0: enclosure logical id(0x500c0ff0f6f2153c), slot(13) [ 24.897299] scsi 1:0:63:0: enclosure level(0x0000), connector name( C3 ) [ 24.904103] scsi 1:0:63:0: serial_number(HWL031Y80000822150Z3) [ 24.909939] scsi 1:0:63:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 24.930834] end_device-10:3:4: mpt3sas_transport_port_add: added: handle(0x0085), sas_addr(0x5000c500ec922bfd) [ 24.944821] scsi 10:0:80:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 24.954433] scsi 10:0:80:0: SSP: handle(0x0086), sas_addr(0x5000c500ec922b51), phy(5), device_name(0x5000c500ec922b50) [ 24.955813] end_device-1:2:13: mpt3sas_transport_port_add: added: handle(0x0058), sas_addr(0x5000c500ec95a642) [ 24.955909] mpt3sas_cm0: detecting: handle(0x0059), sas_address(0x5000c500ec95a6f6), phy(14) [ 24.955913] mpt3sas_cm0: REPORT_LUNS: handle(0x0059), retries(0) [ 24.957255] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0059), lun(0) [ 24.958301] mpt3sas_cm0: handle(0x59) sas_address(0x5000c500ec95a6f6) port_type(0x1) [ 24.962898] scsi 1:0:64:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 24.965226] scsi 1:0:64:0: SSP: handle(0x0059), sas_addr(0x5000c500ec95a6f6), phy(14), device_name(0x5000c500ec95a6f4) [ 24.965228] scsi 1:0:64:0: enclosure logical id(0x500c0ff0f6f2153c), slot(14) [ 24.965230] scsi 1:0:64:0: enclosure level(0x0000), connector name( C3 ) [ 24.965231] scsi 1:0:64:0: serial_number(HWL031WR0000822150Z3) [ 24.965234] scsi 1:0:64:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 25.050974] scsi 10:0:80:0: enclosure logical id(0x500c0ff0f6f4a33c), slot(5) [ 25.058191] scsi 10:0:80:0: enclosure level(0x0000), connector name( C2 ) [ 25.065073] scsi 10:0:80:0: serial_number(HWL0312B0000822150Z3) [ 25.070996] scsi 10:0:80:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 25.095794] end_device-1:2:14: mpt3sas_transport_port_add: added: handle(0x0059), sas_addr(0x5000c500ec95a6f6) [ 25.105980] mpt3sas_cm0: detecting: handle(0x005a), sas_address(0x5000c500ec95a64a), phy(15) [ 25.114419] mpt3sas_cm0: REPORT_LUNS: handle(0x005a), retries(0) [ 25.121781] mpt3sas_cm0: TEST_UNIT_READY: handle(0x005a), lun(0) [ 25.123799] end_device-10:3:5: mpt3sas_transport_port_add: added: handle(0x0086), sas_addr(0x5000c500ec922b51) [ 25.128188] scsi 10:0:81:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 25.130505] scsi 10:0:81:0: SSP: handle(0x0087), sas_addr(0x5000c500ec91bddd), phy(6), device_name(0x5000c500ec91bddc) [ 25.130507] scsi 10:0:81:0: enclosure logical id(0x500c0ff0f6f4a33c), slot(6) [ 25.130508] scsi 10:0:81:0: enclosure level(0x0000), connector name( C2 ) [ 25.130509] scsi 10:0:81:0: serial_number(HWL031EB0000822150Z3) [ 25.130511] scsi 10:0:81:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 25.185913] mpt3sas_cm0: handle(0x5a) sas_address(0x5000c500ec95a64a) port_type(0x1) [ 25.198054] scsi 1:0:65:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 25.207570] scsi 1:0:65:0: SSP: handle(0x005a), sas_addr(0x5000c500ec95a64a), phy(15), device_name(0x5000c500ec95a648) [ 25.208793] end_device-10:3:6: mpt3sas_transport_port_add: added: handle(0x0087), sas_addr(0x5000c500ec91bddd) [ 25.212894] scsi 10:0:82:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 25.215216] scsi 10:0:82:0: SSP: handle(0x0088), sas_addr(0x5000c500ec922b65), phy(7), device_name(0x5000c500ec922b64) [ 25.215218] scsi 10:0:82:0: enclosure logical id(0x500c0ff0f6f4a33c), slot(7) [ 25.215219] scsi 10:0:82:0: enclosure level(0x0000), connector name( C2 ) [ 25.215220] scsi 10:0:82:0: serial_number(HWL031GC0000822150Z3) [ 25.215222] scsi 10:0:82:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 25.276279] scsi 1:0:65:0: enclosure logical id(0x500c0ff0f6f2153c), slot(15) [ 25.283499] scsi 1:0:65:0: enclosure level(0x0000), connector name( C3 ) [ 25.290293] scsi 1:0:65:0: serial_number(HWL031XY0000822150Z3) [ 25.296119] scsi 1:0:65:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 25.316768] end_device-10:3:7: mpt3sas_transport_port_add: added: handle(0x0088), sas_addr(0x5000c500ec922b65) [ 25.331280] scsi 10:0:83:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 25.332783] end_device-1:2:15: mpt3sas_transport_port_add: added: handle(0x005a), sas_addr(0x5000c500ec95a64a) [ 25.332873] mpt3sas_cm0: detecting: handle(0x005b), sas_address(0x5000c500ec955f4e), phy(16) [ 25.332876] mpt3sas_cm0: REPORT_LUNS: handle(0x005b), retries(0) [ 25.334221] mpt3sas_cm0: TEST_UNIT_READY: handle(0x005b), lun(0) [ 25.336290] mpt3sas_cm0: handle(0x5b) sas_address(0x5000c500ec955f4e) port_type(0x1) [ 25.340873] scsi 1:0:66:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 25.343187] scsi 1:0:66:0: SSP: handle(0x005b), sas_addr(0x5000c500ec955f4e), phy(16), device_name(0x5000c500ec955f4c) [ 25.343188] scsi 1:0:66:0: enclosure logical id(0x500c0ff0f6f2153c), slot(16) [ 25.343189] scsi 1:0:66:0: enclosure level(0x0000), connector name( C3 ) [ 25.343189] scsi 1:0:66:0: serial_number(HWL0315N0000822150Z3) [ 25.343191] scsi 1:0:66:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 25.426798] scsi 10:0:83:0: SSP: handle(0x0089), sas_addr(0x5000c500ec91982d), phy(8), device_name(0x5000c500ec91982c) [ 25.437485] scsi 10:0:83:0: enclosure logical id(0x500c0ff0f6f4a33c), slot(8) [ 25.444703] scsi 10:0:83:0: enclosure level(0x0000), connector name( C2 ) [ 25.451588] scsi 10:0:83:0: serial_number(HWL030W10000822150Z3) [ 25.457506] scsi 10:0:83:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 25.476813] end_device-1:2:16: mpt3sas_transport_port_add: added: handle(0x005b), sas_addr(0x5000c500ec955f4e) [ 25.487024] mpt3sas_cm0: detecting: handle(0x005c), sas_address(0x5000c500ec955eda), phy(17) [ 25.495471] mpt3sas_cm0: REPORT_LUNS: handle(0x005c), retries(0) [ 25.502836] mpt3sas_cm0: TEST_UNIT_READY: handle(0x005c), lun(0) [ 25.508931] mpt3sas_cm0: handle(0x5c) sas_address(0x5000c500ec955eda) port_type(0x1) [ 25.511758] end_device-10:3:8: mpt3sas_transport_port_add: added: handle(0x0089), sas_addr(0x5000c500ec91982d) [ 25.515815] scsi 10:0:84:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 25.518146] scsi 10:0:84:0: SSP: handle(0x008a), sas_addr(0x5000c500ec919e99), phy(9), device_name(0x5000c500ec919e98) [ 25.518149] scsi 10:0:84:0: enclosure logical id(0x500c0ff0f6f4a33c), slot(9) [ 25.518150] scsi 10:0:84:0: enclosure level(0x0000), connector name( C2 ) [ 25.518152] scsi 10:0:84:0: serial_number(HWL0314W0000822150Z3) [ 25.518155] scsi 10:0:84:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 25.578907] scsi 1:0:67:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 25.588428] scsi 1:0:67:0: SSP: handle(0x005c), sas_addr(0x5000c500ec955eda), phy(17), device_name(0x5000c500ec955ed8) [ 25.599113] scsi 1:0:67:0: enclosure logical id(0x500c0ff0f6f2153c), slot(17) [ 25.606331] scsi 1:0:67:0: enclosure level(0x0000), connector name( C3 ) [ 25.613126] scsi 1:0:67:0: serial_number(HWL031DW0000822150Z3) [ 25.618960] scsi 1:0:67:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 25.630761] end_device-10:3:9: mpt3sas_transport_port_add: added: handle(0x008a), sas_addr(0x5000c500ec919e99) [ 25.644878] scsi 10:0:85:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 25.654485] scsi 10:0:85:0: SSP: handle(0x008b), sas_addr(0x5000c500ec91bd45), phy(10), device_name(0x5000c500ec91bd44) [ 25.665255] scsi 10:0:85:0: enclosure logical id(0x500c0ff0f6f4a33c), slot(10) [ 25.672559] scsi 10:0:85:0: enclosure level(0x0000), connector name( C2 ) [ 25.679440] scsi 10:0:85:0: serial_number(HWL031260000822150Z3) [ 25.681781] end_device-1:2:17: mpt3sas_transport_port_add: added: handle(0x005c), sas_addr(0x5000c500ec955eda) [ 25.681884] mpt3sas_cm0: detecting: handle(0x005d), sas_address(0x5000c500ec955f72), phy(18) [ 25.681890] mpt3sas_cm0: REPORT_LUNS: handle(0x005d), retries(0) [ 25.683241] mpt3sas_cm0: TEST_UNIT_READY: handle(0x005d), lun(0) [ 25.684288] mpt3sas_cm0: handle(0x5d) sas_address(0x5000c500ec955f72) port_type(0x1) [ 25.688901] scsi 1:0:68:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 25.691187] scsi 1:0:68:0: SSP: handle(0x005d), sas_addr(0x5000c500ec955f72), phy(18), device_name(0x5000c500ec955f70) [ 25.691189] scsi 1:0:68:0: enclosure logical id(0x500c0ff0f6f2153c), slot(18) [ 25.691190] scsi 1:0:68:0: enclosure level(0x0000), connector name( C3 ) [ 25.691191] scsi 1:0:68:0: serial_number(HWL0316M0000822150Z3) [ 25.691193] scsi 1:0:68:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 25.771272] scsi 10:0:85:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 25.792754] end_device-1:2:18: mpt3sas_transport_port_add: added: handle(0x005d), sas_addr(0x5000c500ec955f72) [ 25.802918] mpt3sas_cm0: detecting: handle(0x005e), sas_address(0x5000c500ec955d86), phy(19) [ 25.811362] mpt3sas_cm0: REPORT_LUNS: handle(0x005e), retries(0) [ 25.818712] mpt3sas_cm0: TEST_UNIT_READY: handle(0x005e), lun(0) [ 25.818856] end_device-10:3:10: mpt3sas_transport_port_add: added: handle(0x008b), sas_addr(0x5000c500ec91bd45) [ 25.822962] scsi 10:0:86:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 25.825275] scsi 10:0:86:0: SSP: handle(0x008c), sas_addr(0x5000c500ec919eb1), phy(11), device_name(0x5000c500ec919eb0) [ 25.825277] scsi 10:0:86:0: enclosure logical id(0x500c0ff0f6f4a33c), slot(11) [ 25.825279] scsi 10:0:86:0: enclosure level(0x0000), connector name( C2 ) [ 25.825280] scsi 10:0:86:0: serial_number(HWL0313R0000822150Z3) [ 25.825282] scsi 10:0:86:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 25.883123] mpt3sas_cm0: handle(0x5e) sas_address(0x5000c500ec955d86) port_type(0x1) [ 25.894995] scsi 1:0:69:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 25.904526] scsi 1:0:69:0: SSP: handle(0x005e), sas_addr(0x5000c500ec955d86), phy(19), device_name(0x5000c500ec955d84) [ 25.915208] scsi 1:0:69:0: enclosure logical id(0x500c0ff0f6f2153c), slot(19) [ 25.922428] scsi 1:0:69:0: enclosure level(0x0000), connector name( C3 ) [ 25.929222] scsi 1:0:69:0: serial_number(HWL031GZ0000822150Z3) [ 25.935057] scsi 1:0:69:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 25.946747] end_device-10:3:11: mpt3sas_transport_port_add: added: handle(0x008c), sas_addr(0x5000c500ec919eb1) [ 25.960985] scsi 10:0:87:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 25.970582] scsi 10:0:87:0: SSP: handle(0x008d), sas_addr(0x5000c500ec91bdb5), phy(12), device_name(0x5000c500ec91bdb4) [ 25.981349] scsi 10:0:87:0: enclosure logical id(0x500c0ff0f6f4a33c), slot(12) [ 25.988656] scsi 10:0:87:0: enclosure level(0x0000), connector name( C2 ) [ 25.995536] scsi 10:0:87:0: serial_number(HWL0311W0000822150Z3) [ 25.997751] end_device-1:2:19: mpt3sas_transport_port_add: added: handle(0x005e), sas_addr(0x5000c500ec955d86) [ 25.997848] mpt3sas_cm0: detecting: handle(0x005f), sas_address(0x5000c500ec955ee2), phy(20) [ 25.997853] mpt3sas_cm0: REPORT_LUNS: handle(0x005f), retries(0) [ 25.999198] mpt3sas_cm0: TEST_UNIT_READY: handle(0x005f), lun(0) [ 26.000257] mpt3sas_cm0: handle(0x5f) sas_address(0x5000c500ec955ee2) port_type(0x1) [ 26.004844] scsi 1:0:70:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 26.007160] scsi 1:0:70:0: SSP: handle(0x005f), sas_addr(0x5000c500ec955ee2), phy(20), device_name(0x5000c500ec955ee0) [ 26.007163] scsi 1:0:70:0: enclosure logical id(0x500c0ff0f6f2153c), slot(20) [ 26.007164] scsi 1:0:70:0: enclosure level(0x0000), connector name( C3 ) [ 26.007165] scsi 1:0:70:0: serial_number(HWL031B70000822150Z3) [ 26.007168] scsi 1:0:70:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 26.087367] scsi 10:0:87:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 26.109734] end_device-1:2:20: mpt3sas_transport_port_add: added: handle(0x005f), sas_addr(0x5000c500ec955ee2) [ 26.119903] mpt3sas_cm0: detecting: handle(0x0060), sas_address(0x5000c500ec955f4a), phy(21) [ 26.128338] mpt3sas_cm0: REPORT_LUNS: handle(0x0060), retries(0) [ 26.135706] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0060), lun(0) [ 26.136734] end_device-10:3:12: mpt3sas_transport_port_add: added: handle(0x008d), sas_addr(0x5000c500ec91bdb5) [ 26.140775] scsi 10:0:88:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 26.143084] scsi 10:0:88:0: SSP: handle(0x008e), sas_addr(0x5000c500ec91bdf1), phy(13), device_name(0x5000c500ec91bdf0) [ 26.143085] scsi 10:0:88:0: enclosure logical id(0x500c0ff0f6f4a33c), slot(13) [ 26.143087] scsi 10:0:88:0: enclosure level(0x0000), connector name( C2 ) [ 26.143088] scsi 10:0:88:0: serial_number(HWL0315D0000822150Z3) [ 26.143090] scsi 10:0:88:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 26.200122] mpt3sas_cm0: handle(0x60) sas_address(0x5000c500ec955f4a) port_type(0x1) [ 26.211955] scsi 1:0:71:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 26.221476] scsi 1:0:71:0: SSP: handle(0x0060), sas_addr(0x5000c500ec955f4a), phy(21), device_name(0x5000c500ec955f48) [ 26.223114] end_device-10:3:13: mpt3sas_transport_port_add: added: handle(0x008e), sas_addr(0x5000c500ec91bdf1) [ 26.227332] scsi 10:0:89:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 26.229678] scsi 10:0:89:0: SSP: handle(0x008f), sas_addr(0x5000c500ec8deb3d), phy(14), device_name(0x5000c500ec8deb3c) [ 26.229680] scsi 10:0:89:0: enclosure logical id(0x500c0ff0f6f4a33c), slot(14) [ 26.229682] scsi 10:0:89:0: enclosure level(0x0000), connector name( C2 ) [ 26.229683] scsi 10:0:89:0: serial_number(HWL0305R0000822150Z3) [ 26.229685] scsi 10:0:89:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 26.290463] scsi 1:0:71:0: enclosure logical id(0x500c0ff0f6f2153c), slot(21) [ 26.297682] scsi 1:0:71:0: enclosure level(0x0000), connector name( C3 ) [ 26.304477] scsi 1:0:71:0: serial_number(HWL0316W0000822150Z3) [ 26.310312] scsi 1:0:71:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 26.330705] end_device-10:3:14: mpt3sas_transport_port_add: added: handle(0x008f), sas_addr(0x5000c500ec8deb3d) [ 26.344846] scsi 10:0:90:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 26.354448] scsi 10:0:90:0: SSP: handle(0x0090), sas_addr(0x5000c500ec955d55), phy(15), device_name(0x5000c500ec955d54) [ 26.365217] scsi 10:0:90:0: enclosure logical id(0x500c0ff0f6f4a33c), slot(15) [ 26.372523] scsi 10:0:90:0: enclosure level(0x0000), connector name( C2 ) [ 26.379406] scsi 10:0:90:0: serial_number(HWL031FY0000822150Z3) [ 26.385328] scsi 10:0:90:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 26.397728] end_device-1:2:21: mpt3sas_transport_port_add: added: handle(0x0060), sas_addr(0x5000c500ec955f4a) [ 26.408543] mpt3sas_cm0: detecting: handle(0x0061), sas_address(0x5000c500ec955ec2), phy(22) [ 26.416984] mpt3sas_cm0: REPORT_LUNS: handle(0x0061), retries(0) [ 26.424344] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0061), lun(0) [ 26.430429] mpt3sas_cm0: handle(0x61) sas_address(0x5000c500ec955ec2) port_type(0x1) [ 26.432705] end_device-10:3:15: mpt3sas_transport_port_add: added: handle(0x0090), sas_addr(0x5000c500ec955d55) [ 26.436725] scsi 10:0:91:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 26.439031] scsi 10:0:91:0: SSP: handle(0x0091), sas_addr(0x5000c500ec955f91), phy(16), device_name(0x5000c500ec955f90) [ 26.439032] scsi 10:0:91:0: enclosure logical id(0x500c0ff0f6f4a33c), slot(16) [ 26.439034] scsi 10:0:91:0: enclosure level(0x0000), connector name( C2 ) [ 26.439035] scsi 10:0:91:0: serial_number(HWL0312J0000822150Z3) [ 26.439037] scsi 10:0:91:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 26.501049] scsi 1:0:72:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 26.510568] scsi 1:0:72:0: SSP: handle(0x0061), sas_addr(0x5000c500ec955ec2), phy(22), device_name(0x5000c500ec955ec0) [ 26.521255] scsi 1:0:72:0: enclosure logical id(0x500c0ff0f6f2153c), slot(22) [ 26.528474] scsi 1:0:72:0: enclosure level(0x0000), connector name( C3 ) [ 26.535262] scsi 1:0:72:0: serial_number(HWL031AN0000822150Z3) [ 26.541099] scsi 1:0:72:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 26.556696] end_device-10:3:16: mpt3sas_transport_port_add: added: handle(0x0091), sas_addr(0x5000c500ec955f91) [ 26.570905] scsi 10:0:92:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 26.580507] scsi 10:0:92:0: SSP: handle(0x0092), sas_addr(0x5000c500ec955fa5), phy(17), device_name(0x5000c500ec955fa4) [ 26.591280] scsi 10:0:92:0: enclosure logical id(0x500c0ff0f6f4a33c), slot(17) [ 26.598586] scsi 10:0:92:0: enclosure level(0x0000), connector name( C2 ) [ 26.605467] scsi 10:0:92:0: serial_number(HWL031J00000822150Z3) [ 26.607702] end_device-1:2:22: mpt3sas_transport_port_add: added: handle(0x0061), sas_addr(0x5000c500ec955ec2) [ 26.607778] mpt3sas_cm0: detecting: handle(0x0062), sas_address(0x5000c500ec95a692), phy(23) [ 26.607781] mpt3sas_cm0: REPORT_LUNS: handle(0x0062), retries(0) [ 26.609124] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0062), lun(0) [ 26.610167] mpt3sas_cm0: handle(0x62) sas_address(0x5000c500ec95a692) port_type(0x1) [ 26.615122] scsi 1:0:73:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 26.617429] scsi 1:0:73:0: SSP: handle(0x0062), sas_addr(0x5000c500ec95a692), phy(23), device_name(0x5000c500ec95a690) [ 26.617431] scsi 1:0:73:0: enclosure logical id(0x500c0ff0f6f2153c), slot(23) [ 26.617433] scsi 1:0:73:0: enclosure level(0x0000), connector name( C3 ) [ 26.617434] scsi 1:0:73:0: serial_number(HWL031Y70000822150Z3) [ 26.617437] scsi 1:0:73:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 26.697300] scsi 10:0:92:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 26.718700] end_device-1:2:23: mpt3sas_transport_port_add: added: handle(0x0062), sas_addr(0x5000c500ec95a692) [ 26.729458] mpt3sas_cm0: detecting: handle(0x0064), sas_address(0x500c0ff00c16db3e), phy(36) [ 26.737896] mpt3sas_cm0: REPORT_LUNS: handle(0x0064), retries(0) [ 26.749694] end_device-10:3:17: mpt3sas_transport_port_add: added: handle(0x0092), sas_addr(0x5000c500ec955fa5) [ 26.756642] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0064), lun(0) [ 26.756961] mpt3sas_cm0: handle(0x64) sas_address(0x500c0ff00c16db3e) port_type(0x1) [ 26.773278] scsi 1:0:74:0: Enclosure SEAGATE SP-3224A-E12EBD 52B7 PQ: 0 ANSI: 6 [ 26.776396] scsi 1:0:74:0: set ignore_delay_remove for handle(0x0064) [ 26.776398] scsi 1:0:74:0: SES: handle(0x0064), sas_addr(0x500c0ff00c16db3e), phy(36), device_name(0x500c0ff0f6f2153c) [ 26.776400] scsi 1:0:74:0: enclosure logical id(0x500c0ff0f6f2153c), slot(24) [ 26.776401] scsi 1:0:74:0: enclosure level(0x0000), connector name( C3 ) [ 26.776402] scsi 1:0:74:0: serial_number(SGFGD2338F6F215) [ 26.776405] scsi 1:0:74:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 26.831341] scsi 10:0:93:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 26.841078] scsi 10:0:93:0: SSP: handle(0x0093), sas_addr(0x5000c500ec955e05), phy(18), device_name(0x5000c500ec955e04) [ 26.851850] scsi 10:0:93:0: enclosure logical id(0x500c0ff0f6f4a33c), slot(18) [ 26.859147] scsi 10:0:93:0: enclosure level(0x0000), connector name( C2 ) [ 26.866026] scsi 10:0:93:0: serial_number(HWL0319Y0000822150Z3) [ 26.871944] scsi 10:0:93:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 26.892201] end_device-1:2:24: mpt3sas_transport_port_add: added: handle(0x0064), sas_addr(0x500c0ff00c16db3e) [ 26.903004] mpt3sas_cm0: expander_add: handle(0x0080), parent(0x000a), sas_addr(0x500c0ff00c17443f), phys(37) [ 26.913318] expander-1:3: mpt3sas_transport_port_add: added: handle(0x0080), sas_addr(0x500c0ff00c17443f) [ 26.925894] end_device-10:3:18: mpt3sas_transport_port_add: added: handle(0x0093), sas_addr(0x5000c500ec955e05) [ 26.930852] mpt3sas_cm0: detecting: handle(0x0081), sas_address(0x5000c500ec95a6e2), phy(0) [ 26.930854] mpt3sas_cm0: REPORT_LUNS: handle(0x0081), retries(0) [ 26.932204] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0081), lun(0) [ 26.933248] mpt3sas_cm0: handle(0x81) sas_address(0x5000c500ec95a6e2) port_type(0x1) [ 26.937890] scsi 1:0:75:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 26.940165] scsi 1:0:75:0: SSP: handle(0x0081), sas_addr(0x5000c500ec95a6e2), phy(0), device_name(0x5000c500ec95a6e0) [ 26.940166] scsi 1:0:75:0: enclosure logical id(0x500c0ff0f6f3173c), slot(0) [ 26.940168] scsi 1:0:75:0: enclosure level(0x0000), connector name( C2 ) [ 26.940169] scsi 1:0:75:0: serial_number(HWL031X90000822150Z3) [ 26.940171] scsi 1:0:75:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 27.015840] scsi 10:0:94:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 27.025445] scsi 10:0:94:0: SSP: handle(0x0094), sas_addr(0x5000c500ec955d89), phy(19), device_name(0x5000c500ec955d88) [ 27.036220] scsi 10:0:94:0: enclosure logical id(0x500c0ff0f6f4a33c), slot(19) [ 27.043527] scsi 10:0:94:0: enclosure level(0x0000), connector name( C2 ) [ 27.050412] scsi 10:0:94:0: serial_number(HWL0310H0000822150Z3) [ 27.056334] scsi 10:0:94:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 27.068693] end_device-1:3:0: mpt3sas_transport_port_add: added: handle(0x0081), sas_addr(0x5000c500ec95a6e2) [ 27.078762] mpt3sas_cm0: detecting: handle(0x0082), sas_address(0x5000c500ec95a6f2), phy(1) [ 27.087113] mpt3sas_cm0: REPORT_LUNS: handle(0x0082), retries(0) [ 27.094476] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0082), lun(0) [ 27.100554] mpt3sas_cm0: handle(0x82) sas_address(0x5000c500ec95a6f2) port_type(0x1) [ 27.110685] end_device-10:3:19: mpt3sas_transport_port_add: added: handle(0x0094), sas_addr(0x5000c500ec955d89) [ 27.112390] scsi 1:0:76:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 27.114703] scsi 1:0:76:0: SSP: handle(0x0082), sas_addr(0x5000c500ec95a6f2), phy(1), device_name(0x5000c500ec95a6f0) [ 27.114705] scsi 1:0:76:0: enclosure logical id(0x500c0ff0f6f3173c), slot(1) [ 27.114707] scsi 1:0:76:0: enclosure level(0x0000), connector name( C2 ) [ 27.114708] scsi 1:0:76:0: serial_number(HWL032060000822150Z3) [ 27.114710] scsi 1:0:76:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 27.172503] scsi 10:0:95:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 27.182099] scsi 10:0:95:0: SSP: handle(0x0095), sas_addr(0x5000c500ec915865), phy(20), device_name(0x5000c500ec915864) [ 27.192866] scsi 10:0:95:0: enclosure logical id(0x500c0ff0f6f4a33c), slot(20) [ 27.200172] scsi 10:0:95:0: enclosure level(0x0000), connector name( C2 ) [ 27.207052] scsi 10:0:95:0: serial_number(HWL031DX0000822150Z3) [ 27.212975] scsi 10:0:95:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 27.227674] end_device-1:3:1: mpt3sas_transport_port_add: added: handle(0x0082), sas_addr(0x5000c500ec95a6f2) [ 27.237748] mpt3sas_cm0: detecting: handle(0x0083), sas_address(0x5000c500ec955e6e), phy(2) [ 27.246109] mpt3sas_cm0: REPORT_LUNS: handle(0x0083), retries(0) [ 27.253462] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0083), lun(0) [ 27.259548] mpt3sas_cm0: handle(0x83) sas_address(0x5000c500ec955e6e) port_type(0x1) [ 27.269665] end_device-10:3:20: mpt3sas_transport_port_add: added: handle(0x0095), sas_addr(0x5000c500ec915865) [ 27.271436] scsi 1:0:77:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 27.273743] scsi 1:0:77:0: SSP: handle(0x0083), sas_addr(0x5000c500ec955e6e), phy(2), device_name(0x5000c500ec955e6c) [ 27.273745] scsi 1:0:77:0: enclosure logical id(0x500c0ff0f6f3173c), slot(2) [ 27.273746] scsi 1:0:77:0: enclosure level(0x0000), connector name( C2 ) [ 27.273747] scsi 1:0:77:0: serial_number(HWL031GS0000822150Z3) [ 27.273749] scsi 1:0:77:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 27.331464] scsi 10:0:96:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 27.341069] scsi 10:0:96:0: SSP: handle(0x0096), sas_addr(0x5000c500ec9191f5), phy(21), device_name(0x5000c500ec9191f4) [ 27.351841] scsi 10:0:96:0: enclosure logical id(0x500c0ff0f6f4a33c), slot(21) [ 27.359145] scsi 10:0:96:0: enclosure level(0x0000), connector name( C2 ) [ 27.366029] scsi 10:0:96:0: serial_number(HWL031J30000822150Z3) [ 27.371949] scsi 10:0:96:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 27.383667] end_device-1:3:2: mpt3sas_transport_port_add: added: handle(0x0083), sas_addr(0x5000c500ec955e6e) [ 27.393742] mpt3sas_cm0: detecting: handle(0x0084), sas_address(0x5000c500ec955ede), phy(3) [ 27.402095] mpt3sas_cm0: REPORT_LUNS: handle(0x0084), retries(0) [ 27.409449] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0084), lun(0) [ 27.415527] mpt3sas_cm0: handle(0x84) sas_address(0x5000c500ec955ede) port_type(0x1) [ 27.425645] end_device-10:3:21: mpt3sas_transport_port_add: added: handle(0x0096), sas_addr(0x5000c500ec9191f5) [ 27.427393] scsi 1:0:78:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 27.429697] scsi 1:0:78:0: SSP: handle(0x0084), sas_addr(0x5000c500ec955ede), phy(3), device_name(0x5000c500ec955edc) [ 27.429698] scsi 1:0:78:0: enclosure logical id(0x500c0ff0f6f3173c), slot(3) [ 27.429699] scsi 1:0:78:0: enclosure level(0x0000), connector name( C2 ) [ 27.429700] scsi 1:0:78:0: serial_number(HWL031K30000822150Z3) [ 27.429701] scsi 1:0:78:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 27.487544] scsi 10:0:97:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 27.497149] scsi 10:0:97:0: SSP: handle(0x0097), sas_addr(0x5000c500ec91583d), phy(22), device_name(0x5000c500ec91583c) [ 27.507921] scsi 10:0:97:0: enclosure logical id(0x500c0ff0f6f4a33c), slot(22) [ 27.515228] scsi 10:0:97:0: enclosure level(0x0000), connector name( C2 ) [ 27.522107] scsi 10:0:97:0: serial_number(HWL031LD0000822150Z3) [ 27.528021] scsi 10:0:97:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 27.539838] end_device-1:3:3: mpt3sas_transport_port_add: added: handle(0x0084), sas_addr(0x5000c500ec955ede) [ 27.549921] mpt3sas_cm0: detecting: handle(0x0085), sas_address(0x5000c500ec955ed6), phy(4) [ 27.558273] mpt3sas_cm0: REPORT_LUNS: handle(0x0085), retries(0) [ 27.565662] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0085), lun(0) [ 27.571738] mpt3sas_cm0: handle(0x85) sas_address(0x5000c500ec955ed6) port_type(0x1) [ 27.582641] end_device-10:3:22: mpt3sas_transport_port_add: added: handle(0x0097), sas_addr(0x5000c500ec91583d) [ 27.583789] scsi 1:0:79:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 27.586096] scsi 1:0:79:0: SSP: handle(0x0085), sas_addr(0x5000c500ec955ed6), phy(4), device_name(0x5000c500ec955ed4) [ 27.586097] scsi 1:0:79:0: enclosure logical id(0x500c0ff0f6f3173c), slot(4) [ 27.586099] scsi 1:0:79:0: enclosure level(0x0000), connector name( C2 ) [ 27.586100] scsi 1:0:79:0: serial_number(HWL030TP0000822150Z3) [ 27.586102] scsi 1:0:79:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 27.644497] scsi 10:0:98:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 27.654108] scsi 10:0:98:0: SSP: handle(0x0098), sas_addr(0x5000c500ec955da1), phy(23), device_name(0x5000c500ec955da0) [ 27.664878] scsi 10:0:98:0: enclosure logical id(0x500c0ff0f6f4a33c), slot(23) [ 27.672185] scsi 10:0:98:0: enclosure level(0x0000), connector name( C2 ) [ 27.679063] scsi 10:0:98:0: serial_number(HWL031A40000822150Z3) [ 27.684979] scsi 10:0:98:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 27.696699] end_device-1:3:4: mpt3sas_transport_port_add: added: handle(0x0085), sas_addr(0x5000c500ec955ed6) [ 27.706790] mpt3sas_cm0: detecting: handle(0x0086), sas_address(0x5000c500ec955fa2), phy(5) [ 27.715147] mpt3sas_cm0: REPORT_LUNS: handle(0x0086), retries(0) [ 27.722541] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0086), lun(0) [ 27.728618] mpt3sas_cm0: handle(0x86) sas_address(0x5000c500ec955fa2) port_type(0x1) [ 27.739628] end_device-10:3:23: mpt3sas_transport_port_add: added: handle(0x0098), sas_addr(0x5000c500ec955da1) [ 27.740476] scsi 1:0:80:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 27.742787] scsi 1:0:80:0: SSP: handle(0x0086), sas_addr(0x5000c500ec955fa2), phy(5), device_name(0x5000c500ec955fa0) [ 27.742788] scsi 1:0:80:0: enclosure logical id(0x500c0ff0f6f3173c), slot(5) [ 27.742789] scsi 1:0:80:0: enclosure level(0x0000), connector name( C2 ) [ 27.742790] scsi 1:0:80:0: serial_number(HWL030XP0000822150Z3) [ 27.742791] scsi 1:0:80:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 27.799005] scsi 10:0:99:0: Enclosure SEAGATE SP-3224A-E12EBD 52B7 PQ: 0 ANSI: 6 [ 27.808605] scsi 10:0:99:0: set ignore_delay_remove for handle(0x009a) [ 27.815127] scsi 10:0:99:0: SES: handle(0x009a), sas_addr(0x500c0ff00c170c3e), phy(36), device_name(0x500c0ff0f6f4a33c) [ 27.825899] scsi 10:0:99:0: enclosure logical id(0x500c0ff0f6f4a33c), slot(24) [ 27.833207] scsi 10:0:99:0: enclosure level(0x0000), connector name( C2 ) [ 27.840084] scsi 10:0:99:0: serial_number(SGFGD2338F6F4A3) [ 27.845566] scsi 10:0:99:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 27.860641] end_device-1:3:5: mpt3sas_transport_port_add: added: handle(0x0086), sas_addr(0x5000c500ec955fa2) [ 27.870729] mpt3sas_cm0: detecting: handle(0x0087), sas_address(0x5000c500ec955f66), phy(6) [ 27.879085] mpt3sas_cm0: REPORT_LUNS: handle(0x0087), retries(0) [ 27.886443] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0087), lun(0) [ 27.892544] mpt3sas_cm0: handle(0x87) sas_address(0x5000c500ec955f66) port_type(0x1) [ 27.894820] end_device-10:3:24: mpt3sas_transport_port_add: added: handle(0x009a), sas_addr(0x500c0ff00c170c3e) [ 27.914703] scsi 1:0:81:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 27.924230] scsi 1:0:81:0: SSP: handle(0x0087), sas_addr(0x5000c500ec955f66), phy(6), device_name(0x5000c500ec955f64) [ 27.934828] scsi 1:0:81:0: enclosure logical id(0x500c0ff0f6f3173c), slot(6) [ 27.941959] scsi 1:0:81:0: enclosure level(0x0000), connector name( C2 ) [ 27.948752] scsi 1:0:81:0: serial_number(HWL031J90000822150Z3) [ 27.954582] scsi 1:0:81:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 27.981628] end_device-1:3:6: mpt3sas_transport_port_add: added: handle(0x0087), sas_addr(0x5000c500ec955f66) [ 27.991697] mpt3sas_cm0: detecting: handle(0x0088), sas_address(0x5000c500ec955dfe), phy(7) [ 28.000047] mpt3sas_cm0: REPORT_LUNS: handle(0x0088), retries(0) [ 28.007404] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0088), lun(0) [ 28.013478] mpt3sas_cm0: handle(0x88) sas_address(0x5000c500ec955dfe) port_type(0x1) [ 28.025090] scsi 1:0:82:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 28.034615] scsi 1:0:82:0: SSP: handle(0x0088), sas_addr(0x5000c500ec955dfe), phy(7), device_name(0x5000c500ec955dfc) [ 28.045211] scsi 1:0:82:0: enclosure logical id(0x500c0ff0f6f3173c), slot(7) [ 28.052342] scsi 1:0:82:0: enclosure level(0x0000), connector name( C2 ) [ 28.059125] scsi 1:0:82:0: serial_number(HWL0316J0000822150Z3) [ 28.064953] scsi 1:0:82:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 28.097629] end_device-1:3:7: mpt3sas_transport_port_add: added: handle(0x0088), sas_addr(0x5000c500ec955dfe) [ 28.107719] mpt3sas_cm0: detecting: handle(0x0089), sas_address(0x5000c500ec955d92), phy(8) [ 28.116084] mpt3sas_cm0: REPORT_LUNS: handle(0x0089), retries(0) [ 28.123467] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0089), lun(0) [ 28.129588] mpt3sas_cm0: handle(0x89) sas_address(0x5000c500ec955d92) port_type(0x1) [ 28.141664] scsi 1:0:83:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 28.151196] scsi 1:0:83:0: SSP: handle(0x0089), sas_addr(0x5000c500ec955d92), phy(8), device_name(0x5000c500ec955d90) [ 28.161797] scsi 1:0:83:0: enclosure logical id(0x500c0ff0f6f3173c), slot(8) [ 28.168922] scsi 1:0:83:0: enclosure level(0x0000), connector name( C2 ) [ 28.175719] scsi 1:0:83:0: serial_number(HWL0313J0000822150Z3) [ 28.181557] scsi 1:0:83:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 28.210622] end_device-1:3:8: mpt3sas_transport_port_add: added: handle(0x0089), sas_addr(0x5000c500ec955d92) [ 28.220706] mpt3sas_cm0: detecting: handle(0x008a), sas_address(0x5000c500ec955e7e), phy(9) [ 28.229057] mpt3sas_cm0: REPORT_LUNS: handle(0x008a), retries(0) [ 28.236679] mpt3sas_cm0: TEST_UNIT_READY: handle(0x008a), lun(0) [ 28.242776] mpt3sas_cm0: handle(0x8a) sas_address(0x5000c500ec955e7e) port_type(0x1) [ 28.254771] scsi 1:0:84:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 28.264293] scsi 1:0:84:0: SSP: handle(0x008a), sas_addr(0x5000c500ec955e7e), phy(9), device_name(0x5000c500ec955e7c) [ 28.274886] scsi 1:0:84:0: enclosure logical id(0x500c0ff0f6f3173c), slot(9) [ 28.282009] scsi 1:0:84:0: enclosure level(0x0000), connector name( C2 ) [ 28.288796] scsi 1:0:84:0: serial_number(HWL031L90000822150Z3) [ 28.294631] scsi 1:0:84:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 28.322593] end_device-1:3:9: mpt3sas_transport_port_add: added: handle(0x008a), sas_addr(0x5000c500ec955e7e) [ 28.332670] mpt3sas_cm0: detecting: handle(0x008b), sas_address(0x5000c500ec95a6da), phy(10) [ 28.341112] mpt3sas_cm0: REPORT_LUNS: handle(0x008b), retries(0) [ 28.348464] mpt3sas_cm0: TEST_UNIT_READY: handle(0x008b), lun(0) [ 28.354544] mpt3sas_cm0: handle(0x8b) sas_address(0x5000c500ec95a6da) port_type(0x1) [ 28.366549] scsi 1:0:85:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 28.376089] scsi 1:0:85:0: SSP: handle(0x008b), sas_addr(0x5000c500ec95a6da), phy(10), device_name(0x5000c500ec95a6d8) [ 28.386777] scsi 1:0:85:0: enclosure logical id(0x500c0ff0f6f3173c), slot(10) [ 28.393988] scsi 1:0:85:0: enclosure level(0x0000), connector name( C2 ) [ 28.400788] scsi 1:0:85:0: serial_number(HWL031YT0000822150Z3) [ 28.406617] scsi 1:0:85:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 28.433604] end_device-1:3:10: mpt3sas_transport_port_add: added: handle(0x008b), sas_addr(0x5000c500ec95a6da) [ 28.443773] mpt3sas_cm0: detecting: handle(0x008c), sas_address(0x5000c500ec95a6d6), phy(11) [ 28.452210] mpt3sas_cm0: REPORT_LUNS: handle(0x008c), retries(0) [ 28.459587] mpt3sas_cm0: TEST_UNIT_READY: handle(0x008c), lun(0) [ 28.465670] mpt3sas_cm0: handle(0x8c) sas_address(0x5000c500ec95a6d6) port_type(0x1) [ 28.477800] scsi 1:0:86:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 28.487332] scsi 1:0:86:0: SSP: handle(0x008c), sas_addr(0x5000c500ec95a6d6), phy(11), device_name(0x5000c500ec95a6d4) [ 28.498018] scsi 1:0:86:0: enclosure logical id(0x500c0ff0f6f3173c), slot(11) [ 28.505239] scsi 1:0:86:0: enclosure level(0x0000), connector name( C2 ) [ 28.512031] scsi 1:0:86:0: serial_number(HWL032050000822150Z3) [ 28.517859] scsi 1:0:86:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 28.547587] end_device-1:3:11: mpt3sas_transport_port_add: added: handle(0x008c), sas_addr(0x5000c500ec95a6d6) [ 28.557754] mpt3sas_cm0: detecting: handle(0x008d), sas_address(0x5000c500ec95a6ce), phy(12) [ 28.566189] mpt3sas_cm0: REPORT_LUNS: handle(0x008d), retries(0) [ 28.573547] mpt3sas_cm0: TEST_UNIT_READY: handle(0x008d), lun(0) [ 28.579627] mpt3sas_cm0: handle(0x8d) sas_address(0x5000c500ec95a6ce) port_type(0x1) [ 28.591446] scsi 1:0:87:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 28.600974] scsi 1:0:87:0: SSP: handle(0x008d), sas_addr(0x5000c500ec95a6ce), phy(12), device_name(0x5000c500ec95a6cc) [ 28.611661] scsi 1:0:87:0: enclosure logical id(0x500c0ff0f6f3173c), slot(12) [ 28.618881] scsi 1:0:87:0: enclosure level(0x0000), connector name( C2 ) [ 28.625675] scsi 1:0:87:0: serial_number(HWL031Y00000822150Z3) [ 28.631511] scsi 1:0:87:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 28.659583] end_device-1:3:12: mpt3sas_transport_port_add: added: handle(0x008d), sas_addr(0x5000c500ec95a6ce) [ 28.669738] mpt3sas_cm0: detecting: handle(0x008e), sas_address(0x5000c500ec95a72a), phy(13) [ 28.678180] mpt3sas_cm0: REPORT_LUNS: handle(0x008e), retries(0) [ 28.685541] mpt3sas_cm0: TEST_UNIT_READY: handle(0x008e), lun(0) [ 28.691634] mpt3sas_cm0: handle(0x8e) sas_address(0x5000c500ec95a72a) port_type(0x1) [ 28.703384] scsi 1:0:88:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 28.712921] scsi 1:0:88:0: SSP: handle(0x008e), sas_addr(0x5000c500ec95a72a), phy(13), device_name(0x5000c500ec95a728) [ 28.723606] scsi 1:0:88:0: enclosure logical id(0x500c0ff0f6f3173c), slot(13) [ 28.730824] scsi 1:0:88:0: enclosure level(0x0000), connector name( C2 ) [ 28.737612] scsi 1:0:88:0: serial_number(HWL031Z10000822150Z3) [ 28.743449] scsi 1:0:88:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 28.770576] end_device-1:3:13: mpt3sas_transport_port_add: added: handle(0x008e), sas_addr(0x5000c500ec95a72a) [ 28.780750] mpt3sas_cm0: detecting: handle(0x008f), sas_address(0x5000c500ec95a66e), phy(14) [ 28.789184] mpt3sas_cm0: REPORT_LUNS: handle(0x008f), retries(0) [ 28.796548] mpt3sas_cm0: TEST_UNIT_READY: handle(0x008f), lun(0) [ 28.802642] mpt3sas_cm0: handle(0x8f) sas_address(0x5000c500ec95a66e) port_type(0x1) [ 28.814596] scsi 1:0:89:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 28.824123] scsi 1:0:89:0: SSP: handle(0x008f), sas_addr(0x5000c500ec95a66e), phy(14), device_name(0x5000c500ec95a66c) [ 28.834805] scsi 1:0:89:0: enclosure logical id(0x500c0ff0f6f3173c), slot(14) [ 28.842022] scsi 1:0:89:0: enclosure level(0x0000), connector name( C2 ) [ 28.848806] scsi 1:0:89:0: serial_number(HWL0320B0000822150Z3) [ 28.854646] scsi 1:0:89:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 28.883575] end_device-1:3:14: mpt3sas_transport_port_add: added: handle(0x008f), sas_addr(0x5000c500ec95a66e) [ 28.893739] mpt3sas_cm0: detecting: handle(0x0090), sas_address(0x5000c500ec95a6a6), phy(15) [ 28.902178] mpt3sas_cm0: REPORT_LUNS: handle(0x0090), retries(0) [ 28.909532] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0090), lun(0) [ 28.915620] mpt3sas_cm0: handle(0x90) sas_address(0x5000c500ec95a6a6) port_type(0x1) [ 28.927583] scsi 1:0:90:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 28.937115] scsi 1:0:90:0: SSP: handle(0x0090), sas_addr(0x5000c500ec95a6a6), phy(15), device_name(0x5000c500ec95a6a4) [ 28.947796] scsi 1:0:90:0: enclosure logical id(0x500c0ff0f6f3173c), slot(15) [ 28.955014] scsi 1:0:90:0: enclosure level(0x0000), connector name( C2 ) [ 28.961806] scsi 1:0:90:0: serial_number(HWL031YL0000822150Z3) [ 28.967636] scsi 1:0:90:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 28.998559] end_device-1:3:15: mpt3sas_transport_port_add: added: handle(0x0090), sas_addr(0x5000c500ec95a6a6) [ 29.008723] mpt3sas_cm0: detecting: handle(0x0091), sas_address(0x5000c500ec95a56e), phy(16) [ 29.017158] mpt3sas_cm0: REPORT_LUNS: handle(0x0091), retries(0) [ 29.024509] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0091), lun(0) [ 29.030603] mpt3sas_cm0: handle(0x91) sas_address(0x5000c500ec95a56e) port_type(0x1) [ 29.042522] scsi 1:0:91:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 29.052040] scsi 1:0:91:0: SSP: handle(0x0091), sas_addr(0x5000c500ec95a56e), phy(16), device_name(0x5000c500ec95a56c) [ 29.062729] scsi 1:0:91:0: enclosure logical id(0x500c0ff0f6f3173c), slot(16) [ 29.069947] scsi 1:0:91:0: enclosure level(0x0000), connector name( C2 ) [ 29.076743] scsi 1:0:91:0: serial_number(HWL031XE0000822150Z3) [ 29.082577] scsi 1:0:91:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 29.112554] end_device-1:3:16: mpt3sas_transport_port_add: added: handle(0x0091), sas_addr(0x5000c500ec95a56e) [ 29.122734] mpt3sas_cm0: detecting: handle(0x0092), sas_address(0x5000c500ec95a716), phy(17) [ 29.131172] mpt3sas_cm0: REPORT_LUNS: handle(0x0092), retries(0) [ 29.138523] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0092), lun(0) [ 29.144612] mpt3sas_cm0: handle(0x92) sas_address(0x5000c500ec95a716) port_type(0x1) [ 29.156551] scsi 1:0:92:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 29.166069] scsi 1:0:92:0: SSP: handle(0x0092), sas_addr(0x5000c500ec95a716), phy(17), device_name(0x5000c500ec95a714) [ 29.176751] scsi 1:0:92:0: enclosure logical id(0x500c0ff0f6f3173c), slot(17) [ 29.183971] scsi 1:0:92:0: enclosure level(0x0000), connector name( C2 ) [ 29.190755] scsi 1:0:92:0: serial_number(HWL031XL0000822150Z3) [ 29.196584] scsi 1:0:92:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 29.223554] end_device-1:3:17: mpt3sas_transport_port_add: added: handle(0x0092), sas_addr(0x5000c500ec95a716) [ 29.233713] mpt3sas_cm0: detecting: handle(0x0093), sas_address(0x5000c500ec95a702), phy(18) [ 29.242145] mpt3sas_cm0: REPORT_LUNS: handle(0x0093), retries(0) [ 29.249514] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0093), lun(0) [ 29.255609] mpt3sas_cm0: handle(0x93) sas_address(0x5000c500ec95a702) port_type(0x1) [ 29.267536] scsi 1:0:93:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 29.277060] scsi 1:0:93:0: SSP: handle(0x0093), sas_addr(0x5000c500ec95a702), phy(18), device_name(0x5000c500ec95a700) [ 29.287742] scsi 1:0:93:0: enclosure logical id(0x500c0ff0f6f3173c), slot(18) [ 29.294961] scsi 1:0:93:0: enclosure level(0x0000), connector name( C2 ) [ 29.301749] scsi 1:0:93:0: serial_number(HWL031Y20000822150Z3) [ 29.307583] scsi 1:0:93:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 29.336536] end_device-1:3:18: mpt3sas_transport_port_add: added: handle(0x0093), sas_addr(0x5000c500ec95a702) [ 29.346722] mpt3sas_cm0: detecting: handle(0x0094), sas_address(0x5000c500ec95a6ca), phy(19) [ 29.355158] mpt3sas_cm0: REPORT_LUNS: handle(0x0094), retries(0) [ 29.362522] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0094), lun(0) [ 29.368609] mpt3sas_cm0: handle(0x94) sas_address(0x5000c500ec95a6ca) port_type(0x1) [ 29.380550] scsi 1:0:94:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 29.390079] scsi 1:0:94:0: SSP: handle(0x0094), sas_addr(0x5000c500ec95a6ca), phy(19), device_name(0x5000c500ec95a6c8) [ 29.400759] scsi 1:0:94:0: enclosure logical id(0x500c0ff0f6f3173c), slot(19) [ 29.407970] scsi 1:0:94:0: enclosure level(0x0000), connector name( C2 ) [ 29.414757] scsi 1:0:94:0: serial_number(HWL031XR0000822150Z3) [ 29.420593] scsi 1:0:94:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 29.449537] end_device-1:3:19: mpt3sas_transport_port_add: added: handle(0x0094), sas_addr(0x5000c500ec95a6ca) [ 29.459699] mpt3sas_cm0: detecting: handle(0x0095), sas_address(0x5000c500ec955d36), phy(20) [ 29.468129] mpt3sas_cm0: REPORT_LUNS: handle(0x0095), retries(0) [ 29.475486] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0095), lun(0) [ 29.481572] mpt3sas_cm0: handle(0x95) sas_address(0x5000c500ec955d36) port_type(0x1) [ 29.493500] scsi 1:0:95:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 29.503029] scsi 1:0:95:0: SSP: handle(0x0095), sas_addr(0x5000c500ec955d36), phy(20), device_name(0x5000c500ec955d34) [ 29.513708] scsi 1:0:95:0: enclosure logical id(0x500c0ff0f6f3173c), slot(20) [ 29.520920] scsi 1:0:95:0: enclosure level(0x0000), connector name( C2 ) [ 29.527717] scsi 1:0:95:0: serial_number(HWL031FG0000822150Z3) [ 29.533549] scsi 1:0:95:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 29.564536] end_device-1:3:20: mpt3sas_transport_port_add: added: handle(0x0095), sas_addr(0x5000c500ec955d36) [ 29.574706] mpt3sas_cm0: detecting: handle(0x0096), sas_address(0x5000c500ec955f96), phy(21) [ 29.583143] mpt3sas_cm0: REPORT_LUNS: handle(0x0096), retries(0) [ 29.590548] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0096), lun(0) [ 29.596634] mpt3sas_cm0: handle(0x96) sas_address(0x5000c500ec955f96) port_type(0x1) [ 29.608700] scsi 1:0:96:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 29.618235] scsi 1:0:96:0: SSP: handle(0x0096), sas_addr(0x5000c500ec955f96), phy(21), device_name(0x5000c500ec955f94) [ 29.628919] scsi 1:0:96:0: enclosure logical id(0x500c0ff0f6f3173c), slot(21) [ 29.636130] scsi 1:0:96:0: enclosure level(0x0000), connector name( C2 ) [ 29.642923] scsi 1:0:96:0: serial_number(HWL031C40000822150Z3) [ 29.648754] scsi 1:0:96:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 29.681521] end_device-1:3:21: mpt3sas_transport_port_add: added: handle(0x0096), sas_addr(0x5000c500ec955f96) [ 29.692298] mpt3sas_cm0: detecting: handle(0x0097), sas_address(0x5000c500ec955d82), phy(22) [ 29.700742] mpt3sas_cm0: REPORT_LUNS: handle(0x0097), retries(0) [ 29.708101] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0097), lun(0) [ 29.714192] mpt3sas_cm0: handle(0x97) sas_address(0x5000c500ec955d82) port_type(0x1) [ 29.725812] scsi 1:0:97:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 29.735349] scsi 1:0:97:0: SSP: handle(0x0097), sas_addr(0x5000c500ec955d82), phy(22), device_name(0x5000c500ec955d80) [ 29.746028] scsi 1:0:97:0: enclosure logical id(0x500c0ff0f6f3173c), slot(22) [ 29.753246] scsi 1:0:97:0: enclosure level(0x0000), connector name( C2 ) [ 29.760031] scsi 1:0:97:0: serial_number(HWL0312N0000822150Z3) [ 29.765868] scsi 1:0:97:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 29.800516] end_device-1:3:22: mpt3sas_transport_port_add: added: handle(0x0097), sas_addr(0x5000c500ec955d82) [ 29.810697] mpt3sas_cm0: detecting: handle(0x0098), sas_address(0x5000c500ec955f7a), phy(23) [ 29.819137] mpt3sas_cm0: REPORT_LUNS: handle(0x0098), retries(0) [ 29.826485] mpt3sas_cm0: TEST_UNIT_READY: handle(0x0098), lun(0) [ 29.832570] mpt3sas_cm0: handle(0x98) sas_address(0x5000c500ec955f7a) port_type(0x1) [ 29.844538] scsi 1:0:98:0: Direct-Access SEAGATE XS15360SE70045 0003 PQ: 0 ANSI: 7 [ 29.854066] scsi 1:0:98:0: SSP: handle(0x0098), sas_addr(0x5000c500ec955f7a), phy(23), device_name(0x5000c500ec955f78) [ 29.864749] scsi 1:0:98:0: enclosure logical id(0x500c0ff0f6f3173c), slot(23) [ 29.871967] scsi 1:0:98:0: enclosure level(0x0000), connector name( C2 ) [ 29.878752] scsi 1:0:98:0: serial_number(HWL031KP0000822150Z3) [ 29.884590] scsi 1:0:98:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(8), cmd_que(1) [ 29.914518] end_device-1:3:23: mpt3sas_transport_port_add: added: handle(0x0098), sas_addr(0x5000c500ec955f7a) [ 29.925270] mpt3sas_cm0: detecting: handle(0x009a), sas_address(0x500c0ff00c17443e), phy(36) [ 29.933705] mpt3sas_cm0: REPORT_LUNS: handle(0x009a), retries(0) [ 29.940625] mpt3sas_cm0: TEST_UNIT_READY: handle(0x009a), lun(0) [ 29.947047] mpt3sas_cm0: handle(0x9a) sas_address(0x500c0ff00c17443e) port_type(0x1) [ 29.957198] scsi 1:0:99:0: Enclosure SEAGATE SP-3224A-E12EBD 52B7 PQ: 0 ANSI: 6 [ 29.965833] scsi 1:0:99:0: set ignore_delay_remove for handle(0x009a) [ 29.972273] scsi 1:0:99:0: SES: handle(0x009a), sas_addr(0x500c0ff00c17443e), phy(36), device_name(0x500c0ff0f6f3173c) [ 29.982959] scsi 1:0:99:0: enclosure logical id(0x500c0ff0f6f3173c), slot(24) [ 29.990177] scsi 1:0:99:0: enclosure level(0x0000), connector name( C2 ) [ 29.996972] scsi 1:0:99:0: serial_number(SGFGD2338F6F317) [ 30.002375] scsi 1:0:99:0: qdepth(64), tagged(1), simple(0), ordered(0), scsi_level(7), cmd_que(1) [ 30.026567] end_device-1:3:24: mpt3sas_transport_port_add: added: handle(0x009a), sas_addr(0x500c0ff00c17443e) [ 30.045152] mpt3sas_cm0: port enable: SUCCESS [ 30.052063] sd 1:0:0:0: [sdb] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.052267] sd 1:0:1:0: [sdc] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.052329] sd 1:0:2:0: [sdd] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.052435] sd 1:0:3:0: [sde] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.052507] sd 1:0:4:0: [sdf] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.052625] sd 1:0:5:0: [sdg] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.052703] sd 1:0:6:0: [sdh] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.052768] sd 1:0:7:0: [sdi] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.052995] sd 1:0:8:0: [sdj] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.054819] sd 1:0:9:0: [sdk] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.054875] sd 1:0:10:0: [sdl] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.054925] sd 1:0:11:0: [sdm] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.054981] sd 1:0:12:0: [sdn] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.055017] sd 1:0:13:0: [sdo] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.055076] sd 1:0:14:0: [sdp] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.055113] sd 1:0:15:0: [sdq] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.055349] sd 1:0:16:0: [sdr] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.055458] sd 1:0:18:0: [sdt] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.055500] sd 1:0:19:0: [sdu] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.055561] sd 1:0:20:0: [sdv] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.055594] sd 1:0:21:0: [sdw] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.055669] sd 1:0:23:0: [sdy] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.055713] sd 1:0:25:0: [sdz] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.055746] sd 1:0:26:0: [sdaa] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.055749] sd 1:0:22:0: [sdx] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.055754] sd 1:0:17:0: [sds] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.055780] sd 1:0:27:0: [sdab] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.055817] sd 1:0:28:0: [sdac] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.055885] sd 1:0:29:0: [sdad] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.055924] sd 1:0:30:0: [sdae] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.055955] sd 1:0:32:0: [sdag] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.056038] sd 1:0:34:0: [sdai] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.056080] sd 1:0:35:0: [sdaj] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.056130] sd 1:0:36:0: [sdak] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.056178] sd 1:0:37:0: [sdal] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.056235] sd 1:0:38:0: [sdam] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.056286] sd 1:0:39:0: [sdan] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.056314] sd 1:0:40:0: [sdao] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.056365] sd 1:0:41:0: [sdap] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.056408] sd 1:0:31:0: [sdaf] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.056422] sd 1:0:42:0: [sdaq] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.056433] sd 1:0:33:0: [sdah] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.056498] sd 1:0:43:0: [sdar] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.056882] sd 1:0:44:0: [sdas] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.057085] sd 1:0:45:0: [sdat] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.057276] sd 1:0:46:0: [sdau] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.057826] sd 1:0:47:0: [sdav] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.058296] sd 1:0:48:0: [sdaw] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.059522] sd 1:0:50:0: [sdax] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.060213] sd 1:0:51:0: [sday] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.060408] sd 1:0:52:0: [sdaz] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.061616] sd 1:0:53:0: [sdba] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.061635] sd 1:0:54:0: [sdbb] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.061697] sd 1:0:55:0: [sdbc] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.061706] sd 1:0:56:0: [sdbd] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.061734] sd 1:0:57:0: [sdbe] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.061769] sd 1:0:58:0: [sdbf] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.061811] sd 1:0:59:0: [sdbg] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.061849] sd 1:0:60:0: [sdbh] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.061882] sd 1:0:61:0: [sdbi] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.061928] sd 1:0:63:0: [sdbk] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.062066] sd 1:0:64:0: [sdbl] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.062387] sd 1:0:62:0: [sdbj] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.062718] sd 1:0:65:0: [sdbm] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.062836] sd 1:0:66:0: [sdbn] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.062936] sd 1:0:67:0: [sdbo] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.063054] sd 1:0:68:0: [sdbp] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.063186] sd 1:0:69:0: [sdbq] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.063239] sd 1:0:70:0: [sdbr] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.063364] sd 1:0:71:0: [sdbs] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.063458] sd 1:0:72:0: [sdbt] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.063753] sd 1:0:75:0: [sdbv] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.063866] sd 1:0:76:0: [sdbw] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.063954] sd 1:0:77:0: [sdbx] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.064064] sd 1:0:78:0: [sdby] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.064113] sd 1:0:73:0: [sdbu] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.064279] sd 1:0:79:0: [sdbz] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.064699] sd 1:0:80:0: [sdca] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.065434] sd 1:0:81:0: [sdcb] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.066279] sd 1:0:82:0: [sdcc] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.066393] sd 1:0:83:0: [sdcd] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.066504] sd 1:0:84:0: [sdce] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.066617] sd 1:0:85:0: [sdcf] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.066736] sd 1:0:86:0: [sdcg] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.066810] sd 1:0:87:0: [sdch] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.066921] sd 1:0:88:0: [sdci] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.067009] sd 1:0:89:0: [sdcj] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.067123] sd 1:0:90:0: [sdck] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.067234] sd 1:0:91:0: [sdcl] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.067340] sd 1:0:92:0: [sdcm] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.067474] sd 1:0:93:0: [sdcn] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.067872] sd 1:0:94:0: [sdco] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.068478] sd 1:0:95:0: [sdcp] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.068781] sd 1:0:1:0: [sdc] Write Protect is off [ 30.068783] sd 1:0:1:0: [sdc] Mode Sense: dd 00 10 08 [ 30.069187] sd 1:0:5:0: [sdg] Write Protect is off [ 30.069189] sd 1:0:5:0: [sdg] Mode Sense: dd 00 10 08 [ 30.069205] sd 1:0:6:0: [sdh] Write Protect is off [ 30.069207] sd 1:0:6:0: [sdh] Mode Sense: dd 00 10 08 [ 30.069275] sd 1:0:2:0: [sdd] Write Protect is off [ 30.069277] sd 1:0:2:0: [sdd] Mode Sense: dd 00 10 08 [ 30.069368] sd 1:0:7:0: [sdi] Write Protect is off [ 30.069369] sd 1:0:7:0: [sdi] Mode Sense: dd 00 10 08 [ 30.069426] sd 1:0:96:0: [sdcq] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.069513] sd 1:0:3:0: [sde] Write Protect is off [ 30.069514] sd 1:0:3:0: [sde] Mode Sense: dd 00 10 08 [ 30.069607] sd 1:0:4:0: [sdf] Write Protect is off [ 30.069608] sd 1:0:4:0: [sdf] Mode Sense: dd 00 10 08 [ 30.069810] sd 1:0:97:0: [sdcr] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.069872] sd 1:0:8:0: [sdj] Write Protect is off [ 30.069873] sd 1:0:8:0: [sdj] Mode Sense: dd 00 10 08 [ 30.069918] sd 1:0:98:0: [sdcs] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.071340] sd 1:0:9:0: [sdk] Write Protect is off [ 30.071341] sd 1:0:9:0: [sdk] Mode Sense: dd 00 10 08 [ 30.071398] sd 1:0:10:0: [sdl] Write Protect is off [ 30.071400] sd 1:0:10:0: [sdl] Mode Sense: dd 00 10 08 [ 30.071450] sd 1:0:11:0: [sdm] Write Protect is off [ 30.071451] sd 1:0:11:0: [sdm] Mode Sense: dd 00 10 08 [ 30.071497] sd 1:0:12:0: [sdn] Write Protect is off [ 30.071497] sd 1:0:12:0: [sdn] Mode Sense: dd 00 10 08 [ 30.071537] sd 1:0:13:0: [sdo] Write Protect is off [ 30.071538] sd 1:0:13:0: [sdo] Mode Sense: dd 00 10 08 [ 30.071588] sd 1:0:14:0: [sdp] Write Protect is off [ 30.071588] sd 1:0:14:0: [sdp] Mode Sense: dd 00 10 08 [ 30.071623] sd 1:0:15:0: [sdq] Write Protect is off [ 30.071624] sd 1:0:15:0: [sdq] Mode Sense: dd 00 10 08 [ 30.071864] sd 1:0:16:0: [sdr] Write Protect is off [ 30.071865] sd 1:0:16:0: [sdr] Mode Sense: dd 00 10 08 [ 30.072013] sd 1:0:19:0: [sdu] Write Protect is off [ 30.072014] sd 1:0:19:0: [sdu] Mode Sense: dd 00 10 08 [ 30.072048] sd 1:0:18:0: [sdt] Write Protect is off [ 30.072048] sd 1:0:18:0: [sdt] Mode Sense: dd 00 10 08 [ 30.072096] sd 1:0:20:0: [sdv] Write Protect is off [ 30.072097] sd 1:0:20:0: [sdv] Mode Sense: dd 00 10 08 [ 30.072182] sd 1:0:23:0: [sdy] Write Protect is off [ 30.072183] sd 1:0:23:0: [sdy] Mode Sense: dd 00 10 08 [ 30.072249] sd 1:0:25:0: [sdz] Write Protect is off [ 30.072250] sd 1:0:25:0: [sdz] Mode Sense: dd 00 10 08 [ 30.072258] sd 1:0:17:0: [sds] Write Protect is off [ 30.072259] sd 1:0:17:0: [sds] Mode Sense: dd 00 10 08 [ 30.072270] sd 1:0:26:0: [sdaa] Write Protect is off [ 30.072272] sd 1:0:22:0: [sdx] Write Protect is off [ 30.072274] sd 1:0:26:0: [sdaa] Mode Sense: dd 00 10 08 [ 30.072275] sd 1:0:22:0: [sdx] Mode Sense: dd 00 10 08 [ 30.072306] sd 1:0:27:0: [sdab] Write Protect is off [ 30.072307] sd 1:0:27:0: [sdab] Mode Sense: dd 00 10 08 [ 30.072327] sd 1:0:21:0: [sdw] Write Protect is off [ 30.072328] sd 1:0:21:0: [sdw] Mode Sense: dd 00 10 08 [ 30.072434] sd 1:0:28:0: [sdac] Write Protect is off [ 30.072435] sd 1:0:28:0: [sdac] Mode Sense: dd 00 10 08 [ 30.072463] sd 1:0:29:0: [sdad] Write Protect is off [ 30.072464] sd 1:0:29:0: [sdad] Mode Sense: dd 00 10 08 [ 30.072485] sd 1:0:32:0: [sdag] Write Protect is off [ 30.072486] sd 1:0:32:0: [sdag] Mode Sense: dd 00 10 08 [ 30.072505] sd 1:0:30:0: [sdae] Write Protect is off [ 30.072506] sd 1:0:30:0: [sdae] Mode Sense: dd 00 10 08 [ 30.072609] sd 1:0:35:0: [sdaj] Write Protect is off [ 30.072610] sd 1:0:35:0: [sdaj] Mode Sense: dd 00 10 08 [ 30.072626] sd 1:0:34:0: [sdai] Write Protect is off [ 30.072627] sd 1:0:34:0: [sdai] Mode Sense: dd 00 10 08 [ 30.072760] sd 1:0:38:0: [sdam] Write Protect is off [ 30.072761] sd 1:0:38:0: [sdam] Mode Sense: dd 00 10 08 [ 30.072813] sd 1:0:39:0: [sdan] Write Protect is off [ 30.072814] sd 1:0:39:0: [sdan] Mode Sense: dd 00 10 08 [ 30.072837] sd 1:0:40:0: [sdao] Write Protect is off [ 30.072838] sd 1:0:40:0: [sdao] Mode Sense: dd 00 10 08 [ 30.072886] sd 1:0:41:0: [sdap] Write Protect is off [ 30.072887] sd 1:0:41:0: [sdap] Mode Sense: dd 00 10 08 [ 30.072931] sd 1:0:31:0: [sdaf] Write Protect is off [ 30.072932] sd 1:0:42:0: [sdaq] Write Protect is off [ 30.072934] sd 1:0:31:0: [sdaf] Mode Sense: dd 00 10 08 [ 30.072935] sd 1:0:42:0: [sdaq] Mode Sense: dd 00 10 08 [ 30.072948] sd 1:0:33:0: [sdah] Write Protect is off [ 30.072949] sd 1:0:33:0: [sdah] Mode Sense: dd 00 10 08 [ 30.073020] sd 1:0:43:0: [sdar] Write Protect is off [ 30.073021] sd 1:0:43:0: [sdar] Mode Sense: dd 00 10 08 [ 30.073159] sd 1:0:37:0: [sdal] Write Protect is off [ 30.073160] sd 1:0:36:0: [sdak] Write Protect is off [ 30.073162] sd 1:0:37:0: [sdal] Mode Sense: dd 00 10 08 [ 30.073163] sd 1:0:36:0: [sdak] Mode Sense: dd 00 10 08 [ 30.073416] sd 1:0:44:0: [sdas] Write Protect is off [ 30.073417] sd 1:0:44:0: [sdas] Mode Sense: dd 00 10 08 [ 30.073663] sd 1:0:45:0: [sdat] Write Protect is off [ 30.073664] sd 1:0:45:0: [sdat] Mode Sense: dd 00 10 08 [ 30.073806] sd 1:0:46:0: [sdau] Write Protect is off [ 30.073807] sd 1:0:46:0: [sdau] Mode Sense: dd 00 10 08 [ 30.074006] sd 10:0:0:0: [sdct] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.074116] sd 1:0:1:0: [sdc] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.074119] sd 10:0:1:0: [sdcu] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.074203] sd 10:0:2:0: [sdcv] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.074350] sd 1:0:47:0: [sdav] Write Protect is off [ 30.074351] sd 1:0:47:0: [sdav] Mode Sense: dd 00 10 08 [ 30.074535] sd 1:0:6:0: [sdh] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.074602] sd 1:0:2:0: [sdd] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.074735] sd 1:0:7:0: [sdi] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.074798] sd 10:0:3:0: [sdcw] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.074818] sd 1:0:48:0: [sdaw] Write Protect is off [ 30.074819] sd 1:0:48:0: [sdaw] Mode Sense: dd 00 10 08 [ 30.074868] sd 1:0:3:0: [sde] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.074992] sd 1:0:5:0: [sdg] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.075001] sd 1:0:4:0: [sdf] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.075197] sd 1:0:8:0: [sdj] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.076522] sd 10:0:7:0: [sdda] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.076624] sd 10:0:8:0: [sddb] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.076665] sd 1:0:9:0: [sdk] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.076735] sd 10:0:9:0: [sddc] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.076741] sd 1:0:10:0: [sdl] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.076791] sd 1:0:11:0: [sdm] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.076832] sd 1:0:12:0: [sdn] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.076842] sd 10:0:10:0: [sddd] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.076932] sd 1:0:13:0: [sdo] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.076936] sd 1:0:14:0: [sdp] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.076954] sd 1:0:15:0: [sdq] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.076956] sd 10:0:4:0: [sdcx] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.077124] sd 1:0:50:0: [sdax] Write Protect is off [ 30.077125] sd 1:0:50:0: [sdax] Mode Sense: dd 00 10 08 [ 30.077138] sd 10:0:11:0: [sdde] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.077166] sd 10:0:13:0: [sddg] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.077199] sd 10:0:12:0: [sddf] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.077203] sd 1:0:16:0: [sdr] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.077230] sd 10:0:5:0: [sdcy] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.077252] sd 10:0:14:0: [sddh] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.077360] sd 1:0:19:0: [sdu] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.077378] sd 1:0:18:0: [sdt] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.077424] sd 1:0:20:0: [sdv] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.077431] sd 10:0:15:0: [sddi] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.077460] sd 10:0:16:0: [sddj] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.077556] sd 1:0:23:0: [sdy] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.077576] sd 1:0:25:0: [sdz] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.077578] sd 10:0:17:0: [sddk] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.077579] sd 1:0:17:0: [sds] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.077596] sd 1:0:22:0: [sdx] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.077598] sd 1:0:26:0: [sdaa] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.077651] sd 1:0:27:0: [sdab] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.077658] sd 1:0:21:0: [sdw] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.077735] sd 1:0:51:0: [sday] Write Protect is off [ 30.077736] sd 1:0:51:0: [sday] Mode Sense: dd 00 10 08 [ 30.077797] sd 1:0:28:0: [sdac] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.077801] sd 1:0:32:0: [sdag] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.077819] sd 1:0:29:0: [sdad] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.077870] sd 1:0:30:0: [sdae] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.077934] sd 1:0:35:0: [sdaj] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.077957] sd 1:0:34:0: [sdai] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.077971] sd 10:0:6:0: [sdcz] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.078002] sd 1:0:52:0: [sdaz] Write Protect is off [ 30.078002] sd 1:0:52:0: [sdaz] Mode Sense: dd 00 10 08 [ 30.078098] sd 1:0:38:0: [sdam] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.078108] sd 10:0:19:0: [sddm] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.078154] sd 1:0:39:0: [sdan] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.078162] sd 1:0:40:0: [sdao] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.078170] sd 10:0:18:0: [sddl] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.078259] sd 1:0:42:0: [sdaq] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.078262] sd 1:0:31:0: [sdaf] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.078284] sd 1:0:33:0: [sdah] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.078349] sd 1:0:43:0: [sdar] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.078475] sd 1:0:63:0: [sdbk] Write Protect is off [ 30.078476] sd 1:0:63:0: [sdbk] Mode Sense: dd 00 10 08 [ 30.078493] sd 1:0:36:0: [sdak] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.078495] sd 1:0:37:0: [sdal] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.078602] sd 1:0:41:0: [sdap] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.078607] sd 1:0:64:0: [sdbl] Write Protect is off [ 30.078608] sd 1:0:64:0: [sdbl] Mode Sense: dd 00 10 08 [ 30.078747] sd 1:0:44:0: [sdas] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.078991] sd 1:0:45:0: [sdat] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.079130] sd 10:0:20:0: [sddn] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.079180] sd 1:0:46:0: [sdau] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.079281] sd 1:0:53:0: [sdba] Write Protect is off [ 30.079281] sd 1:0:53:0: [sdba] Mode Sense: dd 00 10 08 [ 30.079284] sd 1:0:57:0: [sdbe] Write Protect is off [ 30.079285] sd 1:0:57:0: [sdbe] Mode Sense: dd 00 10 08 [ 30.079286] sd 1:0:54:0: [sdbb] Write Protect is off [ 30.079288] sd 1:0:54:0: [sdbb] Mode Sense: dd 00 10 08 [ 30.079305] sd 1:0:58:0: [sdbf] Write Protect is off [ 30.079305] sd 1:0:58:0: [sdbf] Mode Sense: dd 00 10 08 [ 30.079386] sd 1:0:60:0: [sdbh] Write Protect is off [ 30.079391] sd 1:0:60:0: [sdbh] Mode Sense: dd 00 10 08 [ 30.079421] sd 1:0:61:0: [sdbi] Write Protect is off [ 30.079422] sd 1:0:61:0: [sdbi] Mode Sense: dd 00 10 08 [ 30.079440] sd 1:0:55:0: [sdbc] Write Protect is off [ 30.079441] sd 1:0:55:0: [sdbc] Mode Sense: dd 00 10 08 [ 30.079450] sd 10:0:25:0: [sddr] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.079584] sd 1:0:56:0: [sdbd] Write Protect is off [ 30.079585] sd 1:0:56:0: [sdbd] Mode Sense: dd 00 10 08 [ 30.079661] sd 10:0:21:0: [sddo] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.079685] sd 1:0:47:0: [sdav] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.079837] sd 1:0:59:0: [sdbg] Write Protect is off [ 30.079839] sd 1:0:59:0: [sdbg] Mode Sense: dd 00 10 08 [ 30.079930] sd 1:0:62:0: [sdbj] Write Protect is off [ 30.079931] sd 1:0:62:0: [sdbj] Mode Sense: dd 00 10 08 [ 30.080055] sd 10:0:22:0: [sddp] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.080056] sd 10:0:26:0: [sdds] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.080149] sd 10:0:23:0: [sddq] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.080161] sd 1:0:48:0: [sdaw] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.080252] sd 1:0:65:0: [sdbm] Write Protect is off [ 30.080253] sd 1:0:65:0: [sdbm] Mode Sense: dd 00 10 08 [ 30.080322] sd 10:0:27:0: [sddt] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.080363] sd 1:0:66:0: [sdbn] Write Protect is off [ 30.080364] sd 1:0:66:0: [sdbn] Mode Sense: dd 00 10 08 [ 30.080582] sd 1:0:68:0: [sdbp] Write Protect is off [ 30.080583] sd 1:0:68:0: [sdbp] Mode Sense: dd 00 10 08 [ 30.080611] sd 1:0:67:0: [sdbo] Write Protect is off [ 30.080612] sd 1:0:67:0: [sdbo] Mode Sense: dd 00 10 08 [ 30.080728] sd 1:0:69:0: [sdbq] Write Protect is off [ 30.080729] sd 1:0:69:0: [sdbq] Mode Sense: dd 00 10 08 [ 30.080848] sd 1:0:70:0: [sdbr] Write Protect is off [ 30.080849] sd 1:0:70:0: [sdbr] Mode Sense: dd 00 10 08 [ 30.080970] sd 1:0:71:0: [sdbs] Write Protect is off [ 30.080971] sd 1:0:71:0: [sdbs] Mode Sense: dd 00 10 08 [ 30.081048] sd 1:0:72:0: [sdbt] Write Protect is off [ 30.081049] sd 1:0:72:0: [sdbt] Mode Sense: dd 00 10 08 [ 30.081559] sd 1:0:73:0: [sdbu] Write Protect is off [ 30.081560] sd 1:0:73:0: [sdbu] Mode Sense: dd 00 10 08 [ 30.081708] sd 10:0:32:0: [sddy] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.081731] sd 10:0:36:0: [sdec] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.081765] sd 10:0:35:0: [sdeb] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.081821] sd 10:0:29:0: [sddv] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.081823] sd 10:0:30:0: [sddw] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.081862] sd 10:0:33:0: [sddz] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.081884] sd 10:0:28:0: [sddu] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.081936] sd 10:0:31:0: [sddx] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.082158] sd 10:0:34:0: [sdea] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.082246] sd 10:0:37:0: [sded] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.082682] sd 10:0:41:0: [sdeh] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.082904] sd 10:0:43:0: [sdej] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.082926] sd 10:0:42:0: [sdei] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.083046] sd 10:0:40:0: [sdeg] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.083047] sd 10:0:44:0: [sdek] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.083171] sd 10:0:45:0: [sdel] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.083226] sd 10:0:50:0: [sdep] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.083254] sd 10:0:51:0: [sdeq] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.083267] sd 10:0:52:0: [sder] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.083328] sd 10:0:46:0: [sdem] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.083370] sd 10:0:47:0: [sden] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.083517] sd 10:0:54:0: [sdet] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.083802] sd 10:0:53:0: [sdes] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.083880] sd 10:0:48:0: [sdeo] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.083973] sd 10:0:55:0: [sdeu] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.083974] sd 10:0:56:0: [sdev] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.084542] sd 10:0:38:0: [sdee] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.084743] sd 10:0:39:0: [sdef] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.085269] sd 10:0:75:0: [sdfn] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.085755] sd 10:0:57:0: [sdew] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.085877] sd 10:0:60:0: [sdez] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.085910] sd 10:0:59:0: [sdey] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.086081] sd 10:0:63:0: [sdfc] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.086099] sd 10:0:65:0: [sdfe] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.086110] sd 10:0:64:0: [sdfd] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.086232] sd 10:0:58:0: [sdex] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.086448] sd 10:0:61:0: [sdfa] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.086480] sd 10:0:62:0: [sdfb] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.086551] sd 10:0:66:0: [sdff] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.087094] sd 1:0:50:0: [sdax] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.087133] sd 10:0:71:0: [sdfk] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.087222] sd 1:0:63:0: [sdbk] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.087427] sd 1:0:64:0: [sdbl] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.087641] sd 10:0:72:0: [sdfl] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.087705] sd 1:0:51:0: [sday] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.087961] sd 1:0:52:0: [sdaz] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.088104] sd 10:0:73:0: [sdfm] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.088538] sd 10:0:67:0: [sdfg] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.088608] sd 10:0:68:0: [sdfh] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.088895] sd 1:0:79:0: [sdbz] Write Protect is off [ 30.088896] sd 1:0:79:0: [sdbz] Mode Sense: dd 00 10 08 [ 30.089100] sd 10:0:69:0: [sdfi] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.089177] sd 1:0:80:0: [sdca] Write Protect is off [ 30.089179] sd 1:0:80:0: [sdca] Mode Sense: dd 00 10 08 [ 30.089258] sd 10:0:70:0: [sdfj] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.089260] sd 1:0:57:0: [sdbe] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.089262] sd 1:0:58:0: [sdbf] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.089363] sd 1:0:54:0: [sdbb] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.089380] sd 1:0:61:0: [sdbi] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.089382] sd 1:0:53:0: [sdba] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.089410] sd 1:0:60:0: [sdbh] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.089519] sd 1:0:55:0: [sdbc] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.089759] sd 1:0:56:0: [sdbd] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.089795] sd 1:0:59:0: [sdbg] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.089944] sd 1:0:81:0: [sdcb] Write Protect is off [ 30.089944] sd 1:0:81:0: [sdcb] Mode Sense: dd 00 10 08 [ 30.090001] sd 10:0:76:0: [sdfo] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.090218] sd 1:0:62:0: [sdbj] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.090324] sd 1:0:66:0: [sdbn] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.090489] sd 10:0:77:0: [sdfp] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.090543] sd 1:0:68:0: [sdbp] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.090561] sd 1:0:67:0: [sdbo] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.090620] sd 1:0:76:0: [sdbw] Write Protect is off [ 30.090621] sd 1:0:76:0: [sdbw] Mode Sense: dd 00 10 08 [ 30.090687] sd 1:0:69:0: [sdbq] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.090693] sd 1:0:65:0: [sdbm] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.090710] sd 1:0:77:0: [sdbx] Write Protect is off [ 30.090711] sd 1:0:77:0: [sdbx] Mode Sense: dd 00 10 08 [ 30.090757] sd 1:0:75:0: [sdbv] Write Protect is off [ 30.090758] sd 1:0:75:0: [sdbv] Mode Sense: dd 00 10 08 [ 30.090805] sd 1:0:70:0: [sdbr] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.090874] sd 10:0:78:0: [sdfq] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.090927] sd 1:0:71:0: [sdbs] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.090971] sd 10:0:79:0: [sdfr] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.091014] sd 1:0:72:0: [sdbt] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.091393] sd 1:0:78:0: [sdby] Write Protect is off [ 30.091394] sd 1:0:78:0: [sdby] Mode Sense: dd 00 10 08 [ 30.091733] sd 1:0:73:0: [sdbu] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.092723] sd 10:0:81:0: [sdft] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.093107] sd 1:0:82:0: [sdcc] Write Protect is off [ 30.093108] sd 1:0:82:0: [sdcc] Mode Sense: dd 00 10 08 [ 30.093280] sd 10:0:80:0: [sdfs] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.093380] sd 10:0:83:0: [sdfv] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.093408] sd 1:0:85:0: [sdcf] Write Protect is off [ 30.093409] sd 1:0:85:0: [sdcf] Mode Sense: dd 00 10 08 [ 30.093540] sd 1:0:84:0: [sdce] Write Protect is off [ 30.093540] sd 1:0:84:0: [sdce] Mode Sense: dd 00 10 08 [ 30.093636] sd 1:0:83:0: [sdcd] Write Protect is off [ 30.093636] sd 1:0:83:0: [sdcd] Mode Sense: dd 00 10 08 [ 30.093652] sd 1:0:86:0: [sdcg] Write Protect is off [ 30.093653] sd 1:0:86:0: [sdcg] Mode Sense: dd 00 10 08 [ 30.093727] sd 1:0:87:0: [sdch] Write Protect is off [ 30.093728] sd 1:0:87:0: [sdch] Mode Sense: dd 00 10 08 [ 30.093788] sd 1:0:89:0: [sdcj] Write Protect is off [ 30.093788] sd 1:0:89:0: [sdcj] Mode Sense: dd 00 10 08 [ 30.093896] sd 1:0:88:0: [sdci] Write Protect is off [ 30.093897] sd 1:0:88:0: [sdci] Mode Sense: dd 00 10 08 [ 30.093935] sd 1:0:90:0: [sdck] Write Protect is off [ 30.093936] sd 1:0:90:0: [sdck] Mode Sense: dd 00 10 08 [ 30.094023] sd 1:0:91:0: [sdcl] Write Protect is off [ 30.094024] sd 1:0:91:0: [sdcl] Mode Sense: dd 00 10 08 [ 30.094267] sd 1:0:92:0: [sdcm] Write Protect is off [ 30.094268] sd 1:0:92:0: [sdcm] Mode Sense: dd 00 10 08 [ 30.094639] sd 1:0:94:0: [sdco] Write Protect is off [ 30.094639] sd 1:0:94:0: [sdco] Mode Sense: dd 00 10 08 [ 30.094672] sd 1:0:93:0: [sdcn] Write Protect is off [ 30.094672] sd 1:0:93:0: [sdcn] Mode Sense: dd 00 10 08 [ 30.094931] sd 10:0:85:0: [sdfx] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.094991] sd 10:0:86:0: [sdfy] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.095028] sd 10:0:87:0: [sdfz] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.095156] sd 10:0:90:0: [sdgc] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.095158] sd 10:0:88:0: [sdga] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.095203] sd 10:0:89:0: [sdgb] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.095296] sd 10:0:84:0: [sdfw] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.095323] sd 10:0:82:0: [sdfu] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.095377] sd 10:0:91:0: [sdgd] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.095580] sd 10:0:93:0: [sdgf] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.095641] sd 1:0:95:0: [sdcp] Write Protect is off [ 30.095642] sd 1:0:95:0: [sdcp] Mode Sense: dd 00 10 08 [ 30.095774] sd 10:0:92:0: [sdge] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.096177] sd 1:0:96:0: [sdcq] Write Protect is off [ 30.096177] sd 1:0:96:0: [sdcq] Mode Sense: dd 00 10 08 [ 30.096559] sd 1:0:97:0: [sdcr] Write Protect is off [ 30.096560] sd 1:0:97:0: [sdcr] Mode Sense: dd 00 10 08 [ 30.096665] sd 1:0:98:0: [sdcs] Write Protect is off [ 30.096666] sd 1:0:98:0: [sdcs] Mode Sense: dd 00 10 08 [ 30.097869] sd 10:0:94:0: [sdgg] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.097914] sd 10:0:95:0: [sdgh] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.098044] sd 10:0:98:0: [sdgk] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.098077] sd 10:0:97:0: [sdgj] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.098160] sd 10:0:96:0: [sdgi] 3750232064 4096-byte logical blocks: (15.0 TB/13.9 TiB) [ 30.099178] sd 1:0:80:0: [sdca] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.099428] sd 1:0:79:0: [sdbz] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.099906] sd 1:0:81:0: [sdcb] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.100661] sd 1:0:77:0: [sdbx] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.100712] sd 1:0:75:0: [sdbv] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.100781] sd 1:0:76:0: [sdbw] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.101374] sd 1:0:78:0: [sdby] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.101942] sd 10:0:75:0: [sdfn] Write Protect is off [ 30.101943] sd 10:0:75:0: [sdfn] Mode Sense: dd 00 10 08 [ 30.103058] sd 1:0:82:0: [sdcc] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.103366] sd 1:0:85:0: [sdcf] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.103490] sd 1:0:84:0: [sdce] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.103598] sd 1:0:83:0: [sdcd] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.103717] sd 1:0:87:0: [sdch] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.103770] sd 1:0:89:0: [sdcj] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.103848] sd 1:0:86:0: [sdcg] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.103895] sd 1:0:88:0: [sdci] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.103939] sd 1:0:90:0: [sdck] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.103973] sd 1:0:91:0: [sdcl] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.104230] sd 1:0:92:0: [sdcm] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.104589] sd 1:0:94:0: [sdco] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.104623] sd 1:0:93:0: [sdcn] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.105608] sd 1:0:95:0: [sdcp] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.106129] sd 1:0:96:0: [sdcq] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.106614] sd 1:0:98:0: [sdcs] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.106637] sd 1:0:97:0: [sdcr] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.107264] sd 10:0:75:0: [sdfn] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.107987] sd 10:0:2:0: [sdcv] Write Protect is off [ 30.107989] sd 10:0:2:0: [sdcv] Mode Sense: dd 00 10 08 [ 30.108048] sd 10:0:0:0: [sdct] Write Protect is off [ 30.108049] sd 10:0:0:0: [sdct] Mode Sense: dd 00 10 08 [ 30.108106] sd 10:0:1:0: [sdcu] Write Protect is off [ 30.108107] sd 10:0:1:0: [sdcu] Mode Sense: dd 00 10 08 [ 30.108752] sd 10:0:3:0: [sdcw] Write Protect is off [ 30.108753] sd 10:0:3:0: [sdcw] Mode Sense: dd 00 10 08 [ 30.110369] sd 10:0:7:0: [sdda] Write Protect is off [ 30.110370] sd 10:0:7:0: [sdda] Mode Sense: dd 00 10 08 [ 30.110677] sd 10:0:10:0: [sddd] Write Protect is off [ 30.110677] sd 10:0:10:0: [sddd] Mode Sense: dd 00 10 08 [ 30.110798] sd 10:0:9:0: [sddc] Write Protect is off [ 30.110799] sd 10:0:9:0: [sddc] Mode Sense: dd 00 10 08 [ 30.110923] sd 10:0:8:0: [sddb] Write Protect is off [ 30.110924] sd 10:0:8:0: [sddb] Mode Sense: dd 00 10 08 [ 30.111002] sd 10:0:12:0: [sddf] Write Protect is off [ 30.111003] sd 10:0:12:0: [sddf] Mode Sense: dd 00 10 08 [ 30.111131] sd 10:0:5:0: [sdcy] Write Protect is off [ 30.111132] sd 10:0:5:0: [sdcy] Mode Sense: dd 00 10 08 [ 30.111157] sd 10:0:11:0: [sdde] Write Protect is off [ 30.111157] sd 10:0:11:0: [sdde] Mode Sense: dd 00 10 08 [ 30.111196] sd 10:0:13:0: [sddg] Write Protect is off [ 30.111196] sd 10:0:13:0: [sddg] Mode Sense: dd 00 10 08 [ 30.111244] sd 10:0:15:0: [sddi] Write Protect is off [ 30.111244] sd 10:0:15:0: [sddi] Mode Sense: dd 00 10 08 [ 30.111286] sd 10:0:16:0: [sddj] Write Protect is off [ 30.111287] sd 10:0:16:0: [sddj] Mode Sense: dd 00 10 08 [ 30.111438] sd 10:0:4:0: [sdcx] Write Protect is off [ 30.111439] sd 10:0:4:0: [sdcx] Mode Sense: dd 00 10 08 [ 30.111531] sd 10:0:17:0: [sddk] Write Protect is off [ 30.111531] sd 10:0:17:0: [sddk] Mode Sense: dd 00 10 08 [ 30.111545] sd 10:0:14:0: [sddh] Write Protect is off [ 30.111546] sd 10:0:14:0: [sddh] Mode Sense: dd 00 10 08 [ 30.111550] sd 10:0:25:0: [sddr] Write Protect is off [ 30.111551] sd 10:0:25:0: [sddr] Mode Sense: dd 00 10 08 [ 30.111840] sd 10:0:6:0: [sdcz] Write Protect is off [ 30.111841] sd 10:0:6:0: [sdcz] Mode Sense: dd 00 10 08 [ 30.111901] sd 10:0:19:0: [sddm] Write Protect is off [ 30.111902] sd 10:0:19:0: [sddm] Mode Sense: dd 00 10 08 [ 30.111936] sd 10:0:18:0: [sddl] Write Protect is off [ 30.111937] sd 10:0:18:0: [sddl] Mode Sense: dd 00 10 08 [ 30.112194] sd 10:0:26:0: [sdds] Write Protect is off [ 30.112195] sd 10:0:26:0: [sdds] Mode Sense: dd 00 10 08 [ 30.112494] sd 10:0:27:0: [sddt] Write Protect is off [ 30.112495] sd 10:0:27:0: [sddt] Mode Sense: dd 00 10 08 [ 30.112904] sd 10:0:20:0: [sddn] Write Protect is off [ 30.112904] sd 10:0:20:0: [sddn] Mode Sense: dd 00 10 08 [ 30.113696] sd 10:0:32:0: [sddy] Write Protect is off [ 30.113697] sd 10:0:32:0: [sddy] Mode Sense: dd 00 10 08 [ 30.113702] sd 10:0:33:0: [sddz] Write Protect is off [ 30.113703] sd 10:0:33:0: [sddz] Mode Sense: dd 00 10 08 [ 30.113842] sd 10:0:36:0: [sdec] Write Protect is off [ 30.113843] sd 10:0:36:0: [sdec] Mode Sense: dd 00 10 08 [ 30.113902] sd 10:0:21:0: [sddo] Write Protect is off [ 30.113902] sd 10:0:21:0: [sddo] Mode Sense: dd 00 10 08 [ 30.113919] sd 10:0:23:0: [sddq] Write Protect is off [ 30.113919] sd 10:0:23:0: [sddq] Mode Sense: dd 00 10 08 [ 30.113956] sd 10:0:22:0: [sddp] Write Protect is off [ 30.113957] sd 10:0:22:0: [sddp] Mode Sense: dd 00 10 08 [ 30.114002] sd 10:0:29:0: [sddv] Write Protect is off [ 30.114002] sd 10:0:29:0: [sddv] Mode Sense: dd 00 10 08 [ 30.114007] sd 10:0:35:0: [sdeb] Write Protect is off [ 30.114007] sd 10:0:35:0: [sdeb] Mode Sense: dd 00 10 08 [ 30.114068] sd 10:0:30:0: [sddw] Write Protect is off [ 30.114069] sd 10:0:30:0: [sddw] Mode Sense: dd 00 10 08 [ 30.114228] sd 10:0:31:0: [sddx] Write Protect is off [ 30.114229] sd 10:0:31:0: [sddx] Mode Sense: dd 00 10 08 [ 30.114243] sd 10:0:28:0: [sddu] Write Protect is off [ 30.114243] sd 10:0:28:0: [sddu] Mode Sense: dd 00 10 08 [ 30.114319] sd 10:0:34:0: [sdea] Write Protect is off [ 30.114320] sd 10:0:34:0: [sdea] Mode Sense: dd 00 10 08 [ 30.114601] sd 10:0:51:0: [sdeq] Write Protect is off [ 30.114602] sd 10:0:51:0: [sdeq] Mode Sense: dd 00 10 08 [ 30.114627] sd 10:0:52:0: [sder] Write Protect is off [ 30.114628] sd 10:0:52:0: [sder] Mode Sense: dd 00 10 08 [ 30.114829] sd 10:0:41:0: [sdeh] Write Protect is off [ 30.114830] sd 10:0:41:0: [sdeh] Mode Sense: dd 00 10 08 [ 30.115016] sd 10:0:43:0: [sdej] Write Protect is off [ 30.115017] sd 10:0:43:0: [sdej] Mode Sense: dd 00 10 08 [ 30.115046] sd 10:0:50:0: [sdep] Write Protect is off [ 30.115047] sd 10:0:50:0: [sdep] Mode Sense: dd 00 10 08 [ 30.115076] sd 10:0:42:0: [sdei] Write Protect is off [ 30.115077] sd 10:0:42:0: [sdei] Mode Sense: dd 00 10 08 [ 30.115150] sd 10:0:44:0: [sdek] Write Protect is off [ 30.115151] sd 10:0:44:0: [sdek] Mode Sense: dd 00 10 08 [ 30.115179] sd 10:0:37:0: [sded] Write Protect is off [ 30.115179] sd 10:0:37:0: [sded] Mode Sense: dd 00 10 08 [ 30.115315] sd 10:0:56:0: [sdev] Write Protect is off [ 30.115315] sd 10:0:56:0: [sdev] Mode Sense: dd 00 10 08 [ 30.115329] sd 10:0:45:0: [sdel] Write Protect is off [ 30.115329] sd 10:0:45:0: [sdel] Mode Sense: dd 00 10 08 [ 30.115387] sd 10:0:53:0: [sdes] Write Protect is off [ 30.115387] sd 10:0:53:0: [sdes] Mode Sense: dd 00 10 08 [ 30.115404] sd 10:0:40:0: [sdeg] Write Protect is off [ 30.115404] sd 10:0:46:0: [sdem] Write Protect is off [ 30.115405] sd 10:0:40:0: [sdeg] Mode Sense: dd 00 10 08 [ 30.115405] sd 10:0:46:0: [sdem] Mode Sense: dd 00 10 08 [ 30.115469] sd 10:0:55:0: [sdeu] Write Protect is off [ 30.115470] sd 10:0:55:0: [sdeu] Mode Sense: dd 00 10 08 [ 30.115480] sd 10:0:47:0: [sden] Write Protect is off [ 30.115481] sd 10:0:47:0: [sden] Mode Sense: dd 00 10 08 [ 30.115492] sd 10:0:54:0: [sdet] Write Protect is off [ 30.115493] sd 10:0:54:0: [sdet] Mode Sense: dd 00 10 08 [ 30.116195] sd 10:0:48:0: [sdeo] Write Protect is off [ 30.116195] sd 10:0:48:0: [sdeo] Mode Sense: dd 00 10 08 [ 30.116514] sd 10:0:39:0: [sdef] Write Protect is off [ 30.116515] sd 10:0:39:0: [sdef] Mode Sense: dd 00 10 08 [ 30.116547] sd 10:0:38:0: [sdee] Write Protect is off [ 30.116548] sd 10:0:38:0: [sdee] Mode Sense: dd 00 10 08 [ 30.117242] sd 10:0:60:0: [sdez] Write Protect is off [ 30.117243] sd 10:0:60:0: [sdez] Mode Sense: dd 00 10 08 [ 30.117275] sd 10:0:59:0: [sdey] Write Protect is off [ 30.117275] sd 10:0:59:0: [sdey] Mode Sense: dd 00 10 08 [ 30.117436] sd 10:0:65:0: [sdfe] Write Protect is off [ 30.117436] sd 10:0:65:0: [sdfe] Mode Sense: dd 00 10 08 [ 30.117439] sd 10:0:63:0: [sdfc] Write Protect is off [ 30.117439] sd 10:0:63:0: [sdfc] Mode Sense: dd 00 10 08 [ 30.117503] sd 10:0:64:0: [sdfd] Write Protect is off [ 30.117503] sd 10:0:64:0: [sdfd] Mode Sense: dd 00 10 08 [ 30.117570] sd 10:0:58:0: [sdex] Write Protect is off [ 30.117571] sd 10:0:58:0: [sdex] Mode Sense: dd 00 10 08 [ 30.117608] sd 10:0:57:0: [sdew] Write Protect is off [ 30.117608] sd 10:0:57:0: [sdew] Mode Sense: dd 00 10 08 [ 30.117868] sd 10:0:61:0: [sdfa] Write Protect is off [ 30.117868] sd 10:0:61:0: [sdfa] Mode Sense: dd 00 10 08 [ 30.117896] sd 10:0:66:0: [sdff] Write Protect is off [ 30.117897] sd 10:0:66:0: [sdff] Mode Sense: dd 00 10 08 [ 30.117923] sd 10:0:62:0: [sdfb] Write Protect is off [ 30.117923] sd 10:0:62:0: [sdfb] Mode Sense: dd 00 10 08 [ 30.117937] sd 10:0:2:0: [sdcv] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.118013] sd 10:0:0:0: [sdct] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.118186] sd 10:0:1:0: [sdcu] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.118546] sd 10:0:71:0: [sdfk] Write Protect is off [ 30.118547] sd 10:0:71:0: [sdfk] Mode Sense: dd 00 10 08 [ 30.118763] sd 10:0:3:0: [sdcw] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.119049] sd 10:0:72:0: [sdfl] Write Protect is off [ 30.119049] sd 10:0:72:0: [sdfl] Mode Sense: dd 00 10 08 [ 30.119491] sd 10:0:73:0: [sdfm] Write Protect is off [ 30.119492] sd 10:0:73:0: [sdfm] Mode Sense: dd 00 10 08 [ 30.119898] sd 10:0:5:0: [sdcy] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.119946] sd 10:0:68:0: [sdfh] Write Protect is off [ 30.119947] sd 10:0:68:0: [sdfh] Mode Sense: dd 00 10 08 [ 30.120150] sd 10:0:4:0: [sdcx] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.120325] sd 10:0:7:0: [sdda] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.120369] sd 10:0:67:0: [sdfg] Write Protect is off [ 30.120369] sd 10:0:67:0: [sdfg] Mode Sense: dd 00 10 08 [ 30.120482] sd 10:0:69:0: [sdfi] Write Protect is off [ 30.120483] sd 10:0:69:0: [sdfi] Mode Sense: dd 00 10 08 [ 30.120494] sd 10:0:6:0: [sdcz] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.120621] sd 10:0:70:0: [sdfj] Write Protect is off [ 30.120622] sd 10:0:70:0: [sdfj] Mode Sense: dd 00 10 08 [ 30.120679] sd 10:0:10:0: [sddd] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.120866] sd 10:0:8:0: [sddb] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.121007] sd 10:0:12:0: [sddf] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.121112] sd 10:0:11:0: [sdde] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.121206] sd 10:0:15:0: [sddi] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.121264] sd 10:0:16:0: [sddj] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.121303] sd 10:0:9:0: [sddc] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.121493] sd 10:0:25:0: [sddr] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.121524] sd 10:0:14:0: [sddh] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.121661] sd 10:0:13:0: [sddg] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.121843] sd 10:0:19:0: [sddm] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.121876] sd 10:0:18:0: [sddl] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.121985] sd 10:0:17:0: [sddk] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.122129] sd 10:0:26:0: [sdds] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.122763] sd 10:0:27:0: [sddt] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.122850] sd 10:0:20:0: [sddn] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.123640] sd 10:0:76:0: [sdfo] Write Protect is off [ 30.123641] sd 10:0:76:0: [sdfo] Mode Sense: dd 00 10 08 [ 30.123713] sd 10:0:33:0: [sddz] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.123822] sd 10:0:36:0: [sdec] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.123849] sd 10:0:77:0: [sdfp] Write Protect is off [ 30.123850] sd 10:0:77:0: [sdfp] Mode Sense: dd 00 10 08 [ 30.123905] sd 10:0:21:0: [sddo] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.124012] sd 10:0:35:0: [sdeb] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.124025] sd 10:0:29:0: [sddv] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.124083] sd 10:0:32:0: [sddy] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.124135] sd 10:0:30:0: [sddw] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.124176] sd 10:0:31:0: [sddx] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.124220] sd 10:0:23:0: [sddq] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.124236] sd 10:0:28:0: [sddu] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.124396] sd 10:0:22:0: [sddp] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.124397] sd 10:0:34:0: [sdea] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.124397] sd 10:0:78:0: [sdfq] Write Protect is off [ 30.124398] sd 10:0:78:0: [sdfq] Mode Sense: dd 00 10 08 [ 30.124548] sd 10:0:51:0: [sdeq] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.124578] sd 10:0:52:0: [sder] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.124589] sd 10:0:79:0: [sdfr] Write Protect is off [ 30.124590] sd 10:0:79:0: [sdfr] Mode Sense: dd 00 10 08 [ 30.124773] sd 10:0:41:0: [sdeh] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.124964] sd 10:0:43:0: [sdej] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.124996] sd 10:0:50:0: [sdep] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.125178] sd 10:0:37:0: [sded] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.125265] sd 10:0:56:0: [sdev] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.125332] sd 10:0:45:0: [sdel] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.125345] sd 10:0:40:0: [sdeg] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.125394] sd 10:0:53:0: [sdes] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.125394] sd 10:0:44:0: [sdek] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.125433] sd 10:0:42:0: [sdei] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.125444] sd 10:0:46:0: [sdem] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.125513] sd 10:0:54:0: [sdet] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.125530] sd 10:0:55:0: [sdeu] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.125575] sd 10:0:47:0: [sden] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.126282] sd 10:0:48:0: [sdeo] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.126487] sd 10:0:39:0: [sdef] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.126496] sd 10:0:38:0: [sdee] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.127134] sd 10:0:83:0: [sdfv] Write Protect is off [ 30.127135] sd 10:0:83:0: [sdfv] Mode Sense: dd 00 10 08 [ 30.127283] sd 10:0:60:0: [sdez] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.127312] sd 10:0:59:0: [sdey] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.127453] sd 10:0:81:0: [sdft] Write Protect is off [ 30.127453] sd 10:0:81:0: [sdft] Mode Sense: dd 00 10 08 [ 30.127510] sd 10:0:58:0: [sdex] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.127528] sd 10:0:64:0: [sdfd] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.127538] sd 10:0:80:0: [sdfs] Write Protect is off [ 30.127539] sd 10:0:80:0: [sdfs] Mode Sense: dd 00 10 08 [ 30.127556] sd 10:0:57:0: [sdew] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.127568] sd 10:0:63:0: [sdfc] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.127720] sd 10:0:65:0: [sdfe] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.127851] sd 10:0:66:0: [sdff] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.128213] sd 10:0:62:0: [sdfb] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.128314] sd 10:0:61:0: [sdfa] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.128629] sd 10:0:71:0: [sdfk] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.128756] sd 10:0:85:0: [sdfx] Write Protect is off [ 30.128756] sd 10:0:85:0: [sdfx] Mode Sense: dd 00 10 08 [ 30.128802] sd 10:0:86:0: [sdfy] Write Protect is off [ 30.128803] sd 10:0:86:0: [sdfy] Mode Sense: dd 00 10 08 [ 30.128900] sd 10:0:88:0: [sdga] Write Protect is off [ 30.128900] sd 10:0:88:0: [sdga] Mode Sense: dd 00 10 08 [ 30.128963] sd 10:0:72:0: [sdfl] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.129127] sd 10:0:90:0: [sdgc] Write Protect is off [ 30.129128] sd 10:0:90:0: [sdgc] Mode Sense: dd 00 10 08 [ 30.129154] sd 10:0:84:0: [sdfw] Write Protect is off [ 30.129155] sd 10:0:84:0: [sdfw] Mode Sense: dd 00 10 08 [ 30.129195] sd 10:0:87:0: [sdfz] Write Protect is off [ 30.129195] sd 10:0:87:0: [sdfz] Mode Sense: dd 00 10 08 [ 30.129345] sd 10:0:89:0: [sdgb] Write Protect is off [ 30.129345] sd 10:0:89:0: [sdgb] Mode Sense: dd 00 10 08 [ 30.129440] sd 10:0:73:0: [sdfm] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.129526] sd 10:0:93:0: [sdgf] Write Protect is off [ 30.129526] sd 10:0:93:0: [sdgf] Mode Sense: dd 00 10 08 [ 30.129528] sd 10:0:91:0: [sdgd] Write Protect is off [ 30.129529] sd 10:0:91:0: [sdgd] Mode Sense: dd 00 10 08 [ 30.129606] sd 10:0:92:0: [sdge] Write Protect is off [ 30.129606] sd 10:0:92:0: [sdge] Mode Sense: dd 00 10 08 [ 30.129647] sd 10:0:82:0: [sdfu] Write Protect is off [ 30.129647] sd 10:0:82:0: [sdfu] Mode Sense: dd 00 10 08 [ 30.130296] sd 10:0:68:0: [sdfh] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.130675] sd 10:0:67:0: [sdfg] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.130943] sd 10:0:70:0: [sdfj] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.131247] sd 10:0:69:0: [sdfi] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.131671] sd 10:0:95:0: [sdgh] Write Protect is off [ 30.131672] sd 10:0:95:0: [sdgh] Mode Sense: dd 00 10 08 [ 30.131717] sd 10:0:94:0: [sdgg] Write Protect is off [ 30.131717] sd 10:0:94:0: [sdgg] Mode Sense: dd 00 10 08 [ 30.131859] sd 10:0:98:0: [sdgk] Write Protect is off [ 30.131859] sd 10:0:98:0: [sdgk] Mode Sense: dd 00 10 08 [ 30.132278] sd 10:0:97:0: [sdgj] Write Protect is off [ 30.132279] sd 10:0:97:0: [sdgj] Mode Sense: dd 00 10 08 [ 30.132407] sd 10:0:96:0: [sdgi] Write Protect is off [ 30.132408] sd 10:0:96:0: [sdgi] Mode Sense: dd 00 10 08 [ 30.133938] sd 10:0:76:0: [sdfo] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.133966] sd 10:0:79:0: [sdfr] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.134249] sd 10:0:77:0: [sdfp] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.135045] sd 10:0:78:0: [sdfq] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.137137] sd 10:0:83:0: [sdfv] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.137406] sd 10:0:81:0: [sdft] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.137521] sd 10:0:80:0: [sdfs] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.138853] sd 10:0:88:0: [sdga] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.139075] sd 10:0:90:0: [sdgc] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.139150] sd 10:0:87:0: [sdfz] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.139290] sd 10:0:89:0: [sdgb] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.139479] sd 10:0:93:0: [sdgf] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.139482] sd 10:0:91:0: [sdgd] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.139575] sd 10:0:92:0: [sdge] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.139682] sd 10:0:82:0: [sdfu] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.139759] sd 10:0:85:0: [sdfx] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.139788] sd 10:0:86:0: [sdfy] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.140518] sd 10:0:84:0: [sdfw] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.141664] sd 10:0:95:0: [sdgh] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.141672] sd 10:0:94:0: [sdgg] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.141803] sd 10:0:98:0: [sdgk] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.142225] sd 10:0:97:0: [sdgj] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.142368] sd 10:0:96:0: [sdgi] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 30.182712] sd 10:0:75:0: [sdfn] Attached SCSI disk [ 30.212154] sd 1:0:5:0: [sdg] Attached SCSI disk [ 30.213481] sd 1:0:21:0: [sdw] Attached SCSI disk [ 30.214167] sd 1:0:23:0: [sdy] Attached SCSI disk [ 30.214497] sd 1:0:19:0: [sdu] Attached SCSI disk [ 30.215940] sd 1:0:8:0: [sdj] Attached SCSI disk [ 30.216243] sd 1:0:7:0: [sdi] Attached SCSI disk [ 30.216827] sd 1:0:11:0: [sdm] Attached SCSI disk [ 30.217324] sd 1:0:10:0: [sdl] Attached SCSI disk [ 30.217574] sd 1:0:6:0: [sdh] Attached SCSI disk [ 30.217668] sd 1:0:4:0: [sdf] Attached SCSI disk [ 30.217790] sd 1:0:22:0: [sdx] Attached SCSI disk [ 30.218498] sd 1:0:1:0: [sdc] Attached SCSI disk [ 30.219906] sd 1:0:9:0: [sdk] Attached SCSI disk [ 30.220560] sd 1:0:14:0: [sdp] Attached SCSI disk [ 30.220964] sd 1:0:12:0: [sdn] Attached SCSI disk [ 30.221385] sd 1:0:20:0: [sdv] Attached SCSI disk [ 30.222356] sd 1:0:2:0: [sdd] Attached SCSI disk [ 30.223621] sd 1:0:13:0: [sdo] Attached SCSI disk [ 30.223873] sd 1:0:16:0: [sdr] Attached SCSI disk [ 30.224097] sd 1:0:15:0: [sdq] Attached SCSI disk [ 30.224553] sd 1:0:3:0: [sde] Attached SCSI disk [ 30.226383] sd 1:0:18:0: [sdt] Attached SCSI disk [ 30.228822] sd 1:0:41:0: [sdap] Attached SCSI disk [ 30.228855] sd 1:0:46:0: [sdau] Attached SCSI disk [ 30.229139] sd 1:0:35:0: [sdaj] Attached SCSI disk [ 30.229209] sd 1:0:32:0: [sdag] Attached SCSI disk [ 30.229697] sd 1:0:43:0: [sdar] Attached SCSI disk [ 30.229894] sd 1:0:47:0: [sdav] Attached SCSI disk [ 30.230023] sd 1:0:17:0: [sds] Attached SCSI disk [ 30.230077] sd 1:0:37:0: [sdal] Attached SCSI disk [ 30.230369] sd 1:0:48:0: [sdaw] Attached SCSI disk [ 30.230890] sd 1:0:33:0: [sdah] Attached SCSI disk [ 30.231002] sd 1:0:45:0: [sdat] Attached SCSI disk [ 30.231018] sd 1:0:34:0: [sdai] Attached SCSI disk [ 30.231477] sd 1:0:44:0: [sdas] Attached SCSI disk [ 30.231605] sd 1:0:39:0: [sdan] Attached SCSI disk [ 30.232930] sd 1:0:42:0: [sdaq] Attached SCSI disk [ 30.233329] sd 1:0:40:0: [sdao] Attached SCSI disk [ 30.234114] sd 1:0:36:0: [sdak] Attached SCSI disk [ 30.235499] sd 1:0:27:0: [sdab] Attached SCSI disk [ 30.235841] sd 1:0:26:0: [sdaa] Attached SCSI disk [ 30.237185] sd 1:0:31:0: [sdaf] Attached SCSI disk [ 30.238622] sd 1:0:38:0: [sdam] Attached SCSI disk [ 30.239484] sd 1:0:66:0: [sdbn] Attached SCSI disk [ 30.240344] sd 1:0:65:0: [sdbm] Attached SCSI disk [ 30.240765] sd 1:0:63:0: [sdbk] Attached SCSI disk [ 30.242065] sd 1:0:67:0: [sdbo] Attached SCSI disk [ 30.242119] sd 1:0:64:0: [sdbl] Attached SCSI disk [ 30.243795] sd 10:0:1:0: [sdcu] Attached SCSI disk [ 30.243875] sd 1:0:60:0: [sdbh] Attached SCSI disk [ 30.244616] sd 1:0:59:0: [sdbg] Attached SCSI disk [ 30.245232] sd 1:0:61:0: [sdbi] Attached SCSI disk [ 30.245833] sd 1:0:72:0: [sdbt] Attached SCSI disk [ 30.246023] sd 1:0:58:0: [sdbf] Attached SCSI disk [ 30.246661] sd 1:0:56:0: [sdbd] Attached SCSI disk [ 30.246807] sd 10:0:21:0: [sddo] Attached SCSI disk [ 30.246953] sd 1:0:57:0: [sdbe] Attached SCSI disk [ 30.247995] sd 1:0:62:0: [sdbj] Attached SCSI disk [ 30.249697] sd 1:0:73:0: [sdbu] Attached SCSI disk [ 30.249960] sd 1:0:86:0: [sdcg] Attached SCSI disk [ 30.250413] sd 1:0:84:0: [sdce] Attached SCSI disk [ 30.252266] sd 1:0:25:0: [sdz] Attached SCSI disk [ 30.252335] sd 1:0:98:0: [sdcs] Attached SCSI disk [ 30.252676] sd 1:0:28:0: [sdac] Attached SCSI disk [ 30.252754] sd 1:0:29:0: [sdad] Attached SCSI disk [ 30.254259] sd 1:0:85:0: [sdcf] Attached SCSI disk [ 30.254962] sd 10:0:5:0: [sdcy] Attached SCSI disk [ 30.255237] sd 1:0:30:0: [sdae] Attached SCSI disk [ 30.255248] sd 10:0:2:0: [sdcv] Attached SCSI disk [ 30.258091] sd 1:0:81:0: [sdcb] Attached SCSI disk [ 30.258510] sd 1:0:97:0: [sdcr] Attached SCSI disk [ 30.259824] sd 10:0:83:0: [sdfv] Attached SCSI disk [ 30.259858] sd 10:0:81:0: [sdft] Attached SCSI disk [ 30.259965] sd 10:0:88:0: [sdga] Attached SCSI disk [ 30.259993] sd 10:0:57:0: [sdew] Attached SCSI disk [ 30.260290] sd 10:0:85:0: [sdfx] Attached SCSI disk [ 30.260366] sd 10:0:64:0: [sdfd] Attached SCSI disk [ 30.260443] sd 10:0:63:0: [sdfc] Attached SCSI disk [ 30.260786] sd 10:0:59:0: [sdey] Attached SCSI disk [ 30.260873] sd 10:0:62:0: [sdfb] Attached SCSI disk [ 30.261241] sd 10:0:60:0: [sdez] Attached SCSI disk [ 30.261346] sd 10:0:82:0: [sdfu] Attached SCSI disk [ 30.261615] sd 1:0:87:0: [sdch] Attached SCSI disk [ 30.261617] sd 10:0:89:0: [sdgb] Attached SCSI disk [ 30.261796] sd 10:0:87:0: [sdfz] Attached SCSI disk [ 30.261822] sd 10:0:77:0: [sdfp] Attached SCSI disk [ 30.262125] sd 10:0:84:0: [sdfw] Attached SCSI disk [ 30.262187] sd 1:0:88:0: [sdci] Attached SCSI disk [ 30.262448] sd 10:0:98:0: [sdgk] Attached SCSI disk [ 30.262608] sd 1:0:83:0: [sdcd] Attached SCSI disk [ 30.262665] sd 1:0:53:0: [sdba] Attached SCSI disk [ 30.262707] sd 1:0:54:0: [sdbb] Attached SCSI disk [ 30.262784] sd 10:0:76:0: [sdfo] Attached SCSI disk [ 30.262795] sd 10:0:58:0: [sdex] Attached SCSI disk [ 30.262949] sd 10:0:86:0: [sdfy] Attached SCSI disk [ 30.262963] sd 10:0:96:0: [sdgi] Attached SCSI disk [ 30.263094] sd 10:0:61:0: [sdfa] Attached SCSI disk [ 30.263155] sd 10:0:93:0: [sdgf] Attached SCSI disk [ 30.263579] sd 10:0:51:0: [sdeq] Attached SCSI disk [ 30.263658] sd 10:0:79:0: [sdfr] Attached SCSI disk [ 30.263734] sd 1:0:55:0: [sdbc] Attached SCSI disk [ 30.263910] sd 10:0:66:0: [sdff] Attached SCSI disk [ 30.263971] sd 10:0:68:0: [sdfh] Attached SCSI disk [ 30.264042] sd 10:0:71:0: [sdfk] Attached SCSI disk [ 30.264095] sd 10:0:52:0: [sder] Attached SCSI disk [ 30.264240] sd 10:0:94:0: [sdgg] Attached SCSI disk [ 30.264338] sd 10:0:4:0: [sdcx] Attached SCSI disk [ 30.264496] sd 10:0:97:0: [sdgj] Attached SCSI disk [ 30.264648] sd 10:0:56:0: [sdev] Attached SCSI disk [ 30.264912] sd 1:0:68:0: [sdbp] Attached SCSI disk [ 30.265013] sd 10:0:50:0: [sdep] Attached SCSI disk [ 30.265186] sd 10:0:95:0: [sdgh] Attached SCSI disk [ 30.265328] sd 10:0:72:0: [sdfl] Attached SCSI disk [ 30.265378] sd 10:0:90:0: [sdgc] Attached SCSI disk [ 30.265399] sd 10:0:92:0: [sdge] Attached SCSI disk [ 30.265567] sd 10:0:73:0: [sdfm] Attached SCSI disk [ 30.265602] sd 10:0:91:0: [sdgd] Attached SCSI disk [ 30.265643] sd 10:0:69:0: [sdfi] Attached SCSI disk [ 30.265658] sd 10:0:70:0: [sdfj] Attached SCSI disk [ 30.265748] sd 10:0:35:0: [sdeb] Attached SCSI disk [ 30.265807] sd 1:0:50:0: [sdax] Attached SCSI disk [ 30.265902] sd 10:0:38:0: [sdee] Attached SCSI disk [ 30.266076] sd 10:0:67:0: [sdfg] Attached SCSI disk [ 30.266178] sd 1:0:93:0: [sdcn] Attached SCSI disk [ 30.266388] sd 10:0:39:0: [sdef] Attached SCSI disk [ 30.266403] sd 10:0:65:0: [sdfe] Attached SCSI disk [ 30.266416] sd 1:0:51:0: [sday] Attached SCSI disk [ 30.266578] sd 10:0:33:0: [sddz] Attached SCSI disk [ 30.266685] sd 1:0:91:0: [sdcl] Attached SCSI disk [ 30.266698] sd 1:0:82:0: [sdcc] Attached SCSI disk [ 30.266701] sd 10:0:80:0: [sdfs] Attached SCSI disk [ 30.266833] sd 1:0:92:0: [sdcm] Attached SCSI disk [ 30.267141] sd 1:0:94:0: [sdco] Attached SCSI disk [ 30.267213] sd 10:0:31:0: [sddx] Attached SCSI disk [ 30.267241] sd 10:0:36:0: [sdec] Attached SCSI disk [ 30.267352] sd 10:0:78:0: [sdfq] Attached SCSI disk [ 30.267547] sd 10:0:46:0: [sdem] Attached SCSI disk [ 30.267588] sd 10:0:55:0: [sdeu] Attached SCSI disk [ 30.267601] sd 10:0:37:0: [sded] Attached SCSI disk [ 30.267617] sd 10:0:32:0: [sddy] Attached SCSI disk [ 30.267750] sd 10:0:53:0: [sdes] Attached SCSI disk [ 30.267787] sd 10:0:54:0: [sdet] Attached SCSI disk [ 30.267829] sd 1:0:52:0: [sdaz] Attached SCSI disk [ 30.267872] sd 1:0:89:0: [sdcj] Attached SCSI disk [ 30.268113] sd 10:0:25:0: [sddr] Attached SCSI disk [ 30.268717] sd 10:0:26:0: [sdds] Attached SCSI disk [ 30.268939] sd 10:0:34:0: [sdea] Attached SCSI disk [ 30.269507] sd 1:0:70:0: [sdbr] Attached SCSI disk [ 30.270027] sd 10:0:47:0: [sden] Attached SCSI disk [ 30.270128] sd 1:0:75:0: [sdbv] Attached SCSI disk [ 30.270139] sd 10:0:27:0: [sddt] Attached SCSI disk [ 30.270387] sd 1:0:69:0: [sdbq] Attached SCSI disk [ 30.270861] sd 1:0:71:0: [sdbs] Attached SCSI disk [ 30.271190] sd 10:0:12:0: [sddf] Attached SCSI disk [ 30.271376] sd 10:0:6:0: [sdcz] Attached SCSI disk [ 30.271601] sd 10:0:41:0: [sdeh] Attached SCSI disk [ 30.271613] sd 10:0:48:0: [sdeo] Attached SCSI disk [ 30.271778] sd 10:0:13:0: [sddg] Attached SCSI disk [ 30.271801] sd 10:0:45:0: [sdel] Attached SCSI disk [ 30.271818] sd 10:0:43:0: [sdej] Attached SCSI disk [ 30.272102] sd 10:0:11:0: [sdde] Attached SCSI disk [ 30.272123] sd 1:0:76:0: [sdbw] Attached SCSI disk [ 30.272251] sd 1:0:77:0: [sdbx] Attached SCSI disk [ 30.272330] sd 10:0:28:0: [sddu] Attached SCSI disk [ 30.272345] sd 10:0:7:0: [sdda] Attached SCSI disk [ 30.272371] sd 10:0:9:0: [sddc] Attached SCSI disk [ 30.272413] sd 10:0:40:0: [sdeg] Attached SCSI disk [ 30.272431] sd 10:0:0:0: [sdct] Attached SCSI disk [ 30.272474] sd 10:0:14:0: [sddh] Attached SCSI disk [ 30.272676] sd 10:0:29:0: [sddv] Attached SCSI disk [ 30.272689] sd 10:0:44:0: [sdek] Attached SCSI disk [ 30.272886] sd 10:0:20:0: [sddn] Attached SCSI disk [ 30.273135] sd 10:0:42:0: [sdei] Attached SCSI disk [ 30.273263] sd 10:0:8:0: [sddb] Attached SCSI disk [ 30.273306] sd 10:0:15:0: [sddi] Attached SCSI disk [ 30.273358] sd 10:0:30:0: [sddw] Attached SCSI disk [ 30.273397] sd 1:0:80:0: [sdca] Attached SCSI disk [ 30.273944] sd 10:0:10:0: [sddd] Attached SCSI disk [ 30.274227] sd 1:0:78:0: [sdby] Attached SCSI disk [ 30.276202] sd 10:0:23:0: [sddq] Attached SCSI disk [ 30.276266] sd 10:0:16:0: [sddj] Attached SCSI disk [ 30.276568] sd 10:0:3:0: [sdcw] Attached SCSI disk [ 30.276583] sd 10:0:17:0: [sddk] Attached SCSI disk [ 30.276659] sd 1:0:90:0: [sdck] Attached SCSI disk [ 30.276712] sd 10:0:19:0: [sddm] Attached SCSI disk [ 30.276770] sd 10:0:18:0: [sddl] Attached SCSI disk [ 30.277537] sd 1:0:95:0: [sdcp] Attached SCSI disk [ 30.277816] sd 10:0:22:0: [sddp] Attached SCSI disk [ 30.278613] sd 1:0:96:0: [sdcq] Attached SCSI disk [ 30.278761] sd 1:0:79:0: [sdbz] Attached SCSI disk [ 35.146214] sd 1:0:0:0: [sdb] Write Protect is off [ 35.151133] sd 1:0:0:0: [sdb] Mode Sense: dd 00 10 08 [ 35.155510] sd 1:0:0:0: [sdb] Write cache: enabled, read cache: enabled, supports DPO and FUA [ 35.255191] sd 1:0:0:0: [sdb] Attached SCSI disk [ 35.501788] EXT4-fs (sda2): mounted filesystem with ordered data mode. Opts: (null) [ 35.755586] systemd-journald[448]: Received SIGTERM from PID 1 (systemd). [ 35.782706] SELinux: Disabled at runtime. [ 35.787462] SELinux: Unregistering netfilter hooks [ 35.829821] type=1404 audit(1706808075.809:2): selinux=0 auid=4294967295 ses=4294967295 [ 35.852488] ip_tables: (C) 2000-2006 Netfilter Core Team [ 35.859357] systemd[1]: Inserted module 'ip_tables' [ 35.934675] EXT4-fs (sda2): re-mounted. Opts: (null) [ 35.953641] systemd-journald[1847]: Received request to flush runtime journal from PID 1 [ 36.067113] device-mapper: uevent: version 1.0.3 [ 36.072839] device-mapper: ioctl: 4.37.1-ioctl (2018-04-03) initialised: dm-devel@redhat.com [ 36.103000] mlx5_core 0000:a1:00.0: slow_pci_heuristic:6365:(pid 2092): Max link speed = 200000, PCI BW = 252048 [ 36.113777] mlx5_core 0000:a1:00.0: MLX5E: StrdRq(0) RqSz(1024) StrdSz(256) RxCqeCmprss(0) [ 36.123291] mlx5_core 0000:a1:00.0: MLX5E: StrdRq(0) RqSz(1024) StrdSz(256) RxCqeCmprss(0) [ 36.253372] xprtrdma: xprtrdma is obsoleted, loading rpcrdma instead [ 37.172715] ACPI Error: No handler for Region [SYSI] (ffff9e055f5bce58) [IPMI] (20130517/evregion-162) [ 37.182068] ACPI Error: Region IPMI (ID=7) has no handler (20130517/exfldio-305) [ 37.189531] ACPI Error: Method parse/execution failed [\_SB_.PMI0._GHL] (Node ffff9e2396394870), AE_NOT_EXIST (20130517/psparse-536) [ 37.201550] ACPI Error: Method parse/execution failed [\_SB_.PMI0._PMC] (Node ffff9e23963947b0), AE_NOT_EXIST (20130517/psparse-536) [ 37.213609] ACPI Exception: AE_NOT_EXIST, Evaluating _PMC (20130517/power_meter-753) [ 37.263140] IPMI message handler: version 39.2 [ 37.269103] ipmi device interface [ 37.276435] ipmi_si: IPMI System Interface driver [ 37.281193] ipmi_si dmi-ipmi-si.0: probing via SMBIOS [ 37.286262] ipmi_platform: ipmi_si: SMBIOS: io 0xca8 regsize 1 spacing 4 irq 10 [ 37.293589] ipmi_si: Adding SMBIOS-specified kcs state machine [ 37.299463] ipmi_si IPI0001:00: probing via ACPI [ 37.304124] ipmi_si IPI0001:00: [io 0x0ca8] regsize 1 spacing 4 irq 10 [ 37.310741] ipmi_si dmi-ipmi-si.0: Removing SMBIOS-specified kcs state machine in favor of ACPI [ 37.328843] ipmi_si: Adding ACPI-specified kcs state machine [ 37.334654] ipmi_si: Trying ACPI-specified kcs state machine at i/o address 0xca8, slave address 0x20, irq 10 [ 37.363897] wmi_bus wmi_bus-PNP0C14:00: WQBC data block query control method not found [ 37.372205] piix4_smbus 0000:00:14.0: SMBus Host Controller at 0xb00, revision 0 [ 37.379604] piix4_smbus 0000:00:14.0: Using register 0x2e for SMBus port selection [ 37.388187] sd 0:2:0:0: Attached scsi generic sg0 type 0 [ 37.393698] sd 1:0:0:0: Attached scsi generic sg1 type 0 [ 37.399319] sd 1:0:1:0: Attached scsi generic sg2 type 0 [ 37.404687] sd 1:0:2:0: Attached scsi generic sg3 type 0 [ 37.410051] sd 1:0:3:0: Attached scsi generic sg4 type 0 [ 37.410734] ipmi_si IPI0001:00: The BMC does not support setting the recv irq bit, compensating, but the BMC needs to be fixed. [ 37.427729] sd 1:0:4:0: Attached scsi generic sg5 type 0 [ 37.433243] sd 1:0:5:0: Attached scsi generic sg6 type 0 [ 37.439377] sd 1:0:6:0: Attached scsi generic sg7 type 0 [ 37.439849] ipmi_si IPI0001:00: Using irq 10 [ 37.449445] sd 1:0:7:0: Attached scsi generic sg8 type 0 [ 37.453066] ipmi_si IPI0001:00: Found new BMC (man_id: 0x0002a2, prod_id: 0x0100, dev_id: 0x20) [ 37.463511] sd 1:0:8:0: Attached scsi generic sg9 type 0 [ 37.468912] sd 1:0:9:0: Attached scsi generic sg10 type 0 [ 37.469076] cdc_ether 3-1.3:1.0 eth0: register 'cdc_ether' at usb-0000:22:00.3-1.3, CDC Ethernet Device, c4:5a:b1:b0:91:35 [ 37.469103] usbcore: registered new interface driver cdc_ether [ 37.491217] sd 1:0:10:0: Attached scsi generic sg11 type 0 [ 37.496884] sd 1:0:11:0: Attached scsi generic sg12 type 0 [ 37.497665] ipmi_si IPI0001:00: IPMI kcs interface initialized [ 37.508250] sd 1:0:12:0: Attached scsi generic sg13 type 0 [ 37.513905] sd 1:0:13:0: Attached scsi generic sg14 type 0 [ 37.519430] sd 1:0:14:0: Attached scsi generic sg15 type 0 [ 37.525070] sd 1:0:15:0: Attached scsi generic sg16 type 0 [ 37.530655] sd 1:0:16:0: Attached scsi generic sg17 type 0 [ 37.536206] sd 1:0:17:0: Attached scsi generic sg18 type 0 [ 37.541766] sd 1:0:18:0: Attached scsi generic sg19 type 0 [ 37.547305] sd 1:0:19:0: Attached scsi generic sg20 type 0 [ 37.552956] sd 1:0:20:0: Attached scsi generic sg21 type 0 [ 37.558490] sd 1:0:21:0: Attached scsi generic sg22 type 0 [ 37.564068] sd 1:0:22:0: Attached scsi generic sg23 type 0 [ 37.569627] sd 1:0:23:0: Attached scsi generic sg24 type 0 [ 37.575175] scsi 1:0:24:0: Attached scsi generic sg25 type 13 [ 37.580972] sd 1:0:25:0: Attached scsi generic sg26 type 0 [ 37.586521] sd 1:0:26:0: Attached scsi generic sg27 type 0 [ 37.592080] sd 1:0:27:0: Attached scsi generic sg28 type 0 [ 37.597671] sd 1:0:28:0: Attached scsi generic sg29 type 0 [ 37.603223] sd 1:0:29:0: Attached scsi generic sg30 type 0 [ 37.608766] sd 1:0:30:0: Attached scsi generic sg31 type 0 [ 37.614310] sd 1:0:31:0: Attached scsi generic sg32 type 0 [ 37.619835] sd 1:0:32:0: Attached scsi generic sg33 type 0 [ 37.625394] sd 1:0:33:0: Attached scsi generic sg34 type 0 [ 37.630983] sd 1:0:34:0: Attached scsi generic sg35 type 0 [ 37.636520] sd 1:0:35:0: Attached scsi generic sg36 type 0 [ 37.642065] sd 1:0:36:0: Attached scsi generic sg37 type 0 [ 37.647655] sd 1:0:37:0: Attached scsi generic sg38 type 0 [ 37.653205] sd 1:0:38:0: Attached scsi generic sg39 type 0 [ 37.658747] sd 1:0:39:0: Attached scsi generic sg40 type 0 [ 37.664263] sd 1:0:40:0: Attached scsi generic sg41 type 0 [ 37.669859] sd 1:0:41:0: Attached scsi generic sg42 type 0 [ 37.675431] sd 1:0:42:0: Attached scsi generic sg43 type 0 [ 37.680956] sd 1:0:43:0: Attached scsi generic sg44 type 0 [ 37.686490] sd 1:0:44:0: Attached scsi generic sg45 type 0 [ 37.692016] sd 1:0:45:0: Attached scsi generic sg46 type 0 [ 37.697552] sd 1:0:46:0: Attached scsi generic sg47 type 0 [ 37.703085] sd 1:0:47:0: Attached scsi generic sg48 type 0 [ 37.708625] sd 1:0:48:0: Attached scsi generic sg49 type 0 [ 37.714216] scsi 1:0:49:0: Attached scsi generic sg50 type 13 [ 37.719993] sd 1:0:50:0: Attached scsi generic sg51 type 0 [ 37.725530] sd 1:0:51:0: Attached scsi generic sg52 type 0 [ 37.731249] sd 1:0:52:0: Attached scsi generic sg53 type 0 [ 37.736805] sd 1:0:53:0: Attached scsi generic sg54 type 0 [ 37.742353] sd 1:0:54:0: Attached scsi generic sg55 type 0 [ 37.747907] sd 1:0:55:0: Attached scsi generic sg56 type 0 [ 37.753437] sd 1:0:56:0: Attached scsi generic sg57 type 0 [ 37.758975] sd 1:0:57:0: Attached scsi generic sg58 type 0 [ 37.764548] sd 1:0:58:0: Attached scsi generic sg59 type 0 [ 37.770086] sd 1:0:59:0: Attached scsi generic sg60 type 0 [ 37.775654] sd 1:0:60:0: Attached scsi generic sg61 type 0 [ 37.781187] sd 1:0:61:0: Attached scsi generic sg62 type 0 [ 37.786723] sd 1:0:62:0: Attached scsi generic sg63 type 0 [ 37.792287] sd 1:0:63:0: Attached scsi generic sg64 type 0 [ 37.797822] sd 1:0:64:0: Attached scsi generic sg65 type 0 [ 37.803361] sd 1:0:65:0: Attached scsi generic sg66 type 0 [ 37.808896] sd 1:0:66:0: Attached scsi generic sg67 type 0 [ 37.814481] sd 1:0:67:0: Attached scsi generic sg68 type 0 [ 37.820021] sd 1:0:68:0: Attached scsi generic sg69 type 0 [ 37.825545] sd 1:0:69:0: Attached scsi generic sg70 type 0 [ 37.831068] sd 1:0:70:0: Attached scsi generic sg71 type 0 [ 37.836620] sd 1:0:71:0: Attached scsi generic sg72 type 0 [ 37.842221] sd 1:0:72:0: Attached scsi generic sg73 type 0 [ 37.847756] sd 1:0:73:0: Attached scsi generic sg74 type 0 [ 37.853313] scsi 1:0:74:0: Attached scsi generic sg75 type 13 [ 37.859218] sd 1:0:75:0: Attached scsi generic sg76 type 0 [ 37.864772] sd 1:0:76:0: Attached scsi generic sg77 type 0 [ 37.870315] sd 1:0:77:0: Attached scsi generic sg78 type 0 [ 37.875848] sd 1:0:78:0: Attached scsi generic sg79 type 0 [ 37.881414] sd 1:0:79:0: Attached scsi generic sg80 type 0 [ 37.886997] sd 1:0:80:0: Attached scsi generic sg81 type 0 [ 37.892525] sd 1:0:81:0: Attached scsi generic sg82 type 0 [ 37.898058] sd 1:0:82:0: Attached scsi generic sg83 type 0 [ 37.903602] sd 1:0:83:0: Attached scsi generic sg84 type 0 [ 37.909131] sd 1:0:84:0: Attached scsi generic sg85 type 0 [ 37.914680] sd 1:0:85:0: Attached scsi generic sg86 type 0 [ 37.920248] sd 1:0:86:0: Attached scsi generic sg87 type 0 [ 37.925799] sd 1:0:87:0: Attached scsi generic sg88 type 0 [ 37.931368] sd 1:0:88:0: Attached scsi generic sg89 type 0 [ 37.936908] sd 1:0:89:0: Attached scsi generic sg90 type 0 [ 37.942446] sd 1:0:90:0: Attached scsi generic sg91 type 0 [ 37.948004] sd 1:0:91:0: Attached scsi generic sg92 type 0 [ 37.953669] sd 1:0:92:0: Attached scsi generic sg93 type 0 [ 37.959188] sd 1:0:93:0: Attached scsi generic sg94 type 0 [ 37.964736] sd 1:0:94:0: Attached scsi generic sg95 type 0 [ 37.970325] sd 1:0:95:0: Attached scsi generic sg96 type 0 [ 37.975860] sd 1:0:96:0: Attached scsi generic sg97 type 0 [ 37.981390] sd 1:0:97:0: Attached scsi generic sg98 type 0 [ 37.986914] sd 1:0:98:0: Attached scsi generic sg99 type 0 [ 37.992461] scsi 1:0:99:0: Attached scsi generic sg100 type 13 [ 37.998368] sd 10:0:0:0: Attached scsi generic sg101 type 0 [ 38.003980] sd 10:0:1:0: Attached scsi generic sg102 type 0 [ 38.009614] sd 10:0:2:0: Attached scsi generic sg103 type 0 [ 38.015268] sd 10:0:3:0: Attached scsi generic sg104 type 0 [ 38.020878] sd 10:0:4:0: Attached scsi generic sg105 type 0 [ 38.026501] sd 10:0:5:0: Attached scsi generic sg106 type 0 [ 38.032123] sd 10:0:6:0: Attached scsi generic sg107 type 0 [ 38.037809] sd 10:0:7:0: Attached scsi generic sg108 type 0 [ 38.043436] sd 10:0:8:0: Attached scsi generic sg109 type 0 [ 38.049057] sd 10:0:9:0: Attached scsi generic sg110 type 0 [ 38.054688] sd 10:0:10:0: Attached scsi generic sg111 type 0 [ 38.060438] sd 10:0:11:0: Attached scsi generic sg112 type 0 [ 38.066144] sd 10:0:12:0: Attached scsi generic sg113 type 0 [ 38.071843] sd 10:0:13:0: Attached scsi generic sg114 type 0 [ 38.077565] sd 10:0:14:0: Attached scsi generic sg115 type 0 [ 38.083273] sd 10:0:15:0: Attached scsi generic sg116 type 0 [ 38.088964] sd 10:0:16:0: Attached scsi generic sg117 type 0 [ 38.094669] sd 10:0:17:0: Attached scsi generic sg118 type 0 [ 38.100350] sd 10:0:18:0: Attached scsi generic sg119 type 0 [ 38.106064] sd 10:0:19:0: Attached scsi generic sg120 type 0 [ 38.111817] sd 10:0:20:0: Attached scsi generic sg121 type 0 [ 38.117525] sd 10:0:21:0: Attached scsi generic sg122 type 0 [ 38.123233] sd 10:0:22:0: Attached scsi generic sg123 type 0 [ 38.128966] sd 10:0:23:0: Attached scsi generic sg124 type 0 [ 38.134679] scsi 10:0:24:0: Attached scsi generic sg125 type 13 [ 38.140686] sd 10:0:25:0: Attached scsi generic sg126 type 0 [ 38.146371] sd 10:0:26:0: Attached scsi generic sg127 type 0 [ 38.152106] sd 10:0:27:0: Attached scsi generic sg128 type 0 [ 38.157829] sd 10:0:28:0: Attached scsi generic sg129 type 0 [ 38.163522] sd 10:0:29:0: Attached scsi generic sg130 type 0 [ 38.169225] sd 10:0:30:0: Attached scsi generic sg131 type 0 [ 38.174913] sd 10:0:31:0: Attached scsi generic sg132 type 0 [ 38.180675] sd 10:0:32:0: Attached scsi generic sg133 type 0 [ 38.186385] sd 10:0:33:0: Attached scsi generic sg134 type 0 [ 38.192087] sd 10:0:34:0: Attached scsi generic sg135 type 0 [ 38.197804] sd 10:0:35:0: Attached scsi generic sg136 type 0 [ 38.203505] sd 10:0:36:0: Attached scsi generic sg137 type 0 [ 38.209265] sd 10:0:37:0: Attached scsi generic sg138 type 0 [ 38.214969] sd 10:0:38:0: Attached scsi generic sg139 type 0 [ 38.220683] sd 10:0:39:0: Attached scsi generic sg140 type 0 [ 38.226402] sd 10:0:40:0: Attached scsi generic sg141 type 0 [ 38.232098] sd 10:0:41:0: Attached scsi generic sg142 type 0 [ 38.237792] sd 10:0:42:0: Attached scsi generic sg143 type 0 [ 38.243521] sd 10:0:43:0: Attached scsi generic sg144 type 0 [ 38.249256] sd 10:0:44:0: Attached scsi generic sg145 type 0 [ 38.254955] sd 10:0:45:0: Attached scsi generic sg146 type 0 [ 38.260677] sd 10:0:46:0: Attached scsi generic sg147 type 0 [ 38.266426] sd 10:0:47:0: Attached scsi generic sg148 type 0 [ 38.272142] sd 10:0:48:0: Attached scsi generic sg149 type 0 [ 38.277853] scsi 10:0:49:0: Attached scsi generic sg150 type 13 [ 38.283838] sd 10:0:50:0: Attached scsi generic sg151 type 0 [ 38.289583] sd 10:0:51:0: Attached scsi generic sg152 type 0 [ 38.295762] sd 10:0:52:0: Attached scsi generic sg153 type 0 [ 38.301460] sd 10:0:53:0: Attached scsi generic sg154 type 0 [ 38.307153] sd 10:0:54:0: Attached scsi generic sg155 type 0 [ 38.312862] sd 10:0:55:0: Attached scsi generic sg156 type 0 [ 38.318597] sd 10:0:56:0: Attached scsi generic sg157 type 0 [ 38.324307] sd 10:0:57:0: Attached scsi generic sg158 type 0 [ 38.330004] sd 10:0:58:0: Attached scsi generic sg159 type 0 [ 38.335744] sd 10:0:59:0: Attached scsi generic sg160 type 0 [ 38.341899] sd 10:0:60:0: Attached scsi generic sg161 type 0 [ 38.347587] sd 10:0:61:0: Attached scsi generic sg162 type 0 [ 38.353274] sd 10:0:62:0: Attached scsi generic sg163 type 0 [ 38.358984] sd 10:0:63:0: Attached scsi generic sg164 type 0 [ 38.364734] sd 10:0:64:0: Attached scsi generic sg165 type 0 [ 38.370428] sd 10:0:65:0: Attached scsi generic sg166 type 0 [ 38.376608] sd 10:0:66:0: Attached scsi generic sg167 type 0 [ 38.382321] sd 10:0:67:0: Attached scsi generic sg168 type 0 [ 38.388014] sd 10:0:68:0: Attached scsi generic sg169 type 0 [ 38.393698] sd 10:0:69:0: Attached scsi generic sg170 type 0 [ 38.399431] sd 10:0:70:0: Attached scsi generic sg171 type 0 [ 38.405188] sd 10:0:71:0: Attached scsi generic sg172 type 0 [ 38.410900] sd 10:0:72:0: Attached scsi generic sg173 type 0 [ 38.416605] sd 10:0:73:0: Attached scsi generic sg174 type 0 [ 38.422419] scsi 10:0:74:0: Attached scsi generic sg175 type 13 [ 38.428405] sd 10:0:75:0: Attached scsi generic sg176 type 0 [ 38.434151] sd 10:0:76:0: Attached scsi generic sg177 type 0 [ 38.439843] sd 10:0:77:0: Attached scsi generic sg178 type 0 [ 38.445567] sd 10:0:78:0: Attached scsi generic sg179 type 0 [ 38.451323] sd 10:0:79:0: Attached scsi generic sg180 type 0 [ 38.457024] sd 10:0:80:0: Attached scsi generic sg181 type 0 [ 38.463094] sd 10:0:81:0: Attached scsi generic sg182 type 0 [ 38.468810] sd 10:0:82:0: Attached scsi generic sg183 type 0 [ 38.474537] sd 10:0:83:0: Attached scsi generic sg184 type 0 [ 38.480257] sd 10:0:84:0: Attached scsi generic sg185 type 0 [ 38.486001] sd 10:0:85:0: Attached scsi generic sg186 type 0 [ 38.491700] sd 10:0:86:0: Attached scsi generic sg187 type 0 [ 38.497395] sd 10:0:87:0: Attached scsi generic sg188 type 0 [ 38.503108] sd 10:0:88:0: Attached scsi generic sg189 type 0 [ 38.508816] sd 10:0:89:0: Attached scsi generic sg190 type 0 [ 38.514521] sd 10:0:90:0: Attached scsi generic sg191 type 0 [ 38.520223] sd 10:0:91:0: Attached scsi generic sg192 type 0 [ 38.525916] sd 10:0:92:0: Attached scsi generic sg193 type 0 [ 38.531646] sd 10:0:93:0: Attached scsi generic sg194 type 0 [ 38.537429] sd 10:0:94:0: Attached scsi generic sg195 type 0 [ 38.543126] sd 10:0:95:0: Attached scsi generic sg196 type 0 [ 38.548846] sd 10:0:96:0: Attached scsi generic sg197 type 0 [ 38.554601] sd 10:0:97:0: Attached scsi generic sg198 type 0 [ 38.560319] sd 10:0:98:0: Attached scsi generic sg199 type 0 [ 38.566068] scsi 10:0:99:0: Attached scsi generic sg200 type 13 [ 39.087892] device-mapper: multipath service-time: version 0.3.0 loaded [ 42.403758] svcrdma: svcrdma is obsoleted, loading rpcrdma instead [ 42.540348] input: PC Speaker as /devices/platform/pcspkr/input/input1 [ 42.556609] cryptd: max_cpu_qlen set to 1000 [ 42.566979] AVX2 version of gcm_enc/dec engaged. [ 42.571615] AES CTR mode by8 optimization enabled [ 42.578562] alg: No test for __gcm-aes-aesni (__driver-gcm-aes-aesni) [ 42.585099] alg: No test for __generic-gcm-aes-aesni (__driver-generic-gcm-aes-aesni) [ 42.618923] kvm: Nested Paging enabled [ 43.429554] dcdbas dcdbas: Dell Systems Management Base Driver (version 5.6.0-3.3) [ 43.446085] ses 1:0:24:0: Attached Enclosure device [ 43.446117] ses 1:0:49:0: Attached Enclosure device [ 43.446146] ses 1:0:74:0: Attached Enclosure device [ 43.446177] ses 1:0:99:0: Attached Enclosure device [ 43.446201] ses 10:0:24:0: Attached Enclosure device [ 43.446220] ses 10:0:49:0: Attached Enclosure device [ 43.446235] ses 10:0:74:0: Attached Enclosure device [ 43.446252] ses 10:0:99:0: Attached Enclosure device [ 75.409044] Adding 4194300k swap on /dev/sda3. Priority:-2 extents:1 across:4194300k SSFS [ 75.440790] type=1305 audit(1706808115.422:3): audit_pid=26804 old=0 auid=4294967295 ses=4294967295 res=1 [ 75.452223] RPC: Registered named UNIX socket transport module. [ 75.458730] RPC: Registered udp transport module. [ 75.464821] RPC: Registered tcp transport module. [ 75.470910] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 75.971584] tg3 0000:e1:00.0: irq 392 for MSI/MSI-X [ 75.971598] tg3 0000:e1:00.0: irq 393 for MSI/MSI-X [ 75.971608] tg3 0000:e1:00.0: irq 394 for MSI/MSI-X [ 75.971618] tg3 0000:e1:00.0: irq 395 for MSI/MSI-X [ 75.971628] tg3 0000:e1:00.0: irq 396 for MSI/MSI-X [ 76.098359] IPv6: ADDRCONF(NETDEV_UP): em1: link is not ready [ 79.646724] tg3 0000:e1:00.0 em1: Link is up at 1000 Mbps, full duplex [ 79.653254] tg3 0000:e1:00.0 em1: Flow control is on for TX and on for RX [ 79.660045] tg3 0000:e1:00.0 em1: EEE is enabled [ 79.664678] IPv6: ADDRCONF(NETDEV_CHANGE): em1: link becomes ready [ 80.482592] IPv6: ADDRCONF(NETDEV_UP): ib0: link is not ready [ 80.505316] IPv6: ADDRCONF(NETDEV_CHANGE): ib0: link becomes ready [ 86.917667] FS-Cache: Loaded [ 86.921854] LNet: HW NUMA nodes: 2, HW CPU cores: 64, npartitions: 2 [ 86.930718] alg: No test for adler32 (adler32-zlib) [ 86.945340] FS-Cache: Netfs 'nfs' registered for caching [ 86.953015] Key type dns_resolver registered [ 86.970719] NFS: Registering the id_resolver key type [ 86.976738] Key type id_resolver registered [ 86.982312] Key type id_legacy registered [ 87.701547] LNet: live_router_check_interval and dead_router_check_interval have been deprecated. Use alive_router_check_interval instead. Ignoring these deprecated parameters. [ 87.737622] LNet: 27832:0:(config.c:1535:lnet_inet_enumerate()) lnet: Ignoring interface em2: it's down [ 87.747877] LNet: Using FastReg for registration [ 87.882125] LNet: Added LNI 10.0.10.116@o2ib7 [8/256/0/180] [ 87.893987] LNetError: 27868:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) route to o2ib2 through 10.0.10.225@o2ib7 has gone from down to up [ 813.290179] Lustre: Lustre: Build Version: 2.15.4_8_gbe21574 [ 813.426290] md: md7 stopped. [ 813.435599] async_tx: api initialized (async) [ 813.441017] xor: automatically using best checksumming function: [ 813.456658] avx : 17320.000 MB/sec [ 813.483656] raid6: sse2x1 gen() 7726 MB/s [ 813.504656] raid6: sse2x2 gen() 13968 MB/s [ 813.525656] raid6: sse2x4 gen() 20996 MB/s [ 813.546656] raid6: avx2x1 gen() 16519 MB/s [ 813.567654] raid6: avx2x2 gen() 33035 MB/s [ 813.588648] raid6: avx2x4 gen() 35656 MB/s [ 813.592918] raid6: using algorithm avx2x4 gen() (35656 MB/s) [ 813.598578] raid6: using avx2x2 recovery algorithm [ 813.617281] md/raid:md7: device dm-90 operational as raid disk 0 [ 813.623292] md/raid:md7: device dm-6 operational as raid disk 11 [ 813.629300] md/raid:md7: device dm-4 operational as raid disk 10 [ 813.635538] md/raid:md7: device dm-2 operational as raid disk 9 [ 813.641458] md/raid:md7: device dm-27 operational as raid disk 8 [ 813.647465] md/raid:md7: device dm-24 operational as raid disk 7 [ 813.653470] md/raid:md7: device dm-21 operational as raid disk 6 [ 813.659478] md/raid:md7: device dm-83 operational as raid disk 5 [ 813.665481] md/raid:md7: device dm-84 operational as raid disk 4 [ 813.671490] md/raid:md7: device dm-76 operational as raid disk 3 [ 813.677492] md/raid:md7: device dm-66 operational as raid disk 2 [ 813.683498] md/raid:md7: device dm-75 operational as raid disk 1 [ 813.690540] md/raid:md7: raid level 6 active with 12 out of 12 devices, algorithm 2 [ 813.701452] md7: detected capacity change from 0 to 153608152678400 [ 813.737288] md: md5 stopped. [ 813.748315] md/raid:md5: device dm-87 operational as raid disk 0 [ 813.754333] md/raid:md5: device dm-44 operational as raid disk 11 [ 813.760430] md/raid:md5: device dm-46 operational as raid disk 10 [ 813.766521] md/raid:md5: device dm-56 operational as raid disk 9 [ 813.772526] md/raid:md5: device dm-29 operational as raid disk 8 [ 813.778533] md/raid:md5: device dm-17 operational as raid disk 7 [ 813.784538] md/raid:md5: device dm-14 operational as raid disk 6 [ 813.790544] md/raid:md5: device dm-67 operational as raid disk 5 [ 813.796548] md/raid:md5: device dm-94 operational as raid disk 4 [ 813.802555] md/raid:md5: device dm-80 operational as raid disk 3 [ 813.808562] md/raid:md5: device dm-58 operational as raid disk 2 [ 813.814568] md/raid:md5: device dm-51 operational as raid disk 1 [ 813.820980] md/raid:md5: raid level 6 active with 12 out of 12 devices, algorithm 2 [ 813.831879] md5: detected capacity change from 0 to 153608152678400 [ 813.839708] md: md3 stopped. [ 813.850200] md/raid:md3: device dm-95 operational as raid disk 0 [ 813.856228] md/raid:md3: device dm-50 operational as raid disk 11 [ 813.862348] md/raid:md3: device dm-52 operational as raid disk 10 [ 813.868441] md/raid:md3: device dm-0 operational as raid disk 9 [ 813.874363] md/raid:md3: device dm-18 operational as raid disk 8 [ 813.880373] md/raid:md3: device dm-28 operational as raid disk 7 [ 813.886379] md/raid:md3: device dm-31 operational as raid disk 6 [ 813.892387] md/raid:md3: device dm-85 operational as raid disk 5 [ 813.898392] md/raid:md3: device dm-89 operational as raid disk 4 [ 813.904398] md/raid:md3: device dm-62 operational as raid disk 3 [ 813.910405] md/raid:md3: device dm-36 operational as raid disk 2 [ 813.916408] md/raid:md3: device dm-69 operational as raid disk 1 [ 813.922933] md/raid:md3: raid level 6 active with 12 out of 12 devices, algorithm 2 [ 813.933920] md3: detected capacity change from 0 to 153608152678400 [ 813.942721] md: md1 stopped. [ 813.955193] md/raid:md1: device dm-92 operational as raid disk 0 [ 813.961262] md/raid:md1: device dm-59 operational as raid disk 11 [ 813.967423] md/raid:md1: device dm-32 operational as raid disk 10 [ 813.973586] md/raid:md1: device dm-11 operational as raid disk 9 [ 813.979637] md/raid:md1: device dm-25 operational as raid disk 8 [ 813.985697] md/raid:md1: device dm-37 operational as raid disk 7 [ 813.991734] md/raid:md1: device dm-34 operational as raid disk 6 [ 813.997749] md/raid:md1: device dm-86 operational as raid disk 5 [ 814.003770] md/raid:md1: device dm-73 operational as raid disk 4 [ 814.009792] md/raid:md1: device dm-71 operational as raid disk 3 [ 814.015814] md/raid:md1: device dm-78 operational as raid disk 2 [ 814.021821] md/raid:md1: device dm-79 operational as raid disk 1 [ 814.028681] md/raid:md1: raid level 6 active with 12 out of 12 devices, algorithm 2 [ 814.040088] md1: detected capacity change from 0 to 153608152678400 [ 814.201725] LDISKFS-fs (md7): file extents enabled, maximum tree depth=5 [ 814.414772] LDISKFS-fs (md3): file extents enabled, maximum tree depth=5 [ 814.534317] LDISKFS-fs (md7): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 814.538740] LDISKFS-fs (md5): file extents enabled, maximum tree depth=5 [ 814.743449] LDISKFS-fs (md3): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 814.754719] LDISKFS-fs (md1): file extents enabled, maximum tree depth=5 [ 814.769503] LustreError: 137-5: fir-OST009b_UUID: not available for connect from 10.0.10.5@o2ib7 (no target). If you are running an HA pair check that the target is mounted on the other server. [ 814.786693] LustreError: Skipped 2 previous similar messages [ 814.870256] LDISKFS-fs (md5): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 815.019012] Lustre: fir-OST009f: Not available for connect from 10.50.5.50@o2ib2 (not set up) [ 815.086415] LDISKFS-fs (md1): mounted filesystem with ordered data mode. Opts: errors=remount-ro,no_mbcache,nodelalloc [ 815.298269] LustreError: 137-5: fir-OST0099_UUID: not available for connect from 10.50.7.56@o2ib2 (no target). If you are running an HA pair check that the target is mounted on the other server. [ 815.315542] LustreError: Skipped 3 previous similar messages [ 815.753504] ofd: 'obdfilter.*.readcache_max_filesize' is deprecated, use 'osd-*.*.readcache_max_filesize' instead [ 815.851945] Lustre: fir-OST009f: Imperative Recovery enabled, recovery window shrunk from 300-900 down to 150-900 [ 815.862908] Lustre: fir-OST009f: in recovery but waiting for the first client to connect [ 815.942849] Lustre: fir-OST009f: Will be in recovery for at least 2:30, or until 737 clients reconnect [ 816.406995] Lustre: fir-OST0099: Imperative Recovery enabled, recovery window shrunk from 300-900 down to 150-900 [ 816.417263] Lustre: Skipped 2 previous similar messages [ 816.423283] Lustre: fir-OST0099: in recovery but waiting for the first client to connect [ 816.431403] Lustre: Skipped 2 previous similar messages [ 816.536128] Lustre: fir-OST0099: Will be in recovery for at least 2:30, or until 739 clients reconnect [ 818.677148] Lustre: fir-OST009b: Denying connection for new client 8f2a21a1-2f0d-4100-a916-4ae650f50861 (at 10.50.3.62@o2ib2), waiting for 742 known clients (2 recovered, 2 in progress, and 0 evicted) to recover in 3:10 [ 820.858895] Lustre: fir-OST009b: Denying connection for new client 8f2a21a1-2f0d-4100-a916-4ae650f50861 (at 10.50.3.62@o2ib2), waiting for 742 known clients (2 recovered, 3 in progress, and 0 evicted) to recover in 3:07 [ 822.432192] Lustre: fir-OST009f: Denying connection for new client 4328d15d-f0aa-4b3c-acef-feeb70914754 (at 10.50.8.11@o2ib2), waiting for 737 known clients (1 recovered, 5 in progress, and 0 evicted) to recover in 3:05 [ 826.987717] Lustre: fir-OST009f: Denying connection for new client a5485b01-5ff2-4c97-9381-5c0ffc821089 (at 10.50.1.64@o2ib2), waiting for 737 known clients (1 recovered, 6 in progress, and 0 evicted) to recover in 3:00 [ 827.007161] Lustre: Skipped 4 previous similar messages [ 831.992415] Lustre: fir-OST009f: Denying connection for new client a5485b01-5ff2-4c97-9381-5c0ffc821089 (at 10.50.1.64@o2ib2), waiting for 737 known clients (2 recovered, 6 in progress, and 0 evicted) to recover in 2:55 [ 832.011871] Lustre: Skipped 5 previous similar messages [ 840.516289] Lustre: fir-OST009f: Denying connection for new client 4328d15d-f0aa-4b3c-acef-feeb70914754 (at 10.50.8.11@o2ib2), waiting for 737 known clients (125 recovered, 26 in progress, and 0 evicted) to recover in 2:47 [ 840.536000] Lustre: Skipped 19 previous similar messages [ 856.701505] Lustre: fir-OST0099: Denying connection for new client 96322459-e362-4ab5-96ba-747eced813f1 (at 10.50.7.10@o2ib2), waiting for 739 known clients (561 recovered, 55 in progress, and 0 evicted) to recover in 2:31 [ 856.721210] Lustre: Skipped 72 previous similar messages [ 888.701352] Lustre: fir-OST009f: Denying connection for new client 0c923143-b5bc-4024-b12e-62fb1ac3572c (at 10.50.4.15@o2ib2), waiting for 737 known clients (660 recovered, 74 in progress, and 0 evicted) to recover in 1:59 [ 888.721075] Lustre: Skipped 136 previous similar messages [ 952.910952] Lustre: fir-OST009b: Denying connection for new client 8f2a21a1-2f0d-4100-a916-4ae650f50861 (at 10.50.3.62@o2ib2), waiting for 742 known clients (680 recovered, 60 in progress, and 0 evicted) to recover in 0:55 [ 952.930666] Lustre: Skipped 346 previous similar messages [ 1007.734317] Lustre: fir-OST009f: recovery is timed out, evict stale exports [ 1007.734584] Lustre: fir-OST0099: disconnecting 1 stale clients [ 1007.746789] Lustre: fir-OST0099: deleting orphan objects from 0x2940000402:4879168 to 0x2940000402:4879169 [ 1007.746999] Lustre: fir-OST0099: deleting orphan objects from 0x2940000401:3897004 to 0x2940000401:3897057 [ 1007.747101] Lustre: fir-OST0099: deleting orphan objects from 0x2940000400:6080431 to 0x2940000400:6080481 [ 1007.747139] Lustre: fir-OST0099: deleting orphan objects from 0x0:1834594 to 0x0:1834625 [ 1007.751044] Lustre: fir-OST0099: Recovery over after 3:12, of 739 clients 738 recovered and 1 was evicted. [ 1007.794496] Lustre: Skipped 1 previous similar message [ 1007.964213] Lustre: fir-OST009f: deleting orphan objects from 0x2ac0000400:6138295 to 0x2ac0000400:6138305 [ 1007.965376] Lustre: fir-OST009f: deleting orphan objects from 0x2ac0000401:3930685 to 0x2ac0000401:3930721 [ 1008.734255] Lustre: fir-OST009b: recovery is timed out, evict stale exports [ 1008.734326] Lustre: fir-OST009d: disconnecting 2 stale clients [ 1008.734327] Lustre: Skipped 1 previous similar message [ 1008.752293] Lustre: Skipped 1 previous similar message [ 1008.784335] Lustre: fir-OST009d: deleting orphan objects from 0x2a40000400:3919114 to 0x2a40000400:3919137 [ 1008.784388] Lustre: fir-OST009d: deleting orphan objects from 0x0:1839637 to 0x0:1839649 [ 1008.785147] Lustre: fir-OST009d: deleting orphan objects from 0x2a40000402:6101179 to 0x2a40000402:6101185 [ 1008.787604] Lustre: fir-OST009d: Recovery over after 3:12, of 750 clients 748 recovered and 2 were evicted. [ 1008.787605] Lustre: Skipped 1 previous similar message [ 1008.812847] Lustre: fir-OST009b: deleting orphan objects from 0x29c0000402:6115297 to 0x29c0000402:6115297 [ 1008.815521] Lustre: fir-OST009b: deleting orphan objects from 0x29c0000401:3920508 to 0x29c0000401:3920577 [ 1008.815598] Lustre: fir-OST009b: deleting orphan objects from 0x29c0000400:4900929 to 0x29c0000400:4900929 [ 1264.672081] Lustre: fir-MDT0002-lwp-OST009f: Connection to fir-MDT0002 (at 10.0.10.53@o2ib7) was lost; in progress operations using this service will wait for recovery to complete [ 1264.688063] Lustre: Skipped 3 previous similar messages [ 1384.687493] Lustre: fir-MDT0002-lwp-OST0099: Connection restored to (at 10.0.10.54@o2ib7) [ 1441.750339] Lustre: 43501:0:(client.c:2295:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1706809354/real 1706809354] req@ffff9e0218998900 x1789718802960000/t0(0) o400->fir-MDT0003-lwp-OST009f@10.0.10.53@o2ib7:12/10 lens 224/224 e 0 to 1 dl 1706809482 ref 1 fl Rpc:XNQr/0/ffffffff rc 0/-1 job:'' [ 1441.779498] Lustre: fir-MDT0003-lwp-OST009f: Connection to fir-MDT0003 (at 10.0.10.53@o2ib7) was lost; in progress operations using this service will wait for recovery to complete [ 1441.795474] Lustre: Skipped 2 previous similar messages [ 1467.804928] Lustre: 43489:0:(client.c:2295:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1706809380/real 1706809380] req@ffff9e0206dd5e80 x1789718802983616/t0(0) o400->fir-MDT0003-lwp-OST0099@10.0.10.53@o2ib7:12/10 lens 224/224 e 0 to 1 dl 1706809508 ref 1 fl Rpc:XNQr/0/ffffffff rc 0/-1 job:'' [ 1467.804930] Lustre: 43485:0:(client.c:2295:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1706809380/real 1706809380] req@ffff9e0206302880 x1789718802983360/t0(0) o400->fir-MDT0003-lwp-OST009b@10.0.10.53@o2ib7:12/10 lens 224/224 e 0 to 1 dl 1706809508 ref 1 fl Rpc:XNQr/0/ffffffff rc 0/-1 job:'' [ 1467.804933] Lustre: 43487:0:(client.c:2295:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1706809380/real 1706809380] req@ffff9e0206dd2880 x1789718802983488/t0(0) o400->fir-MDT0003-lwp-OST009d@10.0.10.53@o2ib7:12/10 lens 224/224 e 0 to 1 dl 1706809508 ref 1 fl Rpc:XNQr/0/ffffffff rc 0/-1 job:'' [ 1467.804934] Lustre: 43485:0:(client.c:2295:ptlrpc_expire_one_request()) Skipped 3 previous similar messages [ 1467.804935] Lustre: 43487:0:(client.c:2295:ptlrpc_expire_one_request()) Skipped 3 previous similar messages [ 1467.911909] Lustre: 43489:0:(client.c:2295:ptlrpc_expire_one_request()) Skipped 1 previous similar message [ 1488.967504] Lustre: fir-OST009d: deleting orphan objects from 0x2a40000402:6102282 to 0x2a40000402:6102369 [ 1488.967537] Lustre: fir-OST0099: deleting orphan objects from 0x2940000400:6081605 to 0x2940000400:6081633 [ 1488.967599] Lustre: fir-OST009b: deleting orphan objects from 0x29c0000402:6116430 to 0x29c0000402:6116449 [ 1488.967669] Lustre: fir-OST009f: deleting orphan objects from 0x2ac0000400:6139438 to 0x2ac0000400:6139489 [ 1490.198357] Lustre: fir-OST009f: deleting orphan objects from 0x2ac0000402:4914800 to 0x2ac0000402:4914817 [ 1490.198358] Lustre: fir-OST009b: deleting orphan objects from 0x29c0000400:4901699 to 0x29c0000400:4901793 [ 1490.198364] Lustre: fir-OST0099: deleting orphan objects from 0x2940000402:4879896 to 0x2940000402:4879969 [ 1490.198563] Lustre: fir-OST009d: deleting orphan objects from 0x2a40000401:4894094 to 0x2a40000401:4894145 [ 1493.859410] Lustre: 43498:0:(client.c:2295:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1706809406/real 1706809406] req@ffff9e02313d4380 x1789718803004160/t0(0) o400->fir-MDT0003-lwp-OST009b@10.0.10.53@o2ib7:12/10 lens 224/224 e 0 to 1 dl 1706809534 ref 1 fl Rpc:XNQr/0/ffffffff rc 0/-1 job:'' [ 1493.859411] Lustre: 43500:0:(client.c:2295:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1706809406/real 1706809406] req@ffff9e02313d3f00 x1789718803004288/t0(0) o400->fir-MDT0003-lwp-OST009d@10.0.10.53@o2ib7:12/10 lens 224/224 e 0 to 1 dl 1706809534 ref 1 fl Rpc:XNQr/0/ffffffff rc 0/-1 job:'' [ 1493.859415] Lustre: 43500:0:(client.c:2295:ptlrpc_expire_one_request()) Skipped 1 previous similar message [ 1493.927500] Lustre: 43498:0:(client.c:2295:ptlrpc_expire_one_request()) Skipped 1 previous similar message [ 1501.803623] Lustre: fir-MDT0003-lwp-OST0099: Connection restored to (at 10.0.10.54@o2ib7) [ 1501.811883] Lustre: Skipped 3 previous similar messages [ 1516.818170] Lustre: 43487:0:(client.c:2295:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1706809429/real 1706809429] req@ffff9e0206d49b00 x1789718803024576/t0(0) o400->fir-MDT0003-lwp-OST0099@10.0.10.54@o2ib7:12/10 lens 224/224 e 0 to 1 dl 1706809557 ref 1 fl Rpc:XNQr/0/ffffffff rc 0/-1 job:'' [ 1541.840782] Lustre: 43498:0:(client.c:2295:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1706809454/real 1706809454] req@ffff9e0200bf6780 x1789718803035776/t0(0) o400->fir-MDT0003-lwp-OST009b@10.0.10.54@o2ib7:12/10 lens 224/224 e 0 to 1 dl 1706809582 ref 1 fl Rpc:XNQr/0/ffffffff rc 0/-1 job:'' [ 1541.870145] Lustre: 43498:0:(client.c:2295:ptlrpc_expire_one_request()) Skipped 5 previous similar messages [ 3115.099006] Lustre: fir-MDT0001-lwp-OST009d: Connection to fir-MDT0001 (at 10.0.10.52@o2ib7) was lost; in progress operations using this service will wait for recovery to complete [ 3115.115186] Lustre: Skipped 4 previous similar messages [ 3220.181746] Lustre: fir-MDT0001-lwp-OST009b: Connection restored to 10.0.10.51@o2ib7 (at 10.0.10.51@o2ib7) [ 3220.191397] Lustre: Skipped 3 previous similar messages [ 3421.269841] Lustre: fir-OST009d: deleting orphan objects from 0x2a40000400:3923222 to 0x2a40000400:3923265 [ 3421.269862] Lustre: fir-OST0099: deleting orphan objects from 0x2940000401:3901133 to 0x2940000401:3901153 [ 3421.270113] Lustre: fir-OST009f: deleting orphan objects from 0x2ac0000401:3934825 to 0x2ac0000401:3934849 [ 3421.270138] Lustre: fir-OST009b: deleting orphan objects from 0x29c0000401:3924691 to 0x29c0000401:3924769 [ 7453.424348] Lustre: fir-OST009b: haven't heard from client dd4289f2-eaec-4bb9-854a-07bbbc233b1d (at 10.51.6.69@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02eac63800, cur 1706815494 expire 1706815344 last 1706815267 [ 7467.435498] Lustre: fir-OST009f: haven't heard from client 73578261-8692-474f-aa84-0ab8ce70d4e7 (at 10.51.16.3@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f2057000, cur 1706815508 expire 1706815358 last 1706815281 [ 7467.457450] Lustre: Skipped 3 previous similar messages [ 7474.426858] Lustre: fir-OST0099: haven't heard from client 73578261-8692-474f-aa84-0ab8ce70d4e7 (at 10.51.16.3@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02ee51cc00, cur 1706815515 expire 1706815365 last 1706815288 [ 7474.448745] Lustre: Skipped 1 previous similar message [ 7480.415130] Lustre: fir-OST009d: haven't heard from client 73578261-8692-474f-aa84-0ab8ce70d4e7 (at 10.51.16.3@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f317dc00, cur 1706815521 expire 1706815371 last 1706815294 [ 7480.436830] Lustre: Skipped 2 previous similar messages [ 7888.394405] Lustre: fir-OST009b: haven't heard from client 9bd884dc-5f9b-422f-9df6-a510bb75eaea (at 10.50.17.42@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e0206329400, cur 1706815929 expire 1706815779 last 1706815702 [ 8529.359647] Lustre: fir-OST009d: haven't heard from client f9cad86f-d6dc-44cd-a569-8a370a0402da (at 10.51.18.22@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f26c0c00, cur 1706816570 expire 1706816420 last 1706816343 [ 8536.361124] Lustre: fir-OST0099: haven't heard from client f9cad86f-d6dc-44cd-a569-8a370a0402da (at 10.51.18.22@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02ee743000, cur 1706816577 expire 1706816427 last 1706816350 [ 8536.382907] Lustre: Skipped 2 previous similar messages [ 8852.344990] Lustre: fir-OST009d: haven't heard from client b56ee6d3-60b7-4e85-82fb-4ab80d944638 (at 10.51.11.20@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f1a4d000, cur 1706816893 expire 1706816743 last 1706816666 [ 8858.340620] Lustre: fir-OST009f: haven't heard from client b56ee6d3-60b7-4e85-82fb-4ab80d944638 (at 10.51.11.20@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e0138492800, cur 1706816899 expire 1706816749 last 1706816672 [11356.202209] Lustre: fir-OST009d: haven't heard from client ab3a8e09-5069-43b4-b770-588ebb9441c1 (at 10.51.6.55@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e0006886400, cur 1706819397 expire 1706819247 last 1706819170 [11432.199614] Lustre: fir-OST009b: haven't heard from client bb1f0e85-c3f9-44f4-8128-1d7aefc4505e (at 10.50.9.50@o2ib2) in 205 seconds. I think it's dead, and I am evicting it. exp ffff9e00085b5400, cur 1706819473 expire 1706819323 last 1706819268 [11432.221312] Lustre: Skipped 7 previous similar messages [11451.197610] Lustre: fir-OST009f: haven't heard from client 6cbb8edf-202d-4ba9-8c75-559a049755bd (at 10.50.3.61@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e41d8039800, cur 1706819492 expire 1706819342 last 1706819265 [11451.219310] Lustre: Skipped 3 previous similar messages [11706.184780] Lustre: fir-OST009f: haven't heard from client 3b789c95-d924-4856-a3a6-8a16e492a903 (at 10.51.12.7@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e0250752800, cur 1706819747 expire 1706819597 last 1706819520 [11706.206478] Lustre: Skipped 3 previous similar messages [11717.187886] Lustre: fir-OST009b: haven't heard from client 3b789c95-d924-4856-a3a6-8a16e492a903 (at 10.51.12.7@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e0008aee400, cur 1706819758 expire 1706819608 last 1706819531 [14227.046669] Lustre: fir-OST009d: haven't heard from client 7faa8079-ed8d-487d-9b4a-6a88eaf60a41 (at 10.50.3.38@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01e7385c00, cur 1706822268 expire 1706822118 last 1706822041 [14227.068365] Lustre: Skipped 1 previous similar message [14245.048166] Lustre: fir-OST009f: haven't heard from client 7faa8079-ed8d-487d-9b4a-6a88eaf60a41 (at 10.50.3.38@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e0231326800, cur 1706822286 expire 1706822136 last 1706822059 [14471.600055] LustreError: 44052:0:(ldlm_lockd.c:261:expired_lock_main()) ### lock callback timer expired after 100s: evicting client at 10.50.9.25@o2ib2 ns: filter-fir-OST0099_UUID lock: ffff9e42039fba80/0xa96a836d902bf496 lrc: 4/0,0 mode: PW/PW res: [0x2940000401:0x3bcc79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 10.50.9.25@o2ib2 remote: 0x9ab028250f755f43 expref: 9 pid: 47122 timeout: 14469 lvb_type: 0 [14593.045961] Lustre: fir-OST009d: haven't heard from client 59ba0b0b-7507-47e7-8b4d-f3764cc2741f (at 10.50.9.25@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f26c3800, cur 1706822634 expire 1706822484 last 1706822407 [14593.068081] Lustre: Skipped 2 previous similar messages [16337.931780] Lustre: fir-OST009f: haven't heard from client ab422353-6cbd-46e9-b627-fcf738e2859c (at 10.50.12.8@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f20ca800, cur 1706824379 expire 1706824229 last 1706824152 [16337.953483] Lustre: Skipped 2 previous similar messages [17562.871075] Lustre: fir-OST009f: haven't heard from client 79801e7a-67cb-4f72-892d-a5e8e718d72a (at 10.51.1.30@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e0338139000, cur 1706825604 expire 1706825454 last 1706825377 [17562.892940] Lustre: Skipped 3 previous similar messages [17567.872095] Lustre: fir-OST009b: haven't heard from client 79801e7a-67cb-4f72-892d-a5e8e718d72a (at 10.51.1.30@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e42e9aa7000, cur 1706825609 expire 1706825459 last 1706825382 [17577.864677] Lustre: fir-OST009d: haven't heard from client 79801e7a-67cb-4f72-892d-a5e8e718d72a (at 10.51.1.30@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f0e45400, cur 1706825619 expire 1706825469 last 1706825392 [18568.810089] Lustre: fir-OST009f: haven't heard from client b5a7488b-0d7b-4ee9-bdcc-f28ec009d0c5 (at 10.50.3.46@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e000fcd9000, cur 1706826610 expire 1706826460 last 1706826383 [18568.831788] Lustre: Skipped 1 previous similar message [24148.507300] Lustre: fir-OST0099: haven't heard from client 2ef84689-ab9e-40d4-bf84-06e04606ccec (at 10.50.6.31@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02b8b4b000, cur 1706832190 expire 1706832040 last 1706831963 [24157.508415] Lustre: fir-OST009d: haven't heard from client 2ef84689-ab9e-40d4-bf84-06e04606ccec (at 10.50.6.31@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e000d8ca400, cur 1706832199 expire 1706832049 last 1706831972 [24482.489075] Lustre: fir-OST009d: haven't heard from client e4ff7c98-f36e-4767-aed7-583c89443943 (at 10.51.4.5@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dff7fb24c00, cur 1706832524 expire 1706832374 last 1706832297 [25125.451512] Lustre: fir-OST009d: haven't heard from client 4adf684b-103e-4083-bf4e-d6dbaf324cc3 (at 10.51.3.40@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f330e400, cur 1706833167 expire 1706833017 last 1706832940 [25125.473205] Lustre: Skipped 1 previous similar message [27701.312277] Lustre: fir-OST009f: haven't heard from client b031116c-001f-4516-bbd5-bca7b8d1bd49 (at 10.51.5.68@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f206d800, cur 1706835743 expire 1706835593 last 1706835516 [27701.334117] Lustre: Skipped 3 previous similar messages [27712.311151] Lustre: fir-OST0099: haven't heard from client b031116c-001f-4516-bbd5-bca7b8d1bd49 (at 10.51.5.68@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02ee59d400, cur 1706835754 expire 1706835604 last 1706835527 [27712.332848] Lustre: Skipped 2 previous similar messages [27882.304326] Lustre: fir-OST009b: haven't heard from client 70a99806-134a-4dce-9dfb-1f7f989c185b (at 10.50.1.65@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e42c9b79c00, cur 1706835924 expire 1706835774 last 1706835697 [27887.309338] Lustre: fir-OST009d: haven't heard from client 70a99806-134a-4dce-9dfb-1f7f989c185b (at 10.50.1.65@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e0305fff000, cur 1706835929 expire 1706835779 last 1706835702 [27887.331036] Lustre: Skipped 1 previous similar message [27893.304214] Lustre: fir-OST0099: haven't heard from client 70a99806-134a-4dce-9dfb-1f7f989c185b (at 10.50.1.65@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3fd3e09000, cur 1706835935 expire 1706835785 last 1706835708 [31120.129187] Lustre: fir-OST009f: haven't heard from client e512d075-98d2-4172-8750-b50520b1f75e (at 10.50.9.25@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e4216b9f400, cur 1706839162 expire 1706839012 last 1706838935 [40791.607318] Lustre: fir-OST009d: haven't heard from client 67cd349b-9ba8-4b9f-9e19-203cc54d6a09 (at 10.51.5.22@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e03a8b7b000, cur 1706848834 expire 1706848684 last 1706848607 [40791.629182] Lustre: Skipped 3 previous similar messages [40796.603570] Lustre: fir-OST0099: haven't heard from client 67cd349b-9ba8-4b9f-9e19-203cc54d6a09 (at 10.51.5.22@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02ee479000, cur 1706848839 expire 1706848689 last 1706848612 [40796.625786] Lustre: Skipped 2 previous similar messages [48437.187161] Lustre: fir-OST0099: haven't heard from client 6eb58f73-aa5a-4556-956f-06e64b7d69bf (at 10.50.5.63@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e42c7be8000, cur 1706856480 expire 1706856330 last 1706856253 [48449.186743] Lustre: fir-OST009f: haven't heard from client 6eb58f73-aa5a-4556-956f-06e64b7d69bf (at 10.50.5.63@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3f7b5bf800, cur 1706856492 expire 1706856342 last 1706856265 [48449.208442] Lustre: Skipped 1 previous similar message [52613.958883] Lustre: fir-OST009f: haven't heard from client 44ebc792-e7f8-4fbd-9c9d-a9d1dad844cb (at 10.50.9.25@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e41d32b0800, cur 1706860657 expire 1706860507 last 1706860430 [52613.980578] Lustre: Skipped 1 previous similar message [52614.971535] Lustre: fir-OST0099: haven't heard from client 44ebc792-e7f8-4fbd-9c9d-a9d1dad844cb (at 10.50.9.25@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e41c5977800, cur 1706860658 expire 1706860508 last 1706860431 [52615.980111] Lustre: fir-OST009b: haven't heard from client 44ebc792-e7f8-4fbd-9c9d-a9d1dad844cb (at 10.50.9.25@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e40ab8f2c00, cur 1706860659 expire 1706860509 last 1706860432 [53933.893116] Lustre: fir-OST009b: haven't heard from client b2f21724-11cb-4ffa-ac7c-ac5db7fac8b3 (at 10.50.5.68@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e025798d000, cur 1706861977 expire 1706861827 last 1706861750 [53933.914827] Lustre: Skipped 3 previous similar messages [53946.886761] Lustre: fir-OST009f: haven't heard from client b2f21724-11cb-4ffa-ac7c-ac5db7fac8b3 (at 10.50.5.68@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e0229435400, cur 1706861990 expire 1706861840 last 1706861763 [53946.908508] Lustre: Skipped 1 previous similar message [53953.906299] Lustre: fir-OST0099: haven't heard from client b2f21724-11cb-4ffa-ac7c-ac5db7fac8b3 (at 10.50.5.68@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e0222a31c00, cur 1706861997 expire 1706861847 last 1706861770 [57111.729461] Lustre: fir-OST009b: haven't heard from client 53f8c498-6b70-4ad8-947a-90449c86aa7e (at 10.50.1.15@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e41cde77000, cur 1706865155 expire 1706865005 last 1706864928 [58265.654262] Lustre: fir-OST009d: haven't heard from client 52ce22ca-461b-4a85-b9e7-640a6b376b18 (at 10.50.9.25@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3fcc0f0000, cur 1706866309 expire 1706866159 last 1706866082 [58266.676152] Lustre: fir-OST009f: haven't heard from client 52ce22ca-461b-4a85-b9e7-640a6b376b18 (at 10.50.9.25@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e4152b0ac00, cur 1706866310 expire 1706866160 last 1706866083 [58266.697849] Lustre: Skipped 2 previous similar messages [66280.215830] Lustre: fir-OST009d: haven't heard from client 7af5a941-f4ae-4b47-8a0e-e75f8173617b (at 10.50.6.8@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e413ac43400, cur 1706874324 expire 1706874174 last 1706874097 [66285.227501] Lustre: fir-OST0099: haven't heard from client 7af5a941-f4ae-4b47-8a0e-e75f8173617b (at 10.50.6.8@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01bb2b4c00, cur 1706874329 expire 1706874179 last 1706874102 [66285.249116] Lustre: Skipped 2 previous similar messages [74667.766489] Lustre: fir-OST009f: haven't heard from client d8560905-92e5-4c87-b032-7378e1f89485 (at 10.51.4.22@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e43ab939000, cur 1706882712 expire 1706882562 last 1706882485 [74674.762081] Lustre: fir-OST009b: haven't heard from client d8560905-92e5-4c87-b032-7378e1f89485 (at 10.51.4.22@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e42e9aa1400, cur 1706882719 expire 1706882569 last 1706882492 [74674.783793] Lustre: Skipped 2 previous similar messages [81460.414016] Lustre: fir-OST009d: haven't heard from client da2f91ea-ce10-4cf5-8449-5ba36f3e5a82 (at 10.50.6.49@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01a7673800, cur 1706889505 expire 1706889355 last 1706889278 [81470.398990] Lustre: fir-OST009f: haven't heard from client da2f91ea-ce10-4cf5-8449-5ba36f3e5a82 (at 10.50.6.49@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01b3484800, cur 1706889515 expire 1706889365 last 1706889288 [81470.420691] Lustre: Skipped 1 previous similar message [82024.633800] Lustre: fir-MDT0000-lwp-OST0099: Connection to fir-MDT0000 (at 10.0.10.51@o2ib7) was lost; in progress operations using this service will wait for recovery to complete [82058.774191] Lustre: fir-MDT0000-lwp-OST009b: Connection to fir-MDT0000 (at 10.0.10.51@o2ib7) was lost; in progress operations using this service will wait for recovery to complete [82086.828759] Lustre: fir-MDT0000-lwp-OST009f: Connection to fir-MDT0000 (at 10.0.10.51@o2ib7) was lost; in progress operations using this service will wait for recovery to complete [82118.845826] LustreError: 43475:0:(ldlm_resource.c:1126:ldlm_resource_complain()) fir-MDT0000-lwp-OST009b: namespace resource [0x200000006:0x2020000:0xf62da].0x0 (ffff9e4229a69740) refcount nonzero (1) after lock cleanup; forcing cleanup. [82118.867295] Lustre: fir-MDT0000-lwp-OST009b: Connection restored to 10.0.10.52@o2ib7 (at 10.0.10.52@o2ib7) [82118.876945] Lustre: Skipped 3 previous similar messages [82119.260501] LustreError: 47089:0:(qsd_reint.c:635:qqi_reint_delayed()) fir-OST009b: Delaying reintegration for qtype:0 until pending updates are flushed. [82119.766943] LustreError: 47014:0:(qsd_reint.c:635:qqi_reint_delayed()) fir-OST009b: Delaying reintegration for qtype:0 until pending updates are flushed. [82119.780683] LustreError: 47014:0:(qsd_reint.c:635:qqi_reint_delayed()) Skipped 9 previous similar messages [82120.810781] LustreError: 46762:0:(qsd_reint.c:635:qqi_reint_delayed()) fir-OST009b: Delaying reintegration for qtype:0 until pending updates are flushed. [82120.824520] LustreError: 46762:0:(qsd_reint.c:635:qqi_reint_delayed()) Skipped 71 previous similar messages [82123.071808] LustreError: 46791:0:(qsd_reint.c:635:qqi_reint_delayed()) fir-OST009b: Delaying reintegration for qtype:0 until pending updates are flushed. [82123.085533] LustreError: 46791:0:(qsd_reint.c:635:qqi_reint_delayed()) Skipped 67 previous similar messages [82127.384304] LustreError: 47089:0:(qsd_reint.c:635:qqi_reint_delayed()) fir-OST009b: Delaying reintegration for qtype:0 until pending updates are flushed. [82127.398029] LustreError: 47089:0:(qsd_reint.c:635:qqi_reint_delayed()) Skipped 123 previous similar messages [82135.473312] LustreError: 47082:0:(qsd_reint.c:635:qqi_reint_delayed()) fir-OST009b: Delaying reintegration for qtype:0 until pending updates are flushed. [82135.487044] LustreError: 47082:0:(qsd_reint.c:635:qqi_reint_delayed()) Skipped 329 previous similar messages [82146.882081] LustreError: 43475:0:(ldlm_resource.c:1126:ldlm_resource_complain()) fir-MDT0000-lwp-OST009f: namespace resource [0x200000006:0x2020000:0x6047a].0x0 (ffff9e3f71bba480) refcount nonzero (1) after lock cleanup; forcing cleanup. [82146.903294] LustreError: 43475:0:(ldlm_resource.c:1126:ldlm_resource_complain()) Skipped 15 previous similar messages [82146.914127] Lustre: fir-MDT0000-lwp-OST009f: Connection restored to 10.0.10.52@o2ib7 (at 10.0.10.52@o2ib7) [82151.501511] LustreError: 46867:0:(qsd_reint.c:635:qqi_reint_delayed()) fir-OST009f: Delaying reintegration for qtype:0 until pending updates are flushed. [82151.515245] LustreError: 46867:0:(qsd_reint.c:635:qqi_reint_delayed()) Skipped 902 previous similar messages [82151.955239] Lustre: fir-MDT0000-lwp-OST009d: Connection to fir-MDT0000 (at 10.0.10.51@o2ib7) was lost; in progress operations using this service will wait for recovery to complete [82158.038537] Lustre: 43485:0:(client.c:2295:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1706890074/real 1706890074] req@ffff9dfdacb28900 x1789719626307264/t0(0) o400->fir-MDT0000-lwp-OST009f@10.0.10.52@o2ib7:12/10 lens 224/224 e 0 to 1 dl 1706890202 ref 1 fl Rpc:XNQr/0/ffffffff rc 0/-1 job:'' [82158.068015] Lustre: 43485:0:(client.c:2295:ptlrpc_expire_one_request()) Skipped 5 previous similar messages [82166.922058] Lustre: 43497:0:(client.c:2295:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1706890083/real 1706890083] req@ffff9dfdacb2f980 x1789719626318336/t0(0) o400->fir-MDT0001-lwp-OST0099@10.0.10.51@o2ib7:12/10 lens 224/224 e 0 to 1 dl 1706890211 ref 1 fl Rpc:XNQr/0/ffffffff rc 0/-1 job:'' [82166.922076] Lustre: fir-MDT0001-lwp-OST009b: Connection to fir-MDT0001 (at 10.0.10.51@o2ib7) was lost; in progress operations using this service will wait for recovery to complete [82166.967186] Lustre: 43497:0:(client.c:2295:ptlrpc_expire_one_request()) Skipped 2 previous similar messages [82182.921187] Lustre: 43502:0:(client.c:2295:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1706890099/real 1706890099] req@ffff9dfdacb2bf00 x1789719626337344/t0(0) o400->fir-MDT0000-lwp-OST009b@10.0.10.52@o2ib7:12/10 lens 224/224 e 0 to 1 dl 1706890227 ref 1 fl Rpc:XNQr/0/ffffffff rc 0/-1 job:'' [82182.950340] Lustre: 43502:0:(client.c:2295:ptlrpc_expire_one_request()) Skipped 3 previous similar messages [82183.588665] LustreError: 47221:0:(qsd_reint.c:635:qqi_reint_delayed()) fir-OST009f: Delaying reintegration for qtype:0 until pending updates are flushed. [82183.602705] LustreError: 47221:0:(qsd_reint.c:635:qqi_reint_delayed()) Skipped 3193 previous similar messages [82186.965583] LustreError: 11-0: fir-MDT0000-lwp-OST009b: operation quota_acquire to node 10.0.10.52@o2ib7 failed: rc = -11 [82191.667720] LustreError: 11-0: fir-MDT0000-lwp-OST009b: operation quota_acquire to node 10.0.10.52@o2ib7 failed: rc = -11 [82191.678672] LustreError: Skipped 25 previous similar messages [82198.906588] LustreError: 11-0: fir-MDT0000-lwp-OST009b: operation quota_acquire to node 10.0.10.52@o2ib7 failed: rc = -11 [82199.998262] Lustre: 43484:0:(client.c:2295:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1706890116/real 1706890116] req@ffff9dfdacb2da00 x1789719626348224/t0(0) o400->fir-MDT0000-lwp-OST009d@10.0.10.51@o2ib7:12/10 lens 224/224 e 0 to 1 dl 1706890244 ref 1 fl Rpc:XNQr/0/ffffffff rc 0/-1 job:'' [82200.027549] Lustre: 43484:0:(client.c:2295:ptlrpc_expire_one_request()) Skipped 18 previous similar messages [82205.039382] Lustre: fir-MDT0000-lwp-OST0099: Connection restored to 10.0.10.52@o2ib7 (at 10.0.10.52@o2ib7) [82205.103790] LustreError: 11-0: fir-MDT0000-lwp-OST0099: operation quota_acquire to node 10.0.10.52@o2ib7 failed: rc = -11 [82209.365985] LustreError: 11-0: fir-MDT0000-lwp-OST0099: operation quota_acquire to node 10.0.10.52@o2ib7 failed: rc = -11 [82209.376938] LustreError: Skipped 31 previous similar messages [82212.050615] LustreError: 43475:0:(ldlm_resource.c:1126:ldlm_resource_complain()) fir-MDT0000-lwp-OST009d: namespace resource [0x200000006:0x1020000:0x291d].0x0 (ffff9e426c916840) refcount nonzero (1) after lock cleanup; forcing cleanup. [82212.071532] LustreError: 43475:0:(ldlm_resource.c:1126:ldlm_resource_complain()) Skipped 15 previous similar messages [82212.082328] Lustre: fir-MDT0000-lwp-OST009d: Connection restored to 10.0.10.52@o2ib7 (at 10.0.10.52@o2ib7) [82218.694808] LustreError: 11-0: fir-MDT0000-lwp-OST0099: operation quota_acquire to node 10.0.10.52@o2ib7 failed: rc = -11 [82218.705782] LustreError: Skipped 9 previous similar messages [82227.091709] Lustre: fir-MDT0001-lwp-OST009b: Connection restored to 10.0.10.52@o2ib7 (at 10.0.10.52@o2ib7) [82234.724497] LustreError: 11-0: fir-MDT0000-lwp-OST0099: operation quota_acquire to node 10.0.10.52@o2ib7 failed: rc = -11 [82234.735647] LustreError: Skipped 16 previous similar messages [82237.375239] Lustre: 43507:0:(client.c:2295:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1706890154/real 1706890154] req@ffff9e4153868900 x1789719626362432/t0(0) o400->fir-MDT0001-lwp-OST009d@10.0.10.52@o2ib7:12/10 lens 224/224 e 0 to 1 dl 1706890282 ref 1 fl Rpc:XNQr/0/ffffffff rc 0/-1 job:'' [82237.404394] Lustre: 43507:0:(client.c:2295:ptlrpc_expire_one_request()) Skipped 22 previous similar messages [82248.212501] LustreError: 47194:0:(qsd_reint.c:635:qqi_reint_delayed()) fir-OST009d: Delaying reintegration for qtype:0 until pending updates are flushed. [82248.226724] LustreError: 47194:0:(qsd_reint.c:635:qqi_reint_delayed()) Skipped 3627 previous similar messages [82267.517016] LustreError: 11-0: fir-MDT0000-lwp-OST0099: operation quota_acquire to node 10.0.10.52@o2ib7 failed: rc = -11 [82267.527979] LustreError: Skipped 128 previous similar messages [82295.429564] Lustre: fir-OST009b: deleting orphan objects from 0x29c0000401:4155303 to 0x29c0000401:4155425 [82295.429566] Lustre: fir-OST009d: deleting orphan objects from 0x2a40000400:4157895 to 0x2a40000400:4157985 [82295.429568] Lustre: fir-OST009f: deleting orphan objects from 0x2ac0000401:4167835 to 0x2ac0000401:4167937 [82295.429574] Lustre: fir-OST0099: deleting orphan objects from 0x2940000401:4131444 to 0x2940000401:4131585 [82306.407596] Lustre: fir-OST009b: deleting orphan objects from 0x0:1935829 to 0x0:1935873 [82306.407778] Lustre: fir-OST0099: deleting orphan objects from 0x0:1929383 to 0x0:1929409 [82306.407820] Lustre: fir-OST009d: deleting orphan objects from 0x0:1936270 to 0x0:1936321 [82306.408113] Lustre: fir-OST009f: deleting orphan objects from 0x0:1943499 to 0x0:1943521 [82830.214146] Lustre: 43496:0:(client.c:2295:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1706890746/real 1706890746] req@ffff9e01483e9f80 x1789719629234816/t0(0) o400->MGC10.0.10.51@o2ib7@10.0.10.51@o2ib7:26/25 lens 224/224 e 0 to 1 dl 1706890874 ref 1 fl Rpc:XNQr/0/ffffffff rc 0/-1 job:'' [82830.242962] Lustre: 43496:0:(client.c:2295:ptlrpc_expire_one_request()) Skipped 29 previous similar messages [82830.252796] LustreError: 166-1: MGC10.0.10.51@o2ib7: Connection to MGS (at 10.0.10.51@o2ib7) was lost; in progress operations using this service will fail [82890.264039] Lustre: Evicted from MGS (at 10.0.10.52@o2ib7) after server handle changed from 0xe3d9f4f5d973c0a to 0x4036013227c39278 [82890.276365] Lustre: MGC10.0.10.51@o2ib7: Connection restored to 10.0.10.52@o2ib7 (at 10.0.10.52@o2ib7) [82890.285671] Lustre: Skipped 3 previous similar messages [82951.335727] Lustre: fir-MDT0002-lwp-OST009b: Connection to fir-MDT0002 (at 10.0.10.54@o2ib7) was lost; in progress operations using this service will wait for recovery to complete [82951.335729] Lustre: fir-MDT0002-lwp-OST009f: Connection to fir-MDT0002 (at 10.0.10.54@o2ib7) was lost; in progress operations using this service will wait for recovery to complete [82951.335733] Lustre: Skipped 3 previous similar messages [82951.372931] Lustre: Skipped 1 previous similar message [83061.026602] LNet: 27861:0:(o2iblnd_cb.c:3418:kiblnd_check_conns()) Timed out tx for 10.0.10.51@o2ib7: 1 seconds [83107.615897] Lustre: fir-MDT0002-lwp-OST009b: Connection restored to 10.0.10.53@o2ib7 (at 10.0.10.53@o2ib7) [83129.612072] Lustre: fir-OST009b: deleting orphan objects from 0x29c0000402:6298539 to 0x29c0000402:6298561 [83129.612075] Lustre: fir-OST009d: deleting orphan objects from 0x2a40000402:6288203 to 0x2a40000402:6288225 [83129.612133] Lustre: fir-OST009f: deleting orphan objects from 0x2ac0000400:6322638 to 0x2ac0000400:6322657 [83129.612179] Lustre: fir-OST0099: deleting orphan objects from 0x2940000400:6262406 to 0x2940000400:6262433 [83431.296783] Lustre: fir-OST009d: haven't heard from client d32950af-0cf9-48f7-9553-ece9c85d57f2 (at 10.51.12.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f1620800, cur 1706891476 expire 1706891326 last 1706891249 [83441.294342] Lustre: fir-OST009f: haven't heard from client d32950af-0cf9-48f7-9553-ece9c85d57f2 (at 10.51.12.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f20e5800, cur 1706891486 expire 1706891336 last 1706891259 [83451.301467] Lustre: fir-OST009b: haven't heard from client d32950af-0cf9-48f7-9553-ece9c85d57f2 (at 10.51.12.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e42c91d2c00, cur 1706891496 expire 1706891346 last 1706891269 [83451.323432] Lustre: Skipped 1 previous similar message [85462.178165] Lustre: fir-OST009f: haven't heard from client c4309a4d-2a9d-474a-8ff2-81ccf7de8e97 (at 10.51.5.52@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f2068c00, cur 1706893507 expire 1706893357 last 1706893280 [85701.266186] Lustre: fir-MDT0000-lwp-OST009b: Connection to fir-MDT0000 (at 10.0.10.52@o2ib7) was lost; in progress operations using this service will wait for recovery to complete [85706.289831] Lustre: fir-MDT0000-lwp-OST009d: Connection to fir-MDT0000 (at 10.0.10.52@o2ib7) was lost; in progress operations using this service will wait for recovery to complete [85720.337108] Lustre: fir-MDT0000-lwp-OST009f: Connection to fir-MDT0000 (at 10.0.10.52@o2ib7) was lost; in progress operations using this service will wait for recovery to complete [85720.353098] Lustre: Skipped 1 previous similar message [85761.360371] Lustre: fir-MDT0000-lwp-OST009b: Connection restored to 10.0.10.51@o2ib7 (at 10.0.10.51@o2ib7) [85761.370372] Lustre: Skipped 3 previous similar messages [85761.374625] LustreError: 44871:0:(qsd_reint.c:635:qqi_reint_delayed()) fir-OST009b: Delaying reintegration for qtype:0 until pending updates are flushed. [85761.374627] LustreError: 44871:0:(qsd_reint.c:635:qqi_reint_delayed()) Skipped 1925 previous similar messages [85766.425651] Lustre: fir-MDT0000-lwp-OST009d: Connection restored to 10.0.10.51@o2ib7 (at 10.0.10.51@o2ib7) [85780.436394] Lustre: fir-MDT0000-lwp-OST009f: Connection restored to 10.0.10.51@o2ib7 (at 10.0.10.51@o2ib7) [85780.502785] LustreError: 44759:0:(qsd_reint.c:635:qqi_reint_delayed()) fir-OST009f: Delaying reintegration for qtype:0 until pending updates are flushed. [85780.516591] LustreError: 44759:0:(qsd_reint.c:635:qqi_reint_delayed()) Skipped 7 previous similar messages [85780.687157] LustreError: 11-0: fir-MDT0000-lwp-OST009f: operation quota_acquire to node 10.0.10.51@o2ib7 failed: rc = -11 [85780.698255] LustreError: Skipped 102 previous similar messages [85840.725651] LustreError: 11-0: fir-MDT0000-lwp-OST009f: operation quota_acquire to node 10.0.10.51@o2ib7 failed: rc = -11 [85840.736607] LustreError: Skipped 7 previous similar messages [85900.738389] LustreError: 11-0: fir-MDT0000-lwp-OST009f: operation quota_acquire to node 10.0.10.51@o2ib7 failed: rc = -11 [85900.749346] LustreError: Skipped 4 previous similar messages [85925.277255] Lustre: fir-OST009b: deleting orphan objects from 0x0:1938370 to 0x0:1938401 [85925.277289] Lustre: fir-OST009d: deleting orphan objects from 0x0:1938757 to 0x0:1938785 [85925.277355] Lustre: fir-OST009f: deleting orphan objects from 0x0:1946047 to 0x0:1946081 [85925.277360] Lustre: fir-OST0099: deleting orphan objects from 0x0:1931783 to 0x0:1931809 [86799.238406] Lustre: 43480:0:(client.c:2295:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1706894716/real 1706894716] req@ffff9e3eee573180 x1789719670479488/t0(0) o400->MGC10.0.10.51@o2ib7@10.0.10.52@o2ib7:26/25 lens 224/224 e 0 to 1 dl 1706894844 ref 1 fl Rpc:XNQr/0/ffffffff rc 0/-1 job:'' [86799.267362] LustreError: 166-1: MGC10.0.10.51@o2ib7: Connection to MGS (at 10.0.10.52@o2ib7) was lost; in progress operations using this service will fail [86859.278250] Lustre: Evicted from MGS (at 10.0.10.51@o2ib7) after server handle changed from 0x4036013227c39278 to 0xe3bacf56340d8b1e [86859.290239] Lustre: MGC10.0.10.51@o2ib7: Connection restored to 10.0.10.51@o2ib7 (at 10.0.10.51@o2ib7) [86859.299547] Lustre: Skipped 1 previous similar message [88671.004249] Lustre: fir-OST009b: haven't heard from client 6af4868f-ee2c-487c-b83b-a6646070d5f8 (at 10.51.4.22@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e41321edc00, cur 1706896716 expire 1706896566 last 1706896489 [88671.025946] Lustre: Skipped 3 previous similar messages [88747.008631] Lustre: fir-OST009f: haven't heard from client 3e6d1f2f-b757-45a0-8ca4-2a25e5f9932f (at 10.50.6.31@o2ib2) in 208 seconds. I think it's dead, and I am evicting it. exp ffff9e0140cd5c00, cur 1706896792 expire 1706896642 last 1706896584 [88747.030339] Lustre: Skipped 3 previous similar messages [90487.905713] Lustre: fir-OST009d: haven't heard from client 74ff874a-f734-474f-ac10-f95d70671da8 (at 10.51.13.12@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f26c1800, cur 1706898533 expire 1706898383 last 1706898306 [90487.927505] Lustre: Skipped 7 previous similar messages [90497.907187] Lustre: fir-OST009f: haven't heard from client 74ff874a-f734-474f-ac10-f95d70671da8 (at 10.51.13.12@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f2114800, cur 1706898543 expire 1706898393 last 1706898316 [90497.928974] Lustre: Skipped 2 previous similar messages [92373.800314] Lustre: fir-OST009f: haven't heard from client 1c604bb3-6de5-463c-a211-0fbfa5a0f33d (at 10.51.13.12@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02506b5400, cur 1706900419 expire 1706900269 last 1706900192 [94317.348583] hrtimer: interrupt took 2693070 ns [99449.428547] Lustre: fir-OST009f: haven't heard from client 331771f8-efb6-4563-9108-0b7748f33f88 (at 10.51.12.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3f7e76d000, cur 1706907495 expire 1706907345 last 1706907268 [99449.450250] Lustre: Skipped 3 previous similar messages [99457.414504] Lustre: fir-OST0099: haven't heard from client 331771f8-efb6-4563-9108-0b7748f33f88 (at 10.51.12.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e41d75f6c00, cur 1706907503 expire 1706907353 last 1706907276 [99457.436207] Lustre: Skipped 2 previous similar messages [108522.921128] Lustre: fir-OST009f: haven't heard from client fe0646fb-ee66-4f40-b2c9-182672b94321 (at 10.51.12.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e41c0586000, cur 1706916569 expire 1706916419 last 1706916342 [108598.917620] Lustre: fir-OST0099: haven't heard from client 3be1d3d4-7753-4c5c-91f8-0bcd3d4fb7b2 (at 10.50.7.56@o2ib2) in 211 seconds. I think it's dead, and I am evicting it. exp ffff9e02062fec00, cur 1706916645 expire 1706916495 last 1706916434 [108598.939567] Lustre: Skipped 3 previous similar messages [108634.921306] Lustre: fir-OST009d: haven't heard from client 3be1d3d4-7753-4c5c-91f8-0bcd3d4fb7b2 (at 10.50.7.56@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dff74601000, cur 1706916681 expire 1706916531 last 1706916454 [108634.943336] Lustre: Skipped 2 previous similar messages [115999.518489] Lustre: fir-OST0099: haven't heard from client a8322c50-427f-4316-acaf-ffe98f9921fa (at 10.51.12.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3ea4707000, cur 1706924046 expire 1706923896 last 1706923819 [116007.513879] Lustre: fir-OST009f: haven't heard from client a8322c50-427f-4316-acaf-ffe98f9921fa (at 10.51.12.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3f953f0000, cur 1706924054 expire 1706923904 last 1706923827 [122147.180584] Lustre: fir-OST009d: haven't heard from client dc061788-7d7b-43fc-b64a-b287783ebc8b (at 10.51.12.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e4367137400, cur 1706930194 expire 1706930044 last 1706929967 [122147.202488] Lustre: Skipped 2 previous similar messages [122153.183170] Lustre: fir-OST0099: haven't heard from client dc061788-7d7b-43fc-b64a-b287783ebc8b (at 10.51.12.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e4186310800, cur 1706930200 expire 1706930050 last 1706929973 [122163.183286] Lustre: fir-OST009b: haven't heard from client dc061788-7d7b-43fc-b64a-b287783ebc8b (at 10.51.12.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e40a8595000, cur 1706930210 expire 1706930060 last 1706929983 [122163.205075] Lustre: Skipped 1 previous similar message [126281.966101] Lustre: fir-OST009d: haven't heard from client 274aab39-e5a9-4521-b63d-084a4c9eba77 (at 10.51.9.40@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f1b56400, cur 1706934329 expire 1706934179 last 1706934102 [126296.964182] Lustre: fir-OST0099: haven't heard from client 274aab39-e5a9-4521-b63d-084a4c9eba77 (at 10.51.9.40@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02ee59f400, cur 1706934344 expire 1706934194 last 1706934117 [132269.626713] Lustre: fir-OST009b: haven't heard from client 46ef8ea7-4172-4dbb-96c6-ffe2fd457808 (at 10.51.12.6@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e43ad114400, cur 1706940317 expire 1706940167 last 1706940090 [132269.648497] Lustre: Skipped 2 previous similar messages [134091.528453] Lustre: fir-OST009f: haven't heard from client a9e253a8-4da6-49c5-bca5-dba264495536 (at 10.50.9.25@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3fcf154000, cur 1706942139 expire 1706941989 last 1706941912 [134091.550247] Lustre: Skipped 3 previous similar messages [134167.527383] Lustre: fir-OST009b: haven't heard from client 522ede3d-3768-4550-8184-c0343a6d3884 (at 10.50.2.39@o2ib2) in 153 seconds. I think it's dead, and I am evicting it. exp ffff9e01d22ca400, cur 1706942215 expire 1706942065 last 1706942062 [134167.549172] Lustre: Skipped 3 previous similar messages [134243.533259] Lustre: fir-OST0099: haven't heard from client 5254f13b-c3e4-43f5-9c02-b7673152cc94 (at 10.50.4.34@o2ib2) in 183 seconds. I think it's dead, and I am evicting it. exp ffff9e41f62ffc00, cur 1706942291 expire 1706942141 last 1706942108 [134243.555282] Lustre: Skipped 2 previous similar messages [134251.553430] Lustre: fir-OST009d: haven't heard from client 522ede3d-3768-4550-8184-c0343a6d3884 (at 10.50.2.39@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01fcde8000, cur 1706942299 expire 1706942149 last 1706942072 [134319.516003] Lustre: fir-OST0099: haven't heard from client 7be2a759-819d-4f62-9437-c97f7ef6f251 (at 10.50.9.43@o2ib2) in 183 seconds. I think it's dead, and I am evicting it. exp ffff9e3fcbb3bc00, cur 1706942367 expire 1706942217 last 1706942184 [134327.517510] Lustre: fir-OST009d: haven't heard from client 6b8c69df-e3c8-435f-aad0-31c1a8e6e7a0 (at 10.50.13.7@o2ib2) in 194 seconds. I think it's dead, and I am evicting it. exp ffff9e40a6322c00, cur 1706942375 expire 1706942225 last 1706942181 [134357.513282] Lustre: fir-OST009b: haven't heard from client 7be2a759-819d-4f62-9437-c97f7ef6f251 (at 10.50.9.43@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3fd7d85400, cur 1706942405 expire 1706942255 last 1706942178 [134397.519133] Lustre: fir-OST009f: haven't heard from client 11256cf7-2e7f-4daf-b06f-3b0c1c267942 (at 10.50.10.20@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e41f5484000, cur 1706942445 expire 1706942295 last 1706942218 [134473.516469] Lustre: fir-OST009f: haven't heard from client 4c3a6feb-7fd9-4d8e-ac99-322065e942cd (at 10.51.6.72@o2ib3) in 220 seconds. I think it's dead, and I am evicting it. exp ffff9e02f2038000, cur 1706942521 expire 1706942371 last 1706942301 [134473.538261] Lustre: Skipped 3 previous similar messages [134766.494745] Lustre: fir-OST009f: haven't heard from client 89d60a01-6da0-4f7d-b645-f0b9ab1162d0 (at 10.50.8.72@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e41c326fc00, cur 1706942814 expire 1706942664 last 1706942587 [134766.516549] Lustre: Skipped 10 previous similar messages [135256.468253] Lustre: fir-OST009f: haven't heard from client 36f22011-24ba-4c34-9cd2-8a0e1e117f50 (at 10.51.2.56@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e40b4bebc00, cur 1706943304 expire 1706943154 last 1706943077 [135256.490047] Lustre: Skipped 5 previous similar messages [136023.428159] Lustre: fir-OST009f: haven't heard from client 42cf56f7-dc2d-479a-969b-0acfdf8d6481 (at 10.50.5.13@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3e8c0b1000, cur 1706944071 expire 1706943921 last 1706943844 [136023.449947] Lustre: Skipped 5 previous similar messages [138681.277030] Lustre: fir-OST009b: haven't heard from client aadfec74-d738-48d8-b472-f1fe91e5bebf (at 10.51.16.2@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e4362f73800, cur 1706946729 expire 1706946579 last 1706946502 [138681.298852] Lustre: Skipped 3 previous similar messages [139534.238132] Lustre: fir-OST009d: haven't heard from client 7ad9b818-4653-4e09-ba34-a9c31a17ded7 (at 10.51.5.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e42c7e21800, cur 1706947582 expire 1706947432 last 1706947355 [139534.259832] Lustre: Skipped 3 previous similar messages [139545.229505] Lustre: fir-OST009b: haven't heard from client 7ad9b818-4653-4e09-ba34-a9c31a17ded7 (at 10.51.5.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01fc930800, cur 1706947593 expire 1706947443 last 1706947366 [139966.209692] Lustre: fir-OST009b: haven't heard from client 07fd9011-a97b-4618-bd34-1432ca5f9131 (at 10.51.5.13@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e41d8eac800, cur 1706948014 expire 1706947864 last 1706947787 [139966.231614] Lustre: Skipped 1 previous similar message [140516.176666] Lustre: fir-OST0099: haven't heard from client 2d24007e-5257-4aed-92c0-b58f1b6c00dc (at 10.51.5.28@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e00089d7800, cur 1706948564 expire 1706948414 last 1706948337 [140608.172964] Lustre: fir-OST009d: haven't heard from client 90158177-804d-43dc-bdd2-4eb73ade452f (at 10.51.5.30@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01e71ea000, cur 1706948656 expire 1706948506 last 1706948429 [143157.033265] Lustre: fir-OST009f: haven't heard from client f7d5f67a-041e-4377-af57-bca618aa0102 (at 10.50.8.12@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f27ba400, cur 1706951205 expire 1706951055 last 1706950978 [143157.055044] Lustre: Skipped 2 previous similar messages [144898.938781] Lustre: fir-OST0099: haven't heard from client 2a1262d3-6b14-4754-9c93-d39c4cf22c34 (at 10.51.11.8@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02eeb3c800, cur 1706952947 expire 1706952797 last 1706952720 [144898.960698] Lustre: Skipped 7 previous similar messages [144904.936877] Lustre: fir-OST009d: haven't heard from client 2a1262d3-6b14-4754-9c93-d39c4cf22c34 (at 10.51.11.8@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f2e68800, cur 1706952953 expire 1706952803 last 1706952726 [144910.955862] Lustre: fir-OST009b: haven't heard from client 2a1262d3-6b14-4754-9c93-d39c4cf22c34 (at 10.51.11.8@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e4362ea2800, cur 1706952959 expire 1706952809 last 1706952732 [144910.977897] Lustre: Skipped 1 previous similar message [147092.818492] Lustre: fir-OST009b: haven't heard from client 02000900-cd06-490a-9fd4-6899f39f957e (at 10.50.5.56@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e0139b54400, cur 1706955141 expire 1706954991 last 1706954914 [147499.815009] Lustre: fir-OST009b: haven't heard from client a30350a8-4a13-4755-8269-5c4688eb497d (at 10.51.13.16@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e436357e400, cur 1706955548 expire 1706955398 last 1706955321 [147499.836895] Lustre: Skipped 3 previous similar messages [147504.824121] Lustre: fir-OST009d: haven't heard from client a30350a8-4a13-4755-8269-5c4688eb497d (at 10.51.13.16@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e0305ff8800, cur 1706955553 expire 1706955403 last 1706955326 [147504.846001] Lustre: Skipped 1 previous similar message [147511.794170] Lustre: fir-OST0099: haven't heard from client a30350a8-4a13-4755-8269-5c4688eb497d (at 10.51.13.16@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02ee407c00, cur 1706955560 expire 1706955410 last 1706955333 [148582.740872] Lustre: fir-OST009b: haven't heard from client ded58f72-21af-4a4c-83b5-5a44f81d14ea (at 10.51.13.6@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e0090203c00, cur 1706956631 expire 1706956481 last 1706956404 [148585.769936] Lustre: fir-OST009d: haven't heard from client ded58f72-21af-4a4c-83b5-5a44f81d14ea (at 10.51.13.6@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01ca43f800, cur 1706956634 expire 1706956484 last 1706956407 [148585.791720] Lustre: Skipped 2 previous similar messages [149655.693737] Lustre: fir-OST009b: haven't heard from client 48211e3a-ddb6-4f59-9e8b-351eb41b9bc7 (at 10.51.5.16@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e43638ed000, cur 1706957704 expire 1706957554 last 1706957477 [149660.696263] Lustre: fir-OST0099: haven't heard from client 48211e3a-ddb6-4f59-9e8b-351eb41b9bc7 (at 10.51.5.16@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02ee51a800, cur 1706957709 expire 1706957559 last 1706957482 [149675.693142] Lustre: fir-OST009f: haven't heard from client 48211e3a-ddb6-4f59-9e8b-351eb41b9bc7 (at 10.51.5.16@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f202ac00, cur 1706957724 expire 1706957574 last 1706957497 [150355.646224] Lustre: fir-OST009b: haven't heard from client 5a1d7e59-d0f0-4b55-82d6-10d2f5168714 (at 10.51.12.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e41c7920400, cur 1706958404 expire 1706958254 last 1706958177 [150355.668016] Lustre: Skipped 1 previous similar message [150367.638745] Lustre: fir-OST0099: haven't heard from client 5a1d7e59-d0f0-4b55-82d6-10d2f5168714 (at 10.51.12.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e40f8445c00, cur 1706958416 expire 1706958266 last 1706958189 [151031.602156] Lustre: fir-OST009b: haven't heard from client 0f393794-b8a1-4e6f-8531-55bb237acb17 (at 10.51.8.39@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e42cc139800, cur 1706959080 expire 1706958930 last 1706958853 [151031.623952] Lustre: Skipped 2 previous similar messages [151542.605913] Lustre: fir-OST009b: haven't heard from client 368b9161-c669-4cad-a72c-f11027471e75 (at 10.51.6.41@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02065ea400, cur 1706959591 expire 1706959441 last 1706959364 [151542.627708] Lustre: Skipped 3 previous similar messages [151552.573788] Lustre: fir-OST009d: haven't heard from client 368b9161-c669-4cad-a72c-f11027471e75 (at 10.51.6.41@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e013d69f000, cur 1706959601 expire 1706959451 last 1706959374 [151561.579689] Lustre: fir-OST0099: haven't heard from client 368b9161-c669-4cad-a72c-f11027471e75 (at 10.51.6.41@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dfe94dc3c00, cur 1706959610 expire 1706959460 last 1706959383 [159578.135867] Lustre: fir-OST009f: haven't heard from client 1f5c4bd3-4ddf-4a79-b064-00d8c44a6f48 (at 10.51.18.15@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e0218882400, cur 1706967627 expire 1706967477 last 1706967400 [159578.157752] Lustre: Skipped 1 previous similar message [168494.651385] Lustre: fir-OST0099: haven't heard from client 41d36c5e-64e2-402d-b4a9-221d49dfd973 (at 10.51.12.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3ea1d28c00, cur 1706976544 expire 1706976394 last 1706976317 [168570.648428] Lustre: fir-OST0099: haven't heard from client 64780bb5-2672-4cd2-bf3a-77f2846a7228 (at 10.51.6.18@o2ib3) in 221 seconds. I think it's dead, and I am evicting it. exp ffff9e3fd1b12000, cur 1706976620 expire 1706976470 last 1706976399 [168570.670441] Lustre: Skipped 19 previous similar messages [168576.649639] Lustre: fir-OST009f: haven't heard from client 64780bb5-2672-4cd2-bf3a-77f2846a7228 (at 10.51.6.18@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e41f6313000, cur 1706976626 expire 1706976476 last 1706976399 [168576.671426] Lustre: Skipped 8 previous similar messages [168646.645026] Lustre: fir-OST009b: haven't heard from client fa08d0c2-f443-4a3b-97f0-42299f894d7a (at 10.50.17.45@o2ib2) in 214 seconds. I think it's dead, and I am evicting it. exp ffff9e420b083c00, cur 1706976696 expire 1706976546 last 1706976482 [168646.666905] Lustre: Skipped 2 previous similar messages [168658.660049] Lustre: fir-OST009f: haven't heard from client b1fdf1ec-4100-4ed9-be90-9676065761ba (at 10.50.7.32@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e008e04e800, cur 1706976708 expire 1706976558 last 1706976481 [168658.681835] Lustre: Skipped 23 previous similar messages [169061.642791] Lustre: fir-OST0099: haven't heard from client 015d9e4c-cc7b-472b-8f16-0e7e38b179c9 (at 10.50.2.6@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01f5c23000, cur 1706977111 expire 1706976961 last 1706976884 [169061.664487] Lustre: Skipped 23 previous similar messages [171096.509092] Lustre: fir-OST009f: haven't heard from client f11dadf2-ad33-4bd4-95e3-cdc362241f83 (at 10.50.8.64@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e41321eb400, cur 1706979146 expire 1706978996 last 1706978919 [171096.530891] Lustre: Skipped 7 previous similar messages [171101.517619] Lustre: fir-OST009d: haven't heard from client f11dadf2-ad33-4bd4-95e3-cdc362241f83 (at 10.50.8.64@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3fcb660c00, cur 1706979151 expire 1706979001 last 1706978924 [171101.539408] Lustre: Skipped 1 previous similar message [171108.511175] Lustre: fir-OST0099: haven't heard from client f11dadf2-ad33-4bd4-95e3-cdc362241f83 (at 10.50.8.64@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e413de54000, cur 1706979158 expire 1706979008 last 1706978931 [172740.423400] Lustre: fir-OST0099: haven't heard from client a5de80b2-17af-44bd-beff-f1fa8f4b8a4a (at 10.51.4.49@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e00086a0c00, cur 1706980790 expire 1706980640 last 1706980563 [172749.417497] Lustre: fir-OST009b: haven't heard from client a5de80b2-17af-44bd-beff-f1fa8f4b8a4a (at 10.51.4.49@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e00be7db800, cur 1706980799 expire 1706980649 last 1706980572 [172749.439280] Lustre: Skipped 1 previous similar message [172755.421153] Lustre: fir-OST009f: haven't heard from client a5de80b2-17af-44bd-beff-f1fa8f4b8a4a (at 10.51.4.49@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f14c1000, cur 1706980805 expire 1706980655 last 1706980578 [174963.298153] Lustre: fir-OST009b: haven't heard from client c504269b-c37d-47f3-acd5-0bfb7acbebbb (at 10.50.6.35@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dff7ceb3400, cur 1706983013 expire 1706982863 last 1706982786 [182302.895943] Lustre: fir-OST009b: haven't heard from client 3eca1b5f-5ef0-42e6-a62d-83499c1b1340 (at 10.51.4.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e42c968f400, cur 1706990353 expire 1706990203 last 1706990126 [182302.917645] Lustre: Skipped 1 previous similar message [182378.891897] Lustre: fir-OST009b: haven't heard from client 9e1397c7-1577-4ba8-adbf-b4acb2fcbc95 (at 10.51.3.38@o2ib3) in 160 seconds. I think it's dead, and I am evicting it. exp ffff9dff7f8ac400, cur 1706990429 expire 1706990279 last 1706990269 [182378.913838] Lustre: Skipped 3 previous similar messages [182457.887861] Lustre: fir-OST0099: haven't heard from client 9e1397c7-1577-4ba8-adbf-b4acb2fcbc95 (at 10.51.3.38@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e0116956000, cur 1706990508 expire 1706990358 last 1706990281 [182464.886990] Lustre: fir-OST009d: haven't heard from client 9e1397c7-1577-4ba8-adbf-b4acb2fcbc95 (at 10.51.3.38@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e0138640400, cur 1706990515 expire 1706990365 last 1706990288 [182464.908900] Lustre: Skipped 1 previous similar message [183050.860929] Lustre: fir-OST009d: haven't heard from client f890ed36-109e-4def-adea-9cc38cb2d3a6 (at 10.51.3.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f2698400, cur 1706991101 expire 1706990951 last 1706990874 [187915.591438] Lustre: fir-OST0099: haven't heard from client bab1ff08-2de1-4ad4-b38a-61afead4a39a (at 10.50.6.7@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e41f9813000, cur 1706995966 expire 1706995816 last 1706995739 [187915.613234] Lustre: Skipped 3 previous similar messages [187925.610617] Lustre: fir-OST009d: haven't heard from client bab1ff08-2de1-4ad4-b38a-61afead4a39a (at 10.50.6.7@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dff6e33e400, cur 1706995976 expire 1706995826 last 1706995749 [187925.632502] Lustre: Skipped 1 previous similar message [187935.603862] Lustre: fir-OST009f: haven't heard from client bab1ff08-2de1-4ad4-b38a-61afead4a39a (at 10.50.6.7@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dff6e339000, cur 1706995986 expire 1706995836 last 1706995759 [188637.564950] Lustre: fir-OST009d: haven't heard from client 917816b8-22c1-4508-9a91-d54091327fcd (at 10.50.8.44@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f2e6d400, cur 1706996688 expire 1706996538 last 1706996461 [188643.550866] Lustre: fir-OST009b: haven't heard from client 917816b8-22c1-4508-9a91-d54091327fcd (at 10.50.8.44@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e431ee2b000, cur 1706996694 expire 1706996544 last 1706996467 [191435.399228] Lustre: fir-OST0099: haven't heard from client 58562d59-efd3-496c-a00c-6ddcc911a4de (at 10.51.4.44@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e40b5bf9c00, cur 1706999486 expire 1706999336 last 1706999259 [191435.421014] Lustre: Skipped 2 previous similar messages [191441.399824] Lustre: fir-OST009d: haven't heard from client 58562d59-efd3-496c-a00c-6ddcc911a4de (at 10.51.4.44@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e41c5b24400, cur 1706999492 expire 1706999342 last 1706999265 [191446.398956] Lustre: fir-OST009b: haven't heard from client 58562d59-efd3-496c-a00c-6ddcc911a4de (at 10.51.4.44@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e41d854b000, cur 1706999497 expire 1706999347 last 1706999270 [194239.249377] Lustre: fir-OST009b: haven't heard from client 8a863cf8-ef2b-4fe7-8ec4-12f037642027 (at 10.51.9.18@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dfd6d7a1400, cur 1707002290 expire 1707002140 last 1707002063 [194239.271259] Lustre: Skipped 1 previous similar message [195148.201435] Lustre: fir-OST009b: haven't heard from client de7e295f-2786-4904-b8df-017c03c18bc6 (at 10.51.9.30@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3f7339fc00, cur 1707003199 expire 1707003049 last 1707002972 [195852.163921] Lustre: fir-OST009b: haven't heard from client a82d3846-ac77-4c20-b033-b47001df4d1c (at 10.51.9.19@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e41ff06cc00, cur 1707003903 expire 1707003753 last 1707003676 [198985.988057] Lustre: fir-OST009b: haven't heard from client 4ce01df5-c125-4bd9-8ba7-99a45bc9cc72 (at 10.51.4.71@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e013a665400, cur 1707007037 expire 1707006887 last 1707006810 [204118.708580] Lustre: fir-OST009f: haven't heard from client 296509bd-b15a-4d55-94c7-48bc82bf54de (at 10.50.5.60@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dff75a3ec00, cur 1707012170 expire 1707012020 last 1707011943 [204118.730381] Lustre: Skipped 1 previous similar message [204123.721887] Lustre: fir-OST009b: haven't heard from client 296509bd-b15a-4d55-94c7-48bc82bf54de (at 10.50.5.60@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01f6555400, cur 1707012175 expire 1707012025 last 1707011948 [204133.718956] Lustre: fir-OST0099: haven't heard from client 296509bd-b15a-4d55-94c7-48bc82bf54de (at 10.50.5.60@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01f6552000, cur 1707012185 expire 1707012035 last 1707011958 [212633.246320] Lustre: fir-OST009d: haven't heard from client 544c6948-49c2-4804-8b5b-8d2070d1afca (at 10.50.15.9@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e40a93c9400, cur 1707020685 expire 1707020535 last 1707020458 [212633.268104] Lustre: Skipped 1 previous similar message [224726.585359] Lustre: fir-OST009d: haven't heard from client f11081fb-159b-439b-972b-bb8e8e00323f (at 10.50.12.5@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f317b800, cur 1707032779 expire 1707032629 last 1707032552 [224731.595330] Lustre: fir-OST0099: haven't heard from client f11081fb-159b-439b-972b-bb8e8e00323f (at 10.50.12.5@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02ee47d000, cur 1707032784 expire 1707032634 last 1707032557 [224731.617124] Lustre: Skipped 2 previous similar messages [228718.371882] Lustre: fir-OST009b: haven't heard from client 6c8a2f72-f677-41e2-ba7f-6051357eb027 (at 10.50.8.67@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dfe8efa3000, cur 1707036771 expire 1707036621 last 1707036544 [228723.367641] Lustre: fir-OST0099: haven't heard from client 6c8a2f72-f677-41e2-ba7f-6051357eb027 (at 10.50.8.67@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01f2256800, cur 1707036776 expire 1707036626 last 1707036549 [229149.001780] md: data-check of RAID array md1 [229155.033076] md: data-check of RAID array md3 [229161.069175] md: data-check of RAID array md5 [229167.113433] md: data-check of RAID array md7 [238401.826880] Lustre: fir-OST009b: haven't heard from client 64d9b5b8-2fce-4626-b917-68d1e0bc26d5 (at 10.50.12.8@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e40a80c9400, cur 1707046455 expire 1707046305 last 1707046228 [238401.848665] Lustre: Skipped 2 previous similar messages [238724.808122] Lustre: fir-OST0099: haven't heard from client fd7720f0-6780-41e0-ae21-9590fd1da326 (at 10.51.8.57@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01ecc4ec00, cur 1707046778 expire 1707046628 last 1707046551 [238724.830203] Lustre: Skipped 3 previous similar messages [238729.820729] Lustre: fir-OST009b: haven't heard from client fd7720f0-6780-41e0-ae21-9590fd1da326 (at 10.51.8.57@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e00bd5c8400, cur 1707046783 expire 1707046633 last 1707046556 [238729.842521] Lustre: Skipped 1 previous similar message [238735.829776] Lustre: fir-OST009d: haven't heard from client fd7720f0-6780-41e0-ae21-9590fd1da326 (at 10.51.8.57@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e0136b6e000, cur 1707046789 expire 1707046639 last 1707046562 [242791.592738] Lustre: fir-OST0099: haven't heard from client 07d0125e-ac0c-4cfa-ba50-12b6a835354f (at 10.50.5.58@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01a1b4ec00, cur 1707050845 expire 1707050695 last 1707050618 [242796.580956] Lustre: fir-OST009d: haven't heard from client 07d0125e-ac0c-4cfa-ba50-12b6a835354f (at 10.50.5.58@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02ed83c400, cur 1707050850 expire 1707050700 last 1707050623 [242811.588521] Lustre: fir-OST009b: haven't heard from client 07d0125e-ac0c-4cfa-ba50-12b6a835354f (at 10.50.5.58@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e0008b86400, cur 1707050865 expire 1707050715 last 1707050638 [248549.257759] Lustre: fir-OST009d: haven't heard from client ab4ce31a-0c75-45e6-ad2f-7f8f5aa4f320 (at 10.50.16.8@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e41c3041c00, cur 1707056603 expire 1707056453 last 1707056376 [248549.279537] Lustre: Skipped 1 previous similar message [248569.260016] Lustre: fir-OST009f: haven't heard from client ab4ce31a-0c75-45e6-ad2f-7f8f5aa4f320 (at 10.50.16.8@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e42c8296800, cur 1707056623 expire 1707056473 last 1707056396 [248569.282245] Lustre: Skipped 1 previous similar message [262600.458130] Lustre: fir-OST009b: haven't heard from client 97931f4c-d2b5-4547-90fe-e91ddc5964a0 (at 10.50.8.68@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e436610dc00, cur 1707070655 expire 1707070505 last 1707070428 [262600.479927] Lustre: Skipped 1 previous similar message [262606.457726] Lustre: fir-OST0099: haven't heard from client 97931f4c-d2b5-4547-90fe-e91ddc5964a0 (at 10.50.8.68@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02eeb38000, cur 1707070661 expire 1707070511 last 1707070434 [276646.665356] Lustre: fir-OST009f: haven't heard from client 6f9b7d43-b82a-4fd8-89e0-930e3c71412b (at 10.51.12.7@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e010d2f5c00, cur 1707084702 expire 1707084552 last 1707084475 [276646.687241] Lustre: Skipped 2 previous similar messages [276661.666630] Lustre: fir-OST009d: haven't heard from client 6f9b7d43-b82a-4fd8-89e0-930e3c71412b (at 10.51.12.7@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02008e5800, cur 1707084717 expire 1707084567 last 1707084490 [276661.688557] Lustre: Skipped 1 previous similar message [276666.669052] Lustre: fir-OST009b: haven't heard from client 6f9b7d43-b82a-4fd8-89e0-930e3c71412b (at 10.51.12.7@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01a969f000, cur 1707084722 expire 1707084572 last 1707084495 [286654.104781] Lustre: fir-OST009f: haven't heard from client cded2317-8b8c-4fc2-b16f-79cff42ad7fb (at 10.51.8.35@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f2082400, cur 1707094710 expire 1707094560 last 1707094483 [286659.104874] Lustre: fir-OST009d: haven't heard from client cded2317-8b8c-4fc2-b16f-79cff42ad7fb (at 10.51.8.35@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f14c5c00, cur 1707094715 expire 1707094565 last 1707094488 [286659.126764] Lustre: Skipped 1 previous similar message [289055.178926] md: md3: data-check done. [289065.656255] md: md7: data-check done. [289074.028778] md: md1: data-check done. [289077.508091] md: md5: data-check done. [314299.597220] Lustre: fir-OST009b: haven't heard from client 7a288afa-f1ff-49ad-8fc1-950d1ca9deb2 (at 10.50.6.46@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e431f3d6c00, cur 1707122357 expire 1707122207 last 1707122130 [314299.619116] Lustre: Skipped 1 previous similar message [314300.597426] Lustre: fir-OST009f: haven't heard from client 7a288afa-f1ff-49ad-8fc1-950d1ca9deb2 (at 10.50.6.46@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f2138800, cur 1707122358 expire 1707122208 last 1707122131 [314300.619212] Lustre: Skipped 1 previous similar message [314302.596598] Lustre: fir-OST009d: haven't heard from client 7a288afa-f1ff-49ad-8fc1-950d1ca9deb2 (at 10.50.6.46@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f26c2000, cur 1707122360 expire 1707122210 last 1707122133 [345702.883361] Lustre: fir-OST009d: haven't heard from client 7f532072-3e6c-40b1-a6fe-c893458ac5ca (at 10.51.10.27@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e0008eb2800, cur 1707153762 expire 1707153612 last 1707153535 [345778.882597] Lustre: fir-OST009b: haven't heard from client 799c38d3-6595-4427-aaa3-b31260f5785f (at 10.50.15.9@o2ib2) in 209 seconds. I think it's dead, and I am evicting it. exp ffff9e3e8e465800, cur 1707153838 expire 1707153688 last 1707153629 [345778.904384] Lustre: Skipped 23 previous similar messages [346179.859114] Lustre: fir-OST009f: haven't heard from client a0e8059a-2f37-432b-9395-ab176f97a4e8 (at 10.50.2.6@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e41e5c2dc00, cur 1707154239 expire 1707154089 last 1707154012 [346179.881312] Lustre: Skipped 19 previous similar messages [347485.785733] Lustre: fir-OST0099: haven't heard from client c8c7d680-9ec2-4448-8b69-fbf0cd222eb9 (at 10.51.5.15@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33d1e2c400, cur 1707155545 expire 1707155395 last 1707155318 [347485.807998] Lustre: Skipped 19 previous similar messages [351963.544404] Lustre: fir-OST0099: haven't heard from client 44339390-f689-47af-9ab0-fcf2095d0634 (at 10.51.16.7@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dff74f30400, cur 1707160023 expire 1707159873 last 1707159796 [351963.566190] Lustre: Skipped 11 previous similar messages [356253.306847] Lustre: fir-OST009d: haven't heard from client 39564133-2aeb-410b-ae96-c7051f8cf9ae (at 10.50.2.24@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e40f8936000, cur 1707164313 expire 1707164163 last 1707164086 [356253.328743] Lustre: Skipped 3 previous similar messages [356463.296469] Lustre: fir-OST009b: haven't heard from client cd8d4dea-e29f-4ae4-88cf-6af8ebf38364 (at 10.50.7.67@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e41c5921c00, cur 1707164523 expire 1707164373 last 1707164296 [356463.318257] Lustre: Skipped 19 previous similar messages [356470.295512] Lustre: fir-OST0099: haven't heard from client cd8d4dea-e29f-4ae4-88cf-6af8ebf38364 (at 10.50.7.67@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e43bbd73000, cur 1707164530 expire 1707164380 last 1707164303 [356477.295732] Lustre: fir-OST009f: haven't heard from client cd8d4dea-e29f-4ae4-88cf-6af8ebf38364 (at 10.50.7.67@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e41c5923000, cur 1707164537 expire 1707164387 last 1707164310 [356477.317520] Lustre: Skipped 1 previous similar message [361932.996215] Lustre: fir-OST009f: haven't heard from client ed535e44-6a0f-4c8e-a338-003cc4ef06af (at 10.51.2.44@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e41c0aaa800, cur 1707169993 expire 1707169843 last 1707169766 [362347.983549] Lustre: fir-OST0099: haven't heard from client 502491d4-0e95-4020-b3b1-a99b985fecc0 (at 10.50.17.23@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33b1195400, cur 1707170408 expire 1707170258 last 1707170181 [362348.005417] Lustre: Skipped 11 previous similar messages [362624.969592] Lustre: fir-OST0099: haven't heard from client 7d405f69-5c50-4bc1-8015-93d29ac7edb1 (at 10.51.3.67@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e40b0f99c00, cur 1707170685 expire 1707170535 last 1707170458 [362637.960669] Lustre: fir-OST009b: haven't heard from client 7d405f69-5c50-4bc1-8015-93d29ac7edb1 (at 10.51.3.67@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33becdd800, cur 1707170698 expire 1707170548 last 1707170471 [362637.982457] Lustre: Skipped 3 previous similar messages [362656.957610] Lustre: fir-OST009d: haven't heard from client 45758dba-ae4e-4996-b74e-2611acdf3af2 (at 10.51.2.50@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f1623000, cur 1707170717 expire 1707170567 last 1707170490 [362656.979685] Lustre: Skipped 4 previous similar messages [362666.969604] Lustre: fir-OST009f: haven't heard from client a090708e-3f7a-482a-9a2c-bcdcca6d4eab (at 10.51.3.5@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f206c400, cur 1707170727 expire 1707170577 last 1707170500 [362666.991305] Lustre: Skipped 3 previous similar messages [362700.955746] Lustre: fir-OST0099: haven't heard from client e0151803-957f-449d-b3bc-a65d460c68b9 (at 10.51.3.25@o2ib3) in 212 seconds. I think it's dead, and I am evicting it. exp ffff9e3e8e2fe800, cur 1707170761 expire 1707170611 last 1707170549 [362700.978010] Lustre: Skipped 3 previous similar messages [362926.942843] Lustre: fir-OST009d: haven't heard from client 21cfce5d-5f3f-4fae-af03-cf5e26c64059 (at 10.51.12.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3e8e343800, cur 1707170987 expire 1707170837 last 1707170760 [363463.913470] Lustre: fir-OST009d: haven't heard from client 8ab3b43a-9079-4490-a87c-86ec19fd5b68 (at 10.51.6.71@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f317d400, cur 1707171524 expire 1707171374 last 1707171297 [363463.935435] Lustre: Skipped 4 previous similar messages [366026.774903] Lustre: fir-OST009f: haven't heard from client ea358f62-995a-4021-aa16-aabb762c04e4 (at 10.51.17.24@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e0090172c00, cur 1707174087 expire 1707173937 last 1707173860 [366026.796791] Lustre: Skipped 3 previous similar messages [366664.748426] Lustre: fir-OST0099: haven't heard from client c483f3a1-906c-40cd-badb-c0f1e3a76a06 (at 10.51.1.50@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df994cc4000, cur 1707174725 expire 1707174575 last 1707174498 [366670.739576] Lustre: fir-OST009b: haven't heard from client c483f3a1-906c-40cd-badb-c0f1e3a76a06 (at 10.51.1.50@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e0229c03800, cur 1707174731 expire 1707174581 last 1707174504 [366677.738478] Lustre: fir-OST009d: haven't heard from client c483f3a1-906c-40cd-badb-c0f1e3a76a06 (at 10.51.1.50@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01f94e7800, cur 1707174738 expire 1707174588 last 1707174511 [366740.736798] Lustre: fir-OST0099: haven't heard from client 2f7d86c9-a257-4a06-8e1e-a86490ae459e (at 10.51.8.68@o2ib3) in 214 seconds. I think it's dead, and I am evicting it. exp ffff9e02ee4e6400, cur 1707174801 expire 1707174651 last 1707174587 [366740.758784] Lustre: Skipped 3 previous similar messages [368504.648262] Lustre: fir-OST009b: haven't heard from client 6cc01361-d3fc-4400-940e-7e12de359f8f (at 10.50.1.57@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e42c91d4800, cur 1707176565 expire 1707176415 last 1707176338 [368504.670052] Lustre: Skipped 1 previous similar message [368509.641214] Lustre: fir-OST0099: haven't heard from client 6cc01361-d3fc-4400-940e-7e12de359f8f (at 10.50.1.57@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02ee652000, cur 1707176570 expire 1707176420 last 1707176343 [368509.663008] Lustre: Skipped 1 previous similar message [368514.640700] Lustre: fir-OST009f: haven't heard from client 6cc01361-d3fc-4400-940e-7e12de359f8f (at 10.50.1.57@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f20e3000, cur 1707176575 expire 1707176425 last 1707176348 [369540.585151] Lustre: fir-OST009f: haven't heard from client f8fe22d2-99ae-4693-8e60-c2b383fce191 (at 10.50.1.4@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df9825d3400, cur 1707177601 expire 1707177451 last 1707177374 [369545.593999] Lustre: fir-OST009d: haven't heard from client f8fe22d2-99ae-4693-8e60-c2b383fce191 (at 10.50.1.4@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df97deaac00, cur 1707177606 expire 1707177456 last 1707177379 [369545.616202] Lustre: Skipped 1 previous similar message [369554.596706] Lustre: fir-OST009b: haven't heard from client f8fe22d2-99ae-4693-8e60-c2b383fce191 (at 10.50.1.4@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01f9667000, cur 1707177615 expire 1707177465 last 1707177388 [370172.547233] Lustre: fir-OST0099: haven't heard from client c8bc63c0-dbb0-4de8-8616-e7c084f4a295 (at 10.51.10.24@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02eeb3dc00, cur 1707178233 expire 1707178083 last 1707178006 [370178.550080] Lustre: fir-OST009d: haven't heard from client c8bc63c0-dbb0-4de8-8616-e7c084f4a295 (at 10.51.10.24@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f3179000, cur 1707178239 expire 1707178089 last 1707178012 [370178.572066] Lustre: Skipped 1 previous similar message [370184.548065] Lustre: fir-OST009b: haven't heard from client c8bc63c0-dbb0-4de8-8616-e7c084f4a295 (at 10.51.10.24@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e43638eb400, cur 1707178245 expire 1707178095 last 1707178018 [383786.813488] Lustre: fir-OST009d: haven't heard from client 72fb84e1-56fa-4beb-a5e3-2ff5c2b8d162 (at 10.51.9.6@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01495b9400, cur 1707191848 expire 1707191698 last 1707191621 [385955.236715] Lustre: 46940:0:(client.c:2295:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1707193888/real 1707193888] req@ffff9df79de93180 x1789725517218048/t0(0) o104->fir-OST0099@10.50.6.46@o2ib2:15/16 lens 328/224 e 0 to 1 dl 1707194016 ref 1 fl Rpc:XQr/0/ffffffff rc 0/-1 job:'' [386027.569778] Lustre: ll_ost00_050: service thread pid 46940 was inactive for 200.340 seconds. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes: [386027.588874] Pid: 46940, comm: ll_ost00_050 3.10.0-1160.108.1.el7_lustre.pl1.x86_64 #1 SMP Fri Jan 26 11:26:38 PST 2024 [386027.599645] Call Trace: [386027.602236] [<0>] ptlrpc_set_wait+0x7b7/0x840 [ptlrpc] [386027.607480] [<0>] ldlm_run_ast_work+0xd5/0x3e0 [ptlrpc] [386027.612805] [<0>] ldlm_handle_conflict_lock+0x70/0x310 [ptlrpc] [386027.618818] [<0>] ldlm_lock_enqueue+0x5e3/0xb60 [ptlrpc] [386027.624231] [<0>] ldlm_cli_enqueue_local+0x387/0x880 [ptlrpc] [386027.630071] [<0>] ofd_destroy_by_fid+0x1d1/0x520 [ofd] [386027.635299] [<0>] ofd_destroy_hdl+0x20f/0xa80 [ofd] [386027.640295] [<0>] tgt_request_handle+0x93f/0x19d0 [ptlrpc] [386027.645878] [<0>] ptlrpc_server_handle_request+0x253/0xc30 [ptlrpc] [386027.652244] [<0>] ptlrpc_main+0xbf4/0x15e0 [ptlrpc] [386027.657211] [<0>] kthread+0xd1/0xe0 [386027.660902] [<0>] ret_from_fork_nospec_begin+0x7/0x21 [386027.666076] [<0>] 0xfffffffffffffffe [386033.683581] Lustre: fir-OST009d: haven't heard from client 1da722e2-2e2a-4baf-ae10-1a83bb169eb8 (at 10.50.6.46@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e41e5ee0c00, cur 1707194095 expire 1707193945 last 1707193868 [386035.683551] Lustre: fir-OST009f: haven't heard from client 1da722e2-2e2a-4baf-ae10-1a83bb169eb8 (at 10.50.6.46@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33cd216c00, cur 1707194097 expire 1707193947 last 1707193870 [386046.686242] Lustre: fir-OST009b: haven't heard from client 1da722e2-2e2a-4baf-ae10-1a83bb169eb8 (at 10.50.6.46@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33d1c8d000, cur 1707194108 expire 1707193958 last 1707193881 [387801.588327] Lustre: fir-OST009d: haven't heard from client 373cb204-ee6c-45bd-b9e3-d4a40ee53fd9 (at 10.50.2.53@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dff78c58c00, cur 1707195863 expire 1707195713 last 1707195636 [387801.610144] Lustre: Skipped 1 previous similar message [387809.586329] Lustre: fir-OST009f: haven't heard from client 4bbf9736-5159-400e-a6f7-28e83e60bb38 (at 10.50.8.5@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e008d34bc00, cur 1707195871 expire 1707195721 last 1707195644 [391028.414576] Lustre: fir-OST009d: haven't heard from client 8ab670f3-00ca-48e4-8e39-b9f9950abd24 (at 10.50.4.42@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3fca4d3800, cur 1707199090 expire 1707198940 last 1707198863 [391798.376737] Lustre: fir-OST009d: haven't heard from client 0f5a72ad-d013-4411-a50c-caf16e977912 (at 10.51.4.18@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e41c915bc00, cur 1707199860 expire 1707199710 last 1707199633 [391811.369520] Lustre: fir-OST0099: haven't heard from client 0f5a72ad-d013-4411-a50c-caf16e977912 (at 10.51.4.18@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e40b0dc2800, cur 1707199873 expire 1707199723 last 1707199646 [391817.370845] Lustre: fir-OST009f: haven't heard from client 0f5a72ad-d013-4411-a50c-caf16e977912 (at 10.51.4.18@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e41dcedb000, cur 1707199879 expire 1707199729 last 1707199652 [393504.277744] Lustre: fir-OST009f: haven't heard from client 3e2f6166-8727-4f10-b521-84154a961b8a (at 10.50.7.71@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e420f247400, cur 1707201566 expire 1707201416 last 1707201339 [393504.299525] Lustre: Skipped 1 previous similar message [396518.119474] Lustre: fir-OST009f: haven't heard from client a1ce3337-a3c2-4b53-829d-8b7fd59737e8 (at 10.51.4.63@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f27b8400, cur 1707204580 expire 1707204430 last 1707204353 [396518.141279] Lustre: Skipped 2 previous similar messages [396538.110980] Lustre: fir-OST0099: haven't heard from client a1ce3337-a3c2-4b53-829d-8b7fd59737e8 (at 10.51.4.63@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02eeb70000, cur 1707204600 expire 1707204450 last 1707204373 [396538.132764] Lustre: Skipped 1 previous similar message [401815.871834] Lustre: fir-OST0099: haven't heard from client c7d94bfd-0905-491e-8854-55aafc6f500b (at 10.51.8.47@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01e770ac00, cur 1707209878 expire 1707209728 last 1707209651 [401815.894264] Lustre: Skipped 1 previous similar message [401829.827034] Lustre: fir-OST009d: haven't heard from client c7d94bfd-0905-491e-8854-55aafc6f500b (at 10.51.8.47@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01efee8400, cur 1707209892 expire 1707209742 last 1707209665 [401834.829509] Lustre: fir-OST009f: haven't heard from client c7d94bfd-0905-491e-8854-55aafc6f500b (at 10.51.8.47@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e013a9e4000, cur 1707209897 expire 1707209747 last 1707209670 [401834.851294] Lustre: Skipped 1 previous similar message [403791.724571] Lustre: fir-OST009d: haven't heard from client 5afaba28-1eac-4615-bf00-7f2ac2511609 (at 10.51.15.10@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02ee344c00, cur 1707211854 expire 1707211704 last 1707211627 [405930.601543] Lustre: fir-OST009d: haven't heard from client b2626c98-c165-462f-9961-9284af85fd5c (at 10.51.15.6@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f1627c00, cur 1707213993 expire 1707213843 last 1707213766 [405930.623326] Lustre: Skipped 1 previous similar message [405938.601060] Lustre: fir-OST0099: haven't heard from client b2626c98-c165-462f-9961-9284af85fd5c (at 10.51.15.6@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02eebe2400, cur 1707214001 expire 1707213851 last 1707213774 [405938.622844] Lustre: Skipped 1 previous similar message [405944.600908] Lustre: fir-OST009f: haven't heard from client b2626c98-c165-462f-9961-9284af85fd5c (at 10.51.15.6@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02fe848800, cur 1707214007 expire 1707213857 last 1707213780 [424855.573135] Lustre: fir-OST009f: haven't heard from client 0c7d2eb4-d65a-4861-91e7-06f52d8037a8 (at 10.51.4.35@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dfe890f7800, cur 1707232919 expire 1707232769 last 1707232692 [424873.579873] Lustre: fir-OST0099: haven't heard from client 0c7d2eb4-d65a-4861-91e7-06f52d8037a8 (at 10.51.4.35@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e0257920000, cur 1707232937 expire 1707232787 last 1707232710 [424873.601662] Lustre: Skipped 2 previous similar messages [431171.414888] Lustre: 46731:0:(client.c:2295:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1707239107/real 1707239107] req@ffff9e31386f3a80 x1789726643941120/t0(0) o106->fir-OST0099@10.51.18.2@o2ib3:15/16 lens 328/280 e 0 to 1 dl 1707239235 ref 1 fl Rpc:XQr/0/ffffffff rc 0/-1 job:'' [431202.228229] Lustre: fir-OST009f: haven't heard from client a915337e-f213-4637-ad36-5721a5f55339 (at 10.51.18.2@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33bb401400, cur 1707239266 expire 1707239116 last 1707239039 [431871.192300] Lustre: fir-OST009d: haven't heard from client 858aa2ac-177c-4281-8513-af52ed0c9807 (at 10.50.12.8@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3f7d2dc000, cur 1707239935 expire 1707239785 last 1707239708 [431871.214439] Lustre: Skipped 3 previous similar messages [431947.188339] Lustre: fir-OST009f: haven't heard from client 4ab301e0-b645-40b1-a498-7d2fa44909d4 (at 10.51.6.71@o2ib3) in 212 seconds. I think it's dead, and I am evicting it. exp ffff9df971c5f400, cur 1707240011 expire 1707239861 last 1707239799 [431947.210285] Lustre: Skipped 3 previous similar messages [433402.109079] Lustre: fir-OST009f: haven't heard from client 13a3e8e5-3a6c-486e-a460-f26a890b7413 (at 10.50.8.5@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e014349b400, cur 1707241466 expire 1707241316 last 1707241239 [433402.131154] Lustre: Skipped 15 previous similar messages [433824.085862] Lustre: fir-OST009d: haven't heard from client 6985bac7-7a8f-4579-bf66-bd19524a8f72 (at 10.50.1.57@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33bf072000, cur 1707241888 expire 1707241738 last 1707241661 [433824.107900] Lustre: Skipped 27 previous similar messages [437721.875446] Lustre: fir-OST009f: haven't heard from client 15a951e7-fede-42e0-8fc2-6b2c1c55cf2d (at 10.51.18.2@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e4203981800, cur 1707245786 expire 1707245636 last 1707245559 [437721.897239] Lustre: Skipped 3 previous similar messages [438483.834423] Lustre: fir-OST009f: haven't heard from client c9a974a9-f174-4556-ae7e-04143a885d4b (at 10.51.12.15@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02fe84f800, cur 1707246548 expire 1707246398 last 1707246321 [438483.856293] Lustre: Skipped 3 previous similar messages [438484.836994] Lustre: fir-OST009d: haven't heard from client c9a974a9-f174-4556-ae7e-04143a885d4b (at 10.51.12.15@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f0cbe400, cur 1707246549 expire 1707246399 last 1707246322 [438495.832967] Lustre: fir-OST0099: haven't heard from client c9a974a9-f174-4556-ae7e-04143a885d4b (at 10.51.12.15@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02ee4e2400, cur 1707246560 expire 1707246410 last 1707246333 [438832.814469] Lustre: fir-OST009f: haven't heard from client a473f513-320c-4d63-b90e-a61434747434 (at 10.51.18.2@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e41c0580800, cur 1707246897 expire 1707246747 last 1707246670 [438832.836548] Lustre: Skipped 1 previous similar message [439671.771437] Lustre: fir-OST009f: haven't heard from client c4cd3b7c-cd4a-4da7-a121-94158ffb35c9 (at 10.51.12.13@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f2114000, cur 1707247736 expire 1707247586 last 1707247509 [439671.794204] Lustre: Skipped 3 previous similar messages [439676.774846] Lustre: fir-OST0099: haven't heard from client c4cd3b7c-cd4a-4da7-a121-94158ffb35c9 (at 10.51.12.13@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02ee5f6800, cur 1707247741 expire 1707247591 last 1707247514 [439676.798926] Lustre: Skipped 1 previous similar message [439690.771913] Lustre: fir-OST009b: haven't heard from client c4cd3b7c-cd4a-4da7-a121-94158ffb35c9 (at 10.51.12.13@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e42c96ebc00, cur 1707247755 expire 1707247605 last 1707247528 [439915.755376] Lustre: fir-OST009d: haven't heard from client f61d2229-63b7-479e-9767-8850f65ec60b (at 10.51.2.65@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f3309400, cur 1707247980 expire 1707247830 last 1707247753 [439922.755352] Lustre: fir-OST0099: haven't heard from client f61d2229-63b7-479e-9767-8850f65ec60b (at 10.51.2.65@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02ee742400, cur 1707247987 expire 1707247837 last 1707247760 [439922.777139] Lustre: Skipped 2 previous similar messages [450006.208212] Lustre: fir-OST009b: haven't heard from client 225e05b2-8836-41a2-8bf5-643deaea50d0 (at 10.50.8.17@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02ea995c00, cur 1707258071 expire 1707257921 last 1707257844 [450215.204669] Lustre: fir-OST009b: haven't heard from client c735a844-8f1a-4c16-9e9e-a36520ed9943 (at 10.50.2.71@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e436357ec00, cur 1707258280 expire 1707258130 last 1707258053 [450215.226463] Lustre: Skipped 3 previous similar messages [450227.195387] Lustre: fir-OST0099: haven't heard from client c735a844-8f1a-4c16-9e9e-a36520ed9943 (at 10.50.2.71@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02eebbbc00, cur 1707258292 expire 1707258142 last 1707258065 [450227.217223] Lustre: Skipped 1 previous similar message [450232.212678] Lustre: fir-OST009f: haven't heard from client c735a844-8f1a-4c16-9e9e-a36520ed9943 (at 10.50.2.71@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e03af951c00, cur 1707258297 expire 1707258147 last 1707258070 [450291.192124] Lustre: fir-OST009d: haven't heard from client 920327ee-193f-4592-a190-1b5df4ba6a9b (at 10.51.3.26@o2ib3) in 172 seconds. I think it's dead, and I am evicting it. exp ffff9e02f14c3800, cur 1707258356 expire 1707258206 last 1707258184 [450346.197643] Lustre: fir-OST009f: haven't heard from client 920327ee-193f-4592-a190-1b5df4ba6a9b (at 10.51.3.26@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e03b1f72c00, cur 1707258411 expire 1707258261 last 1707258184 [450346.219846] Lustre: Skipped 7 previous similar messages [450422.185470] Lustre: fir-OST009f: haven't heard from client b7287334-90ca-4a1b-b525-7f02f5dd667e (at 10.51.8.69@o2ib3) in 209 seconds. I think it's dead, and I am evicting it. exp ffff9e02f2790c00, cur 1707258487 expire 1707258337 last 1707258278 [450422.207780] Lustre: Skipped 2 previous similar messages [450498.192326] Lustre: fir-OST009f: haven't heard from client 7c25b3df-fa32-4a48-b748-b5c135b660e0 (at 10.51.7.45@o2ib3) in 200 seconds. I think it's dead, and I am evicting it. exp ffff9e41c2f4d000, cur 1707258563 expire 1707258413 last 1707258363 [450498.216697] Lustre: Skipped 12 previous similar messages [450864.160709] Lustre: fir-OST009f: haven't heard from client 4587da63-c9d2-45b9-af5a-4f18ca4a4378 (at 10.50.10.7@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df978e23800, cur 1707258929 expire 1707258779 last 1707258702 [450864.182499] Lustre: Skipped 14 previous similar messages [451123.152714] Lustre: fir-OST0099: haven't heard from client 41a8de9e-0162-47ba-8fce-b943a6bf29d6 (at 10.51.4.8@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02ee47a800, cur 1707259188 expire 1707259038 last 1707258961 [451123.174570] Lustre: Skipped 8 previous similar messages [451730.120301] Lustre: fir-OST009b: haven't heard from client 2ca349a1-4328-4993-ba8a-2eb7655be8a9 (at 10.51.15.20@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e41c0b23c00, cur 1707259795 expire 1707259645 last 1707259568 [451730.142179] Lustre: Skipped 21 previous similar messages [454480.964708] Lustre: fir-OST009f: haven't heard from client d3c8b63b-3558-42bc-a7ed-4eeb204a731e (at 10.51.17.6@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dff76bb1800, cur 1707262546 expire 1707262396 last 1707262319 [454480.986750] Lustre: Skipped 1 previous similar message [454767.954790] Lustre: fir-OST009d: haven't heard from client 0b2a3328-f9e0-4e1e-9f92-301a0279f391 (at 10.50.3.58@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df96b4be800, cur 1707262833 expire 1707262683 last 1707262606 [454767.976980] Lustre: Skipped 3 previous similar messages [455210.928274] Lustre: fir-OST0099: haven't heard from client 58c83c34-b05c-43cb-8ab3-82c144e924fa (at 10.51.5.50@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01378d8400, cur 1707263276 expire 1707263126 last 1707263049 [455210.950063] Lustre: Skipped 11 previous similar messages [455515.910995] Lustre: fir-OST009f: haven't heard from client 90f254a9-f8a9-4685-a813-b6f001d8b788 (at 10.51.8.65@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f203d400, cur 1707263581 expire 1707263431 last 1707263354 [455515.932898] Lustre: Skipped 5 previous similar messages [456314.865717] Lustre: fir-OST009b: haven't heard from client 86944726-d11b-4d1a-a508-7f6c88d8a9cc (at 10.51.9.63@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33d3612400, cur 1707264380 expire 1707264230 last 1707264153 [456314.887502] Lustre: Skipped 37 previous similar messages [457105.824408] Lustre: fir-OST009b: haven't heard from client 26adc6d5-c6b1-42ad-8c6e-9f6ecb83c70a (at 10.51.9.58@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33c1399800, cur 1707265171 expire 1707265021 last 1707264944 [457105.846190] Lustre: Skipped 3 previous similar messages [458525.745873] Lustre: fir-OST009f: haven't heard from client 01427a36-bdd6-4204-899c-c4f80ad5f7c9 (at 10.51.3.56@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e00c700bc00, cur 1707266591 expire 1707266441 last 1707266364 [458525.768306] Lustre: Skipped 11 previous similar messages [459157.710851] Lustre: fir-OST009d: haven't heard from client b5ae580a-06fe-4b64-8114-4887066d6f2d (at 10.50.10.41@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01ecd57c00, cur 1707267223 expire 1707267073 last 1707266996 [459157.732739] Lustre: Skipped 3 previous similar messages [460061.662435] Lustre: fir-OST0099: haven't heard from client 611fefd4-9010-4fce-b7ee-8b29e157df07 (at 10.51.5.52@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e025829b400, cur 1707268127 expire 1707267977 last 1707267900 [460061.684293] Lustre: Skipped 11 previous similar messages [460706.626744] Lustre: fir-OST009f: haven't heard from client 3c68d9ba-b692-4289-8de6-1636901a8931 (at 10.51.10.71@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e0200905000, cur 1707268772 expire 1707268622 last 1707268545 [460706.648657] Lustre: Skipped 3 previous similar messages [460709.627452] Lustre: fir-OST0099: haven't heard from client 8b0773c8-e7d2-4c6a-a7de-9c525a8c4bfc (at 10.51.10.53@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df991b4e400, cur 1707268775 expire 1707268625 last 1707268548 [460709.649837] Lustre: Skipped 1 previous similar message [460931.614944] Lustre: fir-OST009d: haven't heard from client 097151ad-d110-4180-b570-743a80719256 (at 10.50.7.59@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33d3a0fc00, cur 1707268997 expire 1707268847 last 1707268770 [460931.636723] Lustre: Skipped 5 previous similar messages [461120.610003] Lustre: fir-OST009f: haven't heard from client 08f966e1-fd61-4ea7-8787-967d102ccd63 (at 10.51.4.69@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02fe84e000, cur 1707269186 expire 1707269036 last 1707268959 [461120.631790] Lustre: Skipped 3 previous similar messages [461196.605517] Lustre: fir-OST009f: haven't heard from client 3adcbdc8-ddf1-47f4-a9ea-9d8c893cbb33 (at 10.51.5.6@o2ib3) in 213 seconds. I think it's dead, and I am evicting it. exp ffff9e03af715400, cur 1707269262 expire 1707269112 last 1707269049 [461196.627549] Lustre: Skipped 7 previous similar messages [461444.587825] Lustre: fir-OST009d: haven't heard from client 71dcfa0e-88c1-44a5-a1ad-8c2786f692f8 (at 10.51.3.32@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dff78cf2000, cur 1707269510 expire 1707269360 last 1707269283 [461444.609926] Lustre: Skipped 3 previous similar messages [461602.579352] Lustre: fir-OST009f: haven't heard from client b8609847-5604-4cd3-b44c-a656eb9cb898 (at 10.51.10.54@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33bce0d400, cur 1707269668 expire 1707269518 last 1707269441 [461602.601226] Lustre: Skipped 3 previous similar messages [462416.539173] Lustre: fir-OST009b: haven't heard from client 0b01badd-7cf5-499e-b2ef-3355b182168a (at 10.51.10.61@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e000387d800, cur 1707270482 expire 1707270332 last 1707270255 [462416.561056] Lustre: Skipped 7 previous similar messages [462435.539050] Lustre: fir-OST009d: haven't heard from client 0b01badd-7cf5-499e-b2ef-3355b182168a (at 10.51.10.61@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df979f23400, cur 1707270501 expire 1707270351 last 1707270274 [462435.560920] Lustre: Skipped 1 previous similar message [463584.471538] Lustre: fir-OST0099: haven't heard from client 96be2609-f9f2-4b3b-9954-19ea34f96a96 (at 10.51.15.12@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e00be335000, cur 1707271650 expire 1707271500 last 1707271423 [463584.493405] Lustre: Skipped 1 previous similar message [463599.472589] Lustre: fir-OST009d: haven't heard from client 96be2609-f9f2-4b3b-9954-19ea34f96a96 (at 10.51.15.12@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e03ae4ba800, cur 1707271665 expire 1707271515 last 1707271438 [463599.494512] Lustre: Skipped 2 previous similar messages [463999.451940] Lustre: fir-OST009f: haven't heard from client 562b8fc2-94f0-47f0-9a71-ab543860a7c4 (at 10.51.1.70@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e0225fb5000, cur 1707272065 expire 1707271915 last 1707271838 [464584.418764] Lustre: fir-OST0099: haven't heard from client c900c841-7da1-4366-a63b-a9335b75d785 (at 10.50.6.16@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33bc2f7c00, cur 1707272650 expire 1707272500 last 1707272423 [464584.440774] Lustre: Skipped 3 previous similar messages [466358.322768] Lustre: fir-OST0099: haven't heard from client d517df65-f53e-4ce9-93d4-4f32d68647a0 (at 10.50.4.71@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e025830f800, cur 1707274424 expire 1707274274 last 1707274197 [468031.237494] Lustre: fir-OST009f: haven't heard from client f4bb1aee-e209-4a6f-b3f7-1290b7fc278b (at 10.50.8.7@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e0143b98c00, cur 1707276097 expire 1707275947 last 1707275870 [468044.228399] Lustre: fir-OST009b: haven't heard from client f4bb1aee-e209-4a6f-b3f7-1290b7fc278b (at 10.50.8.7@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df992df5000, cur 1707276110 expire 1707275960 last 1707275883 [470600.089783] Lustre: fir-OST009d: haven't heard from client 21d6d37c-570e-44c0-8c03-c01f5827989a (at 10.51.5.65@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e40ab740c00, cur 1707278666 expire 1707278516 last 1707278439 [470600.111579] Lustre: Skipped 2 previous similar messages [470965.071004] Lustre: fir-OST0099: haven't heard from client 38d63643-1e3d-48e9-b9e7-f93e5ff05034 (at 10.50.3.58@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e021f3f5000, cur 1707279031 expire 1707278881 last 1707278804 [470965.092938] Lustre: Skipped 7 previous similar messages [472308.998456] Lustre: fir-OST009b: haven't heard from client 7b77551d-9829-463f-86ae-e65e7fb84107 (at 10.51.1.38@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dff7966fc00, cur 1707280375 expire 1707280225 last 1707280148 [472309.020255] Lustre: Skipped 3 previous similar messages [472717.975143] Lustre: fir-OST009d: haven't heard from client 84c36e46-7053-4dcd-b585-494e073a0640 (at 10.50.1.57@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33d5bc1000, cur 1707280784 expire 1707280634 last 1707280557 [474802.901901] Lustre: fir-OST009b: haven't heard from client 53797b2c-2afa-4695-8ccb-fa3a0a1c814d (at 10.50.7.70@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01a7988c00, cur 1707282869 expire 1707282719 last 1707282642 [474802.923686] Lustre: Skipped 3 previous similar messages [474809.867308] Lustre: fir-OST009d: haven't heard from client 53797b2c-2afa-4695-8ccb-fa3a0a1c814d (at 10.50.7.70@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01f2253000, cur 1707282876 expire 1707282726 last 1707282649 [475227.843101] Lustre: fir-OST009d: haven't heard from client c75df8a0-4b03-41c5-bf38-d03d00638a29 (at 10.51.9.54@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f1a4f800, cur 1707283294 expire 1707283144 last 1707283067 [475233.842885] Lustre: fir-OST0099: haven't heard from client c75df8a0-4b03-41c5-bf38-d03d00638a29 (at 10.51.9.54@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02ee5dc000, cur 1707283300 expire 1707283150 last 1707283073 [475245.838351] Lustre: fir-OST009b: haven't heard from client c75df8a0-4b03-41c5-bf38-d03d00638a29 (at 10.51.9.54@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e43638ef400, cur 1707283312 expire 1707283162 last 1707283085 [476157.788673] Lustre: fir-OST009f: haven't heard from client 79847416-7f83-457d-95ec-f6d632620f47 (at 10.50.6.38@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33d32c6400, cur 1707284224 expire 1707284074 last 1707283997 [476157.811788] Lustre: Skipped 1 previous similar message [476166.791791] Lustre: fir-OST0099: haven't heard from client 79847416-7f83-457d-95ec-f6d632620f47 (at 10.50.6.38@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e41d8263800, cur 1707284233 expire 1707284083 last 1707284006 [476166.813571] Lustre: Skipped 1 previous similar message [476173.585993] LustreError: 44052:0:(ldlm_lockd.c:261:expired_lock_main()) ### lock callback timer expired after 100s: evicting client at 10.50.6.38@o2ib2 ns: filter-fir-OST009d_UUID lock: ffff9e3533954a40/0xa96a836deb4e739b lrc: 4/0,0 mode: PR/PR res: [0x15972e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x60000400010020 nid: 10.50.6.38@o2ib2 remote: 0x5dae8a6e3c33a929 expref: 9 pid: 47050 timeout: 476196 lvb_type: 1 [479454.625467] Lustre: fir-OST009b: haven't heard from client d03b7766-baed-4cf6-ab3c-4f8e3b7c1f4a (at 10.51.8.6@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e43ac917800, cur 1707287521 expire 1707287371 last 1707287294 [479455.609021] Lustre: fir-OST009f: haven't heard from client d03b7766-baed-4cf6-ab3c-4f8e3b7c1f4a (at 10.51.8.6@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f20b1400, cur 1707287522 expire 1707287372 last 1707287295 [479460.608903] Lustre: fir-OST009d: haven't heard from client d03b7766-baed-4cf6-ab3c-4f8e3b7c1f4a (at 10.51.8.6@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f1531c00, cur 1707287527 expire 1707287377 last 1707287300 [479905.600099] Lustre: fir-OST009d: haven't heard from client a29aafdf-bc6c-4a1e-a904-2b5d24d3a0a2 (at 10.51.8.8@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e413c41ec00, cur 1707287972 expire 1707287822 last 1707287745 [479905.621792] Lustre: Skipped 1 previous similar message [479915.584696] Lustre: fir-OST009f: haven't heard from client a29aafdf-bc6c-4a1e-a904-2b5d24d3a0a2 (at 10.51.8.8@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33d4739400, cur 1707287982 expire 1707287832 last 1707287755 [481732.485172] Lustre: fir-OST0099: haven't heard from client 32940467-12a9-4c7b-a582-050d0f3e5677 (at 10.51.4.35@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df993715400, cur 1707289799 expire 1707289649 last 1707289572 [481732.506952] Lustre: Skipped 1 previous similar message [485385.291142] Lustre: fir-OST009f: haven't heard from client f9c1bfb8-e365-47aa-a696-38f5d93704f9 (at 10.51.8.56@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3fd1d46800, cur 1707293452 expire 1707293302 last 1707293225 [485385.312938] Lustre: Skipped 3 previous similar messages [489289.081333] Lustre: fir-OST009d: haven't heard from client d75d3e71-9238-4dd5-a13c-4ff0230df7a2 (at 10.51.4.51@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df970353000, cur 1707297356 expire 1707297206 last 1707297129 [489365.083414] Lustre: fir-OST009d: haven't heard from client cf97e6ab-6937-4684-b8f7-00b4cb6530c0 (at 10.50.4.67@o2ib2) in 182 seconds. I think it's dead, and I am evicting it. exp ffff9e000bad0000, cur 1707297432 expire 1707297282 last 1707297250 [489405.070075] Lustre: fir-OST009b: haven't heard from client cf97e6ab-6937-4684-b8f7-00b4cb6530c0 (at 10.50.4.67@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e000ba97400, cur 1707297472 expire 1707297322 last 1707297245 [489410.068193] Lustre: fir-OST009f: haven't heard from client cf97e6ab-6937-4684-b8f7-00b4cb6530c0 (at 10.50.4.67@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e020f4e6800, cur 1707297477 expire 1707297327 last 1707297250 [497231.646521] Lustre: fir-OST0099: haven't heard from client b348e88d-5d1b-444f-a291-aa9c76c95fb6 (at 10.51.10.38@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e420b172000, cur 1707305299 expire 1707305149 last 1707305072 [497231.668795] Lustre: Skipped 1 previous similar message [497242.642705] Lustre: fir-OST009d: haven't heard from client b348e88d-5d1b-444f-a291-aa9c76c95fb6 (at 10.51.10.38@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e40e1b56800, cur 1707305310 expire 1707305160 last 1707305083 [502342.366795] Lustre: fir-OST009d: haven't heard from client 99d2ca16-9c02-4594-a035-55905192f139 (at 10.51.1.64@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dfe970a3c00, cur 1707310410 expire 1707310260 last 1707310183 [502342.388611] Lustre: Skipped 2 previous similar messages [502680.352759] Lustre: fir-OST009f: haven't heard from client 9daf60cc-d8eb-403b-acba-056e56c9b781 (at 10.51.8.20@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e0338138400, cur 1707310748 expire 1707310598 last 1707310521 [502680.374544] Lustre: Skipped 3 previous similar messages [502685.350746] Lustre: fir-OST009d: haven't heard from client 9daf60cc-d8eb-403b-acba-056e56c9b781 (at 10.51.8.20@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f1aac800, cur 1707310753 expire 1707310603 last 1707310526 [502697.355417] Lustre: fir-OST009b: haven't heard from client 9daf60cc-d8eb-403b-acba-056e56c9b781 (at 10.51.8.20@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e439cdb2000, cur 1707310765 expire 1707310615 last 1707310538 [510191.947325] Lustre: fir-OST009b: haven't heard from client 2780fa03-7f68-4ef1-9f39-4552cf2519c2 (at 10.51.3.9@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33b08bd000, cur 1707318260 expire 1707318110 last 1707318033 [510191.969027] Lustre: Skipped 1 previous similar message [510199.939126] Lustre: fir-OST009d: haven't heard from client 2780fa03-7f68-4ef1-9f39-4552cf2519c2 (at 10.51.3.9@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3fd1e63000, cur 1707318268 expire 1707318118 last 1707318041 [510395.929019] Lustre: fir-OST009b: haven't heard from client 498e3e90-54da-4ec0-be84-bfc8e690b99b (at 10.50.5.48@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dfd4fa85c00, cur 1707318464 expire 1707318314 last 1707318237 [510395.951143] Lustre: Skipped 2 previous similar messages [510409.937367] Lustre: fir-OST009d: haven't heard from client 498e3e90-54da-4ec0-be84-bfc8e690b99b (at 10.50.5.48@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dfd4fa84800, cur 1707318478 expire 1707318328 last 1707318251 [510409.959649] Lustre: Skipped 1 previous similar message [512730.802655] Lustre: fir-OST009f: haven't heard from client bd2971d0-ab95-4993-be66-b291dcc06977 (at 10.51.8.35@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e008fc2f800, cur 1707320799 expire 1707320649 last 1707320572 [512730.824482] Lustre: Skipped 1 previous similar message [512736.801317] Lustre: fir-OST0099: haven't heard from client bd2971d0-ab95-4993-be66-b291dcc06977 (at 10.51.8.35@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02820fe000, cur 1707320805 expire 1707320655 last 1707320578 [512743.801582] Lustre: fir-OST009d: haven't heard from client bd2971d0-ab95-4993-be66-b291dcc06977 (at 10.51.8.35@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e0088fb5c00, cur 1707320812 expire 1707320662 last 1707320585 [512743.823383] Lustre: Skipped 1 previous similar message [513247.774057] Lustre: fir-OST0099: haven't heard from client 0d1f214b-913e-4f6a-bc00-1592b580365b (at 10.51.3.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01a7996000, cur 1707321316 expire 1707321166 last 1707321089 [513254.773379] Lustre: fir-OST009d: haven't heard from client 0d1f214b-913e-4f6a-bc00-1592b580365b (at 10.51.3.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e0008f7f800, cur 1707321323 expire 1707321173 last 1707321096 [514496.706794] Lustre: fir-OST009b: haven't heard from client d5784542-432f-4ee0-8a46-fffe1bbf0d80 (at 10.50.1.61@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33c5d2e400, cur 1707322565 expire 1707322415 last 1707322338 [514496.728582] Lustre: Skipped 2 previous similar messages [516385.603044] Lustre: fir-OST0099: haven't heard from client 6ace3a93-d45d-48c2-af6a-e1e4765b13e7 (at 10.50.12.8@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3fd848e000, cur 1707324454 expire 1707324304 last 1707324227 [516595.635280] Lustre: fir-OST009f: haven't heard from client dd4fb0ba-2b49-4555-923b-cd8ca82b8f1a (at 10.50.7.70@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01a148bc00, cur 1707324664 expire 1707324514 last 1707324437 [516595.657067] Lustre: Skipped 15 previous similar messages [516602.592707] Lustre: fir-OST0099: haven't heard from client dd4fb0ba-2b49-4555-923b-cd8ca82b8f1a (at 10.50.7.70@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01a1488800, cur 1707324671 expire 1707324521 last 1707324444 [516602.614504] Lustre: Skipped 4 previous similar messages [517006.573149] Lustre: fir-OST0099: haven't heard from client fb647314-7d08-4fac-98b2-82409ed0c00c (at 10.50.1.57@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33ce3e1c00, cur 1707325075 expire 1707324925 last 1707324848 [517006.595045] Lustre: Skipped 14 previous similar messages [519852.421380] Lustre: fir-OST0099: haven't heard from client 8a751bd2-f9d2-47e6-8f5f-6bb4c3d87b03 (at 10.50.4.35@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df96751fc00, cur 1707327921 expire 1707327771 last 1707327694 [519852.443166] Lustre: Skipped 3 previous similar messages [519865.415633] Lustre: fir-OST009f: haven't heard from client 8a751bd2-f9d2-47e6-8f5f-6bb4c3d87b03 (at 10.50.4.35@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dff74e62400, cur 1707327934 expire 1707327784 last 1707327707 [519865.437905] Lustre: Skipped 2 previous similar messages [520869.368301] Lustre: fir-OST009b: haven't heard from client 82937105-bba0-473b-b01b-fc00603a31e8 (at 10.51.3.67@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3fcb515c00, cur 1707328938 expire 1707328788 last 1707328711 [520874.361314] Lustre: fir-OST009d: haven't heard from client 82937105-bba0-473b-b01b-fc00603a31e8 (at 10.51.3.67@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e40b4bebc00, cur 1707328943 expire 1707328793 last 1707328716 [520881.359240] Lustre: fir-OST009f: haven't heard from client 82937105-bba0-473b-b01b-fc00603a31e8 (at 10.51.3.67@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33bc803c00, cur 1707328950 expire 1707328800 last 1707328723 [521478.337462] Lustre: fir-OST009b: haven't heard from client ce636d1c-43f7-4161-bf17-a5841199a3de (at 10.51.3.42@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e42cc13a000, cur 1707329547 expire 1707329397 last 1707329320 [521478.359245] Lustre: Skipped 1 previous similar message [521485.325626] Lustre: fir-OST009f: haven't heard from client ce636d1c-43f7-4161-bf17-a5841199a3de (at 10.51.3.42@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f27b9800, cur 1707329554 expire 1707329404 last 1707329327 [521843.312296] Lustre: fir-OST009d: haven't heard from client 5fb0fa5d-846e-41f3-9582-c3a9c54831b5 (at 10.51.9.39@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f0cbf400, cur 1707329912 expire 1707329762 last 1707329685 [521843.334082] Lustre: Skipped 2 previous similar messages [521861.306454] Lustre: fir-OST0099: haven't heard from client 5fb0fa5d-846e-41f3-9582-c3a9c54831b5 (at 10.51.9.39@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02eebbd000, cur 1707329930 expire 1707329780 last 1707329703 [521861.328496] Lustre: Skipped 2 previous similar messages [523971.190627] Lustre: fir-OST009d: haven't heard from client d09c85ec-2ec4-4cae-8f80-7260d111a23a (at 10.51.12.7@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e4212d19000, cur 1707332040 expire 1707331890 last 1707331813 [523978.191760] Lustre: fir-OST009b: haven't heard from client d09c85ec-2ec4-4cae-8f80-7260d111a23a (at 10.51.12.7@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e4212d1bc00, cur 1707332047 expire 1707331897 last 1707331820 [524536.159491] Lustre: fir-OST009f: haven't heard from client fa7dae9c-a61f-42d7-9a65-eb13362b47fd (at 10.51.16.7@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df98ed53400, cur 1707332605 expire 1707332455 last 1707332378 [524536.181284] Lustre: Skipped 2 previous similar messages [526515.051354] Lustre: fir-OST0099: haven't heard from client 79f2247e-09af-4913-bbdc-107083cda85b (at 10.50.4.13@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df96779ec00, cur 1707334584 expire 1707334434 last 1707334357 [526515.073497] Lustre: Skipped 3 previous similar messages [530624.829651] Lustre: fir-OST009d: haven't heard from client a5caca84-e6ca-487b-8280-855a2cfa7988 (at 10.51.2.57@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f317e000, cur 1707338694 expire 1707338544 last 1707338467 [530624.851437] Lustre: Skipped 3 previous similar messages [530630.827822] Lustre: fir-OST009f: haven't heard from client a5caca84-e6ca-487b-8280-855a2cfa7988 (at 10.51.2.57@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f206c000, cur 1707338700 expire 1707338550 last 1707338473 [530642.845214] Lustre: fir-OST009b: haven't heard from client a5caca84-e6ca-487b-8280-855a2cfa7988 (at 10.51.2.57@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e42cc13f800, cur 1707338712 expire 1707338562 last 1707338485 [530642.866994] Lustre: Skipped 1 previous similar message [534771.603636] Lustre: fir-OST009d: haven't heard from client cb4ec9e8-8998-4f53-bf83-6d01a9949541 (at 10.51.2.60@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e414e39d400, cur 1707342841 expire 1707342691 last 1707342614 [534782.603853] Lustre: fir-OST009f: haven't heard from client cb4ec9e8-8998-4f53-bf83-6d01a9949541 (at 10.51.2.60@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e40de524800, cur 1707342852 expire 1707342702 last 1707342625 [534782.625643] Lustre: Skipped 2 previous similar messages [535755.551943] Lustre: fir-OST009f: haven't heard from client 8f9f2653-126a-416f-a805-5076b44366f9 (at 10.50.4.62@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df967431800, cur 1707343825 expire 1707343675 last 1707343598 [536049.536968] Lustre: fir-OST009f: haven't heard from client 982ddd87-0a3e-470d-b54b-b199734d83a4 (at 10.51.12.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e42169e1400, cur 1707344119 expire 1707343969 last 1707343892 [536056.536437] Lustre: fir-OST009d: haven't heard from client 982ddd87-0a3e-470d-b54b-b199734d83a4 (at 10.51.12.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33bb85b400, cur 1707344126 expire 1707343976 last 1707343899 [536063.534667] Lustre: fir-OST0099: haven't heard from client 982ddd87-0a3e-470d-b54b-b199734d83a4 (at 10.51.12.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e42c87ca800, cur 1707344133 expire 1707343983 last 1707343906 [536063.556451] Lustre: Skipped 1 previous similar message [538679.394009] Lustre: fir-OST009b: haven't heard from client 5931a6bc-afa4-4493-a9f8-6bd81583a970 (at 10.51.15.11@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3ebcf86c00, cur 1707346749 expire 1707346599 last 1707346522 [538684.391355] Lustre: fir-OST009d: haven't heard from client 5931a6bc-afa4-4493-a9f8-6bd81583a970 (at 10.51.15.11@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3ebcf87400, cur 1707346754 expire 1707346604 last 1707346527 [538684.413892] Lustre: Skipped 1 previous similar message [544122.095043] Lustre: fir-OST0099: haven't heard from client f02b0518-8609-41e7-a9b8-faf6481735f5 (at 10.50.2.56@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e355a2fe800, cur 1707352192 expire 1707352042 last 1707351965 [544980.050128] Lustre: fir-OST009d: haven't heard from client 17e67f96-f539-4af7-a9df-366480ecc5c2 (at 10.51.10.51@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02538e1000, cur 1707353050 expire 1707352900 last 1707352823 [544985.047386] Lustre: fir-OST0099: haven't heard from client 17e67f96-f539-4af7-a9df-366480ecc5c2 (at 10.51.10.51@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df98f534c00, cur 1707353055 expire 1707352905 last 1707352828 [544985.069298] Lustre: Skipped 1 previous similar message [545165.038839] Lustre: fir-OST009f: haven't heard from client e636cda3-7321-4b93-9ea9-73eb07823c81 (at 10.50.17.1@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3308011000, cur 1707353235 expire 1707353085 last 1707353008 [545165.060741] Lustre: Skipped 5 previous similar messages [545619.013318] Lustre: fir-OST0099: haven't heard from client 0dead90f-ed97-4e55-83da-3b8700428384 (at 10.50.6.11@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02ee544400, cur 1707353689 expire 1707353539 last 1707353462 [545619.035154] Lustre: Skipped 3 previous similar messages [548512.855800] Lustre: fir-OST0099: haven't heard from client ccf71a38-419d-4d29-9bf4-b1baab5dfec2 (at 10.50.5.65@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3ec8f2ec00, cur 1707356583 expire 1707356433 last 1707356356 [548512.877807] Lustre: Skipped 3 previous similar messages [548526.857046] Lustre: fir-OST009f: haven't heard from client ccf71a38-419d-4d29-9bf4-b1baab5dfec2 (at 10.50.5.65@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33c6617800, cur 1707356597 expire 1707356447 last 1707356370 [548526.878911] Lustre: Skipped 1 previous similar message [550354.756442] Lustre: fir-OST009d: haven't heard from client 47f0923b-51d2-4dd2-b5f1-8a11063d4717 (at 10.51.3.20@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02497a9c00, cur 1707358425 expire 1707358275 last 1707358198 [550354.778693] Lustre: Skipped 1 previous similar message [550359.755128] Lustre: fir-OST009b: haven't heard from client 47f0923b-51d2-4dd2-b5f1-8a11063d4717 (at 10.51.3.20@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e00f74f5c00, cur 1707358430 expire 1707358280 last 1707358203 [550372.760780] Lustre: fir-OST0099: haven't heard from client 47f0923b-51d2-4dd2-b5f1-8a11063d4717 (at 10.51.3.20@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e00c0645800, cur 1707358443 expire 1707358293 last 1707358216 [550372.782742] Lustre: Skipped 1 previous similar message [557701.355890] Lustre: fir-OST009f: haven't heard from client 5de791c1-1d16-4f16-8666-05671907ec82 (at 10.51.1.44@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02dd530800, cur 1707365772 expire 1707365622 last 1707365545 [558030.338083] Lustre: fir-OST009f: haven't heard from client b3685e96-2bef-48c7-a2c8-38c1dde26af3 (at 10.51.8.28@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e42c7b50c00, cur 1707366101 expire 1707365951 last 1707365874 [558030.360535] Lustre: Skipped 3 previous similar messages [567808.805811] Lustre: fir-OST009d: haven't heard from client 2355bf55-7fac-43c2-9f91-ba6659396ee8 (at 10.51.7.59@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e03a8b7a000, cur 1707375880 expire 1707375730 last 1707375653 [567808.827593] Lustre: Skipped 3 previous similar messages [567813.805415] Lustre: fir-OST0099: haven't heard from client 2355bf55-7fac-43c2-9f91-ba6659396ee8 (at 10.51.7.59@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02ee59b800, cur 1707375885 expire 1707375735 last 1707375658 [572093.578360] Lustre: fir-OST009d: haven't heard from client 29d7d7fc-2d92-4bc5-be03-78cf57463c98 (at 10.50.13.9@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f26c4400, cur 1707380165 expire 1707380015 last 1707379938 [572093.600190] Lustre: Skipped 2 previous similar messages [572101.571898] Lustre: fir-OST0099: haven't heard from client 29d7d7fc-2d92-4bc5-be03-78cf57463c98 (at 10.50.13.9@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02ee726400, cur 1707380173 expire 1707380023 last 1707379946 [580609.109357] Lustre: fir-OST009d: haven't heard from client 872c1508-a3db-429f-8592-4bf8cb66f196 (at 10.51.4.35@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dff6f3a4400, cur 1707388681 expire 1707388531 last 1707388454 [580609.131156] Lustre: Skipped 2 previous similar messages [580617.108773] Lustre: fir-OST009f: haven't heard from client 872c1508-a3db-429f-8592-4bf8cb66f196 (at 10.51.4.35@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dff6f3a5800, cur 1707388689 expire 1707388539 last 1707388462 [580617.130776] Lustre: Skipped 1 previous similar message [589743.612370] Lustre: fir-OST009b: haven't heard from client c57acdb8-eaaa-4354-a96f-eaf0831e080a (at 10.51.6.54@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33b92b2400, cur 1707397816 expire 1707397666 last 1707397589 [589743.634641] Lustre: Skipped 1 previous similar message [596173.263854] Lustre: fir-OST009d: haven't heard from client cfd450e7-7e0e-42e2-b856-2382db46b1a5 (at 10.51.14.10@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f2aac800, cur 1707404246 expire 1707404096 last 1707404019 [596173.285896] Lustre: Skipped 2 previous similar messages [596186.262178] Lustre: fir-OST0099: haven't heard from client cfd450e7-7e0e-42e2-b856-2382db46b1a5 (at 10.51.14.10@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02ee407400, cur 1707404259 expire 1707404109 last 1707404032 [596186.284233] Lustre: Skipped 1 previous similar message [599606.078011] Lustre: fir-OST009f: haven't heard from client 5bb8c170-217e-41be-a63b-630ef36a3d5f (at 10.50.3.53@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e03af716000, cur 1707407679 expire 1707407529 last 1707407452 [599606.099831] Lustre: Skipped 1 previous similar message [599612.076729] Lustre: fir-OST009b: haven't heard from client 5bb8c170-217e-41be-a63b-630ef36a3d5f (at 10.50.3.53@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e4362ea7000, cur 1707407685 expire 1707407535 last 1707407458 [599612.098593] Lustre: Skipped 1 previous similar message [599620.076055] Lustre: fir-OST009d: haven't heard from client 5bb8c170-217e-41be-a63b-630ef36a3d5f (at 10.50.3.53@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f2e6c800, cur 1707407693 expire 1707407543 last 1707407466 [599620.098323] Lustre: Skipped 3 previous similar messages [599829.064031] Lustre: fir-OST0099: haven't heard from client 8395ad71-2dd8-49e1-8b69-123aa0fab823 (at 10.51.6.54@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e2f62514400, cur 1707407902 expire 1707407752 last 1707407675 [599829.085896] Lustre: Skipped 1 previous similar message [600107.049125] Lustre: fir-OST009f: haven't heard from client 0bf6b179-472e-4ce7-82d0-ce2d49a33991 (at 10.50.3.55@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e41f2426000, cur 1707408180 expire 1707408030 last 1707407953 [600107.070928] Lustre: Skipped 7 previous similar messages [600119.051803] Lustre: fir-OST009d: haven't heard from client 0bf6b179-472e-4ce7-82d0-ce2d49a33991 (at 10.50.3.55@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e41f2424000, cur 1707408192 expire 1707408042 last 1707407965 [600119.073603] Lustre: Skipped 2 previous similar messages [600629.020699] Lustre: fir-OST009b: haven't heard from client 87c6df94-2861-46ba-859a-7d0c0b303d68 (at 10.50.3.57@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e42c7be8400, cur 1707408702 expire 1707408552 last 1707408475 [600828.011107] Lustre: fir-OST009d: haven't heard from client e7ae6888-ecd4-4b42-80dc-a5fb9f7f0a44 (at 10.50.3.59@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33cccff800, cur 1707408901 expire 1707408751 last 1707408674 [600828.032891] Lustre: Skipped 3 previous similar messages [601499.973481] Lustre: fir-OST009f: haven't heard from client 85dd07e0-1a96-4765-8115-12044e71ebfc (at 10.51.8.33@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02504dac00, cur 1707409573 expire 1707409423 last 1707409346 [601499.995473] Lustre: Skipped 3 previous similar messages [605940.731690] Lustre: fir-OST009b: haven't heard from client be60c182-dc5d-4245-ab81-dafec2d41e06 (at 10.51.10.16@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33d4ad9400, cur 1707414014 expire 1707413864 last 1707413787 [605940.753558] Lustre: Skipped 3 previous similar messages [612615.373566] Lustre: fir-OST009b: haven't heard from client 1e7f0bb3-8f0b-4ee3-8f86-087d7f8ab365 (at 10.51.12.15@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df97f9ac000, cur 1707420689 expire 1707420539 last 1707420462 [612615.395589] Lustre: Skipped 3 previous similar messages [612622.374919] Lustre: fir-OST0099: haven't heard from client 1e7f0bb3-8f0b-4ee3-8f86-087d7f8ab365 (at 10.51.12.15@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e0223f69400, cur 1707420696 expire 1707420546 last 1707420469 [612634.369175] Lustre: fir-OST009d: haven't heard from client 1e7f0bb3-8f0b-4ee3-8f86-087d7f8ab365 (at 10.51.12.15@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e0223f6b800, cur 1707420708 expire 1707420558 last 1707420481 [612634.391127] Lustre: Skipped 1 previous similar message [615156.230092] Lustre: fir-OST0099: haven't heard from client 45ded471-ff7e-4fc5-9bb2-ca993402e7e6 (at 10.50.12.8@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33c6716800, cur 1707423230 expire 1707423080 last 1707423003 [623164.795417] Lustre: fir-OST0099: haven't heard from client 819b9e24-4f27-4e3c-a91f-58c98c9308fc (at 10.51.7.37@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33bfa17400, cur 1707431239 expire 1707431089 last 1707431012 [623164.817194] Lustre: Skipped 3 previous similar messages [623911.756688] Lustre: fir-OST009f: haven't heard from client f179873e-94e0-4e80-b9e4-9db61bb45487 (at 10.50.3.49@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e2f61eb6400, cur 1707431986 expire 1707431836 last 1707431759 [623911.778643] Lustre: Skipped 3 previous similar messages [623916.752622] Lustre: fir-OST009d: haven't heard from client cbc1c958-c4b4-4749-90db-e7070d7d6cf0 (at 10.50.3.51@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3547d93c00, cur 1707431991 expire 1707431841 last 1707431764 [623916.774407] Lustre: Skipped 2 previous similar messages [629423.452578] Lustre: fir-OST009f: haven't heard from client c40165ce-dd6d-43a4-8d71-6e352b01765b (at 10.50.3.48@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dff794f0c00, cur 1707437498 expire 1707437348 last 1707437271 [629423.474365] Lustre: Skipped 8 previous similar messages [629428.467060] Lustre: fir-OST009d: haven't heard from client c40165ce-dd6d-43a4-8d71-6e352b01765b (at 10.50.3.48@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e0006c3d000, cur 1707437503 expire 1707437353 last 1707437276 [629428.489238] Lustre: Skipped 2 previous similar messages [629499.448754] Lustre: fir-OST009b: haven't heard from client fdc9dc3c-58ac-4cc7-a065-ec130d7543e4 (at 10.51.2.51@o2ib3) in 189 seconds. I think it's dead, and I am evicting it. exp ffff9e42ca35d800, cur 1707437574 expire 1707437424 last 1707437385 [629504.466574] Lustre: fir-OST009d: haven't heard from client fdc9dc3c-58ac-4cc7-a065-ec130d7543e4 (at 10.51.2.51@o2ib3) in 187 seconds. I think it's dead, and I am evicting it. exp ffff9e02f2e6e400, cur 1707437579 expire 1707437429 last 1707437392 [629504.488362] Lustre: Skipped 2 previous similar messages [629575.445822] Lustre: fir-OST009f: haven't heard from client 8107b16e-830b-46c4-a0a2-7501dffb560f (at 10.51.4.13@o2ib3) in 194 seconds. I think it's dead, and I am evicting it. exp ffff9e03b1f72800, cur 1707437650 expire 1707437500 last 1707437456 [629651.440488] Lustre: fir-OST009f: haven't heard from client b6307f74-b0cd-4722-ae5c-01c6bfc91eec (at 10.51.6.34@o2ib3) in 219 seconds. I think it's dead, and I am evicting it. exp ffff9e41e6e51c00, cur 1707437726 expire 1707437576 last 1707437507 [629651.462276] Lustre: Skipped 9 previous similar messages [629684.440138] Lustre: fir-OST009d: haven't heard from client a45a4446-6e80-4139-a298-7693dbd9d659 (at 10.51.2.41@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dff7920e000, cur 1707437759 expire 1707437609 last 1707437532 [629684.461970] Lustre: Skipped 6 previous similar messages [629727.438897] Lustre: fir-OST009b: haven't heard from client dc1d0d8f-22dd-45c9-81b7-085a1763b1cb (at 10.51.15.19@o2ib3) in 224 seconds. I think it's dead, and I am evicting it. exp ffff9df3b5d0a000, cur 1707437802 expire 1707437652 last 1707437578 [629727.460765] Lustre: Skipped 6 previous similar messages [629803.434344] Lustre: fir-OST009f: haven't heard from client a3685263-bc5e-4670-acd5-2c428e594e5c (at 10.51.7.30@o2ib3) in 214 seconds. I think it's dead, and I am evicting it. exp ffff9e007c2b3c00, cur 1707437878 expire 1707437728 last 1707437664 [629803.456154] Lustre: Skipped 18 previous similar messages [629975.422513] Lustre: fir-OST009b: haven't heard from client c4ba410c-f7f0-4db1-a696-0b37ab4f9b70 (at 10.50.9.61@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33cb44dc00, cur 1707438050 expire 1707437900 last 1707437823 [629975.444326] Lustre: Skipped 5 previous similar messages [630342.402840] Lustre: fir-OST009d: haven't heard from client eee5cca4-8347-4ebb-997e-80c90fc173d7 (at 10.51.4.28@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e2f257df800, cur 1707438417 expire 1707438267 last 1707438190 [631793.326437] Lustre: fir-OST009d: haven't heard from client 9b70df1f-3d65-4c24-8397-ef9aad781c51 (at 10.51.4.44@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3fcf2a7000, cur 1707439868 expire 1707439718 last 1707439641 [631793.348224] Lustre: Skipped 4 previous similar messages [632381.291836] Lustre: fir-OST009b: haven't heard from client 08bbd275-8203-481b-a0b6-f1cec94e7e56 (at 10.51.3.12@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dfa09fb6c00, cur 1707440456 expire 1707440306 last 1707440229 [632381.313936] Lustre: Skipped 3 previous similar messages [632603.280167] Lustre: fir-OST0099: haven't heard from client 70d2f6ae-edc7-4c84-a1d1-fb9a22001a4e (at 10.50.6.70@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e2f31ebbc00, cur 1707440678 expire 1707440528 last 1707440451 [632603.301946] Lustre: Skipped 25 previous similar messages [633744.222349] Lustre: fir-OST009b: haven't heard from client 184a609d-4986-4785-b55e-739365c4222b (at 10.51.1.14@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e00e8011000, cur 1707441819 expire 1707441669 last 1707441592 [633744.244126] Lustre: Skipped 15 previous similar messages [634991.149297] Lustre: fir-OST009f: haven't heard from client eccd38ec-5857-472d-878f-9e66053facaa (at 10.51.6.23@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df3bb6be800, cur 1707443066 expire 1707442916 last 1707442839 [634991.171078] Lustre: Skipped 1 previous similar message [635067.147168] Lustre: fir-OST0099: haven't heard from client 305a91d0-e83a-4c8b-b000-34449e33eeb8 (at 10.50.12.8@o2ib2) in 189 seconds. I think it's dead, and I am evicting it. exp ffff9e33cd36dc00, cur 1707443142 expire 1707442992 last 1707442953 [635067.169081] Lustre: Skipped 3 previous similar messages [635143.146239] Lustre: fir-OST0099: haven't heard from client 04315408-a994-48e1-9848-bca277dd38e7 (at 10.51.5.1@o2ib3) in 169 seconds. I think it's dead, and I am evicting it. exp ffff9e42b4ee9000, cur 1707443218 expire 1707443068 last 1707443049 [635143.167934] Lustre: Skipped 3 previous similar messages [635316.131794] Lustre: fir-OST009f: haven't heard from client 2bcdab1d-f733-4186-b030-15779dd71b4f (at 10.51.17.20@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e026f547400, cur 1707443391 expire 1707443241 last 1707443164 [635316.153704] Lustre: Skipped 2 previous similar messages [635717.120552] Lustre: fir-OST009d: haven't heard from client e2fcc31f-490c-4fbf-ac3c-d6ac48601905 (at 10.51.9.61@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e2f4c6e0400, cur 1707443792 expire 1707443642 last 1707443565 [635717.142352] Lustre: Skipped 11 previous similar messages [635890.100289] Lustre: fir-OST0099: haven't heard from client e76d3755-8516-4645-9c82-ffc1fa006210 (at 10.51.9.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df97e25a000, cur 1707443965 expire 1707443815 last 1707443738 [635890.121996] Lustre: Skipped 3 previous similar messages [636330.078920] Lustre: fir-OST0099: haven't heard from client 5b6e9104-6518-4d05-b979-2b81d1d71cee (at 10.51.5.18@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02ee572000, cur 1707444405 expire 1707444255 last 1707444178 [636330.100866] Lustre: Skipped 3 previous similar messages [637675.003348] Lustre: fir-OST009f: haven't heard from client 28228595-8516-402c-8b66-3db0d442512d (at 10.51.9.38@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dff74e60400, cur 1707445750 expire 1707445600 last 1707445523 [637675.025139] Lustre: Skipped 3 previous similar messages [637957.987591] Lustre: fir-OST009b: haven't heard from client 8f69fdc1-39dd-4b6b-97e7-0bb710ac4714 (at 10.50.3.50@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df61a654800, cur 1707446033 expire 1707445883 last 1707445806 [637958.009491] Lustre: Skipped 3 previous similar messages [639043.930052] Lustre: fir-OST009f: haven't heard from client a704c56f-e383-476f-9828-399399daccbc (at 10.50.9.37@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f2797800, cur 1707447119 expire 1707446969 last 1707446892 [639043.951850] Lustre: Skipped 3 previous similar messages [639062.933986] Lustre: fir-OST009d: haven't heard from client a704c56f-e383-476f-9828-399399daccbc (at 10.50.9.37@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f1622400, cur 1707447138 expire 1707446988 last 1707446911 [639062.956091] Lustre: Skipped 1 previous similar message [639082.843048] Lustre: 47158:0:(client.c:2295:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1707447029/real 1707447029] req@ffff9e2eb3e8f080 x1789734743228736/t0(0) o106->fir-OST009d@10.51.7.46@o2ib3:15/16 lens 328/280 e 0 to 1 dl 1707447157 ref 1 fl Rpc:XQr/0/ffffffff rc 0/-1 job:'' [639119.935608] Lustre: fir-OST009b: haven't heard from client fc6ef3ba-9a71-4e84-a3cc-4168d47a21b9 (at 10.51.7.46@o2ib3) in 173 seconds. I think it's dead, and I am evicting it. exp ffff9dfd6cffc800, cur 1707447195 expire 1707447045 last 1707447022 [639119.957444] Lustre: Skipped 1 previous similar message [640322.869383] Lustre: fir-OST009b: haven't heard from client e64de633-807d-4ce5-881d-cab3df5cc0fc (at 10.50.9.5@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e2f63b00000, cur 1707448398 expire 1707448248 last 1707448171 [640322.891108] Lustre: Skipped 3 previous similar messages [640962.826784] Lustre: fir-OST0099: haven't heard from client 066dcc9e-9fb1-41da-86ba-f96471f8bf1e (at 10.50.9.7@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33cebbc800, cur 1707449038 expire 1707448888 last 1707448811 [640962.848650] Lustre: Skipped 7 previous similar messages [640967.858368] Lustre: fir-OST009d: haven't heard from client 066dcc9e-9fb1-41da-86ba-f96471f8bf1e (at 10.50.9.7@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e2f7c420400, cur 1707449043 expire 1707448893 last 1707448816 [640967.880093] Lustre: Skipped 1 previous similar message [640972.841644] Lustre: fir-OST009b: haven't heard from client 066dcc9e-9fb1-41da-86ba-f96471f8bf1e (at 10.50.9.7@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e2f6385b000, cur 1707449048 expire 1707448898 last 1707448821 [642355.748084] Lustre: fir-OST0099: haven't heard from client 30fb2489-b542-4101-8905-c9de24c1630c (at 10.51.15.11@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e2f61c43800, cur 1707450431 expire 1707450281 last 1707450204 [642368.754823] Lustre: fir-OST009b: haven't heard from client 30fb2489-b542-4101-8905-c9de24c1630c (at 10.51.15.11@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3353379c00, cur 1707450444 expire 1707450294 last 1707450217 [642368.777321] Lustre: Skipped 1 previous similar message [642899.717836] Lustre: fir-OST0099: haven't heard from client 61e9f4b8-4044-474b-9203-03fd48416254 (at 10.51.3.60@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e007bb74000, cur 1707450975 expire 1707450825 last 1707450748 [642899.739617] Lustre: Skipped 1 previous similar message [642902.744553] Lustre: fir-OST009f: haven't heard from client 8b434d46-6c61-4921-894d-51bdf56fd4c7 (at 10.51.9.8@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df3aeb48000, cur 1707450978 expire 1707450828 last 1707450751 [642913.719858] Lustre: fir-OST009b: haven't heard from client 61e9f4b8-4044-474b-9203-03fd48416254 (at 10.51.3.60@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dff74785c00, cur 1707450989 expire 1707450839 last 1707450762 [642913.741651] Lustre: Skipped 2 previous similar messages [643502.686233] Lustre: fir-OST0099: haven't heard from client b3a4b840-d737-463c-a62a-f325635ef5b6 (at 10.51.3.46@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02ee6c5000, cur 1707451578 expire 1707451428 last 1707451351 [647416.478714] Lustre: fir-OST009b: haven't heard from client 78dca82f-d074-43fe-88db-e7720a7f3e91 (at 10.51.5.63@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e42c9ef2c00, cur 1707455492 expire 1707455342 last 1707455265 [647416.500497] Lustre: Skipped 3 previous similar messages [647422.473486] Lustre: fir-OST009d: haven't heard from client 78dca82f-d074-43fe-88db-e7720a7f3e91 (at 10.51.5.63@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e036cbae800, cur 1707455498 expire 1707455348 last 1707455271 [647422.495275] Lustre: Skipped 2 previous similar messages [648463.423603] Lustre: fir-OST009f: haven't heard from client 9613e76e-5e68-4fa4-96bc-8cca64cf0585 (at 10.51.5.56@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dff98db4800, cur 1707456539 expire 1707456389 last 1707456312 [648468.416297] Lustre: fir-OST009d: haven't heard from client 9613e76e-5e68-4fa4-96bc-8cca64cf0585 (at 10.51.5.56@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dff746ef800, cur 1707456544 expire 1707456394 last 1707456317 [648468.438082] Lustre: Skipped 1 previous similar message [648481.416247] Lustre: fir-OST009b: haven't heard from client 9613e76e-5e68-4fa4-96bc-8cca64cf0585 (at 10.51.5.56@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02edddf400, cur 1707456557 expire 1707456407 last 1707456330 [665209.505101] Lustre: fir-OST009b: haven't heard from client f6ae8669-343d-4a79-af8e-c8c0d087a010 (at 10.50.2.28@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e4139298800, cur 1707473286 expire 1707473136 last 1707473059 [665219.502180] Lustre: fir-OST0099: haven't heard from client f6ae8669-343d-4a79-af8e-c8c0d087a010 (at 10.50.2.28@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33b9e2ec00, cur 1707473296 expire 1707473146 last 1707473069 [665219.523967] Lustre: Skipped 1 previous similar message [669826.254917] Lustre: fir-OST009b: haven't heard from client f315a8f8-3b41-4747-82f8-66d58e575776 (at 10.50.12.8@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3c85de6800, cur 1707477903 expire 1707477753 last 1707477676 [678153.796880] Lustre: fir-OST009b: haven't heard from client 5855c1fd-f929-44f5-b797-1b7b19e79b8d (at 10.51.12.2@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33bbb51c00, cur 1707486231 expire 1707486081 last 1707486004 [678153.818807] Lustre: Skipped 3 previous similar messages [680114.690508] Lustre: fir-OST009b: haven't heard from client 276db569-3625-4e62-acb9-357ad2b38b21 (at 10.51.10.38@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33d3318400, cur 1707488192 expire 1707488042 last 1707487965 [680114.712378] Lustre: Skipped 3 previous similar messages [680134.689612] Lustre: fir-OST009d: haven't heard from client 276db569-3625-4e62-acb9-357ad2b38b21 (at 10.51.10.38@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3e8cb9f800, cur 1707488212 expire 1707488062 last 1707487985 [685015.424978] Lustre: fir-OST009f: haven't heard from client 7fd28764-4743-4077-aeed-8972afefef88 (at 10.50.1.71@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33bf36d800, cur 1707493093 expire 1707492943 last 1707492866 [685015.447444] Lustre: Skipped 2 previous similar messages [685021.422682] Lustre: fir-OST0099: haven't heard from client 7fd28764-4743-4077-aeed-8972afefef88 (at 10.50.1.71@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e41f9b9fc00, cur 1707493099 expire 1707492949 last 1707492872 [686954.317927] Lustre: fir-OST009b: haven't heard from client e7564383-1c07-48cb-bf1c-75f2dfb1c883 (at 10.51.5.17@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e42035da000, cur 1707495032 expire 1707494882 last 1707494805 [686954.339723] Lustre: Skipped 1 previous similar message [690326.150558] Lustre: fir-OST009d: haven't heard from client 716bcf99-1e67-4e0b-b859-9c45083049f0 (at 10.51.1.42@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f2e6ec00, cur 1707498404 expire 1707498254 last 1707498177 [690326.172337] Lustre: Skipped 23 previous similar messages [690332.133233] Lustre: fir-OST009b: haven't heard from client 716bcf99-1e67-4e0b-b859-9c45083049f0 (at 10.51.1.42@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dff79166000, cur 1707498410 expire 1707498260 last 1707498183 [690337.134633] Lustre: fir-OST009f: haven't heard from client 716bcf99-1e67-4e0b-b859-9c45083049f0 (at 10.51.1.42@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dff6f703800, cur 1707498415 expire 1707498265 last 1707498188 [692751.025274] Lustre: 47175:0:(client.c:2295:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1707500701/real 1707500701] req@ffff9df201c44c80 x1789736370766208/t0(0) o106->fir-OST009f@10.51.1.33@o2ib3:15/16 lens 328/280 e 0 to 1 dl 1707500829 ref 1 fl Rpc:XQr/0/ffffffff rc 0/-1 job:'' [692751.053396] Lustre: 47175:0:(client.c:2295:ptlrpc_expire_one_request()) Skipped 1 previous similar message [692797.000945] Lustre: fir-OST009b: haven't heard from client 1608f9d2-a779-4280-8e41-161aaa11493e (at 10.51.1.33@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e2f63fd9c00, cur 1707500875 expire 1707500725 last 1707500648 [692797.022724] Lustre: Skipped 1 previous similar message [692807.998296] Lustre: fir-OST009d: haven't heard from client 1608f9d2-a779-4280-8e41-161aaa11493e (at 10.51.1.33@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33d3573c00, cur 1707500886 expire 1707500736 last 1707500659 [694069.929580] Lustre: fir-OST009d: haven't heard from client 64cfe594-8b2c-4379-a367-ffd804d9f328 (at 10.51.6.46@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01d24f3c00, cur 1707502148 expire 1707501998 last 1707501921 [694069.951588] Lustre: Skipped 2 previous similar messages [694230.920586] Lustre: fir-OST009f: haven't heard from client fe9778bc-5c0a-4ee7-95b4-71c5489e8567 (at 10.50.12.8@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e40b3117800, cur 1707502309 expire 1707502159 last 1707502082 [694230.942389] Lustre: Skipped 3 previous similar messages [698294.699568] Lustre: fir-OST009d: haven't heard from client c769dbb5-fe8d-4081-89cf-0db0dbc48f80 (at 10.51.8.64@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f1abf400, cur 1707506373 expire 1707506223 last 1707506146 [698294.721347] Lustre: Skipped 3 previous similar messages [699805.616990] Lustre: fir-OST0099: haven't heard from client 3c8a94b9-2e31-42a3-b163-d081f97cbf8d (at 10.50.9.37@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33d6c89c00, cur 1707507884 expire 1707507734 last 1707507657 [699805.638952] Lustre: Skipped 3 previous similar messages [700321.588909] Lustre: fir-OST0099: haven't heard from client 55594011-e66a-412f-8e67-6051fafa15e6 (at 10.50.12.8@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33ba318c00, cur 1707508400 expire 1707508250 last 1707508173 [700321.610689] Lustre: Skipped 11 previous similar messages [701276.537304] Lustre: fir-OST009b: haven't heard from client e3043ee2-1714-4cc5-b0f0-d1ac5feff757 (at 10.51.8.61@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e0076634400, cur 1707509355 expire 1707509205 last 1707509128 [701276.559085] Lustre: Skipped 3 previous similar messages [701434.528430] Lustre: fir-OST009f: haven't heard from client b0ca428c-e591-4dcb-a6a1-b3a03906a7d0 (at 10.51.12.16@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3f7d7c4400, cur 1707509513 expire 1707509363 last 1707509286 [701446.528049] Lustre: fir-OST0099: haven't heard from client b0ca428c-e591-4dcb-a6a1-b3a03906a7d0 (at 10.51.12.16@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e40db804000, cur 1707509525 expire 1707509375 last 1707509298 [701453.534505] Lustre: fir-OST009b: haven't heard from client b0ca428c-e591-4dcb-a6a1-b3a03906a7d0 (at 10.51.12.16@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e40db801c00, cur 1707509532 expire 1707509382 last 1707509305 [701453.556388] Lustre: Skipped 1 previous similar message [702190.487418] Lustre: fir-OST0099: haven't heard from client 71da1fac-7a0f-4829-9e82-7b9e501f658a (at 10.50.5.32@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df9d9653800, cur 1707510269 expire 1707510119 last 1707510042 [702203.486761] Lustre: fir-OST009b: haven't heard from client 71da1fac-7a0f-4829-9e82-7b9e501f658a (at 10.50.5.32@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df98942a000, cur 1707510282 expire 1707510132 last 1707510055 [702266.511463] Lustre: fir-OST0099: haven't heard from client ad7a67b4-5a87-46dc-bb3a-cfba9166e07e (at 10.50.2.26@o2ib2) in 226 seconds. I think it's dead, and I am evicting it. exp ffff9e02ee42c000, cur 1707510345 expire 1707510195 last 1707510119 [702266.533240] Lustre: Skipped 3 previous similar messages [703271.428968] Lustre: fir-OST009d: haven't heard from client 096416d0-bc89-4534-9260-3c8fb9505e03 (at 10.50.3.69@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3f7e76e000, cur 1707511350 expire 1707511200 last 1707511123 [703271.450748] Lustre: Skipped 1 previous similar message [703277.428685] Lustre: fir-OST0099: haven't heard from client 096416d0-bc89-4534-9260-3c8fb9505e03 (at 10.50.3.69@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e41cda9ec00, cur 1707511356 expire 1707511206 last 1707511129 [703277.450473] Lustre: Skipped 2 previous similar messages [703887.398570] Lustre: fir-OST009b: haven't heard from client e89d9ce3-07ba-4905-8c75-4d360361bb2b (at 10.51.7.55@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3f7baddc00, cur 1707511966 expire 1707511816 last 1707511739 [705077.332669] Lustre: fir-OST0099: haven't heard from client b07fac8a-7266-4eb3-86b8-eabe6905f13b (at 10.51.2.39@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02228b1c00, cur 1707513156 expire 1707513006 last 1707512929 [705085.344748] Lustre: fir-OST009f: haven't heard from client b07fac8a-7266-4eb3-86b8-eabe6905f13b (at 10.51.2.39@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df989f51400, cur 1707513164 expire 1707513014 last 1707512937 [705085.366881] Lustre: Skipped 1 previous similar message [705092.329773] Lustre: fir-OST009b: haven't heard from client b07fac8a-7266-4eb3-86b8-eabe6905f13b (at 10.51.2.39@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e008bdf9c00, cur 1707513171 expire 1707513021 last 1707512944 [710533.034378] Lustre: fir-OST009d: haven't heard from client 15e3fbc0-c587-49a6-8b6e-b0ee307becfa (at 10.50.3.50@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dfd5231d800, cur 1707518612 expire 1707518462 last 1707518385 [710825.024874] Lustre: fir-OST009b: haven't heard from client dd60d2d5-e6de-4eab-92c3-c128c93ae510 (at 10.50.7.54@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e0136a77400, cur 1707518904 expire 1707518754 last 1707518677 [710825.046659] Lustre: Skipped 7 previous similar messages [710832.019346] Lustre: fir-OST0099: haven't heard from client dd60d2d5-e6de-4eab-92c3-c128c93ae510 (at 10.50.7.54@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df972b63400, cur 1707518911 expire 1707518761 last 1707518684 [710839.017514] Lustre: fir-OST009d: haven't heard from client dd60d2d5-e6de-4eab-92c3-c128c93ae510 (at 10.50.7.54@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df989cff800, cur 1707518918 expire 1707518768 last 1707518691 [710839.039299] Lustre: Skipped 1 previous similar message [711332.991966] Lustre: fir-OST009d: haven't heard from client 367cf410-bd66-41fd-99d0-4647f6f0aafa (at 10.50.3.52@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df9690cc800, cur 1707519412 expire 1707519262 last 1707519185 [715232.785211] Lustre: fir-OST009d: haven't heard from client b786faa4-def6-4b70-9d62-03f1ac13b21d (at 10.51.1.36@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e0250441c00, cur 1707523312 expire 1707523162 last 1707523085 [715232.807007] Lustre: Skipped 3 previous similar messages [715245.779210] Lustre: fir-OST0099: haven't heard from client b786faa4-def6-4b70-9d62-03f1ac13b21d (at 10.51.1.36@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e0250442c00, cur 1707523325 expire 1707523175 last 1707523098 [715928.745143] Lustre: fir-OST0099: haven't heard from client a856cf05-2f5f-427a-8fcf-8fd255960d86 (at 10.51.1.32@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e008c162800, cur 1707524008 expire 1707523858 last 1707523781 [715928.767105] Lustre: Skipped 2 previous similar messages [718494.601539] Lustre: fir-OST009d: haven't heard from client a05feb32-ec85-4394-bc00-4947b89bfb2d (at 10.50.3.52@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e008e1c1000, cur 1707526574 expire 1707526424 last 1707526347 [719924.527615] Lustre: fir-OST009d: haven't heard from client ea32abc4-7d93-43a2-9bd8-03782b86fd0f (at 10.51.17.15@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f0e42c00, cur 1707528004 expire 1707527854 last 1707527777 [719924.549788] Lustre: Skipped 3 previous similar messages [719939.538549] Lustre: fir-OST0099: haven't heard from client ea32abc4-7d93-43a2-9bd8-03782b86fd0f (at 10.51.17.15@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02eebe7000, cur 1707528019 expire 1707527869 last 1707527792 [719939.560423] Lustre: Skipped 1 previous similar message [720762.478531] Lustre: fir-OST009b: haven't heard from client 39a078a0-afa2-4595-9f5f-15fa7129cefe (at 10.51.1.24@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01acf80400, cur 1707528842 expire 1707528692 last 1707528615 [720762.500322] Lustre: Skipped 1 previous similar message [720767.481699] Lustre: fir-OST0099: haven't heard from client 39a078a0-afa2-4595-9f5f-15fa7129cefe (at 10.51.1.24@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01acf80000, cur 1707528847 expire 1707528697 last 1707528620 [720767.503482] Lustre: Skipped 2 previous similar messages [723236.351099] Lustre: fir-OST0099: haven't heard from client 456e900c-dffa-4c14-8113-66e6adcde122 (at 10.51.8.36@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33d6494c00, cur 1707531316 expire 1707531166 last 1707531089 [723250.344224] Lustre: fir-OST009b: haven't heard from client 456e900c-dffa-4c14-8113-66e6adcde122 (at 10.51.8.36@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3ea102a000, cur 1707531330 expire 1707531180 last 1707531103 [726336.174909] Lustre: fir-OST009f: haven't heard from client 8b8f8c6f-bb71-487b-b566-819ce0024917 (at 10.50.1.37@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e03b1a65800, cur 1707534416 expire 1707534266 last 1707534189 [726336.196965] Lustre: Skipped 2 previous similar messages [726342.176450] Lustre: fir-OST009d: haven't heard from client 8b8f8c6f-bb71-487b-b566-819ce0024917 (at 10.50.1.37@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e0305ff8c00, cur 1707534422 expire 1707534272 last 1707534195 [726354.174282] Lustre: fir-OST0099: haven't heard from client 8b8f8c6f-bb71-487b-b566-819ce0024917 (at 10.50.1.37@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02eeb77c00, cur 1707534434 expire 1707534284 last 1707534207 [732713.829511] Lustre: fir-OST009f: haven't heard from client e500a3f3-e7c2-4294-a501-39ee205dce4d (at 10.51.14.6@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e03b1a66800, cur 1707540794 expire 1707540644 last 1707540567 [732713.851300] Lustre: Skipped 1 previous similar message [732721.834475] Lustre: fir-OST009d: haven't heard from client e500a3f3-e7c2-4294-a501-39ee205dce4d (at 10.51.14.6@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f0fdf800, cur 1707540802 expire 1707540652 last 1707540575 [732721.856260] Lustre: Skipped 1 previous similar message [732732.829281] Lustre: fir-OST009b: haven't heard from client e500a3f3-e7c2-4294-a501-39ee205dce4d (at 10.51.14.6@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e439cdb2800, cur 1707540813 expire 1707540663 last 1707540586 [734048.934466] Lustre: 46808:0:(client.c:2295:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1707542001/real 1707542001] req@ffff9e2df46c6780 x1789738033680000/t0(0) o106->fir-OST0099@10.51.9.46@o2ib3:15/16 lens 328/280 e 0 to 1 dl 1707542129 ref 1 fl Rpc:XQr/0/ffffffff rc 0/-1 job:'' [734048.962577] Lustre: 46808:0:(client.c:2295:ptlrpc_expire_one_request()) Skipped 2 previous similar messages [734121.534520] Lustre: ll_ost01_065: service thread pid 47109 was inactive for 200.605 seconds. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes: [734121.534524] Pid: 47158, comm: ll_ost01_099 3.10.0-1160.108.1.el7_lustre.pl1.x86_64 #1 SMP Fri Jan 26 11:26:38 PST 2024 [734121.534527] Call Trace: [734121.534627] [<0>] ptlrpc_set_wait+0x7b7/0x840 [ptlrpc] [734121.534653] [<0>] ldlm_run_ast_work+0xd5/0x3e0 [ptlrpc] [734121.534682] [<0>] ldlm_glimpse_locks+0x38/0x110 [ptlrpc] [734121.534691] [<0>] ofd_intent_policy+0x78b/0xa50 [ofd] [734121.534716] [<0>] ldlm_lock_enqueue+0x3d5/0xb60 [ptlrpc] [734121.534743] [<0>] ldlm_handle_enqueue0+0x8d6/0x1770 [ptlrpc] [734121.534784] [<0>] tgt_enqueue+0x64/0x250 [ptlrpc] [734121.534817] [<0>] tgt_request_handle+0x93f/0x19d0 [ptlrpc] [734121.534850] [<0>] ptlrpc_server_handle_request+0x253/0xc30 [ptlrpc] [734121.534877] [<0>] ptlrpc_main+0xbf4/0x15e0 [ptlrpc] [734121.534881] [<0>] kthread+0xd1/0xe0 [734121.534884] [<0>] ret_from_fork_nospec_begin+0x7/0x21 [734121.534935] [<0>] 0xfffffffffffffffe [734121.534938] Pid: 46808, comm: ll_ost01_040 3.10.0-1160.108.1.el7_lustre.pl1.x86_64 #1 SMP Fri Jan 26 11:26:38 PST 2024 [734121.534939] Call Trace: [734121.535010] [<0>] ptlrpc_set_wait+0x7b7/0x840 [ptlrpc] [734121.535041] [<0>] ldlm_run_ast_work+0xd5/0x3e0 [ptlrpc] [734121.535074] [<0>] ldlm_glimpse_locks+0x38/0x110 [ptlrpc] [734121.535087] [<0>] ofd_intent_policy+0x78b/0xa50 [ofd] [734121.535116] [<0>] ldlm_lock_enqueue+0x3d5/0xb60 [ptlrpc] [734121.535148] [<0>] ldlm_handle_enqueue0+0x8d6/0x1770 [ptlrpc] [734121.535200] [<0>] tgt_enqueue+0x64/0x250 [ptlrpc] [734121.535239] [<0>] tgt_request_handle+0x93f/0x19d0 [ptlrpc] [734121.535277] [<0>] ptlrpc_server_handle_request+0x253/0xc30 [ptlrpc] [734121.535309] [<0>] ptlrpc_main+0xbf4/0x15e0 [ptlrpc] [734121.535316] [<0>] kthread+0xd1/0xe0 [734121.535320] [<0>] ret_from_fork_nospec_begin+0x7/0x21 [734121.535374] [<0>] 0xfffffffffffffffe [734121.713787] Lustre: Skipped 2 previous similar messages [734121.719107] Pid: 47109, comm: ll_ost01_065 3.10.0-1160.108.1.el7_lustre.pl1.x86_64 #1 SMP Fri Jan 26 11:26:38 PST 2024 [734121.730168] Call Trace: [734121.732767] [<0>] ptlrpc_set_wait+0x7b7/0x840 [ptlrpc] [734121.738006] [<0>] ldlm_run_ast_work+0xd5/0x3e0 [ptlrpc] [734121.743338] [<0>] ldlm_glimpse_locks+0x38/0x110 [ptlrpc] [734121.748749] [<0>] ofd_intent_policy+0x78b/0xa50 [ofd] [734121.753896] [<0>] ldlm_lock_enqueue+0x3d5/0xb60 [ptlrpc] [734121.759305] [<0>] ldlm_handle_enqueue0+0x8d6/0x1770 [ptlrpc] [734121.765083] [<0>] tgt_enqueue+0x64/0x250 [ptlrpc] [734121.769892] [<0>] tgt_request_handle+0x93f/0x19d0 [ptlrpc] [734121.775481] [<0>] ptlrpc_server_handle_request+0x253/0xc30 [ptlrpc] [734121.781849] [<0>] ptlrpc_main+0xbf4/0x15e0 [ptlrpc] [734121.786822] [<0>] kthread+0xd1/0xe0 [734121.790409] [<0>] ret_from_fork_nospec_begin+0x7/0x21 [734121.795579] [<0>] 0xfffffffffffffffe [734123.751698] Lustre: fir-OST009f: haven't heard from client 497e3893-1955-4de2-bc57-a487dcf23acf (at 10.51.9.46@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df9941f6400, cur 1707542204 expire 1707542054 last 1707541977 [734136.751151] Lustre: fir-OST0099: haven't heard from client 497e3893-1955-4de2-bc57-a487dcf23acf (at 10.51.9.46@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e008a213800, cur 1707542217 expire 1707542067 last 1707541990 [734136.773378] Lustre: Skipped 1 previous similar message [738988.489481] Lustre: fir-OST009d: haven't heard from client 93d1d03e-e794-4ee8-8564-fb23516c31c9 (at 10.51.8.49@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dff79167400, cur 1707547069 expire 1707546919 last 1707546842 [738988.511266] Lustre: Skipped 1 previous similar message [741051.375568] Lustre: fir-OST009b: haven't heard from client b45b5bf1-c07c-4fdd-afa0-a3d129796161 (at 10.51.13.10@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e025040b000, cur 1707549132 expire 1707548982 last 1707548905 [741056.374223] Lustre: fir-OST0099: haven't heard from client b45b5bf1-c07c-4fdd-afa0-a3d129796161 (at 10.51.13.10@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dfe8c047000, cur 1707549137 expire 1707548987 last 1707548910 [741056.396231] Lustre: Skipped 1 previous similar message [741061.374188] Lustre: fir-OST009f: haven't heard from client b45b5bf1-c07c-4fdd-afa0-a3d129796161 (at 10.51.13.10@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e022a1bac00, cur 1707549142 expire 1707548992 last 1707548915 [741801.333811] Lustre: fir-OST009b: haven't heard from client b5619b73-0cee-4b8e-b1f9-fb1a39e1d0ed (at 10.51.6.44@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3fe16a6000, cur 1707549882 expire 1707549732 last 1707549655 [741813.340045] Lustre: fir-OST009d: haven't heard from client b5619b73-0cee-4b8e-b1f9-fb1a39e1d0ed (at 10.51.6.44@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e410a395000, cur 1707549894 expire 1707549744 last 1707549667 [741813.361833] Lustre: Skipped 1 previous similar message [741818.334655] Lustre: fir-OST0099: haven't heard from client b5619b73-0cee-4b8e-b1f9-fb1a39e1d0ed (at 10.51.6.44@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33d3ce2000, cur 1707549899 expire 1707549749 last 1707549672 [747247.566256] Lustre: 47111:0:(client.c:2295:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1707555200/real 1707555200] req@ffff9e2df3e51f80 x1789738399780928/t0(0) o106->fir-OST009d@10.51.12.15@o2ib3:15/16 lens 328/280 e 0 to 1 dl 1707555328 ref 1 fl Rpc:XQr/0/ffffffff rc 0/-1 job:'' [747320.176298] Lustre: ll_ost01_067: service thread pid 47111 was inactive for 200.614 seconds. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes: [747320.195398] Pid: 47111, comm: ll_ost01_067 3.10.0-1160.108.1.el7_lustre.pl1.x86_64 #1 SMP Fri Jan 26 11:26:38 PST 2024 [747320.206175] Call Trace: [747320.208756] [<0>] ptlrpc_set_wait+0x7b7/0x840 [ptlrpc] [747320.214359] [<0>] ldlm_run_ast_work+0xd5/0x3e0 [ptlrpc] [747320.219710] [<0>] ldlm_glimpse_locks+0x38/0x110 [ptlrpc] [747320.225125] [<0>] ofd_intent_policy+0x78b/0xa50 [ofd] [747320.230293] [<0>] ldlm_lock_enqueue+0x3d5/0xb60 [ptlrpc] [747320.235713] [<0>] ldlm_handle_enqueue0+0x8d6/0x1770 [ptlrpc] [747320.241487] [<0>] tgt_enqueue+0x64/0x250 [ptlrpc] [747320.246308] [<0>] tgt_request_handle+0x93f/0x19d0 [ptlrpc] [747320.251911] [<0>] ptlrpc_server_handle_request+0x253/0xc30 [ptlrpc] [747320.258277] [<0>] ptlrpc_main+0xbf4/0x15e0 [ptlrpc] [747320.263251] [<0>] kthread+0xd1/0xe0 [747320.266839] [<0>] ret_from_fork_nospec_begin+0x7/0x21 [747320.272022] [<0>] 0xfffffffffffffffe [747326.033034] Lustre: fir-OST0099: haven't heard from client 38295393-6362-4ea5-887e-71b091bcf0f9 (at 10.51.12.15@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dff74e76400, cur 1707555407 expire 1707555257 last 1707555180 [747336.044358] Lustre: fir-OST009d: haven't heard from client 38295393-6362-4ea5-887e-71b091bcf0f9 (at 10.51.12.15@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df8ade50c00, cur 1707555417 expire 1707555267 last 1707555190 [747336.066377] Lustre: Skipped 1 previous similar message [747341.045173] Lustre: fir-OST009f: haven't heard from client 38295393-6362-4ea5-887e-71b091bcf0f9 (at 10.51.12.15@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df2ffadec00, cur 1707555422 expire 1707555272 last 1707555195 [748644.963875] Lustre: fir-OST009b: haven't heard from client 286e623e-9b9f-49c8-9ab7-34d342b01b8f (at 10.50.8.53@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01c4556000, cur 1707556726 expire 1707556576 last 1707556499 [748649.964175] Lustre: fir-OST0099: haven't heard from client 286e623e-9b9f-49c8-9ab7-34d342b01b8f (at 10.50.8.53@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dff80285800, cur 1707556731 expire 1707556581 last 1707556504 [748654.968437] Lustre: fir-OST009d: haven't heard from client 286e623e-9b9f-49c8-9ab7-34d342b01b8f (at 10.50.8.53@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df97109d800, cur 1707556736 expire 1707556586 last 1707556509 [753740.684435] Lustre: fir-OST009f: haven't heard from client bf0d2cb9-ed5a-4e7b-9a7d-439e0d86c6db (at 10.51.5.12@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01c48b3800, cur 1707561822 expire 1707561672 last 1707561595 [768227.899787] Lustre: fir-OST009d: haven't heard from client f5acbe03-ad79-4d72-89a5-122b5ee3f71d (at 10.50.9.25@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3fd0994800, cur 1707576310 expire 1707576160 last 1707576083 [768227.921724] Lustre: Skipped 1 previous similar message [768233.899787] Lustre: fir-OST0099: haven't heard from client f5acbe03-ad79-4d72-89a5-122b5ee3f71d (at 10.50.9.25@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3ea6eab800, cur 1707576316 expire 1707576166 last 1707576089 [768233.921575] Lustre: Skipped 1 previous similar message [775700.498612] Lustre: fir-OST009b: haven't heard from client b745dbad-e80f-489c-93ee-ec773e2bf0b0 (at 10.51.9.46@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df96fc44c00, cur 1707583783 expire 1707583633 last 1707583556 [775700.520684] Lustre: Skipped 1 previous similar message [786950.888263] Lustre: fir-OST009d: haven't heard from client cc7ea456-66ae-4e9b-b451-ea721c273131 (at 10.51.8.48@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e40db814800, cur 1707595034 expire 1707594884 last 1707594807 [786950.910049] Lustre: Skipped 11 previous similar messages [786956.896486] Lustre: fir-OST0099: haven't heard from client cc7ea456-66ae-4e9b-b451-ea721c273131 (at 10.51.8.48@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33c6bdf400, cur 1707595040 expire 1707594890 last 1707594813 [786968.887307] Lustre: fir-OST009b: haven't heard from client cc7ea456-66ae-4e9b-b451-ea721c273131 (at 10.51.8.48@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3fd36e4c00, cur 1707595052 expire 1707594902 last 1707594825 [803428.005336] Lustre: fir-OST009d: haven't heard from client 5ec4a506-0014-4952-b75d-c2f591716b3f (at 10.51.14.10@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e43439b0800, cur 1707611512 expire 1707611362 last 1707611285 [803428.027221] Lustre: Skipped 1 previous similar message [832899.415748] Lustre: fir-OST009f: haven't heard from client 6ff80115-1569-45b3-b543-a40b01990594 (at 10.51.12.7@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e013d710400, cur 1707640985 expire 1707640835 last 1707640758 [832899.437672] Lustre: Skipped 3 previous similar messages [832904.415200] Lustre: fir-OST009b: haven't heard from client 6ff80115-1569-45b3-b543-a40b01990594 (at 10.51.12.7@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e026ee72800, cur 1707640990 expire 1707640840 last 1707640763 [832904.437005] Lustre: Skipped 1 previous similar message [832912.413045] Lustre: fir-OST009d: haven't heard from client 6ff80115-1569-45b3-b543-a40b01990594 (at 10.51.12.7@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01c48b0800, cur 1707640998 expire 1707640848 last 1707640771 [833916.141344] md: data-check of RAID array md1 [833922.179062] md: data-check of RAID array md3 [833928.226527] md: data-check of RAID array md5 [833934.271558] md: data-check of RAID array md7 [836110.236723] Lustre: fir-OST009b: haven't heard from client 35e1be79-fda9-498e-9642-99bdbff95bbb (at 10.51.9.71@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33bf3c3400, cur 1707644196 expire 1707644046 last 1707643969 [836117.236773] Lustre: fir-OST009f: haven't heard from client 35e1be79-fda9-498e-9642-99bdbff95bbb (at 10.51.9.71@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33bea0d000, cur 1707644203 expire 1707644053 last 1707643976 [836117.258578] Lustre: Skipped 1 previous similar message [836124.235488] Lustre: fir-OST009d: haven't heard from client 35e1be79-fda9-498e-9642-99bdbff95bbb (at 10.51.9.71@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33bf3c4000, cur 1707644210 expire 1707644060 last 1707643983 [840475.990960] Lustre: fir-OST009d: haven't heard from client 27d13ac7-0519-4f2d-8458-a766cf9bc4c2 (at 10.51.12.8@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f3309c00, cur 1707648562 expire 1707648412 last 1707648335 [840482.992401] Lustre: fir-OST009b: haven't heard from client 27d13ac7-0519-4f2d-8458-a766cf9bc4c2 (at 10.51.12.8@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e42e9aa2000, cur 1707648569 expire 1707648419 last 1707648342 [840483.014185] Lustre: Skipped 1 previous similar message [847126.616399] Lustre: fir-OST009d: haven't heard from client 7ae74fd9-f6ca-47f1-912c-015751ba907a (at 10.51.12.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e2f639b1c00, cur 1707655213 expire 1707655063 last 1707654986 [847126.638186] Lustre: Skipped 1 previous similar message [847131.615841] Lustre: fir-OST0099: haven't heard from client 7ae74fd9-f6ca-47f1-912c-015751ba907a (at 10.51.12.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3e8c289c00, cur 1707655218 expire 1707655068 last 1707654991 [872210.206574] Lustre: fir-OST009b: haven't heard from client bd781da3-9186-4a33-b9e1-9d2065af6ab0 (at 10.50.17.6@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e0220a52c00, cur 1707680298 expire 1707680148 last 1707680071 [872210.228361] Lustre: Skipped 2 previous similar messages [872216.202009] Lustre: fir-OST009d: haven't heard from client bd781da3-9186-4a33-b9e1-9d2065af6ab0 (at 10.50.17.6@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e40ebbdc400, cur 1707680304 expire 1707680154 last 1707680077 [878065.874424] Lustre: fir-OST009b: haven't heard from client f9abf968-369a-4e88-a15a-40fb11fef2f5 (at 10.51.12.16@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3fd8dae000, cur 1707686154 expire 1707686004 last 1707685927 [878065.896320] Lustre: Skipped 1 previous similar message [878070.886592] Lustre: fir-OST0099: haven't heard from client f9abf968-369a-4e88-a15a-40fb11fef2f5 (at 10.51.12.16@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e41dc3a2800, cur 1707686159 expire 1707686009 last 1707685932 [878076.872339] Lustre: fir-OST009f: haven't heard from client f9abf968-369a-4e88-a15a-40fb11fef2f5 (at 10.51.12.16@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33cf4ae000, cur 1707686165 expire 1707686015 last 1707685938 [878082.874286] Lustre: fir-OST009d: haven't heard from client f9abf968-369a-4e88-a15a-40fb11fef2f5 (at 10.51.12.16@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e32f8854800, cur 1707686171 expire 1707686021 last 1707685944 [879742.781096] Lustre: fir-OST0099: haven't heard from client 5388a26e-c02b-4c71-b354-315932a66e0a (at 10.51.4.36@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33cd58a000, cur 1707687831 expire 1707687681 last 1707687604 [879749.778572] Lustre: fir-OST009d: haven't heard from client 5388a26e-c02b-4c71-b354-315932a66e0a (at 10.51.4.36@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33bd9af000, cur 1707687838 expire 1707687688 last 1707687611 [879755.787662] Lustre: fir-OST009f: haven't heard from client 5388a26e-c02b-4c71-b354-315932a66e0a (at 10.51.4.36@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33bebfcc00, cur 1707687844 expire 1707687694 last 1707687617 [879755.810194] Lustre: Skipped 1 previous similar message [888330.299089] Lustre: fir-OST009d: haven't heard from client 4e1d29f4-e832-4fe5-8495-8b849f375d0d (at 10.51.5.49@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e40a348d400, cur 1707696419 expire 1707696269 last 1707696192 [893882.984719] md: md1: data-check done. [893900.626941] md: md5: data-check done. [893928.218392] md: md7: data-check done. [893930.029932] md: md3: data-check done. [904107.440615] Lustre: fir-OST009d: haven't heard from client 218c64ad-ef05-4ee7-9f9d-ff3a344c72de (at 10.51.4.35@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df35111ec00, cur 1707712197 expire 1707712047 last 1707711970 [904112.443094] Lustre: fir-OST009b: haven't heard from client 218c64ad-ef05-4ee7-9f9d-ff3a344c72de (at 10.51.4.35@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df35111cc00, cur 1707712202 expire 1707712052 last 1707711975 [914620.868172] Lustre: fir-OST009d: haven't heard from client b491ba12-d991-4c31-9ab8-67031fab9e28 (at 10.51.6.34@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e334935a000, cur 1707722711 expire 1707722561 last 1707722484 [914620.889950] Lustre: Skipped 2 previous similar messages [914637.872325] Lustre: fir-OST009b: haven't heard from client b491ba12-d991-4c31-9ab8-67031fab9e28 (at 10.51.6.34@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e41faebf800, cur 1707722728 expire 1707722578 last 1707722501 [914637.894103] Lustre: Skipped 2 previous similar messages [925983.249404] Lustre: fir-OST009b: haven't heard from client 5e9a6c53-063e-409e-8eb1-e2134de2bacd (at 10.51.2.8@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e42c9689c00, cur 1707734074 expire 1707733924 last 1707733847 [926389.227256] Lustre: fir-OST009d: haven't heard from client 5e9a6c53-063e-409e-8eb1-e2134de2bacd (at 10.51.2.8@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33b92bc400, cur 1707734480 expire 1707734330 last 1707734253 [926389.248951] Lustre: Skipped 3 previous similar messages [934931.276483] Lustre: fir-OST009b: Client 822d15fd-71f7-4964-8fab-5d372e0a0e98 (at 10.51.7.69@o2ib3) reconnecting [940887.437330] Lustre: fir-OST009f: haven't heard from client 26b77c19-ca0b-4dc3-9f02-950a19a177b5 (at 10.51.12.6@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e439d878000, cur 1707748979 expire 1707748829 last 1707748752 [940887.459342] Lustre: Skipped 3 previous similar messages [940893.442950] Lustre: fir-OST009b: haven't heard from client 26b77c19-ca0b-4dc3-9f02-950a19a177b5 (at 10.51.12.6@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e41cd86fc00, cur 1707748985 expire 1707748835 last 1707748758 [940903.439088] Lustre: fir-OST0099: haven't heard from client 26b77c19-ca0b-4dc3-9f02-950a19a177b5 (at 10.51.12.6@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e439d878800, cur 1707748995 expire 1707748845 last 1707748768 [947834.059235] Lustre: fir-OST0099: haven't heard from client 2955b1fc-b31b-4a4d-9f4d-6563d321f7be (at 10.50.3.50@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e0070297c00, cur 1707755926 expire 1707755776 last 1707755699 [947834.081057] Lustre: Skipped 1 previous similar message [947990.050578] Lustre: fir-OST009f: haven't heard from client bbf1eab1-651c-4225-830f-7960abc0be3e (at 10.50.8.48@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33bb35e000, cur 1707756082 expire 1707755932 last 1707755855 [947990.072381] Lustre: Skipped 7 previous similar messages [948405.027890] Lustre: fir-OST009d: haven't heard from client 9505545b-fd04-454b-8f22-315e3ecede2f (at 10.50.5.71@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e2f89339000, cur 1707756497 expire 1707756347 last 1707756270 [948405.049886] Lustre: Skipped 7 previous similar messages [948607.016878] Lustre: fir-OST0099: haven't heard from client 7a887fa2-635a-4e87-888d-9f0a851ee20f (at 10.50.3.52@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df3ad0be000, cur 1707756699 expire 1707756549 last 1707756472 [948607.038671] Lustre: Skipped 3 previous similar messages [952412.809132] Lustre: fir-OST009f: haven't heard from client 9a2f46ec-b2ac-43bd-b385-27ade9c0149d (at 10.51.4.35@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e0008bbbc00, cur 1707760505 expire 1707760355 last 1707760278 [952412.830917] Lustre: Skipped 3 previous similar messages [953005.777049] Lustre: fir-OST009d: haven't heard from client 6ba72f98-e03f-48ae-80ad-c9be3084eaab (at 10.51.14.19@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f3308400, cur 1707761098 expire 1707760948 last 1707760871 [953005.798938] Lustre: Skipped 3 previous similar messages [953020.777838] Lustre: fir-OST0099: haven't heard from client 6ba72f98-e03f-48ae-80ad-c9be3084eaab (at 10.51.14.19@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02ee51b800, cur 1707761113 expire 1707760963 last 1707760886 [953020.799721] Lustre: Skipped 2 previous similar messages [957824.515286] Lustre: fir-OST009f: haven't heard from client 990ab818-bdef-4461-a2f2-0a587c8e8c08 (at 10.50.2.33@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df97df2ec00, cur 1707765917 expire 1707765767 last 1707765690 [959414.428907] Lustre: fir-OST009f: haven't heard from client a65a91b2-d15a-47e3-b4fe-0791810f518d (at 10.51.2.38@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e41d7c9f800, cur 1707767507 expire 1707767357 last 1707767280 [959414.450700] Lustre: Skipped 7 previous similar messages [959421.428192] Lustre: fir-OST009b: haven't heard from client a65a91b2-d15a-47e3-b4fe-0791810f518d (at 10.51.2.38@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e41cbc73800, cur 1707767514 expire 1707767364 last 1707767287 [972405.725477] Lustre: fir-OST009f: haven't heard from client 4ca5e58b-32f5-4403-b148-98763df68819 (at 10.50.3.50@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e0257b5f800, cur 1707780499 expire 1707780349 last 1707780272 [973202.681525] Lustre: fir-OST009d: haven't heard from client 5a01de07-b12f-4a25-96d3-9435a1c9d720 (at 10.50.5.71@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3fca5f1400, cur 1707781296 expire 1707781146 last 1707781069 [973202.703478] Lustre: Skipped 3 previous similar messages [974283.626507] Lustre: fir-OST0099: haven't heard from client de8f65a0-53a6-49f0-9b69-25f2dbc72aa5 (at 10.50.2.33@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dff71ab6000, cur 1707782377 expire 1707782227 last 1707782150 [974283.648294] Lustre: Skipped 7 previous similar messages [975099.580698] Lustre: fir-OST009d: haven't heard from client 43d4157f-d4de-478a-ac40-8426a242d644 (at 10.50.3.56@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df97b37ac00, cur 1707783193 expire 1707783043 last 1707782966 [975099.602816] Lustre: Skipped 7 previous similar messages [975508.556816] Lustre: fir-OST009f: haven't heard from client 859c95d7-74ee-4ccb-831c-c49d8d929b58 (at 10.50.4.18@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e41c3146c00, cur 1707783602 expire 1707783452 last 1707783375 [975508.578595] Lustre: Skipped 3 previous similar messages [975511.566917] Lustre: fir-OST0099: haven't heard from client 01d949cc-3146-47fd-b105-89f6ea9af989 (at 10.50.2.72@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02ee720400, cur 1707783605 expire 1707783455 last 1707783378 [975511.588706] Lustre: Skipped 9 previous similar messages [975584.559271] Lustre: fir-OST009d: haven't heard from client 0b0b664a-1273-403d-a1c1-81251dc948b4 (at 10.50.9.19@o2ib2) in 187 seconds. I think it's dead, and I am evicting it. exp ffff9e2f622da400, cur 1707783678 expire 1707783528 last 1707783491 [975584.581055] Lustre: Skipped 8 previous similar messages [975664.549839] Lustre: fir-OST009f: haven't heard from client 4024f412-cce8-4e68-bf0b-7c02fe50a996 (at 10.50.10.37@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df98eaef800, cur 1707783758 expire 1707783608 last 1707783531 [975740.544842] Lustre: fir-OST009f: haven't heard from client 2467581a-d2ca-4727-beef-822f6f0bb56d (at 10.51.4.5@o2ib3) in 197 seconds. I think it's dead, and I am evicting it. exp ffff9e000b989c00, cur 1707783834 expire 1707783684 last 1707783637 [975765.546654] Lustre: fir-OST009b: haven't heard from client 2467581a-d2ca-4727-beef-822f6f0bb56d (at 10.51.4.5@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dff74677800, cur 1707783859 expire 1707783709 last 1707783632 [975816.544996] Lustre: fir-OST009f: haven't heard from client 33a4e466-6476-4b5a-88d0-01b224869c07 (at 10.51.5.24@o2ib3) in 226 seconds. I think it's dead, and I am evicting it. exp ffff9e00c453d800, cur 1707783910 expire 1707783760 last 1707783684 [975816.567132] Lustre: Skipped 11 previous similar messages [975892.544786] Lustre: fir-OST009f: haven't heard from client 08fdc092-946b-4927-9f4e-0df3c29af0b8 (at 10.51.17.11@o2ib3) in 223 seconds. I think it's dead, and I am evicting it. exp ffff9e02f202e800, cur 1707783986 expire 1707783836 last 1707783763 [975892.566654] Lustre: Skipped 5 previous similar messages [976096.527822] Lustre: fir-OST009d: haven't heard from client 39a709e6-dede-47b5-beef-be131c8fa078 (at 10.51.2.53@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e00084c3000, cur 1707784190 expire 1707784040 last 1707783963 [976096.549622] Lustre: Skipped 14 previous similar messages [976771.490023] Lustre: fir-OST009f: haven't heard from client fa64e986-e955-4aeb-9e59-887bf3b5c333 (at 10.51.3.61@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e03b1a61800, cur 1707784865 expire 1707784715 last 1707784638 [976771.511982] Lustre: Skipped 54 previous similar messages [977407.458512] Lustre: fir-OST009b: haven't heard from client 263a87b7-00bc-4416-85ca-e6a51c321b5e (at 10.51.6.26@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e43ad115000, cur 1707785501 expire 1707785351 last 1707785274 [977407.480500] Lustre: Skipped 12 previous similar messages [978307.410581] Lustre: fir-OST0099: haven't heard from client c549ba6d-78b3-4551-959f-f230fc9d892a (at 10.51.15.8@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e008bfb2400, cur 1707786401 expire 1707786251 last 1707786174 [978307.432827] Lustre: Skipped 3 previous similar messages [981628.228495] Lustre: fir-OST0099: haven't heard from client 729955a3-034d-4adb-ab81-674e45318d9f (at 10.51.10.49@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01b20acc00, cur 1707789722 expire 1707789572 last 1707789495 [981628.250558] Lustre: Skipped 5 previous similar messages [982707.169904] Lustre: fir-OST0099: haven't heard from client b6d78121-645c-47e5-a38a-d6cc2e8405bb (at 10.51.1.66@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e021b445000, cur 1707790801 expire 1707790651 last 1707790574 [982707.191692] Lustre: Skipped 3 previous similar messages [983319.137313] Lustre: fir-OST009f: haven't heard from client 88946b2e-fc63-4278-854d-1a33dadbbc20 (at 10.50.9.40@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df3c61e1c00, cur 1707791413 expire 1707791263 last 1707791186 [983351.141271] Lustre: fir-OST0099: haven't heard from client 5d905223-d6e4-4425-83b3-be99b622cd84 (at 10.50.9.25@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e41dfa07800, cur 1707791445 expire 1707791295 last 1707791218 [983351.163221] Lustre: Skipped 5 previous similar messages [985357.029909] Lustre: fir-OST009d: haven't heard from client 68732e83-9b2a-4785-882a-0ecaaeabf984 (at 10.51.8.21@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dfe8d32ec00, cur 1707793451 expire 1707793301 last 1707793224 [985362.035513] Lustre: fir-OST009b: haven't heard from client 68732e83-9b2a-4785-882a-0ecaaeabf984 (at 10.51.8.21@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df31505c000, cur 1707793456 expire 1707793306 last 1707793229 [985362.057295] Lustre: Skipped 1 previous similar message [985552.017767] Lustre: fir-OST0099: haven't heard from client 9476db50-d868-43f3-959f-b6d7f1c5741c (at 10.51.8.61@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df97d852400, cur 1707793646 expire 1707793496 last 1707793419 [985552.039549] Lustre: Skipped 1 previous similar message [987397.916284] Lustre: fir-OST009d: haven't heard from client b646bbc1-75d5-44a1-9827-3e7d306927c9 (at 10.51.1.14@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df6110ba000, cur 1707795492 expire 1707795342 last 1707795265 [987397.938071] Lustre: Skipped 3 previous similar messages [989471.803849] Lustre: fir-OST009b: haven't heard from client 314d830f-0d07-4ce9-8a49-bdc6f892a2cb (at 10.51.7.60@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e43ad116000, cur 1707797566 expire 1707797416 last 1707797339 [989471.825632] Lustre: Skipped 3 previous similar messages [989481.810460] Lustre: fir-OST009d: haven't heard from client 314d830f-0d07-4ce9-8a49-bdc6f892a2cb (at 10.51.7.60@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f0856800, cur 1707797576 expire 1707797426 last 1707797349 [989481.832288] Lustre: Skipped 1 previous similar message [989547.801687] Lustre: fir-OST009f: haven't heard from client f4a53b39-1e96-4495-847d-439c63d74ea0 (at 10.50.4.59@o2ib2) in 186 seconds. I think it's dead, and I am evicting it. exp ffff9e02f213a400, cur 1707797642 expire 1707797492 last 1707797456 [989547.823477] Lustre: Skipped 1 previous similar message [989557.805830] Lustre: fir-OST0099: haven't heard from client f4a53b39-1e96-4495-847d-439c63d74ea0 (at 10.50.4.59@o2ib2) in 196 seconds. I think it's dead, and I am evicting it. exp ffff9e02ee723800, cur 1707797652 expire 1707797502 last 1707797456 [989557.827970] Lustre: Skipped 1 previous similar message [989748.789751] Lustre: fir-OST0099: haven't heard from client 59c2b45e-8489-4d82-b2c2-de429ade8aa4 (at 10.51.7.49@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e4154678c00, cur 1707797843 expire 1707797693 last 1707797616 [989748.811725] Lustre: Skipped 1 previous similar message [989760.788216] Lustre: fir-OST009f: haven't heard from client 59c2b45e-8489-4d82-b2c2-de429ade8aa4 (at 10.51.7.49@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3f734d3400, cur 1707797855 expire 1707797705 last 1707797628 [989760.810002] Lustre: Skipped 1 previous similar message [989824.787083] Lustre: fir-OST0099: haven't heard from client c2660fcd-0c64-4b9b-abe8-fec11cb049e4 (at 10.51.4.15@o2ib3) in 217 seconds. I think it's dead, and I am evicting it. exp ffff9df61a650000, cur 1707797919 expire 1707797769 last 1707797702 [989824.808884] Lustre: Skipped 3 previous similar messages [993285.600179] Lustre: fir-OST0099: haven't heard from client bbc669c6-df4e-4935-9b81-7153ea69193d (at 10.51.15.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dfe945c4400, cur 1707801380 expire 1707801230 last 1707801153 [993285.622136] Lustre: Skipped 1 previous similar message [994489.536904] Lustre: fir-OST009f: haven't heard from client 939d9bad-bbad-41d2-a722-c0140f424f13 (at 10.51.6.50@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e40dc4e4400, cur 1707802584 expire 1707802434 last 1707802357 [994489.558692] Lustre: Skipped 3 previous similar messages [997351.386130] Lustre: fir-OST009d: haven't heard from client e7800081-b676-4660-bbbc-b7b5dce90205 (at 10.51.16.7@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e0218551400, cur 1707805446 expire 1707805296 last 1707805219 [997357.377748] Lustre: fir-OST009b: haven't heard from client e7800081-b676-4660-bbbc-b7b5dce90205 (at 10.51.16.7@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df97ee44400, cur 1707805452 expire 1707805302 last 1707805225 [997368.375979] Lustre: fir-OST0099: haven't heard from client e7800081-b676-4660-bbbc-b7b5dce90205 (at 10.51.16.7@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e0218557400, cur 1707805463 expire 1707805313 last 1707805236 [997622.385498] Lustre: fir-OST009b: haven't heard from client 2f976bf6-77e2-4861-83c1-ec4887d34e48 (at 10.51.8.34@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e41fae1a800, cur 1707805717 expire 1707805567 last 1707805490 [997622.407287] Lustre: Skipped 1 previous similar message [997628.371933] Lustre: fir-OST009d: haven't heard from client 2f976bf6-77e2-4861-83c1-ec4887d34e48 (at 10.51.8.34@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33d37dcc00, cur 1707805723 expire 1707805573 last 1707805496 [1001522.155127] Lustre: fir-OST009f: haven't heard from client 975c1752-de7d-43c6-bd0e-60899026dd53 (at 10.51.8.50@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e43abaf3c00, cur 1707809617 expire 1707809467 last 1707809390 [1001522.177379] Lustre: Skipped 1 previous similar message [1001724.137786] Lustre: fir-OST0099: haven't heard from client 0ee87c5b-5fc9-4d67-9459-56c7f1b08fb0 (at 10.51.6.58@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33ba237c00, cur 1707809819 expire 1707809669 last 1707809592 [1004673.980248] Lustre: fir-OST009b: haven't heard from client 1fbf407e-3b65-47b2-97fd-09ef1cd0348d (at 10.51.3.25@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3fd11c6400, cur 1707812769 expire 1707812619 last 1707812542 [1004674.002114] Lustre: Skipped 3 previous similar messages [1006599.894739] Lustre: fir-OST009d: haven't heard from client e3eb11d1-943b-4d3e-b852-76a379a30efb (at 10.51.7.59@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e2f610b4400, cur 1707814695 expire 1707814545 last 1707814468 [1006599.916979] Lustre: Skipped 3 previous similar messages [1006606.890660] Lustre: fir-OST009b: haven't heard from client e3eb11d1-943b-4d3e-b852-76a379a30efb (at 10.51.7.59@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e40f8e3c000, cur 1707814702 expire 1707814552 last 1707814475 [1006616.876238] Lustre: fir-OST0099: haven't heard from client e3eb11d1-943b-4d3e-b852-76a379a30efb (at 10.51.7.59@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e40e7e3c000, cur 1707814712 expire 1707814562 last 1707814485 [1008612.767060] Lustre: fir-OST009b: haven't heard from client 1cb21086-a6c8-46a4-a5ae-baa4a21dd2dd (at 10.51.8.47@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02190b7c00, cur 1707816708 expire 1707816558 last 1707816481 [1008612.789135] Lustre: Skipped 1 previous similar message [1008616.764758] Lustre: fir-OST009f: haven't heard from client 10b293b0-f102-431f-83ff-9dd7f5ffb4f7 (at 10.51.1.68@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df996092800, cur 1707816712 expire 1707816562 last 1707816485 [1008616.786636] Lustre: Skipped 2 previous similar messages [1011784.592394] Lustre: fir-OST009b: haven't heard from client 2fca9f77-d7cc-4512-9465-4e481b034cbc (at 10.51.4.65@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e020fe74000, cur 1707819880 expire 1707819730 last 1707819653 [1011784.614266] Lustre: Skipped 8 previous similar messages [1011788.592016] Lustre: fir-OST009f: haven't heard from client f99ae79a-af8e-48df-905a-88c0a4376dae (at 10.51.4.63@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df9662bc800, cur 1707819884 expire 1707819734 last 1707819657 [1011788.613885] Lustre: Skipped 5 previous similar messages [1012417.558675] Lustre: fir-OST0099: haven't heard from client 4999a190-c95d-4cc6-95f0-1294f39eb873 (at 10.51.8.72@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e41dbeb3000, cur 1707820513 expire 1707820363 last 1707820286 [1012417.580855] Lustre: Skipped 1 previous similar message [1013540.496829] Lustre: fir-OST009d: haven't heard from client 041052e3-dd57-43ad-b9d7-a9ac39feace1 (at 10.51.8.70@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dfd6c594c00, cur 1707821636 expire 1707821486 last 1707821409 [1013546.496622] Lustre: fir-OST009b: haven't heard from client 041052e3-dd57-43ad-b9d7-a9ac39feace1 (at 10.51.8.70@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3f7c8f1000, cur 1707821642 expire 1707821492 last 1707821415 [1013551.500233] Lustre: fir-OST009f: haven't heard from client 041052e3-dd57-43ad-b9d7-a9ac39feace1 (at 10.51.8.70@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01391d9000, cur 1707821647 expire 1707821497 last 1707821420 [1013616.495289] Lustre: fir-OST009d: haven't heard from client a9cd2b9f-2266-4602-870c-f3ac62aa5251 (at 10.51.4.50@o2ib3) in 213 seconds. I think it's dead, and I am evicting it. exp ffff9e02f2e6dc00, cur 1707821712 expire 1707821562 last 1707821499 [1013616.517159] Lustre: Skipped 3 previous similar messages [1013622.496433] Lustre: fir-OST009b: haven't heard from client a9cd2b9f-2266-4602-870c-f3ac62aa5251 (at 10.51.4.50@o2ib3) in 219 seconds. I think it's dead, and I am evicting it. exp ffff9e436610f400, cur 1707821718 expire 1707821568 last 1707821499 [1018151.247273] Lustre: fir-OST009f: haven't heard from client d5c45559-1fd8-445e-bbd5-fba5880a8f62 (at 10.51.2.11@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dff790ff800, cur 1707826247 expire 1707826097 last 1707826020 [1019659.174497] Lustre: fir-OST009f: haven't heard from client e3d5f0dc-62c5-46ba-8384-0ca9c1b2b8b1 (at 10.51.7.53@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f202cc00, cur 1707827755 expire 1707827605 last 1707827528 [1019659.196376] Lustre: Skipped 3 previous similar messages [1019678.168452] Lustre: fir-OST009b: haven't heard from client e3d5f0dc-62c5-46ba-8384-0ca9c1b2b8b1 (at 10.51.7.53@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e42c9f25000, cur 1707827774 expire 1707827624 last 1707827547 [1020053.156949] Lustre: fir-OST009f: haven't heard from client 99f2e9d0-76df-4b72-bb50-7c635d028d8b (at 10.51.10.35@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01f5f24000, cur 1707828149 expire 1707827999 last 1707827922 [1020053.178901] Lustre: Skipped 2 previous similar messages [1020059.154029] Lustre: fir-OST009b: haven't heard from client 99f2e9d0-76df-4b72-bb50-7c635d028d8b (at 10.51.10.35@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33d64b5400, cur 1707828155 expire 1707828005 last 1707827928 [1020065.149699] Lustre: fir-OST0099: haven't heard from client 99f2e9d0-76df-4b72-bb50-7c635d028d8b (at 10.51.10.35@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df968fd2400, cur 1707828161 expire 1707828011 last 1707827934 [1022192.028849] Lustre: fir-OST009b: haven't heard from client 0bc706c6-9a28-4ac2-8677-ecc34484f506 (at 10.51.8.65@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df9677e0000, cur 1707830288 expire 1707830138 last 1707830061 [1022192.050725] Lustre: Skipped 1 previous similar message [1022197.028975] Lustre: fir-OST009f: haven't heard from client 0bc706c6-9a28-4ac2-8677-ecc34484f506 (at 10.51.8.65@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df9677e6800, cur 1707830293 expire 1707830143 last 1707830066 [1022197.050997] Lustre: Skipped 1 previous similar message [1032147.486664] Lustre: fir-OST009d: haven't heard from client 43c6b02a-979e-4e78-91b0-15d5b8961abd (at 10.51.4.24@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3e8c0b7400, cur 1707840244 expire 1707840094 last 1707840017 [1032147.508544] Lustre: Skipped 1 previous similar message [1032223.483361] Lustre: fir-OST009d: haven't heard from client 6b64677b-fd39-4c34-a889-0eee9b07f652 (at 10.51.7.59@o2ib3) in 206 seconds. I think it's dead, and I am evicting it. exp ffff9e3fd1896000, cur 1707840320 expire 1707840170 last 1707840114 [1032223.505231] Lustre: Skipped 15 previous similar messages [1032299.478326] Lustre: fir-OST009f: haven't heard from client 48785de3-bb0b-4291-b837-c44abf8e916b (at 10.51.3.69@o2ib3) in 207 seconds. I think it's dead, and I am evicting it. exp ffff9e413effc800, cur 1707840396 expire 1707840246 last 1707840189 [1032299.500197] Lustre: Skipped 3 previous similar messages [1032319.483748] Lustre: fir-OST0099: haven't heard from client 48785de3-bb0b-4291-b837-c44abf8e916b (at 10.51.3.69@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3ea4557400, cur 1707840416 expire 1707840266 last 1707840189 [1032319.505617] Lustre: Skipped 25 previous similar messages [1032692.459514] Lustre: fir-OST0099: haven't heard from client e743d60b-98b7-4c46-b74c-efd90948252e (at 10.51.5.60@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e020617a800, cur 1707840789 expire 1707840639 last 1707840562 [1032692.481379] Lustre: Skipped 25 previous similar messages [1033383.421249] Lustre: fir-OST009f: haven't heard from client 2a34953c-25ea-4167-b2b8-cbf09a71d6bb (at 10.50.9.25@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e41cda9f400, cur 1707841480 expire 1707841330 last 1707841253 [1033383.443122] Lustre: Skipped 11 previous similar messages [1033386.423838] Lustre: fir-OST009d: haven't heard from client 2a34953c-25ea-4167-b2b8-cbf09a71d6bb (at 10.50.9.25@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e420fb14c00, cur 1707841483 expire 1707841333 last 1707841256 [1033388.435856] Lustre: fir-OST009b: haven't heard from client 2a34953c-25ea-4167-b2b8-cbf09a71d6bb (at 10.50.9.25@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e41cda9dc00, cur 1707841485 expire 1707841335 last 1707841258 [1033388.457728] Lustre: Skipped 1 previous similar message [1042682.914941] Lustre: fir-OST009b: haven't heard from client 0d49928e-98bf-4d27-85db-d76f43033aaa (at 10.50.7.57@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3f4462b000, cur 1707850780 expire 1707850630 last 1707850553 [1043966.845072] Lustre: fir-OST0099: haven't heard from client e38456ee-b5f8-4158-a69b-b586474d6c4a (at 10.51.5.54@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dff75a0b000, cur 1707852064 expire 1707851914 last 1707851837 [1043966.866941] Lustre: Skipped 3 previous similar messages [1044646.809255] Lustre: fir-OST009f: haven't heard from client c5ec6994-0ee8-491f-b1aa-327b986c0792 (at 10.50.2.33@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df9694eac00, cur 1707852744 expire 1707852594 last 1707852517 [1050727.478471] Lustre: fir-OST009d: haven't heard from client 6612b4ef-b53c-4560-a557-7699a7bf2440 (at 10.51.5.54@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df3b655e000, cur 1707858825 expire 1707858675 last 1707858598 [1050727.500528] Lustre: Skipped 7 previous similar messages [1050803.471651] Lustre: fir-OST009d: haven't heard from client 8a8885a5-b8ea-4084-96ca-4a816d52c5bc (at 10.50.17.27@o2ib2) in 201 seconds. I think it's dead, and I am evicting it. exp ffff9e421f6ca400, cur 1707858901 expire 1707858751 last 1707858700 [1050803.493603] Lustre: Skipped 3 previous similar messages [1051235.450268] Lustre: fir-OST009b: haven't heard from client 444de56b-6ac6-42a2-a51c-870762ea68dd (at 10.50.5.71@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33aff8b800, cur 1707859333 expire 1707859183 last 1707859106 [1051235.472148] Lustre: Skipped 7 previous similar messages [1051608.427822] Lustre: fir-OST009b: haven't heard from client 2d10a258-a753-4cf7-a1e7-c798eb4f087e (at 10.50.5.71@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e414b76e800, cur 1707859706 expire 1707859556 last 1707859479 [1051608.449701] Lustre: Skipped 7 previous similar messages [1052074.404205] Lustre: fir-OST009b: haven't heard from client 64ac06f1-b605-45a3-8833-4dc21582144b (at 10.51.18.9@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df300703800, cur 1707860172 expire 1707860022 last 1707859945 [1052074.426071] Lustre: Skipped 7 previous similar messages [1052484.380818] Lustre: fir-OST009d: haven't heard from client 9ff4d540-f4d3-4818-90ac-5c61fcc199bb (at 10.50.2.33@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df3aefc8400, cur 1707860582 expire 1707860432 last 1707860355 [1052484.402692] Lustre: Skipped 3 previous similar messages [1053609.321082] Lustre: fir-OST009d: haven't heard from client e31a80a4-a1ed-42a0-b665-82412f006257 (at 10.51.4.3@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f1a4ac00, cur 1707861707 expire 1707861557 last 1707861480 [1053609.342882] Lustre: Skipped 7 previous similar messages [1053619.324568] Lustre: fir-OST009b: haven't heard from client e31a80a4-a1ed-42a0-b665-82412f006257 (at 10.51.4.3@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e42c9714400, cur 1707861717 expire 1707861567 last 1707861490 [1056818.146258] Lustre: fir-OST0099: haven't heard from client 9d675f9e-f1e9-4cb2-af9f-43887ae860bc (at 10.51.18.9@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01efd04800, cur 1707864916 expire 1707864766 last 1707864689 [1056818.168127] Lustre: Skipped 2 previous similar messages [1059936.984756] Lustre: fir-OST009f: haven't heard from client d60917bd-d149-4245-a429-14b75a2e64d1 (at 10.50.17.10@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01b354b400, cur 1707868035 expire 1707867885 last 1707867808 [1059937.006712] Lustre: Skipped 3 previous similar messages [1059937.978907] Lustre: fir-OST009d: haven't heard from client 89ac26c9-6c61-46ff-829b-7342a35b915d (at 10.51.3.64@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02328a5000, cur 1707868036 expire 1707867886 last 1707867809 [1059938.000774] Lustre: Skipped 20 previous similar messages [1059941.978825] Lustre: fir-OST0099: haven't heard from client 754724ce-d42b-48d5-9619-e215739b152a (at 10.51.7.12@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02ee4bc400, cur 1707868040 expire 1707867890 last 1707867813 [1059942.000911] Lustre: Skipped 13 previous similar messages [1059943.980124] Lustre: fir-OST009b: haven't heard from client afe5df01-1a82-48ec-b559-992ebf653eb7 (at 10.51.3.14@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dfd4fc85400, cur 1707868042 expire 1707867892 last 1707867815 [1059944.002653] Lustre: Skipped 17 previous similar messages [1060100.971678] Lustre: fir-OST009f: haven't heard from client 39f524e8-a657-4a87-aae1-3de3e2f0aeac (at 10.51.8.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e2f1da30400, cur 1707868199 expire 1707868049 last 1707867972 [1060100.993471] Lustre: Skipped 14 previous similar messages [1060332.957137] Lustre: fir-OST009f: haven't heard from client 14f136b3-83e7-4f10-bf05-834d54e94e4d (at 10.51.1.49@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e2f60e55000, cur 1707868431 expire 1707868281 last 1707868204 [1060332.979012] Lustre: Skipped 19 previous similar messages [1060351.989101] Lustre: fir-OST009d: haven't heard from client c66f52b2-6381-4c5c-8e83-cd1ce89567db (at 10.51.10.7@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df984bfc800, cur 1707868450 expire 1707868300 last 1707868223 [1060352.010974] Lustre: Skipped 7 previous similar messages [1061208.909687] Lustre: fir-OST009f: haven't heard from client dbcc2f35-c3e0-4e41-8ab5-7c24658496f5 (at 10.50.17.7@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e2f60db1400, cur 1707869307 expire 1707869157 last 1707869080 [1061208.931554] Lustre: Skipped 5 previous similar messages [1063153.803141] Lustre: fir-OST009b: haven't heard from client e95fac2f-807d-401e-b071-8e4965f79ef2 (at 10.50.9.44@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df96e690400, cur 1707871252 expire 1707871102 last 1707871025 [1063153.825015] Lustre: Skipped 2 previous similar messages [1063161.803010] Lustre: fir-OST009f: haven't heard from client e95fac2f-807d-401e-b071-8e4965f79ef2 (at 10.50.9.44@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e0008567800, cur 1707871260 expire 1707871110 last 1707871033 [1063452.786085] Lustre: fir-OST009d: haven't heard from client 5180cfdf-d76b-42d0-9a0e-987b23b1de34 (at 10.51.17.14@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01c762a800, cur 1707871551 expire 1707871401 last 1707871324 [1063462.785598] Lustre: fir-OST009b: haven't heard from client 5180cfdf-d76b-42d0-9a0e-987b23b1de34 (at 10.51.17.14@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e0139895000, cur 1707871561 expire 1707871411 last 1707871334 [1063462.807558] Lustre: Skipped 1 previous similar message [1063471.790524] Lustre: fir-OST009f: haven't heard from client 5180cfdf-d76b-42d0-9a0e-987b23b1de34 (at 10.51.17.14@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df993197c00, cur 1707871570 expire 1707871420 last 1707871343 [1063771.769275] Lustre: fir-OST009b: haven't heard from client f2f203aa-84f9-408f-9e5f-f54196a6b425 (at 10.51.1.22@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dfe8cd30000, cur 1707871870 expire 1707871720 last 1707871643 [1064289.741238] Lustre: fir-OST009b: haven't heard from client 524e5be6-ba70-441c-886c-bf41c9a75c8f (at 10.51.5.46@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e00f7464800, cur 1707872388 expire 1707872238 last 1707872161 [1064289.763237] Lustre: Skipped 3 previous similar messages [1064713.719616] Lustre: fir-OST009b: haven't heard from client 68d6986c-94c6-4ac5-8819-a87cab01cdc2 (at 10.51.5.42@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df963f21000, cur 1707872812 expire 1707872662 last 1707872585 [1064713.741762] Lustre: Skipped 3 previous similar messages [1065750.661147] Lustre: fir-OST009f: haven't heard from client 514d82f8-4297-471d-8681-2486096d17f8 (at 10.50.9.39@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e42c7d39400, cur 1707873849 expire 1707873699 last 1707873622 [1065750.683020] Lustre: Skipped 7 previous similar messages [1066094.644473] Lustre: fir-OST009f: haven't heard from client 65287b54-d341-4ebf-93a4-b73fadce116e (at 10.51.2.30@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33b99fa400, cur 1707874193 expire 1707874043 last 1707873966 [1066170.638480] Lustre: fir-OST009f: haven't heard from client ce8fb51f-5820-4d4f-a4da-3c3000c2ee01 (at 10.51.13.4@o2ib3) in 213 seconds. I think it's dead, and I am evicting it. exp ffff9e02f20ce400, cur 1707874269 expire 1707874119 last 1707874056 [1068095.540712] Lustre: fir-OST009f: haven't heard from client 865f1ae7-800e-4fcb-9cb3-a0d6416d5af2 (at 10.51.6.38@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33b92be800, cur 1707876194 expire 1707876044 last 1707875967 [1068095.562589] Lustre: Skipped 3 previous similar messages [1068109.538134] Lustre: fir-OST009b: haven't heard from client 865f1ae7-800e-4fcb-9cb3-a0d6416d5af2 (at 10.51.6.38@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e413b97f800, cur 1707876208 expire 1707876058 last 1707875981 [1069035.482693] Lustre: fir-OST009b: haven't heard from client 980c0dd8-ee3f-4f20-b992-8365deb141b9 (at 10.51.1.3@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e2f61230c00, cur 1707877134 expire 1707876984 last 1707876907 [1069035.504616] Lustre: Skipped 2 previous similar messages [1069549.463079] Lustre: fir-OST0099: haven't heard from client ff9f835d-1218-4803-bdc5-c529e77a8e04 (at 10.51.3.14@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e00254a6c00, cur 1707877648 expire 1707877498 last 1707877421 [1069549.484954] Lustre: Skipped 3 previous similar messages [1069557.456028] Lustre: fir-OST009b: haven't heard from client a856ee8c-8f4e-4f27-9e54-37e141336fb9 (at 10.51.10.23@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e010a342000, cur 1707877656 expire 1707877506 last 1707877429 [1069557.478121] Lustre: Skipped 9 previous similar messages [1073154.259711] Lustre: fir-OST009b: haven't heard from client 78576e07-5f8f-4ae9-839e-5a6ea2edff30 (at 10.50.9.12@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df3b5d16000, cur 1707881253 expire 1707881103 last 1707881026 [1073154.281581] Lustre: Skipped 29 previous similar messages [1073605.243192] Lustre: fir-OST009b: haven't heard from client 7a9dabb7-7603-480a-98c6-cd2b7cb5a4a9 (at 10.51.9.60@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e0013579000, cur 1707881704 expire 1707881554 last 1707881477 [1074579.208375] Lustre: fir-OST009b: haven't heard from client 6b5fa418-7ef6-4e9c-ab64-58c371e87eb6 (at 10.51.8.45@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df3bb95b000, cur 1707882678 expire 1707882528 last 1707882451 [1074597.184349] Lustre: fir-OST0099: haven't heard from client 6b5fa418-7ef6-4e9c-ab64-58c371e87eb6 (at 10.51.8.45@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df31b6ab400, cur 1707882696 expire 1707882546 last 1707882469 [1074831.174374] Lustre: fir-OST0099: haven't heard from client 166289a9-883e-4e83-a94b-7e71e155e1c0 (at 10.51.5.3@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e413f657800, cur 1707882930 expire 1707882780 last 1707882703 [1074831.196637] Lustre: Skipped 2 previous similar messages [1074845.168286] Lustre: fir-OST009f: haven't heard from client 6a66ba99-dd1a-4159-95c9-106882cffeb3 (at 10.51.5.14@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df97e50d800, cur 1707882944 expire 1707882794 last 1707882717 [1074845.190158] Lustre: Skipped 8 previous similar messages [1075255.149005] Lustre: fir-OST0099: haven't heard from client 6739b3ee-938b-4b6d-85d8-4a5b0b8776d7 (at 10.51.5.7@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e40b302bc00, cur 1707883354 expire 1707883204 last 1707883127 [1075255.170927] Lustre: Skipped 2 previous similar messages [1075668.123352] Lustre: fir-OST009f: haven't heard from client 91b6064b-d9f3-43a6-900a-debbd2dfeead (at 10.51.9.68@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df9d86dc400, cur 1707883767 expire 1707883617 last 1707883540 [1075668.145218] Lustre: Skipped 3 previous similar messages [1077392.031932] Lustre: fir-OST009b: haven't heard from client 44ec88d7-38a8-44cf-ae01-2cbcc458543f (at 10.51.3.29@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33bf506400, cur 1707885491 expire 1707885341 last 1707885264 [1077392.053908] Lustre: Skipped 3 previous similar messages [1077400.036793] Lustre: fir-OST009d: haven't heard from client 44ec88d7-38a8-44cf-ae01-2cbcc458543f (at 10.51.3.29@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e2f20daf000, cur 1707885499 expire 1707885349 last 1707885272 [1077400.058797] Lustre: Skipped 2 previous similar messages [1078037.001649] Lustre: fir-OST009f: haven't heard from client a18ca4a4-0beb-45d5-a1a9-02cd52ac9d09 (at 10.51.2.39@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e00888c5000, cur 1707886136 expire 1707885986 last 1707885909 [1078046.005634] Lustre: fir-OST009b: haven't heard from client a18ca4a4-0beb-45d5-a1a9-02cd52ac9d09 (at 10.51.2.39@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df329222c00, cur 1707886145 expire 1707885995 last 1707885918 [1078046.027508] Lustre: Skipped 1 previous similar message [1078057.000503] Lustre: fir-OST009d: haven't heard from client a18ca4a4-0beb-45d5-a1a9-02cd52ac9d09 (at 10.51.2.39@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df96f320c00, cur 1707886156 expire 1707886006 last 1707885929 [1078327.980782] Lustre: fir-OST009d: haven't heard from client e01a1d69-30e8-40a6-b7b9-de9a790eadd1 (at 10.50.1.35@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e41d5c45c00, cur 1707886427 expire 1707886277 last 1707886200 [1078359.980254] Lustre: fir-OST009f: haven't heard from client 34e448e9-4311-4e48-bad5-f4a6b197d8a8 (at 10.51.15.16@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f20e0c00, cur 1707886459 expire 1707886309 last 1707886232 [1078360.002715] Lustre: Skipped 3 previous similar messages [1078371.983550] Lustre: fir-OST0099: haven't heard from client 34e448e9-4311-4e48-bad5-f4a6b197d8a8 (at 10.51.15.16@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02ee740c00, cur 1707886471 expire 1707886321 last 1707886244 [1079337.926439] Lustre: fir-OST009f: haven't heard from client 94dddeb3-fe5f-4fcc-bf79-8882d9dc6e5d (at 10.51.1.52@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e000fcd8000, cur 1707887437 expire 1707887287 last 1707887210 [1079342.928268] Lustre: fir-OST009b: haven't heard from client 94dddeb3-fe5f-4fcc-bf79-8882d9dc6e5d (at 10.51.1.52@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dff772ad800, cur 1707887442 expire 1707887292 last 1707887215 [1079347.931696] Lustre: fir-OST0099: haven't heard from client 94dddeb3-fe5f-4fcc-bf79-8882d9dc6e5d (at 10.51.1.52@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02ee144c00, cur 1707887447 expire 1707887297 last 1707887220 [1079347.953562] Lustre: Skipped 1 previous similar message [1080526.861064] Lustre: fir-OST009f: haven't heard from client 1aa43676-3fd4-44e0-8c5e-e8147cb63c28 (at 10.51.1.55@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f2099800, cur 1707888626 expire 1707888476 last 1707888399 [1080534.863276] Lustre: fir-OST009b: haven't heard from client 1aa43676-3fd4-44e0-8c5e-e8147cb63c28 (at 10.51.1.55@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e4363579800, cur 1707888634 expire 1707888484 last 1707888407 [1080534.885147] Lustre: Skipped 1 previous similar message [1080602.869564] Lustre: fir-OST009f: haven't heard from client c51f4a85-ff1c-4aab-9dd5-27ee42724cd2 (at 10.51.2.54@o2ib3) in 172 seconds. I think it's dead, and I am evicting it. exp ffff9e02f20f8800, cur 1707888702 expire 1707888552 last 1707888530 [1080602.891442] Lustre: Skipped 1 previous similar message [1080610.868711] Lustre: fir-OST0099: haven't heard from client c51f4a85-ff1c-4aab-9dd5-27ee42724cd2 (at 10.51.2.54@o2ib3) in 180 seconds. I think it's dead, and I am evicting it. exp ffff9e02ee6ec000, cur 1707888710 expire 1707888560 last 1707888530 [1080610.890740] Lustre: Skipped 1 previous similar message [1080952.836863] Lustre: fir-OST009b: haven't heard from client 11bd07ff-ee57-49b8-ba5a-33bc56ba010e (at 10.51.1.32@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df970633400, cur 1707889052 expire 1707888902 last 1707888825 [1080952.858740] Lustre: Skipped 1 previous similar message [1083195.718399] Lustre: fir-OST0099: haven't heard from client ca1ebdb0-3c8f-4dab-864f-ffd1df4210f7 (at 10.51.13.18@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02eebe2c00, cur 1707891295 expire 1707891145 last 1707891068 [1083195.740546] Lustre: Skipped 3 previous similar messages [1083208.714502] Lustre: fir-OST009d: haven't heard from client ca1ebdb0-3c8f-4dab-864f-ffd1df4210f7 (at 10.51.13.18@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f1ab9800, cur 1707891308 expire 1707891158 last 1707891081 [1083271.744090] Lustre: fir-OST0099: haven't heard from client d973b384-e333-474e-89fb-67c600d26569 (at 10.51.2.55@o2ib3) in 221 seconds. I think it's dead, and I am evicting it. exp ffff9df31c5e1c00, cur 1707891371 expire 1707891221 last 1707891150 [1083271.765989] Lustre: Skipped 3 previous similar messages [1085685.581993] Lustre: fir-OST009d: haven't heard from client 74094c30-090f-4cb2-bc73-38e3b161b171 (at 10.50.2.32@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f0cb8000, cur 1707893785 expire 1707893635 last 1707893558 [1085691.580167] Lustre: fir-OST009f: haven't heard from client 74094c30-090f-4cb2-bc73-38e3b161b171 (at 10.50.2.32@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e43ac1dc800, cur 1707893791 expire 1707893641 last 1707893564 [1085691.602036] Lustre: Skipped 2 previous similar messages [1086387.545443] Lustre: fir-OST009b: haven't heard from client a3d66685-bb81-4818-ba18-1e0bcf97f420 (at 10.51.4.72@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e40b2909c00, cur 1707894487 expire 1707894337 last 1707894260 [1086397.551656] Lustre: fir-OST009f: haven't heard from client a3d66685-bb81-4818-ba18-1e0bcf97f420 (at 10.51.4.72@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33d4cb2800, cur 1707894497 expire 1707894347 last 1707894270 [1086402.541362] Lustre: fir-OST0099: haven't heard from client a3d66685-bb81-4818-ba18-1e0bcf97f420 (at 10.51.4.72@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3fcb906400, cur 1707894502 expire 1707894352 last 1707894275 [1090490.361629] Lustre: fir-OST009d: haven't heard from client ca2bdece-5cec-4899-9956-6fb6363052f7 (at 10.51.2.38@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e41d81dc400, cur 1707898590 expire 1707898440 last 1707898363 [1090490.383677] Lustre: Skipped 1 previous similar message [1090491.336085] Lustre: fir-OST009b: haven't heard from client ca2bdece-5cec-4899-9956-6fb6363052f7 (at 10.51.2.38@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e2f6046fc00, cur 1707898591 expire 1707898441 last 1707898364 [1090498.320473] Lustre: fir-OST0099: haven't heard from client ca2bdece-5cec-4899-9956-6fb6363052f7 (at 10.51.2.38@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3fd1d45400, cur 1707898598 expire 1707898448 last 1707898371 [1091312.276428] Lustre: fir-OST0099: haven't heard from client 74e559ba-2b82-4f72-80be-2b58ae44fecd (at 10.51.2.61@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df3c0c52800, cur 1707899412 expire 1707899262 last 1707899185 [1091312.298303] Lustre: Skipped 1 previous similar message [1091319.293079] Lustre: fir-OST009f: haven't heard from client 74e559ba-2b82-4f72-80be-2b58ae44fecd (at 10.51.2.61@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01b37c6000, cur 1707899419 expire 1707899269 last 1707899192 [1091388.270764] Lustre: fir-OST0099: haven't heard from client 71318f78-bbef-45b4-b74a-fa8ce0a73f50 (at 10.51.2.59@o2ib3) in 203 seconds. I think it's dead, and I am evicting it. exp ffff9e013a667400, cur 1707899488 expire 1707899338 last 1707899285 [1091395.272228] Lustre: fir-OST009f: haven't heard from client 71318f78-bbef-45b4-b74a-fa8ce0a73f50 (at 10.51.2.59@o2ib3) in 204 seconds. I think it's dead, and I am evicting it. exp ffff9dff79579c00, cur 1707899495 expire 1707899345 last 1707899291 [1091424.269649] Lustre: fir-OST009d: haven't heard from client 71318f78-bbef-45b4-b74a-fa8ce0a73f50 (at 10.51.2.59@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dfcfa170800, cur 1707899524 expire 1707899374 last 1707899297 [1091500.271004] Lustre: fir-OST009d: haven't heard from client c1c38c0b-e375-4f39-8a74-8a46e0fd5a79 (at 10.51.4.53@o2ib3) in 195 seconds. I think it's dead, and I am evicting it. exp ffff9e013d46a400, cur 1707899600 expire 1707899450 last 1707899405 [1091500.292876] Lustre: Skipped 1 previous similar message [1092137.230818] Lustre: fir-OST009f: haven't heard from client 08495e35-f919-4e28-ba2b-a12b43349704 (at 10.51.8.18@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e03af715c00, cur 1707900237 expire 1707900087 last 1707900010 [1092502.211164] Lustre: fir-OST009f: haven't heard from client 345469f5-c0b0-47dc-a0fd-42af9f49d6b3 (at 10.51.8.40@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3fcc3c6400, cur 1707900602 expire 1707900452 last 1707900375 [1092502.233043] Lustre: Skipped 3 previous similar messages [1092509.211508] Lustre: fir-OST0099: haven't heard from client 345469f5-c0b0-47dc-a0fd-42af9f49d6b3 (at 10.51.8.40@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e4216b9b800, cur 1707900609 expire 1707900459 last 1707900382 [1092509.233517] Lustre: Skipped 1 previous similar message [1092522.210008] Lustre: fir-OST009b: haven't heard from client 345469f5-c0b0-47dc-a0fd-42af9f49d6b3 (at 10.51.8.40@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e2f60e9e400, cur 1707900622 expire 1707900472 last 1707900395 [1092578.214265] Lustre: fir-OST009f: haven't heard from client b7d326f4-edd3-4566-97ac-7e09e931f83d (at 10.51.17.6@o2ib3) in 175 seconds. I think it's dead, and I am evicting it. exp ffff9e439d87c000, cur 1707900678 expire 1707900528 last 1707900503 [1092630.212521] Lustre: fir-OST009d: haven't heard from client b7d326f4-edd3-4566-97ac-7e09e931f83d (at 10.51.17.6@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e439d87b000, cur 1707900730 expire 1707900580 last 1707900503 [1092630.234392] Lustre: Skipped 1 previous similar message [1093108.183650] Lustre: fir-OST009d: haven't heard from client 2394204c-41de-4ab5-9097-3d44fb34454f (at 10.50.4.60@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e35498c2000, cur 1707901208 expire 1707901058 last 1707900981 [1093108.205529] Lustre: Skipped 1 previous similar message [1096053.018418] Lustre: fir-OST009b: haven't heard from client 280ca15f-f49f-40c8-809a-98504e00b6a3 (at 10.51.2.62@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33c155b400, cur 1707904153 expire 1707904003 last 1707903926 [1096073.035556] Lustre: fir-OST009f: haven't heard from client 280ca15f-f49f-40c8-809a-98504e00b6a3 (at 10.51.2.62@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3fd3755c00, cur 1707904173 expire 1707904023 last 1707903946 [1096073.057425] Lustre: Skipped 2 previous similar messages [1096532.994876] Lustre: fir-OST0099: haven't heard from client f0025c0a-3343-4bad-8351-4e9bfec96f55 (at 10.51.5.50@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e021360b400, cur 1707904633 expire 1707904483 last 1707904406 [1098157.904776] Lustre: fir-OST009d: haven't heard from client a15fdd76-b154-45cc-bf09-b990ca4a6bc9 (at 10.51.4.52@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33cbcd5800, cur 1707906258 expire 1707906108 last 1707906031 [1098157.926947] Lustre: Skipped 3 previous similar messages [1098166.905620] Lustre: fir-OST009b: haven't heard from client a15fdd76-b154-45cc-bf09-b990ca4a6bc9 (at 10.51.4.52@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33b7cab800, cur 1707906267 expire 1707906117 last 1707906040 [1099714.820031] Lustre: fir-OST0099: haven't heard from client b3d0905f-78c9-4bc1-bc06-d07d1fe687d6 (at 10.51.5.61@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33ba592000, cur 1707907815 expire 1707907665 last 1707907588 [1099714.842065] Lustre: Skipped 2 previous similar messages [1099720.818952] Lustre: fir-OST009b: haven't heard from client b3d0905f-78c9-4bc1-bc06-d07d1fe687d6 (at 10.51.5.61@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e40dc4e0800, cur 1707907821 expire 1707907671 last 1707907594 [1099720.841184] Lustre: Skipped 1 previous similar message [1099726.825142] Lustre: fir-OST009f: haven't heard from client b3d0905f-78c9-4bc1-bc06-d07d1fe687d6 (at 10.51.5.61@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33cf5b8c00, cur 1707907827 expire 1707907677 last 1707907600 [1100369.784009] Lustre: fir-OST009b: haven't heard from client c8c30deb-34d2-418c-a186-a318857c23b3 (at 10.51.9.12@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dfe95b49800, cur 1707908470 expire 1707908320 last 1707908243 [1100770.762008] Lustre: fir-OST009f: haven't heard from client 27c52d14-dafe-420e-8826-a2696cd17e68 (at 10.51.9.32@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e0008ea9800, cur 1707908871 expire 1707908721 last 1707908644 [1100770.784040] Lustre: Skipped 1 previous similar message [1100783.764784] Lustre: fir-OST0099: haven't heard from client 27c52d14-dafe-420e-8826-a2696cd17e68 (at 10.51.9.32@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02edb2fc00, cur 1707908884 expire 1707908734 last 1707908657 [1100783.786805] Lustre: Skipped 2 previous similar messages [1102809.652650] Lustre: fir-OST009f: haven't heard from client a86a58e9-8a54-4817-8889-b6408cd01ea5 (at 10.51.4.41@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df8a9c54800, cur 1707910910 expire 1707910760 last 1707910683 [1102823.651776] Lustre: fir-OST009d: haven't heard from client a86a58e9-8a54-4817-8889-b6408cd01ea5 (at 10.51.4.41@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f36e5800, cur 1707910924 expire 1707910774 last 1707910697 [1102823.673652] Lustre: Skipped 2 previous similar messages [1105360.526095] Lustre: fir-OST009b: haven't heard from client f7703a2c-ed55-490d-a91c-e0396c4d69b0 (at 10.51.6.40@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3f72d9c000, cur 1707913461 expire 1707913311 last 1707913234 [1107756.389546] Lustre: fir-OST0099: haven't heard from client 9a2a28a6-05c6-4d49-aba8-381f311537db (at 10.51.8.69@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01c8c81000, cur 1707915857 expire 1707915707 last 1707915630 [1110265.251938] Lustre: fir-OST0099: haven't heard from client 642bc227-4106-43d3-b5b0-0c649ce2913a (at 10.51.10.39@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dff74d59400, cur 1707918366 expire 1707918216 last 1707918139 [1110265.273897] Lustre: Skipped 3 previous similar messages [1110272.252965] Lustre: fir-OST009f: haven't heard from client 642bc227-4106-43d3-b5b0-0c649ce2913a (at 10.51.10.39@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df98fbf5000, cur 1707918373 expire 1707918223 last 1707918146 [1113719.075195] Lustre: fir-OST009f: haven't heard from client 5c3f3c1c-85da-4ca9-ad20-7e7bfc268536 (at 10.51.8.59@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df30de0e000, cur 1707921820 expire 1707921670 last 1707921593 [1113719.097068] Lustre: Skipped 1 previous similar message [1113744.069034] Lustre: fir-OST0099: haven't heard from client 35309888-f5e0-4979-acf0-203429f8f708 (at 10.50.8.41@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df3aeb02000, cur 1707921845 expire 1707921695 last 1707921618 [1113749.064902] Lustre: fir-OST009b: haven't heard from client 35309888-f5e0-4979-acf0-203429f8f708 (at 10.50.8.41@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01ce551800, cur 1707921850 expire 1707921700 last 1707921623 [1113820.063606] Lustre: fir-OST0099: haven't heard from client ae4e81c6-fc24-4f98-8e39-89bf8f36e37f (at 10.51.8.72@o2ib3) in 157 seconds. I think it's dead, and I am evicting it. exp ffff9e2f7c1f7400, cur 1707921921 expire 1707921771 last 1707921764 [1113825.060897] Lustre: fir-OST009b: haven't heard from client ae4e81c6-fc24-4f98-8e39-89bf8f36e37f (at 10.51.8.72@o2ib3) in 171 seconds. I think it's dead, and I am evicting it. exp ffff9e40f8d36c00, cur 1707921926 expire 1707921776 last 1707921755 [1113881.055897] Lustre: fir-OST009f: haven't heard from client ae4e81c6-fc24-4f98-8e39-89bf8f36e37f (at 10.51.8.72@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e40ab4bf800, cur 1707921982 expire 1707921832 last 1707921755 [1114138.061331] Lustre: fir-OST009d: haven't heard from client ad203b9c-5fda-4e5a-912f-a270b260dba9 (at 10.51.8.56@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33d5ede400, cur 1707922239 expire 1707922089 last 1707922012 [1114138.083327] Lustre: Skipped 1 previous similar message [1114214.043498] Lustre: fir-OST009d: haven't heard from client 8d0051de-f636-4b42-ae0b-696038b843d9 (at 10.51.12.6@o2ib3) in 164 seconds. I think it's dead, and I am evicting it. exp ffff9e2f60b11000, cur 1707922315 expire 1707922165 last 1707922151 [1114214.065367] Lustre: Skipped 3 previous similar messages [1115977.942752] Lustre: fir-OST009f: haven't heard from client 1e3900b8-ca7e-455e-a0a1-4c8617fa3d4a (at 10.51.12.6@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e41d6339c00, cur 1707924079 expire 1707923929 last 1707923852 [1115977.964824] Lustre: Skipped 3 previous similar messages [1116433.938668] Lustre: fir-OST009d: haven't heard from client 072b7b33-8b57-42c4-932d-5caf2133e9d9 (at 10.51.2.7@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dff74f33000, cur 1707924535 expire 1707924385 last 1707924308 [1116433.960454] Lustre: Skipped 3 previous similar messages [1116451.921400] Lustre: fir-OST009b: haven't heard from client 072b7b33-8b57-42c4-932d-5caf2133e9d9 (at 10.51.2.7@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dff74f36000, cur 1707924553 expire 1707924403 last 1707924326 [1117195.877539] Lustre: fir-OST009d: haven't heard from client f74b9639-c49a-405a-8ada-93c063042a81 (at 10.51.4.70@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f2e6ac00, cur 1707925297 expire 1707925147 last 1707925070 [1117195.899728] Lustre: Skipped 2 previous similar messages [1118208.823578] Lustre: fir-OST009b: haven't heard from client fff1972e-4767-4d05-8ed0-d227e6776901 (at 10.51.7.25@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e41d66bfc00, cur 1707926310 expire 1707926160 last 1707926083 [1118208.845448] Lustre: Skipped 3 previous similar messages [1119187.776909] Lustre: fir-OST009b: haven't heard from client caa48e0f-0525-4862-9e15-551c4f95fec3 (at 10.51.10.33@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df97f225c00, cur 1707927289 expire 1707927139 last 1707927062 [1119187.798866] Lustre: Skipped 3 previous similar messages [1119195.773822] Lustre: fir-OST009d: haven't heard from client caa48e0f-0525-4862-9e15-551c4f95fec3 (at 10.51.10.33@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df3b870dc00, cur 1707927297 expire 1707927147 last 1707927070 [1119200.770864] Lustre: fir-OST0099: haven't heard from client caa48e0f-0525-4862-9e15-551c4f95fec3 (at 10.51.10.33@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e03b71d7400, cur 1707927302 expire 1707927152 last 1707927075 [1119200.792824] Lustre: Skipped 1 previous similar message [1119918.730991] Lustre: fir-OST0099: haven't heard from client 5dc08fa5-e36a-48bd-a28c-4430adbdb73a (at 10.51.12.8@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33cbe84400, cur 1707928020 expire 1707927870 last 1707927793 [1119925.732959] Lustre: fir-OST009b: haven't heard from client 5dc08fa5-e36a-48bd-a28c-4430adbdb73a (at 10.51.12.8@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e2f731ae800, cur 1707928027 expire 1707927877 last 1707927800 [1119925.754835] Lustre: Skipped 1 previous similar message [1123268.552117] Lustre: fir-OST009f: haven't heard from client 64a523a6-c9f6-45c2-944b-6e9759eaed31 (at 10.51.8.34@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e2f4c26c000, cur 1707931370 expire 1707931220 last 1707931143 [1123268.573991] Lustre: Skipped 1 previous similar message [1123275.551150] Lustre: fir-OST0099: haven't heard from client 64a523a6-c9f6-45c2-944b-6e9759eaed31 (at 10.51.8.34@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e2f4c268c00, cur 1707931377 expire 1707931227 last 1707931150 [1124956.460322] Lustre: fir-OST009f: haven't heard from client ee5e8a7e-4e96-4a38-a4f6-5ce9516f58ad (at 10.51.5.8@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e0008b98c00, cur 1707933058 expire 1707932908 last 1707932831 [1124956.482110] Lustre: Skipped 2 previous similar messages [1125144.450506] Lustre: fir-OST0099: haven't heard from client d74c7c08-3ad8-4793-b564-01a844073c1c (at 10.51.2.38@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e2f42c3d000, cur 1707933246 expire 1707933096 last 1707933019 [1125144.472375] Lustre: Skipped 11 previous similar messages [1125569.428015] Lustre: fir-OST009b: haven't heard from client 81f11a26-fdc2-42de-ae39-76de4d53e32b (at 10.50.5.71@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e42c7e36c00, cur 1707933671 expire 1707933521 last 1707933444 [1125569.450066] Lustre: Skipped 15 previous similar messages [1126176.405447] Lustre: fir-OST0099: haven't heard from client a38a37bc-6479-4a00-af37-371e70ff0309 (at 10.51.6.62@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33d1f23400, cur 1707934278 expire 1707934128 last 1707934051 [1126176.427321] Lustre: Skipped 35 previous similar messages [1126182.407801] Lustre: fir-OST009b: haven't heard from client a38a37bc-6479-4a00-af37-371e70ff0309 (at 10.51.6.62@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e2f60db5c00, cur 1707934284 expire 1707934134 last 1707934057 [1126196.394985] Lustre: fir-OST009f: haven't heard from client a38a37bc-6479-4a00-af37-371e70ff0309 (at 10.51.6.62@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e2f6249ec00, cur 1707934298 expire 1707934148 last 1707934071 [1129103.245574] Lustre: fir-OST009f: haven't heard from client a9bcac21-8c33-4ae9-a4b3-b888ee45867c (at 10.51.17.6@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e00895f4c00, cur 1707937205 expire 1707937055 last 1707936978 [1129103.267834] Lustre: Skipped 1 previous similar message [1129121.237132] Lustre: fir-OST009b: haven't heard from client a9bcac21-8c33-4ae9-a4b3-b888ee45867c (at 10.51.17.6@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df3093b7400, cur 1707937223 expire 1707937073 last 1707936996 [1130404.176274] Lustre: fir-OST009b: haven't heard from client 3b3e744f-8c49-4067-8906-9d651684446d (at 10.50.17.19@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33d4e91400, cur 1707938506 expire 1707938356 last 1707938279 [1130404.198233] Lustre: Skipped 2 previous similar messages [1130411.167907] Lustre: fir-OST0099: haven't heard from client 3b3e744f-8c49-4067-8906-9d651684446d (at 10.50.17.19@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e2f25541c00, cur 1707938513 expire 1707938363 last 1707938286 [1130411.190000] Lustre: Skipped 1 previous similar message [1131132.129374] Lustre: fir-OST009b: haven't heard from client 9d6ae242-8014-4077-b810-4b4b0465358a (at 10.51.7.5@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e4362ea4000, cur 1707939234 expire 1707939084 last 1707939007 [1131132.151285] Lustre: Skipped 1 previous similar message [1132701.047856] Lustre: fir-OST009f: haven't heard from client 3c080bfb-e5e9-480d-b394-f8b5e11be752 (at 10.51.5.32@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e000b130000, cur 1707940803 expire 1707940653 last 1707940576 [1132701.069734] Lustre: Skipped 3 previous similar messages [1134628.941316] Lustre: fir-OST009f: haven't heard from client 12fc3829-260b-42de-8095-d44b3682eac2 (at 10.51.9.20@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e0138628000, cur 1707942731 expire 1707942581 last 1707942504 [1134628.963187] Lustre: Skipped 3 previous similar messages [1134631.949958] Lustre: fir-OST009d: haven't heard from client 067bfd11-e994-4af8-95d8-4992dad76a9c (at 10.51.9.9@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33ce9a3800, cur 1707942734 expire 1707942584 last 1707942507 [1134631.971737] Lustre: Skipped 3 previous similar messages [1134636.941854] Lustre: fir-OST0099: haven't heard from client 12fc3829-260b-42de-8095-d44b3682eac2 (at 10.51.9.20@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01d1917c00, cur 1707942739 expire 1707942589 last 1707942512 [1134636.963727] Lustre: Skipped 3 previous similar messages [1134640.940672] Lustre: fir-OST009b: haven't heard from client 44d6a72c-a12a-40cd-bd2d-2e60833f6518 (at 10.51.9.10@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e0250b28400, cur 1707942743 expire 1707942593 last 1707942516 [1134640.962547] Lustre: Skipped 3 previous similar messages [1136120.861626] Lustre: fir-OST009b: haven't heard from client 6aa843d6-9c0a-4a6e-b55b-23300460932d (at 10.51.8.25@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dff794adc00, cur 1707944223 expire 1707944073 last 1707943996 [1136120.883662] Lustre: Skipped 3 previous similar messages [1136196.857976] Lustre: fir-OST0099: haven't heard from client 82cdaa1a-f981-412d-a9d9-59ffac436099 (at 10.51.17.18@o2ib3) in 203 seconds. I think it's dead, and I am evicting it. exp ffff9e33b8b25800, cur 1707944299 expire 1707944149 last 1707944096 [1136196.880639] Lustre: Skipped 7 previous similar messages [1136220.858328] Lustre: fir-OST009d: haven't heard from client 82cdaa1a-f981-412d-a9d9-59ffac436099 (at 10.51.17.18@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df99bacb000, cur 1707944323 expire 1707944173 last 1707944096 [1136220.880738] Lustre: Skipped 2 previous similar messages [1137576.787737] Lustre: fir-OST009b: haven't heard from client 78eb81b6-ade1-49b8-b07a-620afd1476f5 (at 10.50.2.30@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e40de98f400, cur 1707945679 expire 1707945529 last 1707945452 [1137941.764721] Lustre: fir-OST009f: haven't heard from client a4cdf81d-c03f-4cb8-a6ad-5c26db538e43 (at 10.50.6.13@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df970579400, cur 1707946044 expire 1707945894 last 1707945817 [1137941.786732] Lustre: Skipped 3 previous similar messages [1137948.765443] Lustre: fir-OST009b: haven't heard from client a4cdf81d-c03f-4cb8-a6ad-5c26db538e43 (at 10.50.6.13@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e0080e6e000, cur 1707946051 expire 1707945901 last 1707945824 [1137948.787317] Lustre: Skipped 1 previous similar message [1137954.770678] Lustre: fir-OST009d: haven't heard from client 517995fd-be20-4425-bc02-82b0c15dcf0f (at 10.50.16.10@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e41c6150400, cur 1707946057 expire 1707945907 last 1707945830 [1137954.792812] Lustre: Skipped 1 previous similar message [1138338.743368] Lustre: fir-OST009b: haven't heard from client 619bf2fb-a050-4c62-918a-356a76451b4e (at 10.50.2.33@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df9783d5800, cur 1707946441 expire 1707946291 last 1707946214 [1138338.765237] Lustre: Skipped 3 previous similar messages [1138723.722847] Lustre: fir-OST009f: haven't heard from client 2e0cdf45-a02e-4a31-9b43-635b37cba4ee (at 10.50.5.71@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e420f3f8400, cur 1707946826 expire 1707946676 last 1707946599 [1138723.744835] Lustre: Skipped 11 previous similar messages [1139990.655160] Lustre: fir-OST009f: haven't heard from client 81995345-4c99-4daf-92fa-eed05318caa9 (at 10.51.17.8@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df315241800, cur 1707948093 expire 1707947943 last 1707947866 [1139990.677027] Lustre: Skipped 3 previous similar messages [1141120.595635] Lustre: fir-OST009f: haven't heard from client d9ac1544-a973-47cf-b06c-17df3278027d (at 10.51.6.60@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e2f617eac00, cur 1707949223 expire 1707949073 last 1707948996 [1141120.617513] Lustre: Skipped 7 previous similar messages [1141128.596281] Lustre: fir-OST009d: haven't heard from client d9ac1544-a973-47cf-b06c-17df3278027d (at 10.51.6.60@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e2f610d0400, cur 1707949231 expire 1707949081 last 1707949004 [1141128.618155] Lustre: Skipped 2 previous similar messages [1142836.505973] Lustre: fir-OST0099: haven't heard from client d9e57149-c9bc-4e8f-8183-3581cf544a91 (at 10.51.1.23@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e40e1656000, cur 1707950939 expire 1707950789 last 1707950712 [1142844.507615] Lustre: fir-OST009b: haven't heard from client d9e57149-c9bc-4e8f-8183-3581cf544a91 (at 10.51.1.23@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e2fe987b400, cur 1707950947 expire 1707950797 last 1707950720 [1142844.529617] Lustre: Skipped 1 previous similar message [1142856.504789] Lustre: fir-OST009d: haven't heard from client d9e57149-c9bc-4e8f-8183-3581cf544a91 (at 10.51.1.23@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e43abef0800, cur 1707950959 expire 1707950809 last 1707950732 [1145022.386068] Lustre: fir-OST0099: haven't heard from client 53c9ec98-ec4c-4ebf-bf87-2d7151ac1d32 (at 10.51.16.16@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02ee5dbc00, cur 1707953125 expire 1707952975 last 1707952898 [1145036.386481] Lustre: fir-OST009f: haven't heard from client 53c9ec98-ec4c-4ebf-bf87-2d7151ac1d32 (at 10.51.16.16@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f2029c00, cur 1707953139 expire 1707952989 last 1707952912 [1145036.408582] Lustre: Skipped 1 previous similar message [1147264.265556] Lustre: fir-OST009b: haven't heard from client 82414d83-3673-4995-a111-ba840a9557ec (at 10.51.16.6@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33c186a400, cur 1707955367 expire 1707955217 last 1707955140 [1147264.287432] Lustre: Skipped 1 previous similar message [1147269.276387] Lustre: fir-OST009d: haven't heard from client 82414d83-3673-4995-a111-ba840a9557ec (at 10.51.16.6@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e42c7adc800, cur 1707955372 expire 1707955222 last 1707955145 [1147274.265021] Lustre: fir-OST009f: haven't heard from client 82414d83-3673-4995-a111-ba840a9557ec (at 10.51.16.6@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e42c7ade400, cur 1707955377 expire 1707955227 last 1707955150 [1147749.239489] Lustre: fir-OST009b: haven't heard from client dcd201bd-0666-49f9-9f85-c5fde2216a80 (at 10.50.2.30@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3e8c288400, cur 1707955852 expire 1707955702 last 1707955625 [1147749.261370] Lustre: Skipped 1 previous similar message [1148196.218641] Lustre: fir-OST009f: haven't heard from client a91abe38-f114-423e-b728-1901ca6c23d3 (at 10.51.11.1@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e38df24b000, cur 1707956299 expire 1707956149 last 1707956072 [1148196.240784] Lustre: Skipped 11 previous similar messages [1148208.236184] Lustre: fir-OST009b: haven't heard from client a91abe38-f114-423e-b728-1901ca6c23d3 (at 10.51.11.1@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3fe3117800, cur 1707956311 expire 1707956161 last 1707956084 [1148208.258281] Lustre: Skipped 1 previous similar message [1149079.166821] Lustre: fir-OST0099: haven't heard from client 397e133b-d550-4900-a1c6-7fd337d29003 (at 10.50.3.16@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df992f65800, cur 1707957182 expire 1707957032 last 1707956955 [1149079.188991] Lustre: Skipped 1 previous similar message [1150530.090077] Lustre: fir-OST009f: haven't heard from client e83f24e6-9d78-4f21-b3bf-fbbe183fdfb8 (at 10.50.14.11@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df3bb682400, cur 1707958633 expire 1707958483 last 1707958406 [1150530.112039] Lustre: Skipped 7 previous similar messages [1150540.090883] Lustre: fir-OST009b: haven't heard from client e83f24e6-9d78-4f21-b3bf-fbbe183fdfb8 (at 10.50.14.11@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df3b28c1c00, cur 1707958643 expire 1707958493 last 1707958416 [1150540.113149] Lustre: Skipped 1 previous similar message [1150606.088169] Lustre: fir-OST009f: haven't heard from client e67f57a9-cb6b-4bb4-af90-a281e3b1dfa2 (at 10.51.13.12@o2ib3) in 226 seconds. I think it's dead, and I am evicting it. exp ffff9dff79522000, cur 1707958709 expire 1707958559 last 1707958483 [1150606.110262] Lustre: Skipped 2 previous similar messages [1150616.094140] Lustre: fir-OST009b: haven't heard from client e67f57a9-cb6b-4bb4-af90-a281e3b1dfa2 (at 10.51.13.12@o2ib3) in 217 seconds. I think it's dead, and I am evicting it. exp ffff9e013dc21800, cur 1707958719 expire 1707958569 last 1707958502 [1150616.116380] Lustre: Skipped 1 previous similar message [1151701.027311] Lustre: fir-OST009b: haven't heard from client 85cbbcbe-68bc-438f-99f8-3243239733da (at 10.51.13.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01c4a07800, cur 1707959804 expire 1707959654 last 1707959577 [1153324.941395] Lustre: fir-OST009b: haven't heard from client 9021387d-017b-400b-959f-badccf1ef860 (at 10.51.6.2@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e2f60d48c00, cur 1707961428 expire 1707961278 last 1707961201 [1153324.963514] Lustre: Skipped 3 previous similar messages [1153343.944877] Lustre: fir-OST009f: haven't heard from client 9021387d-017b-400b-959f-badccf1ef860 (at 10.51.6.2@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e2f43cc6800, cur 1707961447 expire 1707961297 last 1707961220 [1153343.966683] Lustre: Skipped 2 previous similar messages [1158105.686252] Lustre: fir-OST009b: haven't heard from client c5491798-b189-4f3e-bf15-69456ff9bcde (at 10.51.15.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df34ff80800, cur 1707966209 expire 1707966059 last 1707965982 [1162702.448979] Lustre: fir-OST009d: haven't heard from client 5f0d6741-551d-4b70-9f9e-c249fc112b35 (at 10.51.15.1@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e41f99b8c00, cur 1707970806 expire 1707970656 last 1707970579 [1162702.470855] Lustre: Skipped 3 previous similar messages [1162705.436047] Lustre: fir-OST009f: haven't heard from client 5f0d6741-551d-4b70-9f9e-c249fc112b35 (at 10.51.15.1@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3ea6f9f000, cur 1707970809 expire 1707970659 last 1707970582 [1162715.437728] Lustre: fir-OST0099: haven't heard from client 5f0d6741-551d-4b70-9f9e-c249fc112b35 (at 10.51.15.1@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e40b298fc00, cur 1707970819 expire 1707970669 last 1707970592 [1162715.459611] Lustre: Skipped 1 previous similar message [1168813.102517] Lustre: fir-OST009b: haven't heard from client 21426ede-0c18-485a-8b6b-477fc289c846 (at 10.51.7.6@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e022a30f400, cur 1707976917 expire 1707976767 last 1707976690 [1172228.914890] Lustre: fir-OST0099: haven't heard from client 828af271-cdca-4f2c-9dba-81200d25826f (at 10.50.15.13@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02ee723c00, cur 1707980333 expire 1707980183 last 1707980106 [1172228.937114] Lustre: Skipped 3 previous similar messages [1172235.916866] Lustre: fir-OST009b: haven't heard from client 828af271-cdca-4f2c-9dba-81200d25826f (at 10.50.15.13@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e42dfe37c00, cur 1707980340 expire 1707980190 last 1707980113 [1172240.916634] Lustre: fir-OST009d: haven't heard from client 828af271-cdca-4f2c-9dba-81200d25826f (at 10.50.15.13@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f269c400, cur 1707980345 expire 1707980195 last 1707980118 [1173234.859688] Lustre: fir-OST009d: haven't heard from client 8b98d2f0-f2aa-49b9-8222-660d30575848 (at 10.51.7.22@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01c4a03000, cur 1707981339 expire 1707981189 last 1707981112 [1173234.881559] Lustre: Skipped 1 previous similar message [1180905.443227] Lustre: fir-OST0099: haven't heard from client 05ac142c-faa1-43b6-a469-2d34dfed6c4d (at 10.51.8.5@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01f649dc00, cur 1707989010 expire 1707988860 last 1707988783 [1180905.465009] Lustre: Skipped 3 previous similar messages [1180910.445900] Lustre: fir-OST009d: haven't heard from client 05ac142c-faa1-43b6-a469-2d34dfed6c4d (at 10.51.8.5@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df98f957400, cur 1707989015 expire 1707988865 last 1707988788 [1180917.448515] Lustre: fir-OST009f: haven't heard from client 05ac142c-faa1-43b6-a469-2d34dfed6c4d (at 10.51.8.5@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e0143afe000, cur 1707989022 expire 1707988872 last 1707988795 [1180917.470300] Lustre: Skipped 1 previous similar message [1182586.351889] Lustre: fir-OST009b: haven't heard from client 3c0a1922-04a1-4f9c-8de2-bce1732a0ff0 (at 10.50.16.8@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e413b37ec00, cur 1707990691 expire 1707990541 last 1707990464 [1182604.352373] Lustre: fir-OST0099: haven't heard from client 3c0a1922-04a1-4f9c-8de2-bce1732a0ff0 (at 10.50.16.8@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e420972a400, cur 1707990709 expire 1707990559 last 1707990482 [1182604.374475] Lustre: Skipped 1 previous similar message [1186587.144432] Lustre: fir-OST009f: haven't heard from client 2fc35970-40c2-4824-9403-dd2cba7141d8 (at 10.50.5.15@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e41d805f400, cur 1707994692 expire 1707994542 last 1707994465 [1186587.166302] Lustre: Skipped 1 previous similar message [1187272.097852] Lustre: fir-OST009f: haven't heard from client 341f0980-0816-4d16-bbe3-fe794d9e70e8 (at 10.51.12.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33ba7e5000, cur 1707995377 expire 1707995227 last 1707995150 [1187272.119721] Lustre: Skipped 1 previous similar message [1187538.092495] Lustre: fir-OST0099: haven't heard from client 575187f6-9266-4da8-84de-b60191a4582d (at 10.51.2.31@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df3b2834800, cur 1707995643 expire 1707995493 last 1707995416 [1187538.114369] Lustre: Skipped 3 previous similar messages [1187888.066929] Lustre: fir-OST009d: haven't heard from client f15f004e-f83b-4a3b-936b-f432568d1937 (at 10.51.12.7@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df3b654a800, cur 1707995993 expire 1707995843 last 1707995766 [1187901.063905] Lustre: fir-OST009f: haven't heard from client f15f004e-f83b-4a3b-936b-f432568d1937 (at 10.51.12.7@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df3c3de2400, cur 1707996006 expire 1707995856 last 1707995779 [1196097.622561] Lustre: fir-OST0099: haven't heard from client 542dc0ae-2bcc-4caa-a7af-902685cd3376 (at 10.51.6.32@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e41dce08800, cur 1708004203 expire 1708004053 last 1708003976 [1196097.644564] Lustre: Skipped 2 previous similar messages [1196104.619672] Lustre: fir-OST009d: haven't heard from client 542dc0ae-2bcc-4caa-a7af-902685cd3376 (at 10.51.6.32@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33caf5fc00, cur 1708004210 expire 1708004060 last 1708003983 [1200332.410237] Lustre: fir-OST009b: haven't heard from client f6403856-cc73-4c16-b6c8-af7780a11925 (at 10.51.14.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e42e238ec00, cur 1708008438 expire 1708008288 last 1708008211 [1200332.432115] Lustre: Skipped 2 previous similar messages [1200339.396381] Lustre: fir-OST0099: haven't heard from client f6403856-cc73-4c16-b6c8-af7780a11925 (at 10.51.14.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02ee42a000, cur 1708008445 expire 1708008295 last 1708008218 [1200339.418253] Lustre: Skipped 1 previous similar message [1201138.357312] Lustre: fir-OST009f: haven't heard from client 63ba8a0a-c5ec-4ce5-af3c-c84eb60cd52f (at 10.51.2.25@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df3c0cbd800, cur 1708009244 expire 1708009094 last 1708009017 [1201138.379183] Lustre: Skipped 1 previous similar message [1205322.122075] Lustre: fir-OST0099: haven't heard from client 79f60f82-fa6a-4553-989c-94f7df4a4f99 (at 10.50.6.12@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e40b2ac0c00, cur 1708013428 expire 1708013278 last 1708013201 [1210853.823197] Lustre: fir-OST009f: haven't heard from client adefdf52-8e13-4f95-84eb-0b2b127399a7 (at 10.51.5.37@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33bdefc400, cur 1708018960 expire 1708018810 last 1708018733 [1210853.845332] Lustre: Skipped 3 previous similar messages [1210859.822907] Lustre: fir-OST0099: haven't heard from client adefdf52-8e13-4f95-84eb-0b2b127399a7 (at 10.51.5.37@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e421fad6c00, cur 1708018966 expire 1708018816 last 1708018739 [1210859.845005] Lustre: Skipped 1 previous similar message [1211065.814193] Lustre: fir-OST0099: haven't heard from client 71ed79eb-045f-438c-89eb-7b0bcd0e6957 (at 10.51.2.50@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e420f9fa000, cur 1708019172 expire 1708019022 last 1708018945 [1211065.836060] Lustre: Skipped 1 previous similar message [1211243.805028] Lustre: fir-OST009d: haven't heard from client beb4d29d-78ef-49eb-975a-cd4a758ea942 (at 10.51.5.62@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01fcf67c00, cur 1708019350 expire 1708019200 last 1708019123 [1211243.826905] Lustre: Skipped 3 previous similar messages [1211249.801717] Lustre: fir-OST0099: haven't heard from client b677c06a-d241-4803-85dd-204af9c97639 (at 10.51.5.66@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df995fda400, cur 1708019356 expire 1708019206 last 1708019129 [1211249.823764] Lustre: Skipped 1 previous similar message [1211319.797988] Lustre: fir-OST009d: haven't heard from client 3e16afae-06c2-4389-9f75-1d0adb3b1060 (at 10.51.16.7@o2ib3) in 175 seconds. I think it's dead, and I am evicting it. exp ffff9dff73c1cc00, cur 1708019426 expire 1708019276 last 1708019251 [1211319.819899] Lustre: Skipped 5 previous similar messages [1214879.605122] Lustre: fir-OST009b: haven't heard from client 7b8a8f8d-2856-4c8b-9a3b-c3d168142eb7 (at 10.51.17.6@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e020fc05800, cur 1708022986 expire 1708022836 last 1708022759 [1214879.627701] Lustre: Skipped 3 previous similar messages [1217633.483301] Lustre: fir-OST009f: haven't heard from client 2d68d22e-1e8d-4935-9157-a0f88aaf67ea (at 10.51.6.15@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df3b5eee000, cur 1708025740 expire 1708025590 last 1708025513 [1217633.505174] Lustre: Skipped 3 previous similar messages [1217649.461481] Lustre: fir-OST0099: haven't heard from client 2d68d22e-1e8d-4935-9157-a0f88aaf67ea (at 10.51.6.15@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e008a26f400, cur 1708025756 expire 1708025606 last 1708025529 [1221165.274112] Lustre: fir-OST009d: haven't heard from client c1e576f9-d242-4c96-87ac-f6971fab18f9 (at 10.51.2.68@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3973dcf400, cur 1708029272 expire 1708029122 last 1708029045 [1221165.295983] Lustre: Skipped 2 previous similar messages [1221172.267053] Lustre: fir-OST009f: haven't heard from client c1e576f9-d242-4c96-87ac-f6971fab18f9 (at 10.51.2.68@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3e8c26f400, cur 1708029279 expire 1708029129 last 1708029052 [1222781.179798] Lustre: fir-OST009d: haven't heard from client 27f1889a-2391-4ebf-bfaf-d7139a474e4f (at 10.51.2.6@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f3178c00, cur 1708030888 expire 1708030738 last 1708030661 [1222781.201580] Lustre: Skipped 2 previous similar messages [1223061.165419] Lustre: fir-OST009f: haven't heard from client 0378909a-e662-44bb-8509-d9fa809f2e1e (at 10.51.10.52@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f276a000, cur 1708031168 expire 1708031018 last 1708030941 [1223061.187378] Lustre: Skipped 3 previous similar messages [1223064.164446] Lustre: fir-OST009d: haven't heard from client 0378909a-e662-44bb-8509-d9fa809f2e1e (at 10.51.10.52@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f1b54c00, cur 1708031171 expire 1708031021 last 1708030944 [1229582.816508] Lustre: fir-OST009f: haven't heard from client 96d69575-e7f8-4161-bf91-cd12d0e2d68b (at 10.51.8.11@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e0008a7bc00, cur 1708037690 expire 1708037540 last 1708037463 [1229582.838373] Lustre: Skipped 2 previous similar messages [1231475.710849] Lustre: fir-OST0099: haven't heard from client 88666fa9-e95a-4483-a5fd-387e59c89b54 (at 10.50.8.44@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e41d81b0c00, cur 1708039583 expire 1708039433 last 1708039356 [1231475.732726] Lustre: Skipped 11 previous similar messages [1235866.408973] Lustre: 47156:0:(client.c:2295:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1708043845/real 1708043845] req@ffff9def63b1f080 x1789746795312704/t0(0) o106->fir-OST009d@10.50.8.63@o2ib2:15/16 lens 328/280 e 0 to 1 dl 1708043973 ref 1 fl Rpc:XQr/0/ffffffff rc 0/-1 job:'' [1235938.731041] Lustre: ll_ost01_098: service thread pid 47156 was inactive for 200.328 seconds. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes: [1235938.750379] Pid: 47156, comm: ll_ost01_098 3.10.0-1160.108.1.el7_lustre.pl1.x86_64 #1 SMP Fri Jan 26 11:26:38 PST 2024 [1235938.761242] Call Trace: [1235938.763912] [<0>] ptlrpc_set_wait+0x7b7/0x840 [ptlrpc] [1235938.769239] [<0>] ldlm_run_ast_work+0xd5/0x3e0 [ptlrpc] [1235938.774664] [<0>] ldlm_glimpse_locks+0x38/0x110 [ptlrpc] [1235938.780155] [<0>] ofd_intent_policy+0x78b/0xa50 [ofd] [1235938.785399] [<0>] ldlm_lock_enqueue+0x3d5/0xb60 [ptlrpc] [1235938.790911] [<0>] ldlm_handle_enqueue0+0x8d6/0x1770 [ptlrpc] [1235938.796770] [<0>] tgt_enqueue+0x64/0x250 [ptlrpc] [1235938.801664] [<0>] tgt_request_handle+0x93f/0x19d0 [ptlrpc] [1235938.807343] [<0>] ptlrpc_server_handle_request+0x253/0xc30 [ptlrpc] [1235938.813796] [<0>] ptlrpc_main+0xbf4/0x15e0 [ptlrpc] [1235938.818845] [<0>] kthread+0xd1/0xe0 [1235938.822516] [<0>] ret_from_fork_nospec_begin+0x7/0x21 [1235938.827779] [<0>] 0xfffffffffffffffe [1235941.468121] Lustre: fir-OST009f: haven't heard from client 73ed04f7-76f0-4e27-86c0-cf0934b143ce (at 10.50.8.63@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02edf92800, cur 1708044049 expire 1708043899 last 1708043822 [1235941.490195] Lustre: Skipped 7 previous similar messages [1235946.467632] Lustre: fir-OST0099: haven't heard from client 73ed04f7-76f0-4e27-86c0-cf0934b143ce (at 10.50.8.63@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02ee189000, cur 1708044054 expire 1708043904 last 1708043827 [1235946.489861] Lustre: Skipped 2 previous similar messages [1238324.338240] Lustre: fir-OST009d: haven't heard from client b84856f1-9c68-445d-9f0d-b92a4ed3d080 (at 10.51.12.1@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01f6550400, cur 1708046432 expire 1708046282 last 1708046205 [1238337.337824] Lustre: fir-OST009f: haven't heard from client b84856f1-9c68-445d-9f0d-b92a4ed3d080 (at 10.51.12.1@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01efcf5000, cur 1708046445 expire 1708046295 last 1708046218 [1238337.359692] Lustre: Skipped 2 previous similar messages [1240213.235598] Lustre: fir-OST009f: haven't heard from client f813587a-da9f-4eed-9781-d411fe10bf8c (at 10.50.8.63@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01d19a0400, cur 1708048321 expire 1708048171 last 1708048094 [1240289.231368] Lustre: fir-OST009d: haven't heard from client ff6da5ba-9361-4199-bae5-62f7825f499d (at 10.50.9.57@o2ib2) in 217 seconds. I think it's dead, and I am evicting it. exp ffff9e02f317e400, cur 1708048397 expire 1708048247 last 1708048180 [1240289.253233] Lustre: Skipped 9 previous similar messages [1240365.227391] Lustre: fir-OST009f: haven't heard from client af258b33-8baf-4250-9640-39b39f6b9a9e (at 10.51.2.45@o2ib3) in 208 seconds. I think it's dead, and I am evicting it. exp ffff9df973c94400, cur 1708048473 expire 1708048323 last 1708048265 [1240365.249264] Lustre: Skipped 13 previous similar messages [1240441.222992] Lustre: fir-OST009b: haven't heard from client e51d5721-3850-47ac-996f-ee73ec6b0a92 (at 10.51.4.7@o2ib3) in 215 seconds. I think it's dead, and I am evicting it. exp ffff9df9668f4c00, cur 1708048549 expire 1708048399 last 1708048334 [1240441.244788] Lustre: Skipped 15 previous similar messages [1240517.219138] Lustre: fir-OST0099: haven't heard from client 0b7d5cba-3e43-42d7-9136-80c826bfafa7 (at 10.51.10.46@o2ib3) in 154 seconds. I think it's dead, and I am evicting it. exp ffff9e33c188e800, cur 1708048625 expire 1708048475 last 1708048471 [1240517.241411] Lustre: Skipped 15 previous similar messages [1240600.220699] Lustre: fir-OST009f: haven't heard from client 0b7d5cba-3e43-42d7-9136-80c826bfafa7 (at 10.51.10.46@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3eb3251400, cur 1708048708 expire 1708048558 last 1708048481 [1240600.242670] Lustre: Skipped 2 previous similar messages [1240676.210934] Lustre: fir-OST009f: haven't heard from client 0c00746c-6bb5-4730-9572-4e8c0993c635 (at 10.51.2.68@o2ib3) in 218 seconds. I think it's dead, and I am evicting it. exp ffff9e2f63f2ec00, cur 1708048784 expire 1708048634 last 1708048566 [1240752.231682] Lustre: fir-OST009f: haven't heard from client 67af3556-9aa4-4d43-ace9-177b666de159 (at 10.51.6.12@o2ib3) in 195 seconds. I think it's dead, and I am evicting it. exp ffff9e33d3665000, cur 1708048860 expire 1708048710 last 1708048665 [1240752.253552] Lustre: Skipped 11 previous similar messages [1240828.202332] Lustre: fir-OST009f: haven't heard from client a73d9adc-92f7-41a2-869a-4465bec517b8 (at 10.51.10.1@o2ib3) in 225 seconds. I think it's dead, and I am evicting it. exp ffff9dff6ffd3c00, cur 1708048936 expire 1708048786 last 1708048711 [1240828.224314] Lustre: Skipped 24 previous similar messages [1240975.197183] Lustre: fir-OST009b: haven't heard from client 735ca276-b8b2-48d2-b336-8771c536969e (at 10.51.9.27@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33cadd6400, cur 1708049083 expire 1708048933 last 1708048856 [1240975.219680] Lustre: Skipped 2 previous similar messages [1241302.176536] Lustre: fir-OST009d: haven't heard from client f1effc0f-f7fb-49a7-a3b1-8906dd71f541 (at 10.51.2.42@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e414ced2400, cur 1708049410 expire 1708049260 last 1708049183 [1241302.198409] Lustre: Skipped 11 previous similar messages [1241920.142773] Lustre: fir-OST009b: haven't heard from client 62f66021-6bfe-4ad7-9617-f796e80632eb (at 10.51.10.13@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df991625400, cur 1708050028 expire 1708049878 last 1708049801 [1241920.164741] Lustre: Skipped 26 previous similar messages [1243048.081301] Lustre: fir-OST009d: haven't heard from client 822a0ace-e9d0-4f19-b3da-cd8bb80aa108 (at 10.51.4.39@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e0090438c00, cur 1708051156 expire 1708051006 last 1708050929 [1243048.103351] Lustre: Skipped 6 previous similar messages [1244623.995714] Lustre: fir-OST009f: haven't heard from client 7c536b64-7fc5-42c9-8cb0-685293358b2a (at 10.51.1.30@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01c76b4800, cur 1708052732 expire 1708052582 last 1708052505 [1244624.017579] Lustre: Skipped 39 previous similar messages [1245626.946206] Lustre: fir-OST009d: haven't heard from client 7316fe58-bfdb-4215-96d0-99a03fd2e483 (at 10.51.1.37@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33c9d13400, cur 1708053735 expire 1708053585 last 1708053508 [1245626.968118] Lustre: Skipped 3 previous similar messages [1245887.929555] Lustre: fir-OST009d: haven't heard from client e6af1516-fc75-417f-a1a8-b726e41ee5a2 (at 10.51.8.42@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f1a4a000, cur 1708053996 expire 1708053846 last 1708053769 [1245887.951424] Lustre: Skipped 3 previous similar messages [1246405.897681] Lustre: fir-OST009b: haven't heard from client c74c3162-6437-42e8-bbd4-3d519a480e23 (at 10.50.8.40@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e330225e000, cur 1708054514 expire 1708054364 last 1708054287 [1246405.919549] Lustre: Skipped 3 previous similar messages [1246572.888632] Lustre: fir-OST009b: haven't heard from client 13f67666-37cb-4063-9d6b-6f056338c757 (at 10.51.1.53@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e2f51683400, cur 1708054681 expire 1708054531 last 1708054454 [1246572.910624] Lustre: Skipped 3 previous similar messages [1247056.864208] Lustre: fir-OST0099: haven't heard from client 2e9b64d7-d786-4dbd-ac29-37c730406f5c (at 10.51.1.66@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e009008a000, cur 1708055165 expire 1708055015 last 1708054938 [1247056.886081] Lustre: Skipped 3 previous similar messages [1247418.844240] Lustre: fir-OST009b: haven't heard from client 9596fdc5-706b-4a94-8e31-d4c40cbaf771 (at 10.50.9.11@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3e8cac9800, cur 1708055527 expire 1708055377 last 1708055300 [1247418.866112] Lustre: Skipped 13 previous similar messages [1248940.773520] Lustre: fir-OST009f: haven't heard from client 3042eeb9-72d9-4620-a42d-62e2b57ecbbf (at 10.51.14.12@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e2f21170800, cur 1708057049 expire 1708056899 last 1708056822 [1248940.795479] Lustre: Skipped 3 previous similar messages [1250370.683831] Lustre: fir-OST009d: haven't heard from client 4027084e-bfda-4ee6-87c2-8af04d9ccb26 (at 10.51.6.40@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33baf39c00, cur 1708058479 expire 1708058329 last 1708058252 [1250370.705709] Lustre: Skipped 3 previous similar messages [1250375.681899] Lustre: fir-OST0099: haven't heard from client 4027084e-bfda-4ee6-87c2-8af04d9ccb26 (at 10.51.6.40@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33dae8ac00, cur 1708058484 expire 1708058334 last 1708058257 [1250385.681356] Lustre: fir-OST009f: haven't heard from client 4027084e-bfda-4ee6-87c2-8af04d9ccb26 (at 10.51.6.40@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e40c3b75000, cur 1708058494 expire 1708058344 last 1708058267 [1250385.703441] Lustre: Skipped 1 previous similar message [1250563.671289] Lustre: fir-OST009f: haven't heard from client e44dbfd9-f057-4fd9-9b73-0336125b9e62 (at 10.51.2.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3fca5f0c00, cur 1708058672 expire 1708058522 last 1708058445 [1250896.653432] Lustre: fir-OST009f: haven't heard from client 74acb482-b22e-419b-9aa3-b7bffc4920b1 (at 10.51.6.68@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33cf4bc000, cur 1708059005 expire 1708058855 last 1708058778 [1250896.675434] Lustre: Skipped 3 previous similar messages [1250972.660365] Lustre: fir-OST009f: haven't heard from client b78a0c89-32b7-4063-a3d7-d14461dd9b4c (at 10.51.8.1@o2ib3) in 215 seconds. I think it's dead, and I am evicting it. exp ffff9df994681400, cur 1708059081 expire 1708058931 last 1708058866 [1250972.682155] Lustre: Skipped 6 previous similar messages [1251562.618010] Lustre: fir-OST0099: haven't heard from client 8963257f-9301-4848-b41d-a995abe55e27 (at 10.51.1.43@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e414d943800, cur 1708059671 expire 1708059521 last 1708059444 [1251562.640003] Lustre: Skipped 4 previous similar messages [1252527.565061] Lustre: fir-OST009b: haven't heard from client dcf53d34-7c4d-4ecc-82a9-30ea35539d95 (at 10.51.9.8@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33c6387800, cur 1708060636 expire 1708060486 last 1708060409 [1252527.587096] Lustre: Skipped 7 previous similar messages [1253029.544537] Lustre: fir-OST009f: haven't heard from client 83134670-7b9b-4c84-8bfb-f2ac902798d5 (at 10.51.2.10@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33ccaff800, cur 1708061138 expire 1708060988 last 1708060911 [1253029.566534] Lustre: Skipped 3 previous similar messages [1258076.263270] Lustre: fir-OST009b: haven't heard from client 90e3713a-a91b-412e-ac50-c76eeab28e97 (at 10.51.5.19@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e40f8442400, cur 1708066185 expire 1708066035 last 1708065958 [1258076.285520] Lustre: Skipped 3 previous similar messages [1258093.266019] Lustre: fir-OST009f: haven't heard from client 90e3713a-a91b-412e-ac50-c76eeab28e97 (at 10.51.5.19@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e42a788c000, cur 1708066202 expire 1708066052 last 1708065975 [1258093.287908] Lustre: Skipped 1 previous similar message [1258351.249388] Lustre: fir-OST009b: haven't heard from client b9ea2ed0-0ce1-47ac-b897-616235e2a53d (at 10.51.5.12@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01b354e400, cur 1708066460 expire 1708066310 last 1708066233 [1258351.271265] Lustre: Skipped 1 previous similar message [1259244.204330] Lustre: fir-OST009d: haven't heard from client 8f30e2d7-e26e-466e-ba9c-d45567235351 (at 10.51.5.14@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01378dc000, cur 1708067353 expire 1708067203 last 1708067126 [1259244.226378] Lustre: Skipped 3 previous similar messages [1259257.210020] Lustre: fir-OST009f: haven't heard from client 8f30e2d7-e26e-466e-ba9c-d45567235351 (at 10.51.5.14@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df967186400, cur 1708067366 expire 1708067216 last 1708067139 [1259257.231896] Lustre: Skipped 1 previous similar message [1259455.188900] Lustre: fir-OST009f: haven't heard from client 9b951a5f-9586-486c-9486-0400b0df5891 (at 10.51.15.14@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f209d800, cur 1708067564 expire 1708067414 last 1708067337 [1259455.210871] Lustre: Skipped 1 previous similar message [1259620.181108] Lustre: fir-OST0099: haven't heard from client 5e9a6c53-063e-409e-8eb1-e2134de2bacd (at 10.51.2.8@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33bcaf9c00, cur 1708067729 expire 1708067579 last 1708067502 [1259620.202892] Lustre: Skipped 3 previous similar messages [1260033.156961] Lustre: fir-OST009d: haven't heard from client 5a8be05e-bb80-4483-addb-bc71abe88454 (at 10.51.7.67@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e2f78e69c00, cur 1708068142 expire 1708067992 last 1708067915 [1260033.178834] Lustre: Skipped 7 previous similar messages [1260917.109753] Lustre: fir-OST0099: haven't heard from client 83020001-15be-4774-a641-ae63db5d2932 (at 10.51.4.35@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df9766bb800, cur 1708069026 expire 1708068876 last 1708068799 [1260917.131644] Lustre: Skipped 15 previous similar messages [1261132.099317] Lustre: fir-OST009f: haven't heard from client 0dcf2722-eb3f-485e-8bee-5be9a955627a (at 10.51.1.38@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e013862c000, cur 1708069241 expire 1708069091 last 1708069014 [1261132.121195] Lustre: Skipped 7 previous similar messages [1263814.952868] Lustre: fir-OST0099: haven't heard from client 227a812d-3cf9-42b8-9378-58d3d0b23939 (at 10.51.4.53@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02eb1b8000, cur 1708071924 expire 1708071774 last 1708071697 [1263814.975047] Lustre: Skipped 3 previous similar messages [1263826.961064] Lustre: fir-OST009d: haven't heard from client 227a812d-3cf9-42b8-9378-58d3d0b23939 (at 10.51.4.53@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df3b99bd000, cur 1708071936 expire 1708071786 last 1708071709 [1263832.954405] Lustre: fir-OST009b: haven't heard from client 227a812d-3cf9-42b8-9378-58d3d0b23939 (at 10.51.4.53@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e020fd67400, cur 1708071942 expire 1708071792 last 1708071715 [1264878.895443] Lustre: fir-OST0099: haven't heard from client b8e5b41b-f92f-447c-ac3e-3df2815ecb44 (at 10.51.10.63@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e008e047000, cur 1708072988 expire 1708072838 last 1708072761 [1264878.917406] Lustre: Skipped 1 previous similar message [1264898.893276] Lustre: fir-OST009b: haven't heard from client b8e5b41b-f92f-447c-ac3e-3df2815ecb44 (at 10.51.10.63@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dff78c8f400, cur 1708073008 expire 1708072858 last 1708072781 [1265398.872522] Lustre: fir-OST009b: haven't heard from client 005c29eb-a907-421c-b79e-f3eaad3cd762 (at 10.51.14.22@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33cd45d800, cur 1708073508 expire 1708073358 last 1708073281 [1265398.894484] Lustre: Skipped 2 previous similar messages [1265408.867993] Lustre: fir-OST009d: haven't heard from client 005c29eb-a907-421c-b79e-f3eaad3cd762 (at 10.51.14.22@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33ce9a2800, cur 1708073518 expire 1708073368 last 1708073291 [1269022.677841] Lustre: fir-OST009b: haven't heard from client bd9ce821-850a-4cc0-98a0-97dde0daa68e (at 10.51.6.57@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e0138adcc00, cur 1708077132 expire 1708076982 last 1708076905 [1269022.700058] Lustre: Skipped 1 previous similar message [1269034.685992] Lustre: fir-OST009d: haven't heard from client bd9ce821-850a-4cc0-98a0-97dde0daa68e (at 10.51.6.57@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df308ece000, cur 1708077144 expire 1708076994 last 1708076917 [1269034.707867] Lustre: Skipped 2 previous similar messages [1272709.471007] Lustre: fir-OST009d: haven't heard from client fa6434c4-aa6c-432c-bc8f-40f08bbc29d8 (at 10.50.6.53@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01b3032000, cur 1708080819 expire 1708080669 last 1708080592 [1272721.474107] Lustre: fir-OST009b: haven't heard from client fa6434c4-aa6c-432c-bc8f-40f08bbc29d8 (at 10.50.6.53@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df993039000, cur 1708080831 expire 1708080681 last 1708080604 [1272721.495979] Lustre: Skipped 2 previous similar messages [1280098.069771] Lustre: fir-OST009f: haven't heard from client a0343652-28bb-4b95-8ea0-0f5cd0992291 (at 10.51.4.50@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e40de525800, cur 1708088208 expire 1708088058 last 1708087981 [1280306.059944] Lustre: fir-OST009b: haven't heard from client 0c38f896-9b16-474e-8e14-2d0de7602e29 (at 10.51.3.9@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e40f8014800, cur 1708088416 expire 1708088266 last 1708088189 [1280306.082211] Lustre: Skipped 3 previous similar messages [1280382.054776] Lustre: fir-OST009b: haven't heard from client 9243a309-610d-4c2c-a6f6-5443a3a8a64d (at 10.51.3.40@o2ib3) in 215 seconds. I think it's dead, and I am evicting it. exp ffff9e0200416800, cur 1708088492 expire 1708088342 last 1708088277 [1280382.076918] Lustre: Skipped 3 previous similar messages [1280458.051316] Lustre: fir-OST0099: haven't heard from client 7a10500e-58ca-40a2-b1aa-06996ccae025 (at 10.51.4.51@o2ib3) in 191 seconds. I think it's dead, and I am evicting it. exp ffff9e01fcb84c00, cur 1708088568 expire 1708088418 last 1708088377 [1280458.073191] Lustre: Skipped 23 previous similar messages [1280494.059208] Lustre: fir-OST009f: haven't heard from client 7a10500e-58ca-40a2-b1aa-06996ccae025 (at 10.51.4.51@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01388f9800, cur 1708088604 expire 1708088454 last 1708088377 [1280494.082049] Lustre: Skipped 2 previous similar messages [1280906.027308] Lustre: fir-OST0099: haven't heard from client 40043fcb-3442-44bb-a542-06a9e70afe30 (at 10.51.3.34@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e001904c800, cur 1708089016 expire 1708088866 last 1708088789 [1280982.026322] Lustre: fir-OST0099: haven't heard from client 703fab25-3e12-4a50-ac7f-d637e9024ee3 (at 10.51.3.31@o2ib3) in 188 seconds. I think it's dead, and I am evicting it. exp ffff9e02ee6efc00, cur 1708089092 expire 1708088942 last 1708088904 [1280982.048190] Lustre: Skipped 3 previous similar messages [1281027.019744] Lustre: fir-OST009d: haven't heard from client 703fab25-3e12-4a50-ac7f-d637e9024ee3 (at 10.51.3.31@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e036cbaa800, cur 1708089137 expire 1708088987 last 1708088910 [1281027.041616] Lustre: Skipped 1 previous similar message [1281103.017045] Lustre: fir-OST009f: haven't heard from client 07c77934-300c-421f-a433-641f22af6973 (at 10.51.3.18@o2ib3) in 156 seconds. I think it's dead, and I am evicting it. exp ffff9df98ee86000, cur 1708089213 expire 1708089063 last 1708089057 [1281103.039221] Lustre: Skipped 1 previous similar message [1281802.978593] Lustre: fir-OST0099: haven't heard from client 049c8350-c7b7-40c4-934e-94754b18d959 (at 10.51.2.32@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e414e7a4000, cur 1708089913 expire 1708089763 last 1708089686 [1281803.000468] Lustre: Skipped 3 previous similar messages [1285109.800485] Lustre: fir-OST009f: haven't heard from client 0f1d1e47-e402-432d-a355-fb38e0826012 (at 10.51.10.19@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02fe84c400, cur 1708093220 expire 1708093070 last 1708092993 [1285109.822830] Lustre: Skipped 3 previous similar messages [1286148.749266] Lustre: fir-OST009d: haven't heard from client 723f60bc-7ff8-4199-a365-7bf5a4b61681 (at 10.51.6.44@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e4159749000, cur 1708094259 expire 1708094109 last 1708094032 [1286148.771564] Lustre: Skipped 3 previous similar messages [1286154.745433] Lustre: fir-OST0099: haven't heard from client 723f60bc-7ff8-4199-a365-7bf5a4b61681 (at 10.51.6.44@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33d35ee000, cur 1708094265 expire 1708094115 last 1708094038 [1286168.754799] Lustre: fir-OST009f: haven't heard from client 723f60bc-7ff8-4199-a365-7bf5a4b61681 (at 10.51.6.44@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e2f43959c00, cur 1708094279 expire 1708094129 last 1708094052 [1294322.302019] Lustre: fir-OST0099: haven't heard from client 77d0cdfe-676f-4641-b84e-4db9ddad6688 (at 10.51.3.18@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e021024f800, cur 1708102433 expire 1708102283 last 1708102206 [1294322.323917] Lustre: Skipped 1 previous similar message [1294398.298389] Lustre: fir-OST009b: haven't heard from client bcf4448d-5404-44b3-ab73-2141be4e81d5 (at 10.50.8.40@o2ib2) in 224 seconds. I think it's dead, and I am evicting it. exp ffff9e3fd10df000, cur 1708102509 expire 1708102359 last 1708102285 [1294398.320270] Lustre: Skipped 13 previous similar messages [1299105.046006] Lustre: fir-OST009f: haven't heard from client 322f650c-58bd-4fe1-99d1-150392036b00 (at 10.51.14.17@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e03b1a64c00, cur 1708107216 expire 1708107066 last 1708106989 [1299105.067967] Lustre: Skipped 1 previous similar message [1299115.042087] Lustre: fir-OST009d: haven't heard from client 322f650c-58bd-4fe1-99d1-150392036b00 (at 10.51.14.17@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e036cba9800, cur 1708107226 expire 1708107076 last 1708106999 [1299120.041226] Lustre: fir-OST0099: haven't heard from client 322f650c-58bd-4fe1-99d1-150392036b00 (at 10.51.14.17@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02eebba000, cur 1708107231 expire 1708107081 last 1708107004 [1299181.042600] Lustre: fir-OST009f: haven't heard from client 2b1aaa21-51a8-42d6-b457-3b95156a941d (at 10.50.16.1@o2ib2) in 202 seconds. I think it's dead, and I am evicting it. exp ffff9e0229f6f000, cur 1708107292 expire 1708107142 last 1708107090 [1299181.064478] Lustre: Skipped 1 previous similar message [1299191.037732] Lustre: fir-OST009d: haven't heard from client 2b1aaa21-51a8-42d6-b457-3b95156a941d (at 10.50.16.1@o2ib2) in 212 seconds. I think it's dead, and I am evicting it. exp ffff9df97b37fc00, cur 1708107302 expire 1708107152 last 1708107090 [1299511.019932] Lustre: fir-OST009d: haven't heard from client 67ebdaee-20d9-4141-bb68-5793944f5e46 (at 10.50.13.12@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df3b1fbfc00, cur 1708107622 expire 1708107472 last 1708107395 [1299511.041906] Lustre: Skipped 2 previous similar messages [1300691.955677] Lustre: fir-OST009d: haven't heard from client 2c36cb8d-7e6e-4bcb-8352-c489140805b9 (at 10.50.17.46@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df30ab7bc00, cur 1708108803 expire 1708108653 last 1708108576 [1301019.938948] Lustre: fir-OST009b: haven't heard from client 89d9cfb6-998f-41ca-bfc4-98b2b06ab457 (at 10.51.15.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df96902c400, cur 1708109131 expire 1708108981 last 1708108904 [1301019.960847] Lustre: Skipped 3 previous similar messages [1301027.946060] Lustre: fir-OST009d: haven't heard from client 89d9cfb6-998f-41ca-bfc4-98b2b06ab457 (at 10.51.15.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dff73cf4c00, cur 1708109139 expire 1708108989 last 1708108912 [1301027.967940] Lustre: Skipped 1 previous similar message [1302279.869926] Lustre: fir-OST009d: haven't heard from client ae4d86a4-4c78-401c-9bcc-03ac3c3d0773 (at 10.51.8.54@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e40e1a8f400, cur 1708110391 expire 1708110241 last 1708110164 [1302279.891808] Lustre: Skipped 1 previous similar message [1305904.673599] Lustre: fir-OST0099: haven't heard from client c77e6a08-5d1f-4828-831e-46ec47d6bddf (at 10.51.11.22@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02ee5d9000, cur 1708114016 expire 1708113866 last 1708113789 [1305904.695561] Lustre: Skipped 3 previous similar messages [1305910.672555] Lustre: fir-OST009b: haven't heard from client c77e6a08-5d1f-4828-831e-46ec47d6bddf (at 10.51.11.22@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e42c9f20800, cur 1708114022 expire 1708113872 last 1708113795 [1305910.694508] Lustre: Skipped 1 previous similar message [1305916.673498] Lustre: fir-OST009f: haven't heard from client c77e6a08-5d1f-4828-831e-46ec47d6bddf (at 10.51.11.22@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f203fc00, cur 1708114028 expire 1708113878 last 1708113801 [1307197.601773] Lustre: fir-OST009b: haven't heard from client 547883b8-3829-46a5-95b1-78a71ba56c9c (at 10.50.2.36@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e42ca949000, cur 1708115309 expire 1708115159 last 1708115082 [1307201.605192] Lustre: fir-OST009f: haven't heard from client d88f762f-f437-4cc7-bdbc-e0a9acfbc0f4 (at 10.50.5.1@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3f72c88000, cur 1708115313 expire 1708115163 last 1708115086 [1307201.626978] Lustre: Skipped 16 previous similar messages [1307202.605998] Lustre: fir-OST0099: haven't heard from client 547883b8-3829-46a5-95b1-78a71ba56c9c (at 10.50.2.36@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02eebe7800, cur 1708115314 expire 1708115164 last 1708115087 [1307202.628168] Lustre: Skipped 6 previous similar messages [1307273.598415] Lustre: fir-OST009d: haven't heard from client bde63fa0-574f-40fa-8b4d-f00570bb3fd5 (at 10.50.17.22@o2ib2) in 226 seconds. I think it's dead, and I am evicting it. exp ffff9df31b7eec00, cur 1708115385 expire 1708115235 last 1708115159 [1307273.620396] Lustre: Skipped 8 previous similar messages [1307277.600270] Lustre: fir-OST009f: haven't heard from client d6e30a75-924c-449a-a3bb-b892c92cfb05 (at 10.51.3.26@o2ib3) in 225 seconds. I think it's dead, and I am evicting it. exp ffff9df97e437c00, cur 1708115389 expire 1708115239 last 1708115164 [1307277.622156] Lustre: Skipped 25 previous similar messages [1307627.578492] Lustre: fir-OST009d: haven't heard from client df9b590a-9bc5-4f16-a93f-4c0038c39326 (at 10.51.5.63@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e2f4c6bb400, cur 1708115739 expire 1708115589 last 1708115512 [1307627.600361] Lustre: Skipped 75 previous similar messages [1307643.582657] Lustre: fir-OST0099: haven't heard from client df9b590a-9bc5-4f16-a93f-4c0038c39326 (at 10.51.5.63@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e40a873d000, cur 1708115755 expire 1708115605 last 1708115528 [1307643.604521] Lustre: Skipped 5 previous similar messages [1308563.531107] Lustre: fir-OST009f: haven't heard from client 1effaaa6-4fa3-4f23-9993-063948a030e5 (at 10.51.13.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e0001eb2c00, cur 1708116675 expire 1708116525 last 1708116448 [1308563.552988] Lustre: Skipped 5 previous similar messages [1308568.527079] Lustre: fir-OST0099: haven't heard from client 1effaaa6-4fa3-4f23-9993-063948a030e5 (at 10.51.13.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e0080adb000, cur 1708116680 expire 1708116530 last 1708116453 [1309255.492330] Lustre: fir-OST0099: haven't heard from client dff505c7-3199-404a-9ebd-4150cab1b8aa (at 10.51.7.10@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df989f57000, cur 1708117367 expire 1708117217 last 1708117140 [1309255.514203] Lustre: Skipped 2 previous similar messages [1309719.466444] Lustre: fir-OST0099: haven't heard from client 7dec6943-13c5-492b-be2e-74c9d75c5b7c (at 10.50.10.72@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e41d8599400, cur 1708117831 expire 1708117681 last 1708117604 [1309719.488588] Lustre: Skipped 3 previous similar messages [1309724.464965] Lustre: fir-OST009b: haven't heard from client 7dec6943-13c5-492b-be2e-74c9d75c5b7c (at 10.50.10.72@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e41f84c2c00, cur 1708117836 expire 1708117686 last 1708117609 [1311235.719607] LustreError: 27862:0:(events.c:476:server_bulk_callback()) event type 5, status -110, desc ffff9e3fd8b95c00 [1311246.101470] LNetError: 27861:0:(o2iblnd_cb.c:3375:kiblnd_check_txs_locked()) Timed out tx: active_txs(WSQ:100), 58 seconds [1311246.112683] LNetError: 27861:0:(o2iblnd_cb.c:3445:kiblnd_check_conns()) Timed out RDMA with 10.0.10.226@o2ib7 (0): c: 0, oc: 3, rc: 0 [1311246.125854] LustreError: 27861:0:(events.c:476:server_bulk_callback()) event type 5, status -103, desc ffff9e3fd8b95c00 [1311246.137145] LustreError: 47210:0:(ldlm_lib.c:3550:target_bulk_io()) @@@ network error on bulk READ req@ffff9deea0fa1200 x1790757979810432/t0(0) o3->9db2b4b6-8509-4ef8-8803-b49ee30320fe@10.50.6.18@o2ib2:575/0 lens 488/440 e 0 to 0 dl 1708119370 ref 1 fl Interpret:/0/0 rc 0/0 job:'41075134' [1311246.141032] LNet: 27861:0:(o2iblnd_cb.c:1520:kiblnd_reconnect_peer()) Abort reconnection of 10.0.10.226@o2ib7: accepting [1311246.174084] Lustre: fir-OST0099: Bulk IO read error with 9db2b4b6-8509-4ef8-8803-b49ee30320fe (at 10.50.6.18@o2ib2), client will retry: rc -110 [1311258.697972] LustreError: 46914:0:(ldlm_lib.c:3550:target_bulk_io()) @@@ network error on bulk READ req@ffff9deea2340480 x1789563176275392/t0(0) o3->98e9f301-2340-4ced-b77c-4af93a98dd1d@10.50.3.68@o2ib2:602/0 lens 488/440 e 1 to 0 dl 1708119397 ref 1 fl Interpret:/0/0 rc 0/0 job:'41178449' [1311258.699696] Lustre: fir-OST0099: Bulk IO read error with f98762d8-d7d1-462c-9687-8f100e945f45 (at 10.50.6.54@o2ib2), client will retry: rc -110 [1311258.736903] LustreError: 46914:0:(ldlm_lib.c:3550:target_bulk_io()) Skipped 5 previous similar messages [1311297.098725] LNetError: 27861:0:(o2iblnd_cb.c:3375:kiblnd_check_txs_locked()) Timed out tx: tx_queue(WSQ:101), 50 seconds [1311297.109762] LNetError: 27861:0:(o2iblnd_cb.c:3445:kiblnd_check_conns()) Timed out RDMA with 10.0.10.226@o2ib7 (0): c: 0, oc: 0, rc: 0 [1311297.122778] LustreError: 27861:0:(events.c:476:server_bulk_callback()) event type 5, status -103, desc ffff9e01f658e000 [1311297.133729] LustreError: 27861:0:(events.c:476:server_bulk_callback()) Skipped 7 previous similar messages [1311297.143575] LustreError: 47034:0:(ldlm_lib.c:3550:target_bulk_io()) @@@ network error on bulk READ req@ffff9deea17c1b00 x1789562118643392/t0(0) o3->0e954af1-eef4-4f3e-8b8d-7c8145613f19@10.50.4.41@o2ib2:621/0 lens 488/440 e 1 to 0 dl 1708119416 ref 1 fl Interpret:/0/0 rc 0/0 job:'40698564' [1311297.143638] Lustre: fir-OST009b: Bulk IO read error with 0e954af1-eef4-4f3e-8b8d-7c8145613f19 (at 10.50.4.41@o2ib2), client will retry: rc -110 [1311297.143639] Lustre: Skipped 5 previous similar messages [1311297.187864] LustreError: 47034:0:(ldlm_lib.c:3550:target_bulk_io()) Skipped 16 previous similar messages [1311313.449837] Lustre: 46883:0:(client.c:2295:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1708119297/real 1708119297] req@ffff9deea17ad580 x1789747951585728/t0(0) o106->fir-OST009b@10.50.7.62@o2ib2:15/16 lens 328/280 e 0 to 1 dl 1708119425 ref 1 fl Rpc:XQr/0/ffffffff rc 0/-1 job:'' [1311313.478378] Lustre: 46883:0:(client.c:2295:ptlrpc_expire_one_request()) Skipped 34 previous similar messages [1311313.683331] Lustre: fir-OST0099: Client 9db2b4b6-8509-4ef8-8803-b49ee30320fe (at 10.50.6.18@o2ib2) reconnecting [1311321.036324] Lustre: fir-OST009f: Client 009ca699-3318-4bf4-8923-5ffbfe6763fc (at 10.50.10.26@o2ib2) reconnecting [1311338.679483] Lustre: 47135:0:(client.c:2295:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1708119322/real 1708119322] req@ffff9e2966c69200 x1789747951638400/t0(0) o106->fir-OST0099@10.50.7.61@o2ib2:15/16 lens 328/280 e 0 to 1 dl 1708119450 ref 1 fl Rpc:XQr/0/ffffffff rc 0/-1 job:'' [1311338.707687] Lustre: 47135:0:(client.c:2295:ptlrpc_expire_one_request()) Skipped 1 previous similar message [1311338.780934] Lustre: fir-OST0099: Client f98762d8-d7d1-462c-9687-8f100e945f45 (at 10.50.6.54@o2ib2) reconnecting [1311338.791195] Lustre: Skipped 1 previous similar message [1311338.911463] LustreError: 47200:0:(ldlm_lib.c:3544:target_bulk_io()) @@@ Reconnect on bulk WRITE req@ffff9dee9fa89f80 x1790991190461248/t0(0) o4->b1a6b4ea-2026-4c7b-9c6c-385eae2ce2a0@10.50.16.14@o2ib2:4/0 lens 488/448 e 0 to 0 dl 1708119554 ref 1 fl Interpret:/0/0 rc 0/0 job:'41340601' [1311339.533437] LustreError: 46762:0:(ldlm_lib.c:3544:target_bulk_io()) @@@ Reconnect on bulk WRITE req@ffff9e2966c2da00 x1790991190470976/t0(0) o4->b1a6b4ea-2026-4c7b-9c6c-385eae2ce2a0@10.50.16.14@o2ib2:12/0 lens 488/448 e 0 to 0 dl 1708119562 ref 1 fl Interpret:/0/0 rc 0/0 job:'41340601' [1311339.559080] LustreError: 46762:0:(ldlm_lib.c:3544:target_bulk_io()) Skipped 3 previous similar messages [1311353.979106] LustreError: 27863:0:(events.c:476:server_bulk_callback()) event type 5, status -125, desc ffff9e3a1df4f400 [1311353.990061] LustreError: 27863:0:(events.c:476:server_bulk_callback()) Skipped 50 previous similar messages [1311359.939123] Lustre: fir-OST009b: Client 0e954af1-eef4-4f3e-8b8d-7c8145613f19 (at 10.50.4.41@o2ib2) reconnecting [1311359.949386] Lustre: Skipped 3 previous similar messages [1311367.819231] LustreError: 27867:0:(events.c:476:server_bulk_callback()) event type 5, status -125, desc ffff9e33ceb25c00 [1311367.830221] LustreError: 27867:0:(events.c:476:server_bulk_callback()) Skipped 6 previous similar messages [1311368.495873] Lustre: 46823:0:(client.c:2295:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1708119352/real 1708119352] req@ffff9deea41ec380 x1789747951731648/t0(0) o106->fir-OST009d@10.50.7.62@o2ib2:15/16 lens 328/280 e 0 to 1 dl 1708119480 ref 1 fl Rpc:XQr/0/ffffffff rc 0/-1 job:'' [1311368.524069] Lustre: 46823:0:(client.c:2295:ptlrpc_expire_one_request()) Skipped 1 previous similar message [1311371.375837] Lustre: fir-OST0099: haven't heard from client c3f2fb65-3b84-4b97-8926-c7ea5952dfe1 (at 10.50.7.61@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02ee4e7c00, cur 1708119483 expire 1708119333 last 1708119256 [1311373.396617] LustreError: 137-5: fir-OST009a_UUID: not available for connect from 10.50.3.60@o2ib2 (no target). If you are running an HA pair check that the target is mounted on the other server. [1311373.414066] LustreError: Skipped 1 previous similar message [1311373.472656] Lustre: fir-OST009b: Bulk IO write error with b1a6b4ea-2026-4c7b-9c6c-385eae2ce2a0 (at 10.50.16.14@o2ib2), client will retry: rc = -110 [1311373.486167] Lustre: Skipped 1 previous similar message [1311373.487449] Lustre: fir-OST009f: Bulk IO read error with b1a6b4ea-2026-4c7b-9c6c-385eae2ce2a0 (at 10.50.16.14@o2ib2), client will retry: rc -110 [1311373.487450] Lustre: Skipped 16 previous similar messages [1311374.180203] LustreError: 137-5: fir-OST009e_UUID: not available for connect from 10.50.9.6@o2ib2 (no target). If you are running an HA pair check that the target is mounted on the other server. [1311374.197588] LustreError: Skipped 1 previous similar message [1311376.107425] LustreError: 137-5: fir-OST0098_UUID: not available for connect from 10.50.9.8@o2ib2 (no target). If you are running an HA pair check that the target is mounted on the other server. [1311376.124806] LustreError: Skipped 6 previous similar messages [1311376.464746] Lustre: fir-OST0099: Client 5cb84aed-335c-4e8c-b160-09c0f5bd8e4b (at 10.50.1.40@o2ib2) reconnecting [1311376.726446] Lustre: 46789:0:(client.c:2295:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1708119360/real 1708119360] req@ffff9deea20b5100 x1789747951753472/t0(0) o106->fir-OST009b@10.50.7.61@o2ib2:15/16 lens 328/280 e 0 to 1 dl 1708119488 ref 1 fl Rpc:XQr/0/ffffffff rc 0/-1 job:'' [1311378.494894] LustreError: 137-5: fir-OST0098_UUID: not available for connect from 10.50.7.11@o2ib2 (no target). If you are running an HA pair check that the target is mounted on the other server. [1311378.512344] LustreError: Skipped 6 previous similar messages [1311385.227979] LustreError: 137-5: fir-OST0098_UUID: not available for connect from 10.50.2.30@o2ib2 (no target). If you are running an HA pair check that the target is mounted on the other server. [1311385.245921] LustreError: Skipped 3 previous similar messages [1311385.517951] Lustre: ll_ost01_049: service thread pid 46881 was inactive for 200.056 seconds. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes: [1311385.517954] Pid: 47110, comm: ll_ost01_066 3.10.0-1160.108.1.el7_lustre.pl1.x86_64 #1 SMP Fri Jan 26 11:26:38 PST 2024 [1311385.517955] Lustre: ll_ost01_007: service thread pid 46731 was inactive for 200.059 seconds. Watchdog stack traces are limited to 3 per 300 seconds, skipping this one. [1311385.517956] Call Trace: [1311385.517959] Lustre: Skipped 2 previous similar messages [1311385.517996] [<0>] ptlrpc_set_wait+0x7b7/0x840 [ptlrpc] [1311385.518008] [<0>] ldlm_run_ast_work+0xd5/0x3e0 [ptlrpc] [1311385.518021] [<0>] ldlm_glimpse_locks+0x38/0x110 [ptlrpc] [1311385.518027] [<0>] ofd_intent_policy+0x78b/0xa50 [ofd] [1311385.518039] [<0>] ldlm_lock_enqueue+0x3d5/0xb60 [ptlrpc] [1311385.518051] [<0>] ldlm_handle_enqueue0+0x8d6/0x1770 [ptlrpc] [1311385.518073] [<0>] tgt_enqueue+0x64/0x250 [ptlrpc] [1311385.518089] [<0>] tgt_request_handle+0x93f/0x19d0 [ptlrpc] [1311385.518103] [<0>] ptlrpc_server_handle_request+0x253/0xc30 [ptlrpc] [1311385.518121] [<0>] ptlrpc_main+0xbf4/0x15e0 [ptlrpc] [1311385.518124] [<0>] kthread+0xd1/0xe0 [1311385.518126] [<0>] ret_from_fork_nospec_begin+0x7/0x21 [1311385.518171] [<0>] 0xfffffffffffffffe [1311385.518177] Pid: 46770, comm: ll_ost01_021 3.10.0-1160.108.1.el7_lustre.pl1.x86_64 #1 SMP Fri Jan 26 11:26:38 PST 2024 [1311385.518178] Call Trace: [1311385.518281] [<0>] ptlrpc_set_wait+0x7b7/0x840 [ptlrpc] [1311385.518294] [<0>] ldlm_run_ast_work+0xd5/0x3e0 [ptlrpc] [1311385.518307] [<0>] ldlm_glimpse_locks+0x38/0x110 [ptlrpc] [1311385.518315] [<0>] ofd_intent_policy+0x78b/0xa50 [ofd] [1311385.518327] [<0>] ldlm_lock_enqueue+0x3d5/0xb60 [ptlrpc] [1311385.518340] [<0>] ldlm_handle_enqueue0+0x8d6/0x1770 [ptlrpc] [1311385.518364] [<0>] tgt_enqueue+0x64/0x250 [ptlrpc] [1311385.518379] [<0>] tgt_request_handle+0x93f/0x19d0 [ptlrpc] [1311385.518394] [<0>] ptlrpc_server_handle_request+0x253/0xc30 [ptlrpc] [1311385.518407] [<0>] ptlrpc_main+0xbf4/0x15e0 [ptlrpc] [1311385.518411] [<0>] kthread+0xd1/0xe0 [1311385.518413] [<0>] ret_from_fork_nospec_begin+0x7/0x21 [1311385.518457] [<0>] 0xfffffffffffffffe [1311385.719968] Lustre: Skipped 2 previous similar messages [1311385.725376] Pid: 46881, comm: ll_ost01_049 3.10.0-1160.108.1.el7_lustre.pl1.x86_64 #1 SMP Fri Jan 26 11:26:38 PST 2024 [1311385.736243] Call Trace: [1311385.738913] [<0>] ptlrpc_set_wait+0x7b7/0x840 [ptlrpc] [1311385.744244] [<0>] ldlm_run_ast_work+0xd5/0x3e0 [ptlrpc] [1311385.749662] [<0>] ldlm_glimpse_locks+0x38/0x110 [ptlrpc] [1311385.755160] [<0>] ofd_intent_policy+0x78b/0xa50 [ofd] [1311385.760856] [<0>] ldlm_lock_enqueue+0x3d5/0xb60 [ptlrpc] [1311385.766360] [<0>] ldlm_handle_enqueue0+0x8d6/0x1770 [ptlrpc] [1311385.772215] [<0>] tgt_enqueue+0x64/0x250 [ptlrpc] [1311385.777118] [<0>] tgt_request_handle+0x93f/0x19d0 [ptlrpc] [1311385.782794] [<0>] ptlrpc_server_handle_request+0x253/0xc30 [ptlrpc] [1311385.789249] [<0>] ptlrpc_main+0xbf4/0x15e0 [ptlrpc] [1311385.794309] [<0>] kthread+0xd1/0xe0 [1311385.797981] [<0>] ret_from_fork_nospec_begin+0x7/0x21 [1311385.803222] [<0>] 0xfffffffffffffffe [1311386.386435] Lustre: fir-OST009b: haven't heard from client 616cacf6-8b50-4cec-9224-323ada48e343 (at 10.51.1.17@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e42c9ef2400, cur 1708119498 expire 1708119348 last 1708119271 [1311386.408308] Lustre: Skipped 8 previous similar messages [1311478.444526] Lustre: fir-OST0099: Client 9c7a8403-8ba3-437e-9298-14b9ee50ce01 (at 10.50.2.44@o2ib2) reconnecting [1311478.454778] Lustre: Skipped 2 previous similar messages [1311509.481783] Lustre: fir-OST009f: Client 9778767d-da25-49d5-9e7a-aa3ddc1cdf7c (at 10.50.1.72@o2ib2) reconnecting [1311509.492044] Lustre: Skipped 1 previous similar message [1311778.359528] Lustre: fir-OST009f: haven't heard from client 46302008-509e-4991-b452-5584750ccc83 (at 10.51.13.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01bf8b1400, cur 1708119890 expire 1708119740 last 1708119663 [1311778.381395] Lustre: Skipped 2 previous similar messages [1312349.323153] Lustre: fir-OST009b: haven't heard from client 364e86b4-b5fb-4e09-828b-26d74dff142c (at 10.51.10.37@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df3b64abc00, cur 1708120461 expire 1708120311 last 1708120234 [1312349.345119] Lustre: Skipped 3 previous similar messages [1312907.293966] Lustre: fir-OST0099: haven't heard from client d25d07d9-cbc6-4b4e-9329-e3f9ac0a74b3 (at 10.51.12.7@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01d2b79400, cur 1708121019 expire 1708120869 last 1708120792 [1312918.292575] Lustre: fir-OST009d: haven't heard from client d25d07d9-cbc6-4b4e-9329-e3f9ac0a74b3 (at 10.51.12.7@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df2ff9f9c00, cur 1708121030 expire 1708120880 last 1708120803 [1313339.271915] Lustre: fir-OST0099: haven't heard from client d291e882-3828-44d1-a593-75a0a140fed4 (at 10.51.12.20@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02eebe1400, cur 1708121451 expire 1708121301 last 1708121224 [1313339.293879] Lustre: Skipped 2 previous similar messages [1313794.247532] Lustre: fir-OST009d: haven't heard from client 400122f9-ad86-42db-a8a3-a4ae4a319c84 (at 10.50.6.10@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f1ab9000, cur 1708121906 expire 1708121756 last 1708121679 [1313794.269401] Lustre: Skipped 7 previous similar messages [1314140.228483] Lustre: fir-OST009b: haven't heard from client f65f1766-04d6-4f8e-a519-63644b156773 (at 10.50.3.64@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e00c0643000, cur 1708122252 expire 1708122102 last 1708122025 [1314140.250355] Lustre: Skipped 3 previous similar messages [1314269.220055] Lustre: fir-OST0099: haven't heard from client c84b529f-2ac9-4ab2-ac45-dc34e821867e (at 10.50.10.2@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e2f44ba7400, cur 1708122381 expire 1708122231 last 1708122154 [1314269.242163] Lustre: Skipped 5 previous similar messages [1316113.119353] Lustre: fir-OST009b: haven't heard from client b31fe873-1dee-483b-bc24-97be36cdf932 (at 10.51.5.26@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dff745ae000, cur 1708124225 expire 1708124075 last 1708123998 [1316189.114869] Lustre: fir-OST009d: haven't heard from client 4b4aed10-3d49-4d2e-a803-0c3db86291dc (at 10.51.6.37@o2ib3) in 205 seconds. I think it's dead, and I am evicting it. exp ffff9e0139620400, cur 1708124301 expire 1708124151 last 1708124096 [1316189.136744] Lustre: Skipped 3 previous similar messages [1323008.746778] Lustre: fir-OST0099: haven't heard from client 5b32d524-7cb4-441e-a2c5-a673949ca7f1 (at 10.51.2.18@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e414e4a7000, cur 1708131121 expire 1708130971 last 1708130894 [1323008.768646] Lustre: Skipped 3 previous similar messages [1323026.748751] Lustre: fir-OST009f: haven't heard from client 5b32d524-7cb4-441e-a2c5-a673949ca7f1 (at 10.51.2.18@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33bc061c00, cur 1708131139 expire 1708130989 last 1708130912 [1323026.770628] Lustre: Skipped 1 previous similar message [1333446.179328] Lustre: fir-OST009b: haven't heard from client b96a78d3-2ed6-48ef-bf09-db9ac12df439 (at 10.51.4.54@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e431ee2d000, cur 1708141559 expire 1708141409 last 1708141332 [1333446.201200] Lustre: Skipped 1 previous similar message [1333451.179443] Lustre: fir-OST009d: haven't heard from client b96a78d3-2ed6-48ef-bf09-db9ac12df439 (at 10.51.4.54@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f1a4d400, cur 1708141564 expire 1708141414 last 1708141337 [1333451.201315] Lustre: Skipped 3 previous similar messages [1335145.086909] Lustre: fir-OST009f: haven't heard from client d629de65-a892-40fb-b092-48bd471d8720 (at 10.50.5.13@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e4198f71800, cur 1708143258 expire 1708143108 last 1708143031 [1335145.109127] Lustre: Skipped 3 previous similar messages [1335147.090222] Lustre: fir-OST0099: haven't heard from client d629de65-a892-40fb-b092-48bd471d8720 (at 10.50.5.13@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e4198f75800, cur 1708143260 expire 1708143110 last 1708143033 [1335147.112295] Lustre: Skipped 5 previous similar messages [1341462.743927] Lustre: fir-OST009d: haven't heard from client 5884f12a-06c3-48f0-b6f9-0aac8e71ddd7 (at 10.51.8.22@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f1535800, cur 1708149576 expire 1708149426 last 1708149349 [1341462.765796] Lustre: Skipped 1 previous similar message [1342701.676159] Lustre: fir-OST009b: haven't heard from client 49bc8509-cc83-494a-8dbb-8da165715ec8 (at 10.50.10.44@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e40bc633400, cur 1708150815 expire 1708150665 last 1708150588 [1342701.698395] Lustre: Skipped 3 previous similar messages [1346854.449453] Lustre: fir-OST009b: haven't heard from client ec51e958-edf9-46b9-8b9f-f33f4172de70 (at 10.51.9.16@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33b9041400, cur 1708154968 expire 1708154818 last 1708154741 [1346930.452755] Lustre: fir-OST009b: haven't heard from client 9787b71c-d64f-4ff5-88ed-9c1c6c5b410d (at 10.51.13.12@o2ib3) in 198 seconds. I think it's dead, and I am evicting it. exp ffff9df3ae850000, cur 1708155044 expire 1708154894 last 1708154846 [1346959.444963] Lustre: fir-OST009d: haven't heard from client 9787b71c-d64f-4ff5-88ed-9c1c6c5b410d (at 10.51.13.12@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df96b933400, cur 1708155073 expire 1708154923 last 1708154846 [1352976.116829] Lustre: fir-OST009f: haven't heard from client b14894c9-8093-4a29-b41f-0895b14a5e32 (at 10.51.1.5@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02fe84a400, cur 1708161090 expire 1708160940 last 1708160863 [1352976.138610] Lustre: Skipped 2 previous similar messages [1352981.116702] Lustre: fir-OST009b: haven't heard from client b14894c9-8093-4a29-b41f-0895b14a5e32 (at 10.51.1.5@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e43ad114c00, cur 1708161095 expire 1708160945 last 1708160868 [1352995.114783] Lustre: fir-OST0099: haven't heard from client b14894c9-8093-4a29-b41f-0895b14a5e32 (at 10.51.1.5@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02ee574c00, cur 1708161109 expire 1708160959 last 1708160882 [1356647.916891] Lustre: fir-OST0099: haven't heard from client 63db67a7-f2a5-4724-aa06-93242f126ee5 (at 10.50.8.21@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01f23be400, cur 1708164762 expire 1708164612 last 1708164535 [1356647.938766] Lustre: Skipped 1 previous similar message [1360371.712938] Lustre: fir-OST009d: haven't heard from client f6d6e3cc-1f98-453e-80ce-2458f53d084d (at 10.51.12.13@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01d9334400, cur 1708168486 expire 1708168336 last 1708168259 [1360381.712369] Lustre: fir-OST009f: haven't heard from client f6d6e3cc-1f98-453e-80ce-2458f53d084d (at 10.51.12.13@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e020049dc00, cur 1708168496 expire 1708168346 last 1708168269 [1360908.694689] Lustre: fir-OST009d: haven't heard from client 68925aea-4293-4155-bb93-ad4cc8ebcb01 (at 10.50.1.11@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3f72cbcc00, cur 1708169023 expire 1708168873 last 1708168796 [1360908.716561] Lustre: Skipped 2 previous similar messages [1364472.490644] Lustre: fir-OST009f: haven't heard from client e67722f9-3d0c-463d-ace4-8e68cf69ab67 (at 10.51.4.23@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e0220aeec00, cur 1708172587 expire 1708172437 last 1708172360 [1364472.512523] Lustre: Skipped 1 previous similar message [1364761.476244] Lustre: fir-OST0099: haven't heard from client efaedbd3-9db8-4cdc-ac4f-24196fb746b1 (at 10.51.3.44@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dffff9f7400, cur 1708172876 expire 1708172726 last 1708172649 [1364761.498253] Lustre: Skipped 3 previous similar messages [1367889.314284] Lustre: fir-OST009f: haven't heard from client effa90cd-390c-4fae-8cce-b069dcfd715d (at 10.51.2.13@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e0249c08400, cur 1708176004 expire 1708175854 last 1708175777 [1367889.336153] Lustre: Skipped 3 previous similar messages [1372325.065305] Lustre: fir-OST0099: haven't heard from client 401e70f5-26f9-47c1-86f7-dc3697a524b3 (at 10.50.6.5@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02ee574400, cur 1708180440 expire 1708180290 last 1708180213 [1372325.087093] Lustre: Skipped 3 previous similar messages [1372330.064962] Lustre: fir-OST009f: haven't heard from client 401e70f5-26f9-47c1-86f7-dc3697a524b3 (at 10.50.6.5@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e43ac1df800, cur 1708180445 expire 1708180295 last 1708180218 [1372335.064862] Lustre: fir-OST009b: haven't heard from client 401e70f5-26f9-47c1-86f7-dc3697a524b3 (at 10.50.6.5@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e42d56cc800, cur 1708180450 expire 1708180300 last 1708180223 [1373611.003675] Lustre: fir-OST009b: haven't heard from client 0a00f218-9ad5-4ccb-a214-ac888767a81d (at 10.50.1.6@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01c6805c00, cur 1708181726 expire 1708181576 last 1708181499 [1373611.025462] Lustre: Skipped 1 previous similar message [1377516.792237] Lustre: fir-OST0099: haven't heard from client 852a3cc4-431f-4c91-a33b-33a918e48c00 (at 10.51.1.61@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3fd8f51000, cur 1708185632 expire 1708185482 last 1708185405 [1377525.784223] Lustre: fir-OST009d: haven't heard from client 852a3cc4-431f-4c91-a33b-33a918e48c00 (at 10.51.1.61@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e414d93fc00, cur 1708185641 expire 1708185491 last 1708185414 [1377530.783185] Lustre: fir-OST009f: haven't heard from client 852a3cc4-431f-4c91-a33b-33a918e48c00 (at 10.51.1.61@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3fd8f54000, cur 1708185646 expire 1708185496 last 1708185419 [1378394.736155] Lustre: fir-OST009d: haven't heard from client 64485fc7-8dad-4795-886e-8afa714d403e (at 10.51.2.11@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df3b64afc00, cur 1708186510 expire 1708186360 last 1708186283 [1378394.758327] Lustre: Skipped 1 previous similar message [1378403.735500] Lustre: fir-OST0099: haven't heard from client 64485fc7-8dad-4795-886e-8afa714d403e (at 10.51.2.11@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dff7486f800, cur 1708186519 expire 1708186369 last 1708186292 [1378403.757367] Lustre: Skipped 1 previous similar message [1379509.674941] Lustre: fir-OST009f: haven't heard from client 2d244bed-2d71-404d-80ac-25478b6942c8 (at 10.51.7.72@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df8b7a4dc00, cur 1708187625 expire 1708187475 last 1708187398 [1379509.697132] Lustre: Skipped 1 previous similar message [1379512.675180] Lustre: fir-OST0099: haven't heard from client 2d244bed-2d71-404d-80ac-25478b6942c8 (at 10.51.7.72@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dff80281c00, cur 1708187628 expire 1708187478 last 1708187401 [1379512.697052] Lustre: Skipped 1 previous similar message [1383596.456074] Lustre: fir-OST0099: haven't heard from client 0ad71fb0-ce03-45fb-8163-a4dc202e5936 (at 10.51.2.48@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e4139ef7800, cur 1708191712 expire 1708191562 last 1708191485 [1383596.477947] Lustre: Skipped 1 previous similar message [1383609.466308] Lustre: fir-OST009d: haven't heard from client 0ad71fb0-ce03-45fb-8163-a4dc202e5936 (at 10.51.2.48@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e41f84c0000, cur 1708191725 expire 1708191575 last 1708191498 [1383615.454476] Lustre: fir-OST009b: haven't heard from client 0ad71fb0-ce03-45fb-8163-a4dc202e5936 (at 10.51.2.48@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e4153eea000, cur 1708191731 expire 1708191581 last 1708191504 [1383615.476340] Lustre: Skipped 1 previous similar message [1389443.141235] Lustre: fir-OST0099: haven't heard from client f962e7d3-a6a5-46f3-9e3c-389dbaccc290 (at 10.51.15.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df30ab74000, cur 1708197559 expire 1708197409 last 1708197332 [1389448.143021] Lustre: fir-OST009f: haven't heard from client f962e7d3-a6a5-46f3-9e3c-389dbaccc290 (at 10.51.15.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01d24f0c00, cur 1708197564 expire 1708197414 last 1708197337 [1389448.165053] Lustre: Skipped 2 previous similar messages [1390940.060739] Lustre: fir-OST009b: haven't heard from client 7eb3d33f-019f-497f-8f6d-3f3c9d5554bc (at 10.51.15.2@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3ea6f99000, cur 1708199056 expire 1708198906 last 1708198829 [1390958.060393] Lustre: fir-OST009f: haven't heard from client 7eb3d33f-019f-497f-8f6d-3f3c9d5554bc (at 10.51.15.2@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df979120400, cur 1708199074 expire 1708198924 last 1708198847 [1390958.082411] Lustre: Skipped 1 previous similar message [1397177.724064] Lustre: fir-OST0099: haven't heard from client 960f74b2-6f6c-48d7-9a3f-b829ccc6f5a7 (at 10.51.1.10@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df3ad00a800, cur 1708205294 expire 1708205144 last 1708205067 [1397177.745940] Lustre: Skipped 1 previous similar message [1397192.725453] Lustre: fir-OST009b: haven't heard from client 960f74b2-6f6c-48d7-9a3f-b829ccc6f5a7 (at 10.51.1.10@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e008696d000, cur 1708205309 expire 1708205159 last 1708205082 [1397192.747328] Lustre: Skipped 2 previous similar messages [1397756.697858] Lustre: fir-OST009b: haven't heard from client ec862a1e-0abf-434b-95fa-0ccf73602f30 (at 10.51.8.37@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df3b43dfc00, cur 1708205873 expire 1708205723 last 1708205646 [1397761.691982] Lustre: fir-OST0099: haven't heard from client ec862a1e-0abf-434b-95fa-0ccf73602f30 (at 10.51.8.37@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df3b412ec00, cur 1708205878 expire 1708205728 last 1708205651 [1398182.669199] Lustre: fir-OST009b: haven't heard from client 689b8e52-a4b1-4340-a329-c19b7533735b (at 10.51.6.15@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dfcfafa1c00, cur 1708206299 expire 1708206149 last 1708206072 [1398182.691218] Lustre: Skipped 2 previous similar messages [1399705.586569] Lustre: fir-OST009d: haven't heard from client 6a19736a-c119-46eb-b7a3-491668bc799e (at 10.51.13.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dfd5750b800, cur 1708207822 expire 1708207672 last 1708207595 [1399705.608458] Lustre: Skipped 3 previous similar messages [1399720.587552] Lustre: fir-OST009f: haven't heard from client 6a19736a-c119-46eb-b7a3-491668bc799e (at 10.51.13.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e03bd847c00, cur 1708207837 expire 1708207687 last 1708207610 [1399720.609425] Lustre: Skipped 1 previous similar message [1400534.541715] Lustre: fir-OST009d: haven't heard from client a32b2cf2-ed88-4711-8435-faa89ebafb73 (at 10.51.13.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dff6e239800, cur 1708208651 expire 1708208501 last 1708208424 [1400534.563586] Lustre: Skipped 1 previous similar message [1402382.448083] Lustre: fir-OST009f: haven't heard from client b32dedcb-fe89-4109-871b-c2880a03c456 (at 10.51.12.8@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e41c8c6c800, cur 1708210499 expire 1708210349 last 1708210272 [1402382.470257] Lustre: Skipped 3 previous similar messages [1402393.441460] Lustre: fir-OST009b: haven't heard from client b32dedcb-fe89-4109-871b-c2880a03c456 (at 10.51.12.8@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e41c5bc1400, cur 1708210510 expire 1708210360 last 1708210283 [1404218.345071] Lustre: fir-OST009d: haven't heard from client 126398e3-fd09-47f1-8c9a-52f106c8f7a3 (at 10.50.5.5@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f2aabc00, cur 1708212335 expire 1708212185 last 1708212108 [1404218.366852] Lustre: Skipped 2 previous similar messages [1404223.343084] Lustre: fir-OST009b: haven't heard from client 126398e3-fd09-47f1-8c9a-52f106c8f7a3 (at 10.50.5.5@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e4362ea6800, cur 1708212340 expire 1708212190 last 1708212113 [1404223.365179] Lustre: Skipped 1 previous similar message [1404231.343346] Lustre: fir-OST009f: haven't heard from client 126398e3-fd09-47f1-8c9a-52f106c8f7a3 (at 10.50.5.5@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e033813ec00, cur 1708212348 expire 1708212198 last 1708212121 [1415757.725263] Lustre: fir-OST0099: haven't heard from client d56e5ce2-a8a4-4af0-8fa4-159b0aa4ee51 (at 10.51.7.51@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e2f43d9e800, cur 1708223875 expire 1708223725 last 1708223648 [1425278.209423] Lustre: fir-OST0099: haven't heard from client 55000b9f-197a-4d27-9276-b868613880b8 (at 10.50.12.4@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3fe16a5800, cur 1708233396 expire 1708233246 last 1708233169 [1425601.191344] Lustre: fir-OST009d: haven't heard from client 80057ae2-8b37-48e4-8337-a9763e106548 (at 10.51.14.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3e8c6d2400, cur 1708233719 expire 1708233569 last 1708233492 [1425621.191859] Lustre: fir-OST0099: haven't heard from client 80057ae2-8b37-48e4-8337-a9763e106548 (at 10.51.14.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33508e3c00, cur 1708233739 expire 1708233589 last 1708233512 [1425621.213724] Lustre: Skipped 1 previous similar message [1437400.550189] Lustre: fir-OST009f: haven't heard from client e9a39e1c-9138-41a3-b694-3cd7eb88689b (at 10.51.12.1@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df9945e8c00, cur 1708245519 expire 1708245369 last 1708245292 [1437400.572366] Lustre: Skipped 1 previous similar message [1437409.550494] Lustre: fir-OST0099: haven't heard from client e9a39e1c-9138-41a3-b694-3cd7eb88689b (at 10.51.12.1@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e0225aaa400, cur 1708245528 expire 1708245378 last 1708245301 [1437409.572360] Lustre: Skipped 2 previous similar messages [1438053.516673] Lustre: fir-OST009d: haven't heard from client 8e82aee4-1be6-4bad-8828-8a1ae507f691 (at 10.50.9.25@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e40b2980c00, cur 1708246172 expire 1708246022 last 1708245945 [1438058.514302] Lustre: fir-OST009b: haven't heard from client 8e82aee4-1be6-4bad-8828-8a1ae507f691 (at 10.50.9.25@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e417dc15400, cur 1708246177 expire 1708246027 last 1708245950 [1438682.814634] md: data-check of RAID array md1 [1438688.938135] md: data-check of RAID array md3 [1438695.022714] md: data-check of RAID array md5 [1438700.982544] md: data-check of RAID array md7 [1440222.394828] Lustre: fir-OST0099: haven't heard from client f90e622e-cc59-40f9-bcdb-eebccb100352 (at 10.51.12.7@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df9677b6800, cur 1708248341 expire 1708248191 last 1708248114 [1440222.416691] Lustre: Skipped 2 previous similar messages [1440232.398387] Lustre: fir-OST009f: haven't heard from client f90e622e-cc59-40f9-bcdb-eebccb100352 (at 10.51.12.7@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df9677b1400, cur 1708248351 expire 1708248201 last 1708248124 [1440232.420259] Lustre: Skipped 1 previous similar message [1440237.397640] Lustre: fir-OST009b: haven't heard from client f90e622e-cc59-40f9-bcdb-eebccb100352 (at 10.51.12.7@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df982999800, cur 1708248356 expire 1708248206 last 1708248129 [1440444.382370] Lustre: fir-OST009f: haven't heard from client 6588a337-592f-44bb-b5a5-0ef1e9dca779 (at 10.51.6.45@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e2913adc000, cur 1708248563 expire 1708248413 last 1708248336 [1440449.384334] Lustre: fir-OST009b: haven't heard from client 6588a337-592f-44bb-b5a5-0ef1e9dca779 (at 10.51.6.45@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dee63a7b400, cur 1708248568 expire 1708248418 last 1708248341 [1440461.381527] Lustre: fir-OST009d: haven't heard from client 6588a337-592f-44bb-b5a5-0ef1e9dca779 (at 10.51.6.45@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df965410c00, cur 1708248580 expire 1708248430 last 1708248353 [1444239.165956] Lustre: fir-OST009d: haven't heard from client 34119522-9e7a-4fb1-ab4e-2e99d4ef056c (at 10.51.15.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e021247e800, cur 1708252358 expire 1708252208 last 1708252131 [1444239.187838] Lustre: Skipped 1 previous similar message [1444251.164815] Lustre: fir-OST009b: haven't heard from client 34119522-9e7a-4fb1-ab4e-2e99d4ef056c (at 10.51.15.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dffff9d2c00, cur 1708252370 expire 1708252220 last 1708252143 [1444251.186721] Lustre: Skipped 1 previous similar message [1472292.574494] Lustre: fir-OST0099: haven't heard from client 67064505-4996-4f65-bd3d-ecea0eda3f32 (at 10.50.8.37@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02ee540400, cur 1708280413 expire 1708280263 last 1708280186 [1472292.596362] Lustre: Skipped 1 previous similar message [1472301.577161] Lustre: fir-OST009d: haven't heard from client 67064505-4996-4f65-bd3d-ecea0eda3f32 (at 10.50.8.37@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f317bc00, cur 1708280422 expire 1708280272 last 1708280195 [1472301.599030] Lustre: Skipped 1 previous similar message [1473302.521646] Lustre: fir-OST0099: haven't heard from client ad6abe05-c0d9-4aaa-a34a-760f81532c02 (at 10.51.5.70@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01efd07c00, cur 1708281423 expire 1708281273 last 1708281196 [1473302.543530] Lustre: Skipped 1 previous similar message [1473310.521783] Lustre: fir-OST009f: haven't heard from client ad6abe05-c0d9-4aaa-a34a-760f81532c02 (at 10.51.5.70@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01393ee400, cur 1708281431 expire 1708281281 last 1708281204 [1473322.534852] Lustre: fir-OST009b: haven't heard from client ad6abe05-c0d9-4aaa-a34a-760f81532c02 (at 10.51.5.70@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dff7978d000, cur 1708281443 expire 1708281293 last 1708281216 [1474670.443851] Lustre: fir-OST009d: haven't heard from client 12c06837-daf9-4495-b839-fc7b667af209 (at 10.51.3.1@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33b1141400, cur 1708282791 expire 1708282641 last 1708282564 [1474670.465837] Lustre: Skipped 1 previous similar message [1475732.384554] Lustre: fir-OST009d: haven't heard from client 3660fc30-681e-46ab-b8d3-2cafe7916f15 (at 10.50.3.71@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e40e7c77c00, cur 1708283853 expire 1708283703 last 1708283626 [1475732.406546] Lustre: Skipped 3 previous similar messages [1475738.383651] Lustre: fir-OST009b: haven't heard from client 3660fc30-681e-46ab-b8d3-2cafe7916f15 (at 10.50.3.71@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e40f8819000, cur 1708283859 expire 1708283709 last 1708283632 [1475743.381179] Lustre: fir-OST0099: haven't heard from client 3660fc30-681e-46ab-b8d3-2cafe7916f15 (at 10.50.3.71@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e41d3215000, cur 1708283864 expire 1708283714 last 1708283637 [1475749.393679] Lustre: fir-OST009f: haven't heard from client 3660fc30-681e-46ab-b8d3-2cafe7916f15 (at 10.50.3.71@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e40e7c75800, cur 1708283870 expire 1708283720 last 1708283643 [1476283.351998] Lustre: fir-OST009f: haven't heard from client c7144cfd-3e26-42d1-9f2e-32eed6efe7ce (at 10.51.13.15@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e03b1f77c00, cur 1708284404 expire 1708284254 last 1708284177 [1476300.348564] Lustre: fir-OST009d: haven't heard from client c7144cfd-3e26-42d1-9f2e-32eed6efe7ce (at 10.51.13.15@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f1b51800, cur 1708284421 expire 1708284271 last 1708284194 [1476300.370697] Lustre: Skipped 2 previous similar messages [1480239.133161] Lustre: fir-OST009b: haven't heard from client 3d90a05a-6dfd-45c1-89b3-4622544be8cd (at 10.51.15.16@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01d2329400, cur 1708288360 expire 1708288210 last 1708288133 [1480246.124969] Lustre: fir-OST0099: haven't heard from client 3d90a05a-6dfd-45c1-89b3-4622544be8cd (at 10.51.15.16@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01c0fb1000, cur 1708288367 expire 1708288217 last 1708288140 [1480253.130051] Lustre: fir-OST009f: haven't heard from client 3d90a05a-6dfd-45c1-89b3-4622544be8cd (at 10.51.15.16@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dfbb732e800, cur 1708288374 expire 1708288224 last 1708288147 [1483289.956885] Lustre: fir-OST009d: haven't heard from client df85c788-2784-4868-8f88-2711f3b832b6 (at 10.51.16.5@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f0cbf000, cur 1708291411 expire 1708291261 last 1708291184 [1483289.980667] Lustre: Skipped 1 previous similar message [1483296.952921] Lustre: fir-OST009f: haven't heard from client df85c788-2784-4868-8f88-2711f3b832b6 (at 10.51.16.5@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e43ac1d8400, cur 1708291418 expire 1708291268 last 1708291191 [1483296.982285] Lustre: Skipped 1 previous similar message [1488100.679888] Lustre: fir-OST009f: haven't heard from client 7b1a38bb-9a77-443f-a752-4e8ecb8ad072 (at 10.51.9.36@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f213d000, cur 1708296222 expire 1708296072 last 1708295995 [1488100.701804] Lustre: Skipped 1 previous similar message [1488112.680330] Lustre: fir-OST009d: haven't heard from client 7b1a38bb-9a77-443f-a752-4e8ecb8ad072 (at 10.51.9.36@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f26c6800, cur 1708296234 expire 1708296084 last 1708296007 [1488112.702259] Lustre: Skipped 1 previous similar message [1488118.689590] Lustre: fir-OST009b: haven't heard from client 7b1a38bb-9a77-443f-a752-4e8ecb8ad072 (at 10.51.9.36@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e42dfe32800, cur 1708296240 expire 1708296090 last 1708296013 [1490131.569248] Lustre: fir-OST009f: haven't heard from client d7a49c1d-23ca-4e0b-8dd7-5aaaf85f53bd (at 10.51.2.15@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dff7fa26c00, cur 1708298253 expire 1708298103 last 1708298026 [1490148.566454] Lustre: fir-OST0099: haven't heard from client d7a49c1d-23ca-4e0b-8dd7-5aaaf85f53bd (at 10.51.2.15@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01d272d400, cur 1708298270 expire 1708298120 last 1708298043 [1490148.588326] Lustre: Skipped 1 previous similar message [1491706.481545] Lustre: fir-OST009f: haven't heard from client eb0a5889-4d5b-4225-93e3-102b174651d0 (at 10.51.13.15@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e41e6e48c00, cur 1708299828 expire 1708299678 last 1708299601 [1491706.503499] Lustre: Skipped 1 previous similar message [1491716.477916] Lustre: fir-OST009b: haven't heard from client eb0a5889-4d5b-4225-93e3-102b174651d0 (at 10.51.13.15@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e41e6e4bc00, cur 1708299838 expire 1708299688 last 1708299611 [1491716.499971] Lustre: Skipped 1 previous similar message [1497513.152751] Lustre: fir-OST009b: haven't heard from client 7d14b32c-0bb3-400a-971c-118a86247e15 (at 10.51.15.10@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02185e3c00, cur 1708305635 expire 1708305485 last 1708305408 [1497513.174922] Lustre: Skipped 1 previous similar message [1497516.152642] Lustre: fir-OST009d: haven't heard from client 7d14b32c-0bb3-400a-971c-118a86247e15 (at 10.51.15.10@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dff794ccc00, cur 1708305638 expire 1708305488 last 1708305411 [1497948.127164] Lustre: fir-OST009b: haven't heard from client 376a7f4c-e402-4d4f-a6f0-cc06adb37f5e (at 10.51.15.7@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e41d81dbc00, cur 1708306070 expire 1708305920 last 1708305843 [1497948.149105] Lustre: Skipped 2 previous similar messages [1497954.129204] Lustre: fir-OST009d: haven't heard from client 376a7f4c-e402-4d4f-a6f0-cc06adb37f5e (at 10.51.15.7@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e41d81dfc00, cur 1708306076 expire 1708305926 last 1708305849 [1497954.151068] Lustre: Skipped 2 previous similar messages [1498136.115005] Lustre: fir-OST009f: haven't heard from client 499f7ce1-b473-4c81-aba5-73dea75f7c7d (at 10.50.15.6@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dffffa52800, cur 1708306258 expire 1708306108 last 1708306031 [1498951.074791] Lustre: fir-OST009d: haven't heard from client 4c775707-b61a-4d25-be65-19d934d63631 (at 10.51.13.23@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33bc8e2000, cur 1708307073 expire 1708306923 last 1708306846 [1498951.096775] Lustre: Skipped 3 previous similar messages [1498958.070139] Lustre: fir-OST0099: haven't heard from client 4c775707-b61a-4d25-be65-19d934d63631 (at 10.51.13.23@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33b0f8a800, cur 1708307080 expire 1708306930 last 1708306853 [1498961.069915] Lustre: fir-OST009b: haven't heard from client 4c775707-b61a-4d25-be65-19d934d63631 (at 10.51.13.23@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e40f4bd3000, cur 1708307083 expire 1708306933 last 1708306856 [1499587.901954] md: md1: data-check done. [1499591.282983] md: md5: data-check done. [1499753.805287] md: md7: data-check done. [1499790.649591] md: md3: data-check done. [1502345.883540] Lustre: fir-OST009f: haven't heard from client a4a96ba6-2d59-4389-9b77-19e626139452 (at 10.51.9.28@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f2069800, cur 1708310468 expire 1708310318 last 1708310241 [1502345.905410] Lustre: Skipped 1 previous similar message [1515982.147961] Lustre: fir-OST0099: haven't heard from client c026a5d1-7b33-44d3-a12a-598576b06cab (at 10.51.17.9@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3349936000, cur 1708324105 expire 1708323955 last 1708323878 [1515982.169949] Lustre: Skipped 3 previous similar messages [1515997.145797] Lustre: fir-OST009b: haven't heard from client c026a5d1-7b33-44d3-a12a-598576b06cab (at 10.51.17.9@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e2f60355800, cur 1708324120 expire 1708323970 last 1708323893 [1515997.167667] Lustre: Skipped 2 previous similar messages [1524864.664475] Lustre: fir-OST0099: haven't heard from client 666c607d-0b1e-43c0-ac69-a6cb857a0518 (at 10.50.5.13@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e2f602f7800, cur 1708332988 expire 1708332838 last 1708332761 [1525662.620015] Lustre: fir-OST009d: haven't heard from client c6ac21f4-e6ca-4ab9-a57f-32b402071740 (at 10.51.12.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3fd09b2400, cur 1708333786 expire 1708333636 last 1708333559 [1525662.641995] Lustre: Skipped 3 previous similar messages [1533079.214843] Lustre: fir-OST0099: haven't heard from client 6a58a489-2908-4775-bd07-4bae719b069e (at 10.51.15.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dff74432c00, cur 1708341203 expire 1708341053 last 1708340976 [1533079.236903] Lustre: Skipped 3 previous similar messages [1533084.214422] Lustre: fir-OST009d: haven't heard from client 6a58a489-2908-4775-bd07-4bae719b069e (at 10.51.15.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9ded92fe5800, cur 1708341208 expire 1708341058 last 1708340981 [1533090.217451] Lustre: fir-OST009b: haven't heard from client 6a58a489-2908-4775-bd07-4bae719b069e (at 10.51.15.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df807f8a400, cur 1708341214 expire 1708341064 last 1708340987 [1533090.239321] Lustre: Skipped 1 previous similar message [1551167.228564] Lustre: fir-OST009b: haven't heard from client 0b4bae78-fccf-4b7c-8341-ecd28c3dead0 (at 10.51.14.15@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df965414400, cur 1708359292 expire 1708359142 last 1708359065 [1555348.006489] Lustre: fir-OST0099: haven't heard from client 37881936-d529-468f-a099-7c078e83c4eb (at 10.51.6.33@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e00c26c6800, cur 1708363473 expire 1708363323 last 1708363246 [1555353.011057] Lustre: fir-OST009b: haven't heard from client 37881936-d529-468f-a099-7c078e83c4eb (at 10.51.6.33@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e008d940400, cur 1708363478 expire 1708363328 last 1708363251 [1555353.033072] Lustre: Skipped 2 previous similar messages [1563059.580278] Lustre: fir-OST009d: haven't heard from client 43a2f42b-ccce-4ba1-ae88-bde90f734af1 (at 10.51.6.48@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e2f7231a400, cur 1708371185 expire 1708371035 last 1708370958 [1563072.586380] Lustre: fir-OST0099: haven't heard from client 43a2f42b-ccce-4ba1-ae88-bde90f734af1 (at 10.51.6.48@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e35bd240400, cur 1708371198 expire 1708371048 last 1708370971 [1568945.260632] Lustre: fir-OST009b: haven't heard from client 14b7bdf2-9347-4e23-9b0c-d8fd8e674666 (at 10.51.2.29@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dfd6d7a1400, cur 1708377071 expire 1708376921 last 1708376844 [1568945.282518] Lustre: Skipped 2 previous similar messages [1568952.259270] Lustre: fir-OST0099: haven't heard from client 14b7bdf2-9347-4e23-9b0c-d8fd8e674666 (at 10.51.2.29@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02137bb800, cur 1708377078 expire 1708376928 last 1708376851 [1576530.846938] Lustre: fir-OST009b: haven't heard from client 83be43c6-641d-4874-ae7e-f158027eef8f (at 10.51.2.39@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df966006000, cur 1708384657 expire 1708384507 last 1708384430 [1576530.868809] Lustre: Skipped 2 previous similar messages [1576535.847228] Lustre: fir-OST009d: haven't heard from client 83be43c6-641d-4874-ae7e-f158027eef8f (at 10.51.2.39@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02eebbc800, cur 1708384662 expire 1708384512 last 1708384435 [1576540.847526] Lustre: fir-OST009f: haven't heard from client 83be43c6-641d-4874-ae7e-f158027eef8f (at 10.51.2.39@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dff74e1fc00, cur 1708384667 expire 1708384517 last 1708384440 [1577857.780845] Lustre: fir-OST009f: haven't heard from client 836ab3c8-c947-4bb9-ae43-fa214612a796 (at 10.51.13.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dfe8c5eb800, cur 1708385984 expire 1708385834 last 1708385757 [1577857.802729] Lustre: Skipped 1 previous similar message [1577871.795545] Lustre: fir-OST0099: haven't heard from client 836ab3c8-c947-4bb9-ae43-fa214612a796 (at 10.51.13.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dfe8c5e8400, cur 1708385998 expire 1708385848 last 1708385771 [1577871.817562] Lustre: Skipped 2 previous similar messages [1577947.782455] Lustre: fir-OST0099: haven't heard from client 364fae92-90b5-45fa-b3f3-038bc9575fed (at 10.51.12.8@o2ib3) in 168 seconds. I think it's dead, and I am evicting it. exp ffff9e3fd0906800, cur 1708386074 expire 1708385924 last 1708385906 [1577965.665881] Lustre: 46802:0:(client.c:2295:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1708385963/real 1708385963] req@ffff9e26e7f7cc80 x1789752395223168/t0(0) o106->fir-OST009f@10.51.12.8@o2ib3:15/16 lens 328/280 e 0 to 1 dl 1708386091 ref 1 fl Rpc:XQr/0/ffffffff rc 0/-1 job:'' [1578021.229890] Lustre: 46918:0:(client.c:2295:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1708386019/real 1708386019] req@ffff9dec2dd2ec00 x1789752395957888/t0(0) o106->fir-OST009f@10.51.12.8@o2ib3:15/16 lens 328/280 e 0 to 1 dl 1708386147 ref 1 fl Rpc:XQr/0/ffffffff rc 0/-1 job:'' [1578022.768605] Lustre: fir-OST009d: haven't heard from client 364fae92-90b5-45fa-b3f3-038bc9575fed (at 10.51.12.8@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e290b9d4c00, cur 1708386149 expire 1708385999 last 1708385922 [1581056.609955] Lustre: fir-OST009d: haven't heard from client 06d8daff-296a-4452-9c3d-7806a090cade (at 10.50.17.40@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df9723bac00, cur 1708389183 expire 1708389033 last 1708388956 [1581056.631915] Lustre: Skipped 2 previous similar messages [1585727.361459] Lustre: fir-OST009d: haven't heard from client 09607b6d-2ffe-408f-aaad-e8460fcb3aac (at 10.50.12.13@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df9d57f8400, cur 1708393854 expire 1708393704 last 1708393627 [1585727.383424] Lustre: Skipped 2 previous similar messages [1585745.348927] Lustre: fir-OST009f: haven't heard from client 09607b6d-2ffe-408f-aaad-e8460fcb3aac (at 10.50.12.13@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df994fd5400, cur 1708393872 expire 1708393722 last 1708393645 [1586419.318793] Lustre: fir-OST0099: haven't heard from client bd1d77c4-ec96-4f14-8dae-78dbd73c189e (at 10.51.2.68@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33c322f800, cur 1708394546 expire 1708394396 last 1708394319 [1586419.340660] Lustre: Skipped 2 previous similar messages [1586428.312431] Lustre: fir-OST009f: haven't heard from client bd1d77c4-ec96-4f14-8dae-78dbd73c189e (at 10.51.2.68@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e2fc45f1c00, cur 1708394555 expire 1708394405 last 1708394328 [1611892.934312] Lustre: fir-OST009f: haven't heard from client c575d924-d8d1-44a8-992a-fbdbcef48a29 (at 10.51.9.40@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e0080d80400, cur 1708420021 expire 1708419871 last 1708419794 [1611892.956185] Lustre: Skipped 2 previous similar messages [1614702.789221] Lustre: fir-OST009f: haven't heard from client e99bcf6a-3b16-4761-8782-91aef7cda90d (at 10.51.2.65@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df96261dc00, cur 1708422831 expire 1708422681 last 1708422604 [1614702.811094] Lustre: Skipped 3 previous similar messages [1614712.777953] Lustre: fir-OST0099: haven't heard from client e99bcf6a-3b16-4761-8782-91aef7cda90d (at 10.51.2.65@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df304618c00, cur 1708422841 expire 1708422691 last 1708422614 [1614717.780989] Lustre: fir-OST009d: haven't heard from client e99bcf6a-3b16-4761-8782-91aef7cda90d (at 10.51.2.65@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df966bce400, cur 1708422846 expire 1708422696 last 1708422619 [1617886.612008] Lustre: fir-OST009d: haven't heard from client 5e029931-8dfa-4db2-9969-96651f3a0638 (at 10.51.13.9@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e2f21339800, cur 1708426015 expire 1708425865 last 1708425788 [1617886.633884] Lustre: Skipped 1 previous similar message [1617892.605797] Lustre: fir-OST0099: haven't heard from client 5e029931-8dfa-4db2-9969-96651f3a0638 (at 10.51.13.9@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e40a9252c00, cur 1708426021 expire 1708425871 last 1708425794 [1617892.627671] Lustre: Skipped 1 previous similar message [1618883.552027] Lustre: fir-OST009d: haven't heard from client 76fd94b3-9392-4210-8f7f-6b787444e701 (at 10.51.13.9@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e41cde72c00, cur 1708427012 expire 1708426862 last 1708426785 [1618883.573895] Lustre: Skipped 1 previous similar message [1628964.007558] Lustre: fir-OST0099: haven't heard from client a2b9703c-94c8-4877-ae36-aabc46b9db40 (at 10.51.3.31@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e2f62138800, cur 1708437093 expire 1708436943 last 1708436866 [1628964.029434] Lustre: Skipped 3 previous similar messages [1629650.971737] Lustre: fir-OST009b: haven't heard from client 45c42b9e-3538-4ab5-b5aa-250c50514055 (at 10.51.13.9@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e40a873d400, cur 1708437780 expire 1708437630 last 1708437553 [1629650.993611] Lustre: Skipped 3 previous similar messages [1630324.935307] Lustre: fir-OST009b: haven't heard from client 3c5fe065-eab2-4ad2-9720-3ab0a160413a (at 10.51.13.9@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33d2d32000, cur 1708438454 expire 1708438304 last 1708438227 [1630324.957623] Lustre: Skipped 3 previous similar messages [1631083.893030] Lustre: fir-OST009f: haven't heard from client b4ba2684-829f-4973-8de9-7f8b44e07397 (at 10.51.13.9@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3c53ead800, cur 1708439213 expire 1708439063 last 1708438986 [1631083.914898] Lustre: Skipped 3 previous similar messages [1631802.856975] Lustre: fir-OST0099: haven't heard from client e2af3bf8-aa2e-472c-9d37-a5e73eb239f7 (at 10.51.13.9@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33b8543800, cur 1708439932 expire 1708439782 last 1708439705 [1631802.878987] Lustre: Skipped 3 previous similar messages [1632050.854665] Lustre: fir-OST009d: haven't heard from client f963a20c-b055-4bf8-b44b-e5e17a4058ad (at 10.51.8.9@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f0cbd000, cur 1708440180 expire 1708440030 last 1708439953 [1632050.876607] Lustre: Skipped 3 previous similar messages [1632056.840709] Lustre: fir-OST009b: haven't heard from client f963a20c-b055-4bf8-b44b-e5e17a4058ad (at 10.51.8.9@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e439cdb5400, cur 1708440186 expire 1708440036 last 1708439959 [1632064.840330] Lustre: fir-OST0099: haven't heard from client f963a20c-b055-4bf8-b44b-e5e17a4058ad (at 10.51.8.9@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02ee4e2800, cur 1708440194 expire 1708440044 last 1708439967 [1640357.390154] Lustre: fir-OST009d: haven't heard from client b23cacb7-4060-4786-9dc7-a7646bc32815 (at 10.51.7.28@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df3b3959400, cur 1708448487 expire 1708448337 last 1708448260 [1640357.412061] Lustre: Skipped 1 previous similar message [1640433.386040] Lustre: fir-OST009d: haven't heard from client 9eb46bb8-74c2-48b6-bb32-b78e51642923 (at 10.51.4.20@o2ib3) in 177 seconds. I think it's dead, and I am evicting it. exp ffff9e2f626e5400, cur 1708448563 expire 1708448413 last 1708448386 [1640433.407909] Lustre: Skipped 19 previous similar messages [1640509.386232] Lustre: fir-OST009d: haven't heard from client 9e70770e-1440-4932-8d11-638143f51dcf (at 10.50.8.52@o2ib2) in 223 seconds. I think it's dead, and I am evicting it. exp ffff9e33bf3c2c00, cur 1708448639 expire 1708448489 last 1708448416 [1640509.408105] Lustre: Skipped 15 previous similar messages [1647882.980521] Lustre: fir-OST0099: haven't heard from client 7c4799d0-0537-484e-87a0-665502a7c67f (at 10.51.8.3@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df3b5fd5c00, cur 1708456013 expire 1708455863 last 1708455786 [1647883.002388] Lustre: Skipped 3 previous similar messages [1648695.945394] Lustre: fir-OST0099: haven't heard from client 4e54f836-3eea-4e5d-94a9-78d107c6596f (at 10.51.17.14@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df3b5c4d000, cur 1708456826 expire 1708456676 last 1708456599 [1648695.967419] Lustre: Skipped 3 previous similar messages [1648701.936564] Lustre: fir-OST009b: haven't heard from client 4e54f836-3eea-4e5d-94a9-78d107c6596f (at 10.51.17.14@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df314ef0c00, cur 1708456832 expire 1708456682 last 1708456605 [1648708.936909] Lustre: fir-OST009d: haven't heard from client 4e54f836-3eea-4e5d-94a9-78d107c6596f (at 10.51.17.14@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e03b8258000, cur 1708456839 expire 1708456689 last 1708456612 [1648708.958982] Lustre: Skipped 1 previous similar message [1652078.753005] Lustre: fir-OST0099: haven't heard from client 1679c1e3-18b0-4b04-8c07-48b97b8d0e99 (at 10.51.15.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01fcb4b800, cur 1708460209 expire 1708460059 last 1708459982 [1652084.778304] Lustre: fir-OST009f: haven't heard from client 1679c1e3-18b0-4b04-8c07-48b97b8d0e99 (at 10.51.15.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9ded92f9f400, cur 1708460215 expire 1708460065 last 1708459988 [1652084.800564] Lustre: Skipped 2 previous similar messages [1653460.678649] Lustre: fir-OST009d: haven't heard from client b2f6f18d-2daa-444c-8ce2-edf518b574ec (at 10.51.12.2@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33ccab2400, cur 1708461591 expire 1708461441 last 1708461364 [1653474.678401] Lustre: fir-OST0099: haven't heard from client b2f6f18d-2daa-444c-8ce2-edf518b574ec (at 10.51.12.2@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e2f51a54000, cur 1708461605 expire 1708461455 last 1708461378 [1653474.700418] Lustre: Skipped 1 previous similar message [1653519.038176] LustreError: 137-5: fir-OST0098_UUID: not available for connect from 10.51.12.1@o2ib3 (no target). If you are running an HA pair check that the target is mounted on the other server. [1653519.055634] LustreError: Skipped 3 previous similar messages [1653524.054002] Lustre: fir-OST009d: Client 8b9f4dd0-cd8c-4fc8-b603-e9e43831204a (at 10.51.12.1@o2ib3) reconnecting [1653524.064260] Lustre: Skipped 5 previous similar messages [1654312.632285] Lustre: fir-OST009d: haven't heard from client 25be5b6d-b6f1-448a-892a-71aaee331cc2 (at 10.51.17.2@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f1abc400, cur 1708462443 expire 1708462293 last 1708462216 [1654312.654159] Lustre: Skipped 1 previous similar message [1654313.632705] Lustre: fir-OST009b: haven't heard from client 25be5b6d-b6f1-448a-892a-71aaee331cc2 (at 10.51.17.2@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e42c9ef4c00, cur 1708462444 expire 1708462294 last 1708462217 [1654313.654754] Lustre: Skipped 2 previous similar messages [1657333.469917] Lustre: fir-OST009f: haven't heard from client f0e623db-3be6-4821-a424-4a794c026f0f (at 10.51.7.60@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dff746bfc00, cur 1708465464 expire 1708465314 last 1708465237 [1658321.040351] Lustre: 46826:0:(client.c:2295:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1708466323/real 1708466323] req@ffff9deb61d80d80 x1789754625935104/t0(0) o106->fir-OST009f@10.51.9.12@o2ib3:15/16 lens 328/280 e 0 to 1 dl 1708466451 ref 1 fl Rpc:XQr/0/ffffffff rc 0/-1 job:'' [1658391.412058] Lustre: fir-OST009d: haven't heard from client 2b715e5d-861e-4811-9ea5-20d7319cde12 (at 10.51.9.12@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01e770c000, cur 1708466522 expire 1708466372 last 1708466295 [1658391.433934] Lustre: Skipped 3 previous similar messages [1658393.496395] ptlrpc_watchdog_fire: 6 callbacks suppressed [1658393.501909] Lustre: ll_ost01_046: service thread pid 46826 was inactive for 200.462 seconds. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes: [1658393.521106] Pid: 46826, comm: ll_ost01_046 3.10.0-1160.108.1.el7_lustre.pl1.x86_64 #1 SMP Fri Jan 26 11:26:38 PST 2024 [1658393.531979] Call Trace: [1658393.534644] [<0>] ptlrpc_set_wait+0x7b7/0x840 [ptlrpc] [1658393.539974] [<0>] ldlm_run_ast_work+0xd5/0x3e0 [ptlrpc] [1658393.545399] [<0>] ldlm_glimpse_locks+0x38/0x110 [ptlrpc] [1658393.550898] [<0>] ofd_intent_policy+0x78b/0xa50 [ofd] [1658393.556145] [<0>] ldlm_lock_enqueue+0x3d5/0xb60 [ptlrpc] [1658393.561654] [<0>] ldlm_handle_enqueue0+0x8d6/0x1770 [ptlrpc] [1658393.567521] [<0>] tgt_enqueue+0x64/0x250 [ptlrpc] [1658393.572430] [<0>] tgt_request_handle+0x93f/0x19d0 [ptlrpc] [1658393.578278] [<0>] ptlrpc_server_handle_request+0x253/0xc30 [ptlrpc] [1658393.584752] [<0>] ptlrpc_main+0xbf4/0x15e0 [ptlrpc] [1658393.589815] [<0>] kthread+0xd1/0xe0 [1658393.593484] [<0>] ret_from_fork_nospec_begin+0x7/0x21 [1658393.598908] [<0>] 0xfffffffffffffffe [1658408.411279] Lustre: fir-OST009f: haven't heard from client 2b715e5d-861e-4811-9ea5-20d7319cde12 (at 10.51.9.12@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02135e9c00, cur 1708466539 expire 1708466389 last 1708466312 [1658408.433148] Lustre: Skipped 2 previous similar messages [1658699.392861] Lustre: fir-OST009d: haven't heard from client 231a8a81-6b32-4dc3-974c-e55c664f47c3 (at 10.51.7.55@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33baf83c00, cur 1708466830 expire 1708466680 last 1708466603 [1658708.398728] Lustre: fir-OST009f: haven't heard from client 231a8a81-6b32-4dc3-974c-e55c664f47c3 (at 10.51.7.55@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33db2cc400, cur 1708466839 expire 1708466689 last 1708466612 [1658708.420605] Lustre: Skipped 2 previous similar messages [1658880.397039] Lustre: fir-OST009f: haven't heard from client 0b79918a-5e27-468d-9a4a-e6fb4dc340bb (at 10.50.4.72@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f202e400, cur 1708467011 expire 1708466861 last 1708466784 [1658896.396227] Lustre: fir-OST009b: haven't heard from client 0b79918a-5e27-468d-9a4a-e6fb4dc340bb (at 10.50.4.72@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e42ca35a400, cur 1708467027 expire 1708466877 last 1708466800 [1658896.418286] Lustre: Skipped 1 previous similar message [1660457.297148] Lustre: fir-OST009d: haven't heard from client 9257ac8c-aff4-495e-9c83-0ecdb48d4628 (at 10.51.10.3@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df97e78f400, cur 1708468588 expire 1708468438 last 1708468361 [1660457.319014] Lustre: Skipped 1 previous similar message [1660464.306185] Lustre: fir-OST009f: haven't heard from client 9257ac8c-aff4-495e-9c83-0ecdb48d4628 (at 10.51.10.3@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dfd6d1cc000, cur 1708468595 expire 1708468445 last 1708468368 [1660464.328082] Lustre: Skipped 2 previous similar messages [1660734.283474] Lustre: fir-OST009d: haven't heard from client 43801eb9-2227-43a6-b28e-823c05f132b0 (at 10.51.10.36@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e414c2e3800, cur 1708468865 expire 1708468715 last 1708468638 [1660746.282566] Lustre: fir-OST0099: haven't heard from client 43801eb9-2227-43a6-b28e-823c05f132b0 (at 10.51.10.36@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e41c2f4a000, cur 1708468877 expire 1708468727 last 1708468650 [1660810.298520] Lustre: fir-OST009d: haven't heard from client 643fbe2d-bf68-43f1-98b9-8958177e315d (at 10.51.7.53@o2ib3) in 214 seconds. I think it's dead, and I am evicting it. exp ffff9e3c52a33000, cur 1708468941 expire 1708468791 last 1708468727 [1660810.320401] Lustre: Skipped 2 previous similar messages [1661517.239134] Lustre: fir-OST009b: haven't heard from client 5df60bc2-6708-43d4-9464-e27f2ac28174 (at 10.51.17.3@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e2914526400, cur 1708469648 expire 1708469498 last 1708469421 [1661517.261015] Lustre: Skipped 3 previous similar messages [1661721.228363] Lustre: fir-OST009b: haven't heard from client c3544c3e-6cd0-40af-9140-c0d02f131dee (at 10.50.7.72@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01c6890800, cur 1708469852 expire 1708469702 last 1708469625 [1661721.250243] Lustre: Skipped 3 previous similar messages [1661909.220321] Lustre: fir-OST009b: haven't heard from client d0d3c121-28a5-407e-8503-23a6af75f059 (at 10.50.4.27@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dff7701dc00, cur 1708470040 expire 1708469890 last 1708469813 [1661909.242193] Lustre: Skipped 3 previous similar messages [1661985.214303] Lustre: fir-OST009b: haven't heard from client 94965d76-6a02-4648-89d8-c9297c64ae8d (at 10.50.12.8@o2ib2) in 216 seconds. I think it's dead, and I am evicting it. exp ffff9e33ba66e400, cur 1708470116 expire 1708469966 last 1708469900 [1661985.236175] Lustre: Skipped 5 previous similar messages [1664600.079708] Lustre: fir-OST009d: haven't heard from client 9965622a-41c2-4afc-b6c5-097aaf281963 (at 10.51.13.19@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f1aa9400, cur 1708472731 expire 1708472581 last 1708472504 [1664600.101669] Lustre: Skipped 2 previous similar messages [1664605.103288] Lustre: fir-OST009b: haven't heard from client 9965622a-41c2-4afc-b6c5-097aaf281963 (at 10.51.13.19@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e43638e9c00, cur 1708472736 expire 1708472586 last 1708472509 [1666839.950171] Lustre: fir-OST009b: haven't heard from client f127776e-6f8b-48a4-a504-68867ea739a5 (at 10.51.17.3@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e2f605b9400, cur 1708474971 expire 1708474821 last 1708474744 [1666839.972041] Lustre: Skipped 2 previous similar messages [1667311.931705] Lustre: fir-OST009f: haven't heard from client 09c41345-d5c3-4d2c-a79d-98516ec33c2a (at 10.51.14.10@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e2f38479400, cur 1708475443 expire 1708475293 last 1708475216 [1667311.953661] Lustre: Skipped 3 previous similar messages [1667318.922997] Lustre: fir-OST0099: haven't heard from client 09c41345-d5c3-4d2c-a79d-98516ec33c2a (at 10.51.14.10@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3f72d9cc00, cur 1708475450 expire 1708475300 last 1708475223 [1667318.944968] Lustre: Skipped 2 previous similar messages [1669350.813210] Lustre: fir-OST009b: haven't heard from client e517f73b-4f26-4e94-be7c-c4f3b00acc81 (at 10.51.15.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02184ba400, cur 1708477482 expire 1708477332 last 1708477255 [1669350.835082] Lustre: Skipped 8 previous similar messages [1672024.667288] Lustre: fir-OST0099: haven't heard from client 9d4801de-e638-46bb-87b4-2c2caa686da3 (at 10.50.6.33@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01effd4000, cur 1708480156 expire 1708480006 last 1708479929 [1672024.689313] Lustre: Skipped 3 previous similar messages [1672969.617643] Lustre: fir-OST0099: haven't heard from client 5459558f-2a43-4854-ab18-e1f06614563c (at 10.51.13.9@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e28caa5c000, cur 1708481101 expire 1708480951 last 1708480874 [1672969.639604] Lustre: Skipped 15 previous similar messages [1673141.612119] Lustre: fir-OST009b: haven't heard from client 739f89f3-dab2-4e89-8034-d838a58ea163 (at 10.50.6.14@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e4198f74000, cur 1708481273 expire 1708481123 last 1708481046 [1673141.633993] Lustre: Skipped 3 previous similar messages [1673146.607399] Lustre: fir-OST0099: haven't heard from client 739f89f3-dab2-4e89-8034-d838a58ea163 (at 10.50.6.14@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3f7dd31c00, cur 1708481278 expire 1708481128 last 1708481051 [1673146.629646] Lustre: Skipped 1 previous similar message [1673152.609369] Lustre: fir-OST009d: haven't heard from client 739f89f3-dab2-4e89-8034-d838a58ea163 (at 10.50.6.14@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3f7dd35000, cur 1708481284 expire 1708481134 last 1708481057 [1675331.486923] Lustre: fir-OST009f: haven't heard from client 927a83aa-9240-4649-b46f-88987debdf76 (at 10.51.4.35@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df3b1e17000, cur 1708483463 expire 1708483313 last 1708483236 [1675336.492924] Lustre: fir-OST0099: haven't heard from client 927a83aa-9240-4649-b46f-88987debdf76 (at 10.51.4.35@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e0253a1a800, cur 1708483468 expire 1708483318 last 1708483241 [1675336.514810] Lustre: Skipped 1 previous similar message [1675345.488173] Lustre: fir-OST009d: haven't heard from client 927a83aa-9240-4649-b46f-88987debdf76 (at 10.51.4.35@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df3b1e16400, cur 1708483477 expire 1708483327 last 1708483250 [1679579.257657] Lustre: fir-OST009b: haven't heard from client 286a24ef-7283-4cfe-83a1-e068e9dcebbe (at 10.51.6.43@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e0225ee0400, cur 1708487711 expire 1708487561 last 1708487484 [1679586.254289] Lustre: fir-OST009d: haven't heard from client 286a24ef-7283-4cfe-83a1-e068e9dcebbe (at 10.51.6.43@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df983222400, cur 1708487718 expire 1708487568 last 1708487491 [1679592.269257] Lustre: fir-OST009f: haven't heard from client 286a24ef-7283-4cfe-83a1-e068e9dcebbe (at 10.51.6.43@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e0222a35400, cur 1708487724 expire 1708487574 last 1708487497 [1679599.253292] Lustre: fir-OST0099: haven't heard from client 286a24ef-7283-4cfe-83a1-e068e9dcebbe (at 10.51.6.43@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01c4a02800, cur 1708487731 expire 1708487581 last 1708487504 [1680101.226095] Lustre: fir-OST009f: haven't heard from client dfaee85f-6234-4df2-af20-c4c402c9164d (at 10.50.14.13@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01ad63fc00, cur 1708488233 expire 1708488083 last 1708488006 [1680177.223633] Lustre: fir-OST0099: haven't heard from client 99704c6a-8c40-4bce-baed-0a552baa8f89 (at 10.51.2.70@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33bd9aa000, cur 1708488309 expire 1708488159 last 1708488082 [1680177.245509] Lustre: Skipped 1 previous similar message [1680253.217765] Lustre: fir-OST009d: haven't heard from client b5bb52ef-5f08-434a-bcac-392532d76e5e (at 10.51.2.35@o2ib3) in 212 seconds. I think it's dead, and I am evicting it. exp ffff9e007c246400, cur 1708488385 expire 1708488235 last 1708488173 [1680253.239642] Lustre: Skipped 10 previous similar messages [1680329.213676] Lustre: fir-OST0099: haven't heard from client acc556b4-ad69-4424-9777-dac3d2a4a44a (at 10.51.2.62@o2ib3) in 223 seconds. I think it's dead, and I am evicting it. exp ffff9e40ea6d9c00, cur 1708488461 expire 1708488311 last 1708488238 [1680329.235560] Lustre: Skipped 9 previous similar messages [1680405.212904] Lustre: fir-OST0099: haven't heard from client 2c349007-38dc-4f2a-923c-45dbdc08d2f0 (at 10.51.10.22@o2ib3) in 219 seconds. I think it's dead, and I am evicting it. exp ffff9e40e1655400, cur 1708488537 expire 1708488387 last 1708488318 [1680405.234860] Lustre: Skipped 15 previous similar messages [1680570.204104] Lustre: fir-OST009d: haven't heard from client b0df4011-68da-4a70-8b4c-16e1a4906221 (at 10.51.10.11@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df96f64a400, cur 1708488702 expire 1708488552 last 1708488475 [1680570.226169] Lustre: Skipped 39 previous similar messages [1680864.208585] Lustre: fir-OST009f: haven't heard from client 78aa1f5b-a520-47d8-9a5f-662ca3202868 (at 10.51.6.43@o2ib3) in 205 seconds. I think it's dead, and I am evicting it. exp ffff9dff76a25c00, cur 1708488996 expire 1708488846 last 1708488791 [1680864.230471] Lustre: Skipped 42 previous similar messages [1681430.163793] Lustre: fir-OST009b: haven't heard from client 173aecea-e9d9-4f51-ae1f-729b24595db0 (at 10.51.5.71@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e43aca2e400, cur 1708489562 expire 1708489412 last 1708489335 [1681430.185884] Lustre: Skipped 16 previous similar messages [1682759.082598] Lustre: fir-OST009f: haven't heard from client da4d6bf8-dc38-4e80-b0a6-bca92d3f0848 (at 10.51.1.37@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33bfa1ec00, cur 1708490891 expire 1708490741 last 1708490664 [1682759.104622] Lustre: Skipped 14 previous similar messages [1683267.058171] Lustre: fir-OST009b: haven't heard from client 1c9de687-060d-4d37-ae12-b11f0f9d22ff (at 10.51.10.63@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e0008eb4000, cur 1708491399 expire 1708491249 last 1708491172 [1683267.080133] Lustre: Skipped 3 previous similar messages [1683632.034487] Lustre: fir-OST009b: haven't heard from client 756121df-3988-4958-82a8-21e9cc0008c1 (at 10.51.6.35@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df3ae851400, cur 1708491764 expire 1708491614 last 1708491537 [1683632.056625] Lustre: Skipped 3 previous similar messages [1684100.011624] Lustre: fir-OST009f: haven't heard from client 8fa2280f-2883-4d03-a9dc-05109b95b63d (at 10.51.6.39@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e033813e400, cur 1708492232 expire 1708492082 last 1708492005 [1684100.033933] Lustre: Skipped 7 previous similar messages [1685358.943979] Lustre: fir-OST009f: haven't heard from client 7b96cb64-532a-4b51-8557-498293844c5b (at 10.51.2.40@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e324c843000, cur 1708493491 expire 1708493341 last 1708493264 [1685358.965850] Lustre: Skipped 7 previous similar messages [1685715.921994] Lustre: fir-OST009f: haven't heard from client 14cc157c-fa0c-49de-b737-3c9b97778f15 (at 10.51.2.27@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dfd50f6f000, cur 1708493848 expire 1708493698 last 1708493621 [1685715.943863] Lustre: Skipped 3 previous similar messages [1686165.899694] Lustre: fir-OST009f: haven't heard from client fa4a622a-c891-4704-a183-3c9e387f05bd (at 10.51.2.28@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3fcc642000, cur 1708494298 expire 1708494148 last 1708494071 [1686165.922203] Lustre: Skipped 3 previous similar messages [1687118.846808] Lustre: fir-OST009b: haven't heard from client 4f395f5c-f1f3-42a5-8725-a7b96de76a26 (at 10.51.15.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dfd6d9e5c00, cur 1708495251 expire 1708495101 last 1708495024 [1687118.868684] Lustre: Skipped 7 previous similar messages [1688748.765109] Lustre: fir-OST0099: haven't heard from client 27b779ed-884c-4c1f-b10a-5d02c7d7ccf9 (at 10.50.9.8@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02ee5d8400, cur 1708496881 expire 1708496731 last 1708496654 [1688748.786897] Lustre: Skipped 3 previous similar messages [1688755.761719] Lustre: fir-OST009b: haven't heard from client 27b779ed-884c-4c1f-b10a-5d02c7d7ccf9 (at 10.50.9.8@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e42e9aa1000, cur 1708496888 expire 1708496738 last 1708496661 [1692362.565086] Lustre: fir-OST0099: haven't heard from client 3ccef97a-b207-45e3-9ebe-3bea8f12cda8 (at 10.51.6.50@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e41dbbd4c00, cur 1708500495 expire 1708500345 last 1708500268 [1692362.586952] Lustre: Skipped 2 previous similar messages [1692380.557819] Lustre: fir-OST009f: haven't heard from client 3ccef97a-b207-45e3-9ebe-3bea8f12cda8 (at 10.51.6.50@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33cf587000, cur 1708500513 expire 1708500363 last 1708500286 [1692380.579695] Lustre: Skipped 2 previous similar messages [1694539.454302] Lustre: fir-OST0099: haven't heard from client aba2e5f1-f683-499b-9f64-d247f5586a5d (at 10.51.15.3@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33cd1ee000, cur 1708502672 expire 1708502522 last 1708502445 [1694544.439235] Lustre: fir-OST009b: haven't heard from client aba2e5f1-f683-499b-9f64-d247f5586a5d (at 10.51.15.3@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3f7c48a000, cur 1708502677 expire 1708502527 last 1708502450 [1694544.461111] Lustre: Skipped 1 previous similar message [1695799.374058] Lustre: fir-OST009b: haven't heard from client ff5df242-df56-4b2e-8d39-acdd35165d7f (at 10.51.5.51@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e40ab658000, cur 1708503932 expire 1708503782 last 1708503705 [1695799.395942] Lustre: Skipped 5 previous similar messages [1695804.371003] Lustre: fir-OST009d: haven't heard from client ff5df242-df56-4b2e-8d39-acdd35165d7f (at 10.51.5.51@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e40ab65f800, cur 1708503937 expire 1708503787 last 1708503710 [1695809.369722] Lustre: fir-OST0099: haven't heard from client ff5df242-df56-4b2e-8d39-acdd35165d7f (at 10.51.5.51@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33bb35c800, cur 1708503942 expire 1708503792 last 1708503715 [1695814.371179] Lustre: fir-OST009f: haven't heard from client ff5df242-df56-4b2e-8d39-acdd35165d7f (at 10.51.5.51@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e413e309400, cur 1708503947 expire 1708503797 last 1708503720 [1696837.314591] Lustre: fir-OST0099: haven't heard from client 67959612-5d36-4cae-a788-0a033fea2953 (at 10.51.16.2@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33c9eca800, cur 1708504970 expire 1708504820 last 1708504743 [1696849.315616] Lustre: fir-OST009d: haven't heard from client 67959612-5d36-4cae-a788-0a033fea2953 (at 10.51.16.2@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e2f61d85000, cur 1708504982 expire 1708504832 last 1708504755 [1696849.337943] Lustre: Skipped 1 previous similar message [1697755.270271] Lustre: fir-OST009b: haven't heard from client 21e437b2-4af2-427a-9116-75d9851dca3f (at 10.50.1.55@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e42c9712800, cur 1708505888 expire 1708505738 last 1708505661 [1697755.292144] Lustre: Skipped 1 previous similar message [1697767.271183] Lustre: fir-OST009f: haven't heard from client 21e437b2-4af2-427a-9116-75d9851dca3f (at 10.50.1.55@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f276bc00, cur 1708505900 expire 1708505750 last 1708505673 [1697767.293050] Lustre: Skipped 1 previous similar message [1698290.244113] Lustre: fir-OST0099: haven't heard from client adfdc673-334b-460a-af09-d94d6673547b (at 10.51.1.26@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02107ea800, cur 1708506423 expire 1708506273 last 1708506196 [1698290.265991] Lustre: Skipped 1 previous similar message [1698301.233908] Lustre: fir-OST009f: haven't heard from client adfdc673-334b-460a-af09-d94d6673547b (at 10.51.1.26@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df97249cc00, cur 1708506434 expire 1708506284 last 1708506207 [1698564.221367] Lustre: fir-OST009d: haven't heard from client 5e17bc53-de6c-4d05-9afe-598ea56f9290 (at 10.51.8.32@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3e88429c00, cur 1708506697 expire 1708506547 last 1708506470 [1698564.243238] Lustre: Skipped 2 previous similar messages [1699502.168754] Lustre: fir-OST009d: haven't heard from client 3545d85a-ee51-4e90-ad9e-28bd6b486042 (at 10.51.7.62@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df96dc3c400, cur 1708507635 expire 1708507485 last 1708507408 [1699502.190621] Lustre: Skipped 3 previous similar messages [1699951.146108] Lustre: fir-OST009b: haven't heard from client b429e78a-651b-4641-b864-0539e3b4f961 (at 10.51.1.51@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e2f60393800, cur 1708508084 expire 1708507934 last 1708507857 [1699951.167985] Lustre: Skipped 3 previous similar messages [1699964.144229] Lustre: fir-OST0099: haven't heard from client b429e78a-651b-4641-b864-0539e3b4f961 (at 10.51.1.51@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33d79be400, cur 1708508097 expire 1708507947 last 1708507870 [1699970.145551] Lustre: fir-OST009d: haven't heard from client b429e78a-651b-4641-b864-0539e3b4f961 (at 10.51.1.51@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33cce3dc00, cur 1708508103 expire 1708507953 last 1708507876 [1702248.019749] Lustre: fir-OST0099: haven't heard from client 286a3934-1a79-4098-a3e9-e28f38fcad8d (at 10.51.1.12@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02064d8000, cur 1708510381 expire 1708510231 last 1708510154 [1702248.041624] Lustre: Skipped 1 previous similar message [1702257.022001] Lustre: fir-OST009f: haven't heard from client 286a3934-1a79-4098-a3e9-e28f38fcad8d (at 10.51.1.12@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02ee657400, cur 1708510390 expire 1708510240 last 1708510163 [1702257.043884] Lustre: Skipped 1 previous similar message [1703413.955779] Lustre: fir-OST009f: haven't heard from client f88660fb-7a55-48cd-bd26-61d61b3854be (at 10.51.5.55@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e43ac1d8000, cur 1708511547 expire 1708511397 last 1708511320 [1703413.978065] Lustre: Skipped 1 previous similar message [1703489.954436] Lustre: fir-OST009f: haven't heard from client 4514ea98-6b20-41bd-a030-ae11bb4bc404 (at 10.51.7.58@o2ib3) in 222 seconds. I think it's dead, and I am evicting it. exp ffff9df975cb5400, cur 1708511623 expire 1708511473 last 1708511401 [1703489.976317] Lustre: Skipped 6 previous similar messages [1705590.837220] Lustre: fir-OST009b: haven't heard from client 58acf4bd-130e-49fe-a822-9ff37515fc19 (at 10.50.4.61@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e022292d000, cur 1708513724 expire 1708513574 last 1708513497 [1707723.721379] Lustre: fir-OST009d: haven't heard from client 5e9c2fea-12e3-4eeb-90fb-602bb49a7441 (at 10.51.4.19@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df3c21bc400, cur 1708515857 expire 1708515707 last 1708515630 [1707731.727584] Lustre: fir-OST009b: haven't heard from client 5e9c2fea-12e3-4eeb-90fb-602bb49a7441 (at 10.51.4.19@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e008e137000, cur 1708515865 expire 1708515715 last 1708515638 [1707731.749782] Lustre: Skipped 2 previous similar messages [1709966.602522] Lustre: fir-OST009d: haven't heard from client 7b34a1be-16bb-4651-9f7b-aadb71268c86 (at 10.51.6.36@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e2f62785000, cur 1708518100 expire 1708517950 last 1708517873 [1709980.601653] Lustre: fir-OST009f: haven't heard from client 7b34a1be-16bb-4651-9f7b-aadb71268c86 (at 10.51.6.36@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3fe14fb400, cur 1708518114 expire 1708517964 last 1708517887 [1713084.429227] Lustre: fir-OST009f: haven't heard from client eab67405-1be7-491a-b264-f1874526fbd2 (at 10.51.13.16@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e013a667000, cur 1708521218 expire 1708521068 last 1708520991 [1713084.451195] Lustre: Skipped 2 previous similar messages [1713097.430032] Lustre: fir-OST009b: haven't heard from client eab67405-1be7-491a-b264-f1874526fbd2 (at 10.51.13.16@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e0116919c00, cur 1708521231 expire 1708521081 last 1708521004 [1713097.452112] Lustre: Skipped 1 previous similar message [1713252.422844] Lustre: fir-OST0099: haven't heard from client b5a15dca-8b5e-4b25-a620-c8280e92602a (at 10.51.6.32@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e41d8e5a800, cur 1708521386 expire 1708521236 last 1708521159 [1713252.444716] Lustre: Skipped 1 previous similar message [1714138.379389] Lustre: fir-OST0099: haven't heard from client 260082e5-f656-440e-93a2-da8c900ad85f (at 10.51.3.41@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e41c3047c00, cur 1708522272 expire 1708522122 last 1708522045 [1714138.401256] Lustre: Skipped 7 previous similar messages [1714145.372581] Lustre: fir-OST009d: haven't heard from client 260082e5-f656-440e-93a2-da8c900ad85f (at 10.51.3.41@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e41d6168000, cur 1708522279 expire 1708522129 last 1708522052 [1714145.394896] Lustre: Skipped 1 previous similar message [1714214.367989] Lustre: fir-OST009f: haven't heard from client 5352a075-9bee-4b10-870e-344c32388c89 (at 10.51.3.61@o2ib3) in 205 seconds. I think it's dead, and I am evicting it. exp ffff9e3ec8f2b000, cur 1708522348 expire 1708522198 last 1708522143 [1714214.389863] Lustre: Skipped 1 previous similar message [1714221.371277] Lustre: fir-OST009b: haven't heard from client 5352a075-9bee-4b10-870e-344c32388c89 (at 10.51.3.61@o2ib3) in 212 seconds. I think it's dead, and I am evicting it. exp ffff9e4212d1e000, cur 1708522355 expire 1708522205 last 1708522143 [1714221.393147] Lustre: Skipped 3 previous similar messages [1714394.367693] Lustre: fir-OST009f: haven't heard from client 0d28ef1f-1f7d-4a1f-b097-2976a1e7db9d (at 10.51.3.42@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3fd1a2b000, cur 1708522528 expire 1708522378 last 1708522301 [1714394.389761] Lustre: Skipped 3 previous similar messages [1714470.358583] Lustre: fir-OST009b: haven't heard from client fd93823f-5ea7-4ad6-ae60-585b7332ba2d (at 10.51.3.22@o2ib3) in 206 seconds. I think it's dead, and I am evicting it. exp ffff9dff78c4e400, cur 1708522604 expire 1708522454 last 1708522398 [1714470.380460] Lustre: Skipped 3 previous similar messages [1714486.364361] Lustre: fir-OST0099: haven't heard from client fd93823f-5ea7-4ad6-ae60-585b7332ba2d (at 10.51.3.22@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e0200417800, cur 1708522620 expire 1708522470 last 1708522393 [1714486.386237] Lustre: Skipped 2 previous similar messages [1715098.331293] Lustre: fir-OST009f: haven't heard from client 55216853-3c94-46aa-b2e8-c5a6addd529e (at 10.51.3.16@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e43ac692400, cur 1708523232 expire 1708523082 last 1708523005 [1715174.319881] Lustre: fir-OST009f: haven't heard from client 6ab65199-877a-4a84-b3b5-6b55848bd83d (at 10.51.8.29@o2ib3) in 184 seconds. I think it's dead, and I am evicting it. exp ffff9e02f10c0000, cur 1708523308 expire 1708523158 last 1708523124 [1715174.341753] Lustre: Skipped 7 previous similar messages [1715353.306932] Lustre: fir-OST009b: haven't heard from client 7d4b6eb3-ca53-4d3d-9ab5-b3b29d80bbce (at 10.51.8.27@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02064a2400, cur 1708523487 expire 1708523337 last 1708523260 [1715353.328964] Lustre: Skipped 3 previous similar messages [1716907.229174] Lustre: fir-OST009b: haven't heard from client 8dde1c58-6dd6-4cf5-9b72-16ec66484c4e (at 10.50.8.6@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33d6628c00, cur 1708525041 expire 1708524891 last 1708524814 [1716907.251150] Lustre: Skipped 3 previous similar messages [1724077.833172] Lustre: fir-OST0099: haven't heard from client c521dcf7-adbb-47f3-b9c5-c7ffd99d66ca (at 10.51.7.8@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e0218fbc800, cur 1708532212 expire 1708532062 last 1708531985 [1724938.786202] Lustre: fir-OST0099: haven't heard from client 563679f1-d8b0-45c3-947f-7524a28126b6 (at 10.50.2.23@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e000858ec00, cur 1708533073 expire 1708532923 last 1708532846 [1724938.808071] Lustre: Skipped 3 previous similar messages [1725014.782390] Lustre: fir-OST009f: haven't heard from client caa273eb-ebf6-4678-93a7-fd0a97d6c61c (at 10.50.17.32@o2ib2) in 224 seconds. I think it's dead, and I am evicting it. exp ffff9df9620c4000, cur 1708533149 expire 1708532999 last 1708532925 [1725014.804352] Lustre: Skipped 43 previous similar messages [1725764.741115] Lustre: fir-OST009f: haven't heard from client 1a18a445-293b-44d1-aa45-6a4430695d58 (at 10.50.17.13@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e2f73086000, cur 1708533899 expire 1708533749 last 1708533672 [1725764.763225] Lustre: Skipped 19 previous similar messages [1728511.591444] Lustre: fir-OST0099: haven't heard from client fc5bb19b-49f6-4f79-960c-302daee496ad (at 10.51.14.10@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33bb9e6400, cur 1708536646 expire 1708536496 last 1708536419 [1728511.613555] Lustre: Skipped 7 previous similar messages [1728524.620915] Lustre: fir-OST009f: haven't heard from client fc5bb19b-49f6-4f79-960c-302daee496ad (at 10.51.14.10@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33cc84c800, cur 1708536659 expire 1708536509 last 1708536432 [1728524.642879] Lustre: Skipped 2 previous similar messages [1728587.588496] Lustre: fir-OST0099: haven't heard from client 2d4761d3-bec3-4b6b-b0fb-f335f5363105 (at 10.51.1.17@o2ib3) in 153 seconds. I think it's dead, and I am evicting it. exp ffff9e33d5c80c00, cur 1708536722 expire 1708536572 last 1708536569 [1728663.583725] Lustre: fir-OST0099: haven't heard from client 90568ee1-dab6-4713-8405-aa98f5ddf7e1 (at 10.50.6.19@o2ib2) in 165 seconds. I think it's dead, and I am evicting it. exp ffff9ded98b4d800, cur 1708536798 expire 1708536648 last 1708536633 [1728663.605598] Lustre: Skipped 1 previous similar message [1728681.582134] Lustre: fir-OST009d: haven't heard from client 2d4761d3-bec3-4b6b-b0fb-f335f5363105 (at 10.51.1.17@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e353a4be000, cur 1708536816 expire 1708536666 last 1708536589 [1728681.604159] Lustre: Skipped 1 previous similar message [1729949.515955] Lustre: fir-OST009f: haven't heard from client 34db4e61-0b26-45b6-b5e1-b8824d00d418 (at 10.51.2.23@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01b34dec00, cur 1708538084 expire 1708537934 last 1708537857 [1729949.537944] Lustre: Skipped 1 previous similar message [1730204.500058] Lustre: fir-OST009d: haven't heard from client 69c7bca7-750c-4b5c-a08b-b70932a6f831 (at 10.51.1.16@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01fac3f000, cur 1708538339 expire 1708538189 last 1708538112 [1730204.521925] Lustre: Skipped 7 previous similar messages [1730210.500812] Lustre: fir-OST0099: haven't heard from client 69c7bca7-750c-4b5c-a08b-b70932a6f831 (at 10.51.1.16@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e013aa9bc00, cur 1708538345 expire 1708538195 last 1708538118 [1730210.522689] Lustre: Skipped 1 previous similar message [1730814.466992] Lustre: fir-OST009d: haven't heard from client 16ad9bd9-6a19-4c07-b51c-42906cb699e3 (at 10.51.2.22@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33c9962400, cur 1708538949 expire 1708538799 last 1708538722 [1730814.488994] Lustre: Skipped 1 previous similar message [1732981.354611] Lustre: fir-OST009b: haven't heard from client 5e4a05d5-eefa-48ab-abd4-282b0bf6ca1a (at 10.51.12.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3fd37d8000, cur 1708541116 expire 1708540966 last 1708540889 [1732986.351004] Lustre: fir-OST0099: haven't heard from client 5e4a05d5-eefa-48ab-abd4-282b0bf6ca1a (at 10.51.12.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33beacc800, cur 1708541121 expire 1708540971 last 1708540894 [1732986.372871] Lustre: Skipped 1 previous similar message [1732992.355219] Lustre: fir-OST009f: haven't heard from client 5e4a05d5-eefa-48ab-abd4-282b0bf6ca1a (at 10.51.12.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e290b2f3000, cur 1708541127 expire 1708540977 last 1708540900 [1733316.332842] Lustre: fir-OST009b: haven't heard from client 8b9f4dd0-cd8c-4fc8-b603-e9e43831204a (at 10.51.12.1@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df97f178000, cur 1708541451 expire 1708541301 last 1708541224 [1735533.236943] Lustre: fir-OST009f: haven't heard from client 0b653622-0d24-4152-bd08-4db0484addc9 (at 10.51.1.57@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e2f73458000, cur 1708543668 expire 1708543518 last 1708543441 [1735533.259262] Lustre: Skipped 3 previous similar messages [1735543.210895] Lustre: fir-OST009b: haven't heard from client 0b653622-0d24-4152-bd08-4db0484addc9 (at 10.51.1.57@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3fde734c00, cur 1708543678 expire 1708543528 last 1708543451 [1736677.151635] Lustre: fir-OST009d: haven't heard from client 907a0ad3-9fb2-440e-96d5-46ab1915cb41 (at 10.51.7.26@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01f26dd800, cur 1708544812 expire 1708544662 last 1708544585 [1736677.173707] Lustre: Skipped 2 previous similar messages [1738339.059722] Lustre: fir-OST009b: haven't heard from client 626d4d07-8e49-4427-a322-6d34cc1f5123 (at 10.51.15.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df979b2cc00, cur 1708546474 expire 1708546324 last 1708546247 [1738339.081609] Lustre: Skipped 3 previous similar messages [1739161.015893] Lustre: fir-OST009d: haven't heard from client 9778767d-da25-49d5-9e7a-aa3ddc1cdf7c (at 10.50.1.72@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f36e6c00, cur 1708547296 expire 1708547146 last 1708547069 [1739161.037947] Lustre: Skipped 3 previous similar messages [1739171.020935] Lustre: fir-OST009f: haven't heard from client 9778767d-da25-49d5-9e7a-aa3ddc1cdf7c (at 10.50.1.72@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f206e000, cur 1708547306 expire 1708547156 last 1708547079 [1739171.042807] Lustre: Skipped 3 previous similar messages [1740369.952105] Lustre: fir-OST009b: haven't heard from client 4c037665-b280-40f3-8401-43053cd453e8 (at 10.50.8.1@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df314ef7c00, cur 1708548505 expire 1708548355 last 1708548278 [1740369.973894] Lustre: Skipped 3 previous similar messages [1740778.932679] Lustre: fir-OST009b: haven't heard from client 08e7d9bf-472f-40dc-970c-f87612597dee (at 10.50.2.23@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3fd1b7ac00, cur 1708548914 expire 1708548764 last 1708548687 [1740778.954548] Lustre: Skipped 7 previous similar messages [1741206.911640] Lustre: fir-OST009d: haven't heard from client 079a6edb-6beb-4808-99d3-2a8a32dd8ff2 (at 10.51.2.63@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e022a2ad000, cur 1708549342 expire 1708549192 last 1708549115 [1741206.933670] Lustre: Skipped 3 previous similar messages [1741211.909670] Lustre: fir-OST009f: haven't heard from client 079a6edb-6beb-4808-99d3-2a8a32dd8ff2 (at 10.51.2.63@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e00903e6800, cur 1708549347 expire 1708549197 last 1708549120 [1741211.931537] Lustre: Skipped 1 previous similar message [1741948.864679] Lustre: fir-OST009f: haven't heard from client 8eac12c2-3466-46ba-99ca-272909d146c0 (at 10.51.15.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e020f4e6800, cur 1708550084 expire 1708549934 last 1708549857 [1741948.886579] Lustre: Skipped 1 previous similar message [1746226.634808] Lustre: fir-OST0099: haven't heard from client 6d9abf15-6ae8-4848-9508-182cb2b4dcde (at 10.51.7.68@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02062eb000, cur 1708554362 expire 1708554212 last 1708554135 [1746226.656692] Lustre: Skipped 3 previous similar messages [1748565.513206] Lustre: fir-OST0099: haven't heard from client c0b24922-85d3-4e6e-bc48-c032ee279651 (at 10.51.7.57@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e2f4c0c4c00, cur 1708556701 expire 1708556551 last 1708556474 [1748565.535073] Lustre: Skipped 3 previous similar messages [1748573.506258] Lustre: fir-OST009f: haven't heard from client c0b24922-85d3-4e6e-bc48-c032ee279651 (at 10.51.7.57@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e2f4c0c4400, cur 1708556709 expire 1708556559 last 1708556482 [1748579.505861] Lustre: fir-OST009b: haven't heard from client c0b24922-85d3-4e6e-bc48-c032ee279651 (at 10.51.7.57@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e2f4c0c0000, cur 1708556715 expire 1708556565 last 1708556488 [1751203.363925] Lustre: fir-OST009b: haven't heard from client 0a6a02c2-1893-44a6-b503-6fdc8e068038 (at 10.51.13.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df96957a400, cur 1708559339 expire 1708559189 last 1708559112 [1751203.385806] Lustre: Skipped 1 previous similar message [1751208.364185] Lustre: fir-OST009f: haven't heard from client 0a6a02c2-1893-44a6-b503-6fdc8e068038 (at 10.51.13.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02edefdc00, cur 1708559344 expire 1708559194 last 1708559117 [1751208.386059] Lustre: Skipped 1 previous similar message [1756473.077632] Lustre: fir-OST009f: haven't heard from client 0e17e9b4-d144-40ed-acba-18c57397c9c4 (at 10.51.7.52@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df3b8709400, cur 1708564609 expire 1708564459 last 1708564382 [1756473.099541] Lustre: Skipped 1 previous similar message [1756478.077968] Lustre: fir-OST009b: haven't heard from client 0e17e9b4-d144-40ed-acba-18c57397c9c4 (at 10.51.7.52@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df98ee81000, cur 1708564614 expire 1708564464 last 1708564387 [1756484.079336] Lustre: fir-OST009d: haven't heard from client 0e17e9b4-d144-40ed-acba-18c57397c9c4 (at 10.51.7.52@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e03b1f03800, cur 1708564620 expire 1708564470 last 1708564393 [1757366.701742] Lustre: fir-OST0099: Client a0c7fc7e-69ec-4ab7-b721-7f912ebd7e96 (at 10.51.15.2@o2ib3) reconnecting [1757366.712006] Lustre: Skipped 1 previous similar message [1757391.815463] Lustre: fir-OST009b: Client a0c7fc7e-69ec-4ab7-b721-7f912ebd7e96 (at 10.51.15.2@o2ib3) reconnecting [1757391.825721] Lustre: Skipped 1 previous similar message [1757593.016768] Lustre: fir-OST0099: haven't heard from client a0c7fc7e-69ec-4ab7-b721-7f912ebd7e96 (at 10.51.15.2@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df304710400, cur 1708565729 expire 1708565579 last 1708565502 [1757593.038643] Lustre: Skipped 1 previous similar message [1757618.016797] Lustre: fir-OST009f: haven't heard from client a0c7fc7e-69ec-4ab7-b721-7f912ebd7e96 (at 10.51.15.2@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01ce408800, cur 1708565754 expire 1708565604 last 1708565527 [1757618.039165] Lustre: Skipped 1 previous similar message [1757665.012497] Lustre: fir-OST009d: haven't heard from client a429a8cf-0eb7-4714-b520-2da603c2cfd7 (at 10.51.1.54@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e007facd400, cur 1708565801 expire 1708565651 last 1708565574 [1757665.034364] Lustre: Skipped 1 previous similar message [1757741.011775] Lustre: fir-OST009b: haven't heard from client a0c7fc7e-69ec-4ab7-b721-7f912ebd7e96 (at 10.51.15.2@o2ib3) in 225 seconds. I think it's dead, and I am evicting it. exp ffff9dede7e96400, cur 1708565877 expire 1708565727 last 1708565652 [1757741.033646] Lustre: Skipped 2 previous similar messages [1759757.898576] Lustre: fir-OST009f: haven't heard from client 150e151f-f496-4dab-bfce-321aad4db578 (at 10.51.15.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e007fc6b000, cur 1708567894 expire 1708567744 last 1708567667 [1760414.862775] Lustre: fir-OST009d: haven't heard from client b6f41663-a534-4de1-a1d6-065652c7d463 (at 10.50.2.23@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e023a81f800, cur 1708568551 expire 1708568401 last 1708568324 [1760414.884675] Lustre: Skipped 11 previous similar messages [1761439.806514] Lustre: fir-OST0099: haven't heard from client fcf8be3f-f819-4c5f-bbf4-53355a7d17d4 (at 10.51.7.54@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02eebb8000, cur 1708569576 expire 1708569426 last 1708569349 [1761439.828670] Lustre: Skipped 3 previous similar messages [1761455.805663] Lustre: fir-OST009f: haven't heard from client fcf8be3f-f819-4c5f-bbf4-53355a7d17d4 (at 10.51.7.54@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f27bb400, cur 1708569592 expire 1708569442 last 1708569365 [1761455.827544] Lustre: Skipped 1 previous similar message [1762136.771082] Lustre: fir-OST0099: haven't heard from client 96a18254-6a72-4ffe-b656-466d40d628d5 (at 10.51.15.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e000b9f6400, cur 1708570273 expire 1708570123 last 1708570046 [1762136.792958] Lustre: Skipped 1 previous similar message [1763575.690505] Lustre: fir-OST009d: haven't heard from client 4e05bc89-2d99-4887-a958-7ab56dcba9a4 (at 10.51.15.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df3ae855c00, cur 1708571712 expire 1708571562 last 1708571485 [1763575.712374] Lustre: Skipped 3 previous similar messages [1765784.569446] Lustre: fir-OST009d: haven't heard from client c8c982df-c833-489c-9718-1ba276f0953a (at 10.51.15.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02ee59d400, cur 1708573921 expire 1708573771 last 1708573694 [1765784.591321] Lustre: Skipped 3 previous similar messages [1766752.518611] Lustre: fir-OST009d: haven't heard from client 126ecd39-d93b-4bce-b89e-5d42e4cf14a1 (at 10.51.15.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df98f163000, cur 1708574889 expire 1708574739 last 1708574662 [1766752.540482] Lustre: Skipped 3 previous similar messages [1766828.514070] Lustre: fir-OST009d: haven't heard from client a88086cc-ddad-44da-9a1d-a365500c6448 (at 10.51.4.35@o2ib3) in 152 seconds. I think it's dead, and I am evicting it. exp ffff9dff7957fc00, cur 1708574965 expire 1708574815 last 1708574813 [1766828.535941] Lustre: Skipped 3 previous similar messages [1766914.509031] Lustre: fir-OST009f: haven't heard from client a88086cc-ddad-44da-9a1d-a365500c6448 (at 10.51.4.35@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dede60f5800, cur 1708575051 expire 1708574901 last 1708574824 [1766921.509304] Lustre: fir-OST009b: haven't heard from client a88086cc-ddad-44da-9a1d-a365500c6448 (at 10.51.4.35@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df614dc6400, cur 1708575058 expire 1708574908 last 1708574831 [1767300.486458] Lustre: fir-OST0099: haven't heard from client 3d496d4f-6808-4193-9294-aede1419bb35 (at 10.51.16.22@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e2f4c844800, cur 1708575437 expire 1708575287 last 1708575210 [1767300.508418] Lustre: Skipped 1 previous similar message [1767313.485688] Lustre: fir-OST009b: haven't heard from client 3d496d4f-6808-4193-9294-aede1419bb35 (at 10.51.16.22@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33cc01b800, cur 1708575450 expire 1708575300 last 1708575223 [1767313.507818] Lustre: Skipped 1 previous similar message [1768833.403855] Lustre: fir-OST009d: haven't heard from client 494c8ad6-9015-4ef8-bca7-0a9b68a8aa5c (at 10.51.4.35@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df3b985a800, cur 1708576970 expire 1708576820 last 1708576743 [1768833.425723] Lustre: Skipped 1 previous similar message [1771245.278343] Lustre: fir-OST009b: haven't heard from client 75afa234-baab-40df-a87a-5ae86171b86d (at 10.51.8.45@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df3ad352c00, cur 1708579382 expire 1708579232 last 1708579155 [1771245.300531] Lustre: Skipped 3 previous similar messages [1771250.271308] Lustre: fir-OST0099: haven't heard from client 75afa234-baab-40df-a87a-5ae86171b86d (at 10.51.8.45@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e0006d0b000, cur 1708579387 expire 1708579237 last 1708579160 [1771255.270691] Lustre: fir-OST009f: haven't heard from client 75afa234-baab-40df-a87a-5ae86171b86d (at 10.51.8.45@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df982ce4400, cur 1708579392 expire 1708579242 last 1708579165 [1771627.251254] Lustre: fir-OST009f: haven't heard from client def1abd9-5a86-4ef2-adca-db4aa64aad72 (at 10.51.4.35@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dff7851d800, cur 1708579764 expire 1708579614 last 1708579537 [1771627.273124] Lustre: Skipped 1 previous similar message [1772170.226971] Lustre: fir-OST0099: haven't heard from client e1b835a0-937b-4d77-b275-575c9e1c84e0 (at 10.51.1.8@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df993052c00, cur 1708580307 expire 1708580157 last 1708580080 [1772170.248749] Lustre: Skipped 3 previous similar messages [1772184.224467] Lustre: fir-OST009f: haven't heard from client e1b835a0-937b-4d77-b275-575c9e1c84e0 (at 10.51.1.8@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e013a88f800, cur 1708580321 expire 1708580171 last 1708580094 [1772184.246251] Lustre: Skipped 1 previous similar message [1772246.220003] Lustre: fir-OST0099: haven't heard from client e9e59d61-3440-42ac-8797-b96f6de2cadf (at 10.50.12.8@o2ib2) in 218 seconds. I think it's dead, and I am evicting it. exp ffff9e33d3bd2400, cur 1708580383 expire 1708580233 last 1708580165 [1772246.242054] Lustre: Skipped 3 previous similar messages [1772989.183196] Lustre: fir-OST009d: haven't heard from client 716483aa-4de6-42ca-945f-737bb035fb4b (at 10.51.1.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e0090177800, cur 1708581126 expire 1708580976 last 1708580899 [1772989.205155] Lustre: Skipped 1 previous similar message [1772996.186980] Lustre: fir-OST009b: haven't heard from client 716483aa-4de6-42ca-945f-737bb035fb4b (at 10.51.1.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e008d3aec00, cur 1708581133 expire 1708580983 last 1708580906 [1772996.208760] Lustre: Skipped 1 previous similar message [1773009.180130] Lustre: fir-OST009f: haven't heard from client 716483aa-4de6-42ca-945f-737bb035fb4b (at 10.51.1.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02295fcc00, cur 1708581146 expire 1708580996 last 1708580919 [1773892.127716] Lustre: fir-OST0099: haven't heard from client bd4edcfd-d2d8-4e90-86fb-2cb6ceffe31f (at 10.51.1.6@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dee4bb24800, cur 1708582029 expire 1708581879 last 1708581802 [1773907.126147] Lustre: fir-OST009d: haven't heard from client bd4edcfd-d2d8-4e90-86fb-2cb6ceffe31f (at 10.51.1.6@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01c6800c00, cur 1708582044 expire 1708581894 last 1708581817 [1773907.148037] Lustre: Skipped 2 previous similar messages [1774807.077134] Lustre: fir-OST009b: haven't heard from client 233ab117-97b6-4c16-abb0-24936cb04774 (at 10.51.4.35@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e0008977000, cur 1708582944 expire 1708582794 last 1708582717 [1776146.010702] Lustre: fir-OST0099: haven't heard from client 58bfd478-c058-4388-ac04-726ceeb7e5a5 (at 10.51.1.13@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e2f3dd8a000, cur 1708584283 expire 1708584133 last 1708584056 [1776146.032569] Lustre: Skipped 3 previous similar messages [1776151.004224] Lustre: fir-OST009b: haven't heard from client 58bfd478-c058-4388-ac04-726ceeb7e5a5 (at 10.51.1.13@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3fd1cc5000, cur 1708584288 expire 1708584138 last 1708584061 [1776151.026273] Lustre: Skipped 1 previous similar message [1777343.939406] Lustre: fir-OST009b: haven't heard from client eea47764-9255-4324-b5b8-892e30649a29 (at 10.51.6.13@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e013d46a400, cur 1708585481 expire 1708585331 last 1708585254 [1777343.961274] Lustre: Skipped 1 previous similar message [1788992.303092] Lustre: fir-OST0099: haven't heard from client 2f321f87-75b9-4d5b-9425-271840a81c8a (at 10.51.6.59@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e0250b85000, cur 1708597130 expire 1708596980 last 1708596903 [1788992.324966] Lustre: Skipped 7 previous similar messages [1789005.302799] Lustre: fir-OST009f: haven't heard from client 2f321f87-75b9-4d5b-9425-271840a81c8a (at 10.51.6.59@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e0008a37c00, cur 1708597143 expire 1708596993 last 1708596916 [1793528.056340] Lustre: fir-OST009d: haven't heard from client 613d9ba4-9f44-43b8-af10-a74de5fbd4f4 (at 10.51.15.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dff74673400, cur 1708601666 expire 1708601516 last 1708601439 [1793528.078209] Lustre: Skipped 2 previous similar messages [1796443.896447] Lustre: fir-OST009d: haven't heard from client 7037cbb5-2291-404d-9845-b4d35148bf9a (at 10.51.15.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dff76875000, cur 1708604582 expire 1708604432 last 1708604355 [1796443.918322] Lustre: Skipped 3 previous similar messages [1798504.784758] Lustre: fir-OST009b: haven't heard from client 6536c7ec-d0fa-4638-b5ba-9235678d8b76 (at 10.51.15.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e007fb38800, cur 1708606643 expire 1708606493 last 1708606416 [1798504.806630] Lustre: Skipped 3 previous similar messages [1801646.612157] Lustre: fir-OST009d: haven't heard from client 36c9ec2e-1ffb-48ee-a259-d2faa9cb38f3 (at 10.51.15.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dfa102ce800, cur 1708609785 expire 1708609635 last 1708609558 [1801646.634030] Lustre: Skipped 3 previous similar messages [1802440.569045] Lustre: fir-OST009b: haven't heard from client d405c303-568a-42a7-9867-0eb6f87ccdd4 (at 10.51.1.10@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dff7474a800, cur 1708610579 expire 1708610429 last 1708610352 [1802440.591056] Lustre: Skipped 3 previous similar messages [1802445.569601] Lustre: fir-OST0099: haven't heard from client d405c303-568a-42a7-9867-0eb6f87ccdd4 (at 10.51.1.10@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02ee3fe400, cur 1708610584 expire 1708610434 last 1708610357 [1803898.489561] Lustre: fir-OST0099: haven't heard from client 07b207bb-936f-481b-8499-461f97a7964e (at 10.50.4.27@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3fde407800, cur 1708612037 expire 1708611887 last 1708611810 [1803898.511429] Lustre: Skipped 2 previous similar messages [1803904.491963] Lustre: fir-OST009f: haven't heard from client 07b207bb-936f-481b-8499-461f97a7964e (at 10.50.4.27@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3fde401400, cur 1708612043 expire 1708611893 last 1708611816 [1803904.513846] Lustre: Skipped 2 previous similar messages [1804505.461101] Lustre: fir-OST009d: haven't heard from client a286c936-3aa1-466d-a6cb-372834e0489a (at 10.51.1.27@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e4139d00000, cur 1708612644 expire 1708612494 last 1708612417 [1804511.456955] Lustre: fir-OST0099: haven't heard from client a286c936-3aa1-466d-a6cb-372834e0489a (at 10.51.1.27@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e41d3686800, cur 1708612650 expire 1708612500 last 1708612423 [1804511.479221] Lustre: Skipped 1 previous similar message [1804523.455113] Lustre: fir-OST009b: haven't heard from client a286c936-3aa1-466d-a6cb-372834e0489a (at 10.51.1.27@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3f7e76d400, cur 1708612662 expire 1708612512 last 1708612435 [1806399.352753] Lustre: fir-OST009d: haven't heard from client 7ba29c8c-1e04-49b2-83c9-c6c9c3236055 (at 10.51.15.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df3b4140000, cur 1708614538 expire 1708614388 last 1708614311 [1808807.221645] Lustre: fir-OST0099: haven't heard from client c88978b5-2fa7-4f0b-9482-9cef6707779d (at 10.51.16.15@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df2fceac800, cur 1708616946 expire 1708616796 last 1708616719 [1808807.243753] Lustre: Skipped 3 previous similar messages [1808825.221239] Lustre: fir-OST009d: haven't heard from client c88978b5-2fa7-4f0b-9482-9cef6707779d (at 10.51.16.15@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02327d6800, cur 1708616964 expire 1708616814 last 1708616737 [1809202.199698] Lustre: fir-OST009d: haven't heard from client 065cfe79-80ca-4f0e-8b5c-da8bdbacd050 (at 10.50.6.9@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01371c2000, cur 1708617341 expire 1708617191 last 1708617114 [1809202.221496] Lustre: Skipped 2 previous similar messages [1809589.178642] Lustre: fir-OST009d: haven't heard from client b4d3fb6f-3ad9-4dc6-afe2-a1c58183f608 (at 10.50.2.23@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dede659f400, cur 1708617728 expire 1708617578 last 1708617501 [1809589.200514] Lustre: Skipped 3 previous similar messages [1811438.077800] Lustre: fir-OST009d: haven't heard from client b9e2e2ae-4b7c-4d65-8f88-d6a7d0813570 (at 10.51.12.6@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e41f9814800, cur 1708619577 expire 1708619427 last 1708619350 [1811438.099684] Lustre: Skipped 3 previous similar messages [1811458.079719] Lustre: fir-OST009b: haven't heard from client b9e2e2ae-4b7c-4d65-8f88-d6a7d0813570 (at 10.51.12.6@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e40de997400, cur 1708619597 expire 1708619447 last 1708619370 [1811458.101858] Lustre: Skipped 1 previous similar message [1811781.059534] Lustre: fir-OST009f: haven't heard from client 87833b84-f57b-4099-9c5b-17f01e9f5356 (at 10.51.6.13@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dff6f831400, cur 1708619920 expire 1708619770 last 1708619693 [1811781.081403] Lustre: Skipped 1 previous similar message [1811786.059935] Lustre: fir-OST0099: haven't heard from client 87833b84-f57b-4099-9c5b-17f01e9f5356 (at 10.51.6.13@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dfc01155800, cur 1708619925 expire 1708619775 last 1708619698 [1811791.058355] Lustre: fir-OST009b: haven't heard from client 87833b84-f57b-4099-9c5b-17f01e9f5356 (at 10.51.6.13@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02067aec00, cur 1708619930 expire 1708619780 last 1708619703 [1811857.056529] Lustre: fir-OST009f: haven't heard from client 93381591-90ee-4395-a697-c9fc154f9dc9 (at 10.51.13.4@o2ib3) in 185 seconds. I think it's dead, and I am evicting it. exp ffff9dedda730000, cur 1708619996 expire 1708619846 last 1708619811 [1811857.078393] Lustre: Skipped 1 previous similar message [1812453.022208] Lustre: fir-OST009d: haven't heard from client 2e38b7e6-eb18-4e7e-962d-34b058d13008 (at 10.50.2.23@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e022a1e6800, cur 1708620592 expire 1708620442 last 1708620365 [1812453.044075] Lustre: Skipped 3 previous similar messages [1815302.866612] Lustre: fir-OST0099: haven't heard from client 857a7bc4-6e6e-421b-ab2f-e4ee2bb5dd3e (at 10.51.6.13@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dff797f2000, cur 1708623442 expire 1708623292 last 1708623215 [1815302.888656] Lustre: Skipped 3 previous similar messages [1815307.868811] Lustre: fir-OST009d: haven't heard from client 857a7bc4-6e6e-421b-ab2f-e4ee2bb5dd3e (at 10.51.6.13@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f1abd400, cur 1708623447 expire 1708623297 last 1708623220 [1815307.890682] Lustre: Skipped 1 previous similar message [1818656.684178] Lustre: fir-OST009d: haven't heard from client 60006b72-2ce2-40d4-b9b9-84bfdf97fc53 (at 10.51.18.3@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01c8c82000, cur 1708626796 expire 1708626646 last 1708626569 [1818656.706045] Lustre: Skipped 1 previous similar message [1819294.653487] Lustre: fir-OST009f: haven't heard from client 99286f49-eb5a-4596-9c27-595e08fbde9f (at 10.50.2.23@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df96f80b000, cur 1708627434 expire 1708627284 last 1708627207 [1819294.675355] Lustre: Skipped 7 previous similar messages [1819896.617657] Lustre: fir-OST0099: haven't heard from client c12c9c4b-5f73-493b-8ee7-86baf9167ed0 (at 10.51.3.31@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e41d6338800, cur 1708628036 expire 1708627886 last 1708627809 [1819896.639665] Lustre: Skipped 3 previous similar messages [1820172.603394] Lustre: fir-OST009d: haven't heard from client e0253162-435d-49c9-97a2-bb69fb3a5175 (at 10.51.3.39@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3e8c1acc00, cur 1708628312 expire 1708628162 last 1708628085 [1820172.625274] Lustre: Skipped 15 previous similar messages [1820248.598578] Lustre: fir-OST009b: haven't heard from client b5dba9a5-e7fc-4390-ad59-67151f95f8b9 (at 10.51.7.62@o2ib3) in 194 seconds. I think it's dead, and I am evicting it. exp ffff9e01f037c400, cur 1708628388 expire 1708628238 last 1708628194 [1820248.620455] Lustre: Skipped 3 previous similar messages [1820888.563724] Lustre: fir-OST009d: haven't heard from client 745aa114-8628-4c41-b1d0-48fd39646dc2 (at 10.50.2.23@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01f7d41400, cur 1708629028 expire 1708628878 last 1708628801 [1820888.586056] Lustre: Skipped 3 previous similar messages [1821689.529821] Lustre: fir-OST009f: haven't heard from client b134fd93-c936-458e-9e4f-6d45fdfd01e1 (at 10.51.2.30@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33bd173c00, cur 1708629829 expire 1708629679 last 1708629602 [1821689.551692] Lustre: Skipped 3 previous similar messages [1821695.522849] Lustre: fir-OST009d: haven't heard from client b134fd93-c936-458e-9e4f-6d45fdfd01e1 (at 10.51.2.30@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e2f4c4fac00, cur 1708629835 expire 1708629685 last 1708629608 [1821708.527114] Lustre: fir-OST009b: haven't heard from client b134fd93-c936-458e-9e4f-6d45fdfd01e1 (at 10.51.2.30@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e40de98cc00, cur 1708629848 expire 1708629698 last 1708629621 [1821708.548987] Lustre: Skipped 1 previous similar message [1821895.510892] Lustre: fir-OST009b: haven't heard from client 26b5b457-053c-4090-a764-16554ddbb4ae (at 10.51.18.3@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e0218883400, cur 1708630035 expire 1708629885 last 1708629808 [1823703.411597] Lustre: fir-OST0099: haven't heard from client 934ba671-df19-46e5-8d53-2c376360366b (at 10.51.6.25@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df3b98fa000, cur 1708631843 expire 1708631693 last 1708631616 [1823703.433653] Lustre: Skipped 7 previous similar messages [1823710.412744] Lustre: fir-OST009b: haven't heard from client 934ba671-df19-46e5-8d53-2c376360366b (at 10.51.6.25@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df99caeb800, cur 1708631850 expire 1708631700 last 1708631623 [1823710.434779] Lustre: Skipped 2 previous similar messages [1826994.233530] Lustre: fir-OST0099: haven't heard from client 65eda616-81e7-4d27-b3df-ac60785ceb0f (at 10.51.10.14@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02ee541400, cur 1708635134 expire 1708634984 last 1708634907 [1828370.162474] Lustre: fir-OST009b: haven't heard from client 9cfebd8c-039f-432f-8781-552a04412fa1 (at 10.51.10.15@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dff74e1ec00, cur 1708636510 expire 1708636360 last 1708636283 [1828370.184824] Lustre: Skipped 3 previous similar messages [1828386.163296] Lustre: fir-OST0099: haven't heard from client 9cfebd8c-039f-432f-8781-552a04412fa1 (at 10.51.10.15@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e42166c2400, cur 1708636526 expire 1708636376 last 1708636299 [1828386.185253] Lustre: Skipped 1 previous similar message [1829138.117413] Lustre: fir-OST0099: haven't heard from client d49e419d-faea-449f-b158-2402cfdaeca5 (at 10.51.10.37@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df982f30400, cur 1708637278 expire 1708637128 last 1708637051 [1829138.139491] Lustre: Skipped 1 previous similar message [1829143.116643] Lustre: fir-OST009f: haven't heard from client d49e419d-faea-449f-b158-2402cfdaeca5 (at 10.51.10.37@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dff6f833400, cur 1708637283 expire 1708637133 last 1708637056 [1831517.997720] Lustre: fir-OST0099: haven't heard from client ad949be4-553c-4844-9222-68ccbb359893 (at 10.51.4.35@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e023122ec00, cur 1708639658 expire 1708639508 last 1708639431 [1831518.019590] Lustre: Skipped 2 previous similar messages [1831523.988319] Lustre: fir-OST009b: haven't heard from client ad949be4-553c-4844-9222-68ccbb359893 (at 10.51.4.35@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dfd5776a000, cur 1708639664 expire 1708639514 last 1708639437 [1831535.987219] Lustre: fir-OST009f: haven't heard from client ad949be4-553c-4844-9222-68ccbb359893 (at 10.51.4.35@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dfeb88fe000, cur 1708639676 expire 1708639526 last 1708639449 [1831593.985316] Lustre: fir-OST0099: haven't heard from client 83ce4ff2-bc1e-40d9-ac00-6690154f4ba3 (at 10.51.1.15@o2ib3) in 151 seconds. I think it's dead, and I am evicting it. exp ffff9e40ab65f400, cur 1708639734 expire 1708639584 last 1708639583 [1831594.007190] Lustre: Skipped 1 previous similar message [1831599.985145] Lustre: fir-OST009b: haven't heard from client 83ce4ff2-bc1e-40d9-ac00-6690154f4ba3 (at 10.51.1.15@o2ib3) in 157 seconds. I think it's dead, and I am evicting it. exp ffff9e41d37ac000, cur 1708639740 expire 1708639590 last 1708639583 [1831611.983250] Lustre: fir-OST009d: haven't heard from client 83ce4ff2-bc1e-40d9-ac00-6690154f4ba3 (at 10.51.1.15@o2ib3) in 163 seconds. I think it's dead, and I am evicting it. exp ffff9e2f5180cc00, cur 1708639752 expire 1708639602 last 1708639589 [1831814.972779] Lustre: fir-OST009d: haven't heard from client 766ecc05-0b00-4fc4-8031-16e411b1d08a (at 10.51.1.45@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e41c83b1800, cur 1708639955 expire 1708639805 last 1708639728 [1831814.994660] Lustre: Skipped 1 previous similar message [1831983.966343] Lustre: fir-OST0099: haven't heard from client 8c5ce352-3f79-4b87-9c77-d2ca56b93322 (at 10.50.1.2@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df3ad0bcc00, cur 1708640124 expire 1708639974 last 1708639897 [1831983.988132] Lustre: Skipped 3 previous similar messages [1832847.916580] Lustre: fir-OST0099: haven't heard from client c6e93a3b-43e9-40d9-9f86-cc9bffcdef74 (at 10.51.1.58@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e0229fa3000, cur 1708640988 expire 1708640838 last 1708640761 [1832847.938460] Lustre: Skipped 95 previous similar messages [1832856.921761] Lustre: fir-OST009d: haven't heard from client c6e93a3b-43e9-40d9-9f86-cc9bffcdef74 (at 10.51.1.58@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e0229fa7c00, cur 1708640997 expire 1708640847 last 1708640770 [1833142.899704] Lustre: fir-OST009d: haven't heard from client 116fd7e5-4fae-4676-87e3-762abf47cb0b (at 10.51.1.56@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dfd4f674400, cur 1708641283 expire 1708641133 last 1708641056 [1833142.921936] Lustre: Skipped 2 previous similar messages [1836054.746280] Lustre: fir-OST009b: haven't heard from client 387fd16c-7b08-4493-a981-8ca65c05dd90 (at 10.50.2.23@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df9db48e000, cur 1708644195 expire 1708644045 last 1708643968 [1836054.768149] Lustre: Skipped 3 previous similar messages [1837280.674681] Lustre: fir-OST009b: haven't heard from client adce3219-685f-4e8c-a8a7-6642ac423140 (at 10.50.2.23@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dee34fccc00, cur 1708645421 expire 1708645271 last 1708645194 [1837280.696946] Lustre: Skipped 3 previous similar messages [1837927.639232] Lustre: fir-OST0099: haven't heard from client f900b9e8-05d1-4df9-a9d3-4b07f0dc39f3 (at 10.50.4.50@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3f72d49c00, cur 1708646068 expire 1708645918 last 1708645841 [1837927.661127] Lustre: Skipped 3 previous similar messages [1838121.628550] Lustre: fir-OST009f: haven't heard from client 39f6faf0-4df4-4d5d-9697-7675509c6fd2 (at 10.50.10.40@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33d2d56400, cur 1708646262 expire 1708646112 last 1708646035 [1838121.650514] Lustre: Skipped 3 previous similar messages [1838127.630020] Lustre: fir-OST009d: haven't heard from client 39f6faf0-4df4-4d5d-9697-7675509c6fd2 (at 10.50.10.40@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33d2d50000, cur 1708646268 expire 1708646118 last 1708646041 [1838127.652119] Lustre: Skipped 1 previous similar message [1838134.633024] Lustre: fir-OST009b: haven't heard from client 39f6faf0-4df4-4d5d-9697-7675509c6fd2 (at 10.50.10.40@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e40a939f400, cur 1708646275 expire 1708646125 last 1708646048 [1838197.625106] Lustre: fir-OST0099: haven't heard from client d426db4e-855a-4a99-b5ac-3317dc1d02cc (at 10.51.6.29@o2ib3) in 171 seconds. I think it's dead, and I am evicting it. exp ffff9df9751f1c00, cur 1708646338 expire 1708646188 last 1708646167 [1838210.623774] Lustre: fir-OST009b: haven't heard from client d426db4e-855a-4a99-b5ac-3317dc1d02cc (at 10.51.6.29@o2ib3) in 190 seconds. I think it's dead, and I am evicting it. exp ffff9e02f20b5000, cur 1708646351 expire 1708646201 last 1708646161 [1838210.645649] Lustre: Skipped 10 previous similar messages [1838273.620858] Lustre: fir-OST0099: haven't heard from client 1f4e23f1-44b5-4189-b9d4-3d821224bbb4 (at 10.51.2.34@o2ib3) in 220 seconds. I think it's dead, and I am evicting it. exp ffff9e2f7345f800, cur 1708646414 expire 1708646264 last 1708646194 [1838273.642731] Lustre: Skipped 5 previous similar messages [1838349.619873] Lustre: fir-OST009f: haven't heard from client ba775017-d25a-4f40-b395-dad97fb7baf3 (at 10.51.6.70@o2ib3) in 194 seconds. I think it's dead, and I am evicting it. exp ffff9e40a6327000, cur 1708646490 expire 1708646340 last 1708646296 [1838349.641745] Lustre: Skipped 34 previous similar messages [1838425.613773] Lustre: fir-OST0099: haven't heard from client 301da205-6523-4ed3-a300-dd553d2adbcf (at 10.51.10.13@o2ib3) in 216 seconds. I think it's dead, and I am evicting it. exp ffff9df9961d2000, cur 1708646566 expire 1708646416 last 1708646350 [1838425.635736] Lustre: Skipped 43 previous similar messages [1838565.606402] Lustre: fir-OST009b: haven't heard from client a1eb6748-c833-41dc-8ad0-7228f257b400 (at 10.50.6.66@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33d1fe7800, cur 1708646706 expire 1708646556 last 1708646479 [1838565.628275] Lustre: Skipped 23 previous similar messages [1838943.585499] Lustre: fir-OST009f: haven't heard from client 170e57ce-bb29-4122-b5ed-7521e38a888e (at 10.50.2.23@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dedda763c00, cur 1708647084 expire 1708646934 last 1708646857 [1838943.607365] Lustre: Skipped 20 previous similar messages [1839529.554227] Lustre: fir-OST009b: haven't heard from client 143f1323-4007-4d29-b620-999a8576429b (at 10.51.15.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dee66547800, cur 1708647670 expire 1708647520 last 1708647443 [1839529.576097] Lustre: Skipped 31 previous similar messages [1840190.519371] Lustre: fir-OST009f: haven't heard from client fdf063ea-17ae-4cb5-bf97-e8f6dae5f1d5 (at 10.51.7.72@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dfd50cf2400, cur 1708648331 expire 1708648181 last 1708648104 [1840190.541241] Lustre: Skipped 11 previous similar messages [1840807.496595] Lustre: fir-OST009b: haven't heard from client 3771eb9e-52dc-4772-b15a-d38683c58258 (at 10.51.5.21@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e420e89c800, cur 1708648948 expire 1708648798 last 1708648721 [1840807.519223] Lustre: Skipped 9 previous similar messages [1841558.442642] Lustre: fir-OST009d: haven't heard from client 5e1960e8-37e8-4b87-bcbd-e76a73dcd843 (at 10.51.15.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df98f24c400, cur 1708649699 expire 1708649549 last 1708649472 [1841558.464520] Lustre: Skipped 10 previous similar messages [1842847.377886] Lustre: fir-OST009d: haven't heard from client 66349947-7368-44eb-8d32-ff9cedbb4755 (at 10.51.5.35@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e40eae80400, cur 1708650988 expire 1708650838 last 1708650761 [1842847.399758] Lustre: Skipped 11 previous similar messages [1843699.328593] Lustre: fir-OST0099: haven't heard from client 65c9a82e-9de3-47b0-9220-0774936ba595 (at 10.51.5.33@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33cf585c00, cur 1708651840 expire 1708651690 last 1708651613 [1843699.350635] Lustre: Skipped 7 previous similar messages [1843709.325451] Lustre: fir-OST009b: haven't heard from client 65c9a82e-9de3-47b0-9220-0774936ba595 (at 10.51.5.33@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e353a4bc800, cur 1708651850 expire 1708651700 last 1708651623 [1843775.320241] Lustre: fir-OST0099: haven't heard from client 6c3449e2-0534-46b4-aac5-fc1f840a1cf0 (at 10.51.8.38@o2ib3) in 203 seconds. I think it's dead, and I am evicting it. exp ffff9e33d46f7000, cur 1708651916 expire 1708651766 last 1708651713 [1843775.342400] Lustre: Skipped 2 previous similar messages [1843851.316468] Lustre: fir-OST0099: haven't heard from client 2ab9933d-3fee-4d74-b85e-43a10591997d (at 10.51.5.34@o2ib3) in 161 seconds. I think it's dead, and I am evicting it. exp ffff9dfd5200e000, cur 1708651992 expire 1708651842 last 1708651831 [1843851.338472] Lustre: Skipped 3 previous similar messages [1843927.311975] Lustre: fir-OST0099: haven't heard from client e7a7e75c-2799-415b-bbb7-170da4e96948 (at 10.51.4.57@o2ib3) in 182 seconds. I think it's dead, and I am evicting it. exp ffff9e0138a32800, cur 1708652068 expire 1708651918 last 1708651886 [1843927.333849] Lustre: Skipped 6 previous similar messages [1844317.301456] Lustre: fir-OST009b: haven't heard from client e11ec972-b758-4c87-b4c6-e4cee73812a6 (at 10.50.8.58@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e40b7bd1400, cur 1708652458 expire 1708652308 last 1708652231 [1844878.260375] Lustre: fir-OST009d: haven't heard from client e105397d-c8a3-4f83-9772-9f65262ef8c2 (at 10.51.5.28@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01f228b000, cur 1708653019 expire 1708652869 last 1708652792 [1845983.200127] Lustre: fir-OST009b: haven't heard from client 2ef96a72-c975-4882-b5d7-a49ff3535f48 (at 10.51.1.19@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e290b403000, cur 1708654124 expire 1708653974 last 1708653897 [1845983.222179] Lustre: Skipped 63 previous similar messages [1846889.155100] Lustre: fir-OST009f: haven't heard from client 3c3b9004-082b-4a9c-9ef8-290f754db480 (at 10.51.2.27@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e0250404c00, cur 1708655030 expire 1708654880 last 1708654803 [1846889.177107] Lustre: Skipped 7 previous similar messages [1847691.107083] Lustre: fir-OST0099: haven't heard from client b78d3a65-57b7-446b-975c-709d9ae1de92 (at 10.51.5.44@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e008f67e800, cur 1708655832 expire 1708655682 last 1708655605 [1847691.129203] Lustre: Skipped 15 previous similar messages [1848871.043310] Lustre: fir-OST009f: haven't heard from client 216a903d-92f3-4a75-b002-58daa0b3ff69 (at 10.51.2.49@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02328a7000, cur 1708657012 expire 1708656862 last 1708656785 [1848871.065359] Lustre: Skipped 15 previous similar messages [1850262.966780] Lustre: fir-OST009f: haven't heard from client c162a409-9c17-421b-8b35-4e60c62cc9b7 (at 10.51.8.26@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f2768000, cur 1708658404 expire 1708658254 last 1708658177 [1850262.988668] Lustre: Skipped 2 previous similar messages [1854095.759587] Lustre: fir-OST009f: haven't heard from client 072b7b33-8b57-42c4-932d-5caf2133e9d9 (at 10.51.2.7@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e2f75bd2400, cur 1708662237 expire 1708662087 last 1708662010 [1854095.781385] Lustre: Skipped 3 previous similar messages [1854107.758250] Lustre: fir-OST0099: haven't heard from client 072b7b33-8b57-42c4-932d-5caf2133e9d9 (at 10.51.2.7@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e2f75bd3c00, cur 1708662249 expire 1708662099 last 1708662022 [1856436.635765] Lustre: fir-OST0099: haven't heard from client fc18597e-0054-4636-93b8-22c110c83720 (at 10.51.5.67@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3f72c55000, cur 1708664578 expire 1708664428 last 1708664351 [1856436.657643] Lustre: Skipped 2 previous similar messages [1856447.630172] Lustre: fir-OST009d: haven't heard from client fc18597e-0054-4636-93b8-22c110c83720 (at 10.51.5.67@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33b85e4400, cur 1708664589 expire 1708664439 last 1708664362 [1856447.652304] Lustre: Skipped 1 previous similar message [1856452.631960] Lustre: fir-OST009b: haven't heard from client fc18597e-0054-4636-93b8-22c110c83720 (at 10.51.5.67@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e2f30e1f400, cur 1708664594 expire 1708664444 last 1708664367 [1856885.607439] Lustre: fir-OST009b: haven't heard from client 7d52c4b2-2fff-40e9-a594-06fa4dfeb881 (at 10.51.5.53@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e40eae9b000, cur 1708665027 expire 1708664877 last 1708664800 [1858225.532870] Lustre: fir-OST0099: haven't heard from client 20186eb1-614c-4b9f-9d28-acb65a7f2aa5 (at 10.51.4.10@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e2f60149400, cur 1708666367 expire 1708666217 last 1708666140 [1858225.554761] Lustre: Skipped 2 previous similar messages [1859997.437115] Lustre: fir-OST009d: haven't heard from client 5ce461f1-0c7a-4bb0-8632-43f6dad925e9 (at 10.51.16.15@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df998e99800, cur 1708668139 expire 1708667989 last 1708667912 [1859997.459076] Lustre: Skipped 3 previous similar messages [1860007.438275] Lustre: fir-OST0099: haven't heard from client 5ce461f1-0c7a-4bb0-8632-43f6dad925e9 (at 10.51.16.15@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9ded87322c00, cur 1708668149 expire 1708667999 last 1708667922 [1860007.460245] Lustre: Skipped 1 previous similar message [1860160.427092] Lustre: fir-OST009b: haven't heard from client ac93fe77-3b50-4040-adf4-6a44ccb78b73 (at 10.51.4.47@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01efcb7000, cur 1708668302 expire 1708668152 last 1708668075 [1860160.449096] Lustre: Skipped 1 previous similar message [1860166.427156] Lustre: fir-OST0099: haven't heard from client ac93fe77-3b50-4040-adf4-6a44ccb78b73 (at 10.51.4.47@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9ded94390800, cur 1708668308 expire 1708668158 last 1708668081 [1860166.449035] Lustre: Skipped 1 previous similar message [1861109.376073] Lustre: fir-OST009f: haven't heard from client 191994c6-a470-4df1-bbb8-2db332790baa (at 10.51.7.71@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e418674e400, cur 1708669251 expire 1708669101 last 1708669024 [1861109.397960] Lustre: Skipped 1 previous similar message [1861134.377498] Lustre: fir-OST009d: haven't heard from client 191994c6-a470-4df1-bbb8-2db332790baa (at 10.51.7.71@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33cb1e1c00, cur 1708669276 expire 1708669126 last 1708669049 [1865517.134202] Lustre: fir-OST009d: haven't heard from client 1f245d09-ae75-4923-a6e0-f5222886d8e0 (at 10.51.2.8@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e41d32b2000, cur 1708673659 expire 1708673509 last 1708673432 [1865517.156350] Lustre: Skipped 2 previous similar messages [1865526.133763] Lustre: fir-OST0099: haven't heard from client 1f245d09-ae75-4923-a6e0-f5222886d8e0 (at 10.51.2.8@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e40a80b0c00, cur 1708673668 expire 1708673518 last 1708673441 [1865526.155539] Lustre: Skipped 1 previous similar message [1866894.058085] Lustre: fir-OST009b: haven't heard from client be04dc42-3dda-412f-8c06-ec5cdce232e9 (at 10.50.5.39@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e2f60a70800, cur 1708675036 expire 1708674886 last 1708674809 [1866894.080150] Lustre: Skipped 1 previous similar message [1866903.059464] Lustre: fir-OST009d: haven't heard from client be04dc42-3dda-412f-8c06-ec5cdce232e9 (at 10.50.5.39@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e35358d3000, cur 1708675045 expire 1708674895 last 1708674818 [1866903.081673] Lustre: Skipped 4 previous similar messages [1866911.058646] Lustre: fir-OST0099: haven't heard from client be04dc42-3dda-412f-8c06-ec5cdce232e9 (at 10.50.5.39@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33c9a7b800, cur 1708675053 expire 1708674903 last 1708674826 [1866911.080513] Lustre: Skipped 1 previous similar message [1867469.035554] Lustre: fir-OST009d: haven't heard from client 71318d21-c5ab-494e-ae32-01243b08c476 (at 10.51.14.13@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33d6527800, cur 1708675611 expire 1708675461 last 1708675384 [1867469.058107] Lustre: Skipped 1 previous similar message [1867483.030687] Lustre: fir-OST009b: haven't heard from client 71318d21-c5ab-494e-ae32-01243b08c476 (at 10.51.14.13@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e0080eadc00, cur 1708675625 expire 1708675475 last 1708675398 [1867483.052642] Lustre: Skipped 1 previous similar message [1867871.007126] Lustre: fir-OST0099: haven't heard from client 925b2705-ec90-4765-be3f-1bf2cc5b68a2 (at 10.51.8.42@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e2f627d5400, cur 1708676013 expire 1708675863 last 1708675786 [1867871.029116] Lustre: Skipped 1 previous similar message [1871609.805235] Lustre: fir-OST009b: haven't heard from client cd32b718-fbe5-4c2e-8985-7be0af9f412b (at 10.51.1.13@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3426e1f000, cur 1708679752 expire 1708679602 last 1708679525 [1871609.827129] Lustre: Skipped 3 previous similar messages [1872681.749959] Lustre: fir-OST0099: haven't heard from client 7407136c-a28e-40e7-aaf1-e0b6d6ec4801 (at 10.51.13.16@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e021856a400, cur 1708680824 expire 1708680674 last 1708680597 [1872681.771913] Lustre: Skipped 3 previous similar messages [1872686.743951] Lustre: fir-OST009b: haven't heard from client 7407136c-a28e-40e7-aaf1-e0b6d6ec4801 (at 10.51.13.16@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e007fc69400, cur 1708680829 expire 1708680679 last 1708680602 [1872686.765911] Lustre: Skipped 1 previous similar message [1873613.693998] Lustre: fir-OST009b: haven't heard from client 0b45beb8-6b97-4db1-a759-0d7f8a5de761 (at 10.51.4.61@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df9665ec800, cur 1708681756 expire 1708681606 last 1708681529 [1873613.715998] Lustre: Skipped 1 previous similar message [1877256.497826] Lustre: fir-OST0099: haven't heard from client 7012deb1-070d-408c-ac55-ab7405859d7d (at 10.51.6.27@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df8c0264000, cur 1708685399 expire 1708685249 last 1708685172 [1877256.520064] Lustre: Skipped 3 previous similar messages [1877276.495915] Lustre: fir-OST009f: haven't heard from client 7012deb1-070d-408c-ac55-ab7405859d7d (at 10.51.6.27@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df8c0262000, cur 1708685419 expire 1708685269 last 1708685192 [1877276.517786] Lustre: Skipped 2 previous similar messages [1881331.273714] Lustre: fir-OST009d: haven't heard from client 121fe094-285c-414e-b847-cd98787fc740 (at 10.51.1.35@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e32f8856c00, cur 1708689474 expire 1708689324 last 1708689247 [1881350.276402] Lustre: fir-OST009f: haven't heard from client 121fe094-285c-414e-b847-cd98787fc740 (at 10.51.1.35@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e413f650c00, cur 1708689493 expire 1708689343 last 1708689266 [1881350.298274] Lustre: Skipped 1 previous similar message [1881918.243615] Lustre: fir-OST009b: haven't heard from client e0b0ffae-4dff-44ac-9655-7e38c7493164 (at 10.51.2.67@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df96906c000, cur 1708690061 expire 1708689911 last 1708689834 [1881918.265487] Lustre: Skipped 1 previous similar message [1881923.242147] Lustre: fir-OST0099: haven't heard from client e0b0ffae-4dff-44ac-9655-7e38c7493164 (at 10.51.2.67@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dee28e8c800, cur 1708690066 expire 1708689916 last 1708689839 [1881923.264424] Lustre: Skipped 1 previous similar message [1884772.087485] Lustre: fir-OST0099: haven't heard from client f3fe5311-7e7e-4881-abd3-18d537cf19f0 (at 10.51.1.59@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33d32c3400, cur 1708692915 expire 1708692765 last 1708692688 [1884772.109539] Lustre: Skipped 1 previous similar message [1885137.068223] Lustre: fir-OST0099: haven't heard from client 89a56c18-3e2c-448d-ae7b-b9b01aca5fe2 (at 10.51.8.41@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dff76b42c00, cur 1708693280 expire 1708693130 last 1708693053 [1885137.090310] Lustre: Skipped 3 previous similar messages [1885147.066580] Lustre: fir-OST009b: haven't heard from client 89a56c18-3e2c-448d-ae7b-b9b01aca5fe2 (at 10.51.8.41@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dff7474e400, cur 1708693290 expire 1708693140 last 1708693063 [1885147.088451] Lustre: Skipped 1 previous similar message [1890016.935918] LustreError: 137-5: fir-OST0098_UUID: not available for connect from 10.50.1.18@o2ib2 (no target). If you are running an HA pair check that the target is mounted on the other server. [1890016.953976] LustreError: Skipped 3 previous similar messages [1890028.998316] LustreError: 137-5: fir-OST0098_UUID: not available for connect from 10.50.1.3@o2ib2 (no target). If you are running an HA pair check that the target is mounted on the other server. [1890029.015684] LustreError: Skipped 3 previous similar messages [1890041.315379] LustreError: 137-5: fir-OST009c_UUID: not available for connect from 10.50.1.17@o2ib2 (no target). If you are running an HA pair check that the target is mounted on the other server. [1890041.333133] LustreError: Skipped 3 previous similar messages [1890045.848250] LustreError: 137-5: fir-OST0098_UUID: not available for connect from 10.50.1.9@o2ib2 (no target). If you are running an HA pair check that the target is mounted on the other server. [1890045.865616] LustreError: Skipped 3 previous similar messages [1890051.692834] LustreError: 137-5: fir-OST0098_UUID: not available for connect from 10.50.1.13@o2ib2 (no target). If you are running an HA pair check that the target is mounted on the other server. [1890051.710289] LustreError: Skipped 11 previous similar messages [1890059.879714] LustreError: 137-5: fir-OST0098_UUID: not available for connect from 10.50.1.22@o2ib2 (no target). If you are running an HA pair check that the target is mounted on the other server. [1890059.897180] LustreError: Skipped 11 previous similar messages [1890270.788338] Lustre: fir-OST0099: haven't heard from client 5c83a6bc-2800-4faf-a199-cec091d290fd (at 10.50.1.15@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e2914492000, cur 1708698414 expire 1708698264 last 1708698187 [1890270.810210] Lustre: Skipped 1 previous similar message [1891356.728722] Lustre: fir-OST0099: haven't heard from client c182ccca-ce56-43eb-842f-0d0ce97bf083 (at 10.50.1.1@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3fcc1c0800, cur 1708699500 expire 1708699350 last 1708699273 [1891356.750504] Lustre: Skipped 35 previous similar messages [1891361.731504] Lustre: fir-OST009d: haven't heard from client c182ccca-ce56-43eb-842f-0d0ce97bf083 (at 10.50.1.1@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e291650f800, cur 1708699505 expire 1708699355 last 1708699278 [1891368.730648] Lustre: fir-OST009f: haven't heard from client c182ccca-ce56-43eb-842f-0d0ce97bf083 (at 10.50.1.1@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3fcc1c5400, cur 1708699512 expire 1708699362 last 1708699285 [1891643.528642] Lustre: fir-OST0099: Client 271428eb-9657-442c-85b4-5fa160c78416 (at 10.51.15.15@o2ib3) reconnecting [1891815.704069] Lustre: fir-OST0099: haven't heard from client 60e7d790-61b2-4463-864a-7b4aa33decb3 (at 10.50.1.17@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33c672a000, cur 1708699959 expire 1708699809 last 1708699732 [1891815.725938] Lustre: Skipped 1 previous similar message [1891826.709610] Lustre: fir-OST009b: haven't heard from client 60e7d790-61b2-4463-864a-7b4aa33decb3 (at 10.50.1.17@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e2926c74400, cur 1708699970 expire 1708699820 last 1708699743 [1891826.731651] Lustre: Skipped 2 previous similar messages [1891891.700759] Lustre: fir-OST009d: haven't heard from client 4474bb13-27ba-41cb-85d4-bef99eb26b73 (at 10.51.1.57@o2ib3) in 225 seconds. I think it's dead, and I am evicting it. exp ffff9e2f716e6400, cur 1708700035 expire 1708699885 last 1708699810 [1891891.722818] Lustre: Skipped 1 previous similar message [1891901.032684] Lustre: fir-OST0099: Client 271428eb-9657-442c-85b4-5fa160c78416 (at 10.51.15.15@o2ib3) reconnecting [1892302.579013] LustreError: 137-5: fir-OST0098_UUID: not available for connect from 10.51.15.15@o2ib3 (no target). If you are running an HA pair check that the target is mounted on the other server. [1892302.596545] LustreError: Skipped 2 previous similar messages [1892306.578845] Lustre: fir-OST009b: Client 271428eb-9657-442c-85b4-5fa160c78416 (at 10.51.15.15@o2ib3) reconnecting [1892367.263374] Lustre: fir-OST009f: Client 271428eb-9657-442c-85b4-5fa160c78416 (at 10.51.15.15@o2ib3) reconnecting [1892394.277929] Lustre: fir-OST0099: Client 271428eb-9657-442c-85b4-5fa160c78416 (at 10.51.15.15@o2ib3) reconnecting [1892427.300241] LustreError: 137-5: fir-OST009a_UUID: not available for connect from 10.51.15.15@o2ib3 (no target). If you are running an HA pair check that the target is mounted on the other server. [1892439.131581] Lustre: fir-OST009b: Client 271428eb-9657-442c-85b4-5fa160c78416 (at 10.51.15.15@o2ib3) reconnecting [1892546.325762] Lustre: fir-OST009f: Client 271428eb-9657-442c-85b4-5fa160c78416 (at 10.51.15.15@o2ib3) reconnecting [1892602.706587] Lustre: fir-OST0099: Client 271428eb-9657-442c-85b4-5fa160c78416 (at 10.51.15.15@o2ib3) reconnecting [1892695.741742] Lustre: fir-OST009b: Client 271428eb-9657-442c-85b4-5fa160c78416 (at 10.51.15.15@o2ib3) reconnecting [1892791.536516] LustreError: 137-5: fir-OST009c_UUID: not available for connect from 10.51.15.15@o2ib3 (no target). If you are running an HA pair check that the target is mounted on the other server. [1893085.208415] Lustre: fir-OST0099: Client 271428eb-9657-442c-85b4-5fa160c78416 (at 10.51.15.15@o2ib3) reconnecting [1893085.218767] Lustre: Skipped 2 previous similar messages [1893448.852758] Lustre: fir-OST009f: Client 271428eb-9657-442c-85b4-5fa160c78416 (at 10.51.15.15@o2ib3) reconnecting [1893448.863104] Lustre: Skipped 2 previous similar messages [1893982.595483] Lustre: fir-OST0099: haven't heard from client 0eea0e09-c157-4496-8e1b-4f6f2bd1bdcb (at 10.50.1.23@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3e8e513000, cur 1708702126 expire 1708701976 last 1708701899 [1893982.617502] Lustre: Skipped 2 previous similar messages [1893988.586066] Lustre: fir-OST009b: haven't heard from client 0eea0e09-c157-4496-8e1b-4f6f2bd1bdcb (at 10.50.1.23@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e40a939f800, cur 1708702132 expire 1708701982 last 1708701905 [1894001.585932] Lustre: fir-OST009d: haven't heard from client 0eea0e09-c157-4496-8e1b-4f6f2bd1bdcb (at 10.50.1.23@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3e8e515400, cur 1708702145 expire 1708701995 last 1708701918 [1894001.608152] Lustre: Skipped 1 previous similar message [1894223.090730] Lustre: fir-OST009f: Client 271428eb-9657-442c-85b4-5fa160c78416 (at 10.51.15.15@o2ib3) reconnecting [1894223.101081] Lustre: Skipped 5 previous similar messages [1894394.564344] Lustre: fir-OST009f: haven't heard from client 681b4307-b36f-4b12-a2e2-3a2d7fba2bb3 (at 10.51.1.46@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e013aa9cc00, cur 1708702538 expire 1708702388 last 1708702311 [1894412.563216] Lustre: fir-OST0099: haven't heard from client 681b4307-b36f-4b12-a2e2-3a2d7fba2bb3 (at 10.51.1.46@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9ded882b7800, cur 1708702556 expire 1708702406 last 1708702329 [1894999.113534] LustreError: 137-5: fir-OST009a_UUID: not available for connect from 10.51.15.15@o2ib3 (no target). If you are running an HA pair check that the target is mounted on the other server. [1895077.280307] Lustre: fir-OST009d: Client 271428eb-9657-442c-85b4-5fa160c78416 (at 10.51.15.15@o2ib3) reconnecting [1895077.290654] Lustre: Skipped 9 previous similar messages [1895147.522952] Lustre: fir-OST0099: haven't heard from client 9bd6cc93-3550-4b46-8fa3-05f2146cd619 (at 10.51.1.40@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01f6588400, cur 1708703291 expire 1708703141 last 1708703064 [1895147.545283] Lustre: Skipped 2 previous similar messages [1895609.527502] LustreError: 137-5: fir-OST009c_UUID: not available for connect from 10.51.15.15@o2ib3 (no target). If you are running an HA pair check that the target is mounted on the other server. [1895712.658440] Lustre: fir-OST009f: Client 271428eb-9657-442c-85b4-5fa160c78416 (at 10.51.15.15@o2ib3) reconnecting [1895712.668782] Lustre: Skipped 1 previous similar message [1895953.479174] Lustre: fir-OST0099: haven't heard from client 9c61234a-2987-451f-8442-f51d9d06e65d (at 10.50.1.21@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df990899c00, cur 1708704097 expire 1708703947 last 1708703870 [1895953.501058] Lustre: Skipped 3 previous similar messages [1895964.490666] Lustre: fir-OST009f: haven't heard from client 9c61234a-2987-451f-8442-f51d9d06e65d (at 10.50.1.21@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3fcc1c1400, cur 1708704108 expire 1708703958 last 1708703881 [1895972.496674] Lustre: fir-OST009b: haven't heard from client 9c61234a-2987-451f-8442-f51d9d06e65d (at 10.50.1.21@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e40fba30400, cur 1708704116 expire 1708703966 last 1708703889 [1896393.559581] Lustre: fir-OST009b: Client 271428eb-9657-442c-85b4-5fa160c78416 (at 10.51.15.15@o2ib3) reconnecting [1896393.569935] Lustre: Skipped 7 previous similar messages [1896821.433799] Lustre: fir-OST0099: haven't heard from client 27835a3e-60e7-49c4-a318-cbd3862f9e9e (at 10.50.1.16@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9ded862fd000, cur 1708704965 expire 1708704815 last 1708704738 [1896821.455679] Lustre: Skipped 1 previous similar message [1896832.431393] Lustre: fir-OST009b: haven't heard from client 27835a3e-60e7-49c4-a318-cbd3862f9e9e (at 10.50.1.16@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e01efff4400, cur 1708704976 expire 1708704826 last 1708704749 [1896832.453413] Lustre: Skipped 1 previous similar message [1896986.423862] Lustre: fir-OST009b: haven't heard from client f825561d-8ded-4932-94fb-a7fe90ffbd0c (at 10.51.9.67@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e40b3028800, cur 1708705130 expire 1708704980 last 1708704903 [1896986.445730] Lustre: Skipped 1 previous similar message [1896993.422426] Lustre: fir-OST009f: haven't heard from client efc12b58-d0e3-4838-ab43-1ce5569c73f7 (at 10.51.9.59@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e02f2114c00, cur 1708705137 expire 1708704987 last 1708704910 [1896993.444299] Lustre: Skipped 5 previous similar messages [1897098.134283] Lustre: fir-OST009f: Client 271428eb-9657-442c-85b4-5fa160c78416 (at 10.51.15.15@o2ib3) reconnecting [1897098.144769] Lustre: Skipped 5 previous similar messages [1897153.415345] Lustre: fir-OST009b: haven't heard from client ae43027f-346e-4aec-b673-fb634cd00cad (at 10.51.9.52@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e022a30d800, cur 1708705297 expire 1708705147 last 1708705070 [1897153.437211] Lustre: Skipped 1 previous similar message [1897162.423766] Lustre: fir-OST009f: haven't heard from client ae43027f-346e-4aec-b673-fb634cd00cad (at 10.51.9.52@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e021f297000, cur 1708705306 expire 1708705156 last 1708705079 [1897162.445644] Lustre: Skipped 1 previous similar message [1897784.360962] Lustre: fir-OST009d: Client 271428eb-9657-442c-85b4-5fa160c78416 (at 10.51.15.15@o2ib3) reconnecting [1897784.371307] Lustre: Skipped 5 previous similar messages [1897815.553251] LustreError: 137-5: fir-OST0098_UUID: not available for connect from 10.51.15.15@o2ib3 (no target). If you are running an HA pair check that the target is mounted on the other server. [1898447.557844] Lustre: fir-OST009b: Client 271428eb-9657-442c-85b4-5fa160c78416 (at 10.51.15.15@o2ib3) reconnecting [1898447.568288] Lustre: Skipped 4 previous similar messages [1899061.884454] Lustre: fir-OST009f: Client 271428eb-9657-442c-85b4-5fa160c78416 (at 10.51.15.15@o2ib3) reconnecting [1899061.894941] Lustre: Skipped 4 previous similar messages [1899285.300424] Lustre: fir-OST009f: haven't heard from client e8b2cc4c-9cd7-4e97-9b6e-c6a3bae00ea8 (at 10.51.1.5@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33c998b800, cur 1708707429 expire 1708707279 last 1708707202 [1899285.322219] Lustre: Skipped 1 previous similar message [1899723.679449] Lustre: fir-OST009d: Client 271428eb-9657-442c-85b4-5fa160c78416 (at 10.51.15.15@o2ib3) reconnecting [1899723.689952] Lustre: Skipped 6 previous similar messages [1900407.803278] Lustre: fir-OST0099: Client 271428eb-9657-442c-85b4-5fa160c78416 (at 10.51.15.15@o2ib3) reconnecting [1900407.813625] Lustre: Skipped 3 previous similar messages [1900760.272285] LustreError: 137-5: fir-OST009e_UUID: not available for connect from 10.51.15.15@o2ib3 (no target). If you are running an HA pair check that the target is mounted on the other server. [1901019.553973] Lustre: fir-OST009f: Client 271428eb-9657-442c-85b4-5fa160c78416 (at 10.51.15.15@o2ib3) reconnecting [1901019.564481] Lustre: Skipped 5 previous similar messages [1901493.918320] LustreError: 137-5: fir-OST0098_UUID: not available for connect from 10.51.15.15@o2ib3 (no target). If you are running an HA pair check that the target is mounted on the other server. [1901735.115057] Lustre: fir-OST009b: Client 271428eb-9657-442c-85b4-5fa160c78416 (at 10.51.15.15@o2ib3) reconnecting [1901735.125407] Lustre: Skipped 9 previous similar messages [1902100.167509] Lustre: fir-OST009b: haven't heard from client f78c62ed-2d18-4f8f-a4b3-ff2e6bb6b4ec (at 10.51.6.13@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df967f66c00, cur 1708710244 expire 1708710094 last 1708710017 [1902100.189380] Lustre: Skipped 3 previous similar messages [1902112.159492] Lustre: fir-OST0099: haven't heard from client f78c62ed-2d18-4f8f-a4b3-ff2e6bb6b4ec (at 10.51.6.13@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df969f16400, cur 1708710256 expire 1708710106 last 1708710029 [1902448.067346] Lustre: fir-OST009f: Client 271428eb-9657-442c-85b4-5fa160c78416 (at 10.51.15.15@o2ib3) reconnecting [1902448.077692] Lustre: Skipped 5 previous similar messages [1903077.018224] Lustre: fir-OST009f: Client 271428eb-9657-442c-85b4-5fa160c78416 (at 10.51.15.15@o2ib3) reconnecting [1903077.028566] Lustre: Skipped 6 previous similar messages [1903717.128356] Lustre: fir-OST009d: Client 271428eb-9657-442c-85b4-5fa160c78416 (at 10.51.15.15@o2ib3) reconnecting [1903717.138701] Lustre: Skipped 2 previous similar messages [1904495.699992] Lustre: fir-OST009d: Client 271428eb-9657-442c-85b4-5fa160c78416 (at 10.51.15.15@o2ib3) reconnecting [1904495.710465] Lustre: Skipped 4 previous similar messages [1904847.735012] LustreError: 137-5: fir-OST009e_UUID: not available for connect from 10.51.15.15@o2ib3 (no target). If you are running an HA pair check that the target is mounted on the other server. [1905117.878320] Lustre: fir-OST009f: Client 271428eb-9657-442c-85b4-5fa160c78416 (at 10.51.15.15@o2ib3) reconnecting [1905117.889548] Lustre: Skipped 8 previous similar messages [1905747.731240] Lustre: fir-OST009d: Client 271428eb-9657-442c-85b4-5fa160c78416 (at 10.51.15.15@o2ib3) reconnecting [1905747.741584] Lustre: Skipped 4 previous similar messages [1906266.637311] LNetError: 27861:0:(o2iblnd_cb.c:3375:kiblnd_check_txs_locked()) Timed out tx: active_txs(WSQ:100), 48 seconds [1906266.648668] LNetError: 27861:0:(o2iblnd_cb.c:3445:kiblnd_check_conns()) Timed out RDMA with 10.0.10.235@o2ib7 (0): c: 0, oc: 2, rc: 2 [1906266.661861] LustreError: 27861:0:(events.c:476:server_bulk_callback()) event type 5, status -103, desc ffff9e32d7190000 [1906266.661865] LNetError: 27826:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) route to o2ib3 through 10.0.10.235@o2ib7 has gone from up to down [1906266.661866] LNetError: 27826:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) Skipped 11 previous similar messages [1906266.667412] LNetError: 27866:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) route to o2ib3 through 10.0.10.235@o2ib7 has gone from down to up [1906266.708880] LustreError: 27861:0:(events.c:476:server_bulk_callback()) Skipped 34 previous similar messages [1906282.930503] LustreError: 46968:0:(ldlm_lib.c:3550:target_bulk_io()) @@@ network error on bulk READ req@ffff9ded2ebbcc80 x1790912594731904/t0(0) o3->71e6e20b-ea06-46cd-9b26-e9de2b2ddc67@10.51.17.18@o2ib3:719/0 lens 488/440 e 1 to 0 dl 1708714454 ref 1 fl Interpret:/0/0 rc 0/0 job:'41462678' [1906282.930662] Lustre: fir-OST009f: Bulk IO read error with 71e6e20b-ea06-46cd-9b26-e9de2b2ddc67 (at 10.51.17.18@o2ib3), client will retry: rc -110 [1906282.930663] Lustre: Skipped 1 previous similar message [1906282.974944] LustreError: 46968:0:(ldlm_lib.c:3550:target_bulk_io()) Skipped 3 previous similar messages [1906306.933109] LustreError: 47021:0:(ldlm_lib.c:3550:target_bulk_io()) @@@ network error on bulk READ req@ffff9df2d49f9f80 x1789878319820992/t0(0) o3->784e631e-ecea-4248-97b2-4a93787a517d@10.51.13.6@o2ib3:727/0 lens 488/440 e 0 to 0 dl 1708714462 ref 1 fl Interpret:/0/0 rc 0/0 job:'41723416' [1906306.958928] Lustre: fir-OST009b: Bulk IO read error with 784e631e-ecea-4248-97b2-4a93787a517d (at 10.51.13.6@o2ib3), client will retry: rc -110 [1906306.971974] Lustre: Skipped 3 previous similar messages [1906308.935044] LNetError: 27868:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) route to o2ib3 through 10.0.10.235@o2ib7 has gone from down to up [1906308.948213] LNetError: 27868:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) Skipped 1 previous similar message [1906340.926819] Lustre: fir-OST009d: haven't heard from client 7e1f2a7e-63a1-4ba7-aac5-fe6715460992 (at 10.51.5.51@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33ccd92400, cur 1708714485 expire 1708714335 last 1708714258 [1906340.948689] Lustre: Skipped 2 previous similar messages [1906352.012153] Lustre: fir-OST009d: Client 21f491d7-b5c0-4bc1-b356-e429cd8e3ae8 (at 10.51.10.23@o2ib3) reconnecting [1906352.022504] Lustre: Skipped 11 previous similar messages [1906358.914649] Lustre: fir-OST0099: haven't heard from client 7e1f2a7e-63a1-4ba7-aac5-fe6715460992 (at 10.51.5.51@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e2f60d44400, cur 1708714503 expire 1708714353 last 1708714276 [1906369.631667] LNetError: 27861:0:(o2iblnd_cb.c:3375:kiblnd_check_txs_locked()) Timed out tx: tx_queue(WSQ:001), 60 seconds [1906369.642705] LNetError: 27861:0:(o2iblnd_cb.c:3445:kiblnd_check_conns()) Timed out RDMA with 10.0.10.235@o2ib7 (0): c: 0, oc: 1, rc: 2 [1906369.655750] LustreError: 27861:0:(events.c:476:server_bulk_callback()) event type 5, status -103, desc ffff9df3ac0dbc00 [1906369.666697] LustreError: 27861:0:(events.c:476:server_bulk_callback()) Skipped 4 previous similar messages [1906378.933162] LustreError: 47220:0:(ldlm_lib.c:3550:target_bulk_io()) @@@ network error on bulk READ req@ffff9e214a819f80 x1791486149578112/t0(0) o3->164d595f-7d2d-499f-ac5e-2c3d4496d2b2@10.51.10.22@o2ib3:90/0 lens 488/440 e 0 to 0 dl 1708714580 ref 1 fl Interpret:/0/0 rc 0/0 job:'41659331' [1906378.958953] Lustre: fir-OST009b: Bulk IO read error with 164d595f-7d2d-499f-ac5e-2c3d4496d2b2 (at 10.51.10.22@o2ib3), client will retry: rc -110 [1906378.972071] Lustre: Skipped 1 previous similar message [1906402.933869] LustreError: 47038:0:(ldlm_lib.c:3550:target_bulk_io()) @@@ network error on bulk READ req@ffff9e217ad95a00 x1789878320063680/t0(0) o3->784e631e-ecea-4248-97b2-4a93787a517d@10.51.13.6@o2ib3:114/0 lens 488/440 e 0 to 0 dl 1708714604 ref 1 fl Interpret:/0/0 rc 0/0 job:'41723398' [1906402.933914] Lustre: fir-OST009d: Bulk IO read error with 784e631e-ecea-4248-97b2-4a93787a517d (at 10.51.13.6@o2ib3), client will retry: rc -110 [1906402.972912] LustreError: 47038:0:(ldlm_lib.c:3550:target_bulk_io()) Skipped 2 previous similar messages [1906420.628879] LNetError: 27861:0:(o2iblnd_cb.c:3375:kiblnd_check_txs_locked()) Timed out tx: active_txs(WSQ:100), 50 seconds [1906420.640090] LNetError: 27861:0:(o2iblnd_cb.c:3445:kiblnd_check_conns()) Timed out RDMA with 10.0.10.235@o2ib7 (0): c: 3, oc: 0, rc: 3 [1906420.653178] LustreError: 27861:0:(events.c:476:server_bulk_callback()) event type 5, status -103, desc ffff9df3ac0dbc00 [1906420.664126] LustreError: 27861:0:(events.c:476:server_bulk_callback()) Skipped 5 previous similar messages [1906420.673976] LustreError: 47079:0:(ldlm_lib.c:3550:target_bulk_io()) @@@ network error on bulk READ req@ffff9deea808f500 x1789878320063616/t0(0) o3->784e631e-ecea-4248-97b2-4a93787a517d@10.51.13.6@o2ib3:114/0 lens 488/440 e 0 to 0 dl 1708714604 ref 1 fl Interpret:/0/0 rc 0/0 job:'41723398' [1906420.674005] Lustre: fir-OST009d: Bulk IO read error with 784e631e-ecea-4248-97b2-4a93787a517d (at 10.51.13.6@o2ib3), client will retry: rc -110 [1906420.674007] Lustre: Skipped 1 previous similar message [1906420.718726] LustreError: 47079:0:(ldlm_lib.c:3550:target_bulk_io()) Skipped 1 previous similar message [1906471.626092] LNetError: 27861:0:(o2iblnd_cb.c:3375:kiblnd_check_txs_locked()) Timed out tx: tx_queue(WSQ:101), 50 seconds [1906471.637126] LNetError: 27861:0:(o2iblnd_cb.c:3445:kiblnd_check_conns()) Timed out RDMA with 10.0.10.235@o2ib7 (0): c: 0, oc: 0, rc: 5 [1906471.650273] LustreError: 27861:0:(events.c:476:server_bulk_callback()) event type 5, status -103, desc ffff9e33bb846800 [1906471.650280] LNetError: 27826:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) route to o2ib3 through 10.0.10.235@o2ib7 has gone from up to down [1906471.660654] LNetError: 27866:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) route to o2ib3 through 10.0.10.235@o2ib7 has gone from down to up [1906471.686924] LustreError: 27861:0:(events.c:476:server_bulk_callback()) Skipped 4 previous similar messages [1906474.936312] LustreError: 47224:0:(sec.c:2543:sptlrpc_svc_unwrap_bulk()) @@@ truncated bulk GET 14680064(16777216) req@ffff9e2176d2d580 x1791293172794176/t0(0) o4->59705636-2cb1-42cb-bbf8-85e34f706fc8@10.51.13.23@o2ib3:201/0 lens 488/448 e 0 to 0 dl 1708714691 ref 1 fl Interpret:/0/0 rc 0/0 job:'41707499' [1906474.936330] LustreError: 47202:0:(ldlm_lib.c:3550:target_bulk_io()) @@@ network error on bulk READ req@ffff9e2eb0f43600 x1791481432242112/t0(0) o3->d32f8099-ae46-4d9d-ac2d-50cbba65321c@10.51.6.48@o2ib3:201/0 lens 488/440 e 0 to 0 dl 1708714691 ref 1 fl Interpret:/0/0 rc 0/0 job:'41704383' [1906474.936352] Lustre: fir-OST009b: Bulk IO write error with 698de6c1-4f2e-428f-9ff8-e49cf6889638 (at 10.51.10.8@o2ib3), client will retry: rc = -110 [1906474.936361] Lustre: fir-OST009f: Bulk IO read error with d32f8099-ae46-4d9d-ac2d-50cbba65321c (at 10.51.6.48@o2ib3), client will retry: rc -110 [1906474.936361] Lustre: Skipped 1 previous similar message [1906475.021549] LustreError: 47224:0:(sec.c:2543:sptlrpc_svc_unwrap_bulk()) Skipped 2 previous similar messages [1906498.935649] LustreError: 47213:0:(ldlm_lib.c:3550:target_bulk_io()) @@@ network error on bulk READ req@ffff9e2178a8da00 x1790853548880512/t0(0) o3->d0a37c9a-5589-4b66-b4cf-9e5923ee86c0@10.51.16.12@o2ib3:209/0 lens 488/440 e 0 to 0 dl 1708714699 ref 1 fl Interpret:/0/0 rc 0/0 job:'41728708' [1906498.961749] LustreError: 47213:0:(ldlm_lib.c:3550:target_bulk_io()) Skipped 1 previous similar message [1906498.971261] Lustre: fir-OST0099: Bulk IO read error with d0a37c9a-5589-4b66-b4cf-9e5923ee86c0 (at 10.51.16.12@o2ib3), client will retry: rc -110 [1906522.623361] LNetError: 27861:0:(o2iblnd_cb.c:3375:kiblnd_check_txs_locked()) Timed out tx: tx_queue(WSQ:001), 50 seconds [1906522.634395] LNetError: 27861:0:(o2iblnd_cb.c:3445:kiblnd_check_conns()) Timed out RDMA with 10.0.10.235@o2ib7 (0): c: 0, oc: 1, rc: 2 [1906522.647446] LustreError: 27861:0:(events.c:476:server_bulk_callback()) event type 5, status -103, desc ffff9e0259fff800 [1906522.658395] LustreError: 27861:0:(events.c:476:server_bulk_callback()) Skipped 2 previous similar messages [1906522.668283] LNetError: 27826:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) route to o2ib3 through 10.0.10.235@o2ib7 has gone from up to down [1906522.696902] LNetError: 27867:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) route to o2ib3 through 10.0.10.235@o2ib7 has gone from down to up [1906522.936602] Lustre: fir-OST009d: Bulk IO write error with 5f4f196f-951c-4adb-a689-4c15dbc03750 (at 10.51.6.50@o2ib3), client will retry: rc = -110 [1906522.949912] Lustre: Skipped 2 previous similar messages [1906546.937086] LustreError: 47066:0:(ldlm_lib.c:3550:target_bulk_io()) @@@ network error on bulk READ req@ffff9e21771dcc80 x1789878320429632/t0(0) o3->784e631e-ecea-4248-97b2-4a93787a517d@10.51.13.6@o2ib3:261/0 lens 488/440 e 0 to 0 dl 1708714751 ref 1 fl Interpret:/0/0 rc 0/0 job:'41723403' [1906546.937158] Lustre: fir-OST009f: Bulk IO read error with 784e631e-ecea-4248-97b2-4a93787a517d (at 10.51.13.6@o2ib3), client will retry: rc -110 [1906546.937159] Lustre: Skipped 1 previous similar message [1906546.981332] LustreError: 47066:0:(ldlm_lib.c:3550:target_bulk_io()) Skipped 4 previous similar messages [1907068.736876] Lustre: fir-OST009d: Client 271428eb-9657-442c-85b4-5fa160c78416 (at 10.51.15.15@o2ib3) reconnecting [1907068.747223] Lustre: Skipped 26 previous similar messages [1907166.720399] LustreError: 137-5: fir-OST009c_UUID: not available for connect from 10.51.15.15@o2ib3 (no target). If you are running an HA pair check that the target is mounted on the other server. [1907673.497118] Lustre: fir-OST009b: Client 271428eb-9657-442c-85b4-5fa160c78416 (at 10.51.15.15@o2ib3) reconnecting [1907673.507462] Lustre: Skipped 4 previous similar messages [1908336.181374] Lustre: fir-OST009b: Client 271428eb-9657-442c-85b4-5fa160c78416 (at 10.51.15.15@o2ib3) reconnecting [1908336.191728] Lustre: Skipped 4 previous similar messages [1908648.395589] LustreError: 137-5: fir-OST009c_UUID: not available for connect from 10.51.15.15@o2ib3 (no target). If you are running an HA pair check that the target is mounted on the other server. [1909191.671154] Lustre: fir-OST009b: Client 271428eb-9657-442c-85b4-5fa160c78416 (at 10.51.15.15@o2ib3) reconnecting [1909191.681495] Lustre: Skipped 4 previous similar messages [1909273.756269] Lustre: fir-OST0099: haven't heard from client 7959328d-5e24-4a20-bd12-b68e92bcad83 (at 10.50.8.58@o2ib2) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e40a3c79000, cur 1708717418 expire 1708717268 last 1708717191 [1909273.778432] Lustre: Skipped 2 previous similar messages [1910067.296101] Lustre: fir-OST0099: Client 271428eb-9657-442c-85b4-5fa160c78416 (at 10.51.15.15@o2ib3) reconnecting [1910067.306448] Lustre: Skipped 5 previous similar messages [1910708.604807] Lustre: fir-OST009f: Client 271428eb-9657-442c-85b4-5fa160c78416 (at 10.51.15.15@o2ib3) reconnecting [1910708.615465] Lustre: Skipped 6 previous similar messages [1911311.417885] Lustre: fir-OST009b: Client 271428eb-9657-442c-85b4-5fa160c78416 (at 10.51.15.15@o2ib3) reconnecting [1911311.428619] Lustre: Skipped 5 previous similar messages [1911557.633923] Lustre: fir-OST009b: haven't heard from client 882f704e-532e-4ad3-b7f1-3bed0b05e9cc (at 10.51.5.59@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33bf223c00, cur 1708719702 expire 1708719552 last 1708719475 [1911557.656153] Lustre: Skipped 11 previous similar messages [1911563.632943] Lustre: fir-OST009d: haven't heard from client 4bc68a9e-cdaa-431a-9832-a8ce0d9647a0 (at 10.51.4.68@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3e41d36000, cur 1708719708 expire 1708719558 last 1708719481 [1911563.654817] Lustre: Skipped 3 previous similar messages [1912048.989466] Lustre: fir-OST0099: Client 271428eb-9657-442c-85b4-5fa160c78416 (at 10.51.15.15@o2ib3) reconnecting [1912048.999818] Lustre: Skipped 10 previous similar messages [1912695.071696] Lustre: fir-OST0099: Client 271428eb-9657-442c-85b4-5fa160c78416 (at 10.51.15.15@o2ib3) reconnecting [1912695.082045] Lustre: Skipped 9 previous similar messages [1913067.189249] LustreError: 137-5: fir-OST0098_UUID: not available for connect from 10.51.15.15@o2ib3 (no target). If you are running an HA pair check that the target is mounted on the other server. [1913391.948045] Lustre: fir-OST009b: Client 271428eb-9657-442c-85b4-5fa160c78416 (at 10.51.15.15@o2ib3) reconnecting [1913391.958577] Lustre: Skipped 7 previous similar messages [1913934.224591] LNetError: 27861:0:(o2iblnd_cb.c:3375:kiblnd_check_txs_locked()) Timed out tx: active_txs(WSQ:100), 50 seconds [1913934.235798] LNetError: 27861:0:(o2iblnd_cb.c:3445:kiblnd_check_conns()) Timed out RDMA with 10.0.10.235@o2ib7 (0): c: 0, oc: 1, rc: 0 [1913934.248987] LustreError: 27861:0:(events.c:476:server_bulk_callback()) event type 5, status -103, desc ffff9dff6fde3000 [1913934.260124] LustreError: 27861:0:(events.c:476:server_bulk_callback()) Skipped 6 previous similar messages [1913934.270248] LNetError: 27861:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) route to o2ib3 through 10.0.10.235@o2ib7 has gone from up to down [1913939.163339] LustreError: 47017:0:(ldlm_lib.c:3550:target_bulk_io()) @@@ network error on bulk READ req@ffff9e2b6425e300 x1790639736413568/t0(0) o3->1e4aa554-5e6f-4b8b-a4ca-10a3f6273fc3@10.51.18.5@o2ib3:60/0 lens 488/440 e 0 to 0 dl 1708722100 ref 1 fl Interpret:/0/0 rc 0/0 job:'41728650' [1913939.165104] Lustre: fir-OST009d: Bulk IO read error with 59705636-2cb1-42cb-bbf8-85e34f706fc8 (at 10.51.13.23@o2ib3), client will retry: rc -110 [1913939.165105] Lustre: Skipped 2 previous similar messages [1913939.207803] LustreError: 47017:0:(ldlm_lib.c:3550:target_bulk_io()) Skipped 2 previous similar messages [1913963.164050] LustreError: 46847:0:(ldlm_lib.c:3550:target_bulk_io()) @@@ network error on bulk READ req@ffff9e2b4d5d8900 x1791204058424512/t0(0) o3->495dc22c-8a95-4c40-b650-3d56b65db6dd@10.51.7.51@o2ib3:74/0 lens 488/440 e 0 to 0 dl 1708722114 ref 1 fl Interpret:/0/0 rc 0/0 job:'41674001' [1913963.190029] Lustre: fir-OST0099: Bulk IO read error with 495dc22c-8a95-4c40-b650-3d56b65db6dd (at 10.51.7.51@o2ib3), client will retry: rc -110 [1913963.203060] Lustre: Skipped 2 previous similar messages [1913987.164775] LustreError: 47079:0:(ldlm_lib.c:3550:target_bulk_io()) @@@ network error on bulk READ req@ffff9e2b01592880 x1791102479132032/t0(0) o3->13d75fab-3a0f-415b-a7d0-557db9681583@10.51.6.37@o2ib3:109/0 lens 488/440 e 0 to 0 dl 1708722149 ref 1 fl Interpret:/0/0 rc 0/0 job:'sh03-06n37:356699:bwa' [1913987.164859] Lustre: fir-OST0099: Bulk IO read error with 13d75fab-3a0f-415b-a7d0-557db9681583 (at 10.51.6.37@o2ib3), client will retry: rc -110 [1913987.164862] Lustre: fir-OST0099: Bulk IO read error with 13d75fab-3a0f-415b-a7d0-557db9681583 (at 10.51.6.37@o2ib3), client will retry: rc -110 [1913987.217877] LustreError: 47079:0:(ldlm_lib.c:3550:target_bulk_io()) Skipped 1 previous similar message [1913989.165711] LNetError: 27866:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) route to o2ib3 through 10.0.10.235@o2ib7 has gone from down to up [1914010.676706] Lustre: fir-OST009d: Client 271428eb-9657-442c-85b4-5fa160c78416 (at 10.51.15.15@o2ib3) reconnecting [1914010.687199] Lustre: Skipped 9 previous similar messages [1914049.218406] LNetError: 27861:0:(o2iblnd_cb.c:3375:kiblnd_check_txs_locked()) Timed out tx: active_txs(WSQ:100), 59 seconds [1914049.229617] LNetError: 27861:0:(o2iblnd_cb.c:3445:kiblnd_check_conns()) Timed out RDMA with 10.0.10.235@o2ib7 (0): c: 0, oc: 3, rc: 0 [1914049.242737] LustreError: 27861:0:(events.c:476:server_bulk_callback()) event type 5, status -103, desc ffff9e01eab21400 [1914049.253688] LustreError: 27861:0:(events.c:476:server_bulk_callback()) Skipped 7 previous similar messages [1914049.263683] LNetError: 27861:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) route to o2ib3 through 10.0.10.235@o2ib7 has gone from up to down [1914059.164890] LustreError: 46923:0:(ldlm_lib.c:3550:target_bulk_io()) @@@ network error on bulk READ req@ffff9de9f9667080 x1789469834483584/t0(0) o3->bf7a8074-3ca5-4fb9-a6e5-0158def87257@10.51.8.23@o2ib3:191/0 lens 488/440 e 1 to 0 dl 1708722231 ref 1 fl Interpret:/0/0 rc 0/0 job:'41668593' [1914059.164950] Lustre: fir-OST009b: Bulk IO read error with 784e631e-ecea-4248-97b2-4a93787a517d (at 10.51.13.6@o2ib3), client will retry: rc -110 [1914059.164952] Lustre: Skipped 1 previous similar message [1914059.208994] LustreError: 46923:0:(ldlm_lib.c:3550:target_bulk_io()) Skipped 5 previous similar messages [1914086.684407] LustreError: 27867:0:(events.c:476:server_bulk_callback()) event type 5, status -110, desc ffff9df99459fc00 [1914086.695365] LustreError: 27867:0:(events.c:476:server_bulk_callback()) Skipped 7 previous similar messages [1914800.696254] Lustre: fir-OST009f: Client 271428eb-9657-442c-85b4-5fa160c78416 (at 10.51.15.15@o2ib3) reconnecting [1914800.706740] Lustre: Skipped 14 previous similar messages [1915431.706256] Lustre: fir-OST009d: Client 271428eb-9657-442c-85b4-5fa160c78416 (at 10.51.15.15@o2ib3) reconnecting [1915431.716606] Lustre: Skipped 5 previous similar messages [1916033.111571] LNetError: 27861:0:(o2iblnd_cb.c:3375:kiblnd_check_txs_locked()) Timed out tx: tx_queue(WSQ:001), 49 seconds [1916033.122610] LNetError: 27861:0:(o2iblnd_cb.c:3445:kiblnd_check_conns()) Timed out RDMA with 10.0.10.235@o2ib7 (0): c: 0, oc: 1, rc: 3 [1916033.135743] LustreError: 27861:0:(events.c:476:server_bulk_callback()) event type 5, status -103, desc ffff9dff7922dc00 [1916033.135759] LNetError: 27826:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) route to o2ib3 through 10.0.10.235@o2ib7 has gone from up to down [1916033.135761] LNetError: 27826:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) Skipped 1 previous similar message [1916033.141524] LNetError: 27868:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) route to o2ib3 through 10.0.10.235@o2ib7 has gone from down to up [1916033.182830] LustreError: 27861:0:(events.c:476:server_bulk_callback()) Skipped 5 previous similar messages [1916035.319636] Lustre: fir-OST009b: Client 271428eb-9657-442c-85b4-5fa160c78416 (at 10.51.15.15@o2ib3) reconnecting [1916035.329977] Lustre: Skipped 5 previous similar messages [1916051.174601] LustreError: 47065:0:(sec.c:2543:sptlrpc_svc_unwrap_bulk()) @@@ truncated bulk GET 14680064(16777216) req@ffff9e20c6d48000 x1790220936281216/t0(0) o4->a6954b6b-adc3-4047-8ae9-17e4aacadd03@10.51.18.21@o2ib3:650/0 lens 488/448 e 0 to 0 dl 1708724200 ref 1 fl Interpret:/0/0 rc 0/0 job:'41729526' [1916051.174609] LustreError: 46879:0:(ldlm_lib.c:3550:target_bulk_io()) @@@ network error on bulk READ req@ffff9e2c93f03f00 x1789743927152192/t0(0) o3->e8bcad55-7eea-4b68-abdc-50bcc2c8d123@10.51.13.22@o2ib3:650/0 lens 488/440 e 0 to 0 dl 1708724200 ref 1 fl Interpret:/0/0 rc 0/0 job:'41723389' [1916051.174610] LustreError: 46879:0:(ldlm_lib.c:3550:target_bulk_io()) Skipped 3 previous similar messages [1916051.174644] Lustre: fir-OST009d: Bulk IO read error with e8bcad55-7eea-4b68-abdc-50bcc2c8d123 (at 10.51.13.22@o2ib3), client will retry: rc -110 [1916051.174644] Lustre: Skipped 8 previous similar messages [1916051.255702] Lustre: fir-OST009b: Bulk IO write error with a6954b6b-adc3-4047-8ae9-17e4aacadd03 (at 10.51.18.21@o2ib3), client will retry: rc = -110 [1916075.176349] LustreError: 47074:0:(ldlm_lib.c:3550:target_bulk_io()) @@@ network error on bulk READ req@ffff9e217ba8b600 x1790831111903040/t0(0) o3->6a9e419c-4303-4adc-8d3f-fb97f168d201@10.51.10.41@o2ib3:686/0 lens 488/440 e 0 to 0 dl 1708724236 ref 1 fl Interpret:/0/0 rc 0/0 job:'40661017' [1916075.202322] LustreError: 47074:0:(ldlm_lib.c:3550:target_bulk_io()) Skipped 2 previous similar messages [1916075.211913] Lustre: fir-OST009b: Bulk IO read error with 6a9e419c-4303-4adc-8d3f-fb97f168d201 (at 10.51.10.41@o2ib3), client will retry: rc -110 [1916075.225022] Lustre: Skipped 2 previous similar messages [1916225.101212] LNetError: 27861:0:(o2iblnd_cb.c:3375:kiblnd_check_txs_locked()) Timed out tx: active_txs(WSQ:100), 52 seconds [1916225.112424] LNetError: 27861:0:(o2iblnd_cb.c:3445:kiblnd_check_conns()) Timed out RDMA with 10.0.10.235@o2ib7 (0): c: 0, oc: 0, rc: 0 [1916225.125576] LustreError: 27861:0:(events.c:476:server_bulk_callback()) event type 5, status -103, desc ffff9e40de803400 [1916225.136637] LustreError: 27861:0:(events.c:476:server_bulk_callback()) Skipped 4 previous similar messages [1916225.146588] LNetError: 27861:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) route to o2ib3 through 10.0.10.235@o2ib7 has gone from up to down [1916243.174250] LustreError: 47087:0:(ldlm_lib.c:3550:target_bulk_io()) @@@ network error on bulk READ req@ffff9e2177018d80 x1789469841841856/t0(0) o3->bf7a8074-3ca5-4fb9-a6e5-0158def87257@10.51.8.23@o2ib3:108/0 lens 488/440 e 1 to 0 dl 1708724413 ref 1 fl Interpret:/0/0 rc 0/0 job:'41668593' [1916243.174252] LustreError: 46954:0:(sec.c:2543:sptlrpc_svc_unwrap_bulk()) @@@ truncated bulk GET 14680064(16777216) req@ffff9e212f8c9680 x1790220937362880/t0(0) o4->a6954b6b-adc3-4047-8ae9-17e4aacadd03@10.51.18.21@o2ib3:108/0 lens 488/448 e 1 to 0 dl 1708724413 ref 1 fl Interpret:/0/0 rc 0/0 job:'41729534' [1916243.174284] Lustre: fir-OST009d: Bulk IO read error with bf7a8074-3ca5-4fb9-a6e5-0158def87257 (at 10.51.8.23@o2ib3), client will retry: rc -110 [1916243.174288] Lustre: fir-OST009f: Bulk IO write error with a6954b6b-adc3-4047-8ae9-17e4aacadd03 (at 10.51.18.21@o2ib3), client will retry: rc = -110 [1916243.254140] LustreError: 47087:0:(ldlm_lib.c:3550:target_bulk_io()) Skipped 2 previous similar messages [1916276.098462] LNetError: 27861:0:(o2iblnd_cb.c:3375:kiblnd_check_txs_locked()) Timed out tx: active_txs(WSQ:100), 50 seconds [1916276.109672] LNetError: 27861:0:(o2iblnd_cb.c:3445:kiblnd_check_conns()) Timed out RDMA with 10.0.10.235@o2ib7 (0): c: 2, oc: 0, rc: 4 [1916276.122749] LustreError: 27861:0:(events.c:476:server_bulk_callback()) event type 5, status -103, desc ffff9e40de803400 [1916276.133696] LustreError: 27861:0:(events.c:476:server_bulk_callback()) Skipped 7 previous similar messages [1916276.143875] LustreError: 46752:0:(ldlm_lib.c:3550:target_bulk_io()) @@@ network error on bulk READ req@ffff9e27ef0aad00 x1790905593524096/t0(0) o3->f36936eb-36c4-40df-8ac5-6aca84711a04@10.51.7.19@o2ib3:120/0 lens 488/440 e 0 to 0 dl 1708724425 ref 1 fl Interpret:/0/0 rc 0/0 job:'41076547' [1916276.143897] LNetError: 27861:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) route to o2ib3 through 10.0.10.235@o2ib7 has gone from up to down [1916276.143898] LNetError: 27861:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) Skipped 1 previous similar message [1916276.193211] LustreError: 46752:0:(ldlm_lib.c:3550:target_bulk_io()) Skipped 3 previous similar messages [1916315.173407] Lustre: fir-OST009f: Bulk IO read error with 784e631e-ecea-4248-97b2-4a93787a517d (at 10.51.13.6@o2ib3), client will retry: rc -110 [1916315.186445] Lustre: Skipped 6 previous similar messages [1916329.174893] LNetError: 27866:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) route to o2ib3 through 10.0.10.235@o2ib7 has gone from down to up [1916378.092943] LNetError: 27861:0:(o2iblnd_cb.c:3375:kiblnd_check_txs_locked()) Timed out tx: active_txs(WSQ:100), 48 seconds [1916378.104150] LNetError: 27861:0:(o2iblnd_cb.c:3445:kiblnd_check_conns()) Timed out RDMA with 10.0.10.235@o2ib7 (0): c: 1, oc: 1, rc: 1 [1916378.117230] LustreError: 27861:0:(events.c:476:server_bulk_callback()) event type 5, status -103, desc ffff9e0008a79800 [1916378.128180] LustreError: 27861:0:(events.c:476:server_bulk_callback()) Skipped 3 previous similar messages [1916378.138051] LNetError: 27861:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) route to o2ib3 through 10.0.10.235@o2ib7 has gone from up to down [1916387.172473] LustreError: 46951:0:(ldlm_lib.c:3550:target_bulk_io()) @@@ network error on bulk READ req@ffff9e20a0590000 x1790640087916288/t0(0) o3->1e4aa554-5e6f-4b8b-a4ca-10a3f6273fc3@10.51.18.5@o2ib3:295/0 lens 488/440 e 0 to 0 dl 1708724600 ref 1 fl Interpret:/0/0 rc 0/0 job:'41728650' [1916387.198246] LustreError: 46951:0:(ldlm_lib.c:3550:target_bulk_io()) Skipped 5 previous similar messages [1916389.173423] LNetError: 27867:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) route to o2ib3 through 10.0.10.235@o2ib7 has gone from down to up [1916442.089500] LNetError: 27861:0:(o2iblnd_cb.c:3375:kiblnd_check_txs_locked()) Timed out tx: active_txs(WSQ:100), 52 seconds [1916442.100709] LNetError: 27861:0:(o2iblnd_cb.c:3445:kiblnd_check_conns()) Timed out RDMA with 10.0.10.235@o2ib7 (0): c: 0, oc: 0, rc: 2 [1916442.113854] LustreError: 27861:0:(events.c:476:server_bulk_callback()) event type 5, status -103, desc ffff9e4216480000 [1916442.124811] LustreError: 27861:0:(events.c:476:server_bulk_callback()) Skipped 6 previous similar messages [1916442.134700] LNetError: 27861:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) route to o2ib3 through 10.0.10.235@o2ib7 has gone from up to down [1916459.172611] Lustre: fir-OST009d: Bulk IO read error with e4173a19-6364-4ed8-9ad0-6f93a55bf401 (at 10.51.6.67@o2ib3), client will retry: rc -110 [1916459.185731] Lustre: Skipped 10 previous similar messages [1916506.086027] LNetError: 27861:0:(o2iblnd_cb.c:3375:kiblnd_check_txs_locked()) Timed out tx: active_txs(WSQ:100), 50 seconds [1916506.097239] LNetError: 27861:0:(o2iblnd_cb.c:3445:kiblnd_check_conns()) Timed out RDMA with 10.0.10.235@o2ib7 (0): c: 0, oc: 0, rc: 0 [1916506.110364] LustreError: 27861:0:(events.c:476:server_bulk_callback()) event type 5, status -103, desc ffff9e436357f000 [1916506.121432] LustreError: 27861:0:(events.c:476:server_bulk_callback()) Skipped 5 previous similar messages [1916506.131339] LNetError: 27861:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) route to o2ib3 through 10.0.10.235@o2ib7 has gone from up to down [1916506.144199] LNetError: 27861:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) Skipped 1 previous similar message [1916555.172170] LustreError: 46850:0:(ldlm_lib.c:3550:target_bulk_io()) @@@ network error on bulk READ req@ffff9dea47218d80 x1791092473330624/t0(0) o3->13b41e84-d040-4a81-8804-171135a5ca68@10.51.14.12@o2ib3:456/0 lens 488/440 e 0 to 0 dl 1708724761 ref 1 fl Interpret:/0/0 rc 0/0 job:'41486988' [1916555.198165] LustreError: 46850:0:(ldlm_lib.c:3550:target_bulk_io()) Skipped 12 previous similar messages [1916558.083204] LNetError: 27861:0:(o2iblnd_cb.c:3375:kiblnd_check_txs_locked()) Timed out tx: active_txs(WSQ:100), 51 seconds [1916558.094417] LNetError: 27861:0:(o2iblnd_cb.c:3445:kiblnd_check_conns()) Timed out RDMA with 10.0.10.235@o2ib7 (0): c: 3, oc: 0, rc: 3 [1916558.107468] LustreError: 27861:0:(events.c:476:server_bulk_callback()) event type 5, status -103, desc ffff9e41fa94b800 [1916558.118416] LustreError: 27861:0:(events.c:476:server_bulk_callback()) Skipped 7 previous similar messages [1916609.080459] LNetError: 27861:0:(o2iblnd_cb.c:3375:kiblnd_check_txs_locked()) Timed out tx: active_txs(WSQ:100), 50 seconds [1916609.091670] LNetError: 27861:0:(o2iblnd_cb.c:3445:kiblnd_check_conns()) Timed out RDMA with 10.0.10.235@o2ib7 (0): c: 0, oc: 1, rc: 0 [1916609.104902] LNetError: 27861:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) route to o2ib3 through 10.0.10.235@o2ib7 has gone from up to down [1916609.117765] LNetError: 27861:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) Skipped 1 previous similar message [1916660.078523] LustreError: 27861:0:(events.c:476:server_bulk_callback()) event type 5, status -103, desc ffff9e2f749c7000 [1916660.089649] LustreError: 27861:0:(events.c:476:server_bulk_callback()) Skipped 12 previous similar messages [1916671.888416] Lustre: fir-OST009d: Client 13b41e84-d040-4a81-8804-171135a5ca68 (at 10.51.14.12@o2ib3) reconnecting [1916671.898931] Lustre: Skipped 46 previous similar messages [1916711.074952] LNetError: 27861:0:(o2iblnd_cb.c:3375:kiblnd_check_txs_locked()) Timed out tx: active_txs(WSQ:100), 50 seconds [1916711.086157] LNetError: 27861:0:(o2iblnd_cb.c:3375:kiblnd_check_txs_locked()) Skipped 1 previous similar message [1916711.096410] LNetError: 27861:0:(o2iblnd_cb.c:3445:kiblnd_check_conns()) Timed out RDMA with 10.0.10.235@o2ib7 (0): c: 2, oc: 0, rc: 3 [1916711.108568] LNetError: 27861:0:(o2iblnd_cb.c:3445:kiblnd_check_conns()) Skipped 1 previous similar message [1916723.169334] Lustre: fir-OST0099: Bulk IO read error with 1e4aa554-5e6f-4b8b-a4ca-10a3f6273fc3 (at 10.51.18.5@o2ib3), client will retry: rc -110 [1916723.182368] Lustre: Skipped 23 previous similar messages [1916738.369119] Lustre: fir-OST009d: haven't heard from client 7ee175d2-68b7-4261-9a59-17db173512c3 (at 10.51.6.13@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9dff6f54b800, cur 1708724883 expire 1708724733 last 1708724656 [1916738.390986] Lustre: Skipped 3 previous similar messages [1916749.170999] LNetError: 27868:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) route to o2ib3 through 10.0.10.235@o2ib7 has gone from down to up [1916749.183860] LNetError: 27868:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) Skipped 2 previous similar messages [1916801.071020] LustreError: 27861:0:(events.c:476:server_bulk_callback()) event type 5, status -103, desc ffff9e38df249c00 [1916801.082344] LustreError: 27861:0:(events.c:476:server_bulk_callback()) Skipped 10 previous similar messages [1916819.167124] LustreError: 46749:0:(ldlm_lib.c:3550:target_bulk_io()) @@@ network error on bulk READ req@ffff9ded353fa880 x1789743929407808/t0(0) o3->e8bcad55-7eea-4b68-abdc-50bcc2c8d123@10.51.13.22@o2ib3:715/0 lens 488/440 e 0 to 0 dl 1708725020 ref 1 fl Interpret:/0/0 rc 0/0 job:'41723475' [1916819.192978] LustreError: 46749:0:(ldlm_lib.c:3550:target_bulk_io()) Skipped 21 previous similar messages [1916852.067346] LNetError: 27861:0:(o2iblnd_cb.c:3375:kiblnd_check_txs_locked()) Timed out tx: tx_queue(WSQ:001), 50 seconds [1916852.078381] LNetError: 27861:0:(o2iblnd_cb.c:3375:kiblnd_check_txs_locked()) Skipped 1 previous similar message [1916852.088631] LNetError: 27861:0:(o2iblnd_cb.c:3445:kiblnd_check_conns()) Timed out RDMA with 10.0.10.235@o2ib7 (0): c: 0, oc: 2, rc: 6 [1916852.100784] LNetError: 27861:0:(o2iblnd_cb.c:3445:kiblnd_check_conns()) Skipped 1 previous similar message [1916852.130676] LNetError: 27868:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) route to o2ib3 through 10.0.10.235@o2ib7 has gone from down to up [1916903.070838] LNetError: 27867:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) route to o2ib3 through 10.0.10.235@o2ib7 has gone from down to up [1916980.141501] Lustre: 47031:0:(client.c:2295:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1708724996/real 1708724996] req@ffff9e21298d6300 x1789761209754112/t0(0) o106->fir-OST009d@10.51.10.42@o2ib3:15/16 lens 328/280 e 0 to 1 dl 1708725124 ref 1 fl Rpc:XQr/0/ffffffff rc 0/-1 job:'' [1917057.057284] LNetError: 27861:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) route to o2ib3 through 10.0.10.235@o2ib7 has gone from up to down [1917057.070136] LNetError: 27861:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) Skipped 4 previous similar messages [1917159.050936] LNetError: 27861:0:(o2iblnd_cb.c:3375:kiblnd_check_txs_locked()) Timed out tx: active_txs(WSQ:100), 49 seconds [1917159.062150] LNetError: 27861:0:(o2iblnd_cb.c:3375:kiblnd_check_txs_locked()) Skipped 4 previous similar messages [1917159.072492] LNetError: 27861:0:(o2iblnd_cb.c:3445:kiblnd_check_conns()) Timed out RDMA with 10.0.10.235@o2ib7 (0): c: 2, oc: 3, rc: 3 [1917159.084645] LNetError: 27861:0:(o2iblnd_cb.c:3445:kiblnd_check_conns()) Skipped 4 previous similar messages [1917159.095692] LustreError: 27861:0:(events.c:476:server_bulk_callback()) event type 5, status -103, desc ffff9e013d730c00 [1917159.106783] LustreError: 27861:0:(events.c:476:server_bulk_callback()) Skipped 29 previous similar messages [1917227.168302] LustreError: 47009:0:(sec.c:2543:sptlrpc_svc_unwrap_bulk()) @@@ truncated bulk GET 49384(1097960) req@ffff9e2058684380 x1791092802761216/t0(0) o4->cda3e937-5b14-4083-88ce-9aba4e2547d1@10.51.2.31@o2ib3:326/0 lens 488/448 e 0 to 0 dl 1708725386 ref 1 fl Interpret:/0/0 rc 0/0 job:'41565771' [1917227.195070] Lustre: fir-OST009d: Bulk IO write error with cda3e937-5b14-4083-88ce-9aba4e2547d1 (at 10.51.2.31@o2ib3), client will retry: rc = -110 [1917251.168107] Lustre: fir-OST009d: Bulk IO read error with 164d595f-7d2d-499f-ac5e-2c3d4496d2b2 (at 10.51.10.22@o2ib3), client will retry: rc -110 [1917251.181234] Lustre: Skipped 29 previous similar messages [1917292.261133] Lustre: fir-OST009b: Client 164d595f-7d2d-499f-ac5e-2c3d4496d2b2 (at 10.51.10.22@o2ib3) reconnecting [1917292.271625] Lustre: Skipped 51 previous similar messages [1917347.164862] LustreError: 47009:0:(ldlm_lib.c:3550:target_bulk_io()) @@@ network error on bulk READ req@ffff9e205ae71b00 x1789743934185472/t0(0) o3->e8bcad55-7eea-4b68-abdc-50bcc2c8d123@10.51.13.22@o2ib3:500/0 lens 488/440 e 0 to 0 dl 1708725560 ref 1 fl Interpret:/0/0 rc 0/0 job:'41723384' [1917347.190722] LustreError: 47009:0:(ldlm_lib.c:3550:target_bulk_io()) Skipped 34 previous similar messages [1917389.903536] LustreError: 46966:0:(ldlm_lib.c:3534:target_bulk_io()) @@@ timeout on bulk READ after 100+1706808043s req@ffff9e2095834380 x1791535777513728/t0(0) o3->da6fcb59-7743-47f6-97c0-9e4b0fbf9c90@10.51.12.1@o2ib3:497/0 lens 488/440 e 2 to 0 dl 1708725557 ref 1 fl Interpret:/0/0 rc 0/0 job:'41716343' [1917389.930693] LustreError: 46966:0:(ldlm_lib.c:3534:target_bulk_io()) Skipped 3 previous similar messages [1917441.041875] LNetError: 27867:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) route to o2ib3 through 10.0.10.235@o2ib7 has gone from down to up [1917478.320275] Lustre: fir-OST009b: haven't heard from client d402da90-bf22-4df7-940e-7c13447991ca (at 10.51.1.39@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e28d321ac00, cur 1708725623 expire 1708725473 last 1708725396 [1917478.342143] Lustre: Skipped 3 previous similar messages [1917479.315251] Lustre: fir-OST0099: haven't heard from client d402da90-bf22-4df7-940e-7c13447991ca (at 10.51.1.39@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e41d80e0000, cur 1708725624 expire 1708725474 last 1708725397 [1917492.034113] Lustre: fir-OST009d: Bulk IO write error with 563b9ae4-a896-4f09-9708-a55ff7ea8c7e (at 10.51.3.47@o2ib3), client will retry: rc = -110 [1917498.327219] Lustre: fir-OST009f: haven't heard from client d402da90-bf22-4df7-940e-7c13447991ca (at 10.51.1.39@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e41dce0c000, cur 1708725643 expire 1708725493 last 1708725416 [1917498.349103] Lustre: Skipped 1 previous similar message [1917594.028446] LNetError: 27861:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) route to o2ib3 through 10.0.10.235@o2ib7 has gone from up to down [1917594.041300] LNetError: 27861:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) Skipped 10 previous similar messages [1917710.022277] LNetError: 27861:0:(o2iblnd_cb.c:3375:kiblnd_check_txs_locked()) Timed out tx: tx_queue(WSQ:001), 60 seconds [1917710.033491] LNetError: 27861:0:(o2iblnd_cb.c:3375:kiblnd_check_txs_locked()) Skipped 8 previous similar messages [1917710.043833] LNetError: 27861:0:(o2iblnd_cb.c:3445:kiblnd_check_conns()) Timed out RDMA with 10.0.10.235@o2ib7 (0): c: 0, oc: 2, rc: 4 [1917710.055988] LNetError: 27861:0:(o2iblnd_cb.c:3445:kiblnd_check_conns()) Skipped 8 previous similar messages [1917710.067410] LustreError: 27861:0:(events.c:476:server_bulk_callback()) event type 5, status -103, desc ffff9e33d542b000 [1917710.074731] LNetError: 27866:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) route to o2ib3 through 10.0.10.235@o2ib7 has gone from down to up [1917710.091535] LustreError: 27861:0:(events.c:476:server_bulk_callback()) Skipped 62 previous similar messages [1917851.166743] Lustre: fir-OST009f: Bulk IO read error with 8b207e2e-939f-4428-8604-69197db49c07 (at 10.51.10.2@o2ib3), client will retry: rc -110 [1917851.180164] Lustre: Skipped 53 previous similar messages [1917864.052963] LustreError: 44052:0:(ldlm_lockd.c:261:expired_lock_main()) ### lock callback timer expired after 100s: evicting client at 10.51.0.64@o2ib3 ns: filter-fir-OST009d_UUID lock: ffff9e2178941680/0xa96a836f63e455d0 lrc: 3/0,0 mode: PR/PR res: [0x2a40000401:0x160382:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x60000400010020 nid: 10.51.0.64@o2ib3 remote: 0x5dfa3ad49898c176 expref: 2776 pid: 47145 timeout: 1917965 lvb_type: 1 [1917899.166087] LustreError: 46954:0:(sec.c:2543:sptlrpc_svc_unwrap_bulk()) @@@ truncated bulk GET 11534336(12582912) req@ffff9ded2f71d100 x1791676395547712/t0(0) o4->b0fd0f61-e11a-4aa3-b6d7-bad748a0a5bc@10.51.14.13@o2ib3:316/0 lens 488/448 e 0 to 0 dl 1708726131 ref 1 fl Interpret:/0/0 rc 0/0 job:'41727918' [1917899.167308] Lustre: fir-OST0099: Bulk IO write error with f72f24cc-1d50-49d8-8414-698debd83f49 (at 10.51.10.28@o2ib3), client will retry: rc = -110 [1917899.206623] LustreError: 46954:0:(sec.c:2543:sptlrpc_svc_unwrap_bulk()) Skipped 2 previous similar messages [1917906.145534] Lustre: fir-OST009b: Client a9f90e70-2241-493b-8cc7-5218cf930bb2 (at 10.51.10.40@o2ib3) reconnecting [1917906.156060] Lustre: Skipped 56 previous similar messages [1917995.167941] LustreError: 46749:0:(ldlm_lib.c:3550:target_bulk_io()) @@@ network error on bulk READ req@ffff9dea6fa7da00 x1789469849242560/t0(0) o3->bf7a8074-3ca5-4fb9-a6e5-0158def87257@10.51.8.23@o2ib3:342/0 lens 488/440 e 0 to 0 dl 1708726157 ref 1 fl Interpret:/0/0 rc 0/0 job:'41668593' [1917995.193718] LustreError: 46749:0:(ldlm_lib.c:3550:target_bulk_io()) Skipped 55 previous similar messages [1918246.993425] LNetError: 27861:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) route to o2ib3 through 10.0.10.235@o2ib7 has gone from up to down [1918247.006291] LNetError: 27861:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) Skipped 10 previous similar messages [1918259.162717] LustreError: 47017:0:(sec.c:2543:sptlrpc_svc_unwrap_bulk()) @@@ truncated bulk GET 10416128(11464704) req@ffff9dea56818d80 x1790831406933888/t0(0) o4->bbcef8fb-a56b-4a7e-80a7-34578c604621@10.51.17.20@o2ib3:645/0 lens 504/448 e 0 to 0 dl 1708726460 ref 1 fl Interpret:/0/0 rc 0/0 job:'sh03-17n20:337031:python3' [1918259.191537] Lustre: fir-OST0099: Bulk IO write error with bbcef8fb-a56b-4a7e-80a7-34578c604621 (at 10.51.17.20@o2ib3), client will retry: rc = -110 [1918259.205168] Lustre: Skipped 2 previous similar messages [1918297.993559] LNet: 27861:0:(o2iblnd_cb.c:1520:kiblnd_reconnect_peer()) Abort reconnection of 10.0.10.235@o2ib7: accepting [1918349.986833] LNetError: 27861:0:(o2iblnd_cb.c:3375:kiblnd_check_txs_locked()) Timed out tx: tx_queue(WSQ:001), 51 seconds [1918349.997866] LNetError: 27861:0:(o2iblnd_cb.c:3375:kiblnd_check_txs_locked()) Skipped 10 previous similar messages [1918350.008295] LNetError: 27861:0:(o2iblnd_cb.c:3445:kiblnd_check_conns()) Timed out RDMA with 10.0.10.235@o2ib7 (0): c: 0, oc: 1, rc: 6 [1918350.020597] LNetError: 27861:0:(o2iblnd_cb.c:3445:kiblnd_check_conns()) Skipped 10 previous similar messages [1918350.031656] LustreError: 27861:0:(events.c:476:server_bulk_callback()) event type 5, status -103, desc ffff9e33bc6e2800 [1918350.042725] LustreError: 27861:0:(events.c:476:server_bulk_callback()) Skipped 72 previous similar messages [1918350.052717] LNetError: 27866:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) route to o2ib3 through 10.0.10.235@o2ib7 has gone from down to up [1918400.993600] LNetError: 27868:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) route to o2ib3 through 10.0.10.235@o2ib7 has gone from down to up [1918451.982341] Lustre: fir-OST0099: Bulk IO read error with da6fcb59-7743-47f6-97c0-9e4b0fbf9c90 (at 10.51.12.1@o2ib3), client will retry: rc -110 [1918451.995372] Lustre: Skipped 55 previous similar messages [1918502.986533] LNetError: 27868:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) route to o2ib3 through 10.0.10.235@o2ib7 has gone from down to up [1918523.160925] LustreError: 47092:0:(sec.c:2543:sptlrpc_svc_unwrap_bulk()) @@@ truncated bulk GET 4194304(4204049) req@ffff9ded2db9bf00 x1790834878055936/t0(0) o4->eda6850e-7e53-4dd3-9614-a2c217b19fd6@10.51.10.24@o2ib3:125/0 lens 488/448 e 1 to 0 dl 1708726695 ref 1 fl Interpret:/0/0 rc 0/0 job:'41661761' [1918523.187933] Lustre: fir-OST009d: Bulk IO write error with eda6850e-7e53-4dd3-9614-a2c217b19fd6 (at 10.51.10.24@o2ib3), client will retry: rc = -110 [1918531.553650] Lustre: fir-OST0099: Client 357d7403-7934-4613-b3e2-5b777600cb6b (at 10.51.13.7@o2ib3) reconnecting [1918531.563914] Lustre: Skipped 49 previous similar messages [1918595.159675] LustreError: 46954:0:(ldlm_lib.c:3550:target_bulk_io()) @@@ network error on bulk READ req@ffff9e20a074cc80 x1789660143193088/t0(0) o3->3e7b2386-1e44-41a6-a2be-fe9573e9646a@10.51.9.72@o2ib3:185/0 lens 488/440 e 0 to 0 dl 1708726755 ref 1 fl Interpret:/0/0 rc 0/0 job:'41738657' [1918595.185451] LustreError: 46954:0:(ldlm_lib.c:3550:target_bulk_io()) Skipped 54 previous similar messages [1918619.162051] Lustre: fir-OST0099: Bulk IO write error with dc62e762-28a3-4380-917f-7cac89d60689 (at 10.51.0.72@o2ib3), client will retry: rc = -110 [1918859.161402] LustreError: 47226:0:(sec.c:2543:sptlrpc_svc_unwrap_bulk()) @@@ truncated bulk GET 0(12288) req@ffff9e266c7d4c80 x1789871555806272/t0(0) o4->10ba03ae-a55d-46e9-adb9-5b39cf59f392@10.51.10.66@o2ib3:491/0 lens 520/456 e 0 to 0 dl 1708727061 ref 1 fl Interpret:/0/0 rc 0/0 job:'sh03-10n66:291403:python' [1918859.189083] Lustre: fir-OST0099: Bulk IO write error with 10ba03ae-a55d-46e9-adb9-5b39cf59f392 (at 10.51.10.66@o2ib3), client will retry: rc = -110 [1918899.958219] LNetError: 27861:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) route to o2ib3 through 10.0.10.235@o2ib7 has gone from up to down [1918899.971077] LNetError: 27861:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) Skipped 14 previous similar messages [1918963.953824] LNetError: 27861:0:(o2iblnd_cb.c:3375:kiblnd_check_txs_locked()) Timed out tx: active_txs(WSQ:100), 52 seconds [1918963.965032] LNetError: 27861:0:(o2iblnd_cb.c:3375:kiblnd_check_txs_locked()) Skipped 10 previous similar messages [1918963.975460] LNetError: 27861:0:(o2iblnd_cb.c:3445:kiblnd_check_conns()) Timed out RDMA with 10.0.10.235@o2ib7 (0): c: 0, oc: 3, rc: 0 [1918963.987616] LNetError: 27861:0:(o2iblnd_cb.c:3445:kiblnd_check_conns()) Skipped 10 previous similar messages [1918963.998725] LustreError: 27861:0:(events.c:476:server_bulk_callback()) event type 5, status -103, desc ffff9df9895e8c00 [1918964.009894] LustreError: 27861:0:(events.c:476:server_bulk_callback()) Skipped 60 previous similar messages [1919078.952269] LNet: 27861:0:(o2iblnd_cb.c:1520:kiblnd_reconnect_peer()) Abort reconnection of 10.0.10.235@o2ib7: accepting [1919099.155590] Lustre: fir-OST009f: Bulk IO read error with 7b620035-a852-4d83-9d2b-e8f7eadd5c22 (at 10.51.11.12@o2ib3), client will retry: rc -110 [1919099.156838] LustreError: 47234:0:(sec.c:2543:sptlrpc_svc_unwrap_bulk()) @@@ truncated bulk GET 14680064(16777216) req@ffff9e2090bc4c80 x1789000571042368/t0(0) o4->dc62e762-28a3-4380-917f-7cac89d60689@10.51.0.72@o2ib3:731/0 lens 488/448 e 0 to 0 dl 1708727301 ref 1 fl Interpret:/0/0 rc 0/0 job:'sh03-dn02:338930:sftp-server' [1919099.156878] Lustre: fir-OST009b: Bulk IO write error with dc62e762-28a3-4380-917f-7cac89d60689 (at 10.51.0.72@o2ib3), client will retry: rc = -110 [1919099.211092] Lustre: Skipped 55 previous similar messages [1919132.869354] Lustre: fir-OST009d: Client 5f4f196f-951c-4adb-a689-4c15dbc03750 (at 10.51.6.50@o2ib3) reconnecting [1919132.879619] Lustre: Skipped 69 previous similar messages [1919181.945999] LNet: 27861:0:(o2iblnd_cb.c:1520:kiblnd_reconnect_peer()) Abort reconnection of 10.0.10.235@o2ib7: accepting [1919195.158689] LustreError: 47208:0:(ldlm_lib.c:3550:target_bulk_io()) @@@ network error on bulk READ req@ffff9e2c90b28d80 x1791494030523840/t0(0) o3->5f4f196f-951c-4adb-a689-4c15dbc03750@10.51.6.50@o2ib3:80/0 lens 488/440 e 0 to 0 dl 1708727405 ref 1 fl Interpret:/2/0 rc 0/0 job:'41734297' [1919195.184377] LustreError: 47208:0:(ldlm_lib.c:3550:target_bulk_io()) Skipped 53 previous similar messages [1919545.233527] LustreError: 46846:0:(ldlm_lib.c:3544:target_bulk_io()) @@@ Reconnect on bulk READ req@ffff9ded3f02f080 x1791494033034944/t0(0) o3->5f4f196f-951c-4adb-a689-4c15dbc03750@10.51.6.50@o2ib3:522/0 lens 488/440 e 0 to 0 dl 1708727847 ref 1 fl Interpret:/0/0 rc 0/0 job:'41734306' [1919552.923206] LNetError: 27861:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) route to o2ib3 through 10.0.10.235@o2ib7 has gone from up to down [1919552.936068] LNetError: 27861:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) Skipped 13 previous similar messages [1919602.885439] LustreError: 46773:0:(ldlm_lib.c:3544:target_bulk_io()) @@@ Reconnect on bulk READ req@ffff9e217818cc80 x1791092489874432/t0(0) o3->13b41e84-d040-4a81-8804-171135a5ca68@10.51.14.12@o2ib3:579/0 lens 488/440 e 0 to 0 dl 1708727904 ref 1 fl Interpret:/0/0 rc 0/0 job:'41486988' [1919602.910951] LustreError: 46773:0:(ldlm_lib.c:3544:target_bulk_io()) Skipped 1 previous similar message [1919603.919378] LNetError: 27861:0:(o2iblnd_cb.c:3375:kiblnd_check_txs_locked()) Timed out tx: active_txs(WSQ:100), 50 seconds [1919603.930588] LNetError: 27861:0:(o2iblnd_cb.c:3375:kiblnd_check_txs_locked()) Skipped 10 previous similar messages [1919603.941015] LNetError: 27861:0:(o2iblnd_cb.c:3445:kiblnd_check_conns()) Timed out RDMA with 10.0.10.235@o2ib7 (0): c: 4, oc: 3, rc: 4 [1919603.953170] LNetError: 27861:0:(o2iblnd_cb.c:3445:kiblnd_check_conns()) Skipped 10 previous similar messages [1919603.964900] LustreError: 27861:0:(events.c:476:server_bulk_callback()) event type 5, status -103, desc ffff9e2f60ce7000 [1919603.975851] LustreError: 27861:0:(events.c:476:server_bulk_callback()) Skipped 61 previous similar messages [1919610.202478] Lustre: fir-OST009f: haven't heard from client b1d6df14-40f1-4253-a1c8-15fb7dc33ba0 (at 10.51.5.43@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33b0cad000, cur 1708727755 expire 1708727605 last 1708727528 [1919624.199362] Lustre: fir-OST009d: haven't heard from client b1d6df14-40f1-4253-a1c8-15fb7dc33ba0 (at 10.51.5.43@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e290beedc00, cur 1708727769 expire 1708727619 last 1708727542 [1919624.221238] Lustre: Skipped 1 previous similar message [1919629.201825] Lustre: fir-OST0099: haven't heard from client b1d6df14-40f1-4253-a1c8-15fb7dc33ba0 (at 10.51.5.43@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e290ac8b800, cur 1708727774 expire 1708727624 last 1708727547 [1919629.935987] Lustre: 46938:0:(client.c:2295:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1708727646/real 1708727646] req@ffff9e2059d74c80 x1789761259621056/t0(0) o106->fir-OST009b@10.51.4.26@o2ib3:15/16 lens 328/280 e 0 to 1 dl 1708727774 ref 1 fl Rpc:XQr/0/ffffffff rc 0/-1 job:'' [1919699.163859] Lustre: fir-OST009b: Bulk IO read error with f36936eb-36c4-40df-8ac5-6aca84711a04 (at 10.51.7.19@o2ib3), client will retry: rc -110 [1919699.176892] Lustre: Skipped 45 previous similar messages [1919715.249371] LustreError: 47226:0:(ldlm_lib.c:3544:target_bulk_io()) @@@ Reconnect on bulk READ req@ffff9e209130ba80 x1790839683033728/t0(0) o3->39600f98-fe5b-4e22-87d0-7b729c71c176@10.51.6.38@o2ib3:692/0 lens 488/440 e 0 to 0 dl 1708728017 ref 1 fl Interpret:/0/0 rc 0/0 job:'sh03-06n38:356699:samtools' [1919735.633388] Lustre: fir-OST009d: Client 4ab90e2b-981e-4a28-aea4-1ae96b48a9d2 (at 10.51.12.24@o2ib3) reconnecting [1919735.643748] Lustre: Skipped 50 previous similar messages [1919747.161690] LustreError: 46899:0:(sec.c:2543:sptlrpc_svc_unwrap_bulk()) @@@ truncated bulk GET 14680064(16777216) req@ffff9e205850e300 x1790220961190912/t0(0) o4->a6954b6b-adc3-4047-8ae9-17e4aacadd03@10.51.18.21@o2ib3:636/0 lens 488/448 e 0 to 0 dl 1708727961 ref 1 fl Interpret:/0/0 rc 0/0 job:'41729537' [1919747.162466] Lustre: fir-OST009f: Bulk IO write error with a6954b6b-adc3-4047-8ae9-17e4aacadd03 (at 10.51.18.21@o2ib3), client will retry: rc = -110 [1919747.202653] LustreError: 46899:0:(sec.c:2543:sptlrpc_svc_unwrap_bulk()) Skipped 2 previous similar messages [1919789.581366] LustreError: 44052:0:(ldlm_lockd.c:261:expired_lock_main()) ### lock callback timer expired after 100s: evicting client at 10.51.10.40@o2ib3 ns: filter-fir-OST009b_UUID lock: ffff9e20587433c0/0xa96a836f646b90b9 lrc: 4/0,0 mode: PR/PR res: [0x29c0000402:0x1da009b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x60000400010020 nid: 10.51.10.40@o2ib3 remote: 0x65203bb8c06ae5e9 expref: 15 pid: 47123 timeout: 1919891 lvb_type: 1 [1919789.623534] LustreError: 47123:0:(ldlm_lockd.c:1427:ldlm_handle_enqueue0()) ### lock on destroyed export ffff9e41d663a800 ns: filter-fir-OST009b_UUID lock: ffff9e2058745a00/0xa96a836f646b90f1 lrc: 3/0,0 mode: --/PW res: [0x29c0000402:0x1da009b:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50000080020000 nid: 10.51.10.40@o2ib3 remote: 0x65203bb8c06ae5fe expref: 15 pid: 47123 timeout: 0 lvb_type: 0 [1919795.165517] LustreError: 47207:0:(ldlm_lib.c:3550:target_bulk_io()) @@@ network error on bulk READ req@ffff9df8a9a95e80 x1789429744480256/t0(0) o3->4ab90e2b-981e-4a28-aea4-1ae96b48a9d2@10.51.12.24@o2ib3:629/0 lens 488/440 e 0 to 0 dl 1708727954 ref 1 fl Interpret:/0/0 rc 0/0 job:'41693245' [1919795.191538] LustreError: 47207:0:(ldlm_lib.c:3550:target_bulk_io()) Skipped 35 previous similar messages [1919975.230323] LustreError: 47230:0:(ldlm_lib.c:3544:target_bulk_io()) @@@ Reconnect on bulk READ req@ffff9e2de3db0480 x1791494034233984/t0(0) o3->5f4f196f-951c-4adb-a689-4c15dbc03750@10.51.6.50@o2ib3:112/0 lens 488/440 e 0 to 0 dl 1708728192 ref 1 fl Interpret:/0/0 rc 0/0 job:'41734305' [1919992.822378] LustreError: 46846:0:(ldlm_lib.c:3544:target_bulk_io()) @@@ Reconnect on bulk READ req@ffff9e0181995a00 x1791494034428480/t0(0) o3->5f4f196f-951c-4adb-a689-4c15dbc03750@10.51.6.50@o2ib3:184/0 lens 488/440 e 0 to 0 dl 1708728264 ref 1 fl Interpret:/0/0 rc 0/0 job:'41734307' [1920038.903805] LNet: 27861:0:(o2iblnd_cb.c:1520:kiblnd_reconnect_peer()) Abort reconnection of 10.0.10.235@o2ib7: accepting [1920059.162845] Lustre: fir-OST009f: Bulk IO write error with a6954b6b-adc3-4047-8ae9-17e4aacadd03 (at 10.51.18.21@o2ib3), client will retry: rc = -110 [1920059.176222] Lustre: Skipped 4 previous similar messages [1920169.165959] LNetError: 27868:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) route to o2ib3 through 10.0.10.235@o2ib7 has gone from down to up [1920169.178822] LNetError: 27868:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) Skipped 10 previous similar messages [1920175.568506] LustreError: 46864:0:(ldlm_lib.c:3544:target_bulk_io()) @@@ Reconnect on bulk READ req@ffff9e213d93f500 x1791494035009024/t0(0) o3->5f4f196f-951c-4adb-a689-4c15dbc03750@10.51.6.50@o2ib3:366/0 lens 488/440 e 0 to 0 dl 1708728446 ref 1 fl Interpret:/0/0 rc 0/0 job:'41734297' [1920217.886222] LNetError: 27861:0:(o2iblnd_cb.c:3375:kiblnd_check_txs_locked()) Timed out tx: active_txs(WSQ:100), 48 seconds [1920217.897428] LNetError: 27861:0:(o2iblnd_cb.c:3375:kiblnd_check_txs_locked()) Skipped 9 previous similar messages [1920217.907770] LNetError: 27861:0:(o2iblnd_cb.c:3445:kiblnd_check_conns()) Timed out RDMA with 10.0.10.235@o2ib7 (0): c: 0, oc: 0, rc: 0 [1920217.919926] LNetError: 27861:0:(o2iblnd_cb.c:3445:kiblnd_check_conns()) Skipped 9 previous similar messages [1920217.930777] LustreError: 27861:0:(events.c:476:server_bulk_callback()) event type 5, status -103, desc ffff9e013a561800 [1920217.941728] LustreError: 27861:0:(events.c:476:server_bulk_callback()) Skipped 56 previous similar messages [1920346.071161] Lustre: fir-OST009d: Client 9613cbc0-6e26-4556-b836-5be644c3b381 (at 10.51.1.36@o2ib3) reconnecting [1920346.081414] Lustre: Skipped 58 previous similar messages [1920346.165350] Lustre: fir-OST009f: Bulk IO read error with 4eeca784-fc05-4603-96af-6e0e6faaba83 (at 10.51.6.41@o2ib3), client will retry: rc -110 [1920346.178387] Lustre: Skipped 47 previous similar messages [1920418.166448] LustreError: 47230:0:(ldlm_lib.c:3550:target_bulk_io()) @@@ network error on bulk READ req@ffff9e23a9905100 x1791494035619392/t0(0) o3->5f4f196f-951c-4adb-a689-4c15dbc03750@10.51.6.50@o2ib3:538/0 lens 488/440 e 0 to 0 dl 1708728618 ref 1 fl Interpret:/0/0 rc 0/0 job:'41734304' [1920418.192221] LustreError: 47230:0:(ldlm_lib.c:3550:target_bulk_io()) Skipped 47 previous similar messages [1920529.238456] LustreError: 46775:0:(ldlm_lib.c:3544:target_bulk_io()) @@@ Reconnect on bulk READ req@ffff9dee7a885580 x1791494036041984/t0(0) o3->5f4f196f-951c-4adb-a689-4c15dbc03750@10.51.6.50@o2ib3:666/0 lens 488/440 e 0 to 0 dl 1708728746 ref 1 fl Interpret:/0/0 rc 0/0 job:'41734305' [1920659.048460] LustreError: 47207:0:(ldlm_lib.c:3544:target_bulk_io()) @@@ Reconnect on bulk READ req@ffff9e214c7cc380 x1791494036551680/t0(0) o3->5f4f196f-951c-4adb-a689-4c15dbc03750@10.51.6.50@o2ib3:95/0 lens 488/440 e 0 to 0 dl 1708728930 ref 1 fl Interpret:/0/0 rc 0/0 job:'41734297' [1920819.853823] LNetError: 27861:0:(o2iblnd_cb.c:3375:kiblnd_check_txs_locked()) Timed out tx: active_txs(WSQ:100), 50 seconds [1920819.865337] LNetError: 27861:0:(o2iblnd_cb.c:3375:kiblnd_check_txs_locked()) Skipped 9 previous similar messages [1920819.875678] LNetError: 27861:0:(o2iblnd_cb.c:3445:kiblnd_check_conns()) Timed out RDMA with 10.0.10.235@o2ib7 (0): c: 0, oc: 3, rc: 0 [1920819.887832] LNetError: 27861:0:(o2iblnd_cb.c:3445:kiblnd_check_conns()) Skipped 9 previous similar messages [1920819.898608] LustreError: 27861:0:(events.c:476:server_bulk_callback()) event type 5, status -103, desc ffff9e3fcc3c3800 [1920819.909562] LustreError: 27861:0:(events.c:476:server_bulk_callback()) Skipped 52 previous similar messages [1920819.919522] LNetError: 27861:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) route to o2ib3 through 10.0.10.235@o2ib7 has gone from up to down [1920819.932388] LNetError: 27861:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) Skipped 14 previous similar messages [1920929.128982] Lustre: fir-OST009b: haven't heard from client 271428eb-9657-442c-85b4-5fa160c78416 (at 10.51.15.15@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3254da2c00, cur 1708729074 expire 1708728924 last 1708728847 [1920947.847893] Lustre: fir-OST009f: Bulk IO read error with 13b41e84-d040-4a81-8804-171135a5ca68 (at 10.51.14.12@o2ib3), client will retry: rc -110 [1920947.861006] Lustre: Skipped 50 previous similar messages [1920951.313374] Lustre: fir-OST009f: Client 357d7403-7934-4613-b3e2-5b777600cb6b (at 10.51.13.7@o2ib3) reconnecting [1920951.323626] Lustre: Skipped 54 previous similar messages [1920956.226710] LustreError: 137-5: fir-OST0098_UUID: not available for connect from 10.51.15.15@o2ib3 (no target). If you are running an HA pair check that the target is mounted on the other server. [1920956.244252] LustreError: Skipped 3 previous similar messages [1921018.161430] LustreError: 46864:0:(ldlm_lib.c:3550:target_bulk_io()) @@@ network error on bulk READ req@ffff9e2168093180 x1791494037688256/t0(0) o3->5f4f196f-951c-4adb-a689-4c15dbc03750@10.51.6.50@o2ib3:384/0 lens 488/440 e 0 to 0 dl 1708729219 ref 1 fl Interpret:/0/0 rc 0/0 job:'41734305' [1921018.187351] LustreError: 46864:0:(ldlm_lib.c:3550:target_bulk_io()) Skipped 47 previous similar messages [1921130.134060] LustreError: 47222:0:(ldlm_lib.c:3544:target_bulk_io()) @@@ Reconnect on bulk READ req@ffff9dedf5759680 x1791494038185408/t0(0) o3->5f4f196f-951c-4adb-a689-4c15dbc03750@10.51.6.50@o2ib3:512/0 lens 488/440 e 0 to 0 dl 1708729347 ref 1 fl Interpret:/0/0 rc 0/0 job:'41734297' [1921130.159621] LustreError: 47222:0:(ldlm_lib.c:3544:target_bulk_io()) Skipped 1 previous similar message [1921136.153745] Lustre: 47002:0:(client.c:2295:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1708729153/real 1708729153] req@ffff9e2058a44c80 x1789761288625024/t0(0) o106->fir-OST0099@10.51.2.19@o2ib3:15/16 lens 328/280 e 0 to 1 dl 1708729281 ref 1 fl Rpc:XQr/0/ffffffff rc 0/-1 job:'' [1921177.842048] LNetError: 27866:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) route to o2ib3 through 10.0.10.235@o2ib7 has gone from down to up [1921229.838019] LNetError: 27866:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) route to o2ib3 through 10.0.10.235@o2ib7 has gone from down to up [1921234.157493] LustreError: 47086:0:(sec.c:2543:sptlrpc_svc_unwrap_bulk()) @@@ truncated bulk GET 14680064(16777216) req@ffff9ded3c9ade80 x1790220972583680/t0(0) o4->a6954b6b-adc3-4047-8ae9-17e4aacadd03@10.51.18.21@o2ib3:614/0 lens 488/448 e 0 to 0 dl 1708729449 ref 1 fl Interpret:/0/0 rc 0/0 job:'41729521' [1921234.157568] Lustre: fir-OST009f: Bulk IO write error with e4173a19-6364-4ed8-9ad0-6f93a55bf401 (at 10.51.6.67@o2ib3), client will retry: rc = -110 [1921234.198261] LustreError: 47086:0:(sec.c:2543:sptlrpc_svc_unwrap_bulk()) Skipped 1 previous similar message [1921258.170158] LustreError: 46832:0:(ldlm_lib.c:3544:target_bulk_io()) @@@ Reconnect on bulk READ req@ffff9e2c90b29b00 x1791494038429184/t0(0) o3->5f4f196f-951c-4adb-a689-4c15dbc03750@10.51.6.50@o2ib3:694/0 lens 488/440 e 0 to 0 dl 1708729529 ref 1 fl Interpret:/0/0 rc 0/0 job:'41734305' [1921258.195585] LustreError: 46832:0:(ldlm_lib.c:3544:target_bulk_io()) Skipped 1 previous similar message [1921359.802722] Lustre: fir-OST009f: Bulk IO write error with a6954b6b-adc3-4047-8ae9-17e4aacadd03 (at 10.51.18.21@o2ib3), client will retry: rc = -110 [1921359.816245] Lustre: Skipped 2 previous similar messages [1921378.154703] LustreError: 47062:0:(sec.c:2543:sptlrpc_svc_unwrap_bulk()) @@@ truncated bulk GET 14680064(16777216) req@ffff9e2090f2ec00 x1790220973452288/t0(0) o4->a6954b6b-adc3-4047-8ae9-17e4aacadd03@10.51.18.21@o2ib3:745/0 lens 488/448 e 0 to 0 dl 1708729580 ref 1 fl Interpret:/0/0 rc 0/0 job:'41729522' [1921383.104180] Lustre: fir-OST0099: haven't heard from client 5028c8a3-e9e6-4b93-a368-5f9514227ae3 (at 10.51.15.15@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e40b4b27c00, cur 1708729528 expire 1708729378 last 1708729301 [1921383.126144] Lustre: Skipped 3 previous similar messages [1921428.157059] LNetError: 27866:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) route to o2ib3 through 10.0.10.235@o2ib7 has gone from down to up [1921428.169923] LNetError: 27866:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) Skipped 12 previous similar messages [1921436.169553] Lustre: 46786:0:(client.c:2295:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1708729453/real 1708729453] req@ffff9e214c7cd100 x1789761294007296/t0(0) o106->fir-OST009b@10.51.5.44@o2ib3:15/16 lens 328/280 e 0 to 1 dl 1708729581 ref 1 fl Rpc:XQr/0/ffffffff rc 0/-1 job:'' [1921485.817881] LNetError: 27861:0:(o2iblnd_cb.c:3375:kiblnd_check_txs_locked()) Timed out tx: active_txs(WSQ:100), 52 seconds [1921485.829088] LNetError: 27861:0:(o2iblnd_cb.c:3375:kiblnd_check_txs_locked()) Skipped 10 previous similar messages [1921485.839514] LNetError: 27861:0:(o2iblnd_cb.c:3445:kiblnd_check_conns()) Timed out RDMA with 10.0.10.235@o2ib7 (0): c: 1, oc: 0, rc: 2 [1921485.851672] LNetError: 27861:0:(o2iblnd_cb.c:3445:kiblnd_check_conns()) Skipped 10 previous similar messages [1921485.862595] LustreError: 27861:0:(events.c:476:server_bulk_callback()) event type 5, status -103, desc ffff9e2f253e6c00 [1921485.873547] LustreError: 27861:0:(events.c:476:server_bulk_callback()) Skipped 65 previous similar messages [1921556.624667] Lustre: fir-OST0099: Client 0f777384-4371-4e75-91a8-acc288be2fbe (at 10.51.4.47@o2ib3) reconnecting [1921556.634940] Lustre: Skipped 64 previous similar messages [1921594.157075] Lustre: fir-OST0099: Bulk IO read error with 71e6e20b-ea06-46cd-9b26-e9de2b2ddc67 (at 10.51.17.18@o2ib3), client will retry: rc -110 [1921594.170199] Lustre: Skipped 49 previous similar messages [1921642.157480] LustreError: 46771:0:(ldlm_lib.c:3550:target_bulk_io()) @@@ network error on bulk READ req@ffff9deb3f102d00 x1789429745275200/t0(0) o3->4ab90e2b-981e-4a28-aea4-1ae96b48a9d2@10.51.12.24@o2ib3:255/0 lens 520/440 e 0 to 0 dl 1708729845 ref 1 fl Interpret:/0/0 rc 0/0 job:'41693245' [1921642.183340] LustreError: 46771:0:(ldlm_lib.c:3550:target_bulk_io()) Skipped 44 previous similar messages [1921651.604939] LustreError: 47233:0:(ldlm_lib.c:3544:target_bulk_io()) @@@ Reconnect on bulk READ req@ffff9dea59423180 x1790834883670976/t0(0) o3->eda6850e-7e53-4dd3-9614-a2c217b19fd6@10.51.10.24@o2ib3:332/0 lens 488/440 e 0 to 0 dl 1708729922 ref 1 fl Interpret:/0/0 rc 0/0 job:'41661761' [1921651.630455] LustreError: 47233:0:(ldlm_lib.c:3544:target_bulk_io()) Skipped 2 previous similar messages [1921728.885467] LNetError: 27867:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) route to o2ib3 through 10.0.10.235@o2ib7 has gone from down to up [1922057.071959] Lustre: fir-OST0099: haven't heard from client c62a34d5-968c-4af2-bcb1-4811f31d96fe (at 10.51.15.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9df2ff4e9800, cur 1708730202 expire 1708730052 last 1708729975 [1922057.093958] Lustre: Skipped 3 previous similar messages [1922061.787749] LNetError: 27861:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) route to o2ib3 through 10.0.10.235@o2ib7 has gone from up to down [1922061.800606] LNetError: 27861:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) Skipped 13 previous similar messages [1922137.782669] LNetError: 27861:0:(o2iblnd_cb.c:3375:kiblnd_check_txs_locked()) Timed out tx: tx_queue(WSQ:001), 49 seconds [1922137.793698] LNetError: 27861:0:(o2iblnd_cb.c:3375:kiblnd_check_txs_locked()) Skipped 10 previous similar messages [1922137.804126] LNetError: 27861:0:(o2iblnd_cb.c:3445:kiblnd_check_conns()) Timed out RDMA with 10.0.10.235@o2ib7 (0): c: 0, oc: 2, rc: 4 [1922137.816421] LNetError: 27861:0:(o2iblnd_cb.c:3445:kiblnd_check_conns()) Skipped 10 previous similar messages [1922137.827699] LustreError: 27861:0:(events.c:476:server_bulk_callback()) event type 5, status -103, desc ffff9e33d5edc400 [1922137.839145] LustreError: 27861:0:(events.c:476:server_bulk_callback()) Skipped 62 previous similar messages [1922146.156217] LustreError: 46927:0:(sec.c:2543:sptlrpc_svc_unwrap_bulk()) @@@ truncated bulk GET 7340032(8388608) req@ffff9e205997c800 x1789743978049216/t0(0) o4->e8bcad55-7eea-4b68-abdc-50bcc2c8d123@10.51.13.22@o2ib3:15/0 lens 488/448 e 0 to 0 dl 1708730360 ref 1 fl Interpret:/0/0 rc 0/0 job:'41723481' [1922146.156218] LustreError: 47052:0:(sec.c:2543:sptlrpc_svc_unwrap_bulk()) @@@ truncated bulk GET 3145728(4194304) req@ffff9e202ccc9f80 x1789743978049280/t0(0) o4->e8bcad55-7eea-4b68-abdc-50bcc2c8d123@10.51.13.22@o2ib3:15/0 lens 488/448 e 0 to 0 dl 1708730360 ref 1 fl Interpret:/0/0 rc 0/0 job:'41723481' [1922146.156238] Lustre: fir-OST009b: Bulk IO write error with e8bcad55-7eea-4b68-abdc-50bcc2c8d123 (at 10.51.13.22@o2ib3), client will retry: rc = -110 [1922146.156239] Lustre: Skipped 2 previous similar messages [1922146.229401] LustreError: 46927:0:(sec.c:2543:sptlrpc_svc_unwrap_bulk()) Skipped 2 previous similar messages [1922189.797507] LNetError: 27867:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) route to o2ib3 through 10.0.10.235@o2ib7 has gone from down to up [1922191.636459] Lustre: fir-OST009f: Client 07cb0254-9a3a-4c7e-9186-ea7d93c93a14 (at 10.51.0.68@o2ib3) reconnecting [1922191.646718] Lustre: Skipped 59 previous similar messages [1922194.155649] Lustre: fir-OST009d: Bulk IO read error with e8bcad55-7eea-4b68-abdc-50bcc2c8d123 (at 10.51.13.22@o2ib3), client will retry: rc -110 [1922194.168772] Lustre: Skipped 44 previous similar messages [1922240.884760] LNetError: 48640:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) route to o2ib3 through 10.0.10.235@o2ib7 has gone from down to up [1922242.155026] LustreError: 46964:0:(ldlm_lib.c:3550:target_bulk_io()) @@@ network error on bulk READ req@ffff9e2059c1cc80 x1789864646751744/t0(0) o3->d976cb88-0fe0-41bc-a499-b05a1f7fb8b9@10.51.10.17@o2ib3:116/0 lens 488/440 e 0 to 0 dl 1708730461 ref 1 fl Interpret:/0/0 rc 0/0 job:'41738831' [1922242.155033] LustreError: 47029:0:(sec.c:2543:sptlrpc_svc_unwrap_bulk()) @@@ truncated bulk GET 15728640(16777216) req@ffff9dea635b9680 x1790220980027008/t0(0) o4->a6954b6b-adc3-4047-8ae9-17e4aacadd03@10.51.18.21@o2ib3:116/0 lens 488/448 e 0 to 0 dl 1708730461 ref 1 fl Interpret:/0/0 rc 0/0 job:'41729534' [1922242.155075] Lustre: fir-OST0099: Bulk IO write error with a6954b6b-adc3-4047-8ae9-17e4aacadd03 (at 10.51.18.21@o2ib3), client will retry: rc = -110 [1922242.155076] Lustre: Skipped 4 previous similar messages [1922242.226801] LustreError: 46964:0:(ldlm_lib.c:3550:target_bulk_io()) Skipped 43 previous similar messages [1922290.155413] LustreError: 47076:0:(sec.c:2543:sptlrpc_svc_unwrap_bulk()) @@@ truncated bulk GET 15168(1063744) req@ffff9dea24025a00 x1790293272102272/t0(0) o4->0568d57f-c83a-44a4-a54f-e2cb9d8186c8@10.51.10.51@o2ib3:167/0 lens 488/448 e 0 to 0 dl 1708730512 ref 1 fl Interpret:/0/0 rc 0/0 job:'41742059' [1922290.155458] Lustre: fir-OST0099: Bulk IO write error with 0568d57f-c83a-44a4-a54f-e2cb9d8186c8 (at 10.51.10.51@o2ib3), client will retry: rc = -110 [1922290.155460] Lustre: Skipped 2 previous similar messages [1922290.200993] LustreError: 47076:0:(sec.c:2543:sptlrpc_svc_unwrap_bulk()) Skipped 3 previous similar messages [1922291.873044] LNetError: 27869:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) route to o2ib3 through 10.0.10.235@o2ib7 has gone from down to up [1922342.775615] LNet: 27861:0:(o2iblnd_cb.c:1520:kiblnd_reconnect_peer()) Abort reconnection of 10.0.10.235@o2ib7: accepting [1922362.155502] LustreError: 46965:0:(sec.c:2543:sptlrpc_svc_unwrap_bulk()) @@@ truncated bulk GET 14680064(16777216) req@ffff9e2059c18900 x1790220980745728/t0(0) o4->a6954b6b-adc3-4047-8ae9-17e4aacadd03@10.51.18.21@o2ib3:189/0 lens 488/448 e 1 to 0 dl 1708730534 ref 1 fl Interpret:/0/0 rc 0/0 job:'41729528' [1922362.182688] Lustre: fir-OST009f: Bulk IO write error with a6954b6b-adc3-4047-8ae9-17e4aacadd03 (at 10.51.18.21@o2ib3), client will retry: rc = -110 [1922362.196063] Lustre: Skipped 1 previous similar message [1922624.760470] LNet: 27861:0:(o2iblnd_cb.c:1520:kiblnd_reconnect_peer()) Abort reconnection of 10.0.10.235@o2ib7: accepting [1922626.155927] LustreError: 47208:0:(sec.c:2543:sptlrpc_svc_unwrap_bulk()) @@@ truncated bulk GET 4694731(5743307) req@ffff9e202ccb0900 x1791042963778304/t0(0) o4->65f725d0-37c9-4c99-95bf-4329262440a0@10.51.2.10@o2ib3:495/0 lens 488/448 e 0 to 0 dl 1708730840 ref 1 fl Interpret:/0/0 rc 0/0 job:'41527621' [1922626.182853] Lustre: fir-OST0099: Bulk IO write error with 65f725d0-37c9-4c99-95bf-4329262440a0 (at 10.51.2.10@o2ib3), client will retry: rc = -110 [1922675.754477] LNetError: 27861:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) route to o2ib3 through 10.0.10.235@o2ib7 has gone from up to down [1922675.767331] LNetError: 27861:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) Skipped 10 previous similar messages [1922803.746596] LNetError: 27861:0:(o2iblnd_cb.c:3375:kiblnd_check_txs_locked()) Timed out tx: tx_queue(WSQ:101), 49 seconds [1922803.757631] LNetError: 27861:0:(o2iblnd_cb.c:3375:kiblnd_check_txs_locked()) Skipped 10 previous similar messages [1922803.768058] LNetError: 27861:0:(o2iblnd_cb.c:3445:kiblnd_check_conns()) Timed out RDMA with 10.0.10.235@o2ib7 (0): c: 0, oc: 1, rc: 3 [1922803.780492] LNetError: 27861:0:(o2iblnd_cb.c:3445:kiblnd_check_conns()) Skipped 10 previous similar messages [1922803.791446] LustreError: 27861:0:(events.c:476:server_bulk_callback()) event type 5, status -103, desc ffff9e2909cb8800 [1922803.802740] LustreError: 27861:0:(events.c:476:server_bulk_callback()) Skipped 61 previous similar messages [1922806.529156] Lustre: fir-OST009f: Client d976cb88-0fe0-41bc-a499-b05a1f7fb8b9 (at 10.51.10.17@o2ib3) reconnecting [1922806.539517] Lustre: Skipped 74 previous similar messages [1922818.148846] LustreError: 46920:0:(sec.c:2543:sptlrpc_svc_unwrap_bulk()) @@@ truncated bulk GET 14680064(16777216) req@ffff9dea4be22d00 x1790802119910720/t0(0) o4->e4173a19-6364-4ed8-9ad0-6f93a55bf401@10.51.6.67@o2ib3:675/0 lens 488/448 e 0 to 0 dl 1708731020 ref 1 fl Interpret:/0/0 rc 0/0 job:'41729561' [1922818.148870] Lustre: fir-OST009b: Bulk IO read error with a6954b6b-adc3-4047-8ae9-17e4aacadd03 (at 10.51.18.21@o2ib3), client will retry: rc -110 [1922818.148871] Lustre: Skipped 41 previous similar messages [1922818.194545] Lustre: fir-OST0099: Bulk IO write error with e4173a19-6364-4ed8-9ad0-6f93a55bf401 (at 10.51.6.67@o2ib3), client will retry: rc = -110 [1922836.788805] Lustre: 47188:0:(client.c:2295:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1708730853/real 1708730853] req@ffff9e2365f88900 x1789761322337728/t0(0) o106->fir-OST0099@10.51.6.32@o2ib3:15/16 lens 328/280 e 0 to 1 dl 1708730981 ref 1 fl Rpc:XQr/0/ffffffff rc 0/-1 job:'' [1922866.150261] LustreError: 47029:0:(sec.c:2543:sptlrpc_svc_unwrap_bulk()) @@@ truncated bulk GET 3063808(4112384) req@ffff9ded2f365580 x1791627822143936/t0(0) o4->4aa74ffc-c0c2-48be-b211-c402b2fb97cd@10.51.7.62@o2ib3:730/0 lens 488/448 e 0 to 0 dl 1708731075 ref 1 fl Interpret:/0/0 rc 0/0 job:'sh03-07n62:356699:samtools' [1922866.150263] LustreError: 47070:0:(ldlm_lib.c:3550:target_bulk_io()) @@@ network error on bulk READ req@ffff9e202cfa8900 x1789743982436288/t0(0) o3->e8bcad55-7eea-4b68-abdc-50bcc2c8d123@10.51.13.22@o2ib3:730/0 lens 488/440 e 0 to 0 dl 1708731075 ref 1 fl Interpret:/0/0 rc 0/0 job:'41723475' [1922866.150268] LustreError: 47070:0:(ldlm_lib.c:3550:target_bulk_io()) Skipped 43 previous similar messages [1922905.744971] LNet: 27861:0:(o2iblnd_cb.c:1520:kiblnd_reconnect_peer()) Abort reconnection of 10.0.10.235@o2ib7: accepting [1923277.722129] LNetError: 27826:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) route to o2ib3 through 10.0.10.235@o2ib7 has gone from up to down [1923277.734989] LNetError: 27826:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) Skipped 13 previous similar messages [1923277.765880] LNetError: 48640:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) route to o2ib3 through 10.0.10.235@o2ib7 has gone from down to up [1923298.147046] LustreError: 47086:0:(sec.c:2543:sptlrpc_svc_unwrap_bulk()) @@@ truncated bulk GET 14680064(16777216) req@ffff9dea2cb0a400 x1790220987780928/t0(0) o4->a6954b6b-adc3-4047-8ae9-17e4aacadd03@10.51.18.21@o2ib3:397/0 lens 488/448 e 0 to 0 dl 1708731497 ref 1 fl Interpret:/0/0 rc 0/0 job:'41729528' [1923298.174257] Lustre: fir-OST0099: Bulk IO write error with a6954b6b-adc3-4047-8ae9-17e4aacadd03 (at 10.51.18.21@o2ib3), client will retry: rc = -110 [1923298.187633] Lustre: Skipped 1 previous similar message [1923328.722168] LNet: 27861:0:(o2iblnd_cb.c:1520:kiblnd_reconnect_peer()) Abort reconnection of 10.0.10.235@o2ib7: accepting [1923353.758052] Lustre: 47188:0:(client.c:2295:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1708731370/real 1708731370] req@ffff9e2095f28480 x1789761333183552/t0(0) o106->fir-OST0099@10.51.6.30@o2ib3:15/16 lens 328/280 e 0 to 1 dl 1708731498 ref 1 fl Rpc:XQr/0/ffffffff rc 0/-1 job:'' [1923353.786248] Lustre: 47188:0:(client.c:2295:ptlrpc_expire_one_request()) Skipped 1 previous similar message [1923379.730685] LNetError: 27867:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) route to o2ib3 through 10.0.10.235@o2ib7 has gone from down to up [1923393.299912] LustreError: 47086:0:(ldlm_lib.c:3544:target_bulk_io()) @@@ Reconnect on bulk READ req@ffff9e205b653600 x1790912645482048/t0(0) o3->71e6e20b-ea06-46cd-9b26-e9de2b2ddc67@10.51.17.18@o2ib3:564/0 lens 488/440 e 0 to 0 dl 1708731664 ref 1 fl Interpret:/0/0 rc 0/0 job:'41462678' [1923408.008363] Lustre: fir-OST0099: Client bf7a8074-3ca5-4fb9-a6e5-0158def87257 (at 10.51.8.23@o2ib3) reconnecting [1923408.018621] Lustre: Skipped 53 previous similar messages [1923418.146943] Lustre: fir-OST009d: Bulk IO read error with 4ab90e2b-981e-4a28-aea4-1ae96b48a9d2 (at 10.51.12.24@o2ib3), client will retry: rc -110 [1923418.160061] Lustre: Skipped 44 previous similar messages [1923430.712904] LNetError: 27861:0:(o2iblnd_cb.c:3375:kiblnd_check_txs_locked()) Timed out tx: active_txs(WSQ:100), 50 seconds [1923430.724114] LNetError: 27861:0:(o2iblnd_cb.c:3375:kiblnd_check_txs_locked()) Skipped 10 previous similar messages [1923430.734676] LNetError: 27861:0:(o2iblnd_cb.c:3445:kiblnd_check_conns()) Timed out RDMA with 10.0.10.235@o2ib7 (0): c: 0, oc: 1, rc: 0 [1923430.746829] LNetError: 27861:0:(o2iblnd_cb.c:3445:kiblnd_check_conns()) Skipped 10 previous similar messages [1923430.759139] LustreError: 27861:0:(events.c:476:server_bulk_callback()) event type 5, status -103, desc ffff9e2f37fe0800 [1923430.770287] LustreError: 27861:0:(events.c:476:server_bulk_callback()) Skipped 58 previous similar messages [1923490.144732] LustreError: 46921:0:(sec.c:2543:sptlrpc_svc_unwrap_bulk()) @@@ truncated bulk GET 14680064(16777216) req@ffff9e2091071f80 x1790220989350784/t0(0) o4->a6954b6b-adc3-4047-8ae9-17e4aacadd03@10.51.18.21@o2ib3:602/0 lens 504/448 e 0 to 0 dl 1708731702 ref 1 fl Interpret:/0/0 rc 0/0 job:'41729527' [1923490.144735] LustreError: 47052:0:(ldlm_lib.c:3550:target_bulk_io()) @@@ network error on bulk READ req@ffff9e205c9b1680 x1790912645716800/t0(0) o3->71e6e20b-ea06-46cd-9b26-e9de2b2ddc67@10.51.17.18@o2ib3:602/0 lens 488/440 e 0 to 0 dl 1708731702 ref 1 fl Interpret:/0/0 rc 0/0 job:'41462678' [1923490.144740] LustreError: 47052:0:(ldlm_lib.c:3550:target_bulk_io()) Skipped 47 previous similar messages [1923533.714845] LNetError: 27869:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) route to o2ib3 through 10.0.10.235@o2ib7 has gone from down to up [1923778.143098] LustreError: 46748:0:(sec.c:2543:sptlrpc_svc_unwrap_bulk()) @@@ truncated bulk GET 14680064(16777216) req@ffff9deb04ea0d80 x1791627483126656/t0(0) o4->619f57f7-edb4-482a-b8a0-53c09260d1ca@10.51.3.34@o2ib3:85/0 lens 488/448 e 0 to 0 dl 1708731940 ref 1 fl Interpret:/0/0 rc 0/0 job:'41721494' [1923778.170084] LustreError: 46748:0:(sec.c:2543:sptlrpc_svc_unwrap_bulk()) Skipped 3 previous similar messages [1923795.298154] LustreError: 47086:0:(ldlm_lib.c:3544:target_bulk_io()) @@@ Reconnect on bulk READ req@ffff9e214f850000 x1789743989857024/t0(0) o3->e8bcad55-7eea-4b68-abdc-50bcc2c8d123@10.51.13.22@o2ib3:158/0 lens 488/440 e 0 to 0 dl 1708732013 ref 1 fl Interpret:/0/0 rc 0/0 job:'41723449' [1923814.710556] LNetError: 27869:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) route to o2ib3 through 10.0.10.235@o2ib7 has gone from down to up [1923826.141911] Lustre: fir-OST009f: Bulk IO write error with 59705636-2cb1-42cb-bbf8-85e34f706fc8 (at 10.51.13.23@o2ib3), client will retry: rc = -110 [1923826.155285] Lustre: Skipped 5 previous similar messages [1923865.708514] LNetError: 27866:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) route to o2ib3 through 10.0.10.235@o2ib7 has gone from down to up [1923917.691038] LNet: 27861:0:(o2iblnd_cb.c:1520:kiblnd_reconnect_peer()) Abort reconnection of 10.0.10.235@o2ib7: accepting [1923968.687632] LNet: 27861:0:(o2iblnd_cb.c:1520:kiblnd_reconnect_peer()) Abort reconnection of 10.0.10.235@o2ib7: accepting [1924005.296910] LustreError: 46775:0:(ldlm_lib.c:3534:target_bulk_io()) @@@ timeout on bulk READ after 100+1706808043s req@ffff9def5354da00 x1789429752938432/t0(0) o3->4ab90e2b-981e-4a28-aea4-1ae96b48a9d2@10.51.12.24@o2ib3:318/0 lens 488/440 e 2 to 0 dl 1708732173 ref 1 fl Interpret:/0/0 rc 0/0 job:'41693245' [1924008.287009] Lustre: fir-OST009f: Client 164d595f-7d2d-499f-ac5e-2c3d4496d2b2 (at 10.51.10.22@o2ib3) reconnecting [1924008.297360] Lustre: Skipped 68 previous similar messages [1924019.682059] LNetError: 27861:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) route to o2ib3 through 10.0.10.235@o2ib7 has gone from up to down [1924019.682092] Lustre: fir-OST009b: Bulk IO read error with 4ab90e2b-981e-4a28-aea4-1ae96b48a9d2 (at 10.51.12.24@o2ib3), client will retry: rc -110 [1924019.682092] Lustre: Skipped 51 previous similar messages [1924019.713510] LNetError: 27861:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) Skipped 8 previous similar messages [1924121.675681] LNetError: 27861:0:(o2iblnd_cb.c:3375:kiblnd_check_txs_locked()) Timed out tx: tx_queue(WSQ:101), 51 seconds [1924121.686713] LNetError: 27861:0:(o2iblnd_cb.c:3375:kiblnd_check_txs_locked()) Skipped 11 previous similar messages [1924121.697144] LNetError: 27861:0:(o2iblnd_cb.c:3445:kiblnd_check_conns()) Timed out RDMA with 10.0.10.235@o2ib7 (0): c: 0, oc: 3, rc: 3 [1924121.709298] LNetError: 27861:0:(o2iblnd_cb.c:3445:kiblnd_check_conns()) Skipped 11 previous similar messages [1924121.720408] LustreError: 27861:0:(events.c:476:server_bulk_callback()) event type 5, status -103, desc ffff9df616294400 [1924121.732079] LustreError: 27861:0:(events.c:476:server_bulk_callback()) Skipped 69 previous similar messages [1924138.139851] LustreError: 47079:0:(sec.c:2543:sptlrpc_svc_unwrap_bulk()) @@@ truncated bulk GET 14680064(16777216) req@ffff9dedc9630480 x1790220994318912/t0(0) o4->a6954b6b-adc3-4047-8ae9-17e4aacadd03@10.51.18.21@o2ib3:456/0 lens 488/448 e 1 to 0 dl 1708732311 ref 1 fl Interpret:/0/0 rc 0/0 job:'41729524' [1924138.139855] LustreError: 47077:0:(ldlm_lib.c:3550:target_bulk_io()) @@@ network error on bulk READ req@ffff9dedc9631b00 x1789469866132992/t0(0) o3->bf7a8074-3ca5-4fb9-a6e5-0158def87257@10.51.8.23@o2ib3:456/0 lens 488/440 e 1 to 0 dl 1708732311 ref 1 fl Interpret:/0/0 rc 0/0 job:'41668593' [1924138.139862] LustreError: 47077:0:(ldlm_lib.c:3550:target_bulk_io()) Skipped 43 previous similar messages [1924138.202855] LustreError: 47079:0:(sec.c:2543:sptlrpc_svc_unwrap_bulk()) Skipped 8 previous similar messages [1924338.504013] LustreError: 47226:0:(ldlm_lib.c:3544:target_bulk_io()) @@@ Reconnect on bulk READ req@ffff9e21387f3f00 x1791486214710720/t0(0) o3->164d595f-7d2d-499f-ac5e-2c3d4496d2b2@10.51.10.22@o2ib3:30/0 lens 488/440 e 0 to 0 dl 1708732640 ref 1 fl Interpret:/0/0 rc 0/0 job:'41659331' [1924338.529433] LustreError: 47226:0:(ldlm_lib.c:3544:target_bulk_io()) Skipped 4 previous similar messages [1924416.663965] LNet: 27861:0:(o2iblnd_cb.c:1520:kiblnd_reconnect_peer()) Abort reconnection of 10.0.10.235@o2ib7: accepting [1924569.659225] LNetError: 27866:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) route to o2ib3 through 10.0.10.235@o2ib7 has gone from down to up [1924570.137608] Lustre: fir-OST0099: Bulk IO write error with e4173a19-6364-4ed8-9ad0-6f93a55bf401 (at 10.51.6.67@o2ib3), client will retry: rc = -110 [1924570.151250] Lustre: Skipped 14 previous similar messages [1924621.649678] LNetError: 27826:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) route to o2ib3 through 10.0.10.235@o2ib7 has gone from up to down [1924621.662541] LNetError: 27826:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) Skipped 10 previous similar messages [1924621.675050] LNetError: 27866:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) route to o2ib3 through 10.0.10.235@o2ib7 has gone from down to up [1924642.136384] Lustre: fir-OST009f: Bulk IO read error with 5f4f196f-951c-4adb-a689-4c15dbc03750 (at 10.51.6.50@o2ib3), client will retry: rc -110 [1924642.149416] Lustre: Skipped 39 previous similar messages [1924645.989683] Lustre: fir-OST009d: Client fc65bdaa-5c1e-406c-b1e3-0fc23f2bee0a (at 10.51.9.65@o2ib3) reconnecting [1924645.999943] Lustre: Skipped 45 previous similar messages [1924672.656635] LNetError: 27869:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) route to o2ib3 through 10.0.10.235@o2ib7 has gone from down to up [1924690.134767] LustreError: 47200:0:(sec.c:2543:sptlrpc_svc_unwrap_bulk()) @@@ truncated bulk GET 10485760(12582912) req@ffff9e2af0052880 x1790087354449984/t0(0) o4->a9f90e70-2241-493b-8cc7-5218cf930bb2@10.51.10.40@o2ib3:283/0 lens 488/448 e 0 to 0 dl 1708732893 ref 1 fl Interpret:/0/0 rc 0/0 job:'41566195' [1924690.161934] LustreError: 47200:0:(sec.c:2543:sptlrpc_svc_unwrap_bulk()) Skipped 3 previous similar messages [1924697.669698] Lustre: 46826:0:(client.c:2295:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1708732714/real 1708732714] req@ffff9e2059906c00 x1789761358227712/t0(0) o106->fir-OST009f@10.51.6.31@o2ib3:15/16 lens 328/280 e 0 to 1 dl 1708732842 ref 1 fl Rpc:XQr/0/ffffffff rc 0/-1 job:'' [1924723.643299] LNetError: 27861:0:(o2iblnd_cb.c:3375:kiblnd_check_txs_locked()) Timed out tx: tx_queue(WSQ:001), 50 seconds [1924723.654328] LNetError: 27861:0:(o2iblnd_cb.c:3375:kiblnd_check_txs_locked()) Skipped 10 previous similar messages [1924723.664758] LNetError: 27861:0:(o2iblnd_cb.c:3445:kiblnd_check_conns()) Timed out RDMA with 10.0.10.235@o2ib7 (0): c: 0, oc: 3, rc: 4 [1924723.676913] LNetError: 27861:0:(o2iblnd_cb.c:3445:kiblnd_check_conns()) Skipped 10 previous similar messages [1924723.687834] LustreError: 27861:0:(events.c:476:server_bulk_callback()) event type 5, status -103, desc ffff9dfc3f575000 [1924723.699046] LustreError: 27861:0:(events.c:476:server_bulk_callback()) Skipped 55 previous similar messages [1924738.134544] LustreError: 47017:0:(ldlm_lib.c:3550:target_bulk_io()) @@@ network error on bulk READ req@ffff9e209977de80 x1791102601677120/t0(0) o3->13d75fab-3a0f-415b-a7d0-557db9681583@10.51.6.37@o2ib3:281/0 lens 488/440 e 0 to 0 dl 1708732891 ref 1 fl Interpret:/0/0 rc 0/0 job:'sh03-06n37:356699:java' [1924738.161526] LustreError: 47017:0:(ldlm_lib.c:3550:target_bulk_io()) Skipped 40 previous similar messages [1924953.912048] Lustre: fir-OST009b: haven't heard from client 4b0b0bcf-84cc-461f-af51-d7be81883d91 (at 10.51.13.4@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e03b1013400, cur 1708733099 expire 1708732949 last 1708732872 [1924953.933916] Lustre: Skipped 3 previous similar messages [1925011.180835] LustreError: 47042:0:(ldlm_lib.c:3534:target_bulk_io()) @@@ timeout on bulk READ after 100+1706808043s req@ffff9deb61b66300 x1790912649669248/t0(0) o3->71e6e20b-ea06-46cd-9b26-e9de2b2ddc67@10.51.17.18@o2ib3:569/0 lens 488/440 e 2 to 0 dl 1708733179 ref 1 fl Interpret:/0/0 rc 0/0 job:'sh03-17n18:374083:bands.x' [1925011.209559] LustreError: 47042:0:(ldlm_lib.c:3534:target_bulk_io()) Skipped 2 previous similar messages [1925242.143406] Lustre: fir-OST009d: Bulk IO read error with 13d75fab-3a0f-415b-a7d0-557db9681583 (at 10.51.6.37@o2ib3), client will retry: rc -110 [1925242.156561] Lustre: Skipped 39 previous similar messages [1925256.106317] Lustre: fir-OST009d: Client 71e6e20b-ea06-46cd-9b26-e9de2b2ddc67 (at 10.51.17.18@o2ib3) reconnecting [1925256.116658] Lustre: Skipped 71 previous similar messages [1925261.615402] LNetError: 27861:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) route to o2ib3 through 10.0.10.235@o2ib7 has gone from up to down [1925261.628328] LNetError: 27861:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) Skipped 11 previous similar messages [1925325.610848] LNetError: 27861:0:(o2iblnd_cb.c:3375:kiblnd_check_txs_locked()) Timed out tx: active_txs(WSQ:100), 49 seconds [1925325.622052] LNetError: 27861:0:(o2iblnd_cb.c:3375:kiblnd_check_txs_locked()) Skipped 9 previous similar messages [1925325.632394] LNetError: 27861:0:(o2iblnd_cb.c:3445:kiblnd_check_conns()) Timed out RDMA with 10.0.10.235@o2ib7 (0): c: 2, oc: 2, rc: 3 [1925325.644548] LNetError: 27861:0:(o2iblnd_cb.c:3445:kiblnd_check_conns()) Skipped 9 previous similar messages [1925325.655330] LustreError: 27861:0:(events.c:476:server_bulk_callback()) event type 5, status -103, desc ffff9e3a1f650400 [1925325.666293] LustreError: 27861:0:(events.c:476:server_bulk_callback()) Skipped 50 previous similar messages [1925338.140214] LustreError: 46944:0:(ldlm_lib.c:3550:target_bulk_io()) @@@ network error on bulk READ req@ffff9e2058950000 x1790084456257920/t0(0) o3->4eeca784-fc05-4603-96af-6e0e6faaba83@10.51.6.41@o2ib3:206/0 lens 488/440 e 0 to 0 dl 1708733571 ref 1 fl Interpret:/0/0 rc 0/0 job:'41704441' [1925338.165994] LustreError: 46944:0:(ldlm_lib.c:3550:target_bulk_io()) Skipped 41 previous similar messages [1925516.160623] Lustre: 47072:0:(client.c:2295:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1708733533/real 1708733533] req@ffff9ded58fa5580 x1789761372497856/t0(0) o105->fir-OST009b@10.51.6.33@o2ib3:15/16 lens 392/224 e 0 to 1 dl 1708733661 ref 1 fl Rpc:XQr/0/ffffffff rc 0/-1 job:'' [1925657.603401] LNetError: 27867:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) route to o2ib3 through 10.0.10.235@o2ib7 has gone from down to up [1925683.599584] Lustre: 46883:0:(client.c:2295:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1708733700/real 1708733700] req@ffff9dedc8e75100 x1789761375983552/t0(0) o106->fir-OST009b@10.51.13.17@o2ib3:15/16 lens 328/280 e 0 to 1 dl 1708733828 ref 1 fl Rpc:XQr/0/ffffffff rc 0/-1 job:'' [1925709.618240] LNetError: 27869:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) route to o2ib3 through 10.0.10.235@o2ib7 has gone from down to up [1925760.597253] LNetError: 27866:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) route to o2ib3 through 10.0.10.235@o2ib7 has gone from down to up [1925811.592710] LNetError: 27869:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) route to o2ib3 through 10.0.10.235@o2ib7 has gone from down to up [1925842.146877] Lustre: fir-OST009f: Bulk IO read error with dae97147-55d6-4796-84ec-1e99cc9991d8 (at 10.51.11.17@o2ib3), client will retry: rc -110 [1925842.159990] Lustre: Skipped 44 previous similar messages [1925848.605711] LustreError: 47200:0:(ldlm_lib.c:3544:target_bulk_io()) @@@ Reconnect on bulk READ req@ffff9dea6fe2d100 x1791494056715904/t0(0) o3->5f4f196f-951c-4adb-a689-4c15dbc03750@10.51.6.50@o2ib3:701/0 lens 488/440 e 0 to 0 dl 1708734066 ref 1 fl Interpret:/0/0 rc 0/0 job:'41734304' [1925862.582991] LNetError: 27861:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) route to o2ib3 through 10.0.10.235@o2ib7 has gone from up to down [1925862.595969] LNetError: 27861:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) Skipped 11 previous similar messages [1925888.613972] Lustre: fir-OST009f: Client 0f777384-4371-4e75-91a8-acc288be2fbe (at 10.51.4.47@o2ib3) reconnecting [1925888.613972] Lustre: fir-OST0099: Client 0f777384-4371-4e75-91a8-acc288be2fbe (at 10.51.4.47@o2ib3) reconnecting [1925888.613975] Lustre: Skipped 67 previous similar messages [1925888.639964] Lustre: Skipped 1 previous similar message [1925938.144879] LustreError: 47029:0:(ldlm_lib.c:3550:target_bulk_io()) @@@ network error on bulk READ req@ffff9def642bf980 x1791628021951808/t0(0) o3->4aa74ffc-c0c2-48be-b211-c402b2fb97cd@10.51.7.62@o2ib3:730/0 lens 11224/440 e 0 to 0 dl 1708734095 ref 1 fl Interpret:/0/0 rc 0/0 job:'sh03-07n62:436912:mcflirt' [1925938.172471] LustreError: 47029:0:(ldlm_lib.c:3550:target_bulk_io()) Skipped 44 previous similar messages [1925977.575723] LNetError: 27861:0:(o2iblnd_cb.c:3375:kiblnd_check_txs_locked()) Timed out tx: active_txs(WSQ:100), 49 seconds [1925977.587082] LNetError: 27861:0:(o2iblnd_cb.c:3375:kiblnd_check_txs_locked()) Skipped 11 previous similar messages [1925977.597512] LNetError: 27861:0:(o2iblnd_cb.c:3445:kiblnd_check_conns()) Timed out RDMA with 10.0.10.235@o2ib7 (0): c: 0, oc: 0, rc: 4 [1925977.609666] LNetError: 27861:0:(o2iblnd_cb.c:3445:kiblnd_check_conns()) Skipped 11 previous similar messages [1925977.620610] LustreError: 27861:0:(events.c:476:server_bulk_callback()) event type 5, status -103, desc ffff9e3e8fab6000 [1925977.631598] LustreError: 27861:0:(events.c:476:server_bulk_callback()) Skipped 62 previous similar messages [1926001.153428] LustreError: 47235:0:(ldlm_lib.c:3544:target_bulk_io()) @@@ Reconnect on bulk READ req@ffff9dedec7bad00 x1791494057681472/t0(0) o3->5f4f196f-951c-4adb-a689-4c15dbc03750@10.51.6.50@o2ib3:153/0 lens 488/440 e 0 to 0 dl 1708734273 ref 1 fl Interpret:/0/0 rc 0/0 job:'41734300' [1926036.873772] Lustre: fir-OST0099: haven't heard from client d497bee3-3e61-4981-a0b0-c98bd364e29a (at 10.51.9.17@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e33d5d9e800, cur 1708734182 expire 1708734032 last 1708733955 [1926036.896123] Lustre: Skipped 3 previous similar messages [1926046.872069] Lustre: fir-OST009d: haven't heard from client d497bee3-3e61-4981-a0b0-c98bd364e29a (at 10.51.9.17@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e2f74165800, cur 1708734192 expire 1708734042 last 1708733965 [1926046.893944] Lustre: Skipped 2 previous similar messages [1926106.144791] LustreError: 47086:0:(sec.c:2543:sptlrpc_svc_unwrap_bulk()) @@@ truncated bulk GET 14680064(16777216) req@ffff9def794b8d80 x1788590228290624/t0(0) o4->22fc3557-1b59-4be1-9b06-a6babf0eda5a@10.51.0.65@o2ib3:146/0 lens 488/448 e 0 to 0 dl 1708734266 ref 1 fl Interpret:/0/0 rc 0/0 job:'sh03-ln05:337031:cp' [1926106.144846] Lustre: fir-OST009b: Bulk IO write error with 22fc3557-1b59-4be1-9b06-a6babf0eda5a (at 10.51.0.65@o2ib3), client will retry: rc = -110 [1926106.144848] Lustre: Skipped 5 previous similar messages [1926106.191758] LustreError: 47086:0:(sec.c:2543:sptlrpc_svc_unwrap_bulk()) Skipped 6 previous similar messages [1926148.278499] LustreError: 44052:0:(ldlm_lockd.c:261:expired_lock_main()) ### lock callback timer expired after 100s: evicting client at 10.51.6.31@o2ib3 ns: filter-fir-OST009b_UUID lock: ffff9dec0a56cec0/0xa96a836f66396f48 lrc: 4/0,0 mode: PR/PR res: [0x29c0000402:0x1c5485c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1073741824->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.51.6.31@o2ib3 remote: 0x8410bc9ab6e93536 expref: 11 pid: 47127 timeout: 1926250 lvb_type: 1 [1926148.322221] LustreError: 47127:0:(ldlm_lockd.c:1427:ldlm_handle_enqueue0()) ### lock on destroyed export ffff9df995e87400 ns: filter-fir-OST009b_UUID lock: ffff9dec0a56b3c0/0xa96a836f66396f6b lrc: 3/0,0 mode: --/PW res: [0x29c0000402:0x1c5485c:0x0].0x0 rrc: 3 type: EXT [1073741824->18446744073709551615] (req 1073741824->18446744073709551615) gid 0 flags: 0x50000000020000 nid: 10.51.6.31@o2ib3 remote: 0x8410bc9ab6e935bb expref: 11 pid: 47127 timeout: 0 lvb_type: 0 [1926169.567341] Lustre: 47145:0:(client.c:2295:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1708734186/real 1708734186] req@ffff9de9e7b40d80 x1789761385831296/t0(0) o106->fir-OST009d@10.51.6.34@o2ib3:15/16 lens 328/280 e 0 to 1 dl 1708734314 ref 1 fl Rpc:XQr/0/ffffffff rc 0/-1 job:'' [1926352.232501] LustreError: 47229:0:(ldlm_lib.c:3544:target_bulk_io()) @@@ Reconnect on bulk WRITE req@ffff9dec2c8b2880 x1790834896942016/t0(0) o4->eda6850e-7e53-4dd3-9614-a2c217b19fd6@10.51.10.24@o2ib3:504/0 lens 488/448 e 0 to 0 dl 1708734624 ref 1 fl Interpret:/0/0 rc 0/0 job:'41661761' [1926352.258098] LustreError: 47229:0:(ldlm_lib.c:3544:target_bulk_io()) Skipped 1 previous similar message [1926352.267591] Lustre: fir-OST0099: Bulk IO write error with eda6850e-7e53-4dd3-9614-a2c217b19fd6 (at 10.51.10.24@o2ib3), client will retry: rc = -110 [1926352.280959] Lustre: Skipped 2 previous similar messages [1926418.142991] LustreError: 46834:0:(sec.c:2543:sptlrpc_svc_unwrap_bulk()) @@@ truncated bulk GET 10485760(12582912) req@ffff9e265b44c380 x1791293281554368/t0(0) o4->59705636-2cb1-42cb-bbf8-85e34f706fc8@10.51.13.23@o2ib3:500/0 lens 488/448 e 0 to 0 dl 1708734620 ref 1 fl Interpret:/0/0 rc 0/0 job:'41734317' [1926418.170594] LustreError: 46834:0:(sec.c:2543:sptlrpc_svc_unwrap_bulk()) Skipped 2 previous similar messages [1926451.555887] LNetError: 27866:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) route to o2ib3 through 10.0.10.235@o2ib7 has gone from down to up [1926466.140518] Lustre: fir-OST009b: Bulk IO read error with a6954b6b-adc3-4047-8ae9-17e4aacadd03 (at 10.51.18.21@o2ib3), client will retry: rc -110 [1926466.153634] Lustre: Skipped 44 previous similar messages [1926466.830794] Lustre: fir-OST009d: haven't heard from client b798f913-16bc-49a8-b607-197c630ee2dc (at 10.51.9.19@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e41d6376c00, cur 1708734612 expire 1708734462 last 1708734385 [1926497.686191] Lustre: fir-OST009d: Client 495dc22c-8a95-4c40-b650-3d56b65db6dd (at 10.51.7.51@o2ib3) reconnecting [1926497.696449] Lustre: Skipped 57 previous similar messages [1926502.548369] LNetError: 27861:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) route to o2ib3 through 10.0.10.235@o2ib7 has gone from up to down [1926502.561225] LNetError: 27861:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) Skipped 14 previous similar messages [1926562.138271] LustreError: 46967:0:(ldlm_lib.c:3550:target_bulk_io()) @@@ network error on bulk READ req@ffff9df9d9173180 x1790831114971776/t0(0) o3->6a9e419c-4303-4adc-8d3f-fb97f168d201@10.51.10.41@o2ib3:613/0 lens 488/440 e 1 to 0 dl 1708734733 ref 1 fl Interpret:/0/0 rc 0/0 job:'40661017' [1926562.164293] LustreError: 46967:0:(ldlm_lib.c:3550:target_bulk_io()) Skipped 38 previous similar messages [1926579.544345] LNetError: 27861:0:(o2iblnd_cb.c:3375:kiblnd_check_txs_locked()) Timed out tx: active_txs(WSQ:100), 50 seconds [1926579.555730] LNetError: 27861:0:(o2iblnd_cb.c:3375:kiblnd_check_txs_locked()) Skipped 9 previous similar messages [1926579.566070] LNetError: 27861:0:(o2iblnd_cb.c:3445:kiblnd_check_conns()) Timed out RDMA with 10.0.10.235@o2ib7 (0): c: 2, oc: 1, rc: 2 [1926579.578225] LNetError: 27861:0:(o2iblnd_cb.c:3445:kiblnd_check_conns()) Skipped 9 previous similar messages [1926579.589122] LustreError: 27861:0:(events.c:476:server_bulk_callback()) event type 5, status -103, desc ffff9dee6bf14400 [1926579.600476] LustreError: 27861:0:(events.c:476:server_bulk_callback()) Skipped 46 previous similar messages [1926707.581435] Lustre: 47135:0:(client.c:2295:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1708734724/real 1708734724] req@ffff9e205b5f9680 x1789761394610112/t0(0) o106->fir-OST0099@10.51.8.26@o2ib3:15/16 lens 328/280 e 0 to 1 dl 1708734852 ref 1 fl Rpc:XQr/0/ffffffff rc 0/-1 job:'' [1926724.330535] LustreError: 46937:0:(ldlm_lib.c:3544:target_bulk_io()) @@@ Reconnect on bulk READ req@ffff9ded34ef1680 x1791628025705216/t0(0) o3->4aa74ffc-c0c2-48be-b211-c402b2fb97cd@10.51.7.62@o2ib3:121/0 lens 488/440 e 0 to 0 dl 1708734996 ref 1 fl Interpret:/0/0 rc 0/0 job:'sh03-07n62:436912:mcflirt' [1926724.330536] LustreError: 47032:0:(ldlm_lib.c:3544:target_bulk_io()) @@@ Reconnect on bulk READ req@ffff9e205b686c00 x1791628025705600/t0(0) o3->4aa74ffc-c0c2-48be-b211-c402b2fb97cd@10.51.7.62@o2ib3:121/0 lens 488/440 e 0 to 0 dl 1708734996 ref 1 fl Interpret:/0/0 rc 0/0 job:'sh03-07n62:436912:mcflirt' [1926724.330538] LustreError: 47032:0:(ldlm_lib.c:3544:target_bulk_io()) Skipped 1 previous similar message [1926724.393796] LustreError: 46937:0:(ldlm_lib.c:3544:target_bulk_io()) Skipped 4 previous similar messages [1926937.528127] LNet: 27861:0:(o2iblnd_cb.c:1520:kiblnd_reconnect_peer()) Abort reconnection of 10.0.10.235@o2ib7: accepting [1926946.139656] LustreError: 47088:0:(sec.c:2543:sptlrpc_svc_unwrap_bulk()) @@@ truncated bulk GET 14680064(16777216) req@ffff9e2af963f500 x1790221018057664/t0(0) o4->a6954b6b-adc3-4047-8ae9-17e4aacadd03@10.51.18.21@o2ib3:285/0 lens 488/448 e 0 to 0 dl 1708735160 ref 1 fl Interpret:/0/0 rc 0/0 job:'41729554' [1926946.166838] Lustre: fir-OST009b: Bulk IO write error with a6954b6b-adc3-4047-8ae9-17e4aacadd03 (at 10.51.18.21@o2ib3), client will retry: rc = -110 [1926946.180207] Lustre: Skipped 3 previous similar messages [1926989.527079] LNetError: 27868:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) route to o2ib3 through 10.0.10.235@o2ib7 has gone from down to up [1927016.141843] Lustre: 46823:0:(client.c:2295:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1708735033/real 1708735033] req@ffff9e2090248d80 x1789761399521728/t0(0) o106->fir-OST009b@10.51.7.13@o2ib3:15/16 lens 328/280 e 0 to 1 dl 1708735161 ref 1 fl Rpc:XQr/0/ffffffff rc 0/-1 job:'' [1927037.574701] LustreError: 44052:0:(ldlm_lockd.c:261:expired_lock_main()) ### lock callback timer expired after 100s: evicting client at 10.51.2.12@o2ib3 ns: filter-fir-OST009d_UUID lock: ffff9e299714d100/0xa96a836f666e31dd lrc: 4/0,0 mode: PR/PR res: [0x2a40000400:0xd2aae1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x60000400010020 nid: 10.51.2.12@o2ib3 remote: 0xdc15f72832e98d7e expref: 260 pid: 46734 timeout: 1927139 lvb_type: 1 [1927037.616720] LustreError: 47050:0:(ldlm_lockd.c:1427:ldlm_handle_enqueue0()) ### lock on destroyed export ffff9e4203e0c000 ns: filter-fir-OST009d_UUID lock: ffff9e2176dd72c0/0xa96a836f666e31c1 lrc: 3/0,0 mode: --/PW res: [0x2a40000400:0xd2aaf9:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50000080020000 nid: 10.51.2.12@o2ib3 remote: 0xdc15f72832e98972 expref: 260 pid: 47050 timeout: 0 lvb_type: 0 [1927037.654017] LustreError: 47050:0:(ldlm_lockd.c:1427:ldlm_handle_enqueue0()) Skipped 1 previous similar message [1927065.522176] Lustre: 44048:0:(client.c:2295:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1708735082/real 1708735082] req@ffff9e20589ea880 x1789761401000448/t0(0) o105->fir-OST009f@10.51.2.12@o2ib3:15/16 lens 392/224 e 0 to 1 dl 1708735210 ref 1 fl Rpc:XQr/0/ffffffff rc 0/-1 job:'' [1927066.141182] Lustre: fir-OST009d: Bulk IO read error with 3e7b2386-1e44-41a6-a2be-fe9573e9646a (at 10.51.9.72@o2ib3), client will retry: rc -110 [1927066.154215] Lustre: Skipped 53 previous similar messages [1927108.184696] Lustre: fir-OST009b: Client e0fb1cab-86dc-4707-b14a-e6b7efd03861 (at 10.51.4.48@o2ib3) reconnecting [1927108.195142] Lustre: Skipped 70 previous similar messages [1927168.512527] LustreError: 46748:0:(ldlm_lib.c:3550:target_bulk_io()) @@@ network error on bulk READ req@ffff9dee003b7500 x1791229432378688/t0(0) o3->8a7c7b8b-bd48-4064-b12d-1c83f5a33997@10.51.12.7@o2ib3:481/0 lens 488/440 e 0 to 0 dl 1708735356 ref 1 fl Interpret:/2/0 rc 0/0 job:'41748309' [1927168.512541] LNetError: 27861:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) route to o2ib3 through 10.0.10.235@o2ib7 has gone from up to down [1927168.512543] LNetError: 27861:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) Skipped 16 previous similar messages [1927168.561650] LustreError: 46748:0:(ldlm_lib.c:3550:target_bulk_io()) Skipped 46 previous similar messages [1927245.507454] LNetError: 27861:0:(o2iblnd_cb.c:3375:kiblnd_check_txs_locked()) Timed out tx: tx_queue(WSQ:001), 57 seconds [1927245.518488] LNetError: 27861:0:(o2iblnd_cb.c:3375:kiblnd_check_txs_locked()) Skipped 10 previous similar messages [1927245.528918] LNetError: 27861:0:(o2iblnd_cb.c:3445:kiblnd_check_conns()) Timed out RDMA with 10.0.10.235@o2ib7 (0): c: 0, oc: 0, rc: 2 [1927245.541073] LNetError: 27861:0:(o2iblnd_cb.c:3445:kiblnd_check_conns()) Skipped 10 previous similar messages [1927245.551959] LustreError: 27861:0:(events.c:476:server_bulk_callback()) event type 5, status -103, desc ffff9e426b2f8800 [1927245.562914] LustreError: 27861:0:(events.c:476:server_bulk_callback()) Skipped 61 previous similar messages [1927437.098873] LustreError: 137-5: fir-OST0098_UUID: not available for connect from 10.51.9.19@o2ib3 (no target). If you are running an HA pair check that the target is mounted on the other server. [1927437.116346] LustreError: Skipped 3 previous similar messages [1927437.309108] LustreError: 47066:0:(ldlm_lib.c:3544:target_bulk_io()) @@@ Reconnect on bulk READ req@ffff9e209044c800 x1789470076109184/t0(0) o3->bf7a8074-3ca5-4fb9-a6e5-0158def87257@10.51.8.23@o2ib3:79/0 lens 488/440 e 0 to 0 dl 1708735709 ref 1 fl Interpret:/0/0 rc 0/0 job:'41668593' [1927666.141686] LustreError: 47234:0:(sec.c:2543:sptlrpc_svc_unwrap_bulk()) @@@ truncated bulk GET 14680064(16777216) req@ffff9e211a6fc800 x1790902818629312/t0(0) o4->1d850104-6371-464e-95e9-6aad3f31833d@10.51.6.62@o2ib3:196/0 lens 488/448 e 0 to 0 dl 1708735826 ref 1 fl Interpret:/0/0 rc 0/0 job:'41687943' [1927666.168812] Lustre: fir-OST009d: Bulk IO write error with 1d850104-6371-464e-95e9-6aad3f31833d (at 10.51.6.62@o2ib3), client will retry: rc = -110 [1927667.485710] Lustre: fir-OST0099: Bulk IO read error with cda3e937-5b14-4083-88ce-9aba4e2547d1 (at 10.51.2.31@o2ib3), client will retry: rc -110 [1927667.498742] Lustre: Skipped 41 previous similar messages [1927720.921950] Lustre: fir-OST0099: Client 4281e4e1-f9a3-45d6-9cd0-c6decfc604f6 (at 10.51.0.71@o2ib3) reconnecting [1927720.932394] Lustre: Skipped 60 previous similar messages [1927782.479381] LNetError: 27861:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) route to o2ib3 through 10.0.10.235@o2ib7 has gone from up to down [1927782.492240] LNetError: 27861:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) Skipped 13 previous similar messages [1927786.144279] LustreError: 47009:0:(ldlm_lib.c:3550:target_bulk_io()) @@@ network error on bulk READ req@ffff9dec71649b00 x1789660160579456/t0(0) o3->3e7b2386-1e44-41a6-a2be-fe9573e9646a@10.51.9.72@o2ib3:355/0 lens 488/440 e 0 to 0 dl 1708735985 ref 1 fl Interpret:/0/0 rc 0/0 job:'41748383' [1927786.170043] LustreError: 47009:0:(ldlm_lib.c:3550:target_bulk_io()) Skipped 43 previous similar messages [1927846.475017] LNetError: 27861:0:(o2iblnd_cb.c:3375:kiblnd_check_txs_locked()) Timed out tx: active_txs(WSQ:100), 57 seconds [1927846.486513] LNetError: 27861:0:(o2iblnd_cb.c:3375:kiblnd_check_txs_locked()) Skipped 9 previous similar messages [1927846.496855] LNetError: 27861:0:(o2iblnd_cb.c:3445:kiblnd_check_conns()) Timed out RDMA with 10.0.10.235@o2ib7 (0): c: 0, oc: 0, rc: 3 [1927846.509010] LNetError: 27861:0:(o2iblnd_cb.c:3445:kiblnd_check_conns()) Skipped 9 previous similar messages [1927846.519905] LustreError: 27861:0:(events.c:476:server_bulk_callback()) event type 5, status -103, desc ffff9e33c07a7800 [1927846.530861] LustreError: 27861:0:(events.c:476:server_bulk_callback()) Skipped 52 previous similar messages [1928273.053993] LustreError: 47087:0:(ldlm_lib.c:3544:target_bulk_io()) @@@ Reconnect on bulk READ req@ffff9e208fce4c80 x1789470078929664/t0(0) o3->bf7a8074-3ca5-4fb9-a6e5-0158def87257@10.51.8.23@o2ib3:159/0 lens 488/440 e 0 to 0 dl 1708736544 ref 1 fl Interpret:/0/0 rc 0/0 job:'41668593' [1928273.079421] LustreError: 47087:0:(ldlm_lib.c:3544:target_bulk_io()) Skipped 2 previous similar messages [1928307.451089] Lustre: fir-OST009f: Bulk IO read error with bf7a8074-3ca5-4fb9-a6e5-0158def87257 (at 10.51.8.23@o2ib3), client will retry: rc -110 [1928307.464121] Lustre: Skipped 50 previous similar messages [1928323.745450] Lustre: fir-OST009d: Client a742e851-96fb-4676-8566-d5ed8370074d (at 10.51.8.31@o2ib3) reconnecting [1928323.755710] Lustre: Skipped 64 previous similar messages [1928386.144718] LustreError: 46751:0:(ldlm_lib.c:3550:target_bulk_io()) @@@ network error on bulk READ req@ffff9dec2c249680 x1791494066822208/t0(0) o3->5f4f196f-951c-4adb-a689-4c15dbc03750@10.51.6.50@o2ib3:161/0 lens 488/440 e 0 to 0 dl 1708736546 ref 1 fl Interpret:/0/0 rc 0/0 job:'41734304' [1928386.170491] LustreError: 46751:0:(ldlm_lib.c:3550:target_bulk_io()) Skipped 45 previous similar messages [1928428.603642] LustreError: 44052:0:(ldlm_lockd.c:261:expired_lock_main()) ### lock callback timer expired after 100s: evicting client at 10.51.10.39@o2ib3 ns: filter-fir-OST009b_UUID lock: ffff9dea5b2f5e80/0xa96a836f66b22a40 lrc: 4/0,0 mode: PW/PW res: [0x29c0000402:0x1daef68:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->6750207) gid 0 flags: 0x60000400030020 nid: 10.51.10.39@o2ib3 remote: 0xdd02b506ebdfd416 expref: 17 pid: 46885 timeout: 1928530 lvb_type: 0 [1928428.646128] LustreError: 44052:0:(ldlm_lockd.c:261:expired_lock_main()) Skipped 1 previous similar message [1928429.562577] LustreError: 47200:0:(ldlm_lib.c:3538:target_bulk_io()) @@@ Eviction on bulk READ req@ffff9deb60f8b180 x1790434277604864/t0(0) o3->de1c7312-0728-4b26-8a91-192b15c87ece@10.51.10.38@o2ib3:255/0 lens 488/440 e 0 to 0 dl 1708736640 ref 1 fl Interpret:/0/0 rc 0/0 job:'41750242' [1928435.444224] LNetError: 27861:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) route to o2ib3 through 10.0.10.235@o2ib7 has gone from up to down [1928435.457087] LNetError: 27861:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) Skipped 13 previous similar messages [1928499.439810] LNetError: 27861:0:(o2iblnd_cb.c:3375:kiblnd_check_txs_locked()) Timed out tx: active_txs(WSQ:100), 51 seconds [1928499.451019] LNetError: 27861:0:(o2iblnd_cb.c:3375:kiblnd_check_txs_locked()) Skipped 10 previous similar messages [1928499.461444] LNetError: 27861:0:(o2iblnd_cb.c:3445:kiblnd_check_conns()) Timed out RDMA with 10.0.10.235@o2ib7 (0): c: 5, oc: 2, rc: 5 [1928499.473785] LNetError: 27861:0:(o2iblnd_cb.c:3445:kiblnd_check_conns()) Skipped 10 previous similar messages [1928499.485127] LustreError: 27861:0:(events.c:476:server_bulk_callback()) event type 5, status -103, desc ffff9e020049bc00 [1928499.496298] LustreError: 27861:0:(events.c:476:server_bulk_callback()) Skipped 55 previous similar messages [1928563.440958] LNet: 27861:0:(o2iblnd_cb.c:1520:kiblnd_reconnect_peer()) Abort reconnection of 10.0.10.235@o2ib7: accepting [1928614.437858] LNet: 27861:0:(o2iblnd_cb.c:1520:kiblnd_reconnect_peer()) Abort reconnection of 10.0.10.235@o2ib7: accepting [1928614.450515] LNetError: 27867:0:(lib-lnet.h:1243:lnet_set_route_aliveness()) route to o2ib3 through 10.0.10.235@o2ib7 has gone from down to up [1928626.144897] LustreError: 47233:0:(sec.c:2543:sptlrpc_svc_unwrap_bulk()) @@@ truncated bulk GET 14680064(16777216) req@ffff9e2057d0cc80 x1790902819490496/t0(0) o4->1d850104-6371-464e-95e9-6aad3f31833d@10.51.6.62@o2ib3:396/0 lens 488/448 e 0 to 0 dl 1708736781 ref 1 fl Interpret:/0/0 rc 0/0 job:'41687943' [1928626.172094] LustreError: 47233:0:(sec.c:2543:sptlrpc_svc_unwrap_bulk()) Skipped 3 previous similar messages [1928626.182044] Lustre: fir-OST009b: Bulk IO write error with 1d850104-6371-464e-95e9-6aad3f31833d (at 10.51.6.62@o2ib3), client will retry: rc = -110 [1928626.195337] Lustre: Skipped 3 previous similar messages [1928674.862358] LustreError: 44052:0:(ldlm_lockd.c:261:expired_lock_main()) ### lock callback timer expired after 101s: evicting client at 10.51.13.17@o2ib3 ns: filter-fir-OST009f_UUID lock: ffff9e205b298000/0xa96a836f66d6d1d5 lrc: 3/0,0 mode: PR/PR res: [0x2ac0000400:0x1e140c0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1073741824->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 10.51.13.17@o2ib3 remote: 0x44562c5b5f65e93f expref: 110 pid: 47083 timeout: 1928776 lvb_type: 1 [1928674.906159] LustreError: 44052:0:(ldlm_lockd.c:261:expired_lock_main()) Skipped 1 previous similar message [1928857.424971] LNet: 27861:0:(o2iblnd_cb.c:1520:kiblnd_reconnect_peer()) Abort reconnection of 10.0.10.235@o2ib7: accepting [1928884.701283] Lustre: fir-OST009b: haven't heard from client afe42fff-51c4-4ade-9a2a-e13afd6ee1b4 (at 10.51.12.14@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e3fd0995000, cur 1708737030 expire 1708736880 last 1708736803 [1928884.723391] Lustre: Skipped 3 previous similar messages [1928889.713824] Lustre: fir-OST0099: haven't heard from client afe42fff-51c4-4ade-9a2a-e13afd6ee1b4 (at 10.51.12.14@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e2f3dcdc400, cur 1708737035 expire 1708736885 last 1708736808 [1928894.710541] Lustre: fir-OST009d: haven't heard from client afe42fff-51c4-4ade-9a2a-e13afd6ee1b4 (at 10.51.12.14@o2ib3) in 227 seconds. I think it's dead, and I am evicting it. exp ffff9e40f8955400, cur 1708737040 expire 1708736890 last 1708736813 [1928909.418709] Lustre: fir-OST0099: Bulk IO read error with 13b41e84-d040-4a81-8804-171135a5ca68 (at 10.51.14.12@o2ib3), client will retry: rc -110 [1928909.431824] Lustre: Skipped 46 previous similar messages [1928922.657005] LustreError: 44052:0:(ldlm_lockd.c:261:expired_lock_main()) ### lock callback timer expired after 100s: evicting client at 10.51.10.38@o2ib3 ns: filter-fir-OST009f_UUID lock: ffff9e292b11e540/0xa96a836f66e96b33 lrc: 3/0,0 mode: PW/PW res: [0x2ac0000400:0x1e13a4b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4259839) gid 0 flags: 0x60000400020020 nid: 10.51.10.38@o2ib3 remote: 0xc0aaf00bc9c529b4 expref: 44 pid: 47188 timeout: 1929024 lvb_type: 0 [1928922.699614] LustreError: 33995:0:(client.c:1256:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff9e215aab2400 x1789761432555520/t0(0) o105->fir-OST009f@10.51.10.38@o2ib3:15/16 lens 392/224 e 0 to 0 dl 0 ref 1 fl Rpc:QU/0/ffffffff rc 0/-1 job:'' [1928923.056984] LustreError: 46818:0:(ldlm_lib.c:3538:target_bulk_io()) @@@ Eviction on bulk READ req@ffff9e205b151f80 x1790434282424320/t0(0) o3->de1c7312-0728-4b26-8a91-192b15c87ece@10.51.10.38@o2ib3:9/0 lens 488/440 e 0 to 0 dl 1708737149 ref 1 fl Interpret:/0/0 rc 0/0 job:'41750242' [1928923.082396] LustreError: 46818:0:(ofd_io.c:1027:ofd_commitrw_read()) ASSERTION( ofd_object_exists(fo) ) failed: [1928923.092895] LustreError: 46818:0:(ofd_io.c:1027:ofd_commitrw_read()) LBUG [1928923.099873] Pid: 46818, comm: ll_ost_io01_031 3.10.0-1160.108.1.el7_lustre.pl1.x86_64 #1 SMP Fri Jan 26 11:26:38 PST 2024 [1928923.111132] Call Trace: [1928923.113781] [<0>] libcfs_call_trace+0x90/0xf0 [libcfs] [1928923.119107] [<0>] lbug_with_loc+0x4c/0xa0 [libcfs] [1928923.124079] [<0>] ofd_commitrw+0xd2a/0xd80 [ofd] [1928923.128901] [<0>] tgt_brw_read+0xa88/0x2030 [ptlrpc] [1928923.134058] [<0>] tgt_request_handle+0x93f/0x19d0 [ptlrpc] [1928923.139729] [<0>] ptlrpc_server_handle_request+0x253/0xc30 [ptlrpc] [1928923.146185] [<0>] ptlrpc_main+0xbf4/0x15e0 [ptlrpc] [1928923.151246] [<0>] kthread+0xd1/0xe0 [1928923.154921] [<0>] ret_from_fork_nospec_begin+0x7/0x21 [1928923.160178] [<0>] 0xfffffffffffffffe [1928923.163930] Kernel panic - not syncing: LBUG [1928923.168372] CPU: 26 PID: 46818 Comm: ll_ost_io01_031 Kdump: loaded Tainted: G OE ------------ 3.10.0-1160.108.1.el7_lustre.pl1.x86_64 #1 [1928923.181917] Hardware name: Dell Inc. PowerEdge R6525/07Y51T, BIOS 2.13.3 09/12/2023 [1928923.189741] Call Trace: [1928923.192369] [] dump_stack+0x19/0x1f [1928923.197681] [] panic+0xe8/0x21f [1928923.202836] [] lbug_with_loc+0x9b/0xa0 [libcfs] [1928923.209310] [] ofd_commitrw+0xd2a/0xd80 [ofd] [1928923.215493] [] ? wake_up_atomic_t+0x40/0x40 [1928923.221520] [] tgt_brw_read+0xa88/0x2030 [ptlrpc] [1928923.228053] [] ? ptl_send_buf+0x136/0x540 [ptlrpc] [1928923.234674] [] ? lustre_msg_add_version+0x27/0xb0 [ptlrpc] [1928923.241987] [] ? lustre_pack_reply_v2+0x142/0x2c0 [ptlrpc] [1928923.249302] [] ? lustre_pack_reply_flags+0x72/0x1f0 [ptlrpc] [1928923.256787] [] ? lustre_pack_reply+0x11/0x20 [ptlrpc] [1928923.263672] [] tgt_request_handle+0x93f/0x19d0 [ptlrpc] [1928923.270728] [] ? ptlrpc_nrs_req_get_nolock0+0xd5/0x170 [ptlrpc] [1928923.278463] [] ? ktime_get_real_seconds+0xe/0x20 [libcfs] [1928923.285694] [] ptlrpc_server_handle_request+0x253/0xc30 [ptlrpc] [1928923.293513] [] ? task_rq_unlock+0x20/0x20 [1928923.299346] [] ? __wake_up+0x13/0x20 [1928923.304758] [] ptlrpc_main+0xbf4/0x15e0 [ptlrpc] [1928923.311351] [] ? ptlrpc_wait_event+0x5d0/0x5d0 [ptlrpc] [1928923.318550] [] kthread+0xd1/0xe0 [1928923.323602] [] ? insert_kthread_work+0x40/0x40 [1928923.329868] [] ret_from_fork_nospec_begin+0x7/0x21 [1928923.336482] [] ? insert_kthread_work+0x40/0x40